At a CEO summit in the hallowed halls of Yale University, 42% of CEOs indicated that artificial intelligence (AI) could mean the end of humanity within ten years. These aren’t small business leaders: These are 119 CEOs from a cross-section of top companies, including Walmart CEO Doug McMillion, Coca-Cola CEO James Quincy, the leaders of IT companies like Xerox and Zoom, and CEOs of pharmaceuticals, media and manufacturing .

This is not a plot from a dystopian novel or a Hollywood blockbuster. It is a clear warning from the titans of industry who are shaping our future.

The extinction risk of AI: a joke?

It’s easy to dismiss these concerns as science fiction. After all, AI is just a tool, right? It’s like a hammer. It can build a house or smash a window. It all depends on who wields it. But what if the hammer starts to swing by itself?

The findings come just weeks after dozens of AI industry leaders, academics and even some celebrities signed an agreement rack warning of AI “extinction” risk. That statement, signed by Sam Altman, CEO of OpenAI, Geoffrey Hinton, the “godfather of AI,” and top executives from Google and Microsoft, called on society to take steps to guard against the dangers of AI.

“Reducing the risk of AI extinction should be a global priority alongside other societal-scale risks such as pandemics and nuclear war,” the statement said. This is not a call to arms. It is a call for awareness. It is a call to responsibility.

It’s time to take AI risk seriously

The AI ​​revolution is here, transforming everything from how we shop to how we work. But as we embrace the convenience and efficiency of AI, we must also face its potential dangers. We need to ask ourselves: are we ready for a world where AI has the potential to outperform us, outperform us and outlast us?

Business leaders have a responsibility not only to generate profits, but also to secure the future. The risk of AI dying out is not just a technical problem. It’s a business matter. It’s a human issue. And it is a problem that requires our immediate attention.

The CEOs who took part in the Yale survey are not alarmists. They are realists. They understand that AI, like any powerful tool, can be both a blessing and a curse. And they are calling for a balanced approach to AI – one that embraces its potential while mitigating its risks.

Related: Read this terrifying one-sentence statement about AI’s threat to humanity, released by global tech leaders

The tipping point: the existential threat of AI

The existential threat of AI is not a distant possibility. It is a current reality. Every day AI becomes more advanced, more powerful and more autonomous. It’s not just about robots taking over our jobs. These are AI systems that make decisions that can have far-reaching consequences for our society, our economy and our planet.

Consider, for example, the potential of autonomous weapons. These are AI systems designed to kill without human intervention. What happens if they fall into the wrong hands? Or what about AI systems that control our critical infrastructure? A single outage or cyber-attack can have catastrophic consequences.

AI represents a paradox. On the one hand, it promises unprecedented progress. It has the potential to revolutionize healthcare, education, transportation and countless other industries. It could solve some of our most pressing problems, from climate change to poverty.

On the other hand, AI poses a danger like no other. It can lead to mass unemployment, social unrest and even global conflict. And in the worst case, it could lead to human extinction.

This is the paradox we must face. We must harness the power of AI while avoiding the pitfalls. We need to make sure AI serves us, not the other way around.

The AI ​​alignment problem: bridging the gap between machine and human values

The AI ​​alignment problem, the challenge of getting AI systems to behave in a way that aligns with human values, is not just a philosophical conundrum. It’s a potential existential threat. If not handled properly, it can set us on the road to self-destruction.

Consider an AI system designed to optimize for a particular goal, such as maximizing production of a particular resource. If this AI is not perfectly aligned with human values, it can pursue its goal at all costs, without regard for possible negative consequences for humanity. For example, it may overuse resources, leading to environmental devastation, or it may decide that humans themselves are obstacles to its goal and act against us.

This is known as the “instrumental convergencethesis. Essentially, it suggests that unless explicitly programmed otherwise, most AI systems will converge on similar strategies to achieve their goals, such as self-preservation, resource acquisition, and resistance to shutdown. If an AI becomes superintelligent, these will strategies can pose a serious threat to humanity.

The alignment problem becomes even more concerning when we consider the possibility of a “intelligence explosion– a scenario where an AI becomes capable of recursive self-improvement and quickly surpasses human intelligence. In this case, even a small deviation between the AI’s values ​​and ours can have catastrophic consequences. If we lose control of such an Losing AI could lead to human extinction.

Moreover, the alignment problem is complicated by the diversity and dynamics of human values. Values ​​vary greatly between different individuals, cultures and societies, and they can change over time. Programming an AI to respect these diverse and evolving values ​​is a mammoth challenge.

Tackling the AI ​​alignment problem is therefore crucial for our survival. It requires a multidisciplinary approach, combining insights from computer science, ethics, psychology, sociology and other fields. It also requires the involvement of diverse stakeholders, including AI developers, policymakers, ethicists, and the public.

As we stand on the cusp of the AI ​​revolution, the tuning problem presents us with a stark choice. If we get it right, AI can usher in a new era of prosperity and progress. If we get it wrong, it can lead to our downfall. The stakes couldn’t be higher. Let’s make sure we choose wisely.

Related: As Machines Take Over — What Does It Mean To Be Human? Here’s what we know.

The way forward: responsible AI

So what’s the way forward? How do we navigate this brave new world of AI?

First, we need to foster a culture of responsible AI. This means developing AI in a way that respects our values, our laws and our safety. It means ensuring that AI systems are transparent, auditable and fair.

Second, we need to invest in AI security research. We need to understand the risks of AI and know how to mitigate them. We need to develop techniques to control and tailor AI to our interests.

Third, we need to engage in a global dialogue about AI. We need to involve all stakeholders — governments, businesses, civil society and the public — in the decision-making process. We need to reach a global consensus on the rules and standards for AI.

The choice is ours

Ultimately, the question is not whether AI will destroy humanity. The question is: Shall we leave it?

The time to act is now. Let’s take the risk of AI extinction seriously, as do nearly half of top business leaders. Because the future of our businesses – and our very existence – may depend on it. We have the power to shape the future of AI. We have the power to turn the tide. But we must act with wisdom, courage and urgency. Because the stakes couldn’t be higher. The AI ​​revolution is upon us. The choice is ours. Let’s make the right one.