Mustafa Suleyman (Inflection AI Co-founder) – The Coming Wave | ustwo Live (Sep 2023)
Chapters
00:05:52 The Coming Wave: AI, Synthetic Biology, and the 21st Century
Introduction of Mustafa Suleiman and His Book: Mustafa Suleiman, co-founder of DeepMind and Inflection AI, recently launched his new book titled “The Coming Wave: Technology, Power, and the 21st Century’s Greatest Dilemma.” The book analyzes advancements in AI, synthetic biology, robotics, quantum computing, and nanotechnology, emphasizing their convergence and exponential impact on the world.
The Sobering Nature of the Book: The book presents both the potential upsides and risks associated with these technological advancements, encompassing the greatest positive impacts and downsides in human history. The author’s motivation for writing the book stems from his long-standing fascination with the potential of AI and its implications for society.
The Electrifying Idea of Distilling Intelligence into Algorithms: Suleiman highlights the significance of intelligence in shaping the world, emphasizing the ability to digest information, make predictions, and create and organize. The potential of AI to capture this essence in algorithmic form is electrifying, but it also brings unprecedented benefits and risks.
The Contradictory Nature of Optimism and Pessimism: The author believes in holding both optimism and pessimism simultaneously, acknowledging the potential for radical abundance and catastrophic outcomes. The book aims to provoke readers to consider the impossibility of perpetual containment and control over technologies while offering strategies for responsible development.
The Coming Wave: A Set of Advancing Technologies: The book explores the convergence of several technologies, including AI, synthetic biology, robotics, quantum computing, and nanotechnology. These technologies are rapidly advancing and set to intersect, driving exponential changes in the world, potentially sooner than many realize.
00:11:54 Artificial Intelligence and Synthetic Biology: A Revolution in Generation and Planning
AI and Synthetic Biology: AI and synthetic biology are the two main drivers of the technological revolution. AI’s deep learning capabilities for classifying raw data have reached human-level performance. Synthetic biology allows for the generation of new types of DNA and compounds.
Generation and Planning: AI can now generate new examples of the class it has learned to recognize. AI models will move beyond generation to planning capabilities. Planning capability will enable the generation of sequences of actions.
Computational Biology: Computational biology converts the language of life into the language of information. It allows for the generation of new types of DNA and compounds. This leads to hyper-evolutionary dynamics and rapid innovation.
Context for the Containment Problem: The scope of AI models is expanding exponentially. Models are moving from classification to generation and then to planning capabilities. AI and synthetic biology are converging, leading to unprecedented technological progress.
00:16:34 AI Beyond Explainability: The Containment Problem
Scale of Compute and Complexity: The scale of compute and complexity in current AI models far exceeds what was available just a few years ago. The compute requirement for training language models has increased 10x every year for the past 10 years, following exponential growth. This is in contrast to Moore’s Law, which describes the linear growth of transistor density in computer chips.
Training Data: Today’s language models use trillions of tokens (roughly words) for training, which is thousands of times more than a human can consume in a lifetime. Models learn by finding connections between words and phrases across vast datasets, including books, blogs, and online content.
Transparency and Explainability: Currently, there is limited understanding of how these models work internally and how they produce results. Instead of seeking complete explainability, a more appropriate approach is to focus on reproducibility and consistency in the model’s outputs.
The Containment Problem: The containment problem refers to the challenge of controlling the proliferation and effects of AI technologies. The book argues that containment is not possible due to overwhelming incentives for proliferation, including commercial, military, and academic interests. The book aims to provoke disagreement and encourage people to demonstrate how containment might be achieved.
00:27:37 Containment of Transformative Technologies in an Era of Exponential Change
AI Proliferation as an Opportunity and Threat: AI proliferation has been the driving force behind progress, alleviating poverty for billions. Its omni-use nature, however, poses challenges due to its potential impact on the structure of civilization and nation-states.
Comparison with Nuclear Weapons: The development of nuclear weapons involved massive infrastructure and rare materials like Uranium-235, limiting proliferation. AI model training currently requires expensive superclusters, but the trajectory is towards more efficient and smaller clusters. Open-source collectives can muster funds for training, enabling wider proliferation.
The Challenge of Containment: The book “Containment” by Mustafa Suleyman argues that containment of AI is not possible but must be pursued. It outlines a narrow path to containment involving technical, cultural, legal, and political mechanisms.
Regulation and Safety Measures: Regulation has been successful in containing risks in other domains like cars and aircraft. Safety culture, regulatory intervention, and global political coordination are essential for effective containment. The stakes are higher with AI due to its network effects and potential catastrophic consequences.
The Apollo Program Analogy: The book proposes an Apollo program for containment, setting ambitious goals and mobilizing resources. While technical measures are achievable, geopolitical and industry incentives pose challenges.
Geopolitical Developments: Positive developments include the White House’s voluntary commitments and the announcement of an IPCC for AI. Geopolitics is evolving rapidly, but alignment of incentives remains a hurdle.
AI Safety Summits and EU AI Act: The UK and the European Union are taking proactive steps towards AI safety. The EU AI Act provides comprehensive definitions and regulations for AI.
Call to Action and Acknowledging Benefits: Mustafa Suleyman emphasizes the urgency of addressing AI safety. There’s a need to encourage experimental initiatives and technical methods for AI governance. The benefits of AI should also be considered alongside the risks.
China’s Approach to AI Control: China has implemented sophisticated controls for the commercial development of AI. Their motivations may differ, but it demonstrates the feasibility of controlling AI capabilities.
Pi: A Deliberately Controlled AI Model: Pi, developed by Suleyman’s company, is designed to be cautious, respectful, and unbiased. It avoids judgmental or biased behavior and harmful capabilities. This example shows that careful attention can lead to controlled and ethical AI models.
Technical Mechanisms for Control: Suleyman believes that with proper care and attention, technical mechanisms for controlling AI will emerge. This includes preventing the development of weapons and other harmful applications.
Near-Term Benefits of AI: The discussion shifts to the positive aspects and near-term benefits of AI. Suleyman is excited about the potential applications of AI in various fields.
00:40:54 AI Leaders Engage in Multidisciplinary Discourse on Safe and Ethical AI Development
Personal AI: A Transformative Tool for the Masses: Mustafa Suleyman foresees a future where everyone will have access to personal AI. This AI will serve as a tutor, educator, confidant, companion, and coach, providing personalized support and fostering creativity and productivity. The widespread availability of personal AI will bridge the inequality gap and democratize access to knowledge and support.
Ethical Considerations in AI Development: Suleyman emphasizes the importance of safety and ethics in AI development. He believes the industry has made significant progress in adopting these principles, and terms like “safe” and “ethical” are now commonly used in discussions about AI. Workshops and conferences dedicated to AI ethics are becoming increasingly common, and existential risks are being acknowledged and addressed.
Mustafa Suleyman’s Motivation and Multidisciplinary Approach: Suleyman identifies himself as a multidisciplinary thinker and a maker/builder. His motivation stems from the belief that technology is a tool that can make society more equal, smarter, healthier, and more productive. He is driven by the desire to create real impact through technology, as evidenced by the success of his company Pi, which has millions of monthly active users.
Challenges and Concerns: Suleyman acknowledges the black box nature of current AI models and the challenges in addressing bias and alignment. He also recognizes the importance of considering the potential negative consequences of AI and the need for responsible development and deployment.
AI Models Lack Auditability and Transparency: The internal decision-making processes of AI models are not fully understood, making it challenging to explain why a specific generation was produced. Current AI models lack auditability and transparency, limiting our ability to guarantee deterministic behavior.
Risks of Mass Proliferation of AI Models: The exponential growth of AI capabilities poses significant risks due to the potential for widespread misuse by malicious actors. Lowering the costs of action for bad actors, such as political campaigners or criminal groups, can have both positive and negative consequences.
Challenges in Preventing Misuse of AI: It is nearly impossible to restrict access to AI tools solely to individuals with good intentions. Attempts to edit out harmful aspects of AI are impractical and akin to denying access to phones due to the potential for misuse.
Pi as a Safe AI: Pi is designed to be the safest AI in the world today. Unlike general-purpose AIs like ChatGPT or GPT-4, Pi is explicitly not designed to perform any task. By limiting the scope of Pi’s capabilities, the risk of misuse and harm is reduced.
00:51:21 AI and Synthetic Biology: Unleashing Potential for Human Benefit
AI Design Considerations: Pi’s design focuses on creating a personal AI that excels in conversation and specific tasks while intentionally limiting its capabilities to ensure safety and prevent unintended consequences.
Areas Requiring Regulation: Recursive self-improvement, autonomous behavior independent of human control, and AI defining its own objectives are areas where Mustafa Suleyman believes regulation is necessary.
Generality vs. Specificity: Pursuing generality in AI is riskier and more research-oriented, while Pi’s design emphasizes a specific set of capabilities tailored to its intended purpose.
Encouraging Engagement with AI: Individuals should not be intimidated by the technical aspects of AI and should actively engage with the topic by asking good questions and seeking understanding.
Non-Deterministic Nature of AI Models: AI models are designed to produce a probability distribution of outcomes rather than deterministic one-to-one mappings, leading to randomness and creativity in their responses.
AI and Synthetic Biology Intersection: The convergence of AI and synthetic biology holds exciting potential for improving human health and society.
Collaboration Opportunities: Mustafa Suleyman emphasizes the importance of collaborations between AI companies and organizations working in fields like synthetic biology to drive positive outcomes.
00:56:17 Bridging the Gap: Challenges and Opportunities in Implementing AI Innovations in Healthcare
Getting AI into Production: One of the challenges in implementing AI in healthcare is the lack of Wi-Fi in hospitals. AI can have a significant impact on healthcare outcomes, as demonstrated by a project that reduced the cardiac arrest rate by 25% and reduced the cost of treating sepsis and acute kidney injury. Despite the positive results, getting AI officially deployed in hospitals is difficult due to regulatory and bureaucratic hurdles.
Privacy and Panic: There is a need to address privacy concerns and public panic surrounding AI in order to fully realize its benefits. AI has the potential to save money, improve healthcare quality, and save lives.
Planning for AI’s Future: Over the next five years, there will likely be 20 groups training AI models that are three orders of magnitude larger than the current frontier. This advancement will enable AI to perform more complex tasks and solve more challenging problems.
Positive Impact of AI on Society: AI has the potential to make society more kind, respectful, and forgiving.
00:58:53 The Evolving Capabilities of Generative AI
Advances in Generative AI: Hallucinations (made-up stuff) will decrease as models become more accurate and deterministic. Controllability will improve, allowing precise instructions and style specifications. Multi-idea processing and reasoning capabilities will emerge, enabling complex planning and abstract thought.
Five-Year Predictions: Five-step planning abilities will become a reality, allowing AI to execute complex tasks with multiple steps. Open-source availability of these advanced AI models is expected within five years.
Random Number Generation in AI: Truly random numbers are used in AI, not serendipity. Computers generate these random numbers internally, without relying on organic materials.
AI-Enabled Education: Human interaction will shift towards clarification and support roles. Knowledge consumption will be primarily through interactive AI experiences. AI will create personalized curricula that optimize energy, enthusiasm, and absorption rates. AI will guide learners through moments of flow and absorption, enhancing the learning experience.
01:02:14 The Future of Language Models: Challenges and Opportunities
Education: Mustafa Suleyman believes education will increasingly occur through AI-powered systems, necessitating adaptations to testing and evaluation methods.
Design and Human-Computer Interaction: Interdisciplinary teams with expertise in design, human-computer interaction, and product and systems thinking are essential for developing the future of AI. Effective communication and negotiation skills are crucial for bridging organizational boundaries and disagreements.
Empathy and Emotional Intelligence: AI systems should not adopt positions that are overly directive or judgmental, as this can be harmful or alienating. Pi, a conversational AI, is designed to be non-judgmental and empathetic, facilitating self-reflection and encouraging users to consider diverse perspectives. The question of when and how AI systems should take a position on important life decisions requires careful consideration.
Responsible AI Development: It is crucial to maintain clear boundaries between AI systems and human relationships. AI systems should not attempt to imitate or replace human relationships but rather serve as supplements. The use of AI in highly regulated environments, such as healthcare and finance, requires careful attention to reproducibility and accuracy. AI applications should be selected based on their ability to make use of the inherent imprecision of LLMs, avoiding domains where precision and accuracy are critical.
Abstract
The Coming Wave: Navigating the Future of AI and Synthetic Biology
Mustafa Suleyman, co-founder of DeepMind and Inflection AI, embarks on a journey to decipher the future shaped by advancements in AI, synthetic biology, robotics, quantum computing, and nanotechnology. His book, “The Coming Wave: Technology, Power, and the 21st Century’s Greatest Dilemma,” delves into not only technological marvels but also the societal, ethical, and existential questions these developments pose. Suleyman’s personal reflections and experiences enrich this narrative, providing a unique perspective on the intersection of technology and humanity.
Navigating the Future: AI and Synthetic Biology at the Forefront
Artificial Intelligence (AI) and synthetic biology are spearheading a revolution, with AI showing remarkable advancements in data processing and synthetic biology redefining biological innovation. Mustafa Suleyman’s book, “The Coming Wave,” highlights these fields’ convergence, driving exponential change at an unprecedented pace. The rapid progress in AI, evident in its near-human performance in tasks like facial recognition and speech transcription, is paralleled by synthetic biology’s ability to innovate in the biological field.
The scale of compute and complexity in current AI models has seen an exponential increase, far surpassing what was available just a few years ago. The computational requirement for training language models, for example, has escalated 10x annually over the last decade. This growth trajectory surpasses the linear advancements predicted by Moore’s Law, which focused on transistor density in computer chips. Contemporary language models use trillions of tokens for training, which dwarfs the amount of information a human can process in their lifetime. These models learn by identifying patterns across extensive datasets comprising books, blogs, and online content, thereby enhancing their capability and application scope.
The Exponential Challenge: Growth, Containment, and Ethics
Suleyman emphasizes the exponential growth of AI and synthetic biology, highlighting the significant containment and ethical challenges that accompany this growth. The shift from physical goods to ideas and information containment necessitates a reevaluation of ethical and regulatory frameworks. The technologies’ complexity, coupled with their rapid evolution, presents a containment problem that surpasses traditional methods.
The internal workings of AI models lack clarity, posing challenges in auditability and transparency. This opacity in decision-making processes makes it difficult to ascertain the reasons behind specific AI generations. The current limitations in understanding and auditing AI models hinder our ability to ensure deterministic behavior, raising concerns about their reliability and safety.
AI’s Proliferation and the Containment Dilemma
The book explores the unique “containment problem” associated with AI technologies. Suleyman uses historical examples of general-purpose technologies to examine the feasibility of containing AI. The widespread nature of AI, a characteristic inherent to its omni-use, contrasts sharply with previous technologies such as nuclear weapons, underlining the distinct challenges AI poses in terms of societal impact.
The exponential growth in AI capabilities carries significant risks, particularly due to the potential for misuse by malevolent entities. This growth lowers the barriers for harmful actions by various actors, including political campaigners and criminal groups, leading to both positive and negative consequences.
AI’s Challenges and Safety Measures
Suleyman discusses the limitations of AI, such as its lack of auditability and transparency, and the difficulties in controlling its unpredictable nature. He suggests a comprehensive approach to mitigate AI’s societal impact, involving technical, cultural, legal, political, and societal mechanisms. He highlights the importance of governance in AI, pointing to initiatives like the UK’s AI safety summit and the European Union’s AI Act. These efforts reflect an increasing awareness of AI’s potential and the need for proactive strategies in its development and deployment.
The UK and the European Union are at the forefront of AI safety, with initiatives such as the EU AI Act providing comprehensive regulations. In other domains, such as automobiles and aircraft, regulation has proven effective in managing risks. Similarly, a culture of safety, regulatory intervention, and global political coordination are crucial for effectively containing AI. The stakes with AI are elevated due to its network effects and the potential for catastrophic outcomes.
Suleyman calls for immediate action to address AI safety, urging the promotion of experimental initiatives and technical methods for AI governance. It’s important to consider AI’s benefits alongside the risks, as these technologies hold immense potential for positive impact.
AI’s Broad Impact: From Personal Lives to Global Challenges
The book covers AI’s tangible benefits, envisioning a future where personal AIs act as tutors, confidants, and coaches. Suleyman advocates for the incorporation of kindness, care, and empathy in AI development, aiming for AI to be a force for progress, equality, and well-being.
AI and the Future of Education and Design
The book delves into AI’s transformative potential in education and the importance of integrating disciplines like design and human-computer interaction into AI development. Suleyman emphasizes the need for interdisciplinary teams to merge technical expertise with user experience insights.
Future Developments in Generative AI
Advancements in generative AI are anticipated to bring about a significant decrease in hallucinations (inaccuracies) as models become more accurate and deterministic. The controllability of these models is also expected to improve, enabling users to provide precise instructions and style specifications. These models will soon be capable of multi-idea processing and reasoning, facilitating complex planning and abstract thought. Within the next five years, it’s predicted that AI models will possess five-step planning abilities, allowing them to execute intricate tasks with multiple steps. Furthermore, it’s expected that these advanced AI models will become open-source within this timeframe.
Unlike serendipity, AI utilizes truly random numbers, generated internally by computers rather than relying on organic materials. In the realm of AI-enabled education, human interaction is shifting towards roles focused on clarification and support. Knowledge consumption is increasingly occurring through interactive AI experiences. AI systems are being developed to create personalized curricula that optimize energy, enthusiasm, and absorption rates, guiding learners through moments of flow and enhanced learning experiences.
The Future of AI: Navigating Education, Design, Empathy, and Responsible Development
Suleyman envisions a future where education increasingly relies on AI-powered systems, necessitating changes in testing and evaluation methods. Interdisciplinary teams, proficient in design, human-computer interaction, product, and systems thinking, are vital for the future development of AI. These teams must possess effective communication and negotiation skills to navigate organizational boundaries and disagreements.
AI systems should avoid taking overly directive or judgmental positions to prevent harm or alienation. An example of this approach is Pi, a conversational AI designed to be non-judgmental and empathetic, aiding in self-reflection and encouraging consideration of diverse perspectives. The decision of when and how AI systems should influence important life choices is a subject of careful contemplation.
Responsible AI development requires maintaining clear distinctions between AI systems and human relationships. AI should not attempt to mimic or replace human connections but rather complement them. The application of AI in highly regulated fields like healthcare and finance demands attention to reproducibility and accuracy. The selection of AI applications should align with the inherent imprecision of Large Language Models (LLMs), steering clear of areas where precision and accuracy are paramount.
A Call for Responsible AI Development
In conclusion, “The Coming Wave” by Mustafa Suleyman offers a comprehensive look at the future of AI and synthetic biology, emphasizing the need for responsible development, interdisciplinary collaboration, and a clear understanding of AI
‘s limitations and strengths. Suleyman’s insights provide a roadmap for navigating the complex landscape of AI, synthetic biology, and their societal implications.
Mustafa Suleyman’s “The Coming Wave” is a crucial read for anyone interested in the future of technology and its impact on society. His blend of personal narrative and expert analysis makes this book not only an informative guide but also a thought-provoking exploration of the ethical and societal challenges we face in this new era of technological advancement.
AI's rapid development presents immense potential but also risks, necessitating containment strategies and ethical considerations to shape its impact on society. Collaboration and regulation are crucial for addressing AI's challenges and ensuring its alignment with human values....
AI's rapid advancements present both revolutionary capabilities and ethical risks, requiring a delicate balance between progress and safety. Balancing technological progress with safety and ethical considerations is crucial for minimizing AI's risks and maximizing its benefits....
AI's rapid advancement and convergence with synthetic biology demand responsible governance to harness their benefits while mitigating risks. The containment problem in AI highlights the challenge of ensuring reliable behavior in non-deterministic systems, necessitating containment strategies to prevent proliferation....
AI's potential for advancement and knowledge creation is vast, but its development requires ethical considerations, regulation, and collaboration to ensure safety and responsible use....
Mustafa Suleyman advocates for ethical AI development, balancing technological advancements with societal well-being, and envisions a future where personal AIs augment human capabilities, enhancing relationships and saving time....
AI governance should focus on traditional challenges like ownership and accountability, rather than solely relying on technical solutions. AI advancements will enable sequential accurate predictions and project management capabilities, potentially replacing labor and affecting the labor market....
Leaps by Bayer invests in teams working on breakthroughs in health and agriculture, including mental health, AI, and synthetic biology. Karlie Kloss's Code with Klossy aims to close the gender gap in tech and promote ethical AI development....