Peter Norvig (Google Director of Research) – Google’s Approach to AI and Machine Learning (Jun 2017)


Chapters

00:00:00 Introducing Artificial Intelligence: Promises, Concerns, and Landmark Discussion
00:02:15 Current and Future Developments in Artificial Intelligence
00:11:35 Emergence of Deep Learning and the Journey Towards Human-Level AI
00:16:31 Tools for Transitioning from Artisanal to Machine Learning Software
00:21:42 Challenges and Opportunities in the Era of Artificial Intelligence
00:29:14 Machine Learning Explainability: Challenges and Opportunities
00:31:40 The Impact of Technology on News and Politics
00:34:39 AI's Potential Impact on Society: Experts Discuss Benefits and Concerns
00:43:00 AI Solutions for Societal Impact: Challenges and Strategies
00:48:11 Research Culture at Google
00:53:05 Teaching Machine Translation Systems About the Real World

Abstract

The Rapid Evolution of Artificial Intelligence: Promise, Challenges, and the Road Ahead

Introduction

Welcome to the UNSW and Google jointly organized event on artificial intelligence (AI). We acknowledge the Bedjigal people as the traditional custodians of the land where this event is held and pay our respects to their elders, past and present. We also extend our respect to Aboriginal and Torres Strait Islanders present. Professor Ian Jacobs, President and Vice-Chancellor of UNSW Sydney, introduces the panellists, echoing the respect and acknowledgement of the Bedugal people and indigenous attendees. He welcomes everyone to this landmark event featuring two eminent leaders and researchers in AI.

In an era of rapid technological advancements, AI stands at the forefront of reshaping our world. This article provides a comprehensive overview of AI’s current state, its promises, challenges, and anticipated development trajectory.

AI’s Promise and Concerns

Artificial Intelligence promises significant advancements in sectors like transportation with driverless cars and enhances daily life with personal assistants. However, the use of AI in warfare and its potential to displace jobs raises ethical concerns. Moreover, its ability to predict human behavior better than humans themselves brings forth issues of privacy and autonomy, demanding a careful consideration of its societal impacts.

Current State of Artificial Intelligence

AI has seen rapid advancements in various domains, including gaming, healthcare, and everyday applications. UNSW has been instrumental in these developments, especially in quantum computation. AI’s potential seems boundless, with continuous advancements pushing the boundaries of what’s possible.

Computers have surpassed human abilities in strategic games like chess and Go and have made advancements in medical diagnosis through AI-driven imaging analysis. AI and robots are being explored to assist in complex cancer surgeries, while personal assistants, online shopping, and navigation apps like Google Maps enhance user experiences through AI technology. UNSW boasts a strong history in AI research, recognized internationally, particularly as the World Soccer Champions in robo-soccer. Its Center for Quantum Computation and Communication Technology is developing advanced computers that could revolutionize AI. Google’s advancements in AI have been bolstered by access to digital data, computing power, and better algorithms. Language understanding has evolved to process millions of pages, and image recognition is now on par with human capabilities.

Deep Learning

Deep learning, a subset of AI, has gained prominence, especially in vision and natural language processing. It models complex relationships but is not suitable for all AI tasks, such as long-term planning and reasoning. It is expected that deep learning will continue to evolve with new architectures, enhancing its capabilities further. However, it lacks the ability to understand underlying principles and rules, necessitating hybrid approaches that combine deep learning with other techniques.

Hybrid Approaches

Hybrid AI systems, like AlphaGo, have shown success by combining deep learning for perception and traditional AI methods for strategy. AlphaGo’s ability to assess the Go board and identify potential moves played a significant role in its success.

Looking Ahead

AI’s rapid evolution continues as researchers explore ways to enhance deep learning and develop alternative methods for tasks where it falls short. The field has experienced four major “storms,” including the expert systems boom and subsequent “AI winter.” The current AI boom is driven by immediate returns and solutions-oriented approaches. However, the risk of another “winter” looms if AI techniques are perceived as lacking full reasoning capabilities.

Significant breakthroughs in AI, such as speech recognition and machine translation, have occurred, but further advancements are needed. Incremental improvements may be more challenging as AI approaches the limits of current technologies. Public fears about AI taking over should be calmed by acknowledging the field’s complexity and long-term nature, as illustrated by the story of John Henry, emphasizing the continued importance of human involvement in AI development.

Conclusion

The transition to machine learning necessitates new tools and approaches. Google’s data-driven problem-solving and AI integration offer valuable lessons for the broader AI community. As AI

continues to evolve, its equitable and responsible development remains crucial for ensuring its benefits are realized across all segments of society.

Supplemental Information

Google’s innovative structure fosters collaboration among researchers, engineers, and managers, blending long-term research with the creation of widely-used products. The autonomy granted to DeepMind within Google has resulted in both theoretical advancements and practical applications. Machine translation has made significant progress, nearing human-level performance in written form. However, perfect translation is challenging, as human translators also make errors. Understanding the real world is crucial for accurate translation, highlighted by examples like “I dropped the glass on the table, it broke.”

For comprehensive machine translation, incorporating visual information and knowledge about objects and their interactions is essential. Generating natural-sounding speech remains a challenge, requiring advancements in speech generation algorithms to convey emphasis, pauses, and subtle nuances.

Tackling machine translation is considered one of the most challenging problems in AI, as it requires a comprehensive understanding of language, the world, and their interrelation. This complexity positions machine translation as a pivotal problem in the field, representing a key milestone in the pursuit of advanced AI capabilities.


Notes by: OracleOfEntropy