Peter Norvig (Google Director of Research) – The Next Step for Deep Tech in Asia (Jan 2021)
Chapters
00:00:04 Deep Tech Innovations in Asia: The Next Step
Overview: SG Innovate, a supporter of entrepreneurial scientists, held a community event focused on the future of deep tech in Asia. Jasmine Leng, Assistant Director of Talent Networking at SG Innovate, introduced Peter Norvig, Director of Research at Google, as the keynote speaker.
Deep Tech Innovations: Peter Norvig, a renowned expert in artificial intelligence, was invited to share his insights on upcoming deep tech innovations.
SG Innovate’s Talent Programs: SG Innovate offers various initiatives to cultivate deep tech talent within Singapore.
Summation Program: Apprenticeship projects in fields like AI, cybersecurity, and IoT are provided by deep tech companies. Suitable for undergraduates and PhD students seeking summer internships. Application deadline: January 15th.
Infinity Series Program: An extension of Summation, offering projects in software development, data analytics, and UI UX. Geared toward undergraduate and PhD students seeking summer internships. Application deadline: January 15th.
PowerX Program: Traineeships in robotics companies for individuals with one to two years of coding experience. The first batch is currently underway.
SG Innovate’s Portfolio Companies: The Talent Marketplace platform showcases SG Innovate’s portfolio companies, providing information about their offerings and job opportunities.
00:04:06 Machine Learning Advancements and Their Practical Applications
Machine Learning Applications in Robotics: The field of robotics is experiencing a surge in interest and development, similar to the early days of personal computers in the 1970s. Practical applications of robotics are emerging, particularly in areas such as autonomous cars and warehouse robotics. Automated cars face challenges in interacting with the real world, but specific applications like delivery vehicles are becoming feasible. Sensors are becoming more affordable, driving the growth of robotics and computer vision.
Computer Vision: Computer vision plays a crucial role in robotics, enabling tasks like object tagging and image understanding. The field is exploring applications across various domains, including medical imaging and autonomous driving. Adversarial images pose challenges to the reliability of computer vision models, prompting research on understandable and reliable models.
Medical Imaging and Protein Folding: Computer vision models can achieve performance comparable to or exceeding that of trained doctors in medical imaging. These models can detect indicators of diseases beyond the scope of human doctors’ abilities. Advancements in protein folding have opened up new avenues for designing drugs and therapies.
Large Multimodal Models: Peter Norvig emphasizes the significance of large multimodal models, combining data, computing power, and diverse modalities. These models have the potential to revolutionize various fields, including natural language processing, computer vision, and robotics.
Recent Advancements in AI: Larger and more complex models with numerous parameters have led to improved performance. Multimodality combines data types like images, videos, and language, enhancing the capabilities of AI models. Language models can handle various tasks like conversations, translations, and text generation, all within a single model.
Automating Machine Learning: Automated machine learning enables users without expertise to build machine learning models with minimal effort. Systems can generate machine learning models based on provided data and desired outcomes, democratizing access to AI technology.
Challenges and Opportunities for Deep Tech Commercialization: 2020 was a difficult year for commercializing deep tech due to the pandemic-induced uncertainty and disruptions. The pandemic accelerated digital transformation and automation across industries, creating opportunities for deep tech companies. Automation has become a strategic business objective for ensuring business continuity and resilience. Commercializing deep tech requires addressing challenges such as customer hesitancy, remote deployment difficulties, and negotiating through virtual channels.
Harvesting Ideas and Promoting Commercialization: Governments and organizations should provide funding and support for deep tech research and development. Encouraging collaboration between academia, industry, and startups can accelerate innovation and commercialization. Promoting awareness and education about deep tech can help businesses understand and adopt these technologies. Creating a supportive ecosystem with incubators, accelerators, and mentorship programs can foster deep tech startups’ growth.
Lowering the Barrier to Entry: Peter Norvig emphasizes the importance of making it easy for customers to try out products, especially when they are expensive. By offering a low-commitment option, such as a revenue-share approach or a small initial investment, companies can attract more potential customers. This strategy shortens the sales cycle and allows businesses to connect with a broader range of individuals within a company.
Old-School Sales Strategy: Suchitra Narayan highlights the fundamentals of sales strategy, which involve delivering what the customer wants and allowing them to grow. Once customers see growth, they are more likely to pay and share a portion of their success with the company. This approach is considered an old-school sales strategy but remains the foundation for effective sales.
Deep Tech Developments in Asia: Sinuh Arroyo discusses the rise of software computer science companies in Asia, particularly in Singapore. Companies like BeSense and Tiger are leading the way in visual search and automation. Research centers and labs in Asia are actively involved in European research programs, fostering collaboration and innovation.
Opportunities for Cooperation: Arroyo emphasizes the numerous opportunities for cooperation between Asian and European companies in the field of deep tech. Research programs and initiatives facilitate collaboration and the exchange of knowledge and expertise. These partnerships can lead to groundbreaking developments and advancements in deep tech.
Asia’s Focus on Smart Manufacturing and Biotech: Asia, particularly Singapore, is making significant investments in smart manufacturing, biotech, and food innovation. There are numerous promising companies in these fields, such as Bioformis, which has received funding from SoftBank. These companies have the potential to revolutionize their respective industries and make a positive impact on the world.
Global Startup Ecosystems: While Silicon Valley remains a prominent tech hub, other regions such as Asia, Africa, and South America have thriving startup ecosystems. Local startups have a deeper understanding of their markets and can tailor products to meet specific needs. With the right drive, ideas, and execution, startups from anywhere can achieve success.
Robotics and its Applications: Robotics has vast potential in various fields, including healthcare, delivery, and manufacturing. The pandemic has accelerated the demand for contactless solutions, making robots more attractive for various tasks. From self-driving cars to flying drones, there is a wide range of possibilities for robotic applications.
Robotics and Uncertainty: Robotics presents unique challenges due to the unpredictable and uncertain nature of the real world. Robots must learn to adapt and navigate uncertainty, which opens up possibilities for solving complex problems. Reinforcement learning and exploration techniques are essential for robots to learn and operate in the real world.
Sim-to-Real Conversion in Robotics: Robots can learn faster in simulation environments than in the real world due to the ability to run experiments at accelerated speeds. Sim-to-real conversion allows robots to transfer knowledge gained in simulation to the real world, improving their performance.
00:31:41 Robotics in Asia: The Convergence of Affordability, Necessity, and Human Potential
The Simulation-Reality Connection: Simulations improve as more data is acquired, leading to exponential speed-up in learning. Robotics acceleration is expected once simulations reach a certain level of accuracy.
Pandemic-Driven Shifts in Robotics Adoption: Safer distancing requirements slow down supply chain logistics, making robots more feasible. The pandemic has accelerated the acceptance of automation as a necessity.
Overcoming Inertia in Digital Solutions Adoption: Reducing labor costs and increasing operation reliability are key drivers for automation. Freeing human intellect from repetitive tasks allows employees to focus on value-creating aspects of their jobs. Automation should offer employees better opportunities for training, self-development, and career progression.
00:35:25 Strategies for Human Survival in the Era of Artificial Intelligence and Robotics
AGI and Data Training: Peter Norvig emphasizes the need for effective generalization in AI, moving away from supervised learning that heavily relies on high volume data training. The goal is to enable AI models to learn from existing knowledge and apply it to new problems with minimal additional data. Multimodal models are promising in this regard, allowing pre-trained models to be adapted to specific tasks with smaller datasets.
Robotics and Funding Mechanisms: Peter Norvig highlights the longer timescales involved in robotics prototyping and time to market, similar to physical product development. Startups in robotics should adopt strategies used by hardware companies, such as building prototypes, finding customers for components, and generating revenue streams while working towards the final solution. Robotics startups should not feel singled out in facing these challenges, as they are common in many industries that create physical products.
Human Survival and Key Skills in the AI Era: Sinuh Arroyo emphasizes the importance of continuous learning and adaptability in a dynamic environment where jobs are constantly evolving. Individuals should keep an open mind, embrace new skills, and progress in their careers by continuously acquiring knowledge and skills. Peter Norvig stresses the value of being a person and understanding human needs, as robots are not as capable in this area. There will always be jobs for individuals who understand human factors, even in an AI-dominated world. Commercialization of technology often favors solutions that integrate well with human users, rather than those that are technologically superior.
00:42:36 Deep Tech for Human Well-being and Partnership Opportunities
Technology Perfection and Customer Satisfaction: Peter Norvig emphasizes that aiming for perfection in technology is not always necessary. Providing 80% of the desired solution can be sufficient to address a customer’s needs effectively.
Use Cases for Companion Robots: Companion robots for kids and seniors can be successful even without advanced technology. Human willingness to meet technology halfway and engage with it plays a significant role in their acceptance.
Google’s Plans for Asian Deep Tech Startups: Google offers programs to support Asian deep tech startups, including training, consulting, and access to various technologies.
Personal Tech Predictions and Wishes for Deep Tech in 2021: Norvig highlights the importance of defining the intended purpose and goals of technology. He believes that optimization techniques are readily available, but the challenge lies in determining what we truly want our technologies to achieve.
00:45:36 AI Technology Trends and Predictions for 2021
Technology Focus Areas for 2021: Robotics: Advances in robotics are expected to continue, with a focus on improving dexterity, autonomy, and collaboration with humans. Computer Vision: Ongoing progress in computer vision is anticipated, enabling more accurate and versatile object recognition and scene understanding. Natural Language Understanding: A significant breakthrough in natural language understanding is predicted, allowing for more natural and comprehensive conversations with devices.
Challenges in Building Trustworthy AI Systems: Fairness and Bias: Experts emphasize the need to address fairness and bias in AI systems to ensure they are beneficial to all users and avoid perpetuating discrimination. Privacy and Transparency: Concerns about privacy and transparency in AI systems are highlighted, calling for measures to protect user data and ensure accountability.
Quantum Computing and AI Chips: Quantum Computing: While still in its early stages, quantum computing is seen as a potential game-changer in problem-solving and could have a significant impact in the coming years. AI Chips: The term “AI chip” is questioned, as experts suggest that specialized hardware for AI tasks may not be necessary for all applications.
Emerging Fields with Potential: Smart Manufacturing and Biotech: The pandemic has brought attention to the importance of smart manufacturing and biotech, leading to increased investment and research in these areas. Food Innovation: The need for food independence and sustainability drives interest in innovative approaches to food production and agriculture.
Quantum Technologies: Quantum Sensing and Signaling: In the near term, quantum technologies are expected to make an impact in areas such as quantum sensing and signaling, rather than full-fledged quantum computing.
Challenges in the AI Chip Industry: Lack of Standardization: The AI chip industry faces challenges related to a lack of standardization and the need for specialized hardware for different AI applications.
00:51:40 AI Chips: Revolutionizing Computing and Intelligence
Terminology: AI Chips: Peter Norvig suggests that the term “AI chip” is too limiting, as it fails to capture the versatility of these specialized chips.
Specialized Chips and Parallel Computing: The exploration of parallel computations with specialized chips offers significant advantages. Power consumption and battery usage become crucial factors, opening up possibilities for edge computing.
The Revolution in AI: The recent advancements in AI have been driven by data, algorithms, and the increase in computing power.
Data as an Asset and Liability: Data’s value as an asset is acknowledged, but concerns about privacy and stewardship responsibilities have emerged. The concept of federated learning empowers users to retain their data and run processes on their devices.
Measuring Intelligence: Peter Norvig proposes a two-by-two breakdown to define intelligence: Thought processes (validity and coherence) vs. results (achieving the correct answer) Human-like operation vs. achieving the best possible result
The Turing Test and Defining Intelligence: Norvig interprets Alan Turing’s Turing test as a call to define intelligence through task success rather than human imitation. The emphasis is on the task itself, not the task of imitating a human. Norvig believes Turing would have embraced new tasks as measures of intelligence.
AI Limitations: Software’s ability to play games like chess or AlphaGo is not a true representation of intelligence. AI works well when applied to specific, limited domains.
Intelligence Definition: Intelligence should encompass a wide range of human abilities, not just isolated tasks. Software can be considered intelligent when it demonstrates the versatility and creativity of a human mind.
Predictions for Tech Trends: Increased adoption of automation and robotics solutions, becoming mainstream. Digital transformation is no longer optional in the post-COVID remote work world. Virtual collaboration systems need improvement, especially for casual conversations and idea exchange.
Call to Action: Connect with the panelists on LinkedIn or reach out to SG Innovate for further discussions.
Abstract
The Future of Deep Tech: Insights from Google’s Peter Norvig and SG Innovate’s Initiatives
In the rapidly evolving world of technology, deep tech innovations continue to push the boundaries of what’s possible, shaping industries and global societies. This article, drawing from the event organized by SG Innovate featuring Peter Norvig, Director of Research at Google, explores the forefront of these innovations, challenges, and the road ahead.
Embracing the Deep Tech Revolution: Key Insights and Predictions
Peter Norvig, an artificial intelligence (AI) pioneer, shared his insights on the future of deep tech, highlighting advancements in AI, natural language processing, and robotics. His experience at Google and NASA informs his predictions of transformative changes, particularly in machine learning applications, such as automated cars, warehouse robotics, and medical imaging. He also discussed the rapid progress in protein folding, which could lead to significant developments in drug design and therapies. Moreover, the article mentions strategies to shorten sales cycles and connect with a broader audience, such as offering low-commitment options and small initial investments. These strategies resonate with Suchitra Narayan’s principle of meeting customer needs and supporting their growth.
Nurturing Talent and Innovation: SG Innovate’s Role
Under the guidance of Jasmine Leng, Assistant Director of Talent Networking, SG Innovate plays a crucial role in nurturing deep tech talent in Singapore. Through initiatives like Summation, Infinity Series, and PowerX, SG Innovate equips individuals with the skills needed for deep tech careers, thereby sustaining growth and innovation in this sector.
Challenges and Opportunities in Deep Tech Commercialization
The commercialization of deep tech faced significant challenges in 2020 due to the COVID-19 pandemic, which underscored the strategic necessity of automation. In response, companies are advised to focus on shorter sales cycles, lower upfront commitments, and broader customer targeting. The pandemic also accelerated digital transformation and automation, creating opportunities for deep tech companies despite the initial difficulties in commercialization. Addressing challenges such as customer hesitancy and remote deployment is crucial. Support from governments and organizations for deep tech research, along with promoting collaboration between academia, industry, and startups, can accelerate innovation and commercialization. Creating a supportive ecosystem with incubators, accelerators, and mentorship programs is essential for the growth of deep tech startups.
Global Collaboration and Investment in Deep Tech
The collaboration between academia, industry, and government is crucial for deep tech solutions, as seen in Asia’s investment in smart manufacturing, biotech, and the presence of companies like Google for Startups. These collaborations foster innovation and understanding of both local and global marketplaces.
Robotics and AI: The New Frontier
Post-pandemic, there has been an increased reliance on robotics in various industries, from medical applications to delivery services. Key advancements such as reinforcement learning and sim-to-real conversion are vital for navigating real-world complexities. The importance of human-centric design in technology adoption is emphasized, acknowledging that successful technologies often prioritize human integration. In Asia, Singapore leads in robotics, with companies like BeSense and Tiger specializing in visual search and automation. Collaborations between research centers in Asia and European research programs highlight the global nature of deep tech innovation.
Quantum Computing and AI: The Emerging Game-Changers
Quantum computing, still in its early stages, is identified as a potential game-changer, along with developments in AI chips and the growing significance of data as both an asset and a liability. The discussion on measuring intelligence in AI – whether through thought processes or task performance – provides a nuanced view of the challenges in achieving general AI.
Looking Ahead in the AI Era
In conclusion, the insights from Peter Norvig and SG Innovate’s initiatives offer a comprehensive view of the future of deep tech. While challenges in commercialization and achieving general AI persist, the opportunities for innovation and global collaboration are immense. The deep tech revolution, driven by advancements in AI, robotics, and quantum computing, is reshaping industries and redefining the human experience in the digital age.
Incorporating Recent Discussions:
Peter Norvig emphasized the need for AI to move away from heavily data-dependent supervised learning towards effective generalization, where AI models can apply existing knowledge to new problems with minimal data. Multimodal models are promising in this context. For robotics, he highlighted the longer timescales in prototyping and market introduction, suggesting that startups adopt strategies used by hardware companies. Understanding these challenges is important, as they are common in industries creating physical products.
Sinuh Arroyo emphasized the importance of continuous learning and adaptability in the dynamic job landscape. The value of understanding human needs is highlighted, as this is an area where robots are less capable. The commercial success of technology often depends on its integration with human users. The term “AI chip” is seen as limiting, as these specialized chips enable parallel computations with power and battery advantages. The value of data is acknowledged, alongside concerns about privacy and stewardship responsibilities. Federated learning is presented as a solution, allowing users to retain data and run processes on their devices.
Peter Norvig’s interpretation of intelligence in AI includes a two-by-two breakdown based on thought processes and results, as well as human-like operation and achieving the best possible result. He emphasizes task success over human imitation in defining intelligence. The limitations of AI are noted, particularly its performance in specific domains. Intelligence should encompass a wide range of human abilities. The increased adoption of automation and robotics is expected to become mainstream, with digital transformation being essential in the post-COVID remote work world. There is a need for improved virtual collaboration systems for casual conversations and idea exchange.
Software engineering is shifting from a logical approach to an empirical science, and AI problems require distinct techniques due to continuous change and uncertainty. Machine learning is becoming integrated throughout the software engineering lifecycle, offering potential solutions to problems beyond traditional techniques....
Peter Norvig emphasized the relationship between data science, AI, and machine learning, illustrating the shift from rule-based systems to data-driven models and end-to-end solutions....
AI has evolved from complex rules to probabilistic programming and impacted various aspects of society, presenting both opportunities and challenges. Norvig's insights emphasize gradual AI integration, responsible development, and continuous learning in this ever-evolving field....
AI is advancing rapidly due to increased computing power, more available data, and new techniques like deep learning. However, challenges remain in areas such as AI safety, ethical considerations, and the development of conversational AI systems that can understand context and reason effectively....
AI in software development is evolving towards a data-driven, empirical approach, with ethical considerations and a focus on democratizing access. AI advancements should align with human needs, societal values, and global well-being....
AI education has shifted from algorithm analysis to applications, focusing on societal impacts like ethics and privacy. AI's practical applications are growing, but concerns about unintended consequences and safety remain....
Machine learning's paradigm shift from traditional software development allows computers to learn from data and generate programs, offering unparalleled flexibility and speed in program development. Its applications range from natural language processing to computer vision, and it has the potential to revolutionize industries, but challenges like adversarial attacks and the...