Jensen Huang (Nvidia Co-founder) – AI Keynote Session at MSOE (Sep 2019)
Chapters
00:00:07 NVIDIA's Journey: From Humble Beginnings to AI Leadership
Jensen Huang’s Background and Co-founding of NVIDIA: Jensen Huang co-founded NVIDIA in 1993 at the age of 30 and played a key role in shaping the company’s culture and success. His vision and ability to identify opportunities in next-generation technologies established NVIDIA as a leader in the computing industry. Fortune Magazine attributed NVIDIA’s success to Huang’s leadership, emphasizing the company’s focus on community, strategic alignment, and pursuit of excellence through intellectual honesty.
Recognition and Awards: Huang’s contributions to AI have earned him national recognition. He received the Dr. Morris Chang Exemplary Leadership Award and honorary degrees from Taiwan’s National Chiao Tung University and Oregon State University. In 2017, he was named Fortune’s Business Person of the Year, and in 2018, Harvard Business Review ranked him among the world’s best-performing CEOs.
Educational Background: Huang holds a BS degree in electrical engineering from Oregon State University and an MS degree in the same field from Stanford University.
NVIDIA Support for the New Building and Computer Science Degree: The speaker acknowledges and thanks NVIDIA for its support, mentorship, and inspiration in designing the new building, the supercomputer, and the AI-focused computer science degree.
Inaugural Speech at the NVIDIA Auditorium: Huang expressed his honor in giving the inaugural speech in the NVIDIA Auditorium and Milwaukee. He remarked on the unique atmosphere of Milwaukee, mentioning the abundance of sausages and the “cheese that speaks back” when bitten into.
Three Parts of the Talk:
Huang’s talk comprised three parts: 1. The humble beginnings of NVIDIA and the grand dreams that shaped its early vision. 2. The company’s body of work and accomplishments over the past 25 years. 3. A question-and-answer session with the audience.
00:04:54 Early Days of NVIDIA: From Silence to Success
Founding and Early Challenges: NVIDIA was founded in 1993 by Jensen Huang, Chris Malachowsky, and Dwight Dierks. The company’s early days were marked by financial struggles and a lack of success. Despite the challenges, the founders remained committed and raised $2 million in their first funding round.
Startup Struggles: NVIDIA’s early office was a townhouse with no air conditioning. The team lacked equipment and resources, with Jensen using an abacus for calculations. The company’s phones rarely rang, reflecting their lack of initial traction.
Dwight Dierks’ Contributions: Dwight Dierks, NVIDIA’s first employee, played a crucial role in the company’s early success. He initially worked as a software engineer and later became the company’s acting CFO. His dedication and expertise helped NVIDIA weather financial storms and retain key employees.
Company Valuation Journey: NVIDIA’s initial valuation was $0 billion and remained so for over a decade. After raising $2 million in funding, its post-valuation was $6 million. Today, NVIDIA is the 50th most valuable company in the S&P 500 with a valuation of $115 billion.
Dwight’s Generous Gesture: Dwight Dierks made a significant donation to the Milwaukee School of Engineering (MSOE). The donation led to the construction of a new building, a testament to Dwight’s commitment to education and technology.
Dwight’s Role and Influence: Dwight Dierks’ span of control encompasses a third of NVIDIA’s employees, including all software engineers. His dedication to NVIDIA and its employees earned him the respect and appreciation of his colleagues.
Early Office and Humble Beginnings: NVIDIA’s first office, a townhouse, is now on the market for $750,000. The townhouse was a symbol of the company’s modest beginnings and lack of initial success. Jensen Huang reminisced about the early days, including napping at work and playing video games in arcades.
Founding Idea and Vision: NVIDIA’s founders realized the potential of 3D graphics and believed it could become a mainstream medium. Their vision aligned with the emerging personal computer revolution, which would later drive the demand for 3D graphics.
00:17:24 Imagining and Creating New Industries through Virtual Reality
The Genesis of 3D Graphics: Jensen Huang and his colleagues envisioned the democratization of 3D graphics technology to create an entirely new industry: video games.
The Deeper Significance: Beyond the entertainment potential, Huang recognized the profound implications of 3D graphics technology, as it essentially simulates reality and presents a never-ending computational challenge.
The Journey to Virtual Reality: The journey towards creating indistinguishable virtual reality is seen as a long and arduous task, as it requires the emulation of the laws of physics and the integration of artificial intelligence.
The Computational Challenges: Along this journey, Huang emphasizes that the technology developed will have the potential to solve a multitude of complex problems.
Imagination and Great Dreams: Huang attributes the inception of these transformative ideas to imaginative discussions and brainstorming sessions held during breaks and casual gatherings.
The Power of Possibility: Great dreams often start from simple “what ifs” and the pursuit of possibilities that might not have been achievable under ordinary circumstances.
Tackling World’s Grand Challenges: Huang suggests that by acknowledging and overcoming the apparent ridiculousness of ambitious ideas, individuals can push themselves to achieve groundbreaking feats.
Conclusion: Huang highlights the significance of 3D graphics technology, its potential to revolutionize fields beyond entertainment, and the need for imaginative thinking to tackle the world’s grand challenges.
00:19:47 The Journey of Innovation: A Tale of Belief, Conviction, and Reinvention
Genesis of NVIDIA: NVIDIA began with a clear vision and a team of passionate individuals driven by the desire to build a thriving company. Despite facing skepticism and competition from giants like Silicon Graphics and IBM, NVIDIA persisted and succeeded.
Key Ingredients to Success: A clear perspective on the company’s purpose and impact on the industry. A comprehensive understanding of industry dynamics through first-principles thinking. An unwavering belief in the company’s vision, even when faced with resistance from customers and industry experts. The willingness to take risks and innovate, even in the face of potential failure. The courage to follow beliefs and conviction, leading to groundbreaking products like the GPU, programmable shading, CUDA, and AI technologies.
The Power of Emulation: When faced with financial constraints, NVIDIA made a bold move by purchasing an emulator from a failing company. This investment enabled NVIDIA to develop innovative products and technologies that set them apart from competitors.
Suffering as a Catalyst for Innovation: The journey to success is not without its trials and tribulations. NVIDIA embraces the concept of “suffering” as a necessary part of the innovation process. The company views setbacks, failures, and wasted time and money as opportunities for learning and growth.
00:30:11 NVIDIA's Journey from Humble Beginnings to Graphics Revolution
NVIDIA’s Current Standing: NVIDIA has become a large company with significant scale, and its work encompasses three major areas: computer graphics, artificial intelligence (AI), and data science.
Computer Graphics: NVIDIA has played a pivotal role in developing computer graphics technology used in various industries, including automotive design, filmmaking, and video games. The company’s computer graphics journey began in 1994 with the creation of Sega’s Virtual Fighter, which was not very realistic and resembled a cartoon.
Technological Advancements: Over the years, NVIDIA’s computer graphics technology has advanced tremendously. Today, the company can generate photorealistic images using fundamentally different technologies. The computational capability required for this transformation has increased by several million times compared to the early days.
R&D Investment and Growth: NVIDIA’s R&D budget has grown exponentially, from a few million dollars to $5 billion per generation. This significant investment has fueled the company’s innovations, including the invention of the GPU and, recently, ray tracing.
Ray Tracing: Ray tracing involves simulating the physics of light and its interactions with various surfaces as it is absorbed, reflected, and refracted. NVIDIA’s ray-tracing technology allows for the creation of highly realistic and immersive visual experiences.
00:32:27 The Evolution of Computer Graphics and Artificial Intelligence
Ray Tracing in Minecraft: Minecraft now features state-of-the-art path tracing for realistic lighting effects. Physically based material pipeline allows creators to design realistic environments. Ray tracing simulates natural light interactions, including global illumination and reflections.
Per-Pixel Emissives and Reflectivity: Per-pixel emissives enable lighting based on textures, enhancing realism. Varying levels of roughness allow for different levels of reflectivity depending on the material. Micro-facets describe surface roughness, allowing for detailed reflections.
The Birth of CUDA: NVIDIA’s decision to invest in CUDA, a programmable GPU architecture, was a significant gamble. Despite initial financial challenges, CUDA revolutionized computer science.
From Supercomputing to Nobel Prizes: CUDA empowered supercomputing centers and became essential for various scientific fields. Instrumental in discoveries like gravitational waves and biomolecular structures, earning Nobel Prizes.
Video Games and Scientific Computing: The same laws of physics apply to video games and scientific computing, enabling cross-pollination of technologies.
Deep Learning: A Computational Instrument: Deep learning, discovered seven years ago, is an algorithm that writes algorithms beyond human capabilities. NVIDIA’s contribution enabled the flourishing of the artificial intelligence industry.
00:40:32 Evolution of NVIDIA's Computational Innovations
Computational Sciences and AI in Medical Imaging: NVIDIA’s groundbreaking work in medical imaging led to the development of technologies that significantly reduce the dosage of CT scans while maintaining high resolution. This innovation enables more people to benefit from imaging technologies for pre-diagnosis and disease detection. Computational sciences replace brute force imaging, permeating various instruments worldwide, such as LIGO, cryo-EM, and CT.
Artificial Intelligence and Robotics: NVIDIA’s advancements in AI have enabled the company to explore areas like robotics, addressing challenges in perception, reasoning, and path planning. The fusion of sensors, perception, reasoning, and path planning serves as the foundation for artificial intelligence in robotics. NVIDIA showcased examples of teaching virtual reality robots to dance, demonstrating the transferability of neural network brains to physical robots.
Self-Driving Cars and Autonomous Vehicles: NVIDIA’s work in self-driving cars involves using multiple sensors to perceive and reason about the surrounding environment, enabling safe navigation to destinations. The belief that everything that moves will eventually be autonomous drives NVIDIA’s involvement in developing self-driving cars, shuttles, buses, trucks, and taxis. The company envisions a virtual reality city where moving objects are guided by software running on supercomputers.
NVIDIA’s Journey and Unique Contribution: NVIDIA’s journey started with computer graphics and evolved to encompass self-driving cars, robots, supercomputers, and AI knowledge discovery. The company’s mission is to build computers capable of solving complex problems beyond the reach of ordinary computers. NVIDIA aims to create tools for the Da Vincis and Einsteins of our time, enabling them to tackle intricate challenges and advance scientific discoveries.
00:47:35 Artificial Intelligence: The Fourth Industrial Revolution
AI’s Remarkable Achievements: Artificial intelligence has advanced significantly, achieving superhuman levels in image and speech recognition. Conversational AI, where computers understand and respond to human language, is on the horizon.
AI’s Four Eras:
AI’s journey consists of four eras: 1. Building a new computer (DGX) for AI. 2. AI at the edge (turning devices into iPhones). 3. Autonomous AI (robots working alongside humans). 4. Automation of automation (machines learning and writing software).
Implications of AI: AI is revolutionizing industries, from internet and computer companies to healthcare and transportation. AI represents the “automation of automation,” a paradigm shift in computing. AI democratizes computing, enabling non-programmers to access its capabilities.
AI’s Impact on the IT Industry: AI augments the demand for IT engineers, rather than replacing them. AI empowers everyone to become a programmer, expanding access to computing.
Addressing Skepticism: Jensen Huang encourages skeptical leaders to embrace AI’s potential and envision their companies’ transformation. AI provides a competitive edge by enabling innovative products and services.
01:02:05 Artificial Intelligence: Understanding, Embracing, and Relearning for Innovation
Understanding AI Technology: Jensen Huang emphasizes the simplicity of AI technology, explaining that it involves perception, reasoning, and planning actions towards goals. Different types of AI algorithms exist, each擅长处理不同的信息类型,例如空间、图像、文本或语言。 Huang suggests that the perceived complexity of AI should not deter companies from exploring this technology.
Relearning and Reinvention: Huang highlights the importance of continuous learning and reinvention in embracing new technologies. Curiosity and a willingness to relearn are crucial for driving innovation and adapting to disruptions. He draws on NVIDIA’s journey from its inception in 1993 to showcasing its current cutting-edge work, demonstrating the significance of ongoing learning.
Encouraging AI Adoption: Huang urges companies to engage with AI technology by trying it out actively. He encourages experimentation and collaboration, especially among younger employees who are often more open to new ideas. Huang believes that addressing the barriers of understanding, impact, and implementation can facilitate AI adoption.
01:04:47 Artificial Intelligence Innovations in the Era of Edge Computing
The Edge: Defined as anywhere that is not the cloud, including farms, hospitals, and warehouses.
Reasons for Edge AI:
Speed of Light: Some decisions need to be made within milliseconds, making cloud processing infeasible.
Continuous Streaming: Sensors like those in farms and observatories send continuous information, making cloud processing impractical.
Data Privacy: Certain data must remain on-premise due to privacy concerns or ownership rights.
Sensor Fusion: Combining information from multiple sensors, such as cameras, radars, and LIDARs, for better perception.
Example: In healthcare, data from genomics, radiology, diet, family history, pathology, and blood tests must be fused for accurate diagnosis.
Example: In self-driving cars, data from IMUs, radars, cameras, and LIDARs is fused for better perception and decision-making.
The Future of AI: Time Travel and Virtual Reality
Time Travel with Robots: Sending robots on long space journeys to gather new knowledge and share it with humans at the speed of light.
Human Consciousness in Machines: In the future, our consciousness may be captured in machine learning algorithms, allowing essence to be transferred to a robot.
Virtual Reality and AI Collaboration: Virtual reality environments for training robots, where they can solve problems at the speed of light while humans sleep.
Virtual Worlds and Space-Time: Virtual worlds will evolve with AI assistance, changing our concepts of space and time.
Telepresence in Virtual Reality: In the future, presentations can be made from anywhere in the world without noticeable distance.
Abstract
Jensen Huang and NVIDIA: Revolutionizing Technology and AI with Computational Breakthroughs and Innovations
In the landscape of technology and artificial intelligence (AI), few figures have been as influential as Jensen Huang, co-founder of NVIDIA. This article delves into Huang’s journey from founding NVIDIA in a modest townhouse to its rise as a leader in AI and gaming, valued at $115 billion. We explore Huang’s vision of democratizing 3D graphics, his approach of first-principles thinking, and the strategic decisions that transformed NVIDIA into a powerhouse of innovation. Moreover, we examine NVIDIA’s contributions beyond graphics, including advancements in AI, healthcare, robotics, and edge computing, highlighting the transformative impact of Huang’s leadership and vision.
NVIDIA’s Beginnings and Visionary Goals:
Jensen Huang co-founded NVIDIA at the age of 30 in 1993, shaping its culture and success. His unique vision and ability to recognize opportunities in next-generation technologies established NVIDIA as a computing industry leader, as noted by Fortune Magazine. The company was credited for its focus on community, strategic alignment, and intellectual honesty.
NVIDIA emerged with a clear vision and a team driven by the ambition to build a thriving company. Despite skepticism and competition from industry giants like Silicon Graphics and IBM, NVIDIA stood its ground. The key to NVIDIA’s success lay in its clear understanding of its purpose and impact on the industry, a comprehensive grasp of industry dynamics through first-principles thinking, unwavering belief in its vision, a willingness to take risks, and the courage to innovate, leading to groundbreaking products like the GPU, programmable shading, CUDA, and AI technologies. Huang, along with co-founders Chris Malachowsky and Dwight Dierks, overcame early challenges such as financial instability and a lack of customers. Huang’s vision to democratize 3D graphics and make video games significant led to the development of technologies like the GPU and CUDA, despite NVIDIA’s modest beginnings.
Strategic Leadership and Cultural Influence:
Under Huang’s leadership, NVIDIA has excelled in intellectual honesty, strategic alignment, and a culture that fosters excellence. Huang’s method of linking vision to strategy and assembling the right team has been crucial in NVIDIA’s success. This approach, combined with a customer-focused culture, has spurred the company’s growth and innovation.
Innovations in Graphics and Computing:
NVIDIA’s journey in computer graphics, from the invention of the GPU to the implementation of ray tracing technology, has been transformative. The company’s integration of path tracing in Minecraft, creating realistic environments, underscores its impact on video gaming. NVIDIA’s commitment to simulating worlds through supercomputing has led to advancements beyond gaming, influencing physics, chemistry, and biology.
Technological advancements in NVIDIA’s computer graphics technology have been remarkable, enabling the generation of photorealistic images using fundamentally different technologies, with computational capability increasing exponentially. NVIDIA’s R&D budget, growing from a few million to $5 billion per generation, has fueled these innovations. Ray tracing, simulating the physics of light and its interactions, creates immersive visual experiences. In Minecraft, state-of-the-art path tracing creates realistic lighting effects, with physically based material pipeline, global illumination, reflections, per-pixel emissives, varying levels of roughness, and micro-facets for detailed reflections.
AI and Computational Breakthroughs:
Huang’s AI expertise has been pivotal in NVIDIA’s role in the AI revolution. The company’s collaboration with GE Healthcare to reduce CT dosage, and advancements in robotics and self-driving cars, demonstrate NVIDIA’s computational contributions. Huang’s focus on AI led to the development of deep learning, achieving superhuman performance in tasks like image and speech recognition, laying the foundation for conversational AI and transforming industries.
NVIDIA’s investment in CUDA, a programmable GPU architecture, though financially challenging, revolutionized computer science. CUDA enabled supercomputing centers, contributing to discoveries earning Nobel Prizes, and facilitated cross-pollination between video games and scientific computing. Discovered seven years ago, deep learning is an algorithm writing algorithms, and NVIDIA’s contribution has been significant in the AI industry’s growth.
Edge AI, defined as computing outside the cloud, includes areas like farms, hospitals, and warehouses. The need for Edge AI arises from the speed of light limitations, continuous streaming, and data privacy concerns. Sensor fusion, combining multiple sensors, is crucial in applications like healthcare and self-driving cars for accurate diagnosis and perception.
Future Visions and Challenges:
Huang envisions AI extending to edge devices, autonomous systems, and industrial applications, likening it to the automation of automation and predicting its democratization across various fields. The next phase of AI could alter concepts of space and time, enable virtual experiences, and possibly capture consciousness in AI. However, companies must embrace continuous learning and experimentation to keep pace with this evolving landscape.
NVIDIA’s strategic investment in an emulator from a failing company, despite financial constraints, enabled the development of innovative products. The company views “suffering” as an essential part of innovation, treating setbacks and failures as opportunities for learning and growth.
The Future of AI: Time Travel and Virtual Reality:
The future of AI includes concepts like sending robots on long space journeys, capturing human consciousness in machine learning algorithms, and using virtual reality for training robots. Virtual worlds, evolving with AI assistance, will change our perceptions of space and time, allowing presentations to be made from anywhere in the world without noticeable distance.
Jensen Huang’s journey with NVIDIA, from a startup in a townhouse to a global leader in AI and graphics, is a testament to visionary leadership and innovative thinking. His approach to problem-solving, strategic decisions, and contributions to computing and AI have left an indelible mark on technology. As NVIDIA continues to pioneer new frontiers, Huang’s legacy serves as an inspiration for future innovators in the tech world.
NVIDIA's journey from a university startup to a revolutionary force in 3D graphics was marked by serendipitous encounters, relentless passion, and strategic pivots that transformed the technological landscape. NVIDIA's mission to democratize 3D graphics technology led to the development of groundbreaking products like the Riva 128 chip, which transformed 3D...
NVIDIA's rise to dominance in AI and data center computing was driven by strategic leadership, innovation, and a focus on building a strong ecosystem of partners and developers. The company's success can be attributed to its ability to take calculated risks, embrace emulation, and adapt to emerging market demands....
NVIDIA, led by Jensen Huang, evolved from chip design to becoming a leader in AI and accelerated computing due to their strategic shift and commitment to solving impossible applications. NVIDIA's focus on accelerated computing and expertise in learning structure from unstructured data have positioned it as a pioneer in AI,...
NVIDIA's success stemmed from its unique perspective, focus on continuous innovation, and willingness to take calculated risks, particularly in the transition to programmable GPUs. Entrepreneurial success often requires the ability to see the world differently, take calculated risks, and constantly reinvent oneself in a competitive market....
NVIDIA's success is attributed to its strategic decisions, innovative approaches, and resilient leadership under Jensen Huang, transforming the company from a 3D graphics pioneer to an AI trailblazer. NVIDIA's commitment extends beyond technological innovation, inspiring young minds and addressing global challenges through AI and STEM education....
Huang detailed the company's progress in GPUs, AI, and simulation platforms like Omniverse, emphasizing the evolution of GPU architecture, the significance of large language models, the potential of OpenUSD for 3D innovation, and the application of AI in digital industrialization....
NVIDIA's strategic dominance in AI hardware, trade-offs in workload management, and the implications of AI on chip design are key factors shaping the evolution of AI. Jensen Huang's leadership emphasizes continuous learning, curiosity, and fostering a conducive work environment to drive innovation in AI and related technologies....