Jensen Huang (Nvidia Co-founder) – [Excellent] Remarks at OSU Kelley Engineering Center (Mar 2013)


Chapters

00:00:05 Oregon State University Experience of NVIDIA Founder and CEO Jensen Wong
00:05:10 History of Semiconductor Design Methodology
00:13:44 The Genesis of NVIDIA: A Journey of Innovation and Passion
00:17:01 The Significance of Intending to Create Important and Difficult Work
00:23:28 Birth and Death of an Assumption: The Tale of 3D Graphics
00:28:12 From Last Place to Innovation Leader
00:36:38 The Rise and Reinvention of 3D Graphics
00:48:29 Mission Statements: Defining a Company's Purpose
00:51:07 NVIDIA's Journey to Programmable Graphics
00:58:35 NVIDIA's Evolution: From PCs to Mobile and Cloud
01:01:50 Journey of a Startup Founder: From Venture Capital to Cloud Graphics Challenges
01:10:28 Revolutionizing Graphics for Cloud Computing
01:13:11 Lessons Learned from an OSU Education

Abstract

NVIDIA’s Journey: From Campus Memories to Revolutionizing 3D Graphics

Abstract:

Jen-Hsun Huang, CEO and co-founder of NVIDIA, delivered a compelling narrative at Oregon State University, retracing his steps from a university student to leading a revolutionary force in the 3D graphics industry. His journey is marked by serendipitous encounters, a relentless pursuit of passion, and strategic pivots that transformed the technological landscape. This article encapsulates Huang’s path, emphasizing the significance of design methodologies, the courage to embrace risks, and the visionary approach that steered NVIDIA through challenges and innovations.



I. Introduction: Remembering the Roots

Jensen Wong, while addressing his alma mater, reminisced about his formative years at Oregon State University. Graduating in 1984, he reflected on the serendipitous meeting with his wife, Lori, also an electrical engineering student. Wong humorously highlighted the improbability of their meeting in a male-dominated field. His journey began with a fascination for microprocessors, leading to a stint at AMD and nurturing his passion for technology.

Wong’s life philosophy, encapsulated in three questions, guides his endeavors: Is the work something you love and find worthwhile? Is the work hard to do? Is the work worthy of the talent and effort of your team? These questions, applied to NVIDIA’s venture into 3D graphics in 1993, led to the conclusion that the industry had major potential, albeit difficult to master. Despite the challenges, NVIDIA pursued 3D graphics out of passion and belief in its value.

II. The Inception of NVIDIA

Wong’s narrative shifted to the foundation of NVIDIA in 1993, amidst a backdrop of technological evolution and market uncertainties. NVIDIA’s early days were marked by ambitious goals and a vision to democratize 3D graphics technology. Wong, along with his co-founders Chris Malachowski and Curtis Preem, saw 3D graphics not just as a technological advancement but as a new medium for storytelling, interactive and distinct for each user.

The pursuit of 3D graphics was driven by Wong’s belief in the transformative power of passion. He emphasized the importance of loving one’s work, recognizing its difficulty, and acknowledging its worthiness of one’s talent and effort. These principles, applied to NVIDIA’s early endeavors, led to a focus on creating groundbreaking 3D graphics technology that would change the world.

III. Overcoming Market Disruptions

The early successes, however, were soon challenged. The collapse of DRAM prices in 1995 disrupted NVIDIA’s business model, and technological shifts rendered their initial technologies obsolete. Competitors moved towards OpenGL, embracing new techniques like inverse texturing. NVIDIA’s response was a strategic pivot towards developing GPUs, a decision that would cement their position in the graphics industry.

The DRAM price drop in 1995, from $50 to $5 per megabyte, significantly impacted NVIDIA’s assumptions about the market. As DRAM prices are driven by supply and demand, similar to commodities like pork bellies and orange juice, this sudden shift forced NVIDIA to adapt. The company transitioned from being the first in 3D graphics to the last, embracing this position to study competitors’ strategies and play their final hand aggressively.

IV. The ‘Last-Hand’ Strategy

At a critical juncture in 1985, NVIDIA faced a dilemma: conform to industry standards or innovate independently. Choosing the latter, they invested in the Icos Emulator, a risky move that paid off by accelerating the development cycle of their Riva 128 chip. This chip, a technological marvel with a 100-megapixel fill rate texture map Z-buffered engine, marked NVIDIA’s triumphant entry into the graphics market.

In a critical situation with only nine months of funding left and a two-year development cycle for their 3D graphics chip, Jen-Hsun Huang made a bold decision to invest in an emulator machine, the Icos Emulator, to develop software before chip production. This risky move allowed NVIDIA to perfect the chip before tape-out, ensuring a flawless product launch. Riva 128 was the world’s first graphics chip to exceed expectations and became a revolutionary product, bringing forth advanced features like 100-megapixel fill rate texture mapping and Z-buffering, enabling complex 3D graphics with limited CPU resources. Riva 128’s success propelled NVIDIA to become the industry leader in 3D graphics.

V. Reinventing and Evolving

Jensen Wong’s philosophy of reinvention and adaptation played a pivotal role in NVIDIA’s growth. The company constantly sought to redefine its mission, moving from fixed-function graphics to programmable shaders, and later embracing CUDA for computational graphics. This adaptability extended to recognizing the potential of mobile and cloud computing, leading to innovations like Tegra, Shield, and Grid.

VI. Securing the Future

The journey also highlights Huang’s tenacity in securing funding, convincing venture capitalist Don Valentine with NVIDIA’s potential. The investment hinged on three criteria: a killer product, a huge market, and a capable team. Huang’s conviction and vision successfully navigated these criteria.

VII. Navigating Technical Challenges

NVIDIA’s journey was not without technical hurdles. The challenge of latency in cloud graphics processing was significant, especially in contexts like gaming where milliseconds mattered. NVIDIA’s response was the Kepler GPU, the first virtualizable GPU, and the development of a comprehensive cloud graphics solution.

The speed of light and latency pose significant challenges for cloud graphics processing. The need for real-time interactivity requires data to travel through various components within a limited timeframe. The distance between the user and the cloud server introduces additional latency, affecting the responsiveness and interactivity of cloud graphics processing. Avid gamers and professional gamers are particularly sensitive to latency and can notice delays as low as 60 to 90 milliseconds. In games like Guitar Hero, latency can significantly impact gameplay, leading to the need for prediction and anticipation. Overcoming latency is a key challenge in enabling effective cloud graphics processing, requiring innovations in technology and network infrastructure to reduce latency and improve the user experience.

VIII. Educational Foundations and Personal Growth

Wong’s story circles back to his formative years at OSU, emphasizing the impact of people he met, particularly his wife, and the teachings of Professor Amort. These experiences shaped his approach to leadership and problem-solving, highlighting the importance of core principles and social growth alongside academic achievements.

At OSU, Lori Huang (his wife) was a significant influence on Wong. The importance of the people you meet, especially for him, was a key lesson. Professor E.E. Fundy’s class, which emphasized the understanding of first principles and key variables rather than specific details, led to “CEO math,” where round numbers are used to focus on the most important variables. Academics was always a given for Jen-Hsun, but learning social skills was new and challenging for him. He found a good friend in Henry Weinhardt, highlighting the importance of friendships in personal growth. Social growth is considered equally important to academic growth, especially for introverted and shy individuals.

IX. A Vision Realized

NVIDIA’s journey, as narrated by Jen-Hsun Huang, is a testament to vision, innovation, and resilience. From the halls of Oregon State University to leading a revolution in 3D graphics, Huang’s story is one of transcending challenges, embracing serendipity, and relentless

pursuit of passion. NVIDIA, under Huang’s leadership, transformed 3D graphics from a feature into a thriving industry, redefining storytelling in the digital age.



Author’s Note: This article, spanning 1500-2000 words, encapsulates the inspiring narrative of Jen-Hsun Huang and NVIDIA, providing insights into the interplay of personal growth, technological innovation, and strategic foresight in shaping a technological giant.

Supplemental Update:

The evolution of NVIDIA’s graphics processors from Riva 128 to GeForce GTX Titan highlights the rapid advancement in transistor count. Riva 128 had 3 million transistors, while the latest GeForce GTX Titan boasts 7 billion transistors. This exponential growth exceeds Moore’s Law’s predictions, showcasing the relentless pursuit of computational power in GPUs.

NVIDIA faced the challenge of reinvention when Intel entered the integrated 3D graphics market. The company’s unique perspective on the future of 3D graphics led to a strategic shift, focusing on programmability and parallel processing. This vision resulted in the development of programmable shaders, transforming GPUs into powerful computing platforms.

NVIDIA’s bold decisions and innovative spirit have cemented its position as a technology leader in the graphics industry. The company’s relentless pursuit of computational power and reinvention has driven the growth of 3D graphics and revolutionized fields such as gaming, AI, and scientific computing. NVIDIA continues to push the boundaries of what is possible with GPUs, shaping the future of computing and enabling groundbreaking technological advancements.

Jen-Hsun Huang emphasizes that NVIDIA’s mission statement, centered around 3D graphics as a storytelling medium, may sound abstract and open-ended. He contrasts this with other companies’ mission statements, such as building the fastest graphics chip or being a one-stop shop for industry-standard PC components.

Huang points out that mission statements focused on achieving a specific benchmark, like building the fastest chip, limit a company’s perspective to the present and restrict innovation. Similarly, mission statements aimed at meeting industry standards limit differentiation and exploration beyond existing norms.

NVIDIA’s mission statement, while broad and potentially open-ended, allowed the company to explore new possibilities and push boundaries in 3D graphics technology. It enabled NVIDIA to envision and create new applications and use cases for graphics beyond traditional benchmarks and industry standards.

A mission statement that focuses on creating a new medium for storytelling, like NVIDIA’s, encourages a forward-looking mindset and opens up opportunities for innovation and disruption. It allows a company to transcend existing limitations and create entirely new categories and markets.

NVIDIA’s mission was to make 3D graphics a more expressive medium for storytelling. John Carmack’s game Doom revolutionized the gaming industry, highlighting the need for more expressive graphics. NVIDIA introduced programmable shaders, allowing for greater customization and diversity in game graphics. This innovation saved the company from the commoditization of fixed function graphics acceleration.

NVIDIA ventured into computational graphics, introducing CUDA technology. This opened up the GPU for programmability in various applications beyond traditional graphics.

Jen-Hsun Huang emphasizes the significance of doing relevant and exquisite work. He believes that creating shareholder value is important, but it should not compromise the quality of the work. Huang stresses the importance of doing work that one can be proud of, even if it goes unnoticed by others.

NVIDIA faced the reality that shareholder reports are rarely read. Huang insisted on putting heart and soul into the report, even if only a few hundred people would read it. He believes that every piece of work, no matter how small or unseen, should be done with the utmost effort and pride.

Huang highlights the significance of personal judgment in evaluating one’s work. He believes that individuals should strive to do their best work, even if it is only seen by themselves. Ultimately, the goal is to create work that one can be proud of, regardless of external recognition.


Notes by: QuantumQuest