Danny Hillis (Applied Minds Co-founder) – Richard Feynman and Parallel Computers (2018)

Chapters

Abstract

The Pioneering Legacy of Richard Feynman in Parallel Computing and Beyond

Abstract: Richard Feynman, a luminary in physics, left an indelible mark on the field of parallel computation and inspired a generation of scientists and innovators, including Danny Hillis. From his involvement in the development of the Connection Machine, a revolutionary parallel computer, to his unique contributions in management, problem-solving, and experimentation, Feynman’s impact extended far beyond traditional physics. This article delves into Feynman’s multifaceted contributions, exploring his role in shaping the early days of parallel computing, his influence on the work culture and problem-solving approaches of his team, and his enduring legacy in various scientific fields.

1. Introduction

Richard Feynman, renowned for his work in quantum mechanics, played a pivotal role in the development of parallel computation. His collaboration with Danny Hillis in the creation of the Connection Machine, a groundbreaking parallel computer, not only transformed computational possibilities but also laid the groundwork for quantum computing. Feynman’s approach to problem-solving, his management style, and his personal eccentricities greatly influenced the culture and success of the project. This article examines the profound impact of Feynman’s involvement in parallel computing and his lasting legacy in various scientific domains.

2. The Birth of Parallel Computation: Feynman and the Connection Machine

The Connection Machine, conceived by Danny Hillis and propelled by Feynman’s insights, represented a quantum leap in computer design. With its 65,000 processors, this massively parallel computer demonstrated the potential of high-scale parallel architectures. Feynman’s involvement was crucial, from the microcode optimizations for logarithmic calculations to managing team morale. His influence was also evident in the resolution of technical challenges, such as the efficient routing of messages within the system, a problem elegantly solved through differential equations.

In the process of building the Connection Machine, Feynman also made significant theoretical and practical contributions. He proposed a differential equation-based approach to determine the number of buffers needed for efficient message routing, which proved accurate and led to the successful design of the routing chip. Additionally, Feynman developed a table-based method for calculating logarithms, which was faster than the division routine and became part of the machine’s microcode.

Feynman’s involvement in the project went beyond technical contributions. He played a vital role in fostering a positive and productive work culture. Drawing inspiration from his experience at Los Alamos, Feynman emphasized the importance of structured organization, regular knowledge sharing, and open communication. His enthusiasm and passion for the project were contagious, motivating the team and keeping them engaged. Freeman Dyson, a colleague of Feynman, described him as a “half genius, half buffoon” who brought vitality and amusement to his colleagues. Despite his unconventional approach, Feynman’s unique personality and ability to spark new ideas had a profound impact on the project’s success.

3. Feynman’s Multifaceted Contributions

Beyond technical expertise, Feynman brought a unique culture to the project. Drawing from his experience at Los Alamos, he emphasized structured organization and regular knowledge sharing. His enthusiasm and passion for the project were infectious, fueling a vibrant and engaging work environment. Moreover, his approach to problem-solving, focusing intensely on captivating issues and disregarding distractions, exemplified his unconventional but effective method of work.

4. The Impact of Feynman’s Legacy

Feynman’s contributions extended far beyond the walls of the laboratory. The Connection Machine’s success heralded new frontiers in artificial intelligence, neural networks, and scientific simulations. Feynman’s influence is also seen in the architecture of modern chips, such as those by NVIDIA. His legacy is further reflected in the experimental approaches he took with Hillis, including playful explorations with microwaves and the enigmatic problem of spaghetti breakage.

Danny Hillis, a close collaborator of Feynman, provided valuable insights into Feynman’s personality and impact.

The CM5 and Its Success:

Hillis and his team developed the CM5, a parallel processing supercomputer that became a precursor to today’s cloud computing systems. The CM5’s commercial microprocessor architecture made it a workhorse for scientific computing, ranking among the world’s fastest machines for years.

Feynman’s Involvement and Contributions:

Feynman was deeply involved in the development of the CM5, not only writing microcode but also personally preparing the unveiling event. Despite his eccentricities, Feynman’s dedication and focus on his work were instrumental in the CM5’s success.

Feynman’s Stubbornness and Unconventional Approach:

Feynman possessed a stubbornness in understanding things on his own terms, often refusing to conform to conventional methods. Hillis recalls Feynman’s insistence on using “plus” and “minus” instead of “ones” and “zeros” during their initial discussions about computers.

Feynman’s Unwavering Focus and Prioritization:

When engrossed in a problem, Feynman exhibited an unwavering focus, dismissing distractions and interruptions. His priorities were entirely self-determined, and he would work tirelessly on a problem, regardless of its significance, until he made progress or deemed it futile.

Feynman’s Selectivity in Project Involvement:

Feynman had a specific idea of the projects he wanted to work on, often declining requests that fell outside his interests. He would occasionally return to a declined project after some time, but his initial response was typically a firm rejection.

Feynman’s Eccentricities as a Reflection of His Passion:

Hillis suggests that Feynman’s eccentricities, while sometimes challenging, were an integral part of his creative process and passion for his work. Feynman’s ability to focus intensely on his interests and ignore distractions allowed him to make significant contributions to various fields.

5. Beyond Parallel Computing: Feynman’s Broader Influence

Feynman’s curiosity and innovative spirit led him to explore various fields, from evolutionary biology to the investigation of the Challenger disaster. His insights into non-Darwinian evolution and his dissenting report on NASA’s bureaucratic issues demonstrated his wide-ranging impact. Even in his final days, Feynman emphasized the importance of sharing knowledge, leaving a legacy that continues to inspire scientists and thinkers globally.

Feynman’s quirks and relationship with women also shaped his interactions and contributions.

Feynman’s Attitude Towards Women:

Feynman treated women respectfully and avoided giving them unwelcome attention. He would sometimes ask female colleagues to get him food, which some found bothersome but appreciated his attention. Despite this, he engaged with women in a silly and fun manner, sometimes crossing boundaries.

Feynman’s Aversion to Bureaucracy:

Feynman strongly disliked bureaucratic processes and paperwork. He initially refused to sign multiple times for the Challenger investigation but eventually agreed to sign his name only 10 times. He refused to cash the consulting fee check because he had exceeded the limit of 10 signatures.

Feynman’s Fun Experiments:

Feynman enjoyed conducting fun experiments with Danny Hillis. They experimented with various objects in a microwave oven, including Christmas bulbs, light bulbs, and eggs. One of their notable experiments involved studying the behavior of spaghetti when it breaks, leading to insights about the properties of the pasta.

6. Conclusion

Richard Feynman, often remembered for his brilliance in physics, was also a visionary in the field of parallel computation and beyond. His contributions to the development of the Connection Machine and his influence on the culture of scientific exploration have left a lasting impact. Feynman’s legacy is a testament to the power of interdisciplinary collaboration, unconventional thinking, and the relentless pursuit of knowledge.

Danny Hillis shared additional recollections of his experiences with Feynman, further illuminating Feynman’s impact.

Spaghetti Breaking:

Experiments with spaghetti led to interesting observations and a surge of research papers on spaghetti breaking. A recent breakthrough revealed that with the right amount of torque, spaghetti can break in half instead of multiple pieces.

Quantum Computing:

Feynman believed in the potential of quantum computing and made efforts to explore its possibilities at Thinking Machines. Despite progress in the field, a general-purpose quantum computer hasn’t yet outperformed a classical computer on an interesting problem.

Challenger Disaster:

Feynman’s involvement in the Challenger disaster investigation brought attention to systemic problems within NASA. His contrary report highlighted bureaucratic issues that suppressed dissenting opinions and prioritized schedules over technical expertise. His efforts had a positive impact on NASA and eventually led to changes.

Evolutionary Biology:

Hillis and Feynman worked on understanding how traits that require multiple genes can evolve. They developed a reaction-diffusion model that explained non-Darwinian evolution and genetic drift. Their theory had been anticipated by Kimura’s work, which had not received much attention.

Final Meeting with Feynman:

Feynman shared anecdotes about his medical treatments and his awareness of his deteriorating condition. He expressed a philosophical perspective on death, viewing it as a natural part of life. Feynman emphasized the continuation of his legacy through the stories and ideas he had shared with others.

Feynman’s Enduring Legacy:

Feynman’s impact extends beyond those who knew him personally. His teachings, writings, and anecdotes continue to inspire and influence people, even after his passing. Hillis reflects on how he often thinks about how Feynman would approach various problems, demonstrating the internalization of Feynman’s approach.

Notes by: crash_function