Doug Engelbart (Doug Engelbart Institute Founder) – Inventing the Computer Mouse | Talks at Google (Aug 2007)
Chapters
00:00:00 Origins of Dynamic Information Structuring
Doug Engelbart’s Vision of Computers as Media: Doug Engelbart’s vision in the early 1950s was that computers would become the primary medium for accessing and understanding complex world problems and their potential solutions. He realized the need for better ways to collectively comprehend the scope and nature of these problems and solutions.
The Genesis of Engelbart’s Career in Computing: Engelbart’s career in computing began after he started contemplating his career path upon getting engaged. He recognized the need for a meaningful career goal and realized he lacked one beyond his interesting job. After months of reflection, he concluded that contributing to solving the world’s complex problems through better understanding and potential solutions would be the most significant contribution he could make. This led him to pursue computer science and join a research project at Berkeley to build a computer.
Engelbart’s Focus on Structured Information and Dynamic Views: Engelbart’s approach to information and media in computers was not primarily about aesthetics but rather about structuring information for easy access and manipulation. He recognized the potential of computers to provide multiple views of the same material, tailored to different purposes and contexts. He introduced the concept of the hyperlink, allowing specific passages within documents to be linked and accessed directly. Engelbart also developed the idea of “view specification” to transform and present information in different formats and perspectives.
Mobility and Dynamic Views in Digital Media: Engelbart emphasized the importance of mobility and dynamic views in digital media, enabling users to navigate and explore information in various ways. He envisioned a future where books would become obsolete due to the superior flexibility and interactive capabilities of digital media. He introduced features such as jumping between sections and filtering content based on keywords or phrases, enhancing the exploration and understanding of information.
The Significance of Bootstrapping: Engelbart’s concept of bootstrapping involved using existing tools and resources to create more advanced tools and capabilities. He believed in iteratively improving and refining tools through a continuous cycle of development and refinement. This approach allowed him and his team to make significant progress in developing new technologies and applications.
00:05:41 Augmentation, Bootstrapping, and Improvement: Building and Using Tools for Collective
Augmentation: A Historical Perspective: Augmentation has played a crucial role in enhancing our cognitive capabilities throughout history. Writing and various tools have facilitated our capacity to think, communicate, and reason. Computers emerged as a powerful means to further augment our intellectual capabilities.
The Role of Bootstrapping in Augmentation: Bootstrapping involves leveraging the tools we create to improve and build better tools. This iterative process leads to a cycle of continuous improvement and augmentation.
The Concept of Network Improvement Communities: Network improvement communities involve groups collaborating and bootstrapping collectively to achieve a shared goal. Google’s products serve as an example of how this concept can enhance the capabilities of product developers and marketers.
The Importance of Studying Documents: Studying documents effectively requires partitioning, viewing, and moving around flexibly within the document. Google can contribute by focusing on specific capabilities that enable users to read, integrate, and synthesize information effectively.
Google’s Response to Doug’s Ideas: Google acknowledges the significance of augmentation and the interplay between human and tool systems. The science behind sensory, perceptual, motor, mental, and other aspects provides a foundation for research and development in this area. Google emphasizes the importance of continual improvement, similar to the concept of debugging, in achieving ongoing progress.
00:11:30 Knowledge Repository for Continual Improvement
ABC Model of Continual Improvement: Identify and fix bugs (A). Search for similar bugs preemptively (B). Prevent bugs from occurring in the first place (C).
Inbreeding the Idea of Continual Improvement: Creating an effective organization requires instilling the concept of continual improvement in its members.
Dynamic Knowledge Repository: Stores improvements for sharing within and outside the organization. Facilitates horizontal knowledge-sharing among companies, academics, and individuals. Not all knowledge is shared due to individual organizations’ secrecy needs.
Brief Explanation of Kodiak: Kodiak is a knowledge repository used by large organizations to aggregate, resolve, and share knowledge. It enables collective understanding and continual improvement.
Bootstrapping Process: Knowledge repositories should be interconnected and coherent rather than fragmented. A fundamental knowledge repository would be one that describes how to build knowledge repositories. The better we become at building knowledge repositories, the better we will improve our ability to acquire knowledge. Groups of people working together can bootstrap collaboratively to create knowledge repositories about building knowledge repositories.
Networked Improvement Communities: Other improvement communities exist in various professional societies. Networked improvement communities adopt new networking methods to enhance their ability to create knowledge repositories.
00:16:31 Exploring the Co-evolution of Human and Tool Systems
How to Improve Knowledge Sharing: Use a simple feedback loop: Start with what you know, make it easily shareable and improvable, and incorporate improvements into the process itself. Share as much as possible: The more people who can view and contribute to your work, the better the results can be.
Human and Tool Systems: Human systems organize people, conventions, rules, and language for collaboration. Tool systems facilitate collaboration and include physical tools like projectors and chairs as well as digital tools like computers and software. The co-evolution of human and tool systems involves changes in one influencing the other.
The Potential of Technology for Knowledge Sharing: Computers, hypermedia, and the web can facilitate the creation of structured, verified, and coherent knowledge repositories.
Viewing Dynamics: Viewing documents as trees rather than pages allows for zooming in and out, collapsing nodes, and linking nodes in different orders. This provides increased capabilities for studying and communicating but has been overlooked due to the emphasis on simplicity and ease of use.
Challenges in WYSIWYG: The emphasis on making things look like pages in a book rather than building in the structure necessary for indexing and linking has limited the potential of WYSIWYG (What You See Is What You Get) editors.
00:26:55 Expanding the Capabilities of the Open Hyper Document System
Doug Engelbart’s Vision for an Open Hyper Document System: Engelbart emphasizes the significance of paradigms in shaping societal views and their resistance to change. He highlights the need for cultivating change to enhance capability in the world.
Challenges in Advancing the Open Hyper Document System: Sub-addressability of structured document parts is a key missing feature compared to the web. Lack of adoption of proposals for sub-addressing, such as Mark Torrance’s suggestion to use a question mark after the URL. Uncertainty about the crucial nature of a central repository for links.
Capabilities Enabled by an Open Hyper Document System: Different views on a file, allowing authors and readers to customize presentation and consumption. Extended capabilities for exploring links and their sources.
Potential Contributions from Google: Extending capabilities offered to users, moving beyond traditional books and pages. Incorporating dynamic structures, linking, and viewing features. Establishing a dynamic knowledge repository. Supporting research on enhanced studying efficiency with multiple views. Developing a view where different syntactic parts of speech are color-coded.
Practical Steps for Google: Offering extensions that are useful for internal activities and can grow externally. Conducting research on how multiple views can improve studying efficiency. Exploring the feasibility of a view where syntactic parts of speech are color-coded.
00:34:12 Addressing Knowledge Capture Challenges in the Digital Age
General Discussion and Call for Questions: The speakers opened the floor for questions and comments from the audience regarding the presented material.
Importance of Capturing Disagreement and Controversy: An audience member emphasized the need to capture not only consensus knowledge but also the state of disagreement and knowledge in live controversies. This type of knowledge is crucial for understanding the dynamics of complex issues and fostering informed decision-making.
Potential Role of Google in Argument Structuring: The speaker suggested that Google could play a significant role in developing tools and platforms for structuring and visualizing arguments. This would enable users to more easily identify and engage with relevant arguments on various topics.
Challenges in Structuring Arguments: The speaker acknowledged the challenges in capturing arguments in a structured manner, particularly in a way that is accurate and comprehensive. Pointing to specific statements or documents can be helpful, but a more coherent and comprehensive approach is needed.
Potential Benefits of Argument Structuring: The speaker highlighted the potential benefits of building coherent argument structures, including enhancing social value and fostering informed decision-making. Google’s resources and expertise could be instrumental in driving this development.
Wikipedia as a Starting Point: An audience member inquired about the extent to which Wikipedia meets the needs for capturing and structuring knowledge. The speaker acknowledged Wikipedia as an impressive start but noted its limitations in terms of dynamic views and structured exploration of arguments.
Need for More Dynamic and Structured Views: The speaker emphasized the need for more dynamic and structured views of knowledge, allowing users to explore and analyze arguments in a more comprehensive and interactive manner.
Complexity of Capturing and Structuring Knowledge: The speaker acknowledged the complexity of capturing and structuring knowledge, particularly in the context of Wikipedia and similar platforms. He expressed a desire to delve deeper into these issues in future discussions.
00:39:52 Visualizing Information in the Mind vs. on the Page
Comparing Text Editing in Wikipedia and NLS: Wikipedia allows users to edit text files and generate a display from them. NLS and proposed systems enable direct editing of the structure, with different views generated from that structure.
Underlying Logic and Argumentation: Doug Englebart argues that the ultimate representation of knowledge is how it exists in our minds. Wikipedia serves as a display mechanism, while Englebart’s approach focuses on the logic and structure of arguments, not just formal logic but also how people make arguments.
Barriers to Adoption of New Content Delivery Methods: Englebart expresses frustration over the consistent rejection of new ways of portraying and using knowledge. He acknowledges that he may have contributed to this by not actively promoting and selling these ideas.
Historical Shift towards Pages and Fixation on the Page Paradigm: The introduction of pages and laser printers led to a shift away from dynamic and interactive approaches to knowledge representation. Englebart believes this fixation on pages has hindered progress and resulted in a stagnant paradigm.
Transition from Print to Digital and the Importance of Natural Organization: Englebart emphasizes the significance of moving away from the page, comparing it to the transition from pre-literate societies to the widespread adoption of reading and writing. He advocates for embracing new methods of organizing and interacting with information, similar to how we naturally organize it on our desks and in our lives.
Semantic Constructs in Wikipedia and the Potential for Progress: Englebart acknowledges recent efforts in Wikipedia to add semantic constructs to pages. He views this as a step in the right direction but expresses uncertainty about the specific details of this implementation.
Exploring Alternative Structures for Information Interaction: Englebart highlights the disparity between how we organize information on the internet (e.g., web pages) and how we naturally interact with information in real life. He questions whether there are more effective and natural structures for consuming information online, beyond the web page format.
00:45:33 Augmenting the Capabilities of Information Creation and Consumption
Benefits of Moving Beyond Traditional Books: The traditional book orientation limits the flexibility and accessibility of information. Removing these ties allows for more dynamic and interconnected knowledge aggregation. Embedding documents within documents enables explicit referencing and argumentation.
Structured Argumentation: Structured argumentation provides a framework for organizing and presenting arguments. It helps identify relationships between claims, evidence, and counterarguments. Links can point to specific sections of a document, allowing for contextual display.
Augmented Systems and Open Hyper Documents: The “include” function in augment systems allows for the inclusion of paragraphs or sections from other documents. Open hyper documents enable multiple views of the same concept, catering to different user needs.
Challenges of Authoring Abstract Information: Abstract information requires a representation for readers to consume it. Converting abstract knowledge into a tangible representation can be challenging. Authoring tools and conventions play a crucial role in facilitating the creation of accessible information.
Augmenting Information Generation Capabilities: Augmenting information generation capabilities involves enhancing tools, practices, conventions, and agreements. This augmentation improves the process of creating and sharing information effectively.
00:50:13 Creating and Sharing Knowledge in Digital Collaborations
General Discussion: The potential benefits of having a computer system that can support the evolution and reconstruction of arguments and concepts were discussed. The challenge of creating documents with multiple views and the potential for it to become easier with experience and teaching were mentioned. The idea of a “knowledge architect” in an improvement community who develops rules for creating reusable knowledge products was brought up.
Improving Communication and Collaboration: The importance of capturing customer perspectives and knowledge was highlighted, along with the need for effective communication channels to share this information within companies. The desire for a system that allows for real-time comments and feedback on ideas before they are fully implemented was expressed. The current slow process of recording dialogue using audio tape and transcripts was acknowledged, and the potential for a more efficient method was discussed.
Expanding Knowledge Contributors: The historical analogy of priests being the only literate individuals was used to illustrate the current situation with computer programmers being the primary creators of software process knowledge. The question of whether non-professional programmers could contribute to this knowledge was raised, with a focus on democratic participation in building dynamic knowledge repositories.
Google’s Potential Role: The possibility of Google taking a leadership role in promoting sound argument structures and facilitating ongoing debates was suggested. The idea of Google using its platform to demonstrate the feasibility and benefits of such a system was discussed.
Call to Action: An invitation was extended for individuals interested in exploring these ideas further to join a discussion group and continue the dialogue.
Abstract
“Revolutionizing Knowledge: From Doug Engelbart’s Vision to Dynamic Knowledge Repositories”
In the rapidly evolving landscape of information technology, the pioneering vision of Doug Engelbart, dating back to the 1950s, has significantly influenced the way we interact with and process information. Engelbart’s dream, centered around the transformation of computers into primary mediums for accessing and manipulating information, has given birth to innovative structures like DreamSum and concepts like bootstrapping and human-tool co-evolution. Engelbart’s career in computing began after contemplating his career path upon getting engaged, realizing the need for a meaningful career goal and resolving to contribute to solving the world’s complex problems through better understanding and potential solutions. Engelbart pursued computer science and joined a research project at Berkeley to build a computer. This article delves into the paradigm shifts proposed by Engelbart, the challenges and potential solutions in implementing these revolutionary ideas, and the role of entities like Google in advancing the concept of an open hyper document system. By exploring the inception of these ideas and their evolution, we aim to highlight the crucial transition from traditional book-oriented knowledge to flexible, dynamic knowledge repositories and the vital role of collaboration and continual improvement in this journey.
Engelbart’s Early Vision
Doug Engelbart’s early vision in the 1950s was not just about the aesthetic improvement of documents but the structural revolution in how we access and manipulate information. He foresaw computers transcending traditional page views, introducing dynamic, structured, and interactive formats. His work with DreamSum exemplified this, focusing on hyperlinks for direct navigation and view specifications for diverse information representation, pushing the boundaries beyond conventional books. Engelbart’s approach to information and media in computers was not primarily about aesthetics but rather about structuring information for easy access and manipulation. He recognized the potential of computers to provide multiple views of the same material, tailored to different purposes and contexts.
Knowledge Repositories and Bootstrapping
Engelbart envisioned a fundamental knowledge repository that would describe how to build knowledge repositories themselves. This concept highlights the recursive nature of knowledge acquisition: as our proficiency in creating knowledge repositories grows, so does our collective ability to gather and process knowledge. This process of collaborative bootstrapping, where groups of people work together to create knowledge repositories about building knowledge repositories, underpins the collective advancement of human understanding. Additionally, networked improvement communities within various professional societies are adopting new networking methods to further enhance their capacity to create and share knowledge repositories.
Tools, Bootstrapping, and Augmentation
Engelbart and his team pioneered the development of various tools using a bootstrapping approach, which involves using existing tools to create more advanced systems. This iterative process is fundamental to enhancing human intellect and collective IQ. The concept of augmentation, a core aspect of Engelbart’s vision, focuses on enhancing human capabilities through technology, transitioning computers from mere automation devices to tools of augmentation. Engelbart’s bootstrapping ideology revolves around the continuous cycle of development and refinement of tools and resources to create more advanced capabilities. Throughout history, augmentation has been crucial in enhancing our cognitive capabilities, with writing and various tools facilitating our capacity to think, communicate, and reason. Computers have emerged as a powerful means to further augment our intellectual capabilities.
Google’s Role and Continuous Improvement
Google recognizes the importance of combining human and tool systems in the process of augmentation. This includes considering the sensory, perceptual, and mental aspects of human interaction with technology and aligning these with business practices like bug fixing. The concept of a dynamic knowledge repository, such as Kodiak, is central to this approach, enabling shared learning and faster collective improvement. Google’s products serve as an exemplar of how this concept can be leveraged to enhance the capabilities of product developers and marketers. Google also underscores the significance of continual improvement in achieving ongoing progress, mirroring the concept of debugging. This involves starting with what you know, making it easily shareable and improvable, and incorporating improvements into the process itself. Sharing as much as possible enhances the results, as more people can view and contribute to the work. Additionally, the co-evolution of human and tool systems, involving changes in one influencing the other, is crucial. Human systems organize people, conventions, rules, and language for collaboration, while tool systems, including both physical and digital tools, facilitate this collaboration.
Paradigm Shift and Challenges in Implementation
The paradigm shift towards an open hyper document system, as envisioned by Engelbart, encounters several challenges. One such challenge is the web’s lack of sub-addressability, which hinders linking to specific parts of a document. While there have been proposals, like Mark Torrance’s in 1991, to address this issue, their widespread adoption has been limited. The establishment of a central repository for links could ameliorate issues like broken links, thus enhancing the system’s reliability and accessibility. Engelbart’s vision emphasizes the significance of paradigms in shaping societal views and their inherent resistance to change. He advocates for cultivating change to enhance global capability. However, the challenges in advancing the open hyper document system are notable, including the lack of structured document part sub-addressability, limited adoption of sub-addressing proposals, and uncertainty about the essential nature of a central repository for links.
The Role of Customization and Reader Control
Customization in document presentation and reader control over content consumption has become increasingly prevalent. Tools like Grease Monkey empower users to override author-defined CSS, providing greater control over content. Enhancing the link database to include backlink sources could further improve content discoverability and tracking. The capabilities enabled by an open hyper document system include offering different views on a file, allowing authors and readers to customize presentation and consumption. This also extends to capabilities for exploring links and their sources.
Knowledge Integration and NLS vs. Wikipedia
The integration of knowledge within a community, making it accessible to all, is invaluable. Computers, hypermedia, and the web significantly facilitate the creation of such repositories. NLS (oN-Line System) documents, for example, are organized as trees with capabilities for zooming, collapsing, and linking, providing multiple structures for the same content, in contrast to Wikipedia’s text-based presentation. Viewing documents as trees rather than pages enables zooming in and out, collapsing nodes, and linking nodes in different orders, increasing capabilities for studying and communicating. However, this has been overlooked due to an emphasis on simplicity and ease of use. The challenges in WYSIWYG editors stem from their focus on making things look like pages in a book rather than building in the necessary structure for indexing and linking, limiting their potential.
Overcoming Barriers to Adoption and the Allure of Pages
Despite the advantages of new methods of knowledge presentation, media content providers have been slow to adopt them. The focus on pages, especially with the advent of laser printers, has led to a regression in exploring dynamic knowledge representation. However, Wikipedia’s move towards adding semantic constructs is a step towards overcoming these barriers.
Internet vs. Natural Information Organization
There is a notable discrepancy between the internet’s organization of information and natural human organization. The current structure may not be optimal, and exploring alternative visual formats or ideas could improve this situation.
Embracing Flexibility and Structured Argumentation
A shift away from traditional book orientation towards flexible aggregations of knowledge is essential. Structured argumentation, allowing explicit referencing and embedding of documents, enhances the clarity of arguments and counterarguments. Open hyper documents offer diverse views, catering to different perspectives and needs. However, authoring abstract information remains challenging
, requiring representations that are accessible to others.
Expanding Beyond Professional Programmers
Involving non-programmers in knowledge structuring and utilization is crucial for democratizing knowledge building. This approach echoes the historical shift from literacy being confined to priests to becoming accessible to the broader populace.
Google’s Potential Role in Structured Argumentation
Google could significantly contribute to developing sound and challengeable argument structures. Leveraging its platform for structured argumentation and ongoing dialogue could demonstrate the feasibility and benefits of these concepts. Google’s potential contributions include extending capabilities offered to users, incorporating dynamic structures, linking, and viewing features, and establishing a dynamic knowledge repository. Google could also support research on enhanced studying efficiency with multiple views and develop a view where different syntactic parts of speech are color-coded. Practical steps for Google involve offering extensions useful for internal activities that can grow externally, conducting research on how multiple views can improve studying efficiency, and exploring the feasibility of a view where syntactic parts of speech are color-coded.
Conclusion
The evolution of information technology, as envisaged by Doug Engelbart and furthered by modern advancements, stands at a pivotal point. The transition from static to dynamic knowledge repositories, the challenges in implementing these ideas, and the crucial role of entities like Google in facilitating this transition underscore the importance of continual improvement and collaborative efforts.
Engelbart's vision emphasized continuous adaptation to technological changes and the effective use of technology as an organizational nervous system. The concept of collective IQ and dynamic knowledge repositories are crucial for organizations to thrive in a rapidly evolving digital landscape....
Doug Engelbart and the Millennium Project envision a future of dynamic knowledge repositories, augmented knowledge workshops, and open hybrid argumentation systems. They emphasize the importance of standards, collaboration, and user involvement in the evolution of knowledge management systems....
Doug Engelbart emphasizes the transformative power of digital technology, akin to historical shifts like writing and agriculture, and proposes a strategic framework for augmenting human capabilities and addressing complex challenges. Engelbart envisions organizations establishing knowledge outposts and networked improvement communities to facilitate knowledge sharing, collaboration, and continuous improvement....
Paradigms shape our perception of technology, and capabilities depend on technological advancements to enhance human systems. Dynamic knowledge repositories and open hyper-document systems are essential for collective intelligence and addressing global challenges....
Doug Engelbart revolutionized human-computer interaction by introducing the mouse, collaborative computing, and hypertext, while emphasizing the importance of collective problem-solving and human augmentation. Engelbart's visionary ideas and pioneering work continue to inspire and guide current and future generations in the field of computing....
Collaborative environments and reliable systems are key to addressing modern challenges in technology and knowledge work, with the need for continuous improvement, distributed governance, and high-performance teams. These ideas emphasize the integration of diverse perspectives and technologies for more interconnected, secure, and efficient knowledge systems....
Doug Engelbart sought to augment human intellect through technology, leading to groundbreaking work in computer graphics, interactive text manipulation, and input devices like the mouse. Engelbart's vision emphasized collaboration and problem-solving through advanced systems, influencing modern computing and shaping the field of human-computer interaction....