Introduction:
Satya Nadella introduces the theme of Build 2019, emphasizing the importance of imagination and collaboration among developers to make the world of embedded computing a reality. He welcomes young developers, including children of Build attendees, student ambassadors, Imagine Cup participants, and local school students.

Opportunities in Embedded Computing:
Nadella highlights the vast opportunities for developers in the era of embedded computing, where software drives everything from connected cars to smart surgical tools. He emphasizes the role of developers in building this new world and the sense of purpose and mission that grounds Microsoft’s work. The goal is to empower every person in every organization to achieve more through technology.

Responsibility in Tech:
Nadella emphasizes the deep responsibility that platform providers and developers share in the age of embedded computing. He stresses the importance of incorporating trust, privacy, cybersecurity, and AI ethics into the core design process and tooling. Privacy is seen as a human right and an engineering design principle, while cybersecurity and AI ethics require pushing the boundaries of tooling and processes to build unbiased systems. Nadella calls on engineers to take responsibility for what they build and to push the state of the art in these areas.

Security and Transparency:
Microsoft announces an open-source project called Election Guard in collaboration with Free and Fair. This project aims to enhance the transparency and verifiability of election systems, featuring homomorphic encryption technology to modernize election infrastructure worldwide.

Four Platform Opportunities:
Microsoft focuses on four key platform opportunities: Intelligent Cloud and Intelligent Edge platform enabled by Azure. Business process automation with Dynamics 365 and Power Platform. Microsoft 365 as the productivity and communications fabric. Gaming as a platform.

Azure: The World’s Computer:
Azure expands with 54 data center regions worldwide, including the first public cloud data centers in Africa. It offers more compliance certifications than any other public cloud, meeting the security and regulatory needs of various industries. Azure remains an open platform, supporting Windows, Linux, .NET, Java, SQL, Postgres, Kubernetes workloads, Red Hat, OpenShift, and VMware workloads.

Extending Cloud to the Edge:
Microsoft emphasizes the importance of hybrid computing, extending the cloud to the edge through Azure Stack, Azure Data Box Edge, Azure Connect, HoloLens 2, Azure IoT, and Azure Sphere. Azure Database Edge brings the database engine to ARM processors at the Edge, with time series and streaming support, allowing AI compute at the Edge.

Hybrid Consistency:
The focus on hybrid extends to ensuring consistency between the cloud and the edge in terms of operating models, management, security, development environment, DevOps pipelines, and technology stacks.

Real-World Innovation with Azure:
Walgreens Boots Alliance collaborates with startups like Cooler Screens to transform retail experiences using AI. AB InBev leverages IoT and cognitive services to revolutionize their supply chain and track social media for end-to-end digital transformation. St. Jude’s Hospital and DNA Nexus utilize Azure Genomics and create a research cloud to combat childhood cancer. JPMorgan Chase adopts the Azure blockchain service to bring Quorum, a variant of Ethereum, to market alongside Microsoft. AT&T uses Azure Stack for edge compute in conjunction with 5G, enabling applications like drone safety trackers. Starbucks integrates sustainability, IoT, AI, and blockchain to enhance customer experiences and provide transparency in their coffee supply chain.

Machine Learning Personalization:
Starbucks’ DeepRoo platform leverages machine learning to personalize recommendations for customers based on their preferences and local market trends. The mobile app provides tailored recommendations for beverages and food items, enhancing the customer experience.

Azure IoT Central for Coffee Equipment Management:
Starbucks utilizes Azure IoT Central to monitor and manage their coffee equipment across 30,000 stores worldwide. The platform provides real-time data on water temperature, pressure, and pull time, ensuring optimal performance of the Mestrana 2 machines. Predictive maintenance models help identify potential issues remotely, reducing maintenance costs and improving customer satisfaction.

Azure Sphere for Secure Device Connectivity:
Starbucks chose Azure Sphere for its secure end-to-end solution for connecting coffee equipment. The Azure Sphere custom microcontroller can be embedded into new equipment or retrofitted into existing machines, eliminating the need for costly replacements. Over-the-air software updates can be securely delivered to the devices, accelerating innovation and reducing the time required for seasonal coffee introductions.

Starbucks Digital Transformation:
Starbucks is expanding its digital transformation beyond its retail presence to include its vast supply chain, starting with over 380,000 farms in nearly 30 countries. A new digital transparency feature allows customers to scan a code on a bag of coffee using their phones to view an immutable record of the coffee’s history stored on Azure Blockchain Service. Customers can see where the coffee beans were grown, Starbucks’ support efforts for farmers in those regions, when and where the beans were roasted, tasting notes, and more. The goal is to empower coffee farmers and enhance transparency for coffee drinkers.

AI democratization and Infrastructure:
Microsoft aims to democratize access to AI by translating breakthroughs into services, infrastructure, frameworks, and tools for developers. Azure ML advances include no-code ML tools and Azure DevOps extensions for machine learning operations, bringing rigor to development, engineering, and deployment in ML practices.

Azure Speech Services:
Azure Speech Services is advancing speech recognition capabilities, even on commodity hardware, comparable to complex microphone arrays. By combining speech recognition with language models specific to organizational data, the service can capture and understand jargon, making transcripts more useful. Microphone arrays in the cloud using just built-in microphones enable accurate in-person meeting transcription without specialized devices. Azure Speech Service’s language model can be trained on data from a company’s Microsoft 365 tenant, learning unique vocabulary for accurate transcriptions across industries.

Conversational Interfaces with Bot Framework:
3,000 new bots or conversational apps are created each week using the Bot Framework. New features include enhancements to multi-turn dialogue, integration of the Q&A Maker toolkit to convert PDF documents into conversational canvases, and richer language modeling capabilities with LUIS. The strategic importance of the Bot Framework lies in enabling businesses to build their own conversational canvas, controlling their destiny in this new platform of conversations.

Azure:
Use of bot framework for customer service to improve knowledge repositories and services. Coca-Cola’s diverse internal use of Azure across IT, HR, and finance functions. Emphasis on the importance of building conversational assistance capabilities and leveraging others’ personal assistance. Mixed reality services, exemplified by HoloLens 2, are critical AI devices and the edge for Azure. The combination of Azure and HoloLens 2 with Epic Games’ Unreal Engine enables immersive mixed reality experiences. Azure Spatial Anchor service facilitates cross-device mixed reality experiences. Use cases of mixed reality across various industries, including training (PACCAR), non-invasive surgery (Philips), and industrial design (PTC).

Autonomous Systems:
Two forms of autonomy: observing movement and enabling movement. Combination of simulation tools and a new technique called machine teaching for building autonomous systems. Use of AirSim and simulation capabilities to create autonomous pallets (Toyota material handling). Precision drilling using machine teaching services and reinforcement learning (Shell). Autonomous control system loop driven by machine teaching with reinforcement learning (Schneider Electric).

Dynamics 365 and Power Platform:
No specific details covered in this transcript excerpt.

Azure Business Applications and Dynamics 365
Satya Nadella emphasizes the importance of business applications and meeting with independent software developers building them worldwide. Dynamics 365, rewritten as an Azure Cloud native app, showcases innovation beyond the west coast of the United States and the east coast of China. Nadella highlights the unified solution, built-in AI, and extensibility framework of Dynamics 365 through the Power Platform. Dynamics 365 addresses customization challenges with its n-way customization and upgradability, enabling ISVs to build on top of it. The common data model serves as a bootstrap for business process automation, allowing developers to add their own entities and data. Examples of ISVs leveraging Dynamics 365 and Power Platform include Adwe, Adda, Indigene, and Adobe. The Open Data Initiative, in partnership with Adobe and SAP, aims to break free of silos by allowing organizations to control their data across SaaS applications. Unilever’s use of ODI showcases how data from sustainability work can be translated into front-end campaigns using Adobe, improving business outcomes.

Microsoft 365
Microsoft 365 is positioned as the world’s productivity cloud for work and life, encompassing communications, collaboration, and productivity across devices. It serves as the scaffolding for business process workflow, enhancing user engagement by leveraging the UI for communication needs. Microsoft Graph, a rich database of people, relationships, and artifacts, provides developers with a first-class database structure. Windows, Office, Edge, and Teams offer rich canvases for application development. Customer momentum for Microsoft 365 is highlighted, with global brands adopting it. TalentSoft, an HR application provider from France, exemplifies how ISVs are using Microsoft Graph to add value.

Introduction:
Microsoft CEO Satya Nadella discusses the current state and future of conversational canvases. He emphasizes the progress made with conversational AI, acknowledges its limitations, and outlines key areas of improvement.

Progress and Existing Challenges:
Microsoft 365’s first-party apps, such as Microsoft Search, My Analytics, and Cortana, utilize graph data for improved functionality. Cortana’s capabilities are continuously improved, focusing on time management and intelligent suggestions. Despite advances, current conversations are often brittle and lack multi-turn capabilities, losing context from turn to turn.

The Future of Conversational AI:
Envisioning a future where conversational AI can handle complex human language and maintain shared context throughout extended dialogues. Creating a multi-domain assistant that can cross domains without the need to invoke each skill explicitly. Achieving a multi-agent world, moving away from single wake words and assistants, similar to the open web.

Research and Innovation:
Microsoft’s acquisition of Semantic Machines and collaboration with Microsoft research teams to drive innovation in natural language capabilities. Demonstrations of conversational AI’s potential through video showcases at the show floor.

Conclusion:
Satya Nadella expresses excitement about the future of conversational AI with Cortana and Bot Framework, striving towards a true multi-turn, multi-domain, multi-agent world.

The Canvas: Windows and Office
Developers can easily extend their apps’ reach with Windows and Office 365/Microsoft 365’s large user base. Graph data annotation and natural user interface elements enhance app functionality. Examples: Fluid Math’s math tutoring app, Concepts’ drawing tools, and SurveyMonkey’s Outlook integration.

Edge and the Web
Microsoft is committed to open source, contributing to Chromium, and improving accessibility and touch capabilities for all browsers based on Chromium. Edge will be available cross-platform, ensuring consistency across devices. Web innovation, with a focus on collaboration using distributed data structures, promises enhanced productivity across browsers.

Seamless Web Experience for Enterprises
Customizable new tab page displays recent documents and corporate resources for easy access. Integration with Microsoft Search provides contextually relevant search results from the organization. Built-in Internet Explorer (IE) mode eliminates the need for separate IE windows when accessing legacy sites, ensuring seamless switching.

Privacy and Security
Emphasis on data transparency and user control over web tracking and data collection. Commitment to pushing the envelope on web privacy and security measures.

Edge: Empowering Privacy and Productivity
Edge offers simple tools to control third-party tracking with three settings: unrestricted, strict, and balance. Collections feature allows efficient gathering, organizing, and sharing of content from the web, including drag-and-drop functionality. Collections can be exported to Word or Excel, maintaining formatting and citations.

Fluid Framework: Breaking Down Barriers in Collaboration
Fluid Framework enables cross-browser collaboration through hyper-fast co-authoring, AI collaboration, and reusable components. Co-authoring allows for smooth and immersive collaboration, with low latency for real-time updates. Bots and AI can participate as collaborators, providing translation, data insights, design ideas, and security scanning. Fluid Components allow for collaboration across apps, such as copying a table from a Word document and pasting it into a Teams conversation. Components remain collaborative and can be updated in real time across applications.

Teams: The Fastest Growing App at Microsoft
Teams has experienced tremendous growth, becoming the fastest-growing application at Microsoft. Its success lies in its four built-in capabilities: messaging, video conferencing, collaboration, and business process integration. Microsoft 365 tool chain is not only for knowledge workers, but also for first-line users such as retail specialists, factory workers, and healthcare professionals. Teams is being used by Hendrix Sports, Marks and Spencers, and NHS for NASCAR training, retail specialists, and care coordination, respectively. Rana Amjadi from the Teams organization will discuss new capabilities, features, and the hardware ecosystem around Teams.

Teams’ First-Line Experience:
Designed for frontline workers like retail associates and factory technicians. Enables capturing images of situations, annotating, and sharing for better communication. Facilitates location sharing to track deliveries and meet up with teams. Offers easy access to shift schedules and shift swapping directly from a mobile device.

Meetings in Teams:
Focuses on inclusivity and ease of use. Features live captions for accessibility and engagement. Provides customized backgrounds to minimize distractions. Integrates proximity-based room finding for swift collaborations. Delivers immersive meeting experiences with multi-video streams in “Brady Bunch” style.

Innovative Collaboration with Mixed Reality and Teams:
Teams up with Mattel to showcase custom solutions using HoloLens and Microsoft 365. Demonstrates ideation, design, and collaboration across global borders on multiple brands. Integrates easily with Teams, enabling seamless transition to 3D spatial meetings. Allows participants to scan QR codes to join 3D meetings from HoloLens devices. Offers intuitive hand tracking for quick content triage and sharing in virtual spaces. Supports collaborative freehand annotation to enhance design and ideation processes. Integrates with OneDrive to access 3D models and other content from various locations.

Microsoft Graph’s Role in Mixed Reality Collaboration:
Provides a single unified API for mixed reality collaboration solutions. Leverages the power of Microsoft 365 to connect frontline workers and remote teams. Enables easy access to content, comments, and other relevant information.

Overview of Microsoft’s Tech Stack:
Azure: This platform provides a range of runtime services, including mixed reality capabilities. Common Data Model and Microsoft Graph: These tools help in data initialization and provide extensibility. Power Platform: This versatile platform serves as an extensibility framework for various applications. Microsoft 365 and Dynamics 365: These platforms utilize the underlying stack and allow developers to create customized applications.

Focus on Gaming:
Importance of Gaming at Microsoft: Gaming has a long history at Microsoft, dating back to the origins of the company. Gamer-centric Approach: Microsoft’s approach to gaming emphasizes putting the player at the center of the experience. Cross-platform Accessibility: Gaming experiences are designed to be available across platforms, including consoles, PCs, and mobile devices. Xbox, PC Gaming, and Game Pass Mixer: These initiatives are central to driving innovation in gaming.

Game Developer Empowerment:
Support for Game Developers: Microsoft aims to support game developers by providing the necessary resources and tools. Game Stack on Azure: Azure provides a robust platform for game development, with notable partnerships such as Rare, Ubisoft, and Wizards of the Coast. Xbox Live: This platform offers a vast gaming social network with 63 million users and is now available on iOS and Android. Game developers can leverage Xbox Live for increased engagement and gameplay features. Azure PlayFab: This service is designed to support game developers throughout the game’s lifecycle, enabling experimentation, analytics, and live operations. It has over a billion accounts and is used by Roblox to enhance their developers’ experiences.

Overview:
Satya Nadella, CEO of Microsoft, addressed developers at Microsoft Build 2023, emphasizing the company’s commitment to providing advanced technology for various applications, including gaming. Nadella highlighted the significance of the developer community in shaping the future and creating a world that aligns with their aspirations.

Modern Technology Stack:
Microsoft is dedicated to developing a robust and modern technology stack that encompasses applications, data and AI, business process automation, communications and productivity, and gaming. These platforms offer extensive capabilities for developers to transform their visions into reality in the era of cloud and edge computing.

Empowering Magical Experiences:
Nadella envisions magical experiences that enhance productivity, collaboration, and organizational growth. These experiences aim to address pressing challenges in fields such as education and healthcare. Additionally, they facilitate connections, relaxation, and entertainment for individuals.

Developer Community:
Nadella recognizes the power of the developer community to create the future and shape a world that aligns with their ideals. He expresses excitement to witness the magic they will create using Microsoft’s technology.

Sneak Peek of Microsoft’s Magic:
Before concluding his speech, Nadella teases a glimpse of magic that the Microsoft team is developing near the convention center, leaving the audience with anticipation.