Windows 11's new AI Copilot - Hands On & Demo

Windows Central
29 Sept 202314:30

TLDRThe video introduces Microsoft Co-Pilot, a new AI assistant for Windows 11 that replaces Cortana. Built on Bing Chat and Open AI technology, Co-Pilot can perform tasks like searching the web, creating emails, and controlling PC settings. It offers different response styles, from balanced to precise and creative, and integrates with Microsoft Edge for content analysis. The assistant is currently in preview and will receive updates for enhanced functionality and third-party app support.

Takeaways

  • 🚀 Microsoft co-pilot is a new feature launching on Windows 11, built on modern AI technology.
  • 🌟 Co-pilot serves as a smarter replacement for Cortana, utilizing Bing Chat and Open AI for enhanced search queries and tasks.
  • 🔍 The interface is accessible from the taskbar and currently in preview, with basic functionalities set to expand over time.
  • ⛅ Co-pilot can provide weather updates and allows users to adjust the level of detail in responses.
  • 📨 It can assist in writing creative content, such as emails, by generating drafts based on user prompts.
  • 🎁 Co-pilot offers suggestions for gift ideas and can even guide users on purchasing them online.
  • 💻 The feature can control PC settings and open apps, with more advanced functionalities and plugins anticipated in the future.
  • 🔗 Integrated with Microsoft Edge, co-pilot can analyze web content and provide summaries or create social media posts based on the information.
  • 🔄 Co-pilot handles multiple search queries at once, presenting consolidated answers, unlike traditional search engines.
  • 🎤 Voice input is supported, and users can provide feedback to improve the accuracy of information provided by co-pilot.
  • 📈 The feature is rolling out in waves, and users can expect to receive it within the next couple of months.

Q & A

  • What is Microsoft Co-pilot?

    -Microsoft Co-pilot is a new virtual assistant feature launching on Windows 11, which replaces Cortana. It utilizes modern AI technology and is built off Bing Chat, enhancing search queries and other tasks.

  • How does Co-pilot differ from Cortana?

    -Co-pilot is an advanced version of Cortana, incorporating modern AI technology for smarter responses and tasks. It is built on Bing Chat, which allows it to enhance search queries and perform a variety of tasks more efficiently than Cortana.

  • What are the different response styles available in Co-pilot?

    -Co-pilot offers three response styles: balanced, precise, and creative. Balanced provides a comprehensive answer, precise cuts out extra information for a more direct response, and creative is useful for generating content like emails or messages.

  • How can Co-pilot assist with internet search queries?

    -Co-pilot, integrated with Bing Chat, can handle multiple search queries at once and provide synthesized answers. It can also offer additional information like gift suggestions or summarize web articles based on the content viewed.

  • What is the purpose of the 'stop responding' button in Co-pilot?

    -The 'stop responding' button allows users to end the current response generation by Co-pilot if they have received their desired answer or if the assistant is providing too much information.

  • How can Co-pilot control PC settings?

    -Co-pilot can perform basic PC control tasks, such as changing system themes or turning on 'Do Not Disturb' mode, by interpreting Windows-specific commands provided by the user.

  • What is the significance of Co-pilot's integration with Microsoft Edge?

    -Co-pilot's integration with Microsoft Edge allows it to analyze web content and provide additional context or information based on the subjects being viewed. It can also generate messages like tweets based on the content of web articles.

  • How does Co-pilot handle multiple queries in a single question?

    -Co-pilot can process multiple queries within one question by searching the internet for each element and merging the answers into a coherent response. This capability is different from traditional search engines that typically address one query at a time.

  • What feedback mechanism does Co-pilot offer to users?

    -If users encounter incorrect information, they can provide feedback to help Microsoft correct it. This feature contributes to the improvement of Co-pilot's accuracy and reliability over time.

  • How is Co-pilot's user interface designed?

    -Co-pilot's interface is designed with a chat box at the bottom for user commands or questions. It also includes a sidebar that remains at the top level of the interface, ensuring it is always visible and accessible without overlapping with other apps.

  • What are some future enhancements planned for Co-pilot?

    -Future enhancements for Co-pilot include more complex functionalities and the introduction of plugins, which will allow third-party apps like Spotify or Adobe to utilize Co-pilot's features.

Outlines

00:00

🌟 Introduction to Microsoft Co-Pilot on Windows 11

This paragraph introduces viewers to Microsoft Co-Pilot, a new feature launching on Windows 11 as part of the latest updates. Co-Pilot is presented as a smarter alternative to Cortana, utilizing modern AI technology built on Bing Chats. The interface is previewed, showing its basic setup with a taskbar icon and a chat box for commands and queries. The video demonstrates Co-Pilot's ability to provide weather updates and adjust response styles based on user preference, offering a balanced, precise, or creative conversation style. Co-Pilot's potential for growth and integration with third-party apps is also mentioned.

05:01

📱 Basic Functionality and PC Control with Co-Pilot

The second paragraph delves into Co-Pilot's basic functionalities, such as changing system settings and controlling the PC. It highlights how Co-Pilot can assist users in finding specific settings, like enabling dark mode or do not disturb mode, and opening apps. The paragraph also touches on Co-Pilot's integration with Microsoft Edge, allowing it to analyze web content and provide summaries or create social media posts based on the information. The unique interface design of Co-Pilot is discussed, emphasizing its non-intrusive nature and how it adjusts for other apps.

10:01

🔍 Advanced Search Queries and Bing Chat Integration

The final paragraph focuses on Co-Pilot's advanced search capabilities through its integration with Bing Chat. It showcases how Co-Pilot can handle complex, multi-part queries, such as fitting Xbox Series X retail boxes in a Tesla Model 3 trunk. The response to such queries is detailed, providing dimensions and a calculated result. Co-Pilot's ability to identify and provide information on various topics, like TV shows or album sales, is demonstrated. The paragraph concludes with a reminder of Co-Pilot's ongoing rollout and encourages users to look forward to its full release.

Mindmap

Keywords

💡Microsoft co-pilot

Microsoft co-pilot is a new virtual assistant feature being launched on Windows 11. It is designed to replace Cortana and utilizes modern AI technology to enhance search queries and perform various tasks. In the video, the co-pilot is shown to be in its preview phase, offering a smarter and more interactive user experience compared to its predecessor.

💡Windows 11 Updates

Windows 11 Updates refer to the latest improvements and features added to the Windows 11 operating system. These updates are crucial for introducing new functionalities such as the Microsoft co-pilot, enhancing user experience, and ensuring system security and stability.

💡AI technology

AI technology, or Artificial Intelligence, involves the development of computer systems that can perform tasks typically requiring human intelligence, such as speech recognition, decision-making, and language translation. In the context of the video, AI technology is used to power the Microsoft co-pilot, enabling it to understand and respond to user commands in a more natural and intelligent manner.

💡Bing chats

Bing chats is a feature that was unveiled earlier in the year and is known for using open AI technology to enhance search queries and provide users with more relevant information. It forms the foundation of the Microsoft co-pilot, enabling it to perform tasks such as web searches, content summarization, and generating responses to user queries.

💡Taskbar icon

A taskbar icon is a visual representation of an application or feature on the taskbar, which is a part of the user interface in Windows operating systems. In the video, the taskbar icon for the Microsoft co-pilot is highlighted as the primary means for users to access and interact with the virtual assistant.

💡Chat box

A chat box is an interactive text-based interface that allows users to input commands or ask questions. In the context of the video, the chat box is a key component of the co-pilot interface, where users type in their queries or instructions for the virtual assistant to process and respond to.

💡Response styles

Response styles refer to the different ways an AI can formulate its answers, ranging from balanced, precise, to creative conversation styles. These styles cater to various user needs, such as obtaining straightforward information or engaging in more casual interactions. In the video, the co-pilot offers users the option to choose the type of response they prefer, affecting the content and format of the AI's replies.

💡PC control

PC control involves the ability of a software or AI to manage and operate various settings and functions of a computer. In the video, the Microsoft co-pilot is showcased to have basic PC control capabilities, such as changing system themes or opening apps, which can be further expanded with advanced functionality and plugins in the future.

💡Microsoft Edge integration

Microsoft Edge integration refers to the co-pilot's ability to interact with and enhance the user experience within the Microsoft Edge web browser. By analyzing content on the screen, the co-pilot can provide summaries, generate messages, or perform searches related to the content, offering a more dynamic and interactive browsing experience.

💡Bing chat search queries

Bing chat search queries are the questions or commands that users input into the co-pilot, which then utilizes Bing's search capabilities to provide detailed answers. These queries can be complex, involving multiple aspects, and the co-pilot is designed to handle them effectively, merging information from various sources to deliver comprehensive responses.

💡Voice input

Voice input refers to the functionality that allows users to interact with a system or application using spoken words. In the context of the video, the co-pilot supports voice input, enabling users to give commands or ask questions verbally instead of typing them into the chat box.

Highlights

Introduction to Microsoft co-pilot, a new feature launching on Windows 11.

Co-pilot is a replacement to Cortana, utilizing modern AI technology.

Built off Bing chats, which uses open AI technology to enhance search queries and tasks.

Co-pilot is currently in preview, with a basic feature set that will expand over time.

The interface includes a chat box for commands and questions, with options to adjust the response style.

Co-pilot can provide weather updates, with the ability to refine responses for precision.

It can assist in creative tasks, such as writing emails or messages.

Co-pilot offers recommendations and the ability to like or dislike responses for improvement.

Integration with Microsoft Edge allows content analysis and summarization.

Basic PC control functions, like changing system settings or opening apps.

Advanced features include voice input and the ability to handle complex, multi-part queries.

Co-pilot's responses are not always accurate, as they rely on internet information.

Users can provide feedback to correct any inaccuracies found in responses.

The co-pilot sidebar remains at the top level of the interface, ensuring visibility.

Co-pilot's integration with Bing chat allows for powerful internet search capabilities.

It can handle multiple search queries in one request, offering a merged answer.

Co-pilot is rolling out in waves for Windows 11 users, with a wide release expected in the coming months.