Copilot for Microsoft 365 How it ACTUALLY Works!

Andy Malone MVP Official Podcast
18 Jan 202432:48

TLDRIn this informative episode, host Jeremy Chapman from Microsoft Mechanics dives deep into the world of Microsoft 365's co-pilot, a cutting-edge AI service. Chapman discusses the service's capabilities, including its integration with the Microsoft Graph for data retrieval and its use of large language models to formulate responses. He also addresses the recent removal of the 300 purchase limit and the introduction of new co-pilot versions. The episode is packed with insights on how to prepare businesses for co-pilot, customizing prompts, and ensuring compliance and security. Chapman's expertise shines through as he demystifies the technology and explores its potential for enhancing workflows and automation.

Takeaways

  • ๐Ÿš€ Jeremy Chapman, the director of Microsoft 365, discusses the deep learning journey inside co-pilot for Microsoft 365, emphasizing the removal of the 300 purchase limit and introduction of three versions of co-pilot.
  • ๐ŸŒ Co-pilot for Microsoft 365 now comes in three flavors: a free version with the Edge browser, co-pilot Pro for small and medium-sized businesses, and co-pilot for Enterprise.
  • ๐Ÿ“ˆ The large language model and generative AI have been central to the advancements in co-pilot in 2023, making it a highly sought-after topic in conferences.
  • ๐Ÿ” Co-pilot uses Microsoft Graph to access and summarize email threads, ensuring that the information retrieved is compliant with data protection and security controls.
  • ๐Ÿ› ๏ธ The architecture of co-pilot involves an orchestration service that processes user prompts, retrieves information from various sources, and presents it to the large language model for an informed response.
  • ๐Ÿ“š Customization of co-pilot is possible through prompt flows and content filtering, allowing businesses to tailor the AI to their specific needs and compliance requirements.
  • ๐Ÿ”’ Security and compliance are integral to co-pilot's design, with features like auto-labeling and real-time scanning to prevent exposure of sensitive content.
  • ๐Ÿ“Š Admins can use tools like communication compliance and information protection to monitor and control co-pilot usage, ensuring adherence to organizational policies.
  • ๐Ÿš€ Getting started with co-pilot involves ensuring Microsoft 365 apps are on the right update channel, assigning co-pilot licenses, and configuring security and compliance policies through the admin center.
  • ๐Ÿ“ˆ Viva Insights now includes a Power BI app to track adoption and impact of co-pilot across different apps and features, providing valuable insights for organizations.

Q & A

  • What is the main focus of this episode with Jeremy Chapman?

    -The main focus of this episode is to provide a comprehensive learning guide on co-pilot for Microsoft 365, exploring its features, benefits, and how to prepare a business for its implementation.

  • What changes were announced recently regarding co-pilot for Microsoft 365?

    -The recent announcement removed the 300 purchase limit, and introduced a new version of co-pilot with three different versions: a free version with the Edge browser, co-pilot Pro for small and medium-sized businesses, and co-pilot for Microsoft 365 Enterprise.

  • How does co-pilot for Microsoft 365 summarize an email thread?

    -Co-pilot for Microsoft 365 uses its connection to the Microsoft Graph to access and parse the content of the most recent emails between the user and a specified contact. It then formulates a summary and presents it back to the user.

  • What is the role of the Microsoft Graph in co-pilot for Microsoft 365?

    -The Microsoft Graph provides co-pilot with access to a wide range of data including message content, calendar, files in SharePoint and OneDrive, meetings, chats, and more. This data is used to inform the responses generated by the large language model.

  • How does co-pilot for Microsoft 365 ensure compliance with data security and information protection policies?

    -Co-pilot for Microsoft 365 applies data security controls and information protection policies throughout the process. It retrieves and sends data based on the user's explicit access rights and applies labels and other compliance controls before presenting the information to the user.

  • Can the prompts used by co-pilot for Microsoft 365 be customized for different organizations?

    -Yes, organizations can customize the prompts to fit their specific needs and requirements. This can be done using tools like the Azure AI Studio, which allows for the creation of prompt flows and content filtering that align with the organization's policies and goals.

  • What are some best practices for writing effective prompts for co-pilot?

    -Best practices for writing prompts include being specific with the language used, clearly defining the task or information needed, and following any guidelines or examples provided by Microsoft, such as those found in the co-pilot lab or through Viva Insights.

  • How can IT professionals get started with co-pilot for Microsoft 365?

    -IT professionals can get started by ensuring their Microsoft 365 apps for Enterprise are on the correct channel, assigning co-pilot licenses, and configuring security and compliance policies through the Microsoft 365 admin center. They can also utilize resources like the co-pilot lab for guidance and examples of effective use.

  • What features does co-pilot for Microsoft 365 offer for auditing and compliance monitoring?

    -Co-pilot for Microsoft 365 offers features such as logging and auditing, integration with communication compliance and information protection policies, and the ability to set up retention policies for co-pilot conversations and sessions.

  • How can organizations measure the adoption and impact of co-pilot for Microsoft 365?

    -Organizations can measure adoption and impact through Viva Insights, which provides data on how co-pilot is being used across different apps and features, as well as the overall impact on the organization's productivity and efficiency.

Outlines

00:00

๐Ÿ“บ Introduction to the Learning Journey with Microsoft 365 and Co-Pilot

The video begins with an introduction to a special episode featuring Jeremy Chapman, the host of Microsoft Mechanics and the director of Microsoft 365. The host expresses gratitude for the support received on their YouTube journey and announces a significant update regarding the removal of the 300 purchase limit for Co-Pilot, Microsoft's AI-powered assistant. The conversation sets the stage for an in-depth exploration of Co-Pilot for Microsoft 365, highlighting its three versions: a free version with Edge browser, Co-Pilot Pro for small and medium-sized businesses, and Co-Pilot for Enterprise. The host emphasizes the importance of understanding the capabilities of Co-Pilot in the context of Microsoft's large language models and generative AI advancements.

05:03

๐Ÿค– Behind the Scenes of Co-Pilot's Functionality and Customization

Jeremy Chapman provides insights into the mechanics of Co-Pilot, explaining its architecture and how it works with Microsoft Graph to access and summarize email threads. He discusses the importance of compliance controls and the ability to customize prompts for specific organizational needs. Chapman also touches on the process of 'grounding' in AI, where additional data sources are connected to provide context and enhance the AI's response. The discussion includes an overview of how Co-Pilot retrieves and processes information, the role of large language models, and the potential for users to tailor their Co-Pilot experience.

10:06

๐Ÿ” Co-Pilot's Data Retrieval and Automation Processes

The conversation delves into the intricacies of Co-Pilot's data retrieval capabilities, emphasizing the real-time nature of the process. Chapman illustrates how Co-Pilot can access and search through private data sources, such as a search index for a store selling outdoor supplies, and integrate this information into its responses. He explains the use of AI search and vector search to improve the accuracy of results, and how Co-Pilot respects user permissions and data privacy throughout its operations. The segment highlights the complex yet efficient automation processes that occur behind the scenes to deliver a seamless user experience.

15:08

๐Ÿ›ก๏ธ Ensuring Compliance and Security with Co-Pilot

Chapman discusses the importance of compliance and security in the context of Co-Pilot, detailing how the system handles sensitive information and applies content filters. He explains the ability of Co-Pilot to display labels on content, ensuring users are aware of the sensitivity and confidentiality of the information they are interacting with. The conversation also covers auto-labeling features and the real-time scanning of documents to apply appropriate labels. Chapman assures viewers that Co-Pilot is designed to prevent exposure of too much content and to align with organizational policies and regulations.

20:12

๐Ÿš€ Getting Started with Co-Pilot for IT Professionals

The discussion shifts towards practical advice for IT professionals looking to implement Co-Pilot within their organizations. Chapman outlines the necessary steps, including ensuring Microsoft 365 apps are on the correct update channel, assigning Co-Pilot licenses, and configuring security and compliance policies. He introduces new resources in the Microsoft 365 admin center designed to assist admins in setting up and managing Co-Pilot. The conversation also touches on the importance of user education and adoption, with recommendations for creating a community of excellence and utilizing prompts effectively. Chapman mentions the integration of Viva Insights to track and analyze Co-Pilot usage and value across the organization.

25:18

๐ŸŽ‰ Wrapping Up the Discussion on Microsoft 365 Co-Pilot

The host thanks Jeremy Chapman for his valuable insights into Microsoft 365 Co-Pilot, encouraging viewers to subscribe and join the learning community. The host promises to provide links to further resources in the video description and reminds viewers of the wealth of content available on the Microsoft Mechanics channel. The episode concludes with a call to action for viewers to engage with the content and a teaser for upcoming videos.

Mindmap

Host and Guest
YouTube Channel Appreciation
Episode Overview
Introduction
New Features
Large Language Models and Generative AI
Co-pilot Demonstration
Co-pilot for Microsoft 365
Architecture of Co-pilot
Customization and Security
Azure AI Studio
Technical Deep Dive
Getting Started
Admin Center Resources
User Education and Support
Implementation and Adoption
Summary of Key Points
Call to Action
Conclusion
Microsoft 365 Co-pilot Learning Journey
Alert

Keywords

๐Ÿ’กMicrosoft 365

Microsoft 365 is a suite of productivity applications and services provided by Microsoft. It includes cloud-based services like email, file storage, and collaboration tools, as well as desktop applications like Word, Excel, and PowerPoint. In the context of the video, Microsoft 365 is the platform on which the co-pilot feature is being discussed, emphasizing its role in enhancing productivity and collaboration.

๐Ÿ’กCo-pilot

Co-pilot refers to an AI-powered assistant integrated within Microsoft 365 that helps users with various tasks such as summarizing emails, automating workflows, and providing information retrieval. It uses natural language processing to understand user prompts and execute actions accordingly, aiming to streamline work processes and improve efficiency.

๐Ÿ’กLarge Language Models

Large Language Models (LLMs) are a class of artificial intelligence models that can process, understand, and generate human-like text based on the input they receive. These models are trained on vast amounts of data to recognize patterns and predict text, enabling them to assist in tasks such as content creation, translation, and summarization. In the video, LLMs are a fundamental component of the co-pilot feature, powering its ability to interact with users and provide relevant information.

๐Ÿ’กMicrosoft Graph

Microsoft Graph is a RESTful web API that enables developers to access Microsoft cloud service resources. It provides a unified programming model that enables developers to access a vast range of resources, including mail, calendar, files, and more. In the context of the video, Microsoft Graph is used by co-pilot to access and retrieve relevant data from various sources like Outlook, SharePoint, and OneDrive to assist users effectively.

๐Ÿ’กCompliance Controls

Compliance controls refer to the mechanisms and policies put in place to ensure that an organization adheres to regulatory requirements, legal obligations, and company policies. These controls can include data protection, access management, and auditing features. In the video, compliance controls are crucial for the co-pilot feature to ensure that it operates within the boundaries of legal and organizational guidelines, protecting sensitive information and user privacy.

๐Ÿ’กWorkflows

Workflows are sequences of tasks or processes that are automated to streamline business operations. They often involve multiple steps and can be triggered by specific events or conditions. In the context of the video, workflows are part of the co-pilot's capabilities, where it can automate tasks like email summarization or content generation, improving productivity and efficiency.

๐Ÿ’กAutomation

Automation refers to the process of creating technology to perform tasks without human intervention. It is used to reduce repetitive work, increase efficiency, and minimize errors. In the video, automation is a key aspect of co-pilot's functionality, as it can automate various tasks within Microsoft 365 applications, allowing users to save time and focus on more complex tasks.

๐Ÿ’กAI Studio

AI Studio is a platform that allows users to build, train, and deploy AI models. It provides tools and interfaces for developing AI applications, including natural language processing and machine learning models. In the video, AI Studio is mentioned as a place where users can create their own co-pilot with custom workflows and data sources, giving them control over the AI's behavior and responses.

๐Ÿ’กContent Filters

Content filters are systems designed to monitor and control the type of content that can be accessed, created, or shared within a platform. They help to ensure that the content adheres to certain standards, such as avoiding inappropriate material or enforcing copyright laws. In the video, content filters are part of the responsible AI features in co-pilot, ensuring that the information shared and the interactions within the system are appropriate and secure.

๐Ÿ’กPrompts

Prompts are inputs or statements given to an AI system to elicit a specific response or action. They are designed to guide the AI's output, making it more relevant and useful to the user. In the context of the video, prompts are crucial for interacting with co-pilot, as they determine the tasks the AI performs and the information it retrieves.

Highlights

Jeremy Chapman, the director of Microsoft 365, joins the podcast to discuss the deep learning journey inside co-pilot for Microsoft 365.

The 300 purchase limit for co-pilot has been removed, introducing a new version that comes in three different versions: free with Edge browser, Pro for small and medium-sized businesses, and Enterprise.

Co-pilot leverages large language models and access to Microsoft Graph, providing a comprehensive service that integrates various Microsoft 365 features.

Microsoft Graph allows co-pilot to access message content, calendars, files in SharePoint and OneDrive, meetings, chats, and more, providing a rich data source for the AI.

Co-pilot's orchestration service processes prompts, retrieves information from various sources, and sends it to the large language model to formulate an informed response.

Compliance controls and labels are integrated into co-pilot's responses, ensuring that data security and information protection are maintained.

Co-pilot can be customized for organizations, allowing for the tailoring of prompts and the addition of specific plugins and data sources.

The architecture of co-pilot involves multiple steps, including prompt processing, information retrieval, response formulation, and compliance filtering.

Co-pilot can inherit and apply labels from referenced materials, ensuring that generated content has the appropriate sensitivity and classification.

Auditing and logging are built into co-pilot as a Microsoft 365 service, allowing for monitoring and control of usage through tools like communication compliance and information protection.

Microsoft provides resources and guidance for IT professionals to get started with co-pilot, including setup, security configuration, and user adoption strategies.

Viva Insights now includes a PowerBI app to track and analyze co-pilot usage and impact across different apps and features in an organization.

The podcast host expresses gratitude for the audience's support and encourages subscription to the channel for more learning content.

The podcast host introduces Jeremy Chapman and emphasizes the importance of the discussion on co-pilot for Microsoft 365.

Jeremy Chapman shares insights into the workings of co-pilot, demystifying some of the elements involved in its automation and AI capabilities.

The podcast provides a comprehensive guide on preparing a business for Microsoft 365 co-pilot, covering various aspects from setup to security to user adoption.