# AI Companion Diagrams and Dataflows

The following diagrams demonstrate the core data processing pathways and functional architecture of each feature.

## AI Companion 3.0

The following diagram illustrates the dataflows for AI Companion 3.0.

<figure><img src="https://1175968039-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FctBXUMeBy4rtLMmMkKRG%2Fuploads%2F7EqTM5YnBDwj54C2AqRa%2F09B642B5-3F02-434D-997E-AC7800368094.png?alt=media&#x26;token=96dd3264-dec9-4cc0-82a8-83ce0b3c8e5d" alt=""><figcaption><p>How AI Companion 3.0 connects with various internal and external data sources</p></figcaption></figure>

## Core AI Companion Features

The following diagram illustrates the dataflows behind most of Zoom AI Companion's features, organized by Content Resources that provide inputs to these AI services:

* **Static Artifacts 📦**: Artifacts that are stored at rest, such as post-meeting transcripts, Zoom Chat messages, text messages, voicemail, etc.
* **Real-Time Artifacts ⚡**: Artifacts that are considered “live” and ongoing in real-time, such as a live transcript from a meeting or phone call or an active chatbot conversation. Keep in mind that after the live session completes, if these records are retained, they will transition to *Static Artifacts***⚡.**
* **Data Sources 🤖**: Third-party artifacts (email, calendar, and/or files) indexed in a retrieval-augment generated module for improved AI capabilities, if the account setting is enabled. For example, emails and calendar events users can search for with AI Companion.
* **On-Demand Artifacts 💥**: Information that is processed in real-time during active user sessions within the Zoom Workplace app, exclusively for providing contextual input to AI services without any persistent storage or indexing. These artifacts are dynamically pulled from local sources only when needed for immediate workflow context. For example, responding to an ongoing email thread with the Email Compose feature will temporarily include previous emails in the payload to the third-party service directly from the Zoom Workplace app's local access—**not the host server**—providing context that helps shape the response. A list of On-Demand artifacts may include but are not limited to:
  * Zoom Chat Messages
  * Zoom AI Docs
  * Email

In conjunction with the content resources, each feature falls into one of three categories based on how it uses contextual information, as shown in the **Context Table**:

* **Context-Dependent Features**: Features that **always** utilize a relevant, contextual artifact for delivering an AI service. For example, Live Transcripts are used to produce Meeting Summaries.
* **Context-Possible / Context-Conditional Features**: Features that **can** use relevant, contextual artifacts for delivering an AI service, depending on the context or user actions. For example, responding to an ongoing email thread with Email Compose **will** use a contextual artifact, while using Email Compose in a brand new email will not.
* **User-Input Features**: Features that always require user input to function. For example, generating a virtual background based on the user’s input.

By combining the Content Resources and the Context Table into the following unified table, you can see which data types each feature uses, as each feature is labeled with the appropriate symbol to indicate the content source it relies on.

For example, within the **AI Companion Panel** section are a list of features broken down by being **Context-Dependent**, **Context-Possible**, and **User-Input**. In the **Context-Dependent** section is **Smart Scheduling**, with the content resources **Static Artifacts** 📦, **On-Demand Artifacts**💥 , and **Data Sources** 🤖 in the column next to it. Together, these reveal that this feature can use artifacts from all three sources, if they are available (note that these features may work in a diminished capacity if not *all* context sources are available. ).

Alternatively, under the **User-Input** section is **General Knowledge Queries**. Because this feature does not intrinsically depend on any context, except for user-inputs, there are no content resources listed.

<div data-with-frame="true"><figure><img src="https://1175968039-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FctBXUMeBy4rtLMmMkKRG%2Fuploads%2Fgit-blob-7aa191b5dc687bc7f4a4ce343ec0aa7810d1c1ac%2Fimage.png?alt=media" alt=""><figcaption><p>Most AI Companion features and data flows are represented in this image. Choose your feature below, and trace its Content Resource(s) to understand where the data comes from and how it's processed.</p></figcaption></figure></div>

{% hint style="danger" %}
**Warning**

The following tables account for standard artifact use cases. The diagram and table cannot account for user-provided files paired with requests. Readers should assume users may upload files at any time with any feature unless [local file uploads are disabled](https://support.zoom.com/hc/en/article?id=zm_kb\&sysparm_article=KB0077150). Additionally, some features may combine multiple artifact types for optimal results. If certain data sources are unavailable, features automatically adapt to deliver the best possible experience with remaining resources. For example, Context-Aware Follow-Ups creates more detailed responses when third-party Data Sources 🤖 are accessible, while still providing valuable follow-ups without them.
{% endhint %}

### AI Companion Features

### AI Companion Panel

<table data-header-hidden><thead><tr><th></th><th></th><th width="209.86328125"></th><th></th></tr></thead><tbody><tr><td><strong>Context Type</strong></td><td><strong>Feature</strong></td><td><strong>Content Resource</strong></td><td><strong>Description</strong></td></tr><tr><td><strong>Context-Dependent</strong></td><td><strong>Chat Summaries &#x26; Search</strong></td><td><strong>Static Artifacts</strong> 📦<br><strong>On-Demand Artifacts</strong> 💥</td><td>Summarizes recent messages in active chat channels and helps locate specific conversation points users may not clearly remember.</td></tr><tr><td></td><td><strong>Context-Aware Follow-Ups</strong></td><td><strong>Static Artifacts</strong> 📦<br><strong>On-Demand Artifacts</strong> 💥<br><strong>Data Sources</strong> 🤖</td><td>Generates personalized follow-up messages based on meeting transcripts to ensure accuracy and relevance in post-meeting communication.</td></tr><tr><td></td><td><strong>Data Analysis</strong></td><td><strong>On-Demand Artifacts</strong> 💥<br><strong>Data Sources</strong> 🤖</td><td>Allows users to upload datasets and quickly generate summaries of key findings, patterns, and trends.</td></tr><tr><td></td><td><strong>In-App Contextual Awareness</strong></td><td><strong>Static Artifacts</strong> 📦<br><strong>On-Demand Artifacts</strong> 💥<br><strong>Data Sources</strong> 🤖</td><td>Provides intelligent, context-aware assistance that adapts responses based on your current location and activity within the Zoom Workplace application.</td></tr><tr><td></td><td><strong>Post-Meeting Transcript Querying</strong></td><td><strong>Static Artifacts</strong> 📦</td><td>Enables users to ask natural language questions about meeting content and receive instant responses from meeting transcripts.</td></tr><tr><td></td><td><strong>Smart Scheduling</strong></td><td><strong>On-Demand Artifacts</strong> 💥<br><strong>Data Sources</strong> 🤖</td><td>Searches colleagues' calendars to find and schedule meeting times that work for both parties.</td></tr><tr><td><strong>Context-Possible</strong></td><td><strong>Agenda Creation</strong></td><td><strong>Static Artifacts</strong> 📦<br><strong>On-Demand Artifacts</strong> 💥<br><strong>Data Sources</strong> 🤖</td><td>Generates structured agendas leveraging insights from meeting preparation to ensure attendees are aligned on discussion topics.</td></tr><tr><td></td><td><strong>Prompt Assistance</strong></td><td><strong>On-Demand Artifacts</strong> 💥</td><td>Helps users craft better AI prompts by providing guidance on how to phrase queries for optimal results.</td></tr><tr><td></td><td><strong>Meeting Preparation</strong></td><td><strong>Static Artifacts</strong> 📦<br><strong>On-Demand Artifacts</strong> 💥<br><strong>Data Sources</strong> 🤖</td><td>Synthesizes data from various sources to provide personalized summaries, key discussion points, and relevant context before meetings.</td></tr><tr><td><strong>User-Input</strong></td><td><strong>General Knowledge Queries</strong></td><td>None</td><td>Provides definitions, explanations, and contextual insights by leveraging built-in LLM knowledge or conducting web-based searches.</td></tr><tr><td></td><td><strong>Virtual Background Generation</strong></td><td>None</td><td>Creates custom AI-generated backgrounds for meetings using generative AI based on user text prompts.</td></tr></tbody></table>

### Zoom Meetings

<table data-header-hidden><thead><tr><th></th><th></th><th width="209.55859375"></th><th></th></tr></thead><tbody><tr><td><strong>Context Type</strong></td><td><strong>Feature</strong></td><td><strong>Content Resource</strong></td><td><strong>Description</strong></td></tr><tr><td><strong>Context-Dependent</strong></td><td><strong>In-Meeting Questions</strong></td><td><strong>Real-Time Artifacts</strong> ⚡</td><td>Allows participants to discreetly ask AI Companion questions about the meeting using real-time transcript analysis.</td></tr><tr><td></td><td><strong>Meeting Summary</strong></td><td><strong>Real-Time Artifacts</strong> ⚡</td><td>Automatically generates structured summaries capturing key discussion points, decisions, and action items after meetings conclude.</td></tr></tbody></table>

### Recordings

<table data-header-hidden><thead><tr><th></th><th></th><th width="209.90625"></th><th></th></tr></thead><tbody><tr><td><strong>Context Type</strong></td><td><strong>Feature</strong></td><td><strong>Content Resource</strong></td><td><strong>Description</strong></td></tr><tr><td><strong>Context-Dependent</strong></td><td><strong>Smart Recording</strong></td><td><strong>Static Artifacts</strong> 📦</td><td>Enhances cloud recorded meetings by automatically generating structured summaries, highlighting key moments, and identifying action items.</td></tr><tr><td></td><td><strong>Voice Recorder</strong></td><td><strong>Real-Time Artifacts</strong> ⚡</td><td>Brings the power of AI Companion to in-person conversations by capturing, transcribing, and summarizing live discussions through the Zoom Workplace mobile app.</td></tr></tbody></table>

### Chat

<table data-header-hidden><thead><tr><th></th><th width="180.28515625"></th><th width="209.72265625"></th><th></th></tr></thead><tbody><tr><td><strong>Context Type</strong></td><td><strong>Feature</strong></td><td><strong>Content Resource</strong></td><td><strong>Description</strong></td></tr><tr><td><strong>Context-Dependent</strong></td><td><strong>Thread Summary</strong></td><td><strong>On-Demand Artifacts</strong> 💥<br><strong>Static Artifacts</strong> 📦</td><td>Provides AI-generated summaries of all messages within a thread, highlighting key points, decisions, and action items.</td></tr><tr><td></td><td><strong>Document Summary</strong></td><td><strong>On-Demand Artifacts 💥</strong><br><strong>Static Artifacts 📦</strong></td><td>Provides AI-generated summaries of attached text-based files or Zoom docs.</td></tr><tr><td><strong>Context-Possible</strong></td><td><strong>Chat Compose</strong></td><td><strong>On-Demand Artifacts</strong> 💥<br><strong>Static Artifacts</strong> 📦</td><td>Uses AI to assist users in drafting messages by analyzing conversation context and offering suggestions for tone, topics, or length.</td></tr><tr><td></td><td><strong>Quick Scheduling</strong></td><td><strong>On-Demand Artifacts</strong> 💥<br><strong>Static Artifacts</strong> 📦</td><td>Allows users to schedule meetings directly from chat interface by automatically suggesting available times based on participants' schedules.</td></tr><tr><td></td><td><strong>Sentence Completion</strong></td><td><strong>On-Demand Artifacts</strong> 💥</td><td>Assists users by offering AI-generated suggestions to finish sentences as they type based on conversation context.</td></tr></tbody></table>

### Zoom Phone

<table data-header-hidden><thead><tr><th></th><th></th><th width="193.390625"></th><th></th></tr></thead><tbody><tr><td><strong>Context Type</strong></td><td><strong>Feature</strong></td><td><strong>Content Resource</strong></td><td><strong>Description</strong></td></tr><tr><td><strong>Context-Dependent</strong></td><td><strong>Call Summary</strong></td><td><strong>Real-Time Artifacts</strong> ⚡</td><td>Generates AI post-call summaries capturing key details such as dates, names, discussion points, and action items.</td></tr><tr><td></td><td><strong>Call Questions</strong></td><td><strong>Real-Time Artifacts ⚡</strong></td><td>Answers user questions using the live transcript as context.</td></tr><tr><td></td><td><strong>Team SMS Thread Summary</strong></td><td><strong>Static Artifacts</strong> 📦</td><td>Generates AI summaries of Team SMS conversations for Call Queue and Auto Receptionist members.</td></tr><tr><td></td><td><strong>Voicemail Prioritization</strong></td><td><strong>Static Artifacts</strong> 📦</td><td>Automatically identifies and prioritizes voicemail messages that match predefined topics or intents.</td></tr><tr><td></td><td><strong>Voicemail Tasks</strong></td><td><strong>Static Artifacts</strong> 📦</td><td>Analyzes voicemail content and automatically suggests tasks based on key details to help users stay organized.</td></tr><tr><td></td><td><strong>Create Zoom Doc</strong></td><td><strong>Static Artifacts 📦</strong></td><td>Creates a collaborative Zoom doc using the Call Summary.</td></tr></tbody></table>

### Contact Center

<table data-header-hidden><thead><tr><th></th><th></th><th width="210.13671875"></th><th></th></tr></thead><tbody><tr><td><strong>Context Type</strong></td><td><strong>Feature</strong></td><td><strong>Content Resource</strong></td><td><strong>Description</strong></td></tr><tr><td><strong>Context-Dependent</strong></td><td><strong>Agent Talk Metrics</strong></td><td><strong>Real-Time Artifacts</strong> ⚡</td><td>Provides real-time insights into agent speaking speed and speech length during customer engagements.</td></tr><tr><td></td><td><strong>Consumer Sentiment Analysis</strong></td><td><strong>Real-Time Artifacts</strong> ⚡</td><td>Provides real-time insights into customer sentiment during messaging and voice interactions using AI analysis.</td></tr><tr><td></td><td><strong>Conversation Summary</strong></td><td><strong>Real-Time Artifacts</strong> ⚡</td><td>Provides agents with AI-generated summaries of previous conversations when receiving transferred engagements.</td></tr><tr><td></td><td><strong>Follow-Up Tasks</strong></td><td><strong>Real-Time Artifacts</strong> ⚡</td><td>Automatically identifies and suggests follow-up actions based on conversation details to ensure issues are addressed.</td></tr><tr><td></td><td><strong>Smart Compose</strong></td><td><strong>Static Artifacts</strong> 📦</td><td>Helps agents refine their messaging by providing AI-generated suggestions for copyediting, rephrasing, and tone adjustments.</td></tr></tbody></table>

### Tasks

<table data-header-hidden><thead><tr><th></th><th></th><th width="209.65234375"></th><th></th></tr></thead><tbody><tr><td><strong>Context Type</strong></td><td><strong>Feature</strong></td><td><strong>Content Resource</strong></td><td><strong>Description</strong></td></tr><tr><td><strong>Context-Dependent</strong></td><td><strong>Zoom Tasks</strong></td><td><strong>Real-Time Artifacts</strong> ⚡</td><td>Captures action items and follow-ups directly within Zoom Workplace, automatically generating tasks from meeting summaries or Contact Center interactions.</td></tr></tbody></table>

### Mail/Calendar

<table data-header-hidden><thead><tr><th></th><th></th><th width="210.3671875"></th><th></th></tr></thead><tbody><tr><td><strong>Context Type</strong></td><td><strong>Feature</strong></td><td><strong>Content Resource</strong></td><td><strong>Description</strong></td></tr><tr><td><strong>Context-Dependent</strong></td><td><strong>Email Summary</strong></td><td><strong>On-Demand Artifacts 💥</strong></td><td>Provides AI-generated summaries of emails.</td></tr><tr><td><strong>Context-Possible</strong></td><td><strong>Email Compose</strong></td><td><strong>On-Demand Artifacts</strong> 💥</td><td>Helps users draft emails more efficiently by providing AI-generated suggestions based on email thread context or specific user inputs.</td></tr></tbody></table>

### Whiteboard

<table data-header-hidden><thead><tr><th></th><th></th><th width="209.58984375"></th><th></th></tr></thead><tbody><tr><td><strong>Context Type</strong></td><td><strong>Feature</strong></td><td><strong>Content Resource</strong></td><td><strong>Description</strong></td></tr><tr><td><strong>Context-Possible</strong></td><td><strong>Content Generation</strong></td><td><strong>Static Artifacts</strong> 📦</td><td>Enables users to generate ideas, refine existing content, and add visual elements to whiteboards with AI assistance.</td></tr></tbody></table>

### Docs

<table data-header-hidden><thead><tr><th></th><th></th><th width="210.41796875"></th><th></th></tr></thead><tbody><tr><td><strong>Context Type</strong></td><td><strong>Feature</strong></td><td><strong>Content Resource</strong></td><td><strong>Description</strong></td></tr><tr><td><strong>Context-Possible</strong></td><td><strong>Content Generation and Revision</strong></td><td><strong>Static Artifacts</strong> 📦</td><td>Assists users in creating and refining documents by offering suggestions for new content, generating summaries, and revising existing content.</td></tr><tr><td></td><td><strong>Sentence Completion</strong></td><td><strong>On-Demand Artifacts</strong> 💥</td><td>Assists users by offering AI-generated suggestions to finish sentences as they type based on conversation context.</td></tr></tbody></table>

### Events

<table data-header-hidden><thead><tr><th></th><th></th><th width="210.39453125"></th><th></th></tr></thead><tbody><tr><td><strong>Context Type</strong></td><td><strong>Feature</strong></td><td><strong>Content Resource</strong></td><td><strong>Description</strong></td></tr><tr><td><strong>Context-Possible</strong></td><td><strong>Chat Compose</strong></td><td><strong>Static Artifacts</strong> 📦</td><td>Allows users to quickly craft professional and contextually-aware responses within event lobbies.</td></tr><tr><td><strong>User-Input</strong></td><td><strong>Email Compose</strong></td><td>None</td><td>Helps users create email content for event communication including email bodies, subject lines, and call-to-action text.</td></tr><tr><td></td><td><strong>Image Generation</strong></td><td>None</td><td>Creates custom images for events including headers, session images, and expo images using AI-generated content.</td></tr><tr><td></td><td><strong>Smart Compose</strong></td><td>None</td><td>Quickly generates content for event descriptions, session details, speaker bios, and lobby announcements based on user prompts.</td></tr></tbody></table>

### Zoom Hub

<table data-header-hidden><thead><tr><th></th><th></th><th width="209.58984375"></th><th></th></tr></thead><tbody><tr><td><strong>Context Type</strong></td><td><strong>Feature</strong></td><td><strong>Content Resource</strong></td><td><strong>Description</strong></td></tr><tr><td><strong>Context-Dependent</strong></td><td><strong>Ask Questions</strong></td><td><strong>Static Artifacts</strong> 📦</td><td>Queries user selected documents for information and provides AI-generated responses using information from the selected artifacts.</td></tr></tbody></table>

### AI Companion Third-Party Meeting Assistant Architecture

The following diagram outlines typical dataflows for AI Companion when used with third-party meeting services.

<div data-with-frame="true"><figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXeGzNm7e0SPT0clFEPeGLthiWap99bcA4js4UMgfCIDp8teyBYL2HFlZr_TxLe-oxJSYrf08j0KUNhADCNXEMAnk4UEbqlC6OCjKy_BB_6cIxqbExU8-YGTYA7Ob3Il4jEpuTRoEA?key=8xRdbBwKrN2U2fUmgGv7Q9gQ" alt="Diagram depicting Third-Party Meeting Assistant data flows"><figcaption><p>Diagram depicting Third-Party Meeting Assistant data flows</p></figcaption></figure></div>

### Virtual Background Generation

The following diagram illustrates how Zoom generates virtual background generation with AI Companion.

<div data-with-frame="true"><figure><img src="https://1175968039-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FctBXUMeBy4rtLMmMkKRG%2Fuploads%2Fgit-blob-3eee49a5e25e5f27381016ded638473625310c5a%2Fimage23.png?alt=media" alt=""><figcaption><p>Zoom Virtual Background generation dataflows</p></figcaption></figure></div>

### Sentence Completion

The following diagram illustrates how Sentence Completion works within the Zoom Workplace app.

<div data-with-frame="true"><figure><img src="https://1175968039-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FctBXUMeBy4rtLMmMkKRG%2Fuploads%2Fgit-blob-0d3ae579699961ba3915d91b9856f71401b80b1f%2Fimage.png?alt=media" alt=""><figcaption><p>Sentence Completion dataflows</p></figcaption></figure></div>


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://library.zoom.com/zoom-workplace/artificial-intelligence/artificial-intelligence-bluepaper/ai-companion/ai-companion-diagrams-and-dataflows.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.