AI Companion Diagrams and Dataflows
The following diagrams demonstrate the core data processing pathways and functional architecture of each feature.
Core AI Companion Features
The following diagram illustrates the dataflows behind most of Zoom AI Companion's features, organized by Content Resources that provide inputs to these AI services:
Static Artifacts 📦: Artifacts that are stored at rest, such as post-meeting transcripts, Zoom Team Chat messages, text messages, voicemail, etc.
Real-Time Artifacts ⚡: Artifacts that are considered “live” and ongoing in real-time, such as a live transcript from a meeting or phone call or an active chatbot conversation. Keep in mind that after the live session completes, if these records are retained, they will transition to Static Artifacts__⚡.
Data Sources 🤖: Third-party artifacts (email, calendar, and/or files) indexed in a retrieval-augment generated module for improved AI capabilities, if the account setting is enabled. For example, emails and calendar events users can search for with AI Companion.
On-Demand Artifacts 💥: Information that is processed in real-time during active user sessions within the Zoom Workplace app, exclusively for providing contextual input to AI services without any persistent storage or indexing. These artifacts are dynamically pulled from local sources only when needed for immediate workflow context. For example, responding to an ongoing email thread with the Email Compose feature will temporarily include previous emails in the payload to the LLM service directly from the Zoom Workplace app's local access—not the host server—providing context that helps shape the response. A list of On-Demand artifacts may include but are not limited to:
Zoom Team Chat Messages
Zoom Docs
Email
In conjunction with the content resources, each feature falls into one of three categories based on how it uses contextual information, as shown in the Context Table:
Context-Dependent Features: Features that always utilize a relevant, contextual artifact for delivering an AI service. For example, Live Transcripts are used to produce Meeting Summaries.
Context-Possible / Context-Conditional Features: Features that can use relevant, contextual artifacts for delivering an AI service, depending on the context or user actions. For example, responding to an ongoing email thread with Email Compose will use a contextual artifact, while using Email Compose in a brand new email will not.
User-Input Features: Features that always require user input to function. For example, generating a virtual background based on the user’s input.
By combining the Content Resources and the Context Table into the following unified table, you can see which data types each feature uses, as each feature is labeled with the appropriate symbol to indicate the content source it relies on.
For example, within the AI Companion Panel section are a list of features broken down by being Context-Dependent, Context-Possible, and User-Input. In the Context-Dependent section is Smart Scheduling, with the content resources Static Artifacts 📦, On-Demand Artifacts💥 , and Data Sources 🤖 in the column next to it. Together, these reveal that this feature can use artifacts from all three sources, if they are available (note that these features may work in a diminished capacity if not _all_context sources are available. ).
Alternatively, under the User-Input section is General Knowledge Queries. Because this feature does not intrinsically depend on any context—except for user-inputs—, there are no content resources listed.
Warning
The following tables account for standard artifact use cases. The diagram and table cannot account for user-provided files paired with requests. Readers should assume users may upload files at any time with any feature unless local file uploads are disabled. Additionally, some features may combine multiple artifact types for optimal results. If certain data sources are unavailable, features automatically adapt to deliver the best possible experience with remaining resources. For example, Context-Aware Follow-Ups creates more detailed responses when third-party Data Sources 🤖 are accessible, while still providing valuable follow-ups without them.
AI Companion Features
AI Companion Panel
Context Type
Feature
Content Resource
Description
Context-Dependent
Chat Summaries & Search
Static Artifacts 📦 On-Demand Artifacts 💥
Summarizes recent messages in active chat channels and helps locate specific conversation points users may not clearly remember.
Context-Aware Follow-Ups
Static Artifacts 📦 On-Demand Artifacts 💥 Data Sources 🤖
Generates personalized follow-up messages based on meeting transcripts to ensure accuracy and relevance in post-meeting communication.
Data Analysis
On-Demand Artifacts 💥 Data Sources 🤖
Allows users to upload datasets and quickly generate summaries of key findings, patterns, and trends.
In-App Contextual Awareness
Static Artifacts 📦 On-Demand Artifacts 💥 Data Sources 🤖
Provides intelligent, context-aware assistance that adapts responses based on your current location and activity within the Zoom Workplace application.
Post-Meeting Transcript Querying
Static Artifacts 📦
Enables users to ask natural language questions about meeting content and receive instant responses from meeting transcripts.
Smart Scheduling
On-Demand Artifacts 💥 Data Sources 🤖
Searches colleagues' calendars to find and schedule meeting times that work for both parties.
Context-Possible
Agenda Creation
Static Artifacts 📦 On-Demand Artifacts 💥 Data Sources 🤖
Generates structured agendas leveraging insights from meeting preparation to ensure attendees are aligned on discussion topics.
Prompt Assistance
On-Demand Artifacts 💥
Helps users craft better AI prompts by providing guidance on how to phrase queries for optimal results.
Meeting Preparation
Static Artifacts 📦 On-Demand Artifacts 💥 Data Sources 🤖
Synthesizes data from various sources to provide personalized summaries, key discussion points, and relevant context before meetings.
User-Input
General Knowledge Queries
None
Provides definitions, explanations, and contextual insights by leveraging built-in LLM knowledge or conducting web-based searches.
Virtual Background Generation
None
Creates custom AI-generated backgrounds for meetings using generative AI based on user text prompts.
Zoom Meetings
Context Type
Feature
Content Resource
Description
Context-Dependent
In-Meeting Questions
Real-Time Artifacts ⚡
Allows participants to discreetly ask AI Companion questions about the meeting using real-time transcript analysis.
Meeting Summary
Real-Time Artifacts ⚡
Automatically generates structured summaries capturing key discussion points, decisions, and action items after meetings conclude.
Recordings
Context Type
Feature
Content Resource
Description
Context-Dependent
Smart Recording
Static Artifacts 📦
Enhances cloud recorded meetings by automatically generating structured summaries, highlighting key moments, and identifying action items.
Voice Recorder
Real-Time Artifacts ⚡
Brings the power of AI Companion to in-person conversations by capturing, transcribing, and summarizing live discussions through the Zoom Workplace mobile app.
Team Chat
Context Type
Feature
Content Resource
Description
Context-Dependent
Thread Summary
On-Demand Artifacts 💥 Static Artifacts 📦
Provides AI-generated summaries of all messages within a thread, highlighting key points, decisions, and action items.
Context-Possible
Chat Compose
On-Demand Artifacts 💥 Static Artifacts 📦
Uses AI to assist users in drafting messages by analyzing conversation context and offering suggestions for tone, topics, or length.
Quick Scheduling
On-Demand Artifacts 💥 Static Artifacts 📦
Allows users to schedule meetings directly from chat interface by automatically suggesting available times based on participants' schedules.
Sentence Completion
On-Demand Artifacts 💥
Assists users by offering AI-generated suggestions to finish sentences as they type based on conversation context.
Zoom Phone
Context Type
Feature
Content Resource
Description
Context-Dependent
Call Summary
Real-Time Artifacts ⚡
Generates AI post-call summaries capturing key details such as dates, names, discussion points, and action items.
Team SMS Thread Summary
Static Artifacts 📦
Generates AI summaries of Team SMS conversations for Call Queue and Auto Receptionist members.
Voicemail Prioritization
Static Artifacts 📦
Automatically identifies and prioritizes voicemail messages that match predefined topics or intents.
Voicemail Tasks
Static Artifacts 📦
Analyzes voicemail content and automatically suggests tasks based on key details to help users stay organized.
Contact Center
Context Type
Feature
Content Resource
Description
Context-Dependent
Agent Talk Metrics
Real-Time Artifacts ⚡
Provides real-time insights into agent speaking speed and speech length during customer engagements.
Consumer Sentiment Analysis
Real-Time Artifacts ⚡
Provides real-time insights into customer sentiment during messaging and voice interactions using AI analysis.
Conversation Summary
Real-Time Artifacts ⚡
Provides agents with AI-generated summaries of previous conversations when receiving transferred engagements.
Follow-Up Tasks
Real-Time Artifacts ⚡
Automatically identifies and suggests follow-up actions based on conversation details to ensure issues are addressed.
Smart Compose
Static Artifacts 📦
Helps agents refine their messaging by providing AI-generated suggestions for copyediting, rephrasing, and tone adjustments.
Tasks
Context Type
Feature
Content Resource
Description
Context-Dependent
Zoom Tasks
Real-Time Artifacts ⚡
Captures action items and follow-ups directly within Zoom Workplace, automatically generating tasks from meeting summaries or Contact Center interactions.
Mail/Calendar
Context Type
Feature
Content Resource
Description
Context-Possible
Email Compose
On-Demand Artifacts 💥
Helps users draft emails more efficiently by providing AI-generated suggestions based on email thread context or specific user inputs.
Whiteboard
Context Type
Feature
Content Resource
Description
Context-Possible
Content Generation
Static Artifacts 📦
Enables users to generate ideas, refine existing content, and add visual elements to whiteboards with AI assistance.
Docs
Context Type
Feature
Content Resource
Description
Context-Possible
Content Generation and Revision
Static Artifacts 📦
Assists users in creating and refining documents by offering suggestions for new content, generating summaries, and revising existing content.
Sentence Completion
On-Demand Artifacts 💥
Assists users by offering AI-generated suggestions to finish sentences as they type based on conversation context.
Events
Context Type
Feature
Content Resource
Description
Context-Possible
Chat Compose
Static Artifacts 📦
Allows users to quickly craft professional and contextually-aware responses within event lobbies.
User-Input
Email Compose
None
Helps users create email content for event communication including email bodies, subject lines, and call-to-action text.
Image Generation
None
Creates custom images for events including headers, session images, and expo images using AI-generated content.
Smart Compose
None
Quickly generates content for event descriptions, session details, speaker bios, and lobby announcements based on user prompts.
Virtual Background Generation
The following diagram illustrates how Zoom generates virtual background generation with AI Companion.
Sentence Completion
The following diagram illustrates how Sentence Completion works within the Zoom Workplace app.
Last updated
Was this helpful?