Sidebar Assistant Keyword Detection for Virtual Meeting Note-Taking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

During virtual meetings, participants face challenges in engaging in side conversations without disrupting the main presentation, and taking notes on action items or topics of interest without distracting from the main meeting.

Innovation Solution

A sidebar assistant is provided that monitors audio streams in a sidebar meeting to identify keywords, allowing for automated note-taking, transcription, and recording of action items, which can be displayed and edited by participants, and shared after the meeting.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If participants engage in side conversations during virtual meetings, then they can discuss topics of interest, but it may disrupt the main presentation

Engineering Contradiction:
Improveability to engage in side conversationsVSAvoiddisruption to main presentation
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The system segments the meeting environment into a main meeting channel and separate sidebar channels. Participants can join sidebars to discuss topics privately without their audio/video being transmitted to the main meeting, thus enabling side conversations while preventing disruption to the main presentation.

Inventive Principle:
Principle #1Segmentation

2Loss of information

If participants take notes manually during virtual meetings, then they can capture action items, but it distracts from the main meeting

Engineering Contradiction:
Improvecapture of action itemsVSAvoidfocus on main meeting
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The sidebar assistant automatically transcribes audio from the sidebar meeting and identifies action items without requiring manual note-taking. The system self-services by listening to the conversation, generating notes, and presenting them to participants, thus capturing action items while allowing participants to maintain focus on the main meeting.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system replaces the mechanical process of manual note-taking with automated speech recognition and natural language processing. The sidebar assistant uses AI to transcribe audio, identify action items, and generate structured notes, eliminating the need for participants to manually write notes during the meeting.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If automated note-taking is implemented, then note-taking efficiency improves, but accuracy of captured information may decrease

Engineering Contradiction:
Improvenote-taking efficiencyVSAvoidaccuracy of captured information
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system presents generated notes and action items back to participants for review and editing. Participants can verify the accuracy of transcribed information and correct any errors, ensuring high accuracy while maintaining the efficiency benefits of automated note-taking.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20230230595A1Sidebar assistant for notetaking in sidebars during virtual meetings
Publication Date: 2023.07.20 ZOOM VIDEO COMM INC
  • US20230230595A1 patent drawing
  • US20230230595A1 patent drawing
  • US20230230595A1 patent drawing

AI summary

Provided herein are systems and methods for providing a sidebar assistant for sidebars during virtual meetings. A system may include a non-transitory computer-readable medium, a communications interface, and a processor communicatively coupled to the non-transitory computer-readable medium and the communications interface. The processor may be further configured to establish a video conference having a plurality of participants, receive, from a first client device, a request for a sidebar meeting, and transmit to the first client device a first set of audio and video streams corresponding to a main meeting, and a second set of audio and video streams corresponding to the sidebar meeting. The processor-executable instructions may further cause the processor to identify, by a sidebar assistant, one or more keywords in an audio stream corresponding to the sidebar meeting and generate, by the sidebar assistant, a note based on the identified keywords.