Audio Interactive Display Automatic Marker Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Manual operation with mouse or laser pointers during presentations disrupts the fluency of speech and hinders audience engagement in remote video interactions, as they require manual marking of speech content on slides.

Innovation Solution

A display system and method that utilize an audio input device to convert audio signals into text data, comparing this text with identification data from a document file to automatically mark corresponding content on the display image in real-time, using a voice-to-text converting module and analysis module.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual operation with mouse pointer or laser pointer is used to mark speech content on slides, then the current speech content can be marked on the display, but the fluency of user speech is affected and audience identification of remote video is hindered

Engineering Contradiction:
Improveautomatic marking operationVSAvoidspeech fluency
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system automatically marks speech content on slides by capturing audio input, converting it to text, comparing it with identification data in the document, and moving the marker without requiring manual user operation. The system serves itself by autonomously performing the marking function that previously required manual intervention.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical manual operation of moving mouse pointers or laser pointers with an automated system that uses audio capture, voice-to-text conversion, and automated marker control. This substitution eliminates the need for physical manual manipulation while achieving the same marking function.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Extent of automation

If manual operation with mouse pointer or laser pointer is used to mark speech content on slides, then the current speech content can be marked on the display, but audience engagement in remote video interactions is hindered

Engineering Contradiction:
Improveautomatic content markingVSAvoidaudience identification
Core Design Contradiction:
Extent of automationVSEase of operation

Solution Approach 1:

The system automatically marks speech content on slides by capturing audio input, converting it to text, comparing it with identification data in the document, and moving the marker without requiring manual user operation. The system serves itself by autonomously performing the marking function that previously required manual intervention.

Inventive Principle:
Principle #25Self-service

3Productivity

If voice-to-text conversion and automatic marking is implemented, then speech fluency and audience engagement are enhanced, but system complexity increases

Engineering Contradiction:
Improvepresentation efficiencyVSAvoidsystem structure
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent combines multiple functions into an integrated system: audio capture, voice-to-text conversion, text comparison with document content, and automated marker control are merged into a single coordinated system. This consolidation achieves automatic marking while managing complexity through functional integration.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system introduces intermediate components such as the voice-to-text converting module and the comparison module that bridge the gap between audio input and marker control. These intermediaries facilitate the automated process by converting audio to comparable text format and determining when marker movement is required.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11704090B2Audio interactive display system and method of interacting with audio interactive display system
Publication Date: 2023.07.18 AVER INFORMATION INC
  • US11704090B2 patent drawing
  • US11704090B2 patent drawing
  • US11704090B2 patent drawing

AI summary

A display system and method of interacting with the display system are provided. The method of interacting with the display system comprises following steps: receiving an audio signal through an audio input device; converting the audio signal to corresponding text data through a voice-to-text converting module; generating a corresponding display image according to a document file; acquiring multiple identification data corresponding to the display image from the document file; comparing the text data with the identification data; and if the text data corresponds to one of the identification data, moving or displaying a marker on the display image through the display system according to a coordinate of one of the identification data.