Speech Service Layer for Display Window Interaction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing speech-based interaction systems for electronic devices require significant developer effort to implement and manage speech operations for each window, leading to increased workload and hindering the widespread adoption of voice interaction.

Innovation Solution

The system converts speech input into operation instructions and simulates manual selection events for interface elements, allowing existing processing logic to be reused without custom code adaptation, enabling speech support from the system layer across multiple display windows.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If speech-based interaction is implemented in existing application programs, then speech operation support is achieved, but developer workload increases significantly

Engineering Contradiction:

Improvespeech operation supportVSAvoiddeveloper workload

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a universal speech service layer that provides speech operation support to multiple application programs simultaneously. The speech service registers speech instruction sets at the system level, allowing any application window to receive speech control without individual customization. This multi-functional approach enables one speech service infrastructure to serve numerous applications, reducing the need for each developer to implement separate speech recognition systems.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces a speech service as an intermediary layer between the user's speech input and the application programs. This mediator converts speech information into control instructions and routes them to the appropriate application windows. The speech service acts as a buffer that translates speech into standardized commands, shielding application developers from the complexity of speech recognition while providing unified speech control capabilities across multiple applications.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Adaptability or versatility

If custom speech operation code is added to each window, then speech control functionality is achieved, but implementation time increases

Engineering Contradiction:

Improvespeech control functionalityVSAvoidimplementation time

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent extracts the speech operation logic from individual application windows and consolidates it into a separate speech service. Instead of embedding speech recognition and processing code within each application, the speech service handles all speech-related operations centrally. This extraction removes the time-consuming task of implementing speech control in each application, as developers only need to register their windows with the speech service rather than building speech processing capabilities from scratch.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent performs preliminary setup by having the speech service pre-register speech instruction sets and establish the speech processing infrastructure before applications need to use speech control. The speech service is configured in advance to recognize speech patterns and generate appropriate control instructions, so when applications want speech functionality, the framework is already in place and ready to serve them immediately, eliminating the need for time-intensive implementation at the application level.

Inventive Principle:

Principle #10Preliminary action

3Adaptability or versatility

If speech service is integrated into each application program, then speech interaction is enabled, but system resource consumption increases

Engineering Contradiction:

Improvespeech interaction capabilityVSAvoidsystem resource consumption

Core Design Contradiction:

Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent merges the speech service functionality into a single shared system component that serves multiple application programs simultaneously. Instead of each application having its own speech recognition engine, the speech service consolidates speech processing resources into one location. This combining approach allows multiple applications to share the same speech recognition, processing, and conversion resources, significantly reducing the total system resource consumption compared to having duplicate speech services in each application.

Inventive Principle:

Principle #5Merging (Combining)

Data Source

PatentUS11080016B2Speech-based interaction with a display window

Publication Date: 2021.08.03 BANMA ZHIXING NETWORK HONGKONG CO LTD

AI summary

Speech-based interaction with a display window is disclosed, including: receiving speech input with respect to a display window that is presented at a device; converting the speech input into an operation instruction; determining an interface element of the display window that corresponds to the operation instructions, including by querying interface element information corresponding to the display window; and activating the interface element of the display window based at least in part on simulating a manual selection event with respect to the interface element of the display window.