Interaction Object Audio Response Mechanism

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current human-machine interactions using virtual characters are often delayed and unnatural, as virtual characters cannot respond effectively to the speaking state of users, leading to obstacles in communication.

Innovation Solution

A method and apparatus for driving an interaction object based on audio signals at the periphery of a display device, where the interaction object responds to target objects by detecting sounds and adjusting actions according to the speaking state, using first, second, and third driving data, and adjusting volume and position based on environmental noise.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If virtual characters use voice assistant-based interaction, then voice input is accepted, but response timing is delayed and cannot adapt to user speaking state

Engineering Contradiction:
Improvevoice input capabilityVSAvoidresponse delay
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system continuously monitors the audio signal during the interaction object's response action to detect whether the target object continues speaking. This real-time feedback mechanism allows the system to adjust the interaction object's behavior dynamically - repeating the action if speaking continues, or returning to initial state if speaking stops - thereby eliminating response delays and adapting to the user's speaking state in real time

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If interaction object repeats actions based on continuous speaking detection, then response naturalness is improved, but energy consumption increases

Engineering Contradiction:
Improveresponse naturalnessVSAvoidenergy consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

Instead of continuous monitoring, the system uses periodic action by setting a preset time interval to detect whether the target object is still speaking. The interaction object repeats the response action only within this periodic framework, and returns to initial state if the speaking doesn't continue within the preset time. This periodic approach maintains response naturalness while significantly reducing energy consumption compared to continuous monitoring

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS11769499B2Driving interaction object
Publication Date: 2023.09.26 BEIJING SENSETIME TECH DEV CO LTD
  • US11769499B2 patent drawing
  • US11769499B2 patent drawing
  • US11769499B2 patent drawing

AI summary

Methods, electronic devices, and storage media for driving an interaction object are provided. The methods include: obtaining an audio signal at a periphery of a display device; obtaining, based on the audio signal, first driving data for driving the interaction object to respond; monitoring, in response to outputting the first driving data, the audio signal for detecting a sound of a target object; and driving, based on a presence state of the sound of the target object in the audio signal, the interaction object to respond.