Interaction Object Audio Response Mechanism
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current human-machine interactions using virtual characters are often delayed and unnatural, as virtual characters cannot respond effectively to the speaking state of users, leading to obstacles in communication.
Innovation Solution
A method and apparatus for driving an interaction object based on audio signals at the periphery of a display device, where the interaction object responds to target objects by detecting sounds and adjusting actions according to the speaking state, using first, second, and third driving data, and adjusting volume and position based on environmental noise.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If virtual characters use voice assistant-based interaction, then voice input is accepted, but response timing is delayed and cannot adapt to user speaking state
Solution Approach 1:
The system continuously monitors the audio signal during the interaction object's response action to detect whether the target object continues speaking. This real-time feedback mechanism allows the system to adjust the interaction object's behavior dynamically - repeating the action if speaking continues, or returning to initial state if speaking stops - thereby eliminating response delays and adapting to the user's speaking state in real time
2Adaptability or versatility
If interaction object repeats actions based on continuous speaking detection, then response naturalness is improved, but energy consumption increases
Solution Approach 1:
Instead of continuous monitoring, the system uses periodic action by setting a preset time interval to detect whether the target object is still speaking. The interaction object repeats the response action only within this periodic framework, and returns to initial state if the speaking doesn't continue within the preset time. This periodic approach maintains response naturalness while significantly reducing energy consumption compared to continuous monitoring
Data Source
AI summary
Methods, electronic devices, and storage media for driving an interaction object are provided. The methods include: obtaining an audio signal at a periphery of a display device; obtaining, based on the audio signal, first driving data for driving the interaction object to respond; monitoring, in response to outputting the first driving data, the audio signal for detecting a sound of a target object; and driving, based on a presence state of the sound of the target object in the audio signal, the interaction object to respond.


