Audio-Driven Virtual Model Adjustment for Synchronized Image Display

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional virtual models added to images remain inflexible and unchanged, lacking a dynamic linkage between visual and audio presentations.

Innovation Solution

A method and device that adjust virtual model parameters based on attributes of audio information, allowing the virtual model to change over time in response to audio attributes, thereby creating a dynamic linkage between visual and audio presentations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If the virtual model is pre-set or pre-stored in a database, then the virtual model can be easily added to an image, but the virtual model remains unchanged and representation is inflexible

Engineering Contradiction:
Improveease of adding virtual model to imageVSAvoidflexibility of virtual model representation
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent applies the dynamics principle by making the virtual model parameters adjustable and changeable over time based on audio information. The virtual model transitions from a static, pre-stored state to a dynamic state where parameters such as position, scale, rotation, and other visual attributes can be modified in real-time according to audio input, thereby achieving both ease of addition and flexibility of representation

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements parameter changes by modifying the virtual model's parameters based on audio information attributes. The system adjusts parameters including but not limited to position, scale, rotation, transparency, and color of the virtual model in response to audio input, enabling flexible representation while maintaining simple integration into images

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If the virtual model remains unchanged after being added to an image, then the system is simple to operate, but the presentation lacks flexibility and linkage with audio

Engineering Contradiction:
Improvesimplicity of system operationVSAvoidflexibility of virtual model presentation
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent applies self-service by enabling the virtual model to automatically adjust its parameters based on audio information without requiring manual intervention. The system processes audio input and autonomously modifies the virtual model's visual presentation, maintaining operational simplicity while achieving flexible, dynamic representation linked to audio content

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12482205B2Virtual model processing method and apparatus, electronic device and storage medium
Publication Date: 2025.11.25 DOUYIN VISION CO LTD
  • US12482205B2 patent drawing
  • US12482205B2 patent drawing
  • US12482205B2 patent drawing

AI summary

A virtual model processing method and apparatus, an electronic device and a storage medium are provided. Said method comprises: acquiring audio information; according to attribute information of the audio information, adjusting parameters of a virtual model; and according to the adjusted parameters of the virtual model, displaying the virtual model in a target image. The parameters of the virtual model are adjusted according to the attribute information of the audio information. The attribute information of the audio information can change with time. Accordingly, the parameters of the virtual model can also change with time.