Music-Synchronized Special Effects for Motion-Based Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing human-computer interaction technologies in entertainment scenarios lack richness and fail to incorporate musical effects, resulting in uninteresting experiences.

Innovation Solution

A method and apparatus that generate and control effect elements based on music features and user movements, triggering effects when specific conditions are met, enhancing interaction and game experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If existing human-computer interaction technologies are used in entertainment scenarios, then the basic interaction function is achieved, but the interaction richness and musical effect incorporation are insufficient

Engineering Contradiction:
Improveinteraction richnessVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges music playback functionality with effect element generation and control systems. The music player module integrates with the effect element showing module to synchronize visual effects with musical beats, creating rich interactive experiences that combine audio and visual domains without requiring separate independent systems

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The effect element showing module serves multiple functions: it displays effect elements, controls their movement based on music features, and coordinates interactions with the music player. This multi-functional design increases interaction versatility while avoiding the need for separate dedicated components for each function

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If effect elements are controlled according to music features and user movements, then interaction joy is improved, but processing complexity increases

Engineering Contradiction:
Improveinteraction joyVSAvoidcontrol complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system implements feedback loops where music features (beat detection, rhythm analysis) continuously influence effect element behavior, and user movements (detected via sensors or input devices) dynamically adjust element positions. This feedback mechanism creates engaging interactive experiences through automated adaptive control rather than complex manual control systems

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces complex mechanical control systems with automated software-based control. Instead of requiring complex hardware mechanisms to respond to music and user input, the system uses processing modules that analyze music features and movement data, then programmatically control effect elements, simplifying the overall system architecture

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If multiple effect elements are generated and controlled dynamically, then entertainment value increases, but computational resource consumption increases

Engineering Contradiction:
Improveentertainment valueVSAvoidcomputational energy
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The system dynamically generates and manages effect elements based on real-time music features and user interactions. Effect elements are created, moved, and removed automatically according to the current state of music playback and user input, allowing the system to maintain high entertainment value while adapting computational resource allocation to actual usage patterns rather than maintaining maximum capacity continuously

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes operational parameters such as effect element generation rates, movement speeds, and visual properties based on music rhythm and user engagement levels. During high-energy musical segments, more effect elements may be generated, while during quieter passages, the system reduces computational activity, optimizing the balance between entertainment value and energy consumption

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12375618B2Method and apparatus for showing special effect, electronic device, and computer-readable medium
Publication Date: 2025.07.29 DOUYIN VISION CO LTD
  • US12375618B2 patent drawing
  • US12375618B2 patent drawing
  • US12375618B2 patent drawing

AI summary

The present disclosure provides an effect showing method and an apparatus thereof, an electronic device, and a computer-readable medium. The method includes: opening an effect showing interface and turning on a video capturing apparatus; obtaining a music feature of background music in the effect showing interface and second effect elements generated according to the music feature, showing the second effect elements in a preset order, and controlling the second effect elements to move in the effect showing interface according to the music feature; identifying a target object in a video captured by the video capturing apparatus and controlling a first effect element in the effect showing interface to move according to a movement of the target object; and triggering an effect when the first effect element and the second effect elements satisfy a preset condition.