Motion Graphics Synchronization with Music Structure
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems for displaying motion graphics in harmony with music reproduction lack effectiveness in fitting the graphics to the image of the reproduced sound, necessitating an improved method for synchronizing visual elements with audio progression.
Innovation Solution
A music reproduction system that includes a portable communication terminal, an acoustic reproduction device, and server devices to transmit and display motion graphics data synchronized with music genre and structure data, allowing for dynamic adjustment of text and background images based on lyrics and music characteristics.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If motion graphics are displayed based on simple music genre classification, then the display system is easier to implement, but the graphics do not fit the image of the reproduced sound well
Solution Approach 1:
The patent segments music structure into multiple parameters including genre, tempo, key, and structural sections (verse, chorus, bridge). By dividing the music analysis into these components, the system achieves both ease of implementation through standardized classification and high fitting accuracy through multi-dimensional matching with motion graphics parameters.
Solution Approach 2:
The system changes multiple parameters simultaneously including music genre, tempo, key, and structural position to select appropriate motion graphics. This multi-parameter approach allows the system to maintain ease of implementation through parameter-based classification while achieving high fitting accuracy through comprehensive parameter matching.
2Manufacturing precision
If motion graphics are customized for each section of the musical piece, then the visual expression fits the music better, but the system complexity increases
Solution Approach 1:
The patent divides the musical piece into standard structural sections (verse, chorus, bridge, intro, outro) and creates specific motion graphics for each section type. This segmentation allows high visual fitting quality through section-specific customization while keeping system complexity manageable through standardized section classification and template-based graphics generation.
Solution Approach 2:
The system dynamically adjusts motion graphics parameters including display timing, duration, and transition effects based on the current music section and tempo. This dynamic adaptation achieves high visual fitting quality while maintaining system simplicity through rule-based dynamic control rather than complex custom programming for each scenario.
3Manufacturing precision
If multiple parameters including tempo and key are considered for motion graphics selection, then the graphics fit the music image better, but the data processing complexity increases
Solution Approach 1:
The system processes multiple music parameters (genre, tempo, key, structure) simultaneously to select motion graphics that fit the music image. By using parameter-based classification and pre-defined mapping rules, the system achieves high fitting accuracy while keeping data processing complexity manageable through standardized parameter handling and template matching algorithms.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method according to one aspect of the present disclosure includes acquiring verbal data representing a verbal expression corresponding to a sound reproduced by an acoustic device, and displaying, on a display device, motion graphics including the verbal expression corresponding to the sound reproduced by the acoustic device in a form of a text in accordance with the verbal data. The displaying the motion graphics on the display device includes selecting a type of motion graphics that relates to the verbal expression corresponding to the reproduced sound from among various types of motion graphics and displaying the selected type of motion graphics on the display device.