Game Special Effect Generation Using Pre-computed Sound Spectrum Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current game development technologies face challenges in generating real-time sound spectrum information for mobile platforms, limiting the ability to create detailed and diverse special effect animations.

Innovation Solution

A method and device for acquiring and storing sound spectrum information in a color channel of picture or video files, allowing for the generation of special effect animations based on this data, which includes acquiring audio data, performing Fourier transforms, and generating color channel images to represent sound spectrums and intensities, enabling the creation of rich and detailed three-dimensional animations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If sound spectrum information is analyzed and calculated in real-time on mobile platforms, then the ability to generate detailed and diverse special effect animations is improved, but the computational limitations and processing power constraints of mobile platforms cause analysis failures and incomplete data extraction

Engineering Contradiction:
Improvesound spectrum information extraction accuracyVSAvoidreal-time analysis reliability on mobile platforms
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent applies preliminary action by pre-calculating sound spectrum information from audio files during the asset creation phase, storing the computed spectrum data in image files. This allows the game client to directly load and use pre-processed spectrum information without performing computationally intensive real-time Fourier transforms on mobile devices, thereby ensuring both extraction accuracy and analysis reliability on resource-constrained platforms.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If Fourier transform is performed to convert time domain information into frequency domain information for music waveform spectrum, then the ability to present music waveform spectrum is improved, but the computational complexity and processing time increase significantly on mobile platforms

Engineering Contradiction:
Improvemusic waveform spectrum information completenessVSAvoidcomputational complexity on mobile platforms
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent resolves this contradiction by performing the computationally intensive Fourier transform operation in advance during audio file processing, storing the resulting frequency domain spectrum information in image format. This preliminary computation eliminates the need for real-time Fourier transforms on mobile devices, maintaining complete spectrum information while drastically reducing computational complexity and processing time on resource-constrained platforms.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If sound spectrum information is stored in color channels of picture or video files, then the ability to generate special effect animations is improved, but the data structure complexity and file format requirements increase

Engineering Contradiction:
Improvespecial effect animation generation capabilityVSAvoiddata structure and file format complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies the color changes principle by mapping sound spectrum data to color channel values in image files. The amplitude spectrum information is encoded in the RGB color channels, allowing spectrum data to be stored using standard image file formats. This approach enables versatile special effect animation generation while avoiding the need for custom data structures or specialized file formats, as the spectrum information is embedded within conventional image files using color encoding.

Inventive Principle:
Principle #32Color changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for accurate extraction and utilization of sound spectrum information, overcoming real-time analysis limitations on mobile platforms and enriching game special effects with more detailed and diverse animations.

Implementation Method 1

the Fourier transform is used to convert time domain information into frequency domain information to present music waveform spectrum

Methodology Applied
Scientific EffectFourier transform:

Data Source

PatentUS12145059B2Game special effect generation method and apparatus, and storage medium and electronic device
Publication Date: 2024.11.19 NETEASE (HANGZHOU) NETWORK CO LTD
  • US12145059B2 patent drawing
  • US12145059B2 patent drawing
  • US12145059B2 patent drawing

AI summary

Disclosed are a game special effect generation method and apparatus, and a storage medium and an electronic device, which belong to the technical field of game development. The method comprises: in response to a game running event, acquiring a picture file or a video file (S110), wherein sound spectrum information is stored in a color channel of the picture file or the video file; reading the sound spectrum information in the picture file or the video file (S120); and generating a special effect animation in a game according to the sound spectrum information (S130).