Sound Direction Analysis for Image Effect Control

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing image effect technologies fail to accurately add effects to images based on sound information, potentially missing the opportunity to enhance visuals with sound direction, position, frequency, or volume data.

Innovation Solution

An effect control device and method that utilize sound analysis to determine the direction, position, frequency, and volume of sounds, allowing for the addition of corresponding effects to images, such as specific shapes or colors, to visually represent sound characteristics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If an effect corresponding to a selected sound is added to an image, then the image can be enhanced with sound-related effects, but the effect may not correspond to the actual sound data to be reproduced

Engineering Contradiction:

Improveeffect correspondence accuracyVSAvoidsound direction information

Core Design Contradiction:

Adaptability or versatilityVSLoss of information

Solution Approach 1:

The effect control device performs preliminary analysis on the sound data to be reproduced, extracting direction information before adding effects to the image. This ensures the selected sound and reproduced sound have consistent directional characteristics, resolving the contradiction between effect versatility and sound information accuracy.

Inventive Principle:

Principle #10Preliminary action

2Measurement precision

If sound analysis is performed to add accurate effects to images, then the visual representation of sound becomes more realistic, but the device complexity increases

Engineering Contradiction:

Improvesound direction detection accuracyVSAvoidsound analysis processing complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The effect control device extracts only the essential direction information from the sound data, separating this critical parameter from other sound characteristics. This extraction approach enables accurate sound-directional effect addition while keeping the processing complexity manageable by focusing on the most important attribute.

Inventive Principle:

Principle #2Taking out (Extraction)

3Adaptability or versatility

If multiple sound parameters (direction, position, frequency, volume) are analyzed to control image effects, then the immersive experience is enhanced, but the processing time and computational resources increase

Engineering Contradiction:

Improveeffect control precisionVSAvoideffect processing time

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

The effect control device implements partial action by analyzing and utilizing specific sound parameters (direction, position, frequency, volume) that are most relevant for image effect enhancement. Rather than processing all possible sound attributes, it focuses on the essential parameters that provide the greatest immersive experience while minimizing processing overhead.

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS10467785B2Effect control device and effect control method

Publication Date: 2019.11.05 SONY GROUP CORP

AI summary

There is provided an effect control device including an effect control unit that controls an effect added to a target image based on information regarding a direction of a sound.