Audio-Visual Synchronization in Electronic Camera Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In electronic devices with cameras, there is a mismatch between recorded sounds and photographed images, particularly in modes where both are captured simultaneously, leading to incongruent audio-visual combinations due to timing discrepancies and attribute mismatches.

Innovation Solution

An apparatus and method that record both images and sounds for a set period in a 'sound photographing' mode, analyze the attributes of the image and sound, and synchronize them by selecting and storing a sound that matches the mood or attributes of the image, or vice versa, to create a harmonized audio-visual file.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a still image and sound are recorded at the same time in a camera device, then the sound can be stored with the image, but a mismatch between the photographed image and the recorded sound can happen

Engineering Contradiction:
Improveaudio-visual matching accuracyVSAvoidsynchronization accuracy
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system performs preliminary actions by continuously capturing a sequence of images and sounds before the actual photographing moment, then analyzes these pre-captured data to select the most matching combination. This resolves the contradiction by preparing multiple options in advance and selecting the best match after the fact, ensuring both versatility and reliability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback by analyzing the captured images and sounds, evaluating their matching degree, and using this analysis to select the optimal combination. The feedback loop ensures that the final selected image-sound pair has high compatibility, resolving the mismatch problem while maintaining synchronization accuracy.

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If multiple images and sounds are recorded to ensure matching, then the quality of matched pairs improves, but the complexity of selection and processing increases

Engineering Contradiction:
Improvematching qualityVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system replaces complex manual analysis and selection processes with automated image recognition and sound analysis algorithms. These intelligent systems automatically evaluate the matching degree between images and sounds, selecting the best pairs without requiring complex manual processing, thus improving matching quality while managing processing complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If the system analyzes and selects the best matching image-sound pair from multiple recordings, then the emotional accuracy improves, but the time required for processing increases

Engineering Contradiction:
Improveemotional accuracyVSAvoidprocessing time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs preliminary capture of multiple images and sounds, analyzing them to pre-determine the best matching pair. By doing the analysis and selection work after capture but before final storage, the system ensures emotional accuracy is optimized while the actual user experience of time loss is minimized, as the heavy processing occurs in the background.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9451119B2Electronic device and method for synthesizing image with sound suitably using the same
Publication Date: 2016.09.20 SAMSUNG ELECTRONICS CO LTD
  • US9451119B2 patent drawing
  • US9451119B2 patent drawing
  • US9451119B2 patent drawing

AI summary

An apparatus and a method for photographing an image in an electronic device having a camera are disclosed. The electronic device may include an image sensor, an image signal processor configured to process an image obtained by the image sensor, an audio processing unit configured to process a sound received from a microphone, a storage unit configured to store data, and a control unit configured to implement the method. The method may include recording for a set period of time, a series of images and a series of sounds using the image sensor and the microphone when a sound photographing mode is active, selecting a particular sound from the series of sounds having a high correlation with a particular image from the series of images, and synthesizing the particular sound with the particular image and store in the storage unit the synthesized particular sound with the particular image.