Imaging Device Synchronized Slow-Motion Audio Playback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing imaging devices fail to record and playback audio in synchronization with slow-motion movie images, leading to a mismatch in audio duration and playback realism, and are unable to capture the atmosphere of slow-motion footage effectively.

Innovation Solution

An imaging device with an imaging sensor, storage unit, movie image data generation, raw audio recording, and audio data processing units that generate and playback audio in accordance with the playback time of slow-motion movie images, ensuring synchronized audio and image playback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If audio data is extracted from movie image data for still image playback, then audio can be played back with still images, but the audio duration does not match the still image playback duration and realism is adversely affected

Engineering Contradiction:
Improveaudio playback capability with still imagesVSAvoidrealism of audio playback
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent extracts audio data specifically from the movie image data that corresponds to the time period when still images were captured. This extracted audio is then dedicated to still image playback, separating it from the original movie audio track to ensure proper duration matching and realism.

Inventive Principle:
Principle #2Taking out (Extraction)

2Loss of information

If audio data from movie image data is used for still image playback, then audio can be provided during still image display, but the audio duration and timing do not accurately reflect the atmosphere during slow-motion capture

Engineering Contradiction:
Improveatmosphere expression during playbackVSAvoidaudio recording duration
Core Design Contradiction:
Loss of informationVSDuration of action of moving object

Solution Approach 1:

The patent records audio data during the actual slow-motion movie capture period, which is longer than the final playback duration. This preliminary audio recording captures the complete atmosphere and soundscape during the extended capture time, preserving all atmospheric information even though the final playback is shorter.

Inventive Principle:
Principle #10Preliminary action

3Shape

If slow-motion movie images are captured with extended duration, then atmospheric effect is enhanced, but audio data duration becomes shorter relative to playback time and cannot express the capture atmosphere

Engineering Contradiction:
Improveslow-motion effectVSAvoidaudio playback duration
Core Design Contradiction:
ShapeVSDuration of action of moving object

Solution Approach 1:

The system performs preliminary audio recording during the entire slow-motion capture duration, storing more audio data than will ultimately be played back. This ensures that sufficient audio material is captured to represent the full atmospheric experience of the slow-motion sequence, even though the final playback audio is trimmed to match the shortened visual duration.

Inventive Principle:
Principle #10Preliminary action

4Loss of information

If audio is recorded for the full duration of slow-motion capture, then complete atmosphere is captured, but audio playback duration exceeds slow-motion playback duration causing synchronization issues

Engineering Contradiction:
Improveatmospheric information completenessVSAvoidaudio-image synchronization
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent extracts and selects specific portions of the preliminarily recorded audio data that correspond to the actual slow-motion playback duration. This extraction process synchronizes the audio with the visual slow-motion sequence by selecting only the relevant audio segments that match the shortened playback time frame.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS8971689B2Imaging device and image-audio playback device
Publication Date: 2015.03.03 NIKON CORP
  • US8971689B2 patent drawing
  • US8971689B2 patent drawing
  • US8971689B2 patent drawing

AI summary

An imaging device includes: a storage unit that sequentially stores a plurality of frame images and raw recorded audio data; a unit that generates slow-motion movie image data to be played at a second frame rate lower than a first frame rate, based on the plurality of frame images stored in the storage unit during a first predetermined duration; a unit that generates at least one set of still image data on the basis of at least one frame image from among the plurality of frame images stored in the storage unit during the first predetermined duration; a unit that generates audio data on the basis of the raw recorded audio data stored during a second predetermined duration longer than the first predetermined duration; and a unit that records the audio data generated, in association with the slow-motion movie image data generated and the still image data generated.