Image Capture Device Short Audio Video Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Time-lapse video playback without audio content can decrease user engagement, as existing technologies do not effectively integrate short audio into the video generation process.

Innovation Solution

An image capture device with an image sensor and sound sensor captures visual and audio content separately, with the audio capture duration being shorter than the visual capture duration, and generates video content that includes both visual and audio elements, allowing for synchronized playback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If time-lapse video playback is generated without audio content, then the visual content can be captured and played back efficiently, but user engagement with the content decreases

Engineering Contradiction:
Improvevideo generation efficiencyVSAvoidaudio content
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent segments the capture process into separate visual capture and audio capture operations with different durations. The visual content is captured over a longer time period while audio is captured selectively during specific intervals, allowing efficient processing while preserving important audio information.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary capture of both visual and audio content separately before synthesis. Audio content is captured and stored in advance during audio capture durations, then synchronized with visual content during video generation, ensuring audio information is preserved without compromising visual capture efficiency.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If audio content is captured during the entire visual capture duration, then complete audio coverage is achieved, but the audio capture burden and data processing complexity increase

Engineering Contradiction:
Improveaudio coverage completenessVSAvoidcapture process complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

Instead of capturing audio continuously throughout the entire visual capture duration, the system applies partial action by capturing audio only during specific audio capture durations that are shorter than the visual capture duration. This reduces the amount of audio data to process while still capturing essential audio content for synchronization.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The capture process uses periodic action by alternating between visual capture and audio capture operations. Audio is captured during specific intervals (audio capture durations) rather than continuously, creating a periodic pattern that reduces processing complexity while maintaining audio coverage.

Inventive Principle:
Principle #19Periodic action

3Adaptability or versatility

If separate capture durations for visual and audio content are used, then capture flexibility is improved, but synchronization complexity during video generation increases

Engineering Contradiction:
Improvecapture duration flexibilityVSAvoidsynchronization complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system uses timestamps as an intermediary mechanism to bridge separate visual and audio capture processes. Each captured frame and audio segment is tagged with timing information, allowing the video generation process to synchronize disparate capture durations through time-based reference points without complex real-time coordination.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates a temporal map or copy of the capture timeline that records when visual and audio content were captured. This copied temporal information is then used during video generation to synchronize the separate capture durations, avoiding the need for complex real-time synchronization of the actual capture processes.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11310473B2Generating videos with short audio
Publication Date: 2022.04.19 GOPRO INC
  • US11310473B2 patent drawing
  • US11310473B2 patent drawing
  • US11310473B2 patent drawing

AI summary

An image capture device may capture visual content during a visual capture duration and audio content during an audio capture duration. The audio capture duration may be shorter than the visual capture duration. The captured audio content may provide audio for playback of the captured visual content.