Panoramic Video Generation Using Pre-Captured Make-Up Image Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video recording technologies cannot capture and combine moving image data to form a 360-degree panoramic video, as live image data is only available for a specific angle-of-view at any given time, making it impossible to create a seamless panoramic video by combining data from limited angles.

Innovation Solution

A device with image sensors and circuitry that captures live video data, determines the angle-of-view for each frame, generates wide angle video data with a larger view, and creates make-up image data for unrepresented angles, updating the video data to include this information, allowing for the creation of panoramic videos.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of moving object

If video recording is performed by rotating the camera to capture multiple angles, then the angle-of-view coverage is improved, but the timing synchronization deteriorates because live image data is only available for the current facing direction at any given time

Engineering Contradiction:
Improveangle-of-view coverageVSAvoidtiming synchronization
Core Design Contradiction:
Area of moving objectVSReliability

Solution Approach 1:

The system performs preliminary actions by capturing and storing still image data at multiple angles before video playback. During video playback, these pre-captured still images are used to generate make-up image data for angles not currently covered by live video, allowing panoramic video to be constructed without requiring simultaneous multi-angle live capture.

Inventive Principle:
Principle #10Preliminary action

2Area of moving object

If the camera captures images at multiple angles to form a panoramic image, then the panoramic coverage is improved, but the complexity of combining images at correct timings worsens

Engineering Contradiction:
Improvepanoramic coverageVSAvoidimage combination complexity
Core Design Contradiction:
Area of moving objectVSDevice complexity

Solution Approach 1:

The system creates copies of still image data captured at different angles and stores them in memory. During video playback, these copied still images are retrieved and processed as make-up image data to fill in angular gaps, eliminating the need for complex real-time synchronization and combination of multiple live video streams.

Inventive Principle:
Principle #26Copying

3Quantity of substance

If live video data is captured only at the current camera angle, then the data availability is improved, but the ability to form panoramic video worsens due to missing data at other angles

Engineering Contradiction:
Improvelive video data availabilityVSAvoidmissing angular data
Core Design Contradiction:
Quantity of substanceVSLoss of information

Solution Approach 1:

The system discards the requirement for simultaneous multi-angle live video capture and recovers panoramic capability by using pre-captured still images. The still images, captured separately at different angles, are recovered and utilized as make-up data during video playback to reconstruct the panoramic view without needing concurrent multi-angle recording.

Inventive Principle:
Principle #34Discarding and recovering

Data Source

PatentUS10389938B2Device and method for panoramic image processing
Publication Date: 2019.08.20 SONY GROUP CORP
  • US10389938B2 patent drawing
  • US10389938B2 patent drawing
  • US10389938B2 patent drawing

AI summary

A device includes one or more image sensors that capture live video data and a memory that stores the captured live video data. The device includes circuitry that determines an angle-of-view for one or more frames of the live video data and generates wide angle video data that has a larger angle-of-view than the one or more frames of the live video data. The circuitry determines one or more angles-of-view not represented in the wide angle video data by the live video data. The circuitry generates make-up image data captured at a later time than the live video data, wherein the make-up image data has an angle-of-view corresponding to at least one of the one or more angles-of-view that are not represented in the wide angle video data by the live video data. The circuitry updates the wide angle video data to include the make-up image data.