Spatial Video Encoding and Playback for Android MV-HEVC
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The ability to generate and play MV-HEVC spatial video is not available in the Android system, limiting the availability of immersive spatial video experiences.
Innovation Solution
A method and apparatus for generating spatial video by shooting and encoding first-eye and second-eye video frames, and playing these streams synchronously on separate display screens using codec specific data, implemented in an Android system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If MV-HEVC spatial video encoding is implemented, then storage efficiency and encode performance are improved, but the capability to generate and play spatial video is not available in Android system
Solution Approach 1:
The patent segments the spatial video processing into distinct modules: a shooting module that captures first-eye and second-eye video frames through multiple cameras, an encoding module that processes these frames using MV-HEVC, and a generation module that creates the final spatial video file. This segmentation enables the Android system to implement spatial video capability through modular components.
Solution Approach 2:
The patent introduces codec specific data as an intermediary element that bridges the encoding process and playback capability. This metadata contains essential information about the spatial video structure, enabling the Android system to properly interpret and play back MV-HEVC encoded content without requiring complete reimplementation of the encoding standard.
2Manufacturing precision
If multi-camera shooting is used to capture first-eye and second-eye video frames, then spatial video quality is improved, but system complexity increases
Solution Approach 1:
The patent merges the functionality of multiple cameras into a unified shooting module that simultaneously captures first-eye and second-eye video frames. This combining approach manages system complexity by providing a single interface and coordinated control mechanism for multi-camera operations, while still achieving high spatial video quality through the use of multiple viewing angles.
3Manufacturing precision
If separate encoding is performed for first-eye and second-eye video frames, then stereo vision effect is improved, but encoding time increases
Solution Approach 1:
The patent performs preliminary actions by organizing first-eye and second-eye video frames into synchronized frame queues before encoding. This pre-organization allows the encoding module to efficiently process both views in a coordinated manner, maintaining high stereo vision quality while reducing overall encoding time through optimized processing sequences.
Data Source
AI summary
The present disclosure provides a method of generating a spatial video, a method of playing a spatial video, an electronic device, and a storage medium. The method of generating a spatial video includes: shooting a first frame queue by a first camera and shooting a second frame queue by a second camera, wherein the first frame queue includes at least one first-eye video frame, and the second frame queue includes at least one second-eye video frame; performing encoding processing on the first-eye video frame and the second-eye video frame to obtain media data of a target spatial video; and generating a target video file of the target spatial video according to the media data and the codec specific data of the target spatial video, wherein the codec specific data includes first-eye codec specific data and second-eye codec specific data.