Spherical Video Viewport Editing on Resource-Limited Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing computing devices, particularly mobile devices, struggle to display spherical videos effectively due to limited computing resources, leading to poor user experience and inefficiencies in editing spherical video content, which often requires significant processing power and can deter users from sharing or casually editing such content.
Innovation Solution
A computing device receives spherical video data and uses input movement data to track an object, adjust the viewport, and edit the video based on available resources, applying strategies like cropping or modifying resolution to optimize playback on devices with limited capabilities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If spherical video data is edited using conventional editing tools, then editing functionality is provided, but processing demands and resource requirements are excessively high
Solution Approach 1:
The spherical video data is divided into multiple video frames, and each frame is processed independently through cropping operations. This segmentation allows the editing system to handle smaller, more manageable portions of data at any given time, reducing the overall processing burden while maintaining editing functionality.
Solution Approach 2:
The patent extracts only the necessary portions of spherical video data by cropping video frames to generate edited frames. Instead of processing the entire spherical video dataset, the system extracts and processes individual frames or portions of frames that need to be edited, significantly reducing processing demands.
2Ease of manufacture
If spherical video data is edited with high processing requirements, then editing capability is maintained, but user experience deteriorates on mobile devices
Solution Approach 1:
The system performs partial processing by cropping only the necessary portions of video frames rather than processing the entire spherical video data. This partial action approach maintains editing capability while reducing the computational load to levels suitable for mobile devices, thereby improving user experience.
3Ease of manufacture
If conventional editing tools are used for spherical video, then basic editing is possible, but effort required increases due to limited capabilities
Solution Approach 1:
The system automatically determines crop parameters and performs cropping operations on video frames without requiring manual intervention for each frame. This self-service approach maintains basic editing functionality while reducing the effort required from users, as the system handles the complex processing tasks automatically.
4Manufacturing precision
If full-resolution spherical video is processed, then video quality is preserved, but resource requirements increase significantly
Solution Approach 1:
The patent extracts and processes only the necessary portions of video frames through cropping operations. By extracting and processing smaller, cropped portions rather than full-resolution spherical video data, the system maintains adequate video quality for the edited output while significantly reducing memory and processing resource requirements.
Data Source
AI summary
Systems and methods provide for editing of spherical video data. In one example, a computing device can receive a spherical video (or a video associated with an angular field of view greater than an angular field of view associated with a display screen of the computing device), such as by a built-in spherical video capturing system or acquiring the video data from another device. The computing device can display the spherical video data. While the spherical video data is displayed, the computing device can track the movement of an object (e.g., the computing device, a user, a real or virtual object represented in the spherical video data, etc.) to change the position of the viewport into the spherical video. The computing device can generate a new video from the new positions of the viewport.