3D Movie Browser Using Spatial Frame Quads

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Modern movie browsers or editors face challenges in displaying and navigating video frames in a two-dimensional environment, which can be overwhelming, making it difficult for users to find focus points, judge temporal distances, and compare frames, especially when using multiple screens or small frame sizes.

Innovation Solution

A three-dimensional movie browser or editor is introduced, where video frames are represented as quads in space, with a camera following them at the movie's speed, allowing for a focus frame to be highlighted with a cover-flow/dock-like expansion, and frames are loaded at varying resolutions based on their position relative to the focus point or optical flow between frames.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple screens are used to display video frames, then the display area is increased, but the navigation difficulty increases and users find it difficult to browse through multiple screens

Engineering Contradiction:
Improvedisplay areaVSAvoidnavigation difficulty
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

The patent transitions from a two-dimensional display environment to a three-dimensional virtual space where video frames are represented as quads arranged along a temporal axis. This dimensional change allows all frames to be simultaneously visible in a single view without requiring multiple screens, while the spatial arrangement maintains clear navigation through temporal relationships.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent merges multiple video frames into a single unified three-dimensional view rather than distributing them across multiple screens. The camera follows the quads through this unified space, allowing users to browse all frames in one continuous navigation experience without switching between multiple displays.

Inventive Principle:
Principle #5Merging (Combining)

2Ease of operation

If a single screen is used to display video frames, then the navigation simplicity is improved, but the video frame size becomes small making it difficult to browse or edit

Engineering Contradiction:
Improvenavigation simplicityVSAvoidvideo frame size
Core Design Contradiction:
Ease of operationVSArea of moving object

Solution Approach 1:

By arranging video frames as quads in three-dimensional space along a temporal axis, the patent enables large frame sizes to be displayed on a single screen. The vertical arrangement in 3D space allows each frame to occupy sufficient display area while maintaining navigation simplicity through camera movement along the temporal dimension.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The camera dynamically follows the video frame quads through the three-dimensional space at the movie's playback speed. This dynamic camera movement allows the display to adapt to the temporal progression of the video, maintaining optimal frame sizes and positions without requiring multiple static screens.

Inventive Principle:
Principle #15Dynamics

3Device complexity

If video frames are displayed in a two-dimensional environment, then the implementation simplicity is maintained, but the holistic view of video frames becomes difficult to gain

Engineering Contradiction:
Improveimplementation simplicityVSAvoidholistic view
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The patent adds a temporal dimension to the display environment, arranging video frames as quads along a time axis in three-dimensional space. This enables users to gain a holistic view of the video sequence by visualizing the temporal relationships and progression of frames simultaneously, while the implementation remains relatively simple by extending the familiar 2D interface into 3D space.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

4Stability of the object's composition

If video frames are displayed at a single resolution in a two-dimensional environment, then the display consistency is maintained, but the resource consumption increases

Engineering Contradiction:
Improvedisplay consistencyVSAvoidresource consumption
Core Design Contradiction:
Stability of the object's compositionVSUse of energy by moving object

Solution Approach 1:

The patent applies different resolutions to different video frames based on their position in the three-dimensional space relative to the focus point. Frames closer to the focus point are rendered at higher resolutions, while distant frames use lower resolutions. This local quality adjustment maintains visual consistency for important frames while reducing overall resource consumption.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The resolution parameter of video frames is dynamically changed based on their spatial position and temporal distance from the focus point. This parameter adjustment allows the system to optimize resource consumption by rendering only the necessary frames at high quality, while maintaining display consistency for the currently relevant portions of the video.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS8395660B2Three-dimensional movie browser or editor
Publication Date: 2013.03.12 APPLE INC
  • US8395660B2 patent drawing
  • US8395660B2 patent drawing
  • US8395660B2 patent drawing

AI summary

A three-dimensional movie browser or editor is disclosed. In one aspect, video frames are quads in space. A movie plays at full quality by moving the quads in space at a speed of the movie and having a camera follow the quads. A focus frame in the movie is put forward by a cover-flow/dock like expansion around it. Video frames are loaded at a resolution and with an interval that depends on their position regarding a focus point or the optical flow between the frames.