Video Content Synchronization with Virtual Environment Cues

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional TV displays limit the user's experience of video content due to their small size, and existing virtual reality headsets only enhance the cinematic experience by adjusting image size and positional offset, leaving room for further enrichment.

Innovation Solution

A method and apparatus for video content synchronization that generates a virtual environment separate from the video content, which changes in response to predetermined cues during playback, allowing for a complementary and interactive experience by projecting or displaying this environment on an alternative display, such as a projector or AR/VR headset, to expand the viewer's experience beyond the main display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If video content is displayed on a conventional TV display, then the display device is simple and easy to operate, but the user experience is limited due to the small screen size

Engineering Contradiction:
Improvedisplay areaVSAvoidsystem complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent combines the conventional TV display with a virtual reality headset to create an integrated system. The TV continues to display the video content while the VR headset provides an additional virtual environment, merging two display technologies to achieve a larger effective display area without replacing the original simple TV setup

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system makes the TV display serve multiple functions: it acts as both the primary video content display and as a reference for generating the virtual environment in the VR headset. This multi-functionality allows the same video content to be utilized in both conventional and immersive display modes, maximizing the utility of the display system

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If a virtual reality headset is used to enhance cinematic experience by adjusting image size and positional offset, then the display area is effectively increased, but the user experience remains static and non-interactive

Engineering Contradiction:
Improveuser experience enrichmentVSAvoidinteractivity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent introduces dynamic elements to the VR environment that respond to cues from the video content. Virtual objects, environmental changes, and interactive elements are dynamically generated and modified based on the playback state of the video, transforming the static VR experience into an adaptive, responsive system that reacts to the content being displayed

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system establishes a feedback loop where the video content playback provides cues that trigger corresponding changes in the virtual environment. The video acts as both the stimulus and the control signal, creating a synchronized interaction where the virtual environment responds to and reflects the state of the video content, enabling a form of passive interactivity

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11330150B2Video content synchronisation method and apparatus
Publication Date: 2022.05.10 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11330150B2 patent drawing
  • US11330150B2 patent drawing
  • US11330150B2 patent drawing

AI summary

A method of video content synchronisation includes the steps of displaying a video content item on a first display, generating a virtual environment separate from the video content item for display, detecting a predetermined cue associated with a predetermined time in the playback of the video content item, and displaying at least part of the virtual environment, but not on the first display, where the displayed state of the at least part of the virtual environment changes in response to the detected predetermined cue.