Wide-Angle VR Video Display With Gaze-Orientation Metadata

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video display systems, such as head-mounted displays, struggle to accurately guide users to gaze at specific targets within wide-angle videos, leading to confusion when instructions assume a forward-facing orientation that may not align with the user's actual direction.

Innovation Solution

A video display system that includes a capturing unit for generating wide-angle video, a data obtainment unit for determining the user's gaze direction, a metadata composition unit for composing relevant data, and a transmission unit for transmitting metadata alongside the video, along with a VR device for receiving and processing this data to calculate and display appropriate video content based on the user's orientation and gaze direction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If video content is displayed without considering user orientation, then the display system is simple, but the user becomes confused when instructions assume forward-facing orientation that does not align with actual direction

Engineering Contradiction:
Improveuser understandingVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by obtaining user orientation data before displaying video content, calculating the user's actual facing direction, and pre-adjusting the video orientation to match the user's perspective. This ensures that directional instructions in the video align with the user's actual orientation, eliminating confusion without requiring complex real-time adjustments during viewing

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback by continuously obtaining user orientation information from sensors, comparing it with the video content orientation, and automatically adjusting the displayed video to match the user's actual facing direction. This closed-loop feedback mechanism ensures that the video content remains aligned with the user's perspective, improving ease of operation while managing system complexity through automated adaptation

Inventive Principle:
Principle #23Feedback

2Measurement precision

If the system calculates and adjusts video based on user gaze direction and orientation data, then user guidance accuracy improves, but data processing requirements increase

Engineering Contradiction:
Improvegaze direction accuracyVSAvoiddata processing power
Core Design Contradiction:
Measurement precisionVSPower

Solution Approach 1:

The system extracts only the essential orientation and gaze direction data from the user's device sensors, separating this critical information from other unnecessary data. By focusing solely on the relevant angular and directional parameters needed for video adjustment, the system achieves high measurement precision while minimizing data processing power requirements

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system changes parameters by converting raw sensor data into meaningful orientation angles and directional vectors that directly correspond to video transformation parameters. This parameter transformation approach enables precise gaze direction tracking while optimizing processing efficiency by working with compact angular representations rather than raw sensor streams

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If metadata is transmitted alongside video content to convey user orientation and gaze information, then video display accuracy improves, but transmission data volume increases

Engineering Contradiction:
Improvevideo display accuracyVSAvoiddata transmission volume
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The system applies local quality by transmitting orientation and gaze metadata only when and where needed - specifically, only the essential angular and directional parameters required for video adjustment are included in the metadata, rather than transmitting complete scene or object information. This selective metadata transmission maintains video display accuracy while minimizing unnecessary data volume

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12452481B2Video display system, information processing device, information processing method, and recording medium
Publication Date: 2025.10.21 NEOREALX INC
  • US12452481B2 patent drawing
  • US12452481B2 patent drawing
  • US12452481B2 patent drawing

AI summary

A video display system includes: an observation device including a capturing unit that generates a wide-angle video, and a data obtainment unit that obtains data related to a position and/or direction of a target in the wide-angle video to be gazed at by a user of a display device and cue information for informing of a change in the state of the observation system; and a VR device including a reception unit that receives the data and the cue information, and a differential calculation that calculates a relative position and/or direction of the gazing target relative to the position and/or direction of the display device in the wide-angle video, based on a difference between the position and/or direction of the display device in the wide-angle video and the position and/or direction of the gazing target in metadata.