Mediated Reality Display Generator Motion Offset

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional computer-mediated reality systems often cause dizziness and eye fatigue due to their inability to synchronously present images with user head movements, leading to a suboptimal virtual or augmented reality experience.

Innovation Solution

A computer-mediated reality system that includes sensors to determine current reality and instantaneous motion data, using this information to generate displayable scene data by selecting a portion of frame data based on motion, thereby adjusting the field of view and frame rate to match user movement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional head mounted display systems present images based on head position without considering instantaneous motion, then the system structure is simple, but the user experiences dizziness and eye fatigue due to desynchronization between head movements and displayed images

Engineering Contradiction:
Improvesynchronization between head movements and displayed imagesVSAvoidsystem structure
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system performs preliminary action by detecting instantaneous motion data (acceleration) in advance and using it to predict and adjust the field of view selection before the user's head movement completes. This allows the displayed image to be pre-adjusted based on motion trends, improving synchronization without requiring complex real-time rendering adjustments

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system applies dynamics by making the field of view selection dynamic based on instantaneous motion data. Instead of using a fixed or solely position-based field of view, the system continuously adjusts which portion of the generated frame data is displayed based on detected acceleration, allowing the display to adapt dynamically to user motion patterns

Inventive Principle:
Principle #15Dynamics

2Reliability

If the system selects a portion of frame data based on instantaneous motion data, then the synchronization with head movements improves, but the processing complexity increases

Engineering Contradiction:
Improveimage presentation synchronizationVSAvoiddata processing
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system applies partial action by selecting only a specific portion of the generated frame data for display based on instantaneous motion data, rather than processing or rendering the entire frame. This motion-based portion selection reduces processing requirements while maintaining synchronization, as the system only needs to identify and display the relevant subset of pixels or regions corresponding to the user's current field of view

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system segments the full frame data into multiple portions and selects only the relevant portion for display based on instantaneous motion data. This segmentation allows the system to process and display only the necessary part of the scene, reducing computational complexity while maintaining accurate synchronization with user head movements

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach reduces negative effects like dizziness and eye fatigue by synchronizing image presentation with user head movements, enhancing the overall virtual or augmented reality experience.

Implementation Method 1

The current reality data of the system may be indicative of the current location of the system, where such current reality data may be provided to the mediated reality display generator from a global positioning system sensor

Methodology Applied
Scientific EffectGlobal positioning system:

Implementation Method 2

The current reality data of the system may be indicative of the current orientation of the system, where such current reality data may be provided to the mediated reality display generator from at least one of a compass sensor and a gyroscope sensor

Methodology Applied
Scientific EffectCompass sensor:

Implementation Method 3

The current reality data of the system may be indicative of the current orientation of the system, where such current reality data may be provided to the mediated reality display generator from at least one of a compass sensor and a gyroscope sensor

Methodology Applied
Scientific EffectGyroscope sensor:

Implementation Method 4

The instantaneous motion data of the system may be provided to the mediated reality display generator from at least one accelerometer sensor

Methodology Applied
Scientific EffectAccelerometer sensor: Accelerometer

Implementation Method 5

The mediated reality display generator may be configured to generate displayable mediated reality frame data based on the current reality data and the mediated reality data, and the mediated reality display generator may be configured to generate the displayable mediated reality scene data by selecting a portion of the displayable mediated reality frame data based on the instantaneous motion data. In some embodiments, a center of the selected portion may be offset from a center of the displayable mediated reality frame data based on the instantaneous motion data.

Methodology Applied
Scientific EffectField of view adjustment:

Data Source

PatentUS10318018B2Systems, methods, and computer-readable media for generating computer-mediated reality display data
Publication Date: 2019.06.11 SONY INTERACTIVE ENTERTAINMENT LLC
  • US10318018B2 patent drawing
  • US10318018B2 patent drawing
  • US10318018B2 patent drawing

AI summary

Systems, methods, and computer-readable media are provided for generating computer-mediated reality display data based on user instantaneous motion data. A system includes at least one sensor, a mediated reality data source, and a mediated reality display generator that generates displayable mediated reality scene data based on (a) current reality data of the system from the at least one sensor; (b) mediated reality data from the mediated reality data source; and (c) instantaneous motion data of the system from the at least one sensor. In one example the mediated reality display generator generates the displayable mediated reality scene data by generating displayable mediated reality frame data based on the current reality data and the mediated reality data. The operations further include selecting a portion of the displayable mediated reality frame data as the displayable mediated reality scene data based on the instantaneous motion data. The portion that is selected is offset from a center of the displayable mediated reality frame data and is less than a frame size of the displayable mediated reality frame data and the offset is selected based on said instantaneous motion.