Display Screen Head Motion Tracking for Immersive 3D Content

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional television displays are not interactive and fail to provide an immersive experience by not utilizing user movement to dynamically adjust the content presentation, limiting the engagement and interactivity in entertainment and gaming applications.

Innovation Solution

A method and system that tracks user movement to dynamically adjust the content presentation on a display screen, creating an expanded information space where content is progressively revealed based on user position and movement, providing an interactive and immersive experience by simulating a three-dimensional space behind the screen.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional television displays are used to display content, then content can be presented with high resolution and clarity, but the display lacks interactivity and immersive experience

Engineering Contradiction:
ImproveinteractivityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The display screen is transformed from a passive content delivery device to an interactive interface that responds to user movements. The system integrates content display with user motion tracking, allowing the same display to serve both as a traditional television and as an interactive window into a three-dimensional information space, thereby increasing its versatility without requiring separate devices for each function

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

A camera system acts as an intermediary between the user and the display content. The camera tracks user movements and translates these physical movements into virtual navigation within the information space, enabling interactive exploration without requiring direct physical interaction with the display itself. This intermediary layer bridges the gap between passive viewing and active engagement

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If content is displayed on a two-dimensional screen, then the display is simple and easy to manufacture, but it fails to provide an immersive three-dimensional experience

Engineering Contradiction:
Improveimmersive experienceVSAvoiddisplay system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system transitions from two-dimensional content display to three-dimensional information space navigation. By adding the dimension of user movement tracking and perspective adjustment, the display creates an immersive experience where content appears to exist in virtual space behind the screen. This dimensional expansion enables users to feel present within the information space rather than merely observing it from a distance

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The display system becomes dynamic by continuously adjusting content presentation based on real-time user movement. As users move through the physical space, the system dynamically updates the virtual camera perspective and repositions content within the three-dimensional information space. This dynamic adaptation creates an immersive experience where the display responds to and adapts with user movements, transforming a static viewing experience into an interactive journey

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If the display screen is used as a static viewing window, then the content presentation is straightforward, but user engagement and interaction are limited

Engineering Contradiction:
Improveuser interactionVSAvoidcontent delivery efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The system enables self-service interaction by automatically tracking user movements and translating them into virtual navigation without requiring explicit user commands. Users naturally walk or move through the physical space, and the system automatically responds by updating the virtual perspective and revealing relevant content. This eliminates the need for complex input devices or manual control mechanisms, making interaction as intuitive as physical movement itself

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements continuous feedback by monitoring user position and movement in real-time, then immediately reflecting this feedback in the virtual environment. As users move, the system updates the camera perspective and content positioning to match their physical movements, creating a synchronized experience where user actions directly influence the virtual display. This feedback loop maintains engagement by continuously adapting the content delivery to match user interests and movements

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11175727B2Viewing a three-dimensional information space through a display screen
Publication Date: 2021.11.16 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11175727B2 patent drawing
  • US11175727B2 patent drawing
  • US11175727B2 patent drawing

AI summary

A method is provided, including the following operations: capturing images of an interactive environment by an image capture device; analyzing the captured images to track motion of a user's head in the interactive environment; providing a view through a display screen of a three-dimensional (3-D) information space, wherein the view of the 3-D information space is defined from a perspective that is determined by the tracked motion of the user's head in the interactive environment, the perspective being dynamically updated in response to the motion of the user's head; wherein the 3-D information space includes a plurality of predefined content regions that are configured to present respectively assigned visual content, the content regions being visually accessible through the display screen based on the provided view of the 3-D information space.