Autostereoscopic Display Body Tracking Beyond Screen Field of View

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional autostereoscopic displays face challenges in accurately tracking body parts, especially extremities like hands and feet, which can move out of the display's field of view, leading to delayed responses and requiring tedious calibration procedures when using remote body tracking systems.

Innovation Solution

Utilize an integrated head tracking system to determine the position of the head relative to the display, combined with a remote body tracking system to track relevant body parts, allowing for accurate positioning of these parts relative to the display by correlating head and body part positions using both systems.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a remote body tracking system is implemented to enable users to adjust their position and view content from different angles, then user interaction and viewing flexibility are improved, but device complexity and processing requirements increase

Engineering Contradiction:
Improveviewing flexibilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system pre-calculates and stores depth information and view transformation data during content creation or preprocessing. When a user requests a specific viewpoint, the system retrieves pre-computed depth maps and view synthesis data rather than calculating everything in real-time, reducing processing complexity while maintaining viewing flexibility

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces depth maps as an intermediary data structure that mediates between the original 3D content and the synthesized views. These depth maps serve as intermediate representations that simplify the view synthesis process by providing explicit depth information that can be used to warp and reconstruct images from different perspectives without requiring full real-time 3D rendering

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If real-time view synthesis and rendering are performed to enable dynamic perspective changes, then viewing flexibility is improved, but processing time and computational load increase

Engineering Contradiction:
Improveviewing flexibilityVSAvoidprocessing time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs view synthesis calculations in advance and stores pre-rendered view data. When users navigate to different perspectives, the system retrieves and displays pre-computed views rather than performing real-time synthesis, dramatically reducing processing time while maintaining the ability to display content from multiple angles

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements a hybrid approach where the system dynamically determines whether to use pre-computed views or perform real-time synthesis based on the specific viewing request and available data. This dynamic strategy optimizes processing time by using cached data when possible while maintaining flexibility to compute new views when necessary

Inventive Principle:
Principle #15Dynamics

3Reliability

If depth information is utilized for view synthesis to enable parallax effects and 3D content creation, then content realism and interactivity are improved, but data processing requirements and system complexity increase

Engineering Contradiction:
Improvecontent realismVSAvoidprocessing requirements
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent uses depth maps as intermediary data structures that capture essential 3D information in a simplified format. These depth maps serve as mediators between complex 3D scene data and the view synthesis algorithm, providing concise depth representations that enable realistic parallax effects while reducing the computational burden of processing full 3D geometry

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates simplified copies of depth information in the form of depth maps that can be stored and reused for multiple view synthesis operations. Instead of processing complete 3D scene graphs repeatedly, the system works with copied depth representations that retain the essential information needed for realistic view synthesis while requiring significantly less processing power

Inventive Principle:
Principle #26Copying

Data Source

PatentEP4458009B1Autostereoscopic display device having a remote body tracking system
Publication Date: 2026.04.29 DIMENCO HOLDING BV
  • EP4458009B1 patent drawingFigure 1

AI summary

The invention relates to a method for tracking a relevant body part of a viewer of an autostereoscopic screen, using a head tracking system that is integrated with the screen as well as a body tracking system that is remote from the screen. By tracking the head of a viewer simultaneously by both systems, it is possible to relate the position data of all other body parts obtained with the remote body tracking system to the position of the screen. In this way, the position of such body parts relative to the screen can be obtained, even when they are out of a field of view of the integrated head tracking system. In this way, a more accurate and therefore more realistic interaction of the viewer with displayed content can be achieved.