Handheld Terminal Stereoscopic Display Position Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional information processing devices struggle to provide stereoscopic displays that offer a high sense of reality and versatility, especially when the user is not directly facing the display, and they often face challenges in reducing noise and enhancing accuracy in estimating the relative positional relation between the user and the display, particularly in dark environments.

Innovation Solution

A hand-held information processing terminal equipped with a camera capable of capturing images including infrared components, an estimation module to determine the relative positional relation, and a generation module that generates multiple display images using virtual cameras positioned based on this relation, allowing for stereoscopic display adjustments and improvements in noise reduction and accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional image capture methods are used, then the device structure remains simple, but noise increases and estimation accuracy decreases in dark environments

Engineering Contradiction:
Improvepositional estimation accuracyVSAvoidnoise in dark environments
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

An infrared light source is introduced as an intermediary to illuminate the user in dark environments. The infrared camera captures reflected infrared light from the user's face, enabling accurate positional estimation without visible light, thereby reducing noise and improving measurement precision in dark conditions.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system transitions from capturing visible light images to capturing infrared images. By detecting infrared radiation reflected from the user's face, the system can operate in dark environments where visible light is insufficient, improving positional estimation accuracy without adding visible light sources that would complicate the device structure.

Inventive Principle:
Principle #32Color changes

2Reliability

If stereoscopic display is provided only when user faces the display, then the system complexity remains low, but the sense of reality and user experience are limited

Engineering Contradiction:
Improvesense of reality in stereoscopic displayVSAvoidsystem complexity for positional estimation and image generation
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system dynamically adjusts the stereoscopic display based on the user's real-time position and orientation. By continuously estimating the user's position relative to the display and regenerating display images accordingly, the system maintains accurate stereoscopic effect even when the user moves or does not directly face the display, enhancing the sense of reality.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system adds spatial dimension tracking by estimating not just horizontal position but also vertical position and orientation of the user. This multi-dimensional positional information enables the generation of appropriate display images from virtual camera perspectives, providing realistic stereoscopic display across various viewing angles and positions.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If multiple display images are generated based on user position, then stereoscopic display quality improves, but processing complexity and time increase

Engineering Contradiction:
Improvestereoscopic display accuracyVSAvoidimage generation and processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

Display images are pre-generated from multiple virtual camera positions and stored in advance. When the user's position is estimated, the system quickly retrieves and displays the appropriate pre-generated image corresponding to the user's position, avoiding real-time complex image rendering and reducing processing time while maintaining stereoscopic accuracy.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables stereoscopic display with a higher sense of reality and improved accuracy even when the user is not directly facing the display, while reducing noise and enhancing positional estimation, especially in dark environments, by using infrared components and virtual cameras to adjust the display images accordingly.

Implementation Method 1

a camera arranged in proximity to the display and capable of obtaining an image of a user including infrared components

Methodology Applied
Scientific EffectInfrared radiation: Infrared Radiation

Data Source

PatentUS10004990B2Information processing terminal, non-transitory storage medium encoded with computer readable information processing program, information processing terminal system, and information processing method
Publication Date: 2018.06.26 NINTENDO CO LTD
  • US10004990B2 patent drawing
  • US10004990B2 patent drawing
  • US10004990B2 patent drawing

AI summary

A hand-held information processing terminal includes a display, a camera arranged in proximity to the display and capable of obtaining an image of a user including infrared components, an estimation module that estimates relative positional relation between the display and the user based on the obtained image, a generation module that generates a plurality of display images in accordance with the relative positional relation, and a control module that provides stereoscopic display to the user in accordance with a position thereof with the use of the plurality of display images.