3D Glasses Head Tracking via Adaptive Lighting Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing camera-based head tracking systems for 3-D video display and video game entertainment devices are inadequate in varying lighting conditions, as they struggle to maintain robust and accurate tracking in bright, medium, and dim lighting scenarios without being excessively expensive for mass production.

Innovation Solution

The system employs facial tracking algorithms in bright lighting, reflective stickers or materials on glasses for medium lighting, and retroreflectors illuminated by LEDs in dim conditions, with a controller managing the transition between these methods to ensure seamless head tracking across different ambient light levels.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If facial tracking algorithms are used in bright lighting conditions, then tracking accuracy is improved, but the system fails in dim or no-light conditions

Engineering Contradiction:
Improvehead tracking accuracyVSAvoidlighting condition adaptability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system dynamically switches between different tracking methods (facial tracking, reflective material tracking, LED-illuminated tracking) based on ambient lighting conditions. A light sensor detects the current lighting level and automatically selects the appropriate tracking algorithm, enabling the system to adapt to varying environmental conditions and maintain tracking accuracy across all lighting scenarios.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the physical parameters of the glasses according to lighting conditions: in dim light, passive reflective materials are used; in no-light conditions, LED illumination is activated to provide active light sources. This parameter change allows the tracking system to function effectively across the full range of lighting conditions by modifying the optical properties of the glasses.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If reflective materials and LED lights are added to glasses for dim lighting tracking, then tracking capability in low light is improved, but device complexity increases

Engineering Contradiction:
Improvelighting condition coverageVSAvoidglasses structure complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The glasses are segmented into distinct functional components: frame structure, lenses, reflective materials applied to specific surfaces, and LED modules positioned at strategic locations. This segmentation allows each component to perform its specific function independently and simplifies the manufacturing process by enabling modular assembly of the tracking components.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Reflective materials serve as an intermediary between ambient light sources and the camera system. These materials passively reflect available light back toward the camera, enhancing visibility in dim conditions without requiring active illumination. This intermediary approach reduces complexity by utilizing environmental light rather than requiring built-in light sources for all conditions.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If multiple tracking methods are implemented for different lighting conditions, then tracking robustness is improved, but manufacturing cost increases

Engineering Contradiction:
Improvetracking robustnessVSAvoidmass production feasibility
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The glasses are designed with multi-functional components that serve multiple purposes: the reflective materials enhance both passive tracking in dim light and active tracking when LEDs are illuminated; the LED modules can function as both illumination sources and visual indicators; the frame structure integrates both aesthetic and functional requirements. This multi-functionality reduces the need for separate specialized components for each lighting condition.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses cost-effective materials and components suitable for mass production: standard reflective tapes or paints applied to glass surfaces, conventional LED modules, and integration with existing camera-based tracking systems. These components are inexpensive, easily manufactured, and can be produced at scale, making the enhanced tracking system economically viable for consumer markets.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables robust and cost-effective head tracking across various lighting conditions, improving the quality of service by automatically or manually switching between tracking methods based on ambient lighting, ensuring consistent player input and immersive 3-D experiences.

Implementation Method 1

In dim to no-light conditions, the camera tracks the user's head via reflective material, such as retroreflectors, on the glasses that is illuminated by light emitting diode (LED) lights.

Methodology Applied
Scientific EffectRetroreflection: Retroreflector

Implementation Method 2

In dim to no-light conditions, the camera tracks the user's head via reflective material, such as retroreflectors, on the glasses that is illuminated by light emitting diode (LED) lights.

Methodology Applied
Scientific EffectLight emitting diode: Light Emitting Diode

Implementation Method 3

In medium lighting, the camera tracks the user's head via reflective stickers or other material on the glasses, using available light.

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentEP2486441B13-d glasses with camera based head tracking
Publication Date: 2018.02.21 SONY INTERACTIVE ENTERTAINMENT LLC
  • EP2486441B1 patent drawingFigure 1
  • EP2486441B1 patent drawingFigure 2
  • EP2486441B1 patent drawingFigure 3~8

AI summary

Methods, devices, and systems, are described for tracking a video game player's head under different ambient lighting conditions and switching between tracking techniques as lighting conditions change. Based on measurements of ambient lighting conditions, a camera hooked to a game console can (1) track a player's face using facial tracking techniques, (2) track reflective material on the player's 3-D glasses, or (3) turn on or up illumination LEDs mounted on the 3-D glasses.