Image Capture Depth Detection Using Head and Object Coordinates

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current gaming interfaces rely on traditional hand-held controllers and mouse devices, limiting advanced user interactivity and failing to effectively detect depth and direction for enhanced gaming experiences.

Innovation Solution

A system and method using an image capture device to identify a user's head and object location, calculating relative positions to determine pointing direction and depth, enabling machine-recognizable gestures and command discrimination through trigger cues and position determination.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional hand-held controllers and mouse devices are used for gaming interfaces, then device simplicity is maintained, but user interactivity and depth/direction detection capability are limited

Engineering Contradiction:
Improveuser interactivityVSAvoidinterface system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical input devices (controllers, mice) with an optical detection system using image capture devices. The system captures images of users and objects, identifies head and object locations, and calculates pointing directions through coordinate space analysis, substituting mechanical interaction with optical field-based detection.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces visible indicators as intermediaries between the user and the detection system. These indicators on objects help the image capture device accurately identify object locations and orientations, facilitating the calculation of pointing directions without requiring direct complex analysis of the objects themselves.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If stereo imaging is used to detect depth and direction, then pointing direction accuracy is improved, but system complexity and computational requirements increase

Engineering Contradiction:
Improvepointing direction accuracyVSAvoidimaging system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the detection task into distinct components: head detection, object detection, visible indicator identification, and coordinate space calculation. Each component is processed separately through dedicated algorithmic steps, making the overall complex system manageable through modular processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses visible indicators as simplified copies or markers that represent the actual objects. Instead of analyzing complex object geometries directly, the system detects these simpler indicator patterns, reducing computational complexity while maintaining detection accuracy.

Inventive Principle:
Principle #26Copying

3Measurement precision

If visible indicators are used on objects for detection, then object identification accuracy is improved, but manufacturing complexity of objects increases

Engineering Contradiction:
Improveobject identification accuracyVSAvoidobject manufacturing simplicity
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent employs visible indicators that utilize color or optical property changes to encode object information. These indicators can be implemented through colored materials, reflective surfaces, or optically active components that are relatively easy to incorporate into objects during manufacturing while providing robust detection signals.

Inventive Principle:
Principle #32Color changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances user interactivity by accurately determining pointing direction and depth, allowing for more sophisticated gaming interactions and control mechanisms beyond traditional input methods.

Implementation Method 1

The relative position includes a dimension of depth determined by a depth camera

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentEP1960067B1Method for enabling depth and direction detection when interfacing with a computer program
Publication Date: 2019.06.19 SONY INTERACTIVE ENTERTAINMENT LLC
  • EP1960067B1 patent drawingFigure 1A
  • EP1960067B1 patent drawingFigure 1B
  • EP1960067B1 patent drawingFigure 2~3

AI summary

A method for detecting direction when interfacing with a computer program is provided. The method includes capturing an image presented in front of an image capture device. The image capture device has a capture location in a coordinate space. When a person is captured in the image, the method includes identifying a human head in the image and assigning the human head a head location in the coordinate space. The method also includes identifying an object held by the person in the image and assigning the object an object location in coordinate space. The method further includes identifying a relative position in coordinate space between the head location and the object location when viewed from the capture location. The relative position includes a dimension of depth. The method may be practiced on a computer system, such as one used in the gaming field.