3D Position Detection Using Camera and Distance Sensor

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for estimating the three-dimensional position of a person rely heavily on an inter-reference feature point distance, which can lead to inaccurate estimations if not appropriately set, especially due to individual differences and environmental factors.

Innovation Solution

A position detection device that includes a feature point detecting unit, an angle calculating unit, a distance detecting unit, and a position specifying unit, utilizing a camera and a distance measuring sensor to calculate the three-dimensional position based on feature point angles and distances, thereby reducing reliance on inter-reference feature point distances.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If an inter-reference feature point distance is used to estimate the three-dimensional position of a person, then the position can be estimated, but the accuracy deteriorates when the inter-reference feature point distance is not appropriately set

Engineering Contradiction:
Improveaccuracy of three-dimensional position estimationVSAvoidreliability of position estimation
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent introduces a distance measuring sensor as an intermediary device to directly measure the distance from the camera to the person. This mediator replaces the unreliable inter-reference feature point distance parameter, enabling direct measurement without relying on predetermined reference values that may not match actual conditions.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent substitutes the traditional geometric estimation method (relying on image coordinates and reference distances) with a direct measurement approach using a distance measuring sensor. This replacement eliminates the need for complex calculations based on potentially inaccurate reference parameters.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If the inter-reference feature point distance is set based on statistics of actual measurement values for a plurality of humans, then the position estimation can be performed, but the accuracy deteriorates due to individual differences

Engineering Contradiction:
Improveapplicability to different personsVSAvoidaccuracy of three-dimensional position estimation
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system performs self-adjustment by using the distance measuring sensor to obtain the actual distance for each specific person. Instead of relying on pre-set statistical averages that do not account for individual variations, the system measures the actual distance in real-time, adapting automatically to each person's specific characteristics.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent changes the parameter used for distance determination from a fixed inter-reference feature point distance (based on statistical averages) to a dynamically measured distance from the distance measuring sensor. This parameter change allows the system to adapt to individual differences in person size and position.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If the inter-reference feature point distance is calculated by guiding the position of the head of the occupant to a predetermined position, then the position estimation can be performed, but the ease of operation deteriorates

Engineering Contradiction:
Improveaccuracy of three-dimensional position estimationVSAvoidconvenience of position setting
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The distance measuring sensor automatically measures the distance from the camera to the person without requiring manual intervention or guidance procedures. The system performs self-measurement of the actual distance, eliminating the need for operators to manually adjust or set reference positions.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the manual guidance process with an automated distance measurement system. Instead of requiring operators to physically guide the person to predetermined positions, the distance measuring sensor automatically captures the actual distance in real-time.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for more accurate specification of the three-dimensional position of a person, improving accuracy compared to methods that solely depend on inter-reference feature point distances, and is effective even in the presence of individual differences and environmental variations.

Implementation Method 1

a distance detecting unit to detect a first distance from a distance measuring sensor to the target feature point on the basis of sensor information acquired by the distance measuring sensor

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS20240212198A1Position detection device, physique detection system, and position detection method
Publication Date: 2024.06.27 MITSUBISHI ELECTRIC CORP
  • US20240212198A1 patent drawing
  • US20240212198A1 patent drawing
  • US20240212198A1 patent drawing

AI summary

A position detection device includes processing circuitry configured to detect, on a basis of a captured image captured by a camera, a target feature point corresponding to a part of a body of a person in the captured image; calculate, on a basis of a position of the target feature point on the captured image having been detected, a feature point position angle indicating an angle of a straight line connecting the camera and the target feature point with respect to an imaging axis of the camera; detect a first distance from a distance measuring sensor to the target feature point on a basis of sensor information acquired by the distance measuring sensor; and specify a three-dimensional position of the target feature point on a basis of the calculated feature point position angle and the detected first distance.