Contact Detection via Normal Line Vector Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing contact detection methods in information processing devices require stereo cameras and 3D sensors, leading to increased device size, power consumption, and cost, and are unreliable under sunlight conditions, with potential for unintended user inputs due to non-contact being misinterpreted as contact.

Innovation Solution

An information processing apparatus that determines contact based on changes in the normal line vector on the surface of a target object, using polarization imaging to detect the inclination and disturbance of the normal line vector, allowing for precise contact detection without the need for additional sensors, and adjusting threshold values based on the type and position of the target object.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If stereo cameras and 3D sensors are used for contact detection, then contact detection capability is achieved, but device size increases

Engineering Contradiction:
Improvecontact detection capabilityVSAvoiddevice size
Core Design Contradiction:
ReliabilityVSVolume of moving object

Solution Approach 1:

The patent combines the contact detection function with the existing imaging unit already present in the device. Instead of adding separate stereo cameras and 3D sensors, the system uses the single imaging unit to capture images and detects contact through analysis of normal line vector changes in the captured images, thereby achieving contact detection without increasing device volume.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The imaging unit is made multi-functional by enabling it to perform both standard imaging and contact detection functions. By analyzing the normal line vectors in images captured by the existing imaging unit, the system achieves contact detection capability while the imaging unit continues to serve its primary imaging purpose, eliminating the need for dedicated contact detection sensors.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If stereo cameras and 3D sensors are used for contact detection, then contact detection capability is achieved, but power consumption increases

Engineering Contradiction:
Improvecontact detection capabilityVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system merges contact detection functionality into the existing imaging unit's operation. The imaging unit processes images for both visual display and contact detection purposes, eliminating the need for separate power-consuming sensors. Contact detection is achieved by analyzing normal line vector changes in images already being captured for display purposes.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The imaging unit performs dual functions: capturing images for display and detecting contact through normal line vector analysis. This multi-functionality eliminates redundant components and reduces overall power consumption while maintaining contact detection capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Reliability

If stereo cameras and 3D sensors are used for contact detection, then contact detection capability is achieved, but device cost increases

Engineering Contradiction:
Improvecontact detection capabilityVSAvoiddevice cost
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The patent merges contact detection functionality into the existing imaging unit, eliminating the need to manufacture and assemble additional expensive sensors. The system achieves contact detection by processing images from the existing imaging unit through normal line vector analysis, thereby reducing manufacturing costs.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The imaging unit is designed to serve multiple purposes including standard imaging and contact detection. This multi-functionality reduces the total component count and manufacturing complexity, leading to lower device costs while maintaining contact detection capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Device complexity

If contact detection is based on distance threshold, then simple detection is achieved, but accuracy decreases under sunlight and causes unintended inputs

Engineering Contradiction:
Improvedetection method simplicityVSAvoidcontact detection accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system detects contact by analyzing changes in the normal line vectors of surface features in captured images, which manifest as geometric distortions rather than color changes. This approach is insensitive to lighting conditions including sunlight, maintaining high detection accuracy in outdoor environments while avoiding false positives from non-contact proximity.

Inventive Principle:
Principle #32Color changes

Solution Approach 2:

The detection method combines multiple analysis dimensions including normal line vector calculations, surface geometry analysis, and threshold-based decision making. This composite approach processes image data through multiple stages to achieve high precision contact detection that distinguishes true contact from mere proximity, eliminating unintended inputs.

Inventive Principle:
Principle #40Composite materials

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables high-precision contact detection at a lower cost, reducing errors and power consumption, and ensuring accurate input recognition even in outdoor conditions, by utilizing the change in normal line vectors to determine contact without relying on stereo cameras or 3D sensors.

Implementation Method 1

a camera (imaging unit) 12

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentEP3176675B1Information processing device, information processing method and program
Publication Date: 2021.08.25 SONY GROUP CORP
  • EP3176675B1 patent drawingFigure 1
  • EP3176675B1 patent drawingFigure 2~3
  • EP3176675B1 patent drawingFigure 4~5

AI summary

[Object] To provide an information processing apparatus, an information processing method, and a program that are capable of detecting contact with high precision at low cost. [Solving Means] An information processing apparatus according to the present technology includes a contact determination unit. The contact determination unit determines contact of an operation body with a target object on the basis of a change in a normal line vector on a surface of the target object, the target object being an operation target of the operation body.