Occupant Position Detection via Sensor and Image Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing occupant position detection systems, such as those described in Japanese Unexamined Patent Application Publication No. 2018-083561, fail to accurately detect the head position of an occupant, which is crucial for effective airbag deployment, as they do not utilize both image and load sensor detection values effectively.

Innovation Solution

An occupant position detection system that combines image capture from cameras and sensor data from seat sensors, using a neural network and knowledge-based expert system to calculate the occupant's position, and applies the Kalman filter for high accuracy, fusing the first and second positions to determine the head position accurately.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If only image data or only sensor data is used for occupant position detection, then the system complexity is reduced, but the detection accuracy is insufficient

Engineering Contradiction:
Improveoccupant position detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines image data from cameras and detection values from load sensors into a unified occupant position detection system. The imaging device captures images of the occupant while sensors detect load distribution, and both data sources are integrated through data fusion processing to calculate accurate head position and body posture information.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces a data fusion processing unit that acts as an intermediary between the imaging device/sensors and the control unit. This intermediary performs coordinate system transformations, aligns data from different sources, and fuses image data with sensor data to produce accurate occupant position information.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If multiple data sources are fused to improve detection accuracy, then the measurement precision increases, but the data processing complexity increases

Engineering Contradiction:
Improvehead position detection accuracyVSAvoiddata processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex manual data processing with automated image recognition technology and algorithmic data fusion. Neural networks and machine learning models automatically extract feature points from images and fuse them with sensor data, reducing the need for manual coordinate transformations and simplifying the processing complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent transforms data from different coordinate systems into a unified coordinate system through parameter transformations. The data fusion processing unit performs coordinate system conversions and parameter adjustments to align image data with sensor data, enabling accurate fusion while managing processing complexity through systematic parameter changes.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If traditional detection methods are used, then the system is simpler to implement, but the head position detection accuracy is insufficient for effective airbag deployment

Engineering Contradiction:
Improvehead position detection accuracyVSAvoidsystem implementation ease
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent creates a multi-functional detection system that simultaneously performs face recognition, body posture detection, head position calculation, and occupancy detection. The same imaging device and sensor system serve multiple detection purposes, and the data fusion processing unit handles multiple calculation tasks, making the system universally applicable to various safety functions.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11628789B2Occupant position detection system
Publication Date: 2023.04.18 TOYOTA JIDOSHA KK
  • US11628789B2 patent drawing
  • US11628789B2 patent drawing
  • US11628789B2 patent drawing

AI summary

An occupant position detection system includes an imaging device configured to capture an image of an occupant seated on a seat provided in an interior of a vehicle, a sensor provided on the seat, a first calculating unit configured to calculate a first position of the occupant from the image captured by the imaging device, a second calculating unit configured to calculate a second position of the occupant from a detection result of the sensor, an occupant position calculating unit configured to calculate an occupant position by fusing the first position and the second position, and an output unit configured to output information on the occupant position calculated by the occupant position calculating unit, to a safety device.