Sensor Fusion Movement Calculation for Unreliable External Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for calculating the movement amount of a moving object, such as vehicles or drones, face challenges in accuracy due to environmental variations and external sensor reliability, particularly in conditions like tunnels or low light, where external sensor data may be unreliable.

Innovation Solution

An information processing device that combines internal sensor data, like inertial measurement units, with external sensor data, such as photographic images or distance information, to derive a first and second movement amount, with a reliability calculation unit determining the accuracy of the external data-based movement amount, and using both to calculate the current movement amount when reliability criteria are met.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If external sensor data is used to calculate movement amount, then measurement precision is improved, but reliability deteriorates in certain environmental conditions

Engineering Contradiction:
Improvemovement amount calculation precisionVSAvoidexternal sensor data reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent combines data from multiple sensors (external sensors and internal sensors) to calculate movement amount. The calculation unit integrates external sensor data with internal sensor data (acceleration, angular velocity) to compute movement amount, thereby maintaining high precision while compensating for external sensor unreliability in certain environments through sensor fusion

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The reliability calculation unit continuously evaluates the reliability of external sensor data and provides feedback to the calculation unit. When reliability falls below a threshold, the system adjusts its calculation strategy by relying more on internal sensor data, creating a closed-loop feedback mechanism that adapts to environmental conditions

Inventive Principle:
Principle #23Feedback

2Reliability

If only internal sensor data is used, then reliability is maintained, but measurement precision deteriorates

Engineering Contradiction:
Improvemovement amount calculation reliabilityVSAvoidmovement amount calculation precision
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The system merges internal sensor data (acceleration, angular velocity from inertial sensors) with external sensor data (image recognition, distance information) in the calculation unit. This combination leverages the reliability of internal sensors while incorporating the precision-enhancing capabilities of external sensors when available

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent creates a composite sensing system that integrates multiple sensor types with different characteristics. The calculation unit processes data from heterogeneous sensors (inertial sensors, cameras, distance sensors) to produce a movement amount calculation that benefits from the complementary strengths of each sensor type

Inventive Principle:
Principle #40Composite materials

3Measurement precision

If multiple sensors are combined, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvemovement amount calculation precisionVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The calculation unit is designed as a multi-functional processing component that can handle data from various sensor types (external sensors, internal sensors) using unified calculation methods. This universal processing approach reduces system complexity by providing a single integration point rather than separate processing paths for each sensor type

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The reliability calculation unit serves as an intermediary that evaluates external sensor data quality and mediates between external and internal sensor data in the calculation unit. This intermediary layer simplifies the overall system architecture by providing a standardized interface for data integration and automatic quality assessment

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10612937B2Information processing device and method
Publication Date: 2020.04.07 KK TOSHIBA
  • US10612937B2 patent drawing
  • US10612937B2 patent drawing
  • US10612937B2 patent drawing

AI summary

According to an embodiment, an information processing device includes an internal sensor, a first derivation unit, a second derivation unit, a reliability calculation unit, a movement amount calculation unit. The internal sensor monitors monitor information including acceleration of a moving object. The first derivation unit derives a first movement amount of the moving object from the monitor information. The second derivation unit derives a second movement amount of the moving object using surrounding information of the moving object monitored by an external sensor. The reliability calculation unit calculates reliability of the second movement amount. The movement amount calculation unit calculates a current movement amount of the moving object using the first movement amount and the second movement amount when the reliability meets a specific criterion, and calculates the first movement amount as the current movement amount when the reliability does not meet the specific criterion.