Mirror Replacement Camera Fusion for Orientation and Blockage Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing mirror replacement systems in vehicles face challenges in accurately tracking the independent motion of multiple cameras due to vehicle suspensions, leading to difficulties in image analysis and object detection, particularly when cameras are partially blocked or displaced.

Innovation Solution

A system that integrates a motion detection sensor, such as an accelerometer or gyroscope, with each camera, mechanically fixed to an ASIC, to create a fused data set combining image and motion data, which is analyzed by a controller for orientation correction and blockage detection, using machine learning and ASIL decomposition fusion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If motion detection sensors are integrated with each camera to track independent camera motion, then measurement precision of camera orientation is improved, but device complexity increases

Engineering Contradiction:
Improvecamera orientation measurementVSAvoidsystem structure
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple sensors (accelerometers, gyroscopes, inclinometers) with each camera to create an integrated measurement unit. This merging of sensing capabilities directly addresses the need for precise camera orientation tracking while managing system complexity through integration rather than separate components.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The motion detection sensors act as intermediaries between the camera system and the controller. These sensors provide intermediate measurement data about camera orientation and motion, which the controller then uses to correct image data and maintain accurate object detection without requiring direct complex mechanical linkages.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Device complexity

If image data from multiple cameras is analyzed without accounting for independent camera motion, then device complexity is reduced, but object detection accuracy deteriorates

Engineering Contradiction:
Improveimage analysis systemVSAvoidobject detection accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system implements feedback by continuously monitoring camera motion through integrated sensors and using this information to correct image data in real-time. The controller receives motion data from sensors and adjusts image processing accordingly, creating a closed-loop system that maintains detection accuracy without requiring overly complex analysis algorithms.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent changes the parameter space by incorporating motion data (acceleration, rotation, inclination) as additional dimensions for image analysis. Instead of analyzing only static image data, the system integrates temporal motion parameters to compensate for camera displacement, improving object detection accuracy while keeping the analysis framework manageable.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If cameras are mounted on vehicle suspensions to provide broad field of view, then adaptability of mirror replacement system is improved, but stability of camera position deteriorates

Engineering Contradiction:
Improvefield of view coverageVSAvoidcamera position stability
Core Design Contradiction:
Adaptability or versatilityVSStability of the object's composition

Solution Approach 1:

The patent replaces mechanical stabilization mechanisms with sensor-based detection and software correction. Instead of using complex mechanical gimbals or active positioning systems to maintain camera stability, the system uses motion sensors to detect position changes and compensates through image data correction, achieving stability without mechanical complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances camera operation reliability by accurately determining camera orientation, detecting blockages, and reducing end-of-line calibration needs, while improving object detection and stabilization, thus ensuring accurate image analysis and vehicle control.

Implementation Method 1

the motion detection sensor includes one of an accelerometer, a gyroscope, and an inclinometer

Methodology Applied
Scientific EffectAccelerometer: Accelerometer

Implementation Method 2

the motion detection sensor includes one of an accelerometer, a gyroscope, and an inclinometer

Methodology Applied
Scientific EffectGyroscope: Gyroscope

Data Source

PatentEP4008101B1Camera image and sensor fusion for mirror replacement system
Publication Date: 2026.03.18 STONERIDGE ELECTRONICS
  • EP4008101B1 patent drawingFigure 1~2
  • EP4008101B1 patent drawingFigure 3
  • EP4008101B1 patent drawingFigure 4

AI summary

A measurement system for a vehicle including a first camera defining a field of view having a corresponding optical axis, and a motion detection sensor mechanically fixed to the first camera such that the motion detection sensor is configured to detect motion of the optical axis.