Multi-Camera Work Machine Control During Camera Failure

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous work machines face increased power consumption and costs when relying on distance measuring sensors during camera failure states, as they become necessary alternatives.

Innovation Solution

A work machine equipped with multiple cameras that detects camera failures and switches to using parallax images from functioning cameras to calculate distance information, eliminating the need for additional sensors by employing different analysis models for normal and failure states.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a distance measuring sensor is used in a camera failure state, then autonomous traveling can be maintained, but power consumption increases and product cost increases

Engineering Contradiction:
Improveautonomous traveling capabilityVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system changes the operational parameters of the camera system based on failure detection. When a camera failure is detected, the system switches from using both cameras for stereo vision to using only the functioning camera with monocular vision algorithms, adjusting the processing parameters accordingly to maintain autonomous traveling capability while reducing power consumption

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The camera system is designed to perform multiple functions: it can operate in stereo mode for normal depth perception and switch to monocular mode for failure compensation. This multi-functionality allows the system to maintain autonomous traveling capability without requiring separate distance measuring sensors, thereby avoiding increased power consumption and product cost

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If a distance measuring sensor is used in a camera failure state, then autonomous traveling can be maintained, but product cost increases

Engineering Contradiction:
Improveautonomous traveling capabilityVSAvoidproduct cost
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The camera system is designed to perform multiple functions: it can operate in stereo mode for normal depth perception and switch to monocular mode for failure compensation. This multi-functionality allows the system to maintain autonomous traveling capability without requiring separate distance measuring sensors, thereby avoiding increased product cost

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The camera system serves itself by detecting its own failure state and automatically switching to an alternative operational mode. The failure detection unit identifies when a camera is malfunctioning, and the control unit automatically adjusts the vision processing algorithm to use only the functioning camera, eliminating the need for external distance measuring sensors and reducing overall system cost

Inventive Principle:
Principle #25Self-service

3Measurement precision

If multiple cameras are used for stereo vision, then distance information accuracy is improved, but device complexity increases

Engineering Contradiction:
Improvedistance information accuracyVSAvoidcamera system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The camera system dynamically adjusts its operational mode based on real-time failure detection. The system transitions from a static multi-camera configuration to a dynamic configuration that can operate with one or two cameras, maintaining measurement precision when possible while reducing complexity when failures occur

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes operational parameters based on camera availability. When both cameras function, stereo vision parameters are used for high precision. When one camera fails, the system switches to monocular vision parameters, adjusting the processing algorithm to maintain acceptable distance measurement accuracy with reduced hardware complexity

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables autonomous travel without distance measuring sensors, reducing product costs and power consumption by leveraging remaining cameras and adaptive analysis models, ensuring continuous operation even in camera failure scenarios.

Implementation Method 1

obtaining distance information based on images with a parallax which are captured by the plurality of cameras

Methodology Applied
Scientific EffectParallax: Parallax

Data Source

PatentEP3889720B1Work machine, work machine control method, and program
Publication Date: 2023.04.05 HONDA MOTOR CO LTD
  • EP3889720B1 patent drawingFigure 1~2
  • EP3889720B1 patent drawingFigure 3
  • EP3889720B1 patent drawingFigure 4

AI summary

A work machine that operates based on an image of a camera, comprising: a plurality of cameras; detection means for detecting a failure or a trouble in one of the plurality of cameras; and control means for, if the failure or the trouble is detected by the detection means, controlling the work machine based on an image captured by another camera in which the failure or the trouble is not detected.