Autonomous Vehicle Camera Failure Compensation via Multi-Vehicle Image Merging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing autonomous vehicle systems lack a method to ensure safe and continuous autonomous driving when an exterior monitoring camera fails, potentially disrupting safe driving control and autonomous driving operations.

Innovation Solution

An information processing device that receives signals from autonomous vehicles, determines camera failures, detects overlapping route vehicles, and sends travel control information to instruct the failed vehicle to travel in front of or behind a specific vehicle, allowing continued autonomous driving by leveraging image information from adjacent vehicles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If autonomous driving control is implemented using exterior monitoring cameras, then autonomous driving capability is achieved, but system reliability deteriorates when camera failure occurs

Engineering Contradiction:
Improveautonomous driving capabilityVSAvoidsafe driving control
Core Design Contradiction:
Extent of automationVSReliability

Solution Approach 1:

The patent merges the monitoring functions of multiple vehicles by having the information processing device collect image information from both the autonomous vehicle and surrounding vehicles. When a camera fails on one vehicle, the system combines image data from adjacent vehicles to compensate for the loss, maintaining autonomous driving capability despite individual camera failures.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The information processing device acts as an intermediary between vehicles and the autonomous driving control system. It receives image information from multiple sources, processes this data centrally, and provides compensated image information to the autonomous vehicle, thereby mediating the impact of camera failures on autonomous driving reliability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If autonomous driving continues after camera failure, then productivity is maintained, but measurement precision deteriorates due to reduced image information

Engineering Contradiction:
Improveautonomous driving continuityVSAvoidsurroundings detection accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system implements multi-functionality by using image information from multiple vehicles not only for the original vehicle's autonomous navigation but also for compensating camera failures. The same image information infrastructure serves both normal operation and failure compensation, maintaining detection precision through alternative sources.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system changes the source parameter of image information from single-vehicle cameras to multi-vehicle cameras. By altering where the image data comes from (from the failed vehicle's own cameras to adjacent vehicles' cameras), the system maintains sufficient measurement precision for autonomous driving continuity.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If camera failure detection is implemented, then system reliability improves through failure awareness, but device complexity increases due to additional monitoring requirements

Engineering Contradiction:
Improvefailure detection capabilityVSAvoidinformation processing system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system implements self-service by having each vehicle's camera system continuously monitor its own operational status. The failure determination unit detects camera failures by analyzing whether expected image information is received, allowing the system to self-diagnose without requiring separate complex monitoring hardware for each camera.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The information processing device implements feedback by continuously receiving image information from vehicles and determining whether cameras are functioning normally. This feedback loop allows the system to detect failures in real-time and activate compensation mechanisms, improving reliability through continuous monitoring that integrates with the existing communication infrastructure.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11422557B2Information processing device and autonomous traveling control system including information processing device
Publication Date: 2022.08.23 TOYOTA JIDOSHA KK
  • US11422557B2 patent drawing
  • US11422557B2 patent drawing
  • US11422557B2 patent drawing

AI summary

An information processing device includes a receiving unit configured to receive a signal sent from a wireless communication unit included in an autonomous vehicle, a failure determination unit configured to determine a failed vehicle in which an external monitoring camera has failed based on the signal from the wireless communication unit, a detection unit configured to detect a specific vehicle that is planned to travel on a route at least a section of which overlaps with a travel planned route of the failed vehicle beginning at a failure point of the failed vehicle that includes the exterior monitoring camera determined to be failed, and a sending unit configured to send travel control information to the failed vehicle to instruct the failed vehicle to travel in front of or behind the specific vehicle.