Automated Driving Control Using Remaining Camera After Compound Eye Failure

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Automated driving systems face challenges in maintaining safe vehicle control when a failure occurs in a compound eye camera, as they require periodic calibration and increased maintenance, and drivers may struggle to respond promptly to switching from automated to manual driving, leading to potential safety hazards.

Innovation Solution

A control device and system that temporarily continue automated traveling based on the surrounding environment estimated by a functioning onboard camera when an abnormality is detected in one of the cameras, ensuring safer vehicle control by utilizing the remaining camera's image for road region, obstacle, and vehicle recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a compound eye camera is provided in parallel redundantly to guarantee safety, then safety is improved, but production cost increases

Engineering Contradiction:
ImprovesafetyVSAvoidproduction cost
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The compound eye camera is divided into multiple independent camera units (first camera, second camera, third camera, fourth camera) arranged in a specific configuration. Each camera unit can function independently to capture images in different directions, allowing the system to segment the viewing coverage and maintain safety functionality even when some units fail.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Multiple camera units are merged into a single compound eye camera system that functions as one integrated recognition device. The images from all camera units are combined and processed together by the control device to create a comprehensive surrounding environment recognition, achieving redundancy while maintaining a unified system architecture.

Inventive Principle:
Principle #5Merging (Combining)

2Reliability

If a compound eye camera is provided in parallel redundantly, then safety is improved, but maintenance work increases

Engineering Contradiction:
ImprovesafetyVSAvoidmaintenance work
Core Design Contradiction:
ReliabilityVSEase of repair

Solution Approach 1:

The compound eye camera system is designed with multi-functionality where the same camera units serve multiple purposes. The first and second cameras handle forward viewing, while the third and fourth cameras handle rearward viewing. All cameras can be used for both automated driving control and calibration purposes, reducing the need for separate dedicated components and simplifying maintenance procedures.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Extent of automation

If automated driving control is executed with compound eye camera, then driving automation is improved, but response time for driver takeover decreases

Engineering Contradiction:
Improveautomated driving controlVSAvoiddriver response time
Core Design Contradiction:
Extent of automationVSLoss of time

Solution Approach 1:

The system performs preliminary actions by continuously monitoring the operational status of each camera unit and pre-processing images from all cameras even during automated driving. When a failure is detected, the system has already prepared alternative image sources and can immediately switch to using remaining functional cameras without requiring driver intervention for system reconfiguration.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The control device continuously receives feedback from the compound eye camera about the surrounding environment and the operational status of each camera unit. This real-time feedback allows the system to detect failures immediately and adjust its operation accordingly, providing timely alerts to the driver while maintaining automated driving control using remaining functional cameras.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11853074B2Control device and control system
Publication Date: 2023.12.26 SONY SEMICON SOLUTIONS CORP
  • US11853074B2 patent drawing
  • US11853074B2 patent drawing
  • US11853074B2 patent drawing

AI summary

There is provided a control device including: a control unit that performs driving control of a vehicle. The control unit temporarily continues automated traveling of the vehicle on a basis of a surrounding environment estimated by a remaining function of a compound eye camera, in a case where a malfunction of the compound eye camera used in recognition of the surrounding environment is detected during execution of automated driving control for the vehicle.