Dynamic ISP Configuration Switching for Autonomous Vehicle Cameras

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles face challenges in capturing clear images under varying environmental light conditions, which can lead to safety risks due to inadequate image signal processing, as existing technologies struggle to seamlessly transition between different light settings without causing object misclassification or latency.

Innovation Solution

A system comprising at least one image signal processor and two cameras mounted in the same direction, where the image signal processor transitions from an active to a matched configuration by simultaneously using both cameras, with a detector classifying environmental light and selecting appropriate ISP configurations to minimize safety risks during the transition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single image signal processor configuration is used, then device complexity is reduced, but adaptability to different light conditions deteriorates

Engineering Contradiction:
Improveimage signal processor configurationVSAvoidadaptability to light conditions
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The system dynamically switches between different ISP configurations (first and second configurations) based on environmental light conditions detected by the detector. This allows the image processing system to adapt to varying light environments without requiring a completely static design, resolving the contradiction between simplicity and adaptability.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the processing parameters of the image signal processor by switching between different configurations. The first ISP configuration is used under initial light conditions, and the second ISP configuration is used when light conditions change, allowing the system to maintain image quality across different environmental conditions without increasing fundamental device complexity.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If ISP configuration transitions quickly, then adaptability to light changes is improved, but image processing reliability deteriorates due to misclassification or latency

Engineering Contradiction:
Improveresponse to light changesVSAvoidimage processing accuracy
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system uses a detector to monitor environmental light conditions in advance and triggers ISP configuration transitions only when actual light changes are detected. This preliminary detection mechanism prevents unnecessary transitions and ensures that switching occurs at appropriate moments, maintaining both adaptability and reliability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The detector acts as an intermediary between the environment and the ISP configuration system. It mediates the transition process by providing accurate light condition information, ensuring that configuration changes are based on reliable data rather than sudden, potentially erroneous triggers, thus maintaining processing accuracy during transitions.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If image capture parameters are adjusted dynamically, then adaptability to environmental conditions is improved, but processing time increases due to transition latency

Engineering Contradiction:
Improvedynamic adjustment capabilityVSAvoidtransition latency
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system maintains continuous image capture and processing operations while transitioning between ISP configurations. By using a detector to monitor conditions and triggering transitions based on actual environmental changes rather than arbitrary time intervals, the system ensures that useful image processing action continues without unnecessary interruptions or delays.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS11082622B2Systems and methods for dynamically switching image signal processor configurations
Publication Date: 2021.08.03 NURO INC
  • US11082622B2 patent drawing
  • US11082622B2 patent drawing
  • US11082622B2 patent drawing

AI summary

The present disclosure relates to image signal processor configurations. In accordance with aspects, a system includes at least one image signal processor, a first camera configured to cooperate with the image signal processor(s) to capture images of an environment around a vehicle, and a second camera configured to cooperate with the image signal processor(s) to capture images of the environment, where the second camera and the first camera are mounted to the vehicle in the same direction. The image signal processor(s) is configured to transition from capturing images of a field of view using an active image signal processor (ISP) configuration to capturing images of the field of view using a matched image signal processor (ISP) configuration which is different from the active ISP configuration. The transition includes simultaneously using the first camera and the second camera and includes simultaneously using the active ISP configuration and the matched ISP configuration.