Vehicular Vision System Anticipating Objects Outside Camera Field of View

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current vehicle imaging systems struggle to detect objects outside the camera's field of view efficiently, leading to delayed detection and confirmation when these objects enter the camera's view, which can be critical during maneuvers like backing up or driving forward.

Innovation Solution

A vehicle vision system that combines cameras with radar sensors and vehicle-to-vehicle communication systems to anticipate and confirm the presence of objects outside the camera's field of view, using image processing and hypothesis confirmation techniques to enhance detection speed and accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the system relies solely on camera field of view for object detection, then the system complexity is reduced, but the detection speed and accuracy for objects outside the field of view deteriorates

Engineering Contradiction:
Improvesystem complexityVSAvoiddetection delay
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The patent combines multiple sensing modalities (camera, radar, LIDAR, ultrasonic sensors) into a unified vision system that merges their respective fields of view and detection capabilities. This integration allows the system to detect objects outside the camera's field of view using alternative sensors, thereby reducing detection delay without requiring a complete system redesign.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system performs preliminary detection using radar and other sensors before objects enter the camera's field of view. By anticipating object trajectories and positions through multi-sensor data fusion, the system prepares detection hypotheses in advance, enabling faster confirmation when objects enter the visual field and reducing overall detection time.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If the system uses multiple sensors to detect objects outside the field of view, then the detection accuracy is improved, but the device complexity increases

Engineering Contradiction:
Improvedetection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the detection space into different zones (inside and outside the camera's field of view) and assigns different sensing modalities to different zones. Camera-based vision is used for detailed identification within the field of view, while radar and other sensors handle detection outside the field of view. This segmentation allows the system to achieve high detection accuracy across all areas while managing complexity through specialized, modular sensor assignments.

Inventive Principle:
Principle #1Segmentation

3Productivity

If the system processes data from multiple sources to anticipate object entry, then the object confirmation speed is improved, but the computational requirements and processing complexity increase

Engineering Contradiction:
Improveobject confirmation speedVSAvoidprocessing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary processing layer that fuses data from multiple sensors and generates hypothesis information about objects outside the camera's field of view. This intermediary layer pre-processes and filters data before it reaches the final object confirmation stage, reducing the computational burden on the main processing system while still enabling fast confirmation when objects enter the field of view.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20230254451A1Vehicular monitoring system with interior viewing camera and remote communication
Publication Date: 2023.08.10 MAGNA ELECTRONICS INC
  • US20230254451A1 patent drawing
  • US20230254451A1 patent drawing
  • US20230254451A1 patent drawing

AI summary

A vehicular monitoring system includes a camera disposed at a vehicle and viewing interior of the vehicle. The camera is operable to capture image data. Image data captured by the camera is provided to a data processor and is processed at the data processor. A wireless communication link links the vehicle with a remote communication device located remote from the vehicle. The remote communication device, responsive to communication received from the vehicle via the wireless communication link, displays video images derived from image data captured by the camera.