Multi-Camera Vision System for Autonomous Vehicle Obstacle Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles face challenges in navigating changing environments without human intervention, particularly in military contexts where traditional sensing technologies like LIDAR and radar can be detected and jammed, posing risks of collision or disablement.

Innovation Solution

The implementation of a vision system using multiple cameras with varying baselines to detect obstacles and identify paths, which does not rely on electromagnetic radiation, combined with a vehicle control system that includes LIDAR and radar systems for comprehensive terrain detection and path planning, allowing for autonomous operation and enhanced obstacle avoidance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If LIDAR and radar systems are used for terrain detection and obstacle avoidance, then measurement precision and obstacle detection capability are improved, but the vehicle becomes detectable and vulnerable to jamming by electromagnetic radiation

Engineering Contradiction:
Improveobstacle detection precisionVSAvoidelectromagnetic detection and jamming vulnerability
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The system segments the sensing functions by using multiple cameras with different baselines for different detection ranges. Wide-baseline cameras detect distant obstacles while short-baseline cameras detect close obstacles, dividing the electromagnetic sensing task into optical segments that are less vulnerable to jamming

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The vision system using cameras acts as an intermediary to LIDAR and radar systems. Instead of directly using electromagnetic radiation that can be detected and jammed, the system uses optical cameras to capture images, which are then processed to achieve obstacle detection without the harmful electromagnetic signature

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If multiple cameras with varying baselines are used for obstacle detection, then obstacle detection precision and adaptability to different distances are improved, but device complexity increases

Engineering Contradiction:
Improveobstacle detection precisionVSAvoidcamera system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The multiple cameras with different baselines serve universal obstacle detection functions across various distances. The same camera system handles both distant and close obstacle detection by selecting appropriate baseline combinations, reducing the need for separate detection systems for different ranges

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system dynamically selects which camera combinations to use based on detection needs. The processor chooses wide-baseline cameras for distant obstacles and short-baseline cameras for close obstacles, making the system adaptable and efficient rather than constantly processing all camera inputs

Inventive Principle:
Principle #15Dynamics

3Productivity

If the vehicle operates autonomously in continuously changing environments, then productivity and operational capability are improved, but reliability decreases due to inability to assess changing conditions

Engineering Contradiction:
Improveautonomous operation capabilityVSAvoidobstacle avoidance reliability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system performs preliminary actions by continuously capturing images and processing them to identify potential obstacles before they become immediate threats. The multi-camera system proactively scans the environment with different baselines to detect obstacles at various distances, allowing the vehicle to prepare avoidance maneuvers in advance

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The vision system provides continuous feedback to the autonomous control system. Images from multiple cameras are processed to generate real-time information about obstacles and terrain, which feeds back to the control system for immediate decision-making, improving reliability through continuous environmental assessment

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The vision system effectively detects obstacles and paths in diverse environments, reducing the risk of collision and enabling autonomous operation in challenging conditions, while the integrated control system ensures robust navigation and obstacle avoidance, even in adverse lighting and jamming scenarios.

Implementation Method 1

The vision system may include a plurality of cameras that are configured to receive input in the form of images of the surrounding environment

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

such systems may include LIDAR systems (also referred to as LADAR systems in a military context)

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 3

radar systems

Methodology Applied
Scientific EffectElectromagnetic wave reflection: Reflection

Data Source

PatentUS9420203B2Vision system for a vehicle
Publication Date: 2016.08.16 OSHKOSH DEFENSE LLC
  • US9420203B2 patent drawing
  • US9420203B2 patent drawing
  • US9420203B2 patent drawing

AI summary

A vision system includes a processor and a plurality of cameras, each of which is configured to be communicatively coupled to the processor. The processor is configured to select input from different combinations of the plurality of cameras based on a parameter that is associated with at least one of the status of a vehicle and a surrounding environment of the vehicle.