Autonomous Shuttle Sensor Fusion for Safe On-Demand Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Designing a system for autonomous driving of shared or on-demand vehicles without human supervision that ensures safety and practical acceptance is challenging, as it requires replicating the complex obstacle detection and reaction capabilities of human drivers in dynamic environments.

Innovation Solution

The system employs a sensor suite including cameras, LIDAR, RADAR, and other sensors for situational awareness, combined with machine learning and computer vision to enable the vehicle to navigate and interact with passengers and the environment, using a deep learning accelerator for real-time decision-making and ISO 26262 level 4 certification for safety.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a sensor suite and machine learning system are implemented for autonomous obstacle detection and navigation, then safety and situational awareness are improved, but device complexity and cost increase

Engineering Contradiction:
ImprovesafetyVSAvoiddevice complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The autonomous vehicle system divides the complex task of autonomous operation into separate functional modules: sensor suite (cameras, LIDAR, RADAR) for environmental perception, machine learning processors for decision-making, and control systems for execution. This segmentation allows each component to be optimized independently while working together to achieve safe autonomous operation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The sensor suite is designed to perform multiple functions simultaneously - cameras capture visual information for obstacle detection, LIDAR provides depth mapping for navigation, and RADAR detects moving objects. This multi-functionality reduces the need for separate specialized sensors for each task, managing system complexity while maintaining high safety standards.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Speed

If deep learning accelerators and multiple sensors are used for real-time decision-making, then reaction speed and obstacle detection accuracy are improved, but energy consumption increases

Engineering Contradiction:
Improvereaction speedVSAvoidenergy consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary processing of sensor data at the edge devices (cameras and sensors themselves) before transmission to central processors. This preliminary action filters and pre-processes data in real-time, enabling fast local responses to critical events while reducing the energy burden on central deep learning accelerators.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The machine learning system uses periodic processing cycles where sensors continuously collect data, but intensive deep learning inference is performed at strategically determined intervals rather than continuously. This periodic action maintains high reaction speed for critical events while significantly reducing overall energy consumption compared to continuous full-power processing.

Inventive Principle:
Principle #19Periodic action

3Productivity

If the system operates autonomously without human supervision, then productivity and convenience are improved, but reliability and safety challenges increase

Engineering Contradiction:
ImproveproductivityVSAvoidreliability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The autonomous vehicle system continuously monitors its own operational status, sensor functionality, and decision-making processes through multiple feedback loops. This self-monitoring feedback mechanism allows the system to detect and respond to anomalies in real-time, maintaining high reliability during unsupervised autonomous operation and enabling productivity improvements.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system implements redundant sensor suites and backup processing pathways that are activated beforehand when primary systems show signs of failure or uncertainty. This prior cushioning approach ensures that reliability is maintained during autonomous operation by having pre-positioned fail-safes ready to take over, allowing the vehicle to operate without human supervision with confidence.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system allows for safe and efficient operation of autonomous or semi-autonomous vehicles in various conditions, including dynamic environments, by providing situational awareness and enabling the vehicle to react to obstacles and passengers' needs, enhancing safety and convenience.

Implementation Method 1

a sensor suite including cameras, LIDAR, RADAR, and other sensors for situational awareness

Methodology Applied
Scientific EffectLIDAR: LIDAR

Implementation Method 2

a sensor suite including cameras, LIDAR, RADAR, and other sensors for situational awareness

Methodology Applied
Scientific EffectRADAR: Radar

Data Source

PatentUS11874663B2Systems and methods for computer-assisted shuttles, buses, robo-taxis, ride-sharing and on-demand vehicles with situational awareness
Publication Date: 2024.01.16 NVIDIA CORP
  • US11874663B2 patent drawing
  • US11874663B2 patent drawing
  • US11874663B2 patent drawing

AI summary

A system and method for an on-demand shuttle, bus, or taxi service able to operate on private and public roads provides situational awareness and confidence displays. The shuttle may include ISO 26262 Level 4 or Level 5 functionality and can vary the route dynamically on-demand, and/or follow a predefined route or virtual rail. The shuttle is able to stop at any predetermined station along the route. The system allows passengers to request rides and interact with the system via a variety of interfaces, including without limitation a mobile device, desktop computer, or kiosks. Each shuttle preferably includes an in-vehicle controller, which preferably is an AI Supercomputer designed and optimized for autonomous vehicle functionality, with computer vision, deep learning, and real time ray tracing accelerators. An AI Dispatcher performs AI simulations to optimize system performance according to operator-specified system parameters.