In-Vehicle Display Object Detection via LIDAR Data Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current vehicle navigation systems provide limited situational awareness by relying on simplistic indicators for detected objects, such as flashing lights or audible alarms, without detailed representations of object locations or additional information, leading to incomplete understanding of the surrounding environment.

Innovation Solution

An integrated display system that uses LIDAR point cloud data to detect and down-sample objects, converting the data into reduced-size representations for efficient processing and rendering as graphical elements within a navigation display, providing contextual information like object type, size, and location, while minimizing lag and enhancing situational awareness.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If LIDAR point cloud data is displayed in real-time within the navigation display, then situational awareness is improved, but data processing lag increases due to large data quantities

Engineering Contradiction:
Improvesituational awarenessVSAvoiddata processing lag
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system segments the LIDAR point cloud data by separating detected objects from the full point cloud dataset. Only the relevant object data is extracted and transmitted to the display system, while the remaining data is discarded. This segmentation approach maintains complete situational awareness of detected objects while dramatically reducing the data volume that requires real-time processing and transmission, thereby eliminating display lag.

Inventive Principle:
Principle #1Segmentation

2Loss of information

If detailed representations of detected objects are provided, then situational awareness is improved, but device complexity increases

Engineering Contradiction:
Improveobject information completenessVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system extracts only the essential object information (presence, location, and basic characteristics) from the LIDAR point cloud data and transmits this extracted data to the display system. By taking out only the necessary information elements rather than processing and displaying all raw data, the system provides detailed object representations for situational awareness while keeping the processing system relatively simple and efficient.

Inventive Principle:
Principle #2Taking out (Extraction)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system improves situational awareness by providing detailed, real-time visualizations of detected objects within the navigation display, reducing data processing lag and enhancing the driver's understanding of the environment through accurate and efficient rendering of object locations and characteristics.

Implementation Method 1

a light detection and ranging (LIDAR) sensor uses light/lasers to scan the surrounding environment and detect a presence of objects in the surrounding environment

Methodology Applied
Scientific EffectLight detection and ranging (LIDAR): LIDAR

Data Source

PatentUS10648832B2System and method for in-vehicle display with integrated object detection
Publication Date: 2020.05.12 TOYOTA JIDOSHA KK
  • US10648832B2 patent drawing
  • US10648832B2 patent drawing
  • US10648832B2 patent drawing

AI summary

System, methods, and other embodiments described herein relate to improving situational awareness of occupants of a vehicle. In one embodiment, a method includes analyzing, using at least a processor of the vehicle, scan data from a sensor of the vehicle to detect at least one object within the surrounding environment. The method includes converting the scan data into converted data that represents the at least one object with a reduced quantity of data. The method includes rendering, using the converted data, at least one graphic that is a visual representation of the at least one object. The method includes displaying the at least one graphic within a display of the vehicle at a location within the display that represents a location of the at least one object relative to the vehicle in the surrounding environment.