Vehicle Blind-Spot Display and Sensor Fusion for Pillarless Vision

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Vehicle collisions and accidents often result from reduced peripheral vision, necessitating a system that improves situational awareness and reaction time for drivers, particularly for larger vehicles like trucks and trains.

Innovation Solution

An interactive vehicle safety system comprising image capturing devices, object detecting sensors, and a display system that processes real-time data to predict potential collisions, providing visual and audible warnings, and enhancing driver visibility by portraying blocked views from structural pillars, using technologies like clear metal technology and heads-up displays.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If image capturing devices and display systems are added to improve peripheral vision, then driver situational awareness is improved, but device complexity increases

Engineering Contradiction:
Improvedriver situational awarenessVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system divides the vehicle's exterior monitoring into multiple image capturing devices positioned at different locations (front, rear, sides) to capture specific zones. Each device focuses on a particular area, and the processor segments and reassembles these views to create comprehensive pillarless display images, thereby improving situational awareness without requiring a single overly complex device

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The processor acts as an intermediary that receives images from multiple capturing devices, processes them to remove pillar obstructions, and generates composite views. The display system then presents these processed images to the driver. This intermediary processing layer enables complex functionality while keeping individual components relatively simple

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If multiple sensors and processing units are deployed to predict future locations and routes of objects, then collision prediction accuracy is improved, but device complexity increases

Engineering Contradiction:
Improvecollision prediction accuracyVSAvoidprocessing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary tracking and prediction of object trajectories using sensor data before collisions actually occur. By continuously analyzing location, speed, and direction data to forecast future positions and routes of pedestrians, vehicles, and other objects, the system prepares collision warnings in advance, improving prediction accuracy while distributing processing demands over time

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback from multiple sensors (cameras, LIDAR, radar) to continuously update object tracking and prediction models. The processor compares predicted trajectories with actual object positions, refines predictions based on deviations, and adjusts collision risk assessments accordingly. This feedback loop improves measurement precision through iterative refinement

Inventive Principle:
Principle #23Feedback

3Loss of time

If real-time processing of images and sensor data is implemented, then reaction time is improved, but use of energy increases

Engineering Contradiction:
Improvedriver reaction timeVSAvoidsystem energy consumption
Core Design Contradiction:
Loss of timeVSUse of energy by moving object

Solution Approach 1:

The system implements periodic processing cycles where images and sensor data are captured, processed, and displayed at regular intervals optimized for the specific application. Rather than continuous processing, the system updates pillarless views and collision predictions at frame rates sufficient for safety (e.g., 30-60 Hz), reducing energy consumption while maintaining adequate reaction time for driver response

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system performs preliminary processing of sensor data to identify and track objects of interest before full image processing is required. By pre-detecting pedestrians, vehicles, and obstacles using simpler sensor data analysis, the system can prioritize and accelerate processing only for relevant areas, reducing overall energy consumption while maintaining fast reaction times

Inventive Principle:
Principle #10Preliminary action

4Reliability

If pillarless images are displayed to eliminate A-pillar obstructions, then peripheral vision is improved, but ease of operation decreases due to information overload

Engineering Contradiction:
Improveperipheral visionVSAvoiddriver operation ease
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The display system applies local quality enhancement by selectively processing and displaying different regions of the pillarless images with appropriate emphasis. Critical areas such as detected pedestrians, vehicles, or obstacles are highlighted or enhanced in the composite views, while less critical areas are displayed with standard quality. This allows the driver to quickly identify important information without being overwhelmed by uniform high-detail displays of all areas

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system uses color changes and visual differentiation in the displayed pillarless images to convey important information. Detected objects are highlighted with specific colors or color overlays (e.g., red for high-risk obstacles, yellow for moderate risks), and trajectory predictions may be displayed with color-coded confidence levels. This visual coding helps drivers quickly interpret complex multi-source information without cognitive overload

Inventive Principle:
Principle #32Color changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system enhances driver peripheral vision, reduces collision risks by providing seamless 360-degree views, real-time object tracking, and predictive alerts, enabling timely reactions and potentially automatic vehicle operations to prevent accidents.

Implementation Method 1

one or more image capturing devices located on the vehicle configured to transmit one or more images from the vehicle to a processor

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

The one or more object detecting sensors may be ultrasonic sensors, LIDAR radar sensors, or photoelectric sensors

Methodology Applied
Scientific EffectLIDAR: LIDAR

Implementation Method 3

The one or more object detecting sensors may be ultrasonic sensors, LIDAR radar sensors, or photoelectric sensors

Methodology Applied
Scientific EffectUltrasonic detection: Ultrasound

Implementation Method 4

The one or more object detecting sensors may be ultrasonic sensors, LIDAR radar sensors, or photoelectric sensors

Methodology Applied
Scientific EffectPhotoelectric detection: Photoelectric Effect

Data Source

PatentUS12077046B2Interactive safety system for vehicles
Publication Date: 2024.09.03 LIBRE HLDG
  • US12077046B2 patent drawing
  • US12077046B2 patent drawing
  • US12077046B2 patent drawing

AI summary

An interactive vehicle safety system having capabilities to improve peripheral vision, provide warning, and improve reaction time for operators of vehicles. For example, the interactive vehicle safety system may have capabilities for portraying objects, which are being blocked by any of the structural pillars and/or mirrors of a vehicle (such as a truck, van, train, etc.). The interactive vehicle safety system disclosed may comprise one or more image capturing devices (such as camera, sensor, laser), distance and object sensors (such as ultrasonic sensor, LIDAR radar sensor, photoelectric sensor, and infrared sensor), a real-time image processing of an object, and one or more display systems (such as LCD or LED displays). The interactive vehicle safety system may give a seamless 360-degree front panoramic view to a driver.