AR Overlay for Color Blind Drivers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Color blindness poses challenges for drivers in interpreting traffic lights and brake lights, leading to potential accidents, as existing solutions fail to accommodate all degrees of color blindness effectively.

Innovation Solution

An augmented reality system integrated into vehicles, including an AR viewing device and AR gloves, determines the driver's color blindness condition and provides personalized AR overlays to assist in interpreting traffic and brake lights, using GPS, image detection, and depth sensors to display relevant words like 'GO', 'STOP', and 'BRAKE' for accurate navigation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If existing sensor-based display solutions are used to assist color blind drivers, then some color blind drivers can discern traffic lights, but drivers with higher degrees of color blindness still cannot correctly interpret traffic lights and brake lights

Engineering Contradiction:
Improveaccuracy of traffic light interpretationVSAvoidaccommodation of all degrees of color blindness
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system dynamically adapts the AR overlay content based on the driver's specific color blindness condition detected through the mobile application. Different degrees of color blindness receive customized overlays with different color emphasis patterns, allowing the system to effectively accommodate all degrees of color blindness rather than using a static one-size-fits-all approach

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The AR overlays apply different visual enhancements to different color regions based on the driver's specific deficiency. For example, drivers with red-green color blindness receive overlays that specifically enhance red and green light detection, while those with blue-yellow deficiency receive different enhancements, making the assistance locally optimized for each color channel affected by the driver's condition

Inventive Principle:
Principle #3Local quality

2Reliability

If AR overlays with detailed color descriptions are provided to color blind drivers, then driving safety improves, but driver distraction increases due to excessive information

Engineering Contradiction:
Improvedriving safetyVSAvoiddriver attention and focus
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system extracts only the essential information needed for safe driving (traffic light color identification and brake light detection) and presents it through simple AR overlays with minimal text. Rather than providing comprehensive color theory or detailed explanations, the system isolates and displays only the critical action-oriented information such as 'STOP', 'GO', or 'CAUTION'

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system applies partial action by providing AR overlays only when and where needed in the driver's field of view, rather than continuously displaying information. The overlays are selectively applied to specific traffic lights and brake lights that require interpretation, leaving the rest of the visual field undisturbed and maintaining natural driving attention

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If personalized AR overlays are implemented for color blind drivers, then light interpretation accuracy improves, but system complexity increases due to multiple sensors and processing requirements

Engineering Contradiction:
Improvecolor detection accuracyVSAvoidsystem architecture
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system uses the driver's mobile smartphone as an intermediary device to handle the complex color analysis and AR overlay generation. The mobile application processes images from the vehicle's sensors, determines the driver's color blindness condition, and generates personalized AR overlays that are then displayed through the vehicle's display system, offloading computational complexity from the vehicle's main system

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system leverages the mobile smartphone's existing camera and processing capabilities as a multi-functional component that serves both as the color detection sensor and the AR overlay generation engine. This universal device performs multiple functions including image capture, color analysis, condition detection, and overlay generation, reducing the need for dedicated specialized hardware

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10423844B2Personalized augmented reality vehicular assistance for color blindness condition
Publication Date: 2019.09.24 TOYOTA JIDOSHA KK
  • US10423844B2 patent drawing
  • US10423844B2 patent drawing
  • US10423844B2 patent drawing

AI summary

The disclosure includes embodiments for providing augmented reality (“AR”) vehicular assistance for drivers who are color blind. A method according to some embodiments includes identifying an illuminated light in a driving environment of the vehicle based on sensor data recorded by a sensor. The method includes determining a color of the illuminated light based on the sensor data. The method includes determining if the color is of a specific type. The method includes determining a vehicular action to be taken responsive to the color being of the specific type. The method includes displaying an AR overlay using the AR viewing device that visually depicts a word which describes the vehicular action to be taken.