Cognitive State Vehicle Navigation Using Image Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current transportation systems face challenges such as gridlocked traffic, stressful travel experiences, and safety concerns due to factors like road congestion, unfamiliar vehicles, and distracted drivers, which negatively impact cognitive and emotional states of travelers.

Innovation Solution

Cognitive state vehicle navigation uses image processing to analyze occupant emotions and adjust travel routes and vehicle settings, providing a more comfortable and safe travel experience by mapping cognitive state data to location data and updating vehicle routes accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional navigation systems are used, then route guidance is provided, but they cannot adapt to occupant emotional states or cognitive conditions

Engineering Contradiction:
Improveadaptability to occupant stateVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system performs preliminary image capture and cognitive state analysis before making navigation decisions. Images of the occupant are captured and analyzed to determine cognitive state, which then informs route selection and vehicle setting adjustments, allowing the system to proactively adapt rather than reactively respond

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Image processing technology serves as an intermediary between the occupant's internal cognitive state and the navigation system's external controls. The system uses image analysis to detect cognitive states and translates these into appropriate navigation adjustments, bridging the gap between unobservable mental states and actionable vehicle control

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If cognitive state monitoring is implemented, then travel stress is reduced, but privacy concerns and data security issues arise

Engineering Contradiction:
Improvetravel comfortVSAvoidprivacy risks
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The system extracts only the necessary cognitive state information from image data without capturing or storing identifiable personal information. By focusing solely on analyzing emotional and cognitive indicators from facial images while discarding identifying features, the system obtains the needed data for stress reduction while minimizing privacy exposure

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system processes and analyzes images locally within the vehicle using onboard computing resources, allowing the occupant to benefit from adaptive navigation without their data being transmitted externally. This self-contained processing approach enables comfort optimization while keeping sensitive information isolated within the vehicle system

Inventive Principle:
Principle #25Self-service

3Measurement precision

If real-time image processing is performed, then cognitive state detection is accurate, but computing resources and energy consumption increase

Engineering Contradiction:
Improvecognitive state detection accuracyVSAvoidenergy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system performs partial image processing by focusing analysis only on relevant facial regions and cognitive indicators rather than processing the entire image in full detail. This selective approach maintains sufficient detection accuracy for navigation decisions while reducing the computational load and energy requirements compared to comprehensive image analysis

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances road safety, reduces travel stress, and improves the overall transportation experience by tailoring routes and vehicle conditions to the emotional state of occupants, preventing accidents and improving comfort.

Implementation Method 1

Cognitive state vehicle navigation uses image processing to analyze occupant emotions

Methodology Applied
Scientific EffectImage processing: Image Processing

Data Source

PatentUS11067405B2Cognitive state vehicle navigation based on image processing
Publication Date: 2021.07.20 AFFECTIVA
  • US11067405B2 patent drawing
  • US11067405B2 patent drawing
  • US11067405B2 patent drawing

AI summary

Image-based analysis techniques are used for cognitive state vehicle navigation, including an autonomous or a semi-autonomous vehicle. Images including facial data of a vehicle occupant are obtained using an in-vehicle imaging device. The vehicle occupant can be an operator of or a passenger within the vehicle. A first computing device is used to analyze the images to determine occupant cognitive state data. The analysis can occur at various times along a vehicle travel route. The cognitive state data is mapped to location data along the vehicle travel route. Information about the vehicle travel route is updated based on the cognitive state data. The updated information is provided for vehicle control. The updated information is rendered on a second computing device. The updated information includes road ratings for segments of the vehicle travel route. The updated information includes an emotion metric for vehicle travel route segments.