Driver Intent and Pedestrian Awareness for Risk Assessment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Modeling driver behavior, particularly in complex scenarios involving cognitive processes like risk perception and pedestrian awareness, remains challenging due to the complexity of a driver's voluntary responses to external stimuli and the attentiveness of traffic participants.

Innovation Solution

A system utilizing an image sensor, temporal recurrent network (TRN), graph neural network (GNN), and multilayer perceptron (MLP) to estimate ego-vehicle intentions, generate scene representations, and predict situations, determining influenced or non-influenced actions based on pedestrian attentiveness and environmental factors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If complex cognitive processes like risk perception and pedestrian awareness are modeled to improve driver behavior understanding, then the accuracy of driver intent prediction is improved, but the system complexity increases

Engineering Contradiction:
Improvedriver intent prediction accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments driver behavior modeling into distinct functional modules: an intention estimator module that processes temporal sequences to predict driver intent, a scene representation generator that structures environmental data using graph neural networks, and a situation predictor that integrates these elements. This modular segmentation allows each component to specialize in specific aspects of cognitive process modeling, improving overall prediction accuracy while managing system complexity through organized functional decomposition.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces scene representation as an intermediary structure that bridges raw environmental data and driver intent predictions. The graph neural network generates structured representations of traffic participants, road geometry, and environmental context, which serve as intermediate features that facilitate more accurate risk perception modeling without requiring direct complex interactions between all system components.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If multiple neural network components (TRN, GNN, MLP) are integrated to improve situation prediction accuracy, then the reliability of risk assessment is improved, but the computational resource requirements increase

Engineering Contradiction:
Improverisk assessment reliabilityVSAvoidcomputational resource consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The computational workload is segmented across three specialized neural network components: a temporal recurrent network for intention estimation, a graph neural network for scene representation, and a multilayer perceptron for situation prediction. Each network is optimized for its specific function, allowing efficient resource utilization while maintaining high reliability through specialized processing rather than using a single monolithic complex model.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The scene representation generator performs preliminary processing of environmental data into structured graph representations before the situation predictor processes the final prediction. This preliminary action organizes and pre-processes data in advance, reducing the computational burden on subsequent prediction stages and enabling more reliable risk assessment with optimized resource consumption.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If pedestrian attentiveness and environmental factors are comprehensively analyzed to improve safety, then the pedestrian awareness capability is improved, but the difficulty of detecting and measuring increases

Engineering Contradiction:
Improvepedestrian awareness capabilityVSAvoidpedestrian attentiveness detection difficulty
Core Design Contradiction:
ReliabilityVSDifficulty of detecting and measuring

Solution Approach 1:

The graph neural network generates scene representations that serve as intermediaries, structuring complex environmental data including pedestrian positions, road geometry, and traffic conditions into organized graph structures. This intermediate representation makes pedestrian attentiveness and environmental factors more detectable and measurable by providing a structured framework that captures relevant relationships without requiring direct analysis of raw sensor data.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11845464B2Driver behavior risk assessment and pedestrian awareness
Publication Date: 2023.12.19 HONDA MOTOR CO LTD
  • US11845464B2 patent drawing
  • US11845464B2 patent drawing
  • US11845464B2 patent drawing

AI summary

Driver behavior risk assessment and pedestrian awareness may include an receiving an input stream of images of an environment including one or more objects within the environment, estimating an intention of an ego vehicle based on the input stream of images and a temporal recurrent network (TRN), generating a scene representation based on the input stream of images and a graph neural network (GNN), generating a prediction of a situation based on the scene representation and the intention of the ego vehicle, and generating an influenced or non-influenced action determination based on the prediction of the situation and the scene representation.