Road Scene Behavior Prediction Using Human Response Modeling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous driving vehicles struggle to predict human behavior in urban environments, as current methods rely solely on motion vectors and fail to account for other observations, leading to inferior prediction results.

Innovation Solution

A system and method that uses a computing device to generate stimulus data from images or video segments of road scenes, collects user input from human observers to create statistical data, and trains a supervised learning algorithm to predict human behavior, incorporating parameters like central tendency and variance to improve prediction accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If autonomous driving vehicles use motion vector prediction methods, then the system can process data efficiently, but the prediction accuracy of human behavior is insufficient

Engineering Contradiction:
Improveprediction accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments human behavior prediction into multiple independent analysis dimensions: demographic characteristics (age, gender), contextual factors (location, time), behavioral patterns (walking speed, direction), and environmental conditions (weather, traffic). Each segment is analyzed separately using appropriate algorithms, then integrated to form a comprehensive prediction model, improving accuracy without overwhelming system complexity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from traditional 2D motion vector analysis to multi-dimensional behavioral analysis by incorporating temporal patterns (historical behavior data), spatial context (location-based patterns), and demographic dimensions. This dimensional expansion enables more accurate prediction of human intent beyond simple motion extrapolation

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If the system collects and processes extensive user response data, then prediction accuracy improves, but data processing time and computational resources increase

Engineering Contradiction:
Improvebehavior prediction accuracyVSAvoiddata processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary processing of user response data during off-peak periods by pre-computing behavioral patterns, training prediction models, and organizing data structures. This advance preparation reduces real-time processing requirements when actual predictions are needed, maintaining high accuracy while minimizing latency

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts data processing parameters based on operational context: during critical prediction moments, it uses optimized subsets of data with adjusted confidence thresholds, while during non-critical periods, it processes complete datasets for model refinement. This parameter flexibility balances accuracy requirements with processing time constraints

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11753046B2System and method of predicting human interaction with vehicles
Publication Date: 2023.09.12 PERCEPTIVE AUTOMATA INC
  • US11753046B2 patent drawing
  • US11753046B2 patent drawing
  • US11753046B2 patent drawing

AI summary

Systems and methods for predicting user interaction with vehicles. A computing device receives an image and a video segment of a road scene, the first at least one of an image and a video segment being taken from a perspective of a participant in the road scene and then generates stimulus data based on the image and the video segment. Stimulus data is transmitted to a user interface and response data is received, which includes at least one of an action and a likelihood of the action corresponding to another participant in the road scene. The computing device aggregates a subset of the plurality of response data to form statistical data and a model is created based on the statistical data. The model is applied to another image or video segment and a prediction of user behavior in the another image or video segment is generated.