Vehicle-Mobile Interface for Occupant State and AR Pose Detection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing systems fail to effectively integrate augmented reality devices with vehicles to assist occupants by accurately determining their pose and state, leading to potential impairments in vehicle operation due to distractions or health conditions.

Innovation Solution

A method and apparatus that determine the pose of a mobile device relative to a vehicle's coordinate system, assess the state of the occupant, and send data to the vehicle for integrated assistance, using image processing, sensors, and vehicle templates to localize the device and monitor the occupant's condition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If augmented reality devices are integrated with vehicles to provide virtual content and assistance, then occupant assistance and safety are improved, but device complexity and system integration difficulty increase

Engineering Contradiction:

Improveoccupant assistanceVSAvoidsystem integration

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces a vehicle computing system as an intermediary that mediates between the augmented reality device and the vehicle systems. This computing system processes data from multiple sensors, determines occupant state, and controls the AR device content delivery, thereby simplifying the integration complexity while maintaining reliability of occupant assistance

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The augmented reality device is designed to perform multiple functions: displaying virtual content, monitoring occupant state through sensors, determining device pose, and receiving control signals. This multi-functionality consolidates what would otherwise require separate systems, reducing overall system complexity while improving occupant assistance capability

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Reliability

If the system monitors occupant state and determines device pose in real-time, then safety and assistance quality are improved, but processing requirements and energy consumption increase

Engineering Contradiction:

ImprovesafetyVSAvoidprocessing energy

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system implements selective monitoring by determining occupant state and device pose only when necessary or at reduced frequencies during stable conditions. Full real-time monitoring is applied only when safety concerns arise or when virtual content delivery requires precise positioning, thereby reducing overall energy consumption while maintaining safety

Inventive Principle:

Principle #16Partial or excessive action

Solution Approach 2:

The system performs preliminary assessments of occupant state and device pose to anticipate when full monitoring and processing will be needed. By predicting when safety-critical decisions will be required, the system can pre-position data and reduce processing bursts, lowering energy consumption while maintaining safety response capability

Inventive Principle:

Principle #10Preliminary action

3Device complexity

If virtual content is delivered without pose determination, then system simplicity is maintained, but content accuracy and realism deteriorate

Engineering Contradiction:

Improvesystem simplicityVSAvoidcontent positioning accuracy

Core Design Contradiction:

Device complexityVSMeasurement precision

Solution Approach 1:

The patent determines device pose in three-dimensional space relative to the vehicle coordinate system, adding spatial dimensionality to content positioning. This 3D pose determination (x, y, z coordinates plus orientation) enables accurate anchoring of virtual content to real-world positions, dramatically improving content accuracy while the automated nature of the process keeps implementation complexity manageable

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

4Ease of operation

If the system allows unrestricted virtual content delivery, then user experience and entertainment are improved, but occupant safety and distraction risks worsen

Engineering Contradiction:

Improveuser experienceVSAvoidoccupant distraction

Core Design Contradiction:

Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The system continuously monitors occupant state (attention level, drowsiness, distraction indicators) and uses this feedback to dynamically control virtual content delivery. When distraction or impairment is detected, the system automatically adjusts or restricts content, creating a closed-loop system that balances user experience with safety through real-time feedback

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The virtual content delivery is made dynamic rather than static - the system adjusts content type, intensity, and presentation based on real-time occupant state. This dynamic adaptation allows full entertainment capability when occupants are alert while automatically reducing distraction risks when impairment is detected, resolving the contradiction between user experience and safety

Inventive Principle:

Principle #15Dynamics

Data Source

PatentUS20250209834A1Vehicle and mobile device interface for vehicle occupant assistance

Publication Date: 2025.06.26 QUALCOMM INC

AI summary

Systems, methods, and non-transitory media are provided for a vehicle and mobile device interface for vehicle occupant assistance. An example method can include determining, based on one or more images of an interior portion of a vehicle, a pose of a mobile device relative to a coordinate system of the vehicle; determine a state of an occupant of the vehicle; and send, to the vehicle, data indicating the state of the occupant and the pose of the mobile device relative to the coordinate system of the vehicle.