Virtual Figure Support for Driverless AV User Assistance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles (AVs) lack a human interface, leading to user isolation and support challenges during services, as users cannot receive assistance from drivers, which can result in issues with navigation, malfunctions, or simply a desire for companionship during rides.

Innovation Solution

A user support platform utilizing virtual figures projected through augmented reality (AR) or virtual reality (VR) environments, allowing users to interact with computer-generated graphical icons that can provide assistance, entertainment, and supervision, simulating the presence of a driver or passenger.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If autonomous vehicles operate without human drivers, then automation level and productivity are improved, but user isolation and lack of support increase

Engineering Contradiction:
Improveautomation levelVSAvoiduser support
Core Design Contradiction:
Extent of automationVSEase of operation

Solution Approach 1:

The patent introduces a remote operator as an intermediary between the autonomous vehicle system and the user. When a user requests support, a remote operator is connected via communication devices (headsets, microphones, cameras) to provide assistance, thereby resolving the contradiction between high automation and user support needs without compromising the driverless operation

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If autonomous vehicles operate without human drivers, then service efficiency is improved, but user companionship and support decrease

Engineering Contradiction:
Improveservice efficiencyVSAvoiduser companionship
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The system enables users to self-initiate support requests through user interfaces (buttons, voice commands, gestures). Users can independently request assistance when needed, while the autonomous vehicle continues its service operation uninterrupted. This maintains service efficiency while providing on-demand companionship and support

Inventive Principle:
Principle #25Self-service

3Ease of operation

If remote support operators are introduced, then user support and companionship are improved, but system complexity increases

Engineering Contradiction:
Improveuser supportVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent extracts the support function from the vehicle's autonomous driving system and places it in a separate remote operations center. This modular approach allows the autonomous vehicle to maintain its simple driverless operation while the complex support infrastructure operates independently, connecting only when users request assistance

Inventive Principle:
Principle #2Taking out (Extraction)

4Ease of operation

If communication devices are added to AVs, then user support capability is improved, but device complexity and cost increase

Engineering Contradiction:
Improvesupport capabilityVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The communication devices (headsets, microphones, cameras) are not continuously active but are deployed partially only when users request support. This selective activation provides full support capability when needed while minimizing the operational complexity and resource consumption during normal autonomous operation

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS12122416B2System and method for using virtual figures to support users of autonomous vehicles
Publication Date: 2024.10.22 GM CRUISE HOLDINGS LLC
  • US12122416B2 patent drawing
  • US12122416B2 patent drawing
  • US12122416B2 patent drawing

AI summary

Assistance can be provided to AV users through projection of graphical figures. A system may receive a request for assistance from a user of an AV. The system assigns the request to an agent who can assist the user. The system further provides a graphical representation (e.g., an avatar) of the agent to a device that can project the graphical representation to the user. The user can have a conversation with the graphical representation, e.g., based on information provided by the agent. The system can also provide an audio filter to the device for modifying an audio content presented by the device so that the modified audio content appears as if it is made by the graphical representation. The device may be a part of the AV or a client device of the user that can present VR, AR, or MR content. The device may be mobile.