Autonomous Vehicle Telepresence for External Interface Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current autonomous vehicles lack the capability to autonomously interact with external interfaces, such as security gates, law enforcement, or to perform tasks like picking up packages or food, requiring improved systems for interaction and telepresence.

Innovation Solution

An autonomous vehicle system equipped with external sensors, a controller, wireless communication, microphone, speaker, and video display to identify and perform interactions, with telepresence mode engaging remote owners or agents for complex interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If autonomous vehicle is equipped with basic remote trigger capability, then simple interactions are enabled, but complex interactions with external interfaces cannot be performed

Engineering Contradiction:
Improveinteraction capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments interaction capabilities into multiple modes: fully automatic mode for routine interactions, telepresence mode for complex interactions requiring human judgment, and hybrid modes combining both. This segmentation allows the vehicle to handle simple tasks autonomously while escalating to human-in-the-loop control only when necessary, thereby improving versatility without proportionally increasing system complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary telepresence system that bridges the gap between fully autonomous operation and direct human control. When the autonomous system encounters an external interface it cannot handle, the telepresence mode activates to provide human assistance remotely, enabling complex interactions without requiring permanent human presence in the vehicle.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If fully automatic interaction mode is used, then operational efficiency is improved, but handling of complex or unexpected situations is compromised

Engineering Contradiction:
Improveoperational efficiencyVSAvoidinteraction reliability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system dynamically adjusts its level of automation based on the complexity and nature of the external interface being interacted with. Routine interactions with known interfaces operate in fully automatic mode for high efficiency, while novel or complex interfaces automatically trigger telepresence mode for reliable human judgment, optimizing the balance between productivity and reliability in real-time.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system incorporates feedback mechanisms that monitor the success and failure of automatic interactions. When automatic interactions fail or encounter unexpected situations, the system learns from these outcomes and can escalate to telepresence mode, ensuring that reliability is maintained while preserving operational efficiency for successful automatic operations.

Inventive Principle:
Principle #23Feedback

3Reliability

If telepresence mode is activated for all interactions, then interaction reliability is improved, but operational efficiency and user experience deteriorate

Engineering Contradiction:
Improveinteraction reliabilityVSAvoidoperational efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

Instead of applying telepresence to all interactions, the system applies it partially - only when necessary for complex or uncertain situations. This selective application maintains high reliability for critical interactions while avoiding the efficiency penalties of universal telepresence, allowing the majority of routine interactions to proceed automatically.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system applies different levels of interaction control to different situations based on their specific requirements. Routine, well-understood interactions receive automatic processing with high efficiency, while complex, novel, or high-stakes interactions receive telepresence support for enhanced reliability, creating local quality variations in the interaction approach.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12420636B2Autonomous vehicle interaction with physical environment
Publication Date: 2025.09.23 GM GLOBAL TECHNOLOGY OPERATIONS LLC
  • US12420636B2 patent drawing
  • US12420636B2 patent drawing
  • US12420636B2 patent drawing

AI summary

A system for facilitating interaction between an autonomous vehicle and an external interface in proximity to the autonomous vehicle including a plurality of external sensors positioned on the autonomous vehicle and adapted to collect data relative to an environment surrounding and in proximity to the autonomous vehicle, a controller having a wireless communication module, the wireless communication module adapted to facilitate wireless data exchange between the controller and remote entities, the controller adapted to receive data collected from the plurality of external sensors and identify an interaction mode for the external interface, a microphone and a speaker adapted to facilitate audible communication between the controller and the external interface, and a video display adapted to display visual information to the external interface, wherein the controller is adapted to perform an interaction with the external interface.