Systems and methods for remote operation of robot vehicles

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

As autonomous vehicle fleets grow, the number of vehicles vastly outnumbers remote human operators, making it challenging to efficiently manage and prioritize remote human intervention in situations where autonomous vehicles encounter unstructured environments, subsystem failures, or high-risk situations.

Innovation Solution

The system allows autonomous vehicles to request remote human operators based on captured information, including environment and subsystem data, and assigns available operators using a database of experience information to prioritize high-risk situations, enabling risk mitigation and control adjustments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If autonomous vehicles operate independently without remote human operators, then productivity and autonomy are improved, but reliability deteriorates when vehicles encounter unstructured environments or subsystem failures

Engineering Contradiction:
Improveautonomous operationVSAvoidsafety in unstructured environments
Core Design Contradiction:
Extent of automationVSReliability

Solution Approach 1:

A remote human operator system acts as an intermediary between autonomous vehicles and fleet management. The system includes a communication module that enables vehicles to request remote assistance and a remote operator interface that allows human operators to assume control when needed, thereby maintaining high automation while providing a safety net for reliability-critical situations

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary actions by establishing communication channels and operator readiness before failures occur. Vehicles are pre-configured with the ability to request remote assistance, and operators are prepared to take control, ensuring that reliability is maintained without compromising autonomous operation during normal conditions

Inventive Principle:
Principle #10Preliminary action

2Reliability

If remote human operators are assigned to all autonomous vehicles, then reliability is improved, but device complexity and operational cost increase

Engineering Contradiction:
Improveoperational safetyVSAvoidremote operation management system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

Instead of assigning remote operators to all vehicles continuously, the system applies partial action by providing remote operator assistance only when specifically requested by vehicles encountering problems. This reduces device complexity and operational cost while maintaining reliability when needed

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The autonomous vehicle performs self-service by monitoring its own subsystems and autonomously determining when remote assistance is needed. The vehicle's processor evaluates subsystem information and independently initiates requests for remote human operators, reducing the complexity of centralized monitoring systems

Inventive Principle:
Principle #25Self-service

3Reliability

If remote human operators are deployed to assist autonomous vehicles, then reliability is improved, but loss of time increases due to coordination overhead

Engineering Contradiction:
Improvesafety in complex situationsVSAvoidoperator assignment time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by maintaining a pool of ready remote operators and pre-establishing communication channels. When a vehicle requests assistance, operators can be rapidly assigned without extensive coordination overhead, reducing time loss while ensuring reliability

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The vehicle's processor continuously monitors subsystem information and provides feedback about vehicle status and environmental conditions. This enables rapid, informed decisions about when remote assistance is needed, reducing unnecessary coordination time while maintaining safety

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11176591B2Systems and methods for remote operation of robot vehicles
Publication Date: 2021.11.16 NURO INC
  • US11176591B2 patent drawing
  • US11176591B2 patent drawing
  • US11176591B2 patent drawing

AI summary

An autonomous robot vehicle in accordance with aspects of the present disclosure includes a land vehicle conveyance system, a sensor system configured to capture information including surrounding environment information and/or vehicle subsystem information, a communication system configured to communicate with a remote human operator management system, at least one processor, and a memory storing instructions. The instructions, when executed by the processor(s), cause the autonomous robot land vehicle to, autonomously, determine based on the captured information to request a remote human operator, and communicate a request to the remote human operator management system for a remote human operator to assume control of the land vehicle conveyance system, where the request includes at least a portion of the captured information.