Virtual Vehicle Teleoperation for Multi-Vehicle Monitoring Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional systems and methods for controlling vehicles by a teleoperator are limited in monitoring multiple physical vehicles simultaneously, as the teleoperator's views of the vehicles are restricted, leading to inaccurate monitoring.

Innovation Solution

The system generates virtual vehicles linked to physical vehicles based on state information, allowing a teleoperator to control them through teleoperations by determining driving values and initiating actions on virtual vehicles, which are then reflected in the physical vehicles, enabling efficient motion and avoidance of undesired situations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If a teleoperator monitors multiple physical vehicles simultaneously, then the coverage of monitored vehicles increases, but the monitoring accuracy deteriorates due to limited views

Engineering Contradiction:
Improvenumber of monitored vehiclesVSAvoidmonitoring accuracy
Core Design Contradiction:
Quantity of substanceVSMeasurement precision

Solution Approach 1:

The system creates virtual vehicles that are digital replicas of physical vehicles, complete with their own virtual cameras and sensors. These virtual vehicles allow the teleoperator to interact with and monitor multiple physical vehicles through accurate virtual representations, eliminating the need to directly view multiple physical vehicles simultaneously while maintaining full monitoring capability.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The virtual vehicle acts as an intermediary between the teleoperator and the physical vehicle. Instead of directly monitoring physical vehicles with limited views, the teleoperator monitors virtual vehicles that receive and process data from the physical vehicles' actual sensors and cameras, providing comprehensive and accurate monitoring capability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If conventional systems control a single physical vehicle by a teleoperator, then the monitoring accuracy is maintained, but the productivity decreases due to inability to monitor multiple vehicles

Engineering Contradiction:
Improvemonitoring accuracyVSAvoidnumber of vehicles controlled
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

By creating virtual copies of physical vehicles, the system allows a single teleoperator to control multiple vehicles simultaneously through these virtual representations. Each virtual vehicle maintains the same level of detail and accuracy as if directly controlling a single physical vehicle, thereby maintaining monitoring accuracy while significantly improving productivity.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The virtual vehicle platform serves multiple functions: it acts as a control interface for the teleoperator, a data processing hub for sensor information, and a communication bridge between multiple physical vehicles. This multi-functionality enables a single teleoperator to effectively manage multiple vehicles without sacrificing control quality.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Device complexity

If the teleoperator's views of physical vehicles are limited, then the system complexity remains low, but the monitoring capability deteriorates

Engineering Contradiction:
Improvesystem complexityVSAvoidmonitoring capability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

Instead of requiring the teleoperator to directly view multiple physical vehicles with limited views, the system creates virtual copies equipped with comprehensive sensor data from the physical vehicles. This approach significantly enhances monitoring capability while adding only moderate computational complexity, as the virtual vehicles process and integrate data from existing physical vehicle sensors.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS20240319724A1Systems and methods for monitoring a plurality of vehicles by teleoperator
Publication Date: 2024.09.26 TOYOTA CONNECTED NORTH AMERICA INC
  • US20240319724A1 patent drawing
  • US20240319724A1 patent drawing
  • US20240319724A1 patent drawing

AI summary

Systems and methods for monitoring a plurality of vehicles by a teleoperator are provided. The systems include a controller programmed to: obtain state information about a plurality of physical vehicles, generate a plurality of virtual vehicles linked to the plurality of physical vehicles based on the state information about the plurality of physical vehicles, determine driving values for the plurality of virtual vehicles based on the state information, initiate teleoperations on one or more virtual vehicles based on the driving values, and control one or more physical vehicles linked to the one or more virtual vehicles in response to receiving inputs on the one or more virtual vehicles.