Remote Vehicle Guidance Using a Forward Virtual Viewpoint
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In existing vehicle remote assistance systems, there is a delay in the driver's response to changes in traveling circumstances due to the time lag between the operator's remote assistance and the driver's actions, as the operator steers the vehicle based on images of the surrounding environment displayed on an image display unit.
Innovation Solution
An information processing device and method that acquire surrounding information, set a virtual viewpoint position ahead of the vehicle, generate virtual surrounding information, transmit this information to a remote device, and receive driving operation information to generate driving assistance signals for output on the vehicle, allowing the driver to follow remote assistance without delay.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the operator remotely assists the driver by viewing surrounding images from the vehicle position, then the operator can control the vehicle, but the driver cannot respond to changes in traveling circumstances without delay due to time lag
Solution Approach 1:
The patent introduces a virtual viewpoint positioned ahead of the vehicle in the traveling direction, creating a new spatial dimension for viewing surrounding images. This allows the operator to see the environment from a forward position rather than from the vehicle's current location, enabling the operator to anticipate and respond to upcoming circumstances before they reach the vehicle, thereby reducing response time lag while maintaining control reliability
Solution Approach 2:
The patent introduces a virtual vehicle as an intermediary between the operator and the actual vehicle. The virtual vehicle displays surrounding images from a virtual viewpoint ahead of the actual vehicle, serving as a mediator that provides the operator with advanced visual information about upcoming traveling circumstances, enabling faster response without direct delay
2Ease of operation
If the operator views surrounding images from the vehicle position, then remote control is possible, but the driver's response to changes in traveling circumstances is delayed
Solution Approach 1:
The patent implements preliminary action by positioning the virtual viewpoint ahead of the vehicle in the traveling direction. This allows the operator to view and respond to surrounding circumstances before the vehicle actually reaches those locations. The operator can take preliminary control actions based on advanced visual information, eliminating the delay that occurs when viewing from the vehicle's current position
Data Source
AI summary
The present invention acquires surrounding information of surrounding environment of a vehicle; sets a virtual viewpoint position ahead of the vehicle in a traveling direction; uses the acquired surrounding information and generates virtual surrounding information indicating the surrounding environment at the set virtual viewpoint position; transmits a first control signal for controlling an external device located at a location away from the vehicle to display the generated virtual surrounding information; receives driving operation information on a driving operation of the vehicle output from the external device; generates driving assistance information for assisting driving of the vehicle based on the received driving operation information; and generates a second control signal for controlling an output device installed in the vehicle to output the driving assistance information.