Remote Operation Display Using Virtual Objects to Cut Data Load
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote driving techniques face challenges in reducing communication delays and amounts, even when using difference information for three-dimensional map data, which affects the efficiency of remote operation.
Innovation Solution
A control apparatus that acquires information about surrounding objects, determines virtual objects based on this information, and displays them at corresponding geographical locations, reducing the need for transmitting detailed images and thus minimizing communication requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If full image data is transmitted from the vehicle to the remote operator, then the operator can see detailed surroundings, but the communication amount increases significantly
Solution Approach 1:
The patent extracts only the essential elements from the full image data - specifically object information and map data - and transmits only these extracted elements to the remote operator. This selective extraction reduces communication amount while preserving the most critical visual information needed for safe remote operation.
Solution Approach 2:
Instead of transmitting original image data, the system creates simplified copies in the form of object information (extracted features) and map data (environmental context). These copies represent the visual scene in a compressed format that requires minimal communication bandwidth while maintaining operational utility.
2Quantity of substance
If difference information of three-dimensional map data is transmitted, then communication amount is reduced, but there is still room for improvement
Solution Approach 1:
The patent merges object information with map data to create a comprehensive environmental representation. By combining these two data types, the system provides both detailed object information and broader environmental context in a unified format, improving situation awareness without proportionally increasing communication amount.
Solution Approach 2:
The system transitions from transmitting only visual image data to a multi-dimensional data structure that includes object information, map data, and their relationships. This dimensional transformation allows the system to convey richer environmental context using more efficient data representations that exploit the structured nature of spatial information.
Data Source
AI summary
A control apparatus for remotely operating an operation target is provided. The apparatus includes an acquisition unit configured to acquire information regarding an object that exists in the surroundings of the operation target, and is not to be operated by the control apparatus, from an information providing unit outside the control apparatus, a determination unit configured to determine a virtual object for representing the object, based on the information regarding the object, and a display control unit configured to display the virtual object at a display position corresponding to a geographical location of the object.