Remote Terminal 3D Spatial Instruction Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing screen-sharing technologies between remote terminals and instruction terminals struggle to effectively convey three-dimensional effects and the relationship between screen displays and real-space environments, making it difficult for workers to understand instructions accurately.
Innovation Solution
Incorporating a camera unit, image transmitter, display unit for three-dimensional shapes, and an icon display unit that shows instruction icons, such as arrow icons, to guide movement or rotation, along with a location detecting unit and estimating unit to enhance understanding of spatial relationships.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If a flat screen display is used to project work instructions, then the screen sharing function is achieved, but the three-dimensional effect and spatial relationship understanding is poor
Solution Approach 1:
The patent transitions from two-dimensional flat screen display to three-dimensional augmented reality display by overlaying virtual instruction icons (arrows, spheres, cylinders) onto the real-world scene captured by the camera. This dimensional change enables workers to perceive spatial relationships and three-dimensional effects directly in the real environment, resolving the contradiction between achieving screen sharing functionality and enabling effective three-dimensional understanding.
2Device complexity
If work instructions are displayed as flat images, then the instruction transmission is simple, but the worker cannot accurately understand spatial relationships and movement directions
Solution Approach 1:
The patent introduces virtual instruction icons (such as arrows, spheres, and cylinders) as intermediary elements that bridge the gap between the instructor's intentions and the worker's understanding. These icons are overlaid on the real-world scene and provide intuitive visual cues for movement directions and spatial relationships, effectively transmitting complex spatial information without increasing system complexity.
Solution Approach 2:
The patent utilizes color and visual characteristics of the instruction icons to convey different types of information. For example, different colors or styles of icons represent different instruction types (movement direction, object identification, spatial relationship), enabling the worker to quickly and accurately understand spatial relationships and movement directions through visual differentiation.
3Device complexity
If arrow icons are displayed without location detection, then the instruction icon display is simple, but the worker cannot accurately interpret movement directions relative to the real environment
Solution Approach 1:
The system automatically detects the worker's position and orientation using the camera and location detection algorithms, eliminating the need for manual input. The arrow icons are dynamically adjusted based on the detected location and viewing angle, providing accurate movement direction guidance relative to the real environment. This self-service approach maintains high measurement precision while avoiding complex manual configuration systems.
Data Source
AI summary
The present invention is to provide a remote terminal, and a method of remote instruction to easily understand not only a three-dimensional effect but also a relationship between the screen display and the actual real space. A remote terminal 100 receiving an instruction from an instruction terminal 10 while sharing a screen, takes an image, transmits the taken image to the instruction terminal 10, displays a three dimensional shape to understand three dimensional space of the taken image, and displays an instruction icon received from the instruction terminal 10 for the three dimensional shape.