HMD Robot Guide Overlay for Tool Coordinate Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current display systems for robots lack convenience in guiding users to control targets in real space, as they do not effectively provide directional information or coordinate systems for motion mechanisms, limiting user interaction and precision.
Innovation Solution
A display system with a head-mounted display unit that overlays guide images indicating directions and coordinate systems based on control target objects, using image markers and a control unit to identify locations and update displays according to user inputs and robot operations, enhancing user convenience and precision.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If a transmission-type display is used to show 3DCG images, then the display can be transparent and allow viewing of real objects, but the system lacks guidance for users to locate and control target objects in real space
Solution Approach 1:
The patent introduces guide images as an intermediary element between the transparent display and the user. These guide images include coordinate systems and directional indicators that are overlaid on the transparent display, serving as a mediator to guide users in locating and controlling target objects in real space without obstructing the transparency function.
Solution Approach 2:
The patent adds a graphical dimension to the transparent display by overlaying guide images that provide spatial information. This includes displaying coordinate systems (X, Y, Z axes) and directional indicators that exist in a different visual layer, allowing users to understand three-dimensional spatial relationships while maintaining the transparency of the display itself.
2Device complexity
If no coordinate system or directional information is displayed, then the display system remains simple, but users cannot precisely locate or control motion mechanisms in real space
Solution Approach 1:
The patent segments the guidance information into distinct visual elements: coordinate system indicators (X, Y, Z axes), directional arrows, and target object markers. Each element is displayed separately at relevant locations, allowing users to process spatial information systematically without overwhelming complexity.
Solution Approach 2:
The patent displays coordinate systems and directional indicators in advance before users need to perform precise control operations. The guide images are continuously updated to reflect current target locations and orientations, providing users with pre-established spatial reference frames that simplify subsequent control tasks.
3Adaptability or versatility
If guide images are displayed for multiple target locations, then comprehensive spatial guidance is provided, but the processing and display load increases
Solution Approach 1:
The patent implements dynamic guide image display that adapts to the current operational context. The system selectively displays guide images for only those target locations that are currently active or relevant to the user's task, rather than continuously displaying all possible targets. This reduces processing complexity while maintaining comprehensive guidance capability when needed.
Data Source
AI summary
A display system includes an HMD and a PC. The HMD displays an image on a scene in a real space in an overlapped manner. The PC includes a first control unit. The first control unit causes the HMD to display a guide image indicating a direction set based on a robot to correspond to a robot arranged in the real space. On a tool of the robot, a tool coordinate system is set based on the tool. The first control unit displays the guide image indicating the tool coordinate system in accordance with a direction of the tool. The guide image includes an X-axis image, a Y-axis image, and a Z-axis image.