Augmented Reality Robot Trajectory Visualization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current robotic systems lack the ability to accurately visualize and interact with their environment, leading to potential collisions and inefficiencies when following predefined trajectory points, as traditional 3D models may not accurately represent the robot's current operating environment.
Innovation Solution
The use of augmented reality to display robot trajectory points within an actual image of the environment, where the robot's pose is determined using sensors and fiducial markers, allowing users to preview and adjust motion paths before execution, thereby avoiding collisions and improving operational efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional 3D models are used to represent the robot's environment, then the system structure is simple, but the accuracy of environment representation deteriorates leading to potential collisions
Solution Approach 1:
The patent creates a virtual copy of the robot's environment by capturing images with a camera and overlaying trajectory points as virtual elements. This virtual representation accurately mirrors the real environment without requiring complex physical modeling, thus improving accuracy while maintaining system simplicity.
Solution Approach 2:
The patent transitions from traditional 3D model representation to a 2D image-based augmented reality representation. By capturing the environment as a 2D image and overlaying virtual trajectory points in this plane, the system achieves accurate environment representation without the computational complexity of full 3D modeling.
2Ease of operation
If predefined trajectory points are used for robot motion, then the operation is simple, but the risk of collisions increases due to lack of environmental awareness
Solution Approach 1:
The patent implements feedback by displaying the robot's trajectory points overlaid on the actual environment image. This allows operators to see whether trajectory points will cause collisions before execution, providing visual feedback that enables collision avoidance while maintaining simple predefined trajectory operation.
Solution Approach 2:
The patent performs preliminary visualization of the trajectory path by overlaying virtual trajectory points on the environment image before the robot executes the motion. This allows operators to preview and adjust motion paths in advance, preventing collisions before they occur while keeping the operation simple.
3Loss of information
If virtual trajectory points are overlaid on actual environment images, then the visualization accuracy improves, but the computational processing increases
Solution Approach 1:
The patent uses a 2D image copy of the environment rather than processing full 3D spatial data. By capturing the environment as an image and overlaying trajectory points in this 2D representation, the system preserves environment context information while minimizing computational energy requirements compared to complex 3D processing.
Data Source
AI summary
An example method includes receiving, from a sensor, an image of an environment, where the environment includes a robotic device. The method also includes determining, based on the received image of the environment, a pose of the robotic device relative to the sensor. The method further includes determining, based on the pose of the robotic device relative to the sensor, respective positions of a plurality of trajectory points for the robotic device relative to the sensor. The method additionally includes providing for display of the image of the environment and an overlaid plurality of virtual trajectory points corresponding to the plurality of trajectory points, where the plurality of virtual trajectory points are positioned in the image based on the determined respective positions of the plurality of trajectory points for the robotic device relative to the sensor.