Boom-Mounted Robot Assembly With VR Depth Feedback for Remote Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Remote operation of machinery in hazardous or dynamic environments faces challenges due to inadequate visual and sensory information, particularly in providing depth and positioning data in three-dimensional spaces, limiting the ability of operators to accurately control robots in such scenarios.
Innovation Solution
A system comprising a boom-mounted robot unit with a six-degree-of-freedom camera mount, depth cameras, and a head-mounted display that transmits real-time sensory information to the operator, allowing for immersive control and action execution based on three-dimensional representations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If traditional remote operation systems are used, then the operator can control the robot from a distance, but the operator lacks adequate visual information about depth and positioning in three-dimensional space
Solution Approach 1:
The patent transitions from traditional two-dimensional video feeds to three-dimensional virtual reality visualization. Depth cameras capture spatial information that is processed into point cloud representations, allowing operators to perceive depth and positioning in 3D space rather than flat images, directly resolving the information loss problem while maintaining remote control capability
Solution Approach 2:
The system creates a virtual copy of the physical environment through point cloud generation. Depth cameras capture real-world spatial data that is processed into a digital 3D representation, allowing operators to interact with a virtual model that accurately replicates the physical space, thereby preserving complete spatial information during remote operation
2Loss of information
If simple video cameras are used for remote operation, then the system is simple and easy to operate, but the system fails to provide adequate sensory information about depth and positioning
Solution Approach 1:
The patent combines multiple camera types (standard video cameras and depth cameras) into an integrated sensor system. The depth cameras work alongside traditional cameras to capture both visual appearance and spatial structure, merging these data streams into a unified point cloud representation that provides comprehensive sensory information without requiring separate complex systems
Solution Approach 2:
The system replaces traditional mechanical measurement devices with optical sensing and computational processing. Instead of using physical measuring instruments, the patent uses depth cameras and point cloud algorithms to automatically extract depth and positioning information, reducing mechanical complexity while enhancing information capture
3Adaptability or versatility
If the robot is positioned in a dynamic and different job site, then the robot can adapt to various environments, but it becomes near impossible to determine the exact actions the robot will perform before positioning
Solution Approach 1:
The system performs preliminary scanning and point cloud generation before the robot executes any actions. Depth cameras capture the environment in advance, creating a 3D model that allows operators to plan and determine exact robot actions before positioning and execution, enabling informed decision-making in dynamic environments while maintaining adaptability
Solution Approach 2:
The system provides continuous real-time feedback through the virtual reality display, showing operators the current 3D environment and robot position. This feedback loop allows operators to adjust robot actions based on actual environmental conditions as they are captured, enabling adaptive control in dynamic job sites while maintaining complete information about the current state
Data Source
AI summary
A system, method, and device for a remotely controlled robot unit affixed to a boom assembly. The robot unit comprises at least one arm for performing an action, a remotely controlled movable six-degree-of freedom camera mount, at least one camera disposed on the camera mount to capture visual information, and at least one depth camera disposed on the camera mount to capture three-dimensional depth information. Captured sensory information may be transmitted to an operator using a head mount and motion controls for controlling movement of the robot unit. Operator movement captured by the head mount and motion controls may be compared to a digital representation generated from the three-dimensional depth information to aid in positioning and moving the robot unit.