Boom-Mounted Robot Assembly With 3D Vision for Remote Positioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current remote operation technologies face challenges in providing adequate visual and sensory information, particularly depth and positioning information, to operators controlling robots in dynamic and hazardous environments.
Innovation Solution
A system and method utilizing a boom-mounted robot unit equipped with a camera mount, cameras, depth cameras, and sensors, transmitting real-time sensory information via a fiber-optic cable to a head-mounted display, allowing for immersive and accurate remote operation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If traditional remote operation technologies are used, then operators can control robots from a distance, but operators do not receive adequate visual and sensory information about depth and positioning in three-dimensional space
Solution Approach 1:
The patent combines multiple camera systems (stereo cameras, depth cameras, RGB cameras) into a single integrated remote capture device mounted on the robot. This merging of multiple sensing modalities provides comprehensive visual and depth information to the operator, resolving the information loss problem while managing system complexity through integration rather than separate systems
Solution Approach 2:
The patent introduces a head-mounted display as an intermediary device that delivers processed visual and depth information directly to the operator's field of view. This intermediary transforms raw sensor data into an immersive visual experience, providing adequate depth and positioning information without requiring complex traditional display setups
2Adaptability or versatility
If robots are positioned in dynamic and hazardous environments, then robots can perform work in locations difficult for humans, but it becomes near impossible to determine the exact actions the robot will perform before positioning
Solution Approach 1:
The patent enables preliminary viewing of the job site environment through the remote capture device and head-mounted display system before the robot is positioned. Operators can see the three-dimensional environment and plan actions in advance, performing the information-gathering action preliminarily to reduce uncertainty about robot actions in dynamic environments
Solution Approach 2:
The patent implements real-time feedback by continuously transmitting visual and depth information from the robot's perspective to the operator through the head-mounted display. This feedback loop allows operators to monitor and adjust robot actions in dynamic environments, determining exact actions based on real-time visual information rather than pre-positioning assumptions
3Measurement precision
If current visual technologies are used, then operators can view the remote environment, but operators do not receive adequate sensory information about depth and positioning
Solution Approach 1:
The patent merges stereo vision technology with active depth sensing (time-of-flight or structured light cameras) into a unified visual system. This combination provides both high-resolution visual information and precise depth measurements, achieving accurate depth and positioning information while managing complexity through integrated hardware and software processing
Solution Approach 2:
The patent transitions from traditional two-dimensional visual displays to three-dimensional immersive visualization through the head-mounted display. By adding the depth dimension to the visual information, the system provides accurate depth and positioning perception, allowing operators to mentally construct three-dimensional space from multi-camera inputs
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables operators to receive real-time, immersive sensory information, enhancing their ability to accurately control robots in complex environments, thereby improving operational efficiency and safety.
Implementation Method 1
a fiber-optic cable to transmit a signal comprising sensory information collected by the remote capture device to the head-mounted display
Data Source
AI summary
A system, method, and device for a remotely controlled robot unit affixed to a boom assembly. The robot unit comprises at least one arm for performing an action, a remotely controlled movable six-degree-of freedom camera mount, at least one camera disposed on the camera mount to capture visual information, and at least one depth camera disposed on the camera mount to capture three-dimensional depth information. Captured sensory information may be transmitted to an operator using a head mount and motion controls for controlling movement of the robot unit. Operator movement captured by the head mount and motion controls may be compared to a digital representation generated from the three-dimensional depth information to aid in positioning and moving the robot unit.