Robot Camera Image Processing for Wider Operator Field of View
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Operators face difficulty in effectively controlling robots when the field of view of the robot's image capture device is narrower than their own, leading to reduced operability.
Innovation Solution
A data processing apparatus that combines capture image data from a robot with past image data to generate composite image data with a wider angle of view, displayed on an operator's device, aligning the robot's head orientation with the operator's field of view.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the robot's image capture device is used to provide visual feedback to the operator, then the operator can control the robot remotely, but the narrow field of view of the capture device makes it difficult for the operator to operate the robot effectively
Solution Approach 1:
The patent combines the robot's capture image data with past capture image data to generate composite image data. This merging of current and historical visual information creates a wider angle of view that exceeds the robot's native field of view, allowing the operator to see more of the environment and operate the robot more effectively.
Solution Approach 2:
The patent adds a temporal dimension to the visual feedback by incorporating past capture images into the composite image. This transforms the limited spatial field of view into a broader perspective by utilizing the time dimension, allowing operators to view areas that are not currently in the robot's direct line of sight.
2Measurement precision
If the robot is equipped with high-resolution image capture devices to provide clear visual feedback, then the operator can see details clearly, but the cost and complexity of the robot system increases
Solution Approach 1:
The patent performs image processing and composite image generation in advance on the data processing apparatus before transmitting to the operator terminal. This preliminary processing of visual data allows the system to provide enhanced visual feedback without requiring the robot itself to have high-resolution capture devices, thereby reducing robot system complexity and cost.
Solution Approach 2:
The patent introduces a data processing apparatus as an intermediary between the robot's simple capture device and the operator terminal. This intermediary performs the complex tasks of combining current and past images, generating the composite wide-angle view, and processing the visual data, thereby keeping the robot system simple while still providing high-quality visual feedback to the operator.
Data Source
AI summary
A data processing apparatus includes a control unit. The control unit is configured to obtain capture image data generated based on image capturing by a camera provided for a robot, combine at least a portion of display image data of the capture image data obtained at a first time point and at least a portion of past capture image data of the capture image data obtained at a second time point before the first time point to generate composite image data having a wider angle of view than the display image data, and display the composite image data on a display device viewable by an operator of the robot.