Composite Image Generation for Teleoperation Visual Gaps
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing teleoperation systems for work machines fail to provide a sense of presence to remote operators, leading to decreased work efficiency due to limited visual information.
Innovation Solution
An image generation device that creates a composite image by combining a main image captured at the work site with complementary images that fill in areas outside the main image's imaging range, enhancing the sense of presence for remote operators.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If only a main image captured by an imaging device is provided to remote operators, then the device complexity is reduced, but the sense of presence and work efficiency deteriorate due to limited visual information
Solution Approach 1:
The patent creates a virtual copy of the work site environment by generating a composite image that combines the real captured image with a virtual image. The virtual image replicates the appearance of areas outside the imaging device's field of view, providing remote operators with a comprehensive visual representation that enhances sense of presence without requiring additional physical cameras or sensors in those blind spots
Solution Approach 2:
The image generation device acts as an intermediary between the limited captured image data and the operator's need for comprehensive visual information. It processes the captured image, generates virtual content to fill blind spots, and combines them into a composite image that mediates the gap between what the imaging device can capture and what the operator needs to see for effective teleoperation
2Loss of information
If multiple imaging devices are deployed to cover all areas, then the visual information completeness is improved, but the device complexity and cost increase significantly
Solution Approach 1:
Instead of deploying multiple physical imaging devices to capture all areas, the system creates a virtual copy of the blind spot areas through image generation. The virtual image synthesizes visual content for regions outside the main imaging device's field of view, achieving complete visual coverage with a single physical camera
Solution Approach 2:
The patent replaces the mechanical solution of adding more physical cameras and imaging hardware with a computational approach. Image processing algorithms and virtual content generation substitute for additional mechanical imaging devices, reducing system complexity while maintaining visual information completeness
3Area of stationary object
If the imaging range of the main image is expanded, then the visual coverage is improved, but the image quality and distortion deteriorate in peripheral areas
Solution Approach 1:
The patent segments the visual field into two parts: the central area captured by the imaging device with high quality, and the peripheral blind spots generated virtually. By separating the captured image from the generated virtual image and combining them appropriately, the system maintains high image quality in the main view while providing comprehensive coverage through the virtual composite
Data Source
AI summary
An image generation device generates an image for assisting teleoperation of a work machine equipped with a work attachment. The image generation device is configured to generate a composite image that includes a main image included in an image captured at a work site where the work machine works by an imaging device, and a complementary image that complements an outside of an imaging range of the main image.