Image Processing Device for Remote Operation Video Continuity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In situations where the inter-frame difference of a moving image is large, such as when a work attachment of a working machine rapidly moves, the amount of moving image data after compression increases, leading to potential discontinuity in the moving image output to a remote operation device.
Innovation Solution
An image processing device that includes a state detection element to identify the remote operation mode or moving mode of a working machine, an image prediction element to predict if the data amount of a captured image will exceed a threshold, and an image compression element that eliminates high frequency components in specific areas of the image to reduce data volume.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If video compression is applied to reduce data transmission, then data transmission efficiency is improved, but image quality and continuity deteriorate when inter-frame difference is large
Solution Approach 1:
The patent applies different compression strategies to different regions of the image. High-frequency components are selectively eliminated in the second specified image area (peripheral region) while preserving them in the first specified image area (central region). This local differentiation allows aggressive compression in less critical areas while maintaining image continuity and quality in important regions, resolving the contradiction between compression efficiency and image continuity.
2Quantity of substance
If high frequency components are eliminated to reduce data amount, then data transmission load is reduced, but image quality deteriorates
Solution Approach 1:
The patent eliminates high-frequency components only in the second specified image area (peripheral region) while preserving them in the first specified image area (central region). This selective approach reduces overall data amount for transmission while maintaining image quality in the central region where the operator's attention is focused, thus resolving the contradiction between data reduction and image quality preservation.
3Speed
If aggressive compression is applied to handle rapid movement, then data transmission is improved, but inter-frame continuity deteriorates
Solution Approach 1:
When rapid movement is detected (large inter-frame difference), the patent applies strong compression by eliminating high-frequency components in the peripheral second specified image area while maintaining quality in the central first specified image area. This localized approach allows the system to handle rapid movement scenarios with aggressive compression where it matters least (periphery) while preserving continuity in the central region, resolving the contradiction between speed of response and inter-frame continuity.
Data Source
AI summary
A device or the like capable of improving continuity of a moving image outputted to an image output device of a remote operation device even in circumstances where an inter-frame difference of the moving image becomes large. When it is predicted that a data amount of a captured image is to exceed a threshold in consideration of a detection result of a moving mode of a working machine, high frequency components exceeding a specified frequency in a second specified image area excluding a first specified image area of the captured image are eliminated. Thus, the data amount of the captured image is reduced so that the data amount becomes equal to or smaller than the threshold. Then, not only inter-frame continuity of the first specified image area of an environment image outputted to an image output device of a remote operation device but also visibility by an operator is improved.