Remote Work Machine Camera Zoom Switching for Situational Awareness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Remote operation of working machines, such as hydraulic shovels, faces challenges in accurately recognizing the surrounding environment due to difficulties in displaying enlarged detailed images and maintaining appropriate display magnification, leading to obstructed recognition of the situation needed for work.
Innovation Solution
An image capturing function control system that controls the zoom magnification of an actual machine image capturing device, allowing panoramic recognition in operational states and adjustable zoom operations in non-operational states, enabling operators to recognize the environment effectively through specified and arbitrary display magnifications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the display magnification of the camera is increased to display an enlarged detailed image of a specific part, then the operator can recognize detailed information of the working situation, but the recognition of the surrounding situation is obstructed and becomes insufficient
Solution Approach 1:
The display screen is segmented into multiple regions: a main display area showing the wide-angle camera image for surrounding situation recognition, and a sub-display area showing the zoomed-in image for detailed information. This segmentation allows simultaneous display of both wide-field and detailed views without obstructing the surrounding situation recognition.
Solution Approach 2:
The solution transitions from a single-dimensional display (either wide-angle or zoomed-in) to a two-dimensional display layout where the zoomed-in image is positioned in a corner region while the wide-angle image occupies the main area. This dimensional arrangement allows both views to coexist on the same screen.
2Measurement precision
If the operator manually adjusts the zoom magnification to confirm working situation, then detailed recognition is improved, but the operation complexity increases and efficiency decreases due to repeated adjustments
Solution Approach 1:
The system automatically manages the zoom magnification settings based on the detected working state. When work is detected, the system automatically sets the camera to a predetermined magnification suitable for work confirmation, eliminating the need for manual adjustment and allowing the operator to focus on operation.
Solution Approach 2:
The system detects the working state (whether the working machine is performing work or not) and provides feedback by automatically adjusting the camera magnification accordingly. This feedback mechanism ensures the display is always optimized for the current working condition without requiring operator intervention.
3Measurement precision
If the camera magnification is not returned to minimum after use, then detailed viewing capability is maintained, but the surrounding situation recognition is obstructed and work safety is compromised
Solution Approach 1:
The system pre-configures predetermined magnification values for different working states. When work is detected, the system automatically switches to the predetermined magnification suitable for work confirmation. This preliminary setup ensures the operator immediately gets the appropriate view without manual adjustment, and the system automatically manages the magnification state.
Solution Approach 2:
The system continuously monitors the working state and provides feedback by automatically adjusting the magnification. When work is detected, it switches to work-appropriate magnification; when work is not detected, it returns to the initial magnification for surrounding situation recognition, ensuring safety and appropriate viewing for each state.
4Loss of information
If multiple images are simultaneously displayed to show both driving view and attention area, then information completeness is improved, but the display configuration becomes complex and operator confusion increases
Solution Approach 1:
The display allocates different quality levels to different regions: the main display area shows the wide-angle view for overall situation awareness, while a smaller sub-display area in the corner shows the zoomed-in detailed view. This local quality differentiation ensures important information is prominent while detailed information is available without overwhelming the operator.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A system or the like capable of making an operator recognize an environment around a working machine in an appropriate form in consideration of a state of the working machine. In the case where a working machine 40 is in a first state (an operable state), a display magnification of a captured image (environment image) outputted to a remote output interface 220 is controlled only in a range of a specified display magnification or lower, or is fixed at a value of the specified display magnification or lower. On the other hand, in the case where the working machine 40 is in a second state (an inoperable state), a zoom function of an actual machine image capturing device 412 is demonstrated according to a zoom operation through a remote input interface 210 by the operator.