Remote Work Machine Camera Selection for Clear Operator Viewing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing imaging systems for work machines struggle to provide clear and reliable images of the machines during remote operation, as the motion and surroundings change frequently, making it difficult for operators to monitor and control the machines effectively.

Innovation Solution

A work assisting system that automatically selects and switches imaging devices to maintain optimal viewing angles and content awareness, ensuring clear images of the work machine are displayed on the operator's display device without manual intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If fixed point cameras are placed in work sites to overview the entire site, then the safety monitoring capability is improved, but the work machine appears small or hardly appears in the image making it difficult to use

Engineering Contradiction:
Improveimaging rangeVSAvoidwork machine visibility
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The system dynamically switches between multiple fixed point cameras based on the work machine's position and movement. As the work machine moves between different locations, the system automatically selects and switches to different cameras that can capture the machine at appropriate distances, maintaining both overview capability and machine visibility.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

Multiple fixed point cameras are deployed to serve dual purposes: providing overall site monitoring and capturing detailed views of the work machine. By strategically positioning cameras at different locations with different fields of view, the system makes each camera versatile for both overview and close-up imaging functions.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If multiple imaging devices are used to capture the work machine, then the reliability of monitoring is improved, but the complexity of device management increases

Engineering Contradiction:
Improvemonitoring reliabilityVSAvoidimaging device management
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system implements automatic camera selection and switching based on the work machine's position and movement detected through image processing. The system self-manages the multiple imaging devices by automatically determining which camera should be active at any given time, eliminating the need for manual intervention and reducing operational complexity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system continuously analyzes images from multiple cameras to detect the work machine's position and movement, then uses this feedback information to automatically switch between cameras. This closed-loop feedback mechanism ensures reliable monitoring while simplifying device management through automated decision-making.

Inventive Principle:
Principle #23Feedback

3Loss of information

If the operator manually switches imaging devices to track the work machine, then the image relevance is improved, but the operational efficiency decreases

Engineering Contradiction:
Improvework machine tracking accuracyVSAvoidoperational efficiency
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The system automatically performs the task of tracking the work machine by detecting its position in images and switching cameras without operator intervention. This self-service capability maintains accurate tracking while freeing the operator to focus on primary work tasks, thereby improving operational efficiency.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system proactively monitors the work machine's position and anticipates movement, automatically switching cameras before the machine leaves the current field of view. This preliminary action ensures continuous tracking accuracy without requiring reactive manual intervention from the operator.

Inventive Principle:
Principle #10Preliminary action

4Area of stationary object

If fixed point cameras are used to monitor the work site, then the safety overview is improved, but the work machine motion changes make the image difficult to use for remote operation

Engineering Contradiction:
Improvesite coverageVSAvoidremote operation support
Core Design Contradiction:
Area of stationary objectVSReliability

Solution Approach 1:

The system dynamically adapts to the work machine's motion by automatically switching between fixed point cameras as the machine moves. This dynamic switching maintains continuous visual contact with the work machine throughout its movements across the site, providing reliable imagery for remote operation while preserving comprehensive site coverage.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP4050164B1Work assisting server and method for selecting imaging device
Publication Date: 2025.11.19 KOBELCO CONSTR MASCH CO LTD
  • EP4050164B1 patent drawingFigure 1
  • EP4050164B1 patent drawingFigure 2
  • EP4050164B1 patent drawingFigure 3

AI summary

A work assisting server 10 includes a first assisting process element 121 and a second assisting process element 122 and communicates with a plurality of facility cameras 30 when an operator OP remotely operates a work machine 40 while viewing a captured image displayed on an image output device 221. The first assisting process element 121 extracts, as candidates, the facility cameras 30 including the work machine 40 in imaging ranges. The second assisting process element 122 selects the facility camera 30 that is able to obtain the imaging range including an optimal direction or size on the basis of movement of the work machine 40 and causes the selected facility camera 30 to output a captured image to the image output device 221.