Gesture-Controlled Shovel Operation for External Workers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Shovels require manual operation from within the cabin, limiting their functionality and safety when needing to be controlled by workers outside the cabin.

Innovation Solution

Integration of an operating element, recognition part, and control part that allows the shovel to recognize gestures from workers outside the cabin, enabling autonomous operation of its hydraulic actuators based on predefined gestures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the shovel is operated manually from inside the cabin, then the operator can directly control the operating elements, but the worker cannot operate the shovel from outside the cabin

Engineering Contradiction:
Improveoperational flexibilityVSAvoidoperability by external worker
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent replaces the traditional mechanical control system with a gesture recognition system. The recognition part detects gestures made by the worker outside the cabin, and the control part translates these gestures into commands for the operating elements, eliminating the need for the operator to be physically inside the cabin.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The recognition part acts as an intermediary between the worker's gestures and the shovel's control system. It captures gesture information from the worker outside the cabin and transmits it to the control part, which then executes the corresponding operating element control.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If a gesture recognition system is added to enable remote operation, then the shovel can be operated by workers outside the cabin, but the device complexity increases

Engineering Contradiction:
Improveremote operabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The control part is designed to handle multiple functions: it receives control inputs from both the traditional operating elements inside the cabin and the new gesture recognition system. This multi-functionality allows the system to support both manual and remote operation modes without requiring entirely separate control systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If the recognition part recognizes multiple gestures, then the operational versatility is improved, but the difficulty of detecting and measuring increases

Engineering Contradiction:
Improvegesture recognition capabilityVSAvoidgesture detection complexity
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The gesture recognition system divides the recognition process into distinct segments or categories. Each gesture type (e.g., hand movements, arm positions) is recognized and processed separately, allowing the control part to handle multiple gesture types systematically without overwhelming complexity.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP3835492B1Remotely operated shovel
Publication Date: 2023.03.08 SUMITOMO CONSTRUCTION MACHINERY
  • EP3835492B1 patent drawingFigure 1
  • EP3835492B1 patent drawingFigure 2
  • EP3835492B1 patent drawingFigure 3

AI summary

A shovel and the like that can be operated by a worker in a surrounding area or the like is provided. For this, a shovel according to an embodiment of the present invention includes an operating element (for example, the lower traveling structure 1, the upper swing structure 3, the attachment AT or the like), the gesture recognition part 301 configured to recognize a worker in a surrounding area and a predetermined gesture made by the recognized worker, and the operation control part 302 configured to control the operation of an operating element in response to the predetermined gesture made by the worker recognized by the gesture recognition part 301.