Work Machine Obstacle Alerts Using Operator Confirmation Actions

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing work machine obstacle notification systems require operators to manually confirm and cancel notifications for obstacles, which is cumbersome and prone to oversight.

Innovation Solution

A system that includes an obstacle determination unit, action detection unit, and notification unit to automatically change notification modes based on the operator's confirmation actions, such as pointing and calling, to confirm obstacles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the peripheral monitoring system notifies the operator of an obstacle through display or speaker, then the operator receives obstacle information, but the operator must manually confirm and press cancel button to end notification which is complicated

Engineering Contradiction:

Improveobstacle notification reliabilityVSAvoidnotification cancellation ease

Core Design Contradiction:

ReliabilityVSEase of operation

Solution Approach 1:

The system automatically determines when the operator has confirmed obstacle safety through action detection (e.g., pointing gestures, verbal confirmation) and autonomously changes the notification mode or ends notification, eliminating the need for manual cancel button pressing. The system serves itself by detecting operator intentions and executing appropriate notification management actions.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical interaction of pressing a cancel button with automated detection methods including gesture recognition (pointing detection), voice recognition (verbal confirmation detection), or eye tracking (gaze direction detection). These detection systems substitute the manual mechanical operation with automated sensing and interpretation of operator intent.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If the operator confirms obstacle presence and instructs system to end notification by pressing cancel button, then the notification is ended, but the operator needs to confirm and instruct every time which is time-consuming

Engineering Contradiction:

Improveobstacle confirmation reliabilityVSAvoidnotification management time

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary detection of operator confirmation actions (pointing gestures, verbal confirmations, or gaze direction) before automatically changing the notification mode. This preliminary detection allows the system to anticipate operator intent and execute notification changes proactively, eliminating the need for subsequent manual cancel button pressing and reducing overall time required.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system continuously monitors operator actions and provides feedback by automatically adjusting notification modes based on detected confirmation behaviors. This closed-loop feedback mechanism detects operator intent through gestures, voice, or gaze, and responds by modifying notification status, creating an efficient interactive cycle that reduces time loss.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS12359405B2Work machine obstacle notification system and work machine obstacle notification method

Publication Date: 2025.07.15 KOMATSU LTD

AI summary

An obstacle determination unit determines whether an obstacle is present in a periphery of the work machine. An action detection unit detects an action of an operator of the work machine. An action determination unit determines whether the detected action is a confirmation action executed at the time of safety confirmation. A notification unit changes a mode of notification when the action is determined to be the confirmation action.