Work Vehicle Obstacle Markers That Track Detection Delay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing periphery monitoring systems for work vehicles face challenges in accurately displaying the position of obstacles, such as people, due to the delay between obstacle detection and marker updates, leading to a feeling of strangeness for the operator as the obstacle's position deviates from the marker's position on the screen.

Innovation Solution

A display system for work vehicles that includes an image acquisition unit, a detection unit, and a display control unit, which acquires images, detects obstacles, and generates signals to display markers at their positions and change their form over time based on detection results, ensuring the marker follows the obstacle's movement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If obstacle detection is performed using image processing, then obstacle detection capability is improved, but marker update frequency decreases

Engineering Contradiction:
Improveobstacle detection capabilityVSAvoidmarker update frequency
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The system performs preliminary obstacle detection and stores detection results in advance. When generating the monitoring image, it retrieves and displays previously detected obstacle positions, allowing the marker to be updated at the same frequency as the monitoring image without requiring real-time detection for each marker update.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts the marker display strategy based on detection results. When an obstacle is detected, a marker is displayed at its position; when no obstacle is detected, no marker is displayed. This dynamic approach optimizes the balance between detection accuracy and update frequency.

Inventive Principle:
Principle #15Dynamics

2Use of energy by moving object

If marker update interval is longer than frame update interval, then calculation load is reduced, but position accuracy decreases

Engineering Contradiction:
Improvecalculation loadVSAvoidposition accuracy
Core Design Contradiction:
Use of energy by moving objectVSMeasurement precision

Solution Approach 1:

The system performs obstacle detection in advance and stores the results. The monitoring image generation unit creates monitoring images at a higher frequency using these pre-detected positions, allowing markers to be updated frequently without requiring frequent heavy detection calculations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates a monitoring image that is a processed version of the captured image, adding marker information to indicate obstacle positions. This copying approach allows the monitoring image to be generated and updated frequently without requiring full detection processing each time.

Inventive Principle:
Principle #26Copying

3Ease of operation

If obstacle position deviates from marker position, then operator awareness is reduced, but system complexity is reduced

Engineering Contradiction:
Improveoperator awarenessVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system provides visual feedback by displaying markers at the actual detected positions of obstacles in the monitoring image. This allows the operator to see the relationship between the obstacle and its marker representation, improving awareness without requiring complex additional systems.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system separates the detection function from the display function. The detection unit identifies obstacles, while the display control unit independently manages marker placement and monitoring image generation. This segmentation allows flexible optimization of each function independently.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12157991B2Display system for work vehicle, and method for displaying work vehicle
Publication Date: 2024.12.03 KOMATSU LTD
  • US12157991B2 patent drawing
  • US12157991B2 patent drawing
  • US12157991B2 patent drawing

AI summary

This display system is provided with: an image acquisition unit for acquiring a captured image obtained by capturing an image around a work vehicle; a detection unit for detecting an obstacle around the work vehicle; and a display control unit which, on the basis of the result of detection of the obstacle, generates a signal for displaying a marker image in a position corresponding to the obstacle, and a signal for causing the form of the marker image to change over time.