Construction Work Medium State Recognition via Stereo Camera Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems can only recognize three-dimensional data of construction site landforms and not the detailed actions or states of work machinery, such as whether a work medium is operating or not.

Innovation Solution

An operation information transmission device that acquires image data from a construction site using a stereo camera, specifies the type and state of work machinery, and transmits this information to a server device, enabling detailed recognition of work medium states.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image data is acquired using a stereo camera to create three-dimensional data of the construction site landform, then the three-dimensional structure of the construction site can be visualized and managed, but the detailed actions or states of work machinery (such as whether a work medium is operating) cannot be recognized

Engineering Contradiction:
Improverecognition precision of work medium stateVSAvoidloss of work medium operation information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent segments the work medium detection into distinct functional components: image data acquisition unit, type/state specifying unit, and operation information transmission unit. This segmentation allows specialized processing of work medium characteristics separate from landform three-dimensional data, enabling detailed recognition of work medium states without compromising the overall construction site management system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary processing system that includes a type/state specifying unit which acts as a mediator between the stereo camera and the operation information transmission unit. This intermediary unit analyzes image data to extract work medium type and state information, serving as a bridge that transforms raw image data into actionable operation information.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If detailed recognition of work medium states is implemented using image data analysis, then comprehensive construction site monitoring is achieved, but the system complexity increases

Engineering Contradiction:
Improveversatility of construction site monitoringVSAvoidcomplexity of operation information transmission device
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements multi-functionality by enabling the same image data acquisition system to serve multiple purposes: creating three-dimensional landform data for construction management and simultaneously extracting work medium type and state information for operation monitoring. This universal approach allows one system to address both landform visualization and work medium state recognition without requiring separate dedicated systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent creates a digital copy of work medium characteristics through image data analysis, extracting type and state information as virtual representations. This copying approach allows the physical work medium states to be represented and transmitted as digital operation information, enabling remote monitoring without physical contact with the actual work machinery.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11076130B2Operation information transmission device, construction management system, operation information transmission method, and program
Publication Date: 2021.07.27 KOMATSU LTD
  • US11076130B2 patent drawing
  • US11076130B2 patent drawing
  • US11076130B2 patent drawing

AI summary

An operation information transmission device transmits a state of each work medium performing work in a construction site (F) to an information providing device. The operation information transmission device includes an image data acquisition unit that acquires image data including the work medium, a type/state specifying unit that specifies the type and a state of the work medium included in the image data, and an operation information transmission unit that transmits operation information indicating the specified type and state of the work medium to the information providing device.