Vision-Based Working Edge Positioning for Heavy Equipment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional heavy equipment working edge control systems face sensor damage due to stressful operating environments, leading to inefficiencies and downtime for repair or replacement.

Innovation Solution

A GNSS/INS system that uses a vision system to acquire images of a target on the working edge, calculating its location and orientation, and transforms this information into the GNSS/INS coordinate system for accurate navigation and control, reducing the need for sensitive sensors on the working edge.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If sensors are mounted on the working edge to monitor location and orientation, then working edge positioning accuracy is improved, but sensor reliability deteriorates due to damage from stressful operating environment

Engineering Contradiction:
Improveworking edge positioning accuracyVSAvoidsensor reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent uses image capture devices (cameras) to create visual copies of the working edge and target features instead of mounting physical sensors directly on the working edge. The vision system captures images and processes them to determine working edge location and orientation, eliminating the need for fragile physical sensors in the harsh working environment.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical sensor mounting system with an optical vision system. Instead of using physical sensors that require mechanical attachment to the working edge, the system uses image capture devices mounted on the vehicle body to photograph the working edge and target features, then uses computer vision algorithms to extract positioning information.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If sensors are mounted on the working edge, then real-time position monitoring is achieved, but operational downtime increases due to sensor repair or replacement

Engineering Contradiction:
Improvereal-time position monitoringVSAvoidoperational downtime
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The vision system continuously captures images of the working edge and target features, creating real-time visual copies that are processed to determine position and orientation. This eliminates the need for physical sensors that would require maintenance, ensuring continuous operation without downtime.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system uses the existing camera system and target features on the working edge to self-determine its position and orientation without requiring external sensor calibration or maintenance. The vision system automatically processes images to maintain real-time positioning capability.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If delicate sensors are mounted on the working edge, then precise working edge control is achieved, but the system complexity increases due to sensor protection and calibration requirements

Engineering Contradiction:
Improveworking edge control precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses visual copying through image capture devices to track working edge position and orientation. The system photographs target features attached to the working edge and uses image processing algorithms to determine precise positioning, eliminating the need for complex sensor mounting, protection, and calibration systems.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces target features as intermediaries between the working edge and the measurement system. These targets are attached to the working edge and serve as visual markers that the vision system can easily track, simplifying the measurement process compared to direct sensor mounting on the working edge.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution provides accurate and reliable working edge positioning without the risk of sensor damage, enhancing operational efficiency and reducing downtime by using image acquisition and processing to determine the working edge's location and orientation within the GNSS/INS system.

Implementation Method 1

an image capture device configured to obtain images of a target on the working edge

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentEP2971377B1System and method for heavy equipment navigation and working edge positioning
Publication Date: 2019.11.27 HEXAGON TECH CENT GMBH
  • EP2971377B1 patent drawingFigure 1
  • EP2971377B1 patent drawingFigure 2
  • EP2971377B1 patent drawingFigure 3

AI summary

A system and method for automatically controlling working edges on a heavy equipment vehicle is provided. A GNSS/INS system determines a location of the vehicle. A vision system calculates a location of the working edge in a vision system coordinate system by obtaining images of a target connected to the working edge using a camera with a fixed field view that incorporates the relative movement of the target and determining the relative position of the target in the images. The location is then transformed to the navigation system coordinate system. The transformed location information is used by a working edge control system to control the placement of the working edge.