Vision System for Heavy Equipment Edge Positioning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional heavy equipment working edge control systems face sensor damage due to the stressful operating environment, leading to inefficiencies and downtime for repair or replacement.

Innovation Solution

A GNSS/INS system utilizing a vision system with a time of flight camera to obtain working edge location information, transforming it into the navigation system's coordinate system for accurate control, reducing the reliance on sensitive sensors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If delicate sensors are mounted on the working edge to monitor location and orientation, then working edge positioning accuracy is improved, but the sensors are subject to damage from the stressful work environment

Engineering Contradiction:
Improveworking edge positioning accuracyVSAvoidsensor durability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent extracts the sensing function from the stressful working edge environment and relocates it to the protected cab environment. Cameras and sensors are mounted in the cab to capture images of the working edge, eliminating direct exposure to damaging conditions while maintaining measurement capability

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces an intermediary optical system (cameras and imaging devices) that indirectly measures working edge position from a protected location. Instead of mounting sensors directly on the blade, the system uses visual intermediaries to transmit position information from the working edge to the control system

Inventive Principle:
Principle #24Intermediary (Mediator)

2Extent of automation

If sensors are mounted on the working edge for continuous monitoring, then automation capability is improved, but downtime for sensor repair or replacement increases

Engineering Contradiction:
Improveautomatic working edge positioningVSAvoiddowntime for sensor repair
Core Design Contradiction:
Extent of automationVSLoss of time

Solution Approach 1:

The sensing components are extracted from the working edge and relocated to the protected cab environment where they are shielded from damage. This prevents sensor failure and eliminates downtime associated with repair or replacement, while maintaining continuous automated monitoring capability

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent creates an optical copy (image) of the working edge position rather than using physical sensors in contact with the working edge. This virtual representation allows continuous monitoring without physical exposure to damaging conditions

Inventive Principle:
Principle #26Copying

3Measurement precision

If manual verification is performed to check grading accuracy, then measurement precision is improved, but productivity decreases due to iterative work-measurement cycles

Engineering Contradiction:
Improvegrading accuracy verificationVSAvoidwork efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent implements continuous automated monitoring of working edge position during operation, eliminating the stop-start nature of manual verification. The system continuously captures images and calculates position, allowing work to proceed without interruption while maintaining precision through real-time feedback

Inventive Principle:
Principle #20Continuity of useful action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances the accuracy and reliability of heavy equipment navigation by providing precise working edge positioning without the risk of sensor damage, improving operational efficiency and reducing downtime.

Implementation Method 1

an image acquisition device, such as a time of flight camera, acquires an image that includes the target. The image acquisition device illustratively provides both an intensity and distance value for each pixel within its field of view

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentEP2971378B1System and method for heavy equipment navigation and working edge positioning using an image acquisition device that provides distance information
Publication Date: 2019.05.08 HEXAGON TECH CENT GMBH
  • EP2971378B1 patent drawingFigure 1
  • EP2971378B1 patent drawingFigure 2
  • EP2971378B1 patent drawingFigure 3

AI summary

A system and method for automatically controlling working edges on a heavy equipment vehicle is provided. A GNSS/INS system determines a location of the vehicle. A vision system calculates a location of the working edge in a vision system coordinate system by obtaining images of a target connected to the working edge using a camera with a fixed field view that obtains distance information for each pixel in the fixed field of view. The location is then transformed to the navigation system coordinate system. The transformed location information is used by a working edge control system to control the placement of the working edge.