Stereo Imaging 3D Terrain Mapping for Machine Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing machine control systems lack the ability to effectively recognize and map terrain features beyond the limited range of visual sensors, leading to operator fatigue and inefficiencies in machine operations due to obstructed views and physical limitations.

Innovation Solution

A machine control system equipped with a stereo imaging apparatus that generates 3-D models of terrain features using stereo cameras, allowing for automatic operation and path adjustments based on these models, enhancing operator awareness and reducing fatigue.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If a machine operator uses traditional sensors to assist with operation, then the operator receives machine data and job site data, but the operator still experiences fatigue and the sensors cannot solve issues related to limited field of vision and obstructed views

Engineering Contradiction:
Improvejob site data availabilityVSAvoidoperator fatigue
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system enables automatic machine operation where the machine control system autonomously performs operations based on 3-D terrain maps and stereo imaging data, eliminating the need for continuous operator intervention and reducing fatigue while maintaining complete job site awareness

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the operator's visual observation and manual control with automated vision systems (stereo cameras) and control algorithms that process 3-D terrain models to automatically guide machine operations, substituting human sensory and motor functions with mechanical and computational systems

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If visual sensors are used to recognize terrain features, then the system can detect objects within the sensor range, but the sensors cannot recognize terrain features beyond the limited range or outside the area defined by beacons

Engineering Contradiction:
Improveterrain feature recognitionVSAvoiddetection range
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system transitions from 2-D sensor data to comprehensive 3-D terrain mapping using stereo vision, enabling the machine to perceive and navigate complex three-dimensional terrain features, piles, and trenches with accurate depth and spatial information that extends beyond limited sensor ranges

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The stereo imaging apparatus and 3-D mapping system serve multiple functions: they create detailed terrain maps, identify various terrain features (piles, trenches, obstacles), guide automatic navigation, and provide spatial awareness for operation planning, making the system versatile across different job site conditions and machine types

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If the machine operator relies on sight to analyze the job site and perform operations, then the operator can make real-time decisions, but the operator's view is obstructed by obstacles at the job site or machine components

Engineering Contradiction:
Improvereal-time decision makingVSAvoidjob site visibility
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The system introduces stereo cameras and 3-D mapping technology as intermediaries that capture and process visual information from multiple angles and positions, creating a comprehensive digital representation of the job site that compensates for obstructed physical views and provides the control system with complete spatial awareness for real-time decision making

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system improves machine operation efficiency by providing comprehensive 3-D terrain mapping and automatic operation capabilities, reducing operator fatigue and enhancing safety by enabling machines to navigate and perform tasks with improved awareness of their environment.

Implementation Method 1

a machine mounted stereo imaging apparatus configured to provide a 3-D model indicative of a terrain feature

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS7865285B2Machine control system and method
Publication Date: 2011.01.04 CATERPILLAR INC
  • US7865285B2 patent drawing
  • US7865285B2 patent drawing
  • US7865285B2 patent drawing

AI summary

A machine control system may include a machine mounted stereo imaging apparatus configured to provide a 3-D model indicative of a terrain feature. The machine control system may also include a control module configured to process the 3-D model, and automatically perform an operation with a work tool based on the characteristics of the 3-D model.