3D Field Visualization for Agricultural Machine Operator Assistance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for operating self-propelled agricultural working machines struggle to provide users with accurate and readily available information about the properties of the area in front of the machine, particularly the position of crop edges, limiting user influence on control actions.

Innovation Solution

The method processes sensor information from a laser-based sensor system and presents it graphically to the user as a three-dimensional display image or sequence, allowing users to easily derive essential field information and initiate corrective measures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If sensor-based monitoring is implemented to detect properties of the machine's surroundings, then the availability of field information is improved, but the complexity of processing and presenting this information to the user increases

Engineering Contradiction:
Improveavailability of field informationVSAvoidcomplexity of processing and presenting information
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system creates a virtual copy of the real-world apron area by generating a three-dimensional display image from sensor data. This virtual representation allows users to interact with and analyze field information in a simplified digital environment rather than processing raw sensor data directly, thereby reducing information loss while maintaining manageable system complexity

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The image processing system acts as an intermediary between the laser-based sensor system and the user. It transforms complex sensor information into intuitive three-dimensional visualizations, serving as a mediator that converts raw data into comprehensible field information without requiring the user to directly handle complex sensor processing

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If detailed sensor information is processed to accurately identify crop edge positions, then the precision of field information is improved, but the time required to process and present this information increases

Engineering Contradiction:
Improveaccuracy of crop edge positionVSAvoidtime to process and present information
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary processing of sensor information by continuously generating three-dimensional display images of the apron area before the machine reaches critical positions. This allows crop edge positions to be identified and analyzed in advance, maintaining high measurement precision while reducing the time pressure during critical operating moments

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system transforms two-dimensional sensor data into three-dimensional display images, adding a spatial dimension to the representation. This dimensional enhancement allows for more accurate crop edge position identification through visual depth perception while maintaining efficient processing through automated image generation algorithms

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If the user needs to closely monitor the area in front of the machine to accurately perceive field information, then the accuracy of information perception is improved, but the ease of operation deteriorates due to the need for close monitoring

Engineering Contradiction:
Improveaccuracy of information perceptionVSAvoidcomfort of user position
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system creates a virtual three-dimensional copy of the apron area that can be displayed on screens positioned within the operator's comfortable viewing range. This virtual copy preserves all essential spatial information about crop edges and field properties, allowing accurate information perception without requiring the user to physically position themselves close to the machine

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The display system serves as an intermediary that delivers detailed field information to the user's location. Instead of requiring the user to be close to the physical apron area to perceive details, the intermediary display system brings the detailed information to the user's comfortable position, maintaining both accuracy and ease of operation

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables users to perceive essential field information from a comfortable position, facilitating early detection of critical information and allowing for timely corrective actions, thereby improving the efficiency and accuracy of agricultural operations.

Implementation Method 1

a laser-based sensor system (11)

Methodology Applied
Scientific EffectLaser: Laser

Implementation Method 2

The laser-based sensor system detects properties of the field, also referred to as field information, based on the sensor information from the sensor system

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentEP3732950B1Method for operating a self-propelled agricultural working machine
Publication Date: 2025.06.18 CLAAS SELBSTFAHRENDE ERNTEMASCHINEN GMBH
  • EP3732950B1 patent drawingFigure 1
  • EP3732950B1 patent drawingFigure 2
  • EP3732950B1 patent drawingFigure 3

AI summary

The invention relates to a method for operating a self-propelled agricultural machine (1), in particular a harvesting machine, wherein the agricultural machine (1) has at least one working element (2-8) for carrying out or supporting agricultural work in a field, wherein the agricultural machine (1) has a driver assistance system (9) for generating control actions within the machine (1), wherein the driver assistance system (9) has a sensor arrangement (10) for generating foreground information, wherein the driver assistance system (9) generates the control actions based on the foreground information, wherein the sensor arrangement (10) has a laser-based sensor system (11) that generates sensor information about a predetermined, relevant foreground area (13) of the machine (1).It is proposed that the driver assistance system (9) includes an image processing system (14) for processing the sensor information and that the image processing system (14) generates a display image (A) or a display image sequence in the form of a three-dimensional visualization of the predetermined, relevant area in front of the working machine (13) on a display (15) of the driver assistance system (9) based on the sensor information of the laser-based sensor system (11).