Bird's-Eye View Camera System for Construction Machine Visibility

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Self-propelled construction machines, such as road milling machines and surface miners, face restricted visibility due to their transport devices extending beyond the machine frame, limiting the operator's field of view and making it difficult to detect objects hidden by the transport device.

Innovation Solution

A camera system with cameras positioned on the transport device and the machine frame, providing overlapping image areas that are combined by an image processing system to create a bird's-eye view, allowing the operator to see the entire area around the machine, including sections covered by the transport device, through cameras with viewing directions directed towards and away from the machine frame.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a transport device is extended beyond the machine frame to convey removed material, then the material transport capability is improved, but the operator's field of view is restricted and objects hidden by the transport device cannot be detected

Engineering Contradiction:
Improvematerial transport capabilityVSAvoidobject detection capability
Core Design Contradiction:
ProductivityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent introduces cameras as intermediary devices to capture images of areas obscured by the transport device. These cameras act as mediators between the operator and the hidden areas, transmitting visual information through the image display device so the operator can see objects that would otherwise be blocked by the extended transport device.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical limitation of direct visual observation with an optical-electronic system. Instead of relying on the operator's direct line of sight, which is mechanically blocked by the transport device, the system uses cameras and image processing to substitute the blocked mechanical viewing path with an electronic imaging path.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Loss of information

If multiple cameras are positioned on the transport device and machine frame with different viewing directions, then complete coverage of surrounding areas is achieved, but the device complexity increases

Engineering Contradiction:
Improvesurroundings coverage completenessVSAvoidcamera system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent divides the surveillance task into multiple segments by positioning cameras at different locations (transport device and machine frame) with different viewing directions. Each camera captures a specific segment of the surrounding area, and the image processing device combines these segmented views into a complete overview, reducing information loss without requiring a single complex camera system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a multi-functional camera system where cameras serve multiple purposes: monitoring areas obscured by the transport device, providing overall surroundings coverage, and enabling the operator to see both near and far areas. The image display device integrates these multiple functions into a single comprehensive view, making the system universally applicable for all viewing needs.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If cameras are positioned to capture overlapping image areas, then complete all-round view is achieved, but the image processing complexity increases

Engineering Contradiction:
Improveoperator's all-round view capabilityVSAvoidimage processing system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent merges multiple overlapping image areas captured by different cameras into a single integrated all-round view. The image processing device combines the overlapping fields of view from cameras positioned on both the transport device and machine frame, creating a unified comprehensive image that provides the operator with complete surrounding awareness.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentEP3135822B1Self-propelled construction machine and method for displaying the area surrounding same
Publication Date: 2020.12.16 WIRTGEN GMBH
  • EP3135822B1 patent drawingFigure 1
  • EP3135822B1 patent drawingFigure 2
  • EP3135822B1 patent drawingFigure 3

AI summary

The invention relates to a self-propelled construction machine with a transport device 10 extending beyond the machine frame 2 in the working direction A, in particular a road milling machine or surface miner. Furthermore, the invention relates to a method for displaying an image of the surroundings of a self-propelled construction machine. The construction machine according to the invention has an image display device 17 for displaying a bird's-eye view image of the surroundings of the construction machine, which comprises a camera system 18 with several cameras 18A, B, C, D for capturing individual overlapping image areas 20A, 20B, 20C, 20D of the construction machine's surroundings from different image acquisition positions, and an image processing system 19. The image processing system 19 is configured such that image sections of the individual image areas 20A, 20B, 20C, 20D are combined to form a complete image 27 in a bird's-eye view.The camera system 18 comprises at least one camera 18D, 18D', 18D", which is arranged on the transport device 10 such that the camera's viewing direction is directed towards the machine frame 2, and at least one further camera 18A, 18B, 18C which is arranged on the machine frame 2 such that the camera's viewing direction is directed away from the machine frame 2. With the cameras directed into and away from the machine frame, the machine operator has a complete all-round view that includes the area covered by the transport device in the working direction in front of the construction machine.