Construction Machinery Camera Blind Spot Removal

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Construction machinery, such as wheel loaders and excavators, face safety issues due to obstructed forward visibility caused by work apparatus like buckets and booms, which limit the operator's view and increase the risk of accidents.

Innovation Solution

A control system incorporating upper and lower cameras to capture images, a work apparatus posture detection system, and an image processing unit that synthesizes and transparency-processes these images to create a clear view on a display device, removing blind spots obscured by the work apparatus, allowing operators to maintain stability and safety.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a work apparatus (bucket, boom) is installed in construction machinery to perform excavation and loading work, then the work capability and productivity are improved, but the operator's front view is obstructed and safety is compromised

Engineering Contradiction:
Improvework capabilityVSAvoidsafety
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent introduces cameras as intermediary devices to capture the forward view that is obstructed by the work apparatus. The cameras are positioned to photograph areas blocked by the bucket and boom, and the captured images are displayed on a monitor to provide the operator with indirect visual information about the forward environment, thus mediating between the obstructed view and the operator's need for visibility

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transitions from direct optical viewing (three-dimensional spatial view) to electronic image display (two-dimensional planar view). By converting the obstructed three-dimensional forward view into two-dimensional images displayed on a monitor, the system allows the operator to see around the work apparatus from an alternative dimensional perspective that is not limited by the physical obstruction

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If the work apparatus is positioned to invade a predetermined position (blocking the view), then the work range and flexibility are improved, but the blind spot increases and safety decreases

Engineering Contradiction:
Improvework rangeVSAvoidblind spot
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system performs preliminary action by capturing images with cameras positioned to cover areas that will be obscured by the work apparatus before the apparatus moves into the obstructing position. The images are processed and displayed in advance, allowing the operator to maintain awareness of the environment even when the work apparatus subsequently blocks the direct view

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies local quality by selectively transparency-processing specific regions of the displayed image corresponding to areas obscured by the work apparatus. Instead of uniformly processing the entire image, only the local regions that are blocked by the bucket or boom are transparency-processed, preserving the natural appearance of visible areas while compensating for obstructed areas

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP3848516B1System and method for controlling construction machinery
Publication Date: 2023.03.08 HD HYUNDAI INFRACORE CO LTD
  • EP3848516B1 patent drawingFigure 1
  • EP3848516B1 patent drawingFigure 2
  • EP3848516B1 patent drawingFigure 3

AI summary

A control system for construction machinery (10) includes an upper camera (110) installed in a driver cabin (40) to photograph the front of the driver cabin, a lower camera (120) installed in a vehicle body to photograph the front of the vehicle body, a work apparatus posture detection portion configured to detect a posture of the work apparatus connected rotatably to the vehicle body, an image processing portion (200) configured to synthesize first and second images captured from the upper camera and the lower camera into one image, and configured to transparency-process at least one of the first and second images in the synthesized image according to the posture of the work apparatus detected by the work apparatus posture detection portion, and a display device (300) configured to display the synthesized image transparency-processed by the image processing portion.