Construction Machinery Camera Fusion for Blind Spot Transparency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Construction machinery such as wheel loaders and excavators face safety issues due to obstruction of the operator's forward view by the work apparatus, which can lead to accidents.
Innovation Solution
A control system with an upper and lower camera system, image processing device, and display device that synthesizes images to create a transparency-processed view, allowing the operator to see around the work apparatus by transparency-processing areas based on the steering angle and posture of the work apparatus.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the work apparatus is installed in the construction machinery to perform excavation and loading operations, then the productivity and functionality of the machinery is improved, but the operator's forward visibility is obstructed which can cause safety accidents
Solution Approach 1:
The patent introduces cameras as intermediary devices to capture the forward view that is obstructed by the work apparatus. These cameras are positioned to photograph areas blocked by the boom and bucket, and the captured images are displayed on a display device to provide the operator with visual information about the forward area, thus mediating the visibility problem without removing the work apparatus
Solution Approach 2:
The patent creates a visual copy of the obstructed forward area by using cameras to photograph the scene and displaying the images on a screen. This optical copy allows the operator to see the forward area indirectly through the display device, effectively replicating the visual experience of having direct line-of-sight without the physical obstruction
2Object-affected harmful factors
If transparency processing is applied to the synthesized image to improve visibility around the work apparatus, then the operator's visibility is enhanced, but the image processing complexity increases
Solution Approach 1:
The patent applies transparency processing selectively to specific regions of the synthesized image rather than the entire image. The image processing device identifies areas where the work apparatus obstructs the view and applies transparency processing only to those local regions, thereby improving visibility where needed while minimizing the overall processing complexity and computational load
Data Source
AI summary
A control system for construction machinery includes an upper camera installed in a driver cabin in a rear body to photograph the front of the driver cabin, a lower camera installed in a front body rotatably connected to the rear body to photograph the front of the front body, an image processing device configured to synthesize first and second images captured from the upper camera and the lower camera into one image, and configured to detect a shape of a front work apparatus in the first image to determine a steering angle of the front body and determine a position of a transparency processing area in which at least one of the first and second images is transparency-processed in the synthesized image according to the steering angle, and a display device configured to display the synthesized image transparency-processed by the image processing device.