Composite Front Image Generation for Wheel Loader Blind Zone Elimination
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Heavy equipment, such as wheel loaders, often have obstructed front views due to large parts like buckets, leading to reduced work efficiency and increased safety risks.
Innovation Solution
A front image generation device for heavy equipment that uses multiple cameras (upper and lower) to capture images and an image processor to composite these images, creating a clear and unobstructed front view by making the bucket appear translucent when it blocks the view.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a single camera is used to capture the front view, then the device complexity is low, but the front view is blocked by the bucket leading to blind zones
Solution Approach 1:
The front view is divided into multiple segments captured by different cameras (upper camera capturing upper front view, lower camera capturing lower front view). These segmented views are then composited to form a complete unobstructed front image, resolving the blocking issue while maintaining manageable system complexity through modular camera placement.
Solution Approach 2:
The solution transitions from a single-viewpoint (2D) camera to a multi-viewpoint (3D spatial) camera arrangement. By positioning cameras at different vertical dimensions (upper and lower positions), the system captures images from multiple spatial perspectives and composites them to eliminate blind zones.
2Loss of information
If multiple cameras are used to capture different front views, then blind zones are minimized, but the device complexity increases
Solution Approach 1:
The image processor acts as an intermediary that receives images from multiple cameras, performs compositing operations, and generates the final unified front image. This intermediary component manages the complexity of processing multiple image sources while presenting a simplified single-view output to the user.
Solution Approach 2:
Multiple images captured from different camera positions are merged into a single composite front image. The image processor combines the upper front image and lower front image by compositing techniques, integrating multiple information sources into one unified view that eliminates blind zones.
3Reliability
If the bucket is made opaque for safety, then the bucket structure is simple, but the driver cannot see through the bucket during operation
Solution Approach 1:
The composite front image dynamically adjusts the visual representation of the bucket by changing its transparency properties. When the bucket blocks the target, it is represented in a translucent or transparent state in the composite image, allowing the driver to see through it while maintaining awareness of the bucket's position and status.
Solution Approach 2:
The bucket representation in the composite image is dynamic rather than static. The transparency of the bucket changes based on operational conditions - it appears opaque when not blocking the view and becomes translucent when blocking the target, providing adaptive visual information that enhances both safety and operability.
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
Disclosed is a front image generation device for heavy equipment, which generates a composite front image by using two or more cameras. The front image generation device includes: an upper camera disposed on a wheel loader and configured to generate a first front image; a lower camera disposed on the wheel loader and configured to generate a second front image; an image processor configured to generate a composite front image by compositing the first front image and the second front image; and a display configured to display the composite front image generated by the image processor.