Augmented Reality Implement View for Obscured Work Vehicles
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Work vehicles with obscured work implements complicate effective material handling due to obstructed views from the operator's perspective, hindering accurate manipulation.
Innovation Solution
A system comprising a camera array, operator gaze detection, and image processing to generate an augmented view on a display, providing a clear line-of-sight of the obscured implement and its environment from the operator's perspective.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If the operator uses the vehicle's existing view to manipulate the implement, then the operator can see the vehicle's controls and cabin, but the implement and its operating environment are obscured from view
Solution Approach 1:
The patent introduces cameras as intermediary devices mounted on the vehicle to capture images of the implement and its environment. These cameras act as mediators between the implement and the operator, transmitting visual information without requiring the operator to physically position themselves for direct viewing. The captured images are then processed and displayed to compensate for the obscured view.
Solution Approach 2:
The system creates a visual copy of the implement and its operating environment through camera imaging. Instead of requiring direct line-of-sight viewing, the system generates image copies that represent the actual state of the implement, allowing the operator to view these copies on displays within the cabin. This copying approach enables viewing of obscured areas without physical repositioning.
2Ease of operation
If the operator positions themselves to see the implement, then the implement becomes visible, but the operator cannot simultaneously monitor vehicle controls and maintain proper operating position
Solution Approach 1:
The patent replaces the mechanical requirement for operator physical positioning with an electronic imaging and display system. Instead of the operator needing to move their body to different positions to see different areas, the system uses cameras and displays to electronically present visual information from multiple perspectives, allowing the operator to remain in a fixed, ergonomically optimal position while maintaining comprehensive awareness.
Solution Approach 2:
The imaging system serves multiple functions simultaneously: it captures the implement's position and environment, provides real-time visual feedback to the operator, and allows monitoring from a fixed operator position. The system consolidates multiple viewing requirements into a single integrated solution that supports both implement visualization and overall situational awareness without requiring the operator to switch between different physical positions.
3Object-affected harmful factors
If the vehicle structure is designed to protect the operator, then safety is improved, but the vehicle components obscure the implement from the operator's view
Solution Approach 1:
The camera system acts as an intermediary that bridges the gap created by protective vehicle structures. The cameras are positioned on the vehicle exterior where they can capture images of the implement without compromising the protective enclosure of the operator's cabin. These images are then transmitted to displays inside the protected cabin, allowing the operator to view the implement while remaining protected within the vehicle structure.
Data Source
AI summary
One or more techniques and/or systems are disclosed for improvements to a work vehicle that utilizes an implement that may be partially obscured from operator view during use. A camera array can be mounted to the vehicle to generate image data for the working environment of the implement and target object of the implement. Further, a gaze direction and position for the vehicle operator can be detected using a second camera array. The implement image data and operator image data can be combined to generate an augmented image for display in the line of sight of the operator. The augmented image comprises computer generated representations of the implement where it is obscured from view, along with the target object. In this way, the operator can effectively interact with the target object, even though the implement and object may be out of direct sight of the operator.