Surround View Camera Control for Work Vehicles
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Self-propelled work vehicles, such as excavators and loaders, face limited operational awareness due to restricted views from the operator cab, especially when work implements obstruct the view of external objects, and existing camera systems require manual selection and are limited in providing a comprehensive 360-degree view or manipulating image size and distortion.
Innovation Solution
A control system that allows natural touch gestures on a touch screen to manipulate surround view camera images, enabling automatic changes in the region of interest and distortion based on detected functions, work conditions, and obstacle detection, providing intuitive and dynamic visualization of the vehicle's surroundings.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional camera systems are used to provide surround view, then the operator can see the surroundings of the vehicle, but the view is limited to predetermined camera locations and requires manual selection of images
Solution Approach 1:
The system dynamically adjusts the displayed camera view based on the work implement's position and orientation. The controller automatically selects and switches between camera images according to real-time operational conditions, eliminating the need for manual image selection while providing adaptable views that match the current work context
Solution Approach 2:
The system uses feedback from sensors detecting the work implement's position and orientation to automatically determine which camera view should be displayed. This closed-loop control allows the display to adaptively respond to changing operational conditions without requiring manual intervention from the operator
2Ease of operation
If fixed camera positions are used for surround view, then the system structure is simple, but the operator cannot view smaller sections or manipulate the shape and size of the image
Solution Approach 1:
The system uses a fixed set of cameras positioned at standard locations on the vehicle, but these cameras serve multiple functions by displaying different portions of their captured images on the screen. Through software control, the same physical camera system can provide various views including zoomed-in sections, different aspect ratios, and selective region displays, eliminating the need for additional cameras while maintaining operational flexibility
3Loss of information
If the operator cab provides direct observation, then the setup is simple, but the view of external objects is substantially limited, especially when work implements obstruct the view
Solution Approach 1:
The system introduces cameras and a display screen as intermediary devices that capture and present visual information about the surroundings. These intermediaries compensate for the operator's limited direct line of sight by providing electronic views of areas that would otherwise be obscured by the vehicle structure or work implements
Solution Approach 2:
The surround view is divided into multiple discrete camera perspectives, each capturing a specific sector of the environment. The system can selectively display individual camera feeds or combine them to show different composite views, allowing the operator to focus on specific areas of interest without being overwhelmed by a complete 360-degree view
Data Source
AI summary
A self-propelled work vehicle is provided with a control system enabling the use of gestures on a touch screen interface to provide a simple and intuitive way to manipulate displayed images, and/or automatically changing a region of interest of a surround view camera unit. Exemplary automatic manipulation may be implemented if a work vehicle is detected as performing a certain function, wherein surround view images can automatically change to a smaller sub-view which gives more focused visibility appropriate to that function. The distortion and simulated field of view of surround view images may also/otherwise be automatically manipulated based on a detected operation/function. The control system can also/otherwise dynamically modify surround view images in accordance with a detected work state, and/or based on outputs from an obstacle detection system. The control system can also/otherwise lock the sub-view to recognized objects of interest, such as trucks or trenches.