Agricultural Machine Camera Synthetic Image Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Agricultural machines face issues with inaccurate control due to uncertainty in estimating actual values from image data, leading to potential errors in machine operation, especially when visibility is poor or when movable components experience disturbances, resulting in impurities in harvested crops and reduced revenue.
Innovation Solution
An agricultural machine equipped with a camera, display screen, and image processing unit that generates a synthetic image by overlaying raw images with stored three-dimensional coordinates of machine components, allowing for immediate recognition of position deviations and disruptions, thereby facilitating corrective actions or machine shutdown to prevent incorrect operation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If image data is used to estimate actual values for controlling machine parameters, then automation level increases, but measurement precision deteriorates due to uncertainty in image evaluation
Solution Approach 1:
A display image is introduced as an intermediary between the camera system and the operator. This display image includes a synthetic representation of the machine component with indicated actual position, bridging the gap between automated image capture and precise human interpretation, thereby maintaining high automation while improving measurement precision through visual feedback
Solution Approach 2:
The system provides visual feedback by displaying the actual position of machine components based on image evaluation. This feedback loop allows the operator to verify and correct position estimates, improving measurement precision while maintaining automation through continuous monitoring and adjustment
2Device complexity
If image evaluation is performed to determine component position, then device complexity is reduced, but reliability deteriorates under poor visibility conditions such as dust
Solution Approach 1:
The display image serves as an intermediary that enhances the reliability of image evaluation under poor visibility conditions. By providing a processed visual representation with indicated component positions, it helps the operator compensate for dust and other visibility issues without adding complex hardware solutions
Solution Approach 2:
The synthetic image in the display uses color differentiation to highlight machine components and their positions. This visual enhancement allows the operator to distinguish components more easily under poor visibility conditions, improving reliability without increasing device complexity
3Ease of operation
If the actual position of movable components is not accurately monitored, then ease of operation is maintained, but manufacturing precision deteriorates due to undetected position deviations
Solution Approach 1:
The display provides continuous visual feedback on the actual position of movable components. This feedback enables the operator to maintain ease of operation while ensuring manufacturing precision, as position deviations become immediately visible and can be corrected without complicating the operating procedure
Solution Approach 2:
The display image acts as an intermediary between the machine's actual state and the operator's perception. It translates complex position data into visual information that is easy to interpret, maintaining ease of operation while improving manufacturing precision through enhanced position monitoring
Data Source
Figure 1
Figure 2~3
AI summary
In an agricultural machine (1) comprising a machine component (2), a camera (12) directed at the machine component (2, 3, 5, 11), a display screen (18), and an image processing unit (14) connected to the camera (12) and the display screen (18) to display images of the machine component (2, 3, 5, 11) based on raw images supplied by the camera (12), the image processing unit (14) is configured to generate a synthetic image (20, 22, 23, 24, 27, 28) of the machine component (2, 3, 5, 11) and to obtain the display image by superimposing a raw image with the synthetic image (20, 22, 23, 24, 27, 28).