UAV Image Display Control Based on Operator Visual Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing display control systems for unmanned aerial vehicles (UAVs) either constantly present aerial vehicle photographing images to operators, obstructing their vision, or fail to provide necessary visual feedback when the operator cannot see the UAV, compromising safety.
Innovation Solution
A display control system that acquires aerial vehicle photographing images, determines the operator's visual recognition of the UAV using sensing data, and dynamically controls the display state of the image on a head-mounted display, including size and visibility, based on this determination, to ensure optimal operator awareness without visual obstruction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If aerial vehicle photographing image is always displayed to operator, then operator can grasp surroundings situation, but operator's eyesight is blocked
Solution Approach 1:
The display control system dynamically adjusts the display state of aerial vehicle photographing images based on real-time detection of operator's visual recognition status. When the operator cannot visually recognize the unmanned aerial vehicle, the system displays the photographing image; when the operator can visually recognize the vehicle, the system suppresses or reduces the display. This dynamic adaptation resolves the contradiction by making the display state contingent on operational context rather than static.
Solution Approach 2:
The system uses sensing data to detect whether the operator can visually recognize the unmanned aerial vehicle and uses this feedback to control the display state of photographing images. This closed-loop feedback mechanism ensures that information display is optimized based on actual operator needs, preventing vision obstruction while maintaining situational awareness.
2Object-affected harmful factors
If aerial vehicle photographing image is suppressed when operator can visually recognize UAV, then operator's vision is not blocked, but operator loses situational awareness when visual recognition is impaired
Solution Approach 1:
The system dynamically switches between different display states based on the operator's visual recognition capability. When visual recognition is possible, the system suppresses the photographing image display to avoid obstruction. When visual recognition fails, the system activates the display to provide situational awareness. This dynamic response ensures optimal balance between vision clarity and information availability.
Solution Approach 2:
The display control means receives feedback from sensing data about the operator's visual recognition status and adjusts the photographing image display accordingly. This feedback-driven control ensures that the operator maintains situational awareness only when necessary, avoiding unnecessary vision obstruction while preserving critical information access.
3Loss of information
If head-mounted display is worn by operator, then operator can see aerial vehicle photographing image, but operator cannot visually recognize UAV with naked eyes
Solution Approach 1:
The system dynamically controls the display state of the head-mounted display based on whether the operator needs visual assistance. When the operator can visually recognize the UAV with naked eyes, the system suppresses or reduces the photographing image display on the head-mounted display. When visual recognition is impaired, the system activates the display. This dynamic control allows the operator to switch between naked-eye viewing and head-mounted display viewing as needed.
Solution Approach 2:
The display control means uses sensing data to detect the operator's visual recognition status and provides feedback to control the head-mounted display output. This feedback mechanism ensures that the head-mounted display supplements rather than replaces the operator's natural vision, allowing flexible switching between viewing modes based on operational conditions.
Data Source
AI summary
Provided are a display control system, a display control device, and a display control method, which are capable of appropriately controlling a display state of an image photographed by a camera included in an unmanned aerial vehicle. A sensing data acquisition module acquires an aerial vehicle photographing image photographed by the camera included in the unmanned aerial vehicle in flight. A determiner determines whether an operator of the unmanned aerial vehicle is able to visually recognize the unmanned aerial vehicle based on sensing data on at least one of the unmanned aerial vehicle or the operator. A display controller controls a display state of the aerial vehicle photographing image on a display depending on a result of determination by the determiner.