UAV Bifocal Camera Image Processing for Accurate Picture-in-Picture Display

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing methods for bifocal cameras on UAVs, such as side-by-side and picture-in-picture displays, suffer from inaccuracies due to differences in field of view (FOV) between infrared thermal imaging and visible light lenses, leading to suboptimal image presentation for flight users, particularly affecting measurement accuracy.

Innovation Solution

An image processing method and apparatus that acquires images from both lenses, determines current FOV information, and calculates target display information to achieve accurate picture-in-picture displaying in real scene proportions, dynamically adjusting for changes in lens parameters like FOV and image resolution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If side-by-side displaying is used for bifocal camera images, then both infrared thermal image and visible light image can be displayed, but the visible light image must be downscaled due to large FOV difference, resulting in poor image presentation effect

Engineering Contradiction:
Improveimage presentation accuracyVSAvoidimage display quality
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent implements picture-in-picture displaying where one image is nested within another, with the infrared thermal image displayed in a smaller window overlaid on the visible light image. This nesting approach allows both images with different FOV to be displayed simultaneously without requiring downscaling, thereby maintaining image quality while enabling dual-display functionality.

Inventive Principle:
Principle #7Nested doll (Nesting)

2Ease of operation

If picture-in-picture displaying is used, then one image can be displayed in full screen, but the other image is displayed in a very small window, making it suitable only for simple preview and not for accurate measurement

Engineering Contradiction:
Improvedisplay flexibilityVSAvoidmeasurement accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces dynamic switching capability that allows users to switch between picture-in-picture mode for preview and full-screen mode for accurate measurement. The system can dynamically adjust the display mode based on operational requirements, enabling both simple preview and accurate measurement functions to be fulfilled by the same bifocal camera system.

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If conventional picture-in-picture displaying is used, then display flexibility is improved, but the displaying manner cannot maintain real scene proportion due to lens parameter changes, causing inconsistent picture stacking proportion

Engineering Contradiction:
Improvedisplay mode flexibilityVSAvoidpicture stacking proportion accuracy
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent implements a feedback mechanism where the system acquires FOV information from both lenses and uses this information to dynamically adjust the display parameters. By continuously monitoring lens parameters and adjusting the picture-in-picture display proportion accordingly, the system maintains accurate real scene proportion representation even when lens parameters change, ensuring consistent picture stacking proportion.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12126938B2Image processing method and apparatus, device and storage medium
Publication Date: 2024.10.22 AUTEL ROBOTICS CO LTD
  • US12126938B2 patent drawing
  • US12126938B2 patent drawing
  • US12126938B2 patent drawing

AI summary

Embodiments of the present invention discloses an image processing method and apparatus, a device and a storage medium. The method includes: acquiring a first image and a second image, where the first image and the second image are respectively captured and transmitted by a first lens and a second lens disposed on an unmanned aerial vehicle (UAV); acquiring current field of view (FOV) information of the first lens and the second lens; and determining target display information of the second lens according to the FOV information and datum display information set for the first lens.