Nested Colourmap Algorithm for See-Through Thermal Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies fail to effectively display thermal images on see-through displays, particularly for firefighting applications, as they struggle to balance detail perception and temperature perception while maintaining image quality across varying lighting conditions and being non-obtrusive.
Innovation Solution
A method involving a nested colourmap algorithm that processes thermal images into two separate colourmaps for detail and temperature perception, combined with automatic gain and brightness control, to enhance contour and temperature visibility on see-through displays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If thermal images are displayed on see-through displays using standard LCD screen processing, then the display technology is simple and well-understood, but the thermal images are very faintly perceived and detail perception is poor
Solution Approach 1:
The patent segments the thermal image processing into multiple enhancement stages including histogram equalisation, contrast enhancement, and edge detection. This segmentation allows each processing stage to be optimised independently, improving overall thermal image perception quality while making the complex processing more manageable and systematic.
Solution Approach 2:
The patent applies preliminary image processing enhancements before display, including pre-computing histogram equalisation and contrast adjustment. This preliminary action ensures that thermal images are optimised for see-through display conditions in advance, improving perception quality without adding real-time processing complexity during critical moments.
2Measurement precision
If thermal images are displayed with enhanced detail perception, then contour visibility is improved, but temperature perception and metric value accuracy deteriorate
Solution Approach 1:
The patent applies local quality enhancement by using multi-resolution analysis and selective contrast enhancement. Different regions of the thermal image receive different processing intensities - high-contrast enhancement for contour detection in critical areas while preserving temperature gradient information in other regions. This allows simultaneous improvement of detail perception and temperature perception through spatially varying processing quality.
3Loss of information
If the display adds non-visible thermal information, then information completeness is improved, but obtrusiveness increases and real-world visual access is blocked
Solution Approach 1:
The patent implements dynamic display characteristics that adapt to environmental conditions and user needs. The see-through display dynamically adjusts thermal image opacity, contrast, and enhancement levels based on ambient lighting conditions, detected scene complexity, and user interaction patterns. This dynamic adaptation ensures thermal information is added without permanently blocking real-world visual access, resolving the contradiction between information completeness and ease of visual operation.
Solution Approach 2:
The patent changes display parameters such as luminance, contrast, and transparency dynamically. By adjusting these parameters based on ambient conditions and thermal image content, the system maximises thermal information visibility while minimising obstruction of the real-world view through the see-through display.
4Adaptability or versatility
If the display adapts to different lighting conditions, then adaptability is improved, but device complexity and control mechanisms increase
Solution Approach 1:
The patent implements feedback mechanisms where the display system continuously monitors ambient lighting conditions, thermal image content, and user interaction patterns. This feedback drives automatic adjustment of display parameters including luminance, contrast, and enhancement levels. The feedback loop enables adaptability to different lighting conditions without requiring complex manual control systems, as the system self-adjusts based on sensed environmental and usage parameters.
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
The present invention concerns a method of displaying an image on a see-through display. The method comprises: obtaining (101) a first electromagnetic radiation matrix of an object, the first matrix comprising first matrix elements representing radiation intensity values of corresponding locations of the object; dividing (103) the first matrix into a second matrix representing a first subset of the radiation intensity values of the matrix elements, and a third, different matrix representing a second, different subset of the radiation intensity values of the matrix elements; generating (105) a first histogram for the second matrix; equalising (107) the first histogram to obtain an equalised second histogram; generating (109) a first grayscale image representing the first subset of the radiation intensity values from the second matrix and the equalised second histogram; colouring (111) the first grayscale image with a first colourmap to obtain a first colour image; generating (113) a second grayscale image representing the second subset of the radiation intensity values image by mapping substantially linearly the second subset of the radiation intensity values to a given number of encoded radiation intensity values; colouring (115) the second grayscale image with a second colourmap, which is different from the first colourmap, to obtain a second colour image; combining (117) the first colour image and the second colour image to obtain a combined colour image; and displaying (123) the combined colour image on the see-through display.