Pseudo-color implementation method, infrared thermal imaging device and storage medium

Abstract

Provided in the embodiments of the present application are a pseudo-color implementation method, an infrared thermal imaging device and a storage medium. The pseudo-color implementation method comprises: acquiring display setting information of thumbnail windows to be selected in a pseudo-color selection interface, wherein the display setting information comprises the number and arrangement of said thumbnail windows; according to the display setting information, determining a coordinate mapping relationship and pseudo-color plate attributes, which correspond to the positions of said thumbnail windows in the pseudo-color selection interface; acquiring real-time image data; and according to the coordinate mapping relationship, respectively displaying the real-time image data in said thumbnail windows, and according to the pseudo-color plate attributes, respectively presenting corresponding pseudo-color effects on the real-time image data in said thumbnail windows.

Description

Pseudo-color realization method, infrared thermal imaging device and storage medium Technical Field

[0001] The present application relates to the field of image technology, and in particular to a pseudo-color implementation method, an infrared thermal imaging device, and a computer-readable storage medium. Background Art

[0002] With the development of infrared technology, infrared thermal imaging equipment is widely used in various industries. Traditional infrared thermal imaging equipment often displays real-time images in black and white, which makes it unable to meet the needs of some application scenarios. To enrich the image effect, with the development of technology, infrared thermal imaging equipment has gradually been introduced. After acquiring the raw data, it can perform different color mapping on the raw data according to different pseudo-color plates, so that the image can present different pseudo-color effects.

[0003] Currently known pseudo-color effects are implemented by displaying multiple pre-set pseudo-color renderings of multiple images in different pseudo-color settings through a pseudo-color selection interface. Users need to select and preview each of the renderings in the pseudo-color selection interface one by one, and then select the pseudo-color effect corresponding to a specific rendering to perform the same pseudo-color processing on the image currently captured by the infrared thermal imaging device. However, in this pseudo-color implementation method, users can only select based on the pseudo-color renderings of multiple pre-set fixed images. What they see is not what they get, which makes it difficult for users to determine which pseudo-color effect is more suitable for the currently captured image. Secondly, the current presentation of different pseudo-color renderings requires a separate set of image data. When this implementation method is also applied to video data, the computational complexity is too large, making it impossible to meet the requirements of real-time scene changes. Technical issues

[0004] In order to solve the existing technical problems, the present application provides a pseudo-color implementation method, infrared thermal imaging equipment and computer-readable storage medium that effectively reduces the amount of calculation and can present a pseudo-color effect of real-time scene changes to facilitate the selection of pseudo-color effects. Technical Solutions

[0005] According to a first aspect of an embodiment of the present invention, a pseudo-color implementation method is provided, comprising:

[0006] Obtaining display setting information of thumbnail windows to be selected in the pseudo-color selection interface; the display setting information includes the number and arrangement of the thumbnail windows to be selected;

[0007] Determining, according to the display setting information, a coordinate mapping relationship and pseudo color palette attributes corresponding to the position of each of the to-be-selected thumbnail windows in the pseudo color selection interface;

[0008] Acquire real-time image data;

[0009] The real-time image data is displayed in each of the thumbnail windows to be selected according to the coordinate mapping relationship, and a corresponding pseudo-color effect is presented on the real-time image data in each of the thumbnail windows to be selected according to the pseudo-color plate attributes.

[0010] In a second aspect, an infrared thermal imaging device is also provided, comprising a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the pseudo-color realization method as described in any embodiment of the present application is implemented.

[0011] According to a third aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the pseudo-color realization method as described in any embodiment of the present application is implemented. Beneficial effects

[0012] The pseudo-color implementation method of the above embodiment determines the coordinate mapping relationship and pseudo-color plate attributes corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface according to the display setting information of the thumbnail window to be selected in the pseudo-color selection interface and the number and arrangement of the thumbnail windows to be selected, obtains real-time image data corresponding to the real-time transformation scene, displays the real-time image data in each thumbnail window to be selected according to the coordinate mapping relationship corresponding to each thumbnail window to be selected, and presents corresponding pseudo-color effects on the real-time image data in each thumbnail window to be selected according to the corresponding pseudo-color plate attributes. In this way, by determining the coordinate mapping relationship corresponding to the position of each of the thumbnail windows to be selected in the pseudo-color selection interface, the pseudo-color selection interface can use multiple thumbnail windows to share a copy of real-time image data, and display the real-time image data simultaneously in multiple thumbnail windows to be selected through coordinate mapping. On the one hand, it realizes the use of real-time image data to form a pseudo-color effect image and present it in the pseudo-color selection interface. What you see is what you get, which facilitates users to more intuitively and accurately judge and select the pseudo-color processing effect of the image data that is most suitable for the current scene from the multiple thumbnail windows to be selected in the pseudo-color selection interface; on the other hand, by using the coordinate mapping method, the multiple thumbnail windows to be selected in the pseudo-color selection interface can share a copy of real-time image data to present the corresponding pseudo-color effect images respectively, which greatly reduces the image data copying operation and effectively reduces the amount of calculation, so that it can better meet the pseudo-color processing requirements of video image data in real-time transformation scenes.

[0013] In the above embodiments, the infrared thermal imaging device and the computer-readable storage medium and the corresponding pseudo-color implementation method embodiments belong to the same concept, and thus have the same technical effects as the corresponding pseudo-color implementation method embodiments, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] FIG1 is a schematic diagram of an application scenario of a pseudo-color implementation method according to an embodiment;

[0015] FIG2 is a schematic diagram of an application scenario of a pseudo-color implementation method according to another embodiment;

[0016] FIG3 is a flow chart of a pseudo-color implementation method according to an embodiment;

[0017] FIG4 is a schematic diagram showing the principle of determining the coordinate mapping relationship corresponding to the position of the thumbnail window to be selected in the pseudo-color selection interface using the OpenGL rendering principle;

[0018] FIG5 is a schematic diagram of a pseudo-color selection interface in one embodiment;

[0019] FIG6 is a schematic diagram showing the principle of coordinate conversion using a coordinate mapping relationship in one embodiment;

[0020] FIG7 is a schematic diagram of various arrangements of thumbnail windows to be selected in one embodiment;

[0021] FIG8 is a flow chart of a pseudo-color implementation method in an optional specific example;

[0022] FIG9 is a schematic structural diagram of a pseudo-color implementation device according to an embodiment;

[0023] FIG10 is a schematic structural diagram of an infrared thermal imaging device in one embodiment. Modes for Carrying Out the Invention

[0024] The technical solution of the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0025] In order to make the purpose, technical solutions and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limiting this application. All other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0026] In the following description, the expression "some embodiments" is involved, which describes a subset of all possible embodiments. It should be noted that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict.

[0027] In the following description, the terms "first, second, and third" are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It is understandable that "first, second, and third" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0028] Please refer to FIG1 , which is a schematic diagram of an optional application scenario for the pseudo-color implementation method provided in an embodiment of the present application. The pseudo-color implementation method can be applied to an infrared thermal imaging device 10, which can be an intelligent device equipped with infrared image data acquisition capabilities and storage and computing capabilities, such as an infrared thermal imager, a handheld thermal imaging thermometer, an infrared aiming device, etc. The infrared thermal imaging device 10 can be loaded with a computer program that implements the pseudo-color implementation method provided in an embodiment of the present application. The device can display infrared image data collected by an infrared sensor 12 on a local display screen 11, as well as various application interfaces, such as a pseudo-color selection interface for simultaneously viewing multiple pseudo-color effects in real time, and a configuration interface for configuring or modifying the display settings of the thumbnail window to be selected in the pseudo-color selection interface. While using the infrared thermal imaging device 10 to capture a target scene, the user can browse thumbnails of real-time image data showing different pseudo-color effects in the pseudo-color selection interface and select the pseudo-color effect that best suits the image being captured. In the embodiment of the present application, the infrared thermal imaging device 10 is a handheld infrared device. In addition to being capable of capturing infrared image data, the handheld infrared device also captures white light image data and / or low light image data. The real-time image data may be infrared image data or a fusion of infrared image data with image data from other light sources, such as white light and / or low light. In this embodiment, the real-time image data primarily refers to infrared picture data or infrared video data.

[0029] Alternatively, referring to FIG. 2 , the infrared thermal imaging device 10 may be communicatively connected to a host computer 30, with the infrared thermal imaging device 10 and the host computer 30 cooperating, with the host computer 30 assisting in performing some data processing functions, to jointly implement the pseudo-color implementation method provided in the embodiments of the present application. For example, the host computer 30 may be loaded with a client program that implements the pseudo-color implementation method provided in the embodiments of the present application, and the host computer 30, through the client program, may provide a configuration interface for configuring or modifying the display settings of the selected thumbnail window in the pseudo-color selection interface. The user can configure or modify the display setting information such as the number and arrangement of the thumbnail windows to be selected in the pseudo-color selection interface through the host computer 30. The host computer 30 sends the display setting information to the infrared thermal imaging device 10, and the infrared thermal imaging device 10 presents thumbnails of real-time image data with different pseudo-color effects in the pseudo-color selection interface displayed on the local display screen 11 according to the display setting information configured by the user. This allows the user to directly browse the thumbnails of real-time image data with different pseudo-color effects presented in the pseudo-color selection interface while using the infrared thermal imaging device 10 to shoot the target scene, and select the pseudo-color effect that best suits the image shot for the current scene.

[0030] Please refer to FIG3 , which shows a pseudo-color implementation method provided in an embodiment of the present application, which can be applied to the infrared thermal imaging device shown in FIG1 or FIG2 . The pseudo-color implementation method includes the following steps:

[0031] S101, obtaining display setting information of thumbnail windows to be selected in a pseudo-color selection interface; the display setting information includes the number and arrangement of the thumbnail windows to be selected.

[0032] The pseudo color selection interface refers to an interface that displays thumbnails of different pseudo color effects in multiple thumbnail windows for user selection. The pseudo color selection interface can be the main interface or a sub-interface that is accessed by clicking a setting function button on the main interface.

[0033] Pseudo-color refers to the process in which the color of each pixel in an image is not directly determined by the numerical value of each basic color component. Instead, the pixel is treated as the entry address of a palette or color look-up table (CLUT). Based on this address, the actual R, G, and B intensity values ​​can be found. If the color in the image does not exist in the palette or color look-up table, the palette will use the closest color to match it. The color generated by the found R, G, and B intensity values ​​is not the true color of the image itself, so it is called pseudo-color. Different palettes or color look-up tables correspond to a pseudo-color plate. Pseudo-color processing refers to the technical process of converting grayscale images or multi-band images into color images using pseudo-color plates, with the goal of improving the recognizability of the image content. Images with different pseudo-color effects refer to images obtained by pseudo-color processing using different pseudo-color plates.

[0034] The thumbnail window to be selected refers to a window that displays an image after pseudo-color processing. In the present embodiment, a plurality of thumbnail windows to be selected are arranged in the pseudo-color selection interface, and different thumbnail windows to be selected correspondingly display thumbnails with different pseudo-color effects. Wherein, the display setting information of the thumbnail windows to be selected in the pseudo-color selection interface can be a default initial value, or can support user-defined settings, and the display setting information includes but is not limited to the number and arrangement of the thumbnail windows to be selected. The display setting information of the thumbnail windows to be selected in the pseudo-color selection interface can refer to obtaining the default initial value of the display setting information of the thumbnail windows to be selected in the pseudo-color selection interface, that is, the user does not need to reset or modify the display setting information of the pseudo-color selection interface, and when directly switching to the pseudo-color selection interface, the thumbnail windows to be selected are displayed in the pseudo-color selection interface according to the default initial value; or it can refer to obtaining the selected display setting information based on the user's selection operation of the number and arrangement of the thumbnail windows to be selected, and when entering the pseudo-color selection interface, the thumbnail windows to be selected are displayed in the pseudo-color selection interface according to the user's selected value.

[0035] S103: Determine, according to the display setting information, a coordinate mapping relationship and pseudo color palette attributes corresponding to the position of each of the to-be-selected thumbnail windows in the pseudo color selection interface.

[0036] The quantity and arrangement of the thumbnail windows to be selected that need to be shown in the pseudo-color selection interface will affect the size of each thumbnail window to be selected and the position of each thumbnail window to be selected in the pseudo-color selection interface. When entering the pseudo-color selection interface, according to the display setting information currently corresponding to the pseudo-color selection interface, determine the position of each thumbnail window to be selected in the described pseudo-color selection interface, and determine to obtain the coordinate mapping relationship corresponding to the position of each thumbnail window to be selected by the mode of coordinate conversion. Refer to Fig. 4, take the thumbnail windows to be selected that need to be shown in the pseudo-color selection interface as 5, vertical arrangement as an example, take the coordinate conversion principle of the independent image display window for displaying image data in the pseudo-color selection interface as the basis (as shown in a), calculate and obtain the coordinate mapping relationship corresponding to the position of 5 thumbnail windows to be selected in the pseudo-color selection interface (as shown in b) by coordinate conversion. Pseudo-color plate attribute refers to the type information that the image data displayed in each thumbnail window to be selected is carried out the pseudo-color processing mode. The pseudo color plate attributes correspond one-to-one to the pseudo color effects, and can be any pseudo color plate information that can uniquely characterize the use of different pseudo color effects, such as the serial number, name, code, and other information of the pseudo color plate representing different pseudo color effects.

[0037] The pseudo-color palette attributes corresponding to each thumbnail window to be selected are determined by randomly selecting the same number of pseudo-color palettes from a large number of pseudo-color palettes based on the number of thumbnail windows to be selected that need to be displayed in the pseudo-color selection interface and associating them with the thumbnail windows to be selected in a one-to-one correspondence; or by selecting the same number of pseudo-color palettes as the thumbnail windows to be selected from a large number of pseudo-color palettes according to a certain order or rule and associating them with the thumbnail windows to be selected in a one-to-one correspondence; or by selecting a certain pseudo-color palette from a large number of pseudo-color palettes based on the user's selection of the selected pseudo-color palette first and then selecting from the large number of pseudo-color palettes, thereby determining the same number of pseudo-color palettes as the thumbnail windows to be selected and associating them with the thumbnail windows to be selected in a one-to-one correspondence.

[0038] S105, acquiring real-time image data.

[0039] Real-time image data refers to picture data, video data, or video frame data extracted from the real-time collected video data collected in real time for the target scene. Acquiring real-time image data can refer to pictures, videos, or video frames extracted from the video that need to be pseudo-colored and currently acquired through real-time shooting. It can also refer to pictures, videos, or video frames extracted from the video that need to be pseudo-colored and acquired from other shooting devices through data communication. In this embodiment, the real-time image data is infrared video data acquired by real-time shooting of the target scene.

[0040] S107 , displaying the real-time image data in each of the thumbnail windows to be selected according to the coordinate mapping relationship, and presenting corresponding pseudo color effects on the real-time image data in each of the thumbnail windows to be selected according to the pseudo color plate attributes.

[0041] The pseudo-color selection interface determines the coordinate mapping relationship corresponding to the positions of multiple thumbnail windows to be selected, and utilizes the coordinate mapping relationship so that multiple thumbnail windows to be selected can realize the display of the real-time image data in multiple thumbnail windows based on a copy of real-time image data through coordinate conversion. At the same time, by determining the pseudo-color plate attributes corresponding to multiple thumbnail windows to be selected, the corresponding pseudo-color plates are respectively called to perform pseudo-color processing on the real-time image data, so that multiple thumbnail windows to be selected respectively display the pseudo-color effects of the real-time image data after pseudo-color processing by the corresponding pseudo-color plates. In the pseudo-color selection interface, multiple thumbnail windows to be selected respectively present different pseudo-color effects of the real-time image data, which is convenient for users to intuitively judge which pseudo-color effect best meets their needs.

[0042] In the above embodiment, based on the display setting information of the thumbnail windows to be selected in the pseudo-color selection interface and the number and arrangement of the thumbnail windows to be selected, the coordinate mapping relationship and pseudo-color palette attributes corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface are determined. By determining the coordinate mapping relationship corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface, the pseudo-color selection interface can use multiple thumbnail windows to share a copy of real-time image data, and simultaneously display the real-time image data in the multiple thumbnail windows to be selected through coordinate mapping. On the one hand, pseudo-color effect images are generated using real-time image data and presented in the pseudo-color selection interface, achieving what you see is what you get, and facilitating users to more intuitively and accurately determine and select the pseudo-color processing effect that best suits the image data for the current scene from the multiple thumbnail windows to be selected in the pseudo-color selection interface. On the other hand, the coordinate mapping method allows multiple thumbnail windows to share a copy of real-time image data and respectively present corresponding pseudo-color effect images, greatly reducing image data copying operations and effectively reducing computational complexity, thereby better meeting the pseudo-color processing requirements for video image data in real-time transformation scenes.

[0043] In some embodiments, further comprising:

[0044] Acquire a selection instruction for the thumbnail window to be selected, and determine a target pseudo-color plate attribute according to the selection instruction;

[0045] The real-time image data is displayed in a preview window, and a corresponding pseudo color effect is presented on the real-time image data in the preview window according to the target pseudo color plate attribute.

[0046] The preview window can be located in a preview interface of a pre-set fixed area in the pseudo-color selection interface, or it can be a preview interface independent of the pseudo-color selection interface. As shown in Figure 5, a selectable schematic diagram of simultaneously displaying a preview window and a plurality of thumbnail windows to be selected in the pseudo-color selection interface is shown. The preview screen displayed by the preview interface through the preview window is real-time image data. By obtaining the pseudo-color plate attribute corresponding to the selected thumbnail window to be selected according to the user's selection of one of the thumbnail windows to be selected, the corresponding pseudo-color plate is called to perform pseudo-color processing on the real-time image data, so that the preview window can display the pseudo-color effect after the real-time image data is pseudo-colored by the pseudo-color plate selected by the user.

[0047] Among them, the thumbnail window for selection usually displays small-sized thumbnails, while the size of the preview window can be significantly larger than the thumbnail window for selection. The user can select the required pseudo-color effect based on the thumbnail, and then present the image with the required pseudo-color effect in real time through the preview window. The purpose of observation is achieved through the real-time image data after pseudo-color processing presented in the preview window.

[0048] Optionally, acquiring real-time image data may refer to real-time image data that is currently required to be browsed or real-time image data that is currently required to be previewed. In some embodiments, acquiring the real-time image data to be viewed includes:

[0049] Obtaining a preview instruction for the currently captured image data, switching to a pseudo-color selection interface including a preview window and a thumbnail window to be selected according to the preview instruction, and using the currently captured image data as real-time image data; or,

[0050] Obtaining a preview instruction for the currently browsed image, switching to a pseudo-color selection interface including a preview window and a thumbnail window to be selected according to the preview instruction, and using the currently browsed image as real-time image data; or,

[0051] In the preview mode, a pseudo-color selection interface including a preview window and a thumbnail window to be selected is displayed, a selection instruction for uploading target image data is obtained, and the target image data is used as real-time image data according to the selection instruction.

[0052] The pseudo-color selection interface may refer to an interface that is called up based on a user's preview instruction for image data. For example, when a user clicks "Preview" during the process of capturing real-time image data, the interface switches to a pseudo-color selection interface that includes a preview window and a thumbnail window to be selected, and the real-time captured image data is used as real-time image data; or when a user clicks "Preview" during the process of browsing images, the interface switches to a pseudo-color selection interface that includes a preview window and a thumbnail window to be selected, and the currently browsed image is used as real-time image data. The pseudo-color selection interface may also be the main interface displayed when the user enters preview mode. In preview mode, the user can select image data to be previewed for upload, and the selected target image data to be uploaded is used as real-time image data. In this embodiment, based on the user's preview requirements for real-time captured images or completed image data, the thumbnail windows to be selected corresponding to the real-time image data currently to be previewed and the preview window are displayed in the same interface, making it easier for the user to more intuitively and accurately judge and select the pseudo-color processing effect that best suits the image data for the current scene from the multiple thumbnail windows to be selected in the pseudo-color selection interface.

[0053] Optionally, the pseudo-color implementation method further includes:

[0054] Obtaining a zoom adjustment operation for the preview image in the preview window;

[0055] If the zoom adjustment operation is a touch operation on a preset image zoom button, the preview image is enlarged or reduced according to a preset ratio according to the touch operation on the image zoom button; and / or,

[0056] If the zoom adjustment operation is a preset zoom gesture, the zoom ratio is determined according to the finger sliding distance of the preset zoom gesture, and the preview image is enlarged or reduced accordingly according to the zoom ratio.

[0057] The preview image displayed in the preview window supports user zoom adjustment operations. In an optional example, preset image zoom buttons can be displayed at the edge of the preview window, such as the plus key represents the button for zooming in on the image, and the minus key represents the button for zooming out on the image. The user can click the plus key or the minus key to zoom in or out on the preview image according to a preset ratio; in another optional example, the user can slide in the preview window to input a preset zoom gesture, such as sliding the thumb and index finger in opposite directions to zoom in, and sliding the thumb and index finger in opposite directions to zoom out. The user can control the zoom in or out of the preview image by sliding his fingers in the preview window.

[0058] Optionally, the pseudo-color implementation method further includes:

[0059] A local zoom instruction for the preview image in the preview window is obtained, and according to the local zoom instruction and the currently selected position, a target portion is determined with the currently selected position as the center, and the target portion is correspondingly zoomed in according to a preset ratio.

[0060] The preview image displayed in the preview window supports users to zoom in and view a part of the image. In an optional example, a zoom button can be displayed at the edge of the preview window, such as a magnifying glass icon, which indicates zooming in and viewing a part of the image. The user can click the magnifying glass icon and then click to select the target part that needs to be zoomed in and viewed. The preview image will then zoom in on the target part according to a preset ratio, making it easier for the user to focus on observation.

[0061] Optionally, the pseudo-color implementation method further includes:

[0062] Acquire a movement adjustment operation for the preview image in the preview window;

[0063] If the movement adjustment operation is a touch operation on a preset image movement button, the preview image is translated according to the corresponding movement direction and movement distance based on the touch operation on the image movement button; and / or,

[0064] If the movement adjustment operation is a preset movement gesture, the movement direction and movement distance are determined according to the finger sliding direction and sliding distance of the preset movement gesture, and the preview image is translated accordingly according to the movement direction and movement distance.

[0065] The preview image displayed in the preview window supports user movement and adjustment operations. In an optional example, preset image movement buttons can be displayed at the edge of the preview window, such as an upper arrow representing a button for moving the image up, a lower arrow representing a button for moving the image down, a left arrow representing a button for moving the image left, and a right arrow representing a button for moving the image right. The user can click the corresponding arrow to control the preview image to move in the corresponding direction by a preset movement distance; in another optional example, the user can slide in the preview window to input a preset movement gesture, such as long pressing the image and then dragging the image, and accordingly control the preview image to move following the dragging operation.

[0066] In some embodiments, determining, based on the display setting information, the coordinate mapping relationship and pseudo color palette attributes corresponding to the position of each of the to-be-selected thumbnail windows in the pseudo color selection interface includes:

[0067] According to the number and arrangement of the thumbnail windows to be selected currently to be displayed, the coordinate mapping relationship corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface is determined using the OpenGL rendering principle;

[0068] A target pseudo color plate corresponding to the number of the thumbnail windows to be selected is determined from a pseudo color plate library, and the target pseudo color plate is sequentially determined as the pseudo color plate attribute corresponding to each of the thumbnail windows to be selected.

[0069] OpenGL (Open Graphics Library) is a cross-language, cross-platform application programming interface (API) for rendering 2D and 3D vector graphics. The pseudo-color selection interface determines the coordinate mapping relationship corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface based on the number and arrangement of the thumbnail windows to be selected, using the viewport transformation method of the OpenGL rendering principle. A connection is established between the transformed coordinates and the pixels on the screen, enabling simultaneous display of the same real-time image data projected into multiple thumbnail windows to be selected. A pseudo-color palette library refers to a database containing multiple pseudo-color palettes. Different pseudo-color palettes correspond to different pseudo-color effects. Once the number and arrangement of the thumbnail windows to be selected in the pseudo-color selection interface are determined, when entering the pseudo-color selection interface, pseudo-color palettes with the same number of thumbnail windows to be selected that are ranked first in the pseudo-color palette library can be selected according to the order of the pseudo-color palettes. These pseudo-color palettes are then used one by one as the pseudo-color palette attributes corresponding to the thumbnail windows to be selected, according to the arrangement of the thumbnail windows to be selected. For example, there are five thumbnail windows to be selected, arranged vertically. Pseudo-color plates 1 to 5 are selected from the pseudo-color plate library, and the pseudo-color plate attributes corresponding to thumbnail windows 1 to 5 to be selected are pseudo-color plates 1 to 5, respectively.

[0070] OpenGL has a large set of functions that can be used to operate models and pictures. In OpenGL, specific function is called respectively by a large amount of rendering pipelines (graphics pipeline) to progressively complete the viewport transformation between a stereoscopic image coordinate to the pixel in the screen and image display window, by the data in the program shader (shader) parallel processing rendering pipeline running on GPU, processing efficiency can be effectively improved. In the present embodiment, by adopting OpenGL rendering principle to realize synchronous display real-time image data in multiple thumbnail windows to be selected in pseudo color selection interface, thus can meet the display demand of the thumbnail of different pseudo color effects to real-time video data in pseudo color selection interface.

[0071] In some embodiments, determining target pseudo-color plates corresponding to the number of the thumbnail windows to be selected from a pseudo-color plate library, and sequentially determining the target pseudo-color plates as pseudo-color plate attributes corresponding to the thumbnail windows to be selected, includes:

[0072] Obtaining target pseudo-color plates corresponding to the number of thumbnail windows to be selected according to an initial arrangement order of pseudo-color plates in a pseudo-color plate library; or obtaining target pseudo-color plates corresponding to the number of thumbnail windows to be selected according to a preset selection instruction for pseudo-color plates in the pseudo-color plate library;

[0073] The corresponding thumbnail numbers are determined in sequence according to the arrangement of the thumbnail windows to be selected, and the target pseudo-color palette is determined in sequence as the pseudo-color palette attributes corresponding to the thumbnail numbers.

[0074] The pseudo-color plate library usually contains multiple pseudo-color plates. The pseudo-color selection interface can be based on the initial arrangement order of the pseudo-color plates in the pseudo-color plate library, and sequentially select multiple pseudo-color plates corresponding to the number of multiple thumbnail windows to be selected that are currently displayed in the pseudo-color selection interface as the target pseudo-color plate. Optionally, the determination of the pseudo-color plate attributes corresponding to the multiple thumbnail windows to be selected also supports the method of manually selecting from the pseudo-color plate library by the user. According to the arrangement and order of the multiple thumbnail windows to be selected in the pseudo-color selection interface, the thumbnail serial numbers corresponding to the thumbnail windows to be selected are determined, and then the target pseudo-color plate is determined one by one as the pseudo-color plate attributes corresponding to each thumbnail serial number, that is, the pseudo-color plate attributes corresponding to each thumbnail window to be selected.

[0075] In some embodiments, the pseudo-color palette library includes a pseudo-color palette file in a picture format and / or a pseudo-color palette file in a document format that records a color mapping relationship corresponding to pseudo-color conversion; the pseudo-color implementation method further includes:

[0076] Obtaining a local upgrade instruction for a pseudo-color plate file, receiving an uploaded updated pseudo-color plate file based on the local upgrade instruction, adding the updated pseudo-color plate file to the pseudo-color plate library to achieve the upgrade or replacing the original pseudo-color plate file with the updated pseudo-color plate file to achieve the upgrade; and / or,

[0077] Obtain an online upgrade instruction for the pseudo-color plate file, obtain an updated pseudo-color plate file from the cloud based on the online upgrade instruction, add the updated pseudo-color plate file to the pseudo-color plate library to achieve the upgrade, or replace the original pseudo-color plate file with the updated pseudo-color plate file to achieve the upgrade.

[0078] The pseudo-color plate file can be a file in picture format. Optionally, each pseudo-color plate attribute can correspond to a picture containing a color plate strip image, or a picture can include multiple color plate strip images corresponding to multiple different pseudo-color plate attributes. The color information displayed by each color plate strip image can represent the color mapping relationship when the corresponding pseudo-color plate performs pseudo-color processing on the image. The pseudo-color plate file can also be a file in document format. Optionally, it can record the color mapping relationship when different pseudo-color plates perform pseudo-color processing on the image in Excel format, XML format file, etc. The upgrade of the pseudo-color plate library can be a local upgrade, where the user creates a pseudo-color plate file and uploads it, or the user modifies and adjusts the existing pseudo-color plate file and uploads it; it can also be an online upgrade, such as the manufacturer of the infrared thermal imaging equipment uniformly updates and maintains the upgrade of the pseudo-color plate library to meet the personalized pseudo-color processing needs in more application scenarios.

[0079] In some embodiments, determining the coordinate mapping relationship corresponding to the position of each of the thumbnail windows to be selected in the pseudo-color selection interface using the OpenGL rendering principle according to the number and arrangement of the thumbnail windows to be selected currently to be displayed includes:

[0080] According to the number and arrangement of the thumbnail windows to be selected currently to be displayed, the coordinate scaling ratio and coordinate translation size corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface are determined.

[0081] The coordinate mapping relationship corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface mainly includes a coordinate scaling ratio and a coordinate translation size. Among them, the coordinate scaling ratio is mainly related to the number of thumbnail windows to be selected that need to be displayed in the pseudo-color selection interface, and the coordinate translation size is mainly related to the arrangement direction and order of each thumbnail window to be selected. In this embodiment, the OpenGL rendering principle is utilized, and the real-time image data is input into the pseudo-color selection interface in the form of texture mapping. The pseudo-color selection interface then maps the same real-time image data to the screen coordinates composed of a specified number of pixels in each thumbnail window to be selected through the implementation method of scaling and translation, so that multiple thumbnail windows to be selected share a copy of real-time image data to respectively display pseudo-color thumbnails with different pseudo-color effects of the real-time image data.

[0082] Optionally, displaying the real-time image data in each of the to-be-selected thumbnail windows according to the coordinate mapping relationship, and presenting a corresponding pseudo-color effect on the real-time image data in each of the to-be-selected thumbnail windows according to the pseudo-color plate attributes, includes:

[0083] Calculating the position coordinates of the pixel points in each of the thumbnail windows to be selected after coordinate transformation according to the coordinate scaling ratio and coordinate translation size corresponding to each of the thumbnail windows to be selected;

[0084] According to the real-time image data currently to be displayed, the image data corresponding to the position coordinates of each pixel point after the coordinate transformation is determined as pixel data;

[0085] According to the pseudo-color plate attributes corresponding to each of the thumbnail windows to be selected, the image data of each pixel point in each of the thumbnail windows to be selected are processed using the corresponding pseudo-color plate, and real-time pseudo-color results are obtained that present corresponding pseudo-color effects on the real-time image data in each of the thumbnail windows to be selected.

[0086] In this embodiment, by calculating the position coordinates of the pixel points in each thumbnail window to be selected after coordinate transformation, and determining the image data corresponding to the position coordinates of the pixel points after coordinate transformation as pixel data, the real-time image data is displayed in each thumbnail window to be selected.

[0087] Referring to FIG. 6 , an object in a 3D scene is represented in a normalized cube, and the normalized coordinates (-1, 1) are mapped to screen coordinates consisting of nx*ny pixels. The transformation of projecting the normalized cube onto the screen is implemented as an example through scaling and translation as follows:

[0088] Scaling: The x and y axes are enlarged from 2 and 2 to nx and ny, with a scaling ratio of nx / 2 and ny / 2;

[0089] Translation: The origin position remains unchanged after scaling. At this time, the point in the lower left corner needs to be moved to the origin of the screen coordinate system through translation. The positive movement distances of the x and y axes are nx / 2-0.5 and ny / 2-0.5 respectively, where 0.5 means that the screen coordinate origin is the center point of the lower left pixel (one pixel is equivalent to a small rectangle).

[0090] The viewport transformation matrix is ​​represented as follows:

[0091] In the above embodiment, by determining the coordinate scaling ratio and coordinate translation size corresponding to the position of each of the thumbnail windows to be selected in the pseudo-color selection interface, the same real-time image data is projected into each of the thumbnail windows to be selected for synchronous display using viewport transformation.

[0092] In some embodiments, the display setting information further includes identification setting information for setting each of the thumbnail windows to be selected to include a corresponding identification area; displaying the real-time image data in each of the thumbnail windows to be selected according to the coordinate mapping relationship, and presenting a corresponding pseudo-color effect on the real-time image data in each of the thumbnail windows to be selected according to the pseudo-color plate attributes, includes:

[0093] According to the pseudo-color plate attributes corresponding to each of the thumbnail windows to be selected, image processing is performed on the image data of each pixel point in each of the thumbnail windows to be selected through the corresponding pseudo-color plate, so that corresponding pseudo-color effects are presented on the real-time image data in each of the thumbnail windows to be selected, and real-time pseudo-color results of the pseudo-color category name of the corresponding pseudo-color plate are displayed in the identification area corresponding to each of the thumbnail windows to be selected.

[0094] In the present embodiment, the pseudo-color selection interface is provided with two adjacent thumbnail windows to be selected spaced apart from each other to form a marking area. By the setting of the marking area, after the pseudo-color process is carried out in each thumbnail window to be selected by the corresponding pseudo-color plate, on the basis of displaying the thumbnail of the corresponding pseudo-color effect in the corresponding thumbnail window to be selected, the pseudo-color category name is further displayed in the marking area of ​​the corresponding thumbnail window to be selected. Optionally, the display of the pseudo-color category name can be realized by adding a text icon, adding a transparent layer in the thumbnail window to be selected when the pseudo-color process is carried out by the pseudo-color plate. It should be noted that the setting of the marking area is conducive to avoiding the display of the pseudo-color category name from blocking the image in the thumbnail window to be selected. As another optional embodiment, in the pseudo-color selection interface, a plurality of thumbnail windows to be selected are adjacent in pairs, and in each thumbnail window to be selected, only the pseudo-color thumbnail of the real-time image data is presented and the corresponding pseudo-color category name is not displayed, or the corresponding pseudo-color category name is directly displayed in the designated area on the pseudo-color thumbnail.

[0095] In some embodiments, determining the coordinate scaling ratio and coordinate translation size corresponding to the position of each of the thumbnail windows to be selected in the pseudo-color selection interface according to the number and arrangement of the thumbnail windows to be selected currently to be displayed includes:

[0096] If the arrangement of the thumbnail windows to be selected is horizontal, determining, according to the number of the thumbnail windows to be selected, a horizontal coordinate scaling ratio and a horizontal coordinate translation value corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface;

[0097] If the arrangement of the thumbnail windows to be selected is vertical, determining, according to the number of the thumbnail windows to be selected, a vertical coordinate scaling ratio and a vertical coordinate translation value corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface;

[0098] If the arrangement of the thumbnail windows to be selected is a grid, the horizontal coordinate scaling ratio and vertical coordinate scaling ratio corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface, as well as the corresponding horizontal coordinate translation value and vertical coordinate translation value are determined according to the number of rows and columns of the thumbnail windows to be selected.

[0099] Please refer to Figure 7 for examples of several common arrangements of multiple thumbnail windows to be selected in the pseudo-color selection interface. Optionally, the pseudo-color selection interface or the configuration interface for configuring display settings in the pseudo-color selection interface can provide a configuration option for the user to select an arrangement of the thumbnail windows to be selected. If the user does not select an arrangement of the thumbnail windows to be selected, one of the arrangement modes, such as vertical arrangement, can be used as the default. Determine the coordinate scaling ratio and coordinate translation size corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface. The calculation method is different according to the different arrangement methods of the thumbnail windows to be selected in the pseudo-color selection interface. When the arrangement method of the thumbnail windows to be selected is horizontal, the position of each thumbnail window to be selected in the pseudo-color selection interface may only involve scaling and translation in the horizontal coordinate direction; when the arrangement method of the thumbnail windows to be selected is vertical, the position of each thumbnail window to be selected in the pseudo-color selection interface may only involve scaling and translation in the vertical coordinate direction; when the arrangement method of the thumbnail windows to be selected is a grid, the position of each thumbnail window to be selected in the pseudo-color selection interface involves scaling and translation in both the horizontal and vertical coordinate directions.

[0100] Optionally, obtaining display setting information of a thumbnail window to be selected in the pseudo-color selection interface includes:

[0101] Obtaining display setting information of a thumbnail window to be selected in the pseudo-color selection interface according to initialization settings of the pseudo-color selection interface; and / or,

[0102] Based on the configuration operation on the number and arrangement of the thumbnail windows to be selected in the pseudo-color selection interface, display setting information of the thumbnail windows to be selected in the pseudo-color selection interface is obtained.

[0103] The number and arrangement of the thumbnail windows to be selected in the pseudo-color selection interface can be determined based on initialization settings. That is, before entering the pseudo-color selection interface, the user does not necessarily need to set the attribute information such as the number and arrangement of the thumbnail windows to be selected in the pseudo-color selection interface. Optionally, before entering the pseudo-color selection interface, or while opening the pseudo-color selection interface to view the pseudo-color thumbnails of the real-time image data displayed in each thumbnail window to be selected, the user can call up a configuration interface for setting the pseudo-color selection interface and configure the number and arrangement of the thumbnail windows to be selected, thereby adjusting the number, arrangement, and other display modes of the pseudo-color thumbnails in the pseudo-color selection interface.

[0104] In some embodiments, the pseudo-color implementation method further includes:

[0105] According to the switching operation on the thumbnail window to be selected in the current pseudo-color selection interface, obtaining a switching instruction corresponding to the current switching operation;

[0106] According to the switching instruction, the target pseudo color palette attribute corresponding to each of the thumbnail windows to be selected, for which the pseudo color palette currently needs to be switched, is selected from the currently selectable pseudo color palette attributes;

[0107] Image processing is performed on the image data in each of the to-be-selected thumbnail windows using the target pseudo-color palette attributes, to obtain real-time pseudo-color results in which the real-time image data in each of the to-be-selected thumbnail windows after switching present corresponding pseudo-color effects.

[0108] The switching operation of the thumbnail window to be selected in the current pseudo-color selection interface can include multiple different types of operation modes, such as the operation of sliding in a specified direction within a specified area of ​​the pseudo-color selection interface, the operation of selecting one or more thumbnail windows to be selected to move, the click operation of a button that controls the movement of the thumbnail window to be selected in a specified direction, etc. Different switching operations can represent different switching instructions, such as switching the pseudo-color thumbnails displayed in one of the thumbnail windows to be selected, and batch switching the pseudo-color thumbnails displayed in the thumbnail windows to be selected in the current pseudo-color selection interface. The currently selectable pseudo-color plate attribute can refer to the pseudo-color plates that are arranged in order after the pseudo-color plates used in the current pseudo-color selection interface in the pseudo-color plate library. In the process of switching the pseudo-color thumbnails of the real-time image data displayed in the thumbnail window to be selected in the pseudo-color selection interface, the real-time image data displayed in each thumbnail window to be selected does not need to be switched. It is only necessary to switch the number of pseudo-color plates as needed, and the real-time image data in each thumbnail window to be selected is pseudo-colored using the switched pseudo-color plates.

[0109] In some embodiments, the current switching operation is an operation of sliding m thumbnail windows to be selected in a specified direction, where m is less than or equal to the number of selectable pseudo-color palettes, and the number of thumbnail windows to be selected in the pseudo-color selection interface is n; and selecting, according to the switching instruction, from the currently selectable pseudo-color palette attributes, the target pseudo-color palette attribute corresponding to each of the thumbnail windows to be selected, for which the pseudo-color palette currently needs to be switched, includes:

[0110] Selecting m pseudo color palette attributes in sequence from currently selectable pseudo color palette attributes according to a switching instruction corresponding to the current switching operation;

[0111] If m is greater than or equal to n, the m pseudo color plate attributes are sequentially replaced with the target pseudo color plate attributes corresponding to each of the thumbnail windows to be selected in the pseudo color selection interface;

[0112] If m is less than n, the pseudo-color plate attributes corresponding to the nm thumbnail windows to be selected and retained based on the current pseudo-color selection interface are added to the m pseudo-color plate attributes, and the target pseudo-color plate attributes corresponding to each of the thumbnail windows to be selected in the pseudo-color selection interface are replaced in sequence.

[0113] Different sliding operations correspond to different numbers of windows to be switched. If the sliding operation indicates that the number of windows to be switched is greater than or equal to the total number of windows in the interface, the pseudo-color palette attributes in all windows in the interface are switched, that is, the selected m pseudo-color palette attributes are sequentially arranged and updated to the target pseudo-color palette attributes corresponding to each of the thumbnail windows to be selected in the pseudo-color selection interface. If the sliding operation indicates that the number of windows that need to be switched is less than the total number of windows in the interface, the pseudo-color plate attributes of the window sorted later in the interface will be moved up, and the selected m pseudo-color plate attributes will be used as a supplement. For example, after subtracting the thumbnail window to be selected in the current pseudo-color selection interface from the window moved forward m positions in the sliding direction, the pseudo-color plate attributes corresponding to the remaining thumbnail window to be selected are added to the m pseudo-color plate attributes and arranged in sequence, and updated to the target pseudo-color plate attributes corresponding to each thumbnail window to be selected in the pseudo-color selection interface; it can also be that the pseudo-color plate attributes corresponding to all windows in the current pseudo-color selection interface are added to the selected m pseudo-color plate attributes, and then the window switching number m indicated by the current switching operation is subtracted, and then the pseudo-color plate attributes in the window are replaced in sequence; both can form a batch switching effect of window sliding and pseudo-color plate attribute replacement.

[0114] Wherein, optional pseudo color plate number refers to the quantity of optional pseudo color plate in the current pseudo color plate library.When the user is performing the batch switching of pseudo color plate, the distance sliding in the specified direction is proportional to the quantity of the pseudo color plate that once switches, and when the pseudo color plate is set to be switched in batches by sliding operation, m is less than or equal to optional pseudo color plate number.If m is less than the quantity n of the thumbnail window to be selected that comprises in the pseudo color selection interface, then m pseudo color plates after the pseudo color plate used in the selected current pseudo color selection interface can be arranged in order from the pseudo color plate library, the pseudo color plate attribute corresponding to other thumbnail windows to be selected that the current pseudo color selection interface does not need to switch is moved forward in sequence to the target pseudo color plate attribute corresponding to m windows as the corresponding window, and these m pseudo color plates are used as the target pseudo color plate attribute corresponding to m thumbnail windows to be selected in the rear that are sorted, like this, finish the switching of m pseudo color thumbnails, and form the visual effect that the pseudo color thumbnail slides of different pseudo color effects in a plurality of described thumbnail windows to be selected. If m is greater than or equal to the number n of thumbnail windows to be selected contained in the pseudo-color selection interface, then n pseudo-color plates following the pseudo-color plates used in the current pseudo-color selection interface can be selected in sequence from the pseudo-color plate library, and these n pseudo-color plates are sequentially used as the target pseudo-color plate attributes corresponding to the n thumbnail windows to be selected. In this way, batch switching of the pseudo-color thumbnails displayed in all the thumbnail windows to be selected in the current pseudo-color selection interface is completed.

[0115] In order to have a more comprehensive understanding of the pseudo-color implementation method provided in the embodiment of the present application, please refer to FIG8 . In an optional specific example, taking the pseudo-color implementation method applied to an infrared thermal imager as an example, the pseudo-color implementation method includes:

[0116] S11, setting the number and arrangement of thumbnail windows to be selected in the pseudo-color selection interface;

[0117] The thumbnail windows to be selected correspond one-to-one to the color palette thumbnails after pseudo-color processing. The number of color palette thumbnails can be specified at the beginning of the program or changed as needed. It determines the scaling ratio of the original image data in the color palette thumbnail display interface; the arrangement of the color palette thumbnails can be horizontal, vertical, or grid-like, which determines the transformation method of the texture coordinates of the original image data in the glsl (OpenGL Shader Language, OpenGL's shader programming language) file.

[0118] S12, determining the pseudo color plate attributes corresponding to each thumbnail window to be selected;

[0119] A pseudo-color plate library can be pre-built, and a large number of pseudo-color plates corresponding to different pseudo-color effects can be stored in the pseudo-color plate library. These pseudo-color plates can be stored according to certain rules, such as pseudo-color plates are named with serial numbers and stored in ascending order. Pseudo-color plate attributes include identification information that can uniquely characterize the identity of the corresponding pseudo-color plate, such as the serial number, code, name, etc. of the pseudo-color plate. The relevant information of the pseudo-color plate attributes can be pre-set when creating the pseudo-color plate, or it can be automatically generated according to preset rules. Pseudo-color plates can use texture mapping. In the pseudo-color plate library, you can import only the same number of color plates as the number of thumbnail windows to be selected in the pseudo-color selection interface, or you can import all color plates in batches at once. Optionally, the application interface can provide function buttons for local addition or online upgrade of color palettes, supporting users to connect to the network through the corresponding function buttons and download the latest color palette data from the cloud to upgrade the pseudo-color palette library or the pseudo-color selection interface in the thumbnail window to be selected in real time; it also supports users to import some locally stored color palette data through the corresponding function buttons, or create some color palette data by themselves, to upgrade the pseudo-color palette library or the pseudo-color selection interface in real time.

[0120] S13, determining the target pseudo-color plate attribute corresponding to the preview window according to the selection of the thumbnail window to be selected;

[0121] The user can select the pseudo-color effect that he wants to preview from the multiple thumbnail windows to be selected currently displayed in the pseudo-color selection interface. The preview window obtains the pseudo-color palette attributes corresponding to the selected thumbnail window as the target pseudo-color palette attributes, and presents the corresponding pseudo-color effect according to the target pseudo-color palette attributes. In an optional specific example, the user can select and click on the location of the corresponding thumbnail window to be selected. According to the position of the click position in the palette thumbnail display interface, the attribute information such as the sequence number, id or name of the clicked palette thumbnail is calculated. This attribute information can be passed to the preview interface, so that the preview interface updates the specified palette information, realizes the thumbnail interface selection of the palette, and the preview interface updates the specified palette to present the corresponding pseudo-color effect.

[0122] Among them, when the user selects a pseudo-color effect from the pseudo-color selection interface, all color palettes corresponding to the current thumbnail window to be selected can be batch-switched. In an optional specific example, the user's operation of switching the color palette can be based on the increase or decrease of a specified sequence number, or by sliding in a specified direction to form a switching instruction. According to the specified sequence number, the color palette corresponding to the thumbnail window to be selected in the current pseudo-color selection interface can be batch-switched in up / down / left / right / forward / backward, etc., to achieve the effect of batch switching pseudo-colors; or according to the sliding distance or sliding direction or the touch position of the finger, the color palette corresponding to the thumbnail window to be selected in the current pseudo-color selection interface can be batch-switched to achieve the effect of batch switching pseudo-colors.

[0123] S14, using the OpenGL rendering principle to determine the coordinate mapping relationship corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface, the acquired real-time image data is associated with the pixels in each thumbnail window to be selected through coordinate conversion, and the corresponding pseudo-color plate is called according to the pseudo-color plate properties corresponding to each thumbnail window to be selected for pseudo-color processing, and a pseudo-color thumbnail with a pseudo-color effect corresponding to the real-time image data is presented through each thumbnail window to be selected.

[0124] Among them, the rendering data, that is, the real-time image data can be a picture, a real-time transformed video stream, or a real-time changing camera output stream. Rendering can realize pseudo-color thumbnail rendering with pseudo-color names, and can also realize pseudo-color thumbnail rendering without pseudo-color names. Using the OpenGL rendering principle, multiple thumbnail windows to be selected in the pseudo-color selection interface can be designed to use an OpenGL interface, and the real-time image data is input into the pseudo-color selection interface through texture mapping, such as OES texture or sampler2D texture mapping. All thumbnails in this pseudo-color selection interface share a copy of real-time image data through coordinate transformation, and according to the pseudo-color plate properties corresponding to each thumbnail window to be selected, the corresponding color plate is called to achieve the pseudo-color effect of the corresponding thumbnail.

[0125] S15 , the preview window acquires real-time image data, and presents a preview image of the pseudo-color effect corresponding to the real-time image data according to the target pseudo-color plate attributes.

[0126] The preview window is based on the user's real-time operation on the pseudo color selection interface. When the user selects or switches the pseudo color thumbnail corresponding to the pseudo color effect currently to be previewed, the preview window is linked with the user's operation in the pseudo color selection interface to achieve a real-time pseudo color switching effect.

[0127] The pseudo-color implementation method provided in the above embodiment has at least the following characteristics:

[0128] First, multiple thumbnail windows to be selected in the pseudo-color selection interface share the same real-time image data by calculating a coordinate mapping relationship through coordinate conversion. Different pseudo-color palettes are called for pseudo-color processing according to the user's selection or switching operation, thereby presenting pseudo-color thumbnails of the real-time image data. This ensures that the real-time pseudo-color efficiency does not increase with the increase in the number of pseudo-color palettes, and can meet the low-power real-time pseudo-color effect of real-time video streaming data. Conventional pseudo-color thumbnail implementations use a complete copy of the original image data for each thumbnail. When there are many pseudo-color palettes and the pseudo-color palette needs to be switched, resource consumption is high, and it cannot meet the real-time pseudo-color requirements.

[0129] Second, it supports setting the number, arrangement and other display information of the thumbnail windows to be selected in the pseudo-color selection interface, and supports fast batch switching of pseudo-color thumbnails in the pseudo-color selection interface. It is flexible to operate and convenient to modularize, and can meet different needs in different application scenarios.

[0130] Third, the thumbnail window for selection in the pseudo-color selection interface directly presents the pseudo-color palette effect of the real-time image data. What you see is what you get, making it convenient for users to intuitively and accurately select the pseudo-color effect required for the current real-time scene.

[0131] Please refer to Figure 9. On the other hand, the present application provides a pseudo-color implementation device, including: a setting module 91, used to obtain display setting information of the thumbnail windows to be selected in the pseudo-color selection interface; the display setting information includes the number and arrangement of the thumbnail windows to be selected; a rendering module 92, used to determine the coordinate mapping relationship and pseudo-color plate properties corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface according to the display setting information; obtain real-time image data; display the real-time image data in each thumbnail window to be selected according to the coordinate mapping relationship, and present corresponding pseudo-color effects on the real-time image data in each thumbnail window to be selected according to the pseudo-color plate properties.

[0132] Optionally, the pseudo-color implementation device also includes a switching module 93, which is used to obtain a selection instruction for the thumbnail window to be selected, and determine the target pseudo-color plate attributes according to the selection instruction; display the real-time image data in the preview window, and present a corresponding pseudo-color effect on the real-time image data in the preview window according to the target pseudo-color plate attributes.

[0133] Optionally, the rendering module 92 is also used to determine the coordinate mapping relationship corresponding to the position of each of the thumbnail windows to be selected in the pseudo-color selection interface according to the number and arrangement of the thumbnail windows to be selected currently to be displayed, using the OpenGL rendering principle; determine the target pseudo-color plate corresponding to the number of the thumbnail windows to be selected from the pseudo-color plate library, and determine the target pseudo-color plate in sequence as the pseudo-color plate attribute corresponding to each of the thumbnail windows to be selected.

[0134] Optionally, the rendering module 92 is further used to obtain target pseudo-color plates corresponding to the number of thumbnail windows to be selected based on the initial arrangement order of the pseudo-color plates in the pseudo-color plate library; or, to obtain target pseudo-color plates corresponding to the number of thumbnail windows to be selected based on the selection instruction of the pseudo-color plates in the preset pseudo-color plate library; and to determine the thumbnail numbers corresponding to each of the thumbnail windows to be selected in sequence according to the arrangement of the thumbnail windows to be selected, and to determine the target pseudo-color plates in sequence as the pseudo-color plate attributes corresponding to each of the thumbnail numbers.

[0135] Optionally, the rendering module 92 is further configured to determine the coordinate scaling ratio and coordinate translation size corresponding to the position of each of the thumbnail windows to be selected in the pseudo-color selection interface according to the number and arrangement of the thumbnail windows to be selected currently to be displayed.

[0136] Optionally, the rendering module 92 is further used to calculate the position coordinates of the pixel points in each of the thumbnail windows to be selected after the coordinate transformation according to the coordinate scaling ratio and coordinate translation size corresponding to each of the thumbnail windows to be selected; determine the image data corresponding to the position coordinates of each of the pixel points after the coordinate transformation as pixel data according to the real-time image data to be displayed currently; and perform image processing on the image data of each of the pixel points in each of the thumbnail windows to be selected through the corresponding pseudo-color plate according to the pseudo-color plate attributes corresponding to each of the thumbnail windows to be selected, so as to obtain real-time pseudo-color results that present corresponding pseudo-color effects on the real-time image data in each of the thumbnail windows to be selected.

[0137] Optionally, the rendering module 92 is also used to perform image processing on the image data of each pixel point in each of the thumbnail windows to be selected through the corresponding pseudo-color plate according to the pseudo-color plate attributes corresponding to each of the thumbnail windows to be selected, so as to obtain corresponding pseudo-color effects on the real-time image data in each of the thumbnail windows to be selected, and to display the real-time pseudo-color results of the pseudo-color category name of the corresponding pseudo-color plate in the identification area corresponding to each of the thumbnail windows to be selected.

[0138] Optionally, the rendering module 92 is also used to determine the horizontal coordinate scaling ratio and the horizontal coordinate translation value corresponding to the position of each thumbnail window in the pseudo-color selection interface according to the number of thumbnail windows to be selected if the arrangement of the thumbnail windows to be selected is horizontal; if the arrangement of the thumbnail windows to be selected is vertical, determine the vertical coordinate scaling ratio and the vertical coordinate translation value corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface according to the number of thumbnail windows to be selected; if the arrangement of the thumbnail windows to be selected is a grid, determine the horizontal coordinate scaling ratio and the vertical coordinate scaling ratio, as well as the corresponding horizontal coordinate translation value and the vertical coordinate translation value corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface according to the number of rows and columns of the thumbnail windows to be selected.

[0139] Optionally, the setting module 91 is also used to obtain display setting information of the thumbnail window to be selected in the pseudo-color selection interface according to the initialization setting of the pseudo-color selection interface; and / or, based on the configuration operation of the number and arrangement of the thumbnail windows to be selected in the pseudo-color selection interface, obtain the display setting information of the thumbnail window to be selected in the pseudo-color selection interface.

[0140] Optionally, the switching module 93 is also used to obtain a switching instruction corresponding to the current switching operation based on the switching operation of the thumbnail window to be selected in the current pseudo-color selection interface; according to the switching instruction, select the target pseudo-color plate attribute corresponding to each of the thumbnail windows to be selected that currently needs to switch the pseudo-color plate from the currently optional pseudo-color plate attributes; perform image processing on the image data in each of the thumbnail windows to be selected through the target pseudo-color plate attribute, and obtain real-time pseudo-color results with corresponding pseudo-color effects on the real-time image data in each of the thumbnail windows to be selected after switching.

[0141] Optionally, the switching module 93 is also used to select m pseudo-color plate attributes in sequence from the currently selectable pseudo-color plate attributes according to the switching instruction corresponding to the current switching operation; if m is greater than or equal to the number of the thumbnail windows to be selected in the current pseudo-color selection interface, the n pseudo-color plate attributes are arranged in sequence and updated to the target pseudo-color plate attributes corresponding to each of the thumbnail windows to be selected in the pseudo-color selection interface; if m is less than the number of thumbnail windows to be selected in the current pseudo-color selection interface, the pseudo-color plate attributes corresponding to the remaining thumbnail windows to be selected after subtracting the first m in the sliding direction are added to the m pseudo-color plate attributes, and arranged in sequence, and updated to the target pseudo-color plate attributes corresponding to each of the thumbnail windows to be selected in the pseudo-color selection interface.

[0142] It should be noted that the pseudo-color implementation device provided in the above embodiment, in the process of implementing the pseudo-color implementation method, is merely illustrated by the division of the aforementioned program modules. In actual applications, the aforementioned processing can be assigned to different program modules as needed, that is, the internal structure of the device can be divided into different program modules to complete all or part of the method steps described above. In addition, the pseudo-color implementation device provided in the above embodiment and the corresponding pseudo-color implementation method embodiment are based on the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0143] On the other hand, the present application provides an infrared thermal imaging device. Please refer to Figure 10, which is an optional hardware structure diagram of the infrared thermal imaging device provided in an embodiment of the present application. The infrared thermal imaging device includes a processor 111 and a memory 112 connected to the processor 111. The memory 112 is used to store various categories of data to support the operation of the infrared thermal imaging device, and stores a computer program for implementing the pseudo-color implementation method provided in any embodiment of the present application. When the computer program is executed by the processor, the steps of the pseudo-color implementation method provided in any embodiment of the present application are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0144] Wherein, the infrared thermal imaging device includes an image sensor connected to the processor 111, the image sensor is used to collect real-time image data, and transmit the real-time image data to the processor, the processor includes an image processing unit (GPU), and the image processing unit is used to perform parallel calculations on the coordinate mapping relationship of each of the thumbnail windows to be selected. Optionally, the image sensor is an infrared sensor, and the real-time image data is infrared video data captured in real time for the target scene, wherein the thumbnails displayed in each thumbnail window to be selected are pseudo-color thumbnails corresponding to the infrared video data. The infrared thermal imaging device includes a display screen connected to the processor 111, and the user can complete the display information setting of the pseudo-color selection interface, the viewing and switching of pseudo-color thumbnails, and other operations through the application interface displayed on the display screen.

[0145] The present application also provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the various processes of the above-mentioned image processing method embodiment are implemented and the same technical effects are achieved. To avoid repetition, the details are not described here. The computer-readable storage medium is, for example, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0146] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0147] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better embodiment. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), including a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present invention.

[0148] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any modifications or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present invention should be included in the scope of protection of the present invention. The scope of protection of the present invention should be based on the scope of protection of the claims.

Claims

1. A pseudo-color realization method, characterized in that: include: Acquire display setting information of the thumbnail windows to be selected in the pseudo-color selection interface; the display setting information includes the number and arrangement of the thumbnail windows to be selected; Determine, according to the display setting information, the coordinate mapping relationship and pseudo color palette attributes corresponding to the position of each of the to-be-selected thumbnail windows in the pseudo color selection interface; Acquire real-time image data; The real-time image data is displayed in each of the thumbnail windows to be selected according to the coordinate mapping relationship, and the corresponding pseudo-color effect is presented on the real-time image data in each of the thumbnail windows to be selected according to the pseudo-color plate attribute.

2. The pseudo-color realization method according to claim 1, characterized in that: Also includes: Acquire a selection instruction for the thumbnail window to be selected, and determine a target pseudo-color plate attribute according to the selection instruction; The real-time image data is displayed in a preview window, and a corresponding pseudo-color effect is presented on the real-time image data in the preview window according to the target pseudo-color plate attribute.

3. The pseudo-color realization method according to claim 2, characterized in that: Also includes: Obtaining a zoom adjustment operation for the preview image in the preview window; If the zoom adjustment operation is a touch operation on a preset image zoom button, the preview image is enlarged or reduced according to a preset ratio according to the touch operation on the image zoom button; and / or, If the zoom adjustment operation is a preset zoom gesture, the zoom ratio is determined according to the finger sliding distance of the preset zoom gesture, and the preview image is enlarged or reduced accordingly according to the zoom ratio.

4. The pseudo-color realization method according to claim 3, characterized in that: Also includes: A local zoom-in instruction for the preview image in the preview window is obtained, and according to the local zoom-in instruction and the currently selected position, a target part is determined with the currently selected position as the center, and the target part is correspondingly zoomed in according to a preset ratio.

5. The pseudo-color realization method according to claim 2, characterized in that: Also includes: Acquire a movement adjustment operation for the preview image in the preview window; If the movement adjustment operation is a touch operation on a preset image movement button, the preview image is translated according to a corresponding movement direction and movement distance according to the touch operation on the image movement button; and / or, If the movement adjustment operation is a preset movement gesture, the movement direction and the movement distance are determined according to the finger sliding direction and the sliding distance of the preset movement gesture, and the preview image is translated accordingly according to the movement direction and the movement distance.

6. The pseudo-color realization method according to claim 1, characterized in that: Determining the coordinate mapping relationship and pseudo color palette attributes corresponding to the position of each of the to-be-selected thumbnail windows in the pseudo color selection interface according to the display setting information includes: According to the number and arrangement of the thumbnail windows to be selected to be displayed currently, the coordinate mapping relationship corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface is determined by using the OpenGL rendering principle; A target pseudo color plate corresponding to the number of the thumbnail windows to be selected is determined from a pseudo color plate library, and the target pseudo color plate is sequentially determined as the pseudo color plate attribute corresponding to each of the thumbnail windows to be selected.

7. The pseudo-color realization method according to claim 6, characterized in that: The step of determining target pseudo-color plates corresponding to the number of the thumbnail windows to be selected from the pseudo-color plate library, and sequentially determining the target pseudo-color plates as pseudo-color plate attributes corresponding to the thumbnail windows to be selected, comprises: According to the initial arrangement order of the pseudo-color plates in the pseudo-color plate library, the target pseudo-color plates corresponding to the number of the thumbnail windows to be selected are obtained; or, according to the selection instruction of the pseudo-color plates in the pseudo-color plate library, the target pseudo-color plates corresponding to the number of the thumbnail windows to be selected are obtained; The corresponding thumbnail numbers are determined in sequence according to the arrangement of the thumbnail windows to be selected, and the target pseudo-color palette is determined in sequence as the pseudo-color palette attributes corresponding to the thumbnail numbers.

8. The pseudo-color realization method according to claim 7, characterized in that: The pseudo color plate library includes pseudo color plate files in picture format and / or pseudo color plate files in document format recording color mapping relationships corresponding to pseudo color conversion; The pseudo-color implementation method further includes: Obtaining a local upgrade instruction for a pseudo-color plate file, receiving an uploaded updated pseudo-color plate file based on the local upgrade instruction, adding the updated pseudo-color plate file to the pseudo-color plate library to achieve the upgrade or replacing the original pseudo-color plate file with the updated pseudo-color plate file to achieve the upgrade; and / or, Obtain an online upgrade instruction for the pseudo-color plate file, obtain an updated pseudo-color plate file from the cloud based on the online upgrade instruction, add the updated pseudo-color plate file to the pseudo-color plate library to achieve the upgrade or replace the original pseudo-color plate file with the updated pseudo-color plate file to achieve the upgrade.

9. The pseudo-color realization method according to claim 6, characterized in that: The method of determining the coordinate mapping relationship corresponding to the position of each of the thumbnail windows to be selected in the pseudo-color selection interface according to the number and arrangement of the thumbnail windows to be selected currently to be displayed and using the OpenGL rendering principle includes: According to the number and arrangement of the thumbnail windows to be selected currently to be displayed, the coordinate scaling ratio and coordinate translation size corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface are determined.

10. The pseudo-color realization method according to claim 9, characterized in that: The determining, according to the number and arrangement of the currently displayed thumbnail windows to be selected, the coordinate scaling ratio and coordinate translation size corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface, comprises: If the arrangement of the thumbnail windows to be selected is horizontal, determining the horizontal coordinate scaling ratio and the horizontal coordinate translation value corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface according to the number of the thumbnail windows to be selected; If the arrangement of the thumbnail windows to be selected is vertical, determining the vertical coordinate scaling ratio and the vertical coordinate translation value corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface according to the number of the thumbnail windows to be selected; If the arrangement of the thumbnail windows to be selected is a grid, the horizontal axis scaling ratio and the vertical axis scaling ratio corresponding to the position of each thumbnail window to be selected in the pseudo-color selection interface, as well as the corresponding horizontal axis translation value and the vertical axis translation value are determined according to the number of rows and columns of the thumbnail windows to be selected.

11. The pseudo-color realization method according to claim 9, characterized in that: The displaying of the image data in each of the thumbnail windows to be selected according to the coordinate mapping relationship, and presenting corresponding pseudo color effects on the image data in each of the thumbnail windows to be selected according to the pseudo color plate attributes, include: Calculating the position coordinates of the pixel points in each of the thumbnail windows to be selected after the coordinate transformation according to the coordinate scaling ratio and coordinate translation size corresponding to each of the thumbnail windows to be selected; According to the image data to be displayed currently, determining the image data corresponding to the position coordinates of each pixel point after the coordinate transformation as pixel data; According to the pseudo-color plate attributes corresponding to each of the thumbnail windows to be selected, the image data of each of the pixels in each of the thumbnail windows to be selected are processed using the corresponding pseudo-color plate to obtain real-time pseudo-color results that present corresponding pseudo-color effects on the image data in each of the thumbnail windows to be selected.

12. The pseudo-color realization method according to claim 1, characterized in that: The display setting information also includes identification setting information of the identification area corresponding to each of the thumbnail windows to be selected; the image data is displayed in each of the thumbnail windows to be selected according to the coordinate mapping relationship, and the corresponding pseudo color effect is presented on the image data in each of the thumbnail windows to be selected according to the pseudo color plate attribute, including: According to the pseudo-color plate attributes corresponding to each of the thumbnail windows to be selected, the image data of each of the pixel points in each of the thumbnail windows to be selected are respectively processed through the corresponding pseudo-color plate, so that corresponding pseudo-color effects are presented on the real-time image data in each of the thumbnail windows to be selected, and the real-time pseudo-color results of the pseudo-color category names of the corresponding pseudo-color plate are displayed in the identification area corresponding to each of the thumbnail windows to be selected.

13. The pseudo-color realization method according to claim 1, characterized in that: The step of obtaining display setting information of a thumbnail window to be selected in the pseudo-color selection interface includes: According to the initialization settings of the pseudo-color selection interface, obtaining display setting information of the thumbnail window to be selected in the pseudo-color selection interface; and / or, Based on the configuration operation of the number and arrangement of the thumbnail windows to be selected in the pseudo-color selection interface, the display setting information of the thumbnail windows to be selected in the pseudo-color selection interface is obtained.

14. The pseudo-color realization method according to claim 1, characterized in that: Also includes: According to the switching operation on the thumbnail window to be selected in the current pseudo-color selection interface, obtaining a switching instruction corresponding to the current switching operation; According to the switching instruction, the target pseudo-color palette attribute corresponding to each of the selected thumbnail windows that currently need to switch the pseudo-color palette is selected from the currently selectable pseudo-color palette attributes; The image data in each of the thumbnail windows to be selected are processed by the target pseudo-color plate attribute to obtain real-time pseudo-color results showing corresponding pseudo-color effects on the real-time image data in each of the thumbnail windows to be selected after switching.

15. The pseudo-color realization method according to claim 14, characterized in that: The current switching operation is an operation of sliding m thumbnail windows to be selected in a specified direction, wherein m is less than or equal to the number of selectable pseudo-color panels, and the number of thumbnail windows to be selected in the pseudo-color selection interface is n; and selecting, according to the switching instruction, from the currently selectable pseudo-color panel attributes, the target pseudo-color panel attributes corresponding to each of the thumbnail windows to be selected that currently need to switch the pseudo-color panel, includes: Selecting m pseudo-color palette attributes in sequence from currently selectable pseudo-color palette attributes according to a switching instruction corresponding to the current switching operation; If m is greater than or equal to n, the m pseudo-color plate attributes are used to sequentially replace the target pseudo-color plate attributes corresponding to each of the thumbnail windows to be selected in the pseudo-color selection interface; If m is less than n, the pseudo-color plate attributes corresponding to the nm thumbnail windows to be selected and retained in the current pseudo-color selection interface are added to the m pseudo-color plate attributes, and the target pseudo-color plate attributes corresponding to each thumbnail window to be selected in the pseudo-color selection interface are replaced in sequence.

16. The pseudo-color realization method according to claim 1, characterized in that: The acquiring of real-time image data comprises: Obtaining a preview instruction for the currently captured image data, switching to a pseudo-color selection interface including a preview window and a thumbnail window to be selected according to the preview instruction, and using the currently captured image data as real-time image data to be displayed; or, Obtaining a preview instruction for the currently browsed image, switching to a pseudo-color selection interface including a preview window and a thumbnail window to be selected according to the preview instruction, and using the currently browsed image as real-time image data to be displayed; or, In the preview mode, a pseudo-color selection interface including a preview window and a thumbnail window to be selected is displayed, a selection instruction for uploading target image data is obtained, and the target image data is used as real-time image data to be displayed according to the selection instruction.

17. An infrared thermal imaging device, characterized in that: Includes processor, memory and image sensor; The image sensor is used to collect real-time image data and send it to the processor, and the image sensor includes an infrared sensor; the memory stores a computer program, and when the computer program is executed by the processor, the pseudo-color realization method according to any one of claims 1 to 16 is implemented.

18. The infrared thermal imaging device according to claim 17, characterized in that: The processor comprises an image processor, and the image processor is used to perform parallel calculation on the coordinate mapping relationship of each of the thumbnail windows to be selected.

19. The infrared thermal imaging device according to claim 18, characterized in that: The real-time image data is infrared video data captured in real time for a target scene.

20. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the pseudo-color realization method according to any one of claims 1 to 16 is implemented.

Images