Target highlighting method and device, storage medium and infrared night vision device

Abstract

The invention provides a target highlighting method and device, a storage medium and an infrared night vision device. The target highlighting method comprises the following steps: acquiring an interested temperature zone and an infrared image; converting the interested temperature zone into an interested pixel value interval according to a temperature pixel mapping curve, wherein the temperature pixel mapping curve is calibrated in advance; a first interested temperature zone TOI mask is obtained according to the interested pixel value interval and the pixel value of each pixel in the infrared image, the first TOI mask comprises a target area, the pixel value of each pixel in the target area is 1, and the pixel value of each pixel outside the target area is 0; and highlighting the target area in the infrared image at least according to the first TOI mask. The invention provides a scheme capable of distinguishing the target from the background in the infrared image and highlighting the target.

Description

Technical Field

[0001] This application relates to the field of image processing technology, and in particular to a target highlighting method and apparatus, a storage medium, and an infrared night vision device. Background Technology

[0002] Infrared night vision devices can display infrared images captured by infrared image sensors in real time on an integrated handheld display screen, and are often used for hunting or animal observation at night.

[0003] However, when the background contains objects with high temperatures, the temperature of the target is close to that of the background, and the target is mixed in with the background, making it difficult to detect in infrared images. Summary of the Invention

[0004] This application provides a target highlighting method and apparatus, which provides a solution for distinguishing a target from the background in an infrared image and highlighting the target.

[0005] To achieve the above objectives, this application provides the following technical solution:

[0006] In a first aspect, a target highlighting method is provided, which is applied to a terminal device, a chip in a terminal device, or a chip module. The target highlighting method includes: acquiring a region of interest (ROI) and an infrared image; converting the ROI into a range of pixel values ​​of interest according to a temperature-pixel mapping curve, wherein the temperature-pixel mapping curve is pre-calibrated; obtaining a first ROI TOI mask based on the range of pixel values ​​of interest and the pixel values ​​of each pixel in the infrared image, wherein the first TOI mask includes a target region, wherein the pixel value of each pixel within the target region is 1, and the pixel value of each pixel outside the target region is 0; and highlighting the target region in the infrared image at least based on the first TOI mask.

[0007] Optionally, each pixel within the target area corresponds to a pixel in the infrared image whose pixel value is within the range of the pixel value of interest, and each pixel outside the target area corresponds to a pixel in the infrared image whose pixel value is outside the range of the pixel value of interest.

[0008] Optionally, after obtaining the first temperature of interest (TOI) mask in the infrared image based on the range of pixel values ​​of interest, the method further includes: performing a morphological opening operation on the first TOI mask to eliminate the high and low temperature transition zone from the first TOI mask, thereby obtaining a second TOI mask, wherein the second TOI mask is used to highlight the target region.

[0009] Optionally, the target highlighting method further includes: performing a morphological dilation operation on the second TOI mask to obtain a third TOI mask, wherein the target region in the third TOI mask contains the complete target.

[0010] Optionally, highlighting the target region in the infrared image at least according to the first TOI mask includes: highlighting the target region in the infrared image according to the third TOI mask.

[0011] Optionally, highlighting the target region in the infrared image at least according to the first TOI mask includes performing at least one of the following operations on the target region in the infrared image: coloring, image matting, or edge extraction.

[0012] Optionally, coloring the target region in the infrared image includes: mapping the pixel value of each pixel in the infrared image to a corresponding color value to obtain a color image; for each pixel within the target region, determining the pixel value of each pixel to be the pixel value of the corresponding pixel in the color image; and for each pixel outside the target region, determining the pixel value of each pixel to be the pixel value of the corresponding pixel in the infrared image.

[0013] Optionally, the step of cutting out the target region in the infrared image includes: multiplying the first TOI mask, the second TOI mask, or the third TOI mask with the infrared image to obtain the target image.

[0014] Optionally, the edge extraction of the target region in the infrared image includes: traversing the infrared image through a sliding window and calculating the maximum pixel value, the center pixel value, and the minimum pixel value within the sliding window; determining the edges of each object in the infrared image using at least one of the following methods to obtain a contour image: calculating the difference between the maximum pixel value and the minimum pixel value; calculating the difference between the maximum pixel value and the center pixel value; calculating the difference between the center pixel value and the minimum pixel value; and multiplying the first TOI mask, the second TOI mask, or the third TOI mask with the contour image to obtain the target image.

[0015] Secondly, this application also discloses a target highlighting device, comprising: an acquisition module for acquiring a temperature region of interest (TRI) and an infrared image; a conversion module for converting the TRI into a range of pixel values ​​of interest (PI) according to a temperature-pixel mapping curve, wherein the temperature-pixel mapping curve is pre-calibrated; a TOI mask determination module for obtaining a first TRI TOI mask based on the range of PI and the pixel values ​​of each pixel in the infrared image, wherein the first TOI mask includes a target region, wherein the pixel value of each pixel within the target region is 1, and the pixel value of each pixel outside the target region is 0; and a highlighting module for highlighting the target region in the infrared image at least based on the first TOI mask.

[0016] Thirdly, a computer-readable storage medium is provided having a computer program stored thereon, the computer program being executed by a processor to perform the method provided in the first aspect.

[0017] Fourthly, a computer program product is provided, on which a computer program is stored, the computer program being executed by a processor to perform the method provided in the first aspect.

[0018] Fifthly, embodiments of this application also provide a chip that stores a computer program, which, when executed by the chip, implements the steps of the above-described method.

[0019] In a sixth aspect, embodiments of this application also provide a system chip for use in a terminal. The system chip includes at least one processor and an interface circuit, the interface circuit and the at least one processor being interconnected via a line. The at least one processor is used to execute instructions to perform a method provided in the first aspect.

[0020] In a seventh aspect, embodiments of this application also provide an infrared night vision device, including a memory and a processor, wherein the memory stores a computer program executable on the processor, and the processor executes the steps of the target highlighting method described in the first aspect when running the computer program.

[0021] Compared with the prior art, the technical solution of this application has the following beneficial effects:

[0022] In this application's technical solution, a temperature of interest (TOI) region for the target can be pre-set. Since there is a mapping relationship between temperature and pixel values ​​in an infrared image, the TOI region can be converted into a range of pixel values ​​of interest. Using this range, a first TOI mask including the target region can be obtained in the infrared image. This first TOI mask allows for the differentiation between the target and the background, highlighting the target within the TOI region and improving the distinction between the target and the background in the infrared image.

[0023] Furthermore, this solution requires minimal computation and can output data in real time on mobile devices such as infrared night vision devices.

[0024] Furthermore, by performing a morphological opening operation on the first TOI mask, this application can eliminate the high and low temperature transition zone from the first TOI mask, thereby preventing objects whose temperature is outside the temperature of interest from being misidentified as targets and improving the accuracy of distinguishing targets from the background.

[0025] Furthermore, this application obtains a third TOI mask by performing a morphological dilation operation on the second TOI mask. This allows the target area in the third TOI mask to be expanded by several pixels compared to the target area in the second TOI mask, thus enabling the target to be more completely contained within the third TOI mask. In addition, since the high and low temperature transition zone in the second TOI mask has already been eliminated through the morphological opening operation, performing a morphological dilation operation on the second TOI mask will not restore the eliminated high and low temperature transition zone, but will only dilate the target area existing in the second TOI mask. This makes the subsequent target highlighting process more natural, and makes the subsequent target edges thicker, more solid, and more continuous, thereby improving the user experience. Attached Figure Description

[0026] Figure 1 This is a schematic diagram of an infrared image in the prior art;

[0027] Figure 2 This is a flowchart of a target highlighting method provided in an embodiment of this application;

[0028] Figure 3 This is a schematic diagram of a pixel mapping curve provided in an embodiment of this application;

[0029] Figures 4 to 6 This is a schematic diagram illustrating a specific application scenario provided in the embodiments of this application;

[0030] Figure 7 This is a comparative diagram of a first TOI mask and a second TOI mask provided in an embodiment of this application;

[0031] Figure 8This is a comparative schematic diagram of a second TOI mask and a third TOI mask provided in an embodiment of this application;

[0032] Figure 9 This is a flowchart illustrating a specific process for staining a target region, as provided in an embodiment of this application.

[0033] Figure 10 This is a flowchart illustrating a specific process for edge extraction of a target region, as provided in an embodiment of this application.

[0034] Figure 11 This is a schematic diagram of a target edge provided in an embodiment of this application;

[0035] Figure 12 This is a schematic diagram of the structure of a target highlighting device provided in an embodiment of this application. Detailed Implementation

[0036] As described in the background section, when the background contains objects with higher temperatures, the target becomes difficult to spot. Specifically, because tree bark is dark in color, it absorbs more heat during the day, and its temperature remains relatively high even at night. When animals are in the forest, such as... Figure 1 The distinction between animals and the background in the infrared images shown will decrease, making them harder to detect.

[0037] In this technical solution, the temperature of interest (TRI) of the target can be preset. Since there is a mapping relationship between temperature and pixel values ​​in an infrared image, the TRI can be converted into a range of pixel values ​​of interest. Using this range, a first TOI mask including the target region can be obtained in the infrared image. This first TOI mask allows for the differentiation between the target and the background, highlighting the target within the TRI and improving the distinction between the target and the background in the infrared image.

[0038] All user data involved in the technical solution of this application has been obtained with user authorization. For example, the user is informed of the purpose, scope and permissions of the data through the interactive interface, and valid authorization is obtained after the user actively checks the box to agree or completes the electronic signature.

[0039] To facilitate understanding of the technical solution of this application, a brief introduction to the relevant technologies involved in this application will be given first.

[0040] To make the above-mentioned objectives, features and advantages of this application more apparent and understandable, specific embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0041] This application provides a target highlighting method, referring to... Figure 2 The following will provide a detailed explanation through specific steps.

[0042] It is understood that, in specific implementations, the target highlighting method can be implemented using software programs, which run within a processor integrated into the chip or chip module. This method can also be implemented using a combination of software and hardware; this application does not impose any limitations on this approach. The following description uses a terminal device as the executing entity.

[0043] In step 201, the temperature region of interest and infrared images are acquired.

[0044] In step 202, the region of interest is converted into a range of pixel values ​​of interest based on the temperature pixel mapping curve, which is pre-calibrated.

[0045] In step 203, a first region of interest (TOI) mask is obtained based on the range of pixel values ​​of interest and the pixel values ​​of each pixel in the infrared image.

[0046] In step 204, the target region is highlighted in the infrared image at least according to the first TOI mask.

[0047] It should be noted that the sequence number of each step in this embodiment does not represent a limitation on the execution order of each step.

[0048] In this embodiment, the temperature zones of interest [temp_lo, temp_hi] can be preset by the user according to the usage scenario or target. For example, in a hunting scenario, if the target is a wild boar, the temperature zones of interest can be set to the surface temperature range of the wild boar: temp_lo = 38℃, temp_hi = 39.5℃.

[0049] In this embodiment, the infrared image can be the original infrared image acquired by the infrared sensor, or the original infrared image after non-uniformity correction (NUC). Non-uniformity correction can eliminate fixed pattern noise caused by the non-uniformity of the detector itself in the original infrared image, and can also enhance contrast and make details clearer.

[0050] It should be noted that non-uniformity correction can employ any appropriate algorithm, such as two-point correction, multi-point correction, time-domain high-pass filtering, spatial registration, etc., and this application does not impose any restrictions on it.

[0051] In the specific implementation of step 202, the temperature-pixel mapping curve can represent the mapping relationship between temperature and pixel values. The temperature-pixel mapping curve is as follows: Figure 3As shown, the graph is pre-calibrated, where the horizontal axis represents temperature values ​​and the vertical axis represents pixel values, which can specifically be grayscale values. The specific calibration process for the temperature-pixel mapping curve is as follows: A blackbody capable of uniform heating is set to different temperature values. An infrared image sensor is used to capture images of the blackbody, obtaining corresponding infrared images. The pixel values ​​of the infrared images obtained at different temperatures are measured to obtain the temperature-pixel mapping curve.

[0052] Therefore, the mapping relationship represented by the temperature pixel mapping curve can be used to map the lower threshold temp_lo and upper threshold temp_hi of the temperature region of interest to the lower threshold pix_lo and upper threshold pix_hi of the pixel value range of interest.

[0053] It is important to note that the temperature-pixel mapping curve may change with variations in ambient temperature, meaning the mapping relationship between temperature and pixel values ​​may also change. Therefore, in practical applications, it is necessary to measure a series of temperature-pixel mapping curves under different ambient temperatures beforehand, and then, based on the current actual ambient temperature, use the temperature-pixel mapping curve under the actual ambient temperature to convert the range of pixel values ​​of interest.

[0054] Furthermore, in response to the absence of a temperature pixel mapping curve under the actual ambient temperature, at least two temperature pixel mapping curves at the temperature closest to the actual ambient temperature can be retrieved, and interpolation can be performed based on the at least two temperature pixel mapping curves to obtain a temperature pixel mapping curve applicable under the actual ambient temperature, which can be used to convert the range of pixel values ​​of interest.

[0055] In the specific implementation of step 203, a first TOI mask is obtained based on the lower threshold pix_lo and the upper threshold pix_hi of the range of pixel values ​​of interest. The first TOI mask includes the target region, where each pixel within the target region has a pixel value of 1, and each pixel outside the target region has a pixel value of 0. The target region represents the area where the target is located, and the target temperature is within the region of interest.

[0056] The first TOI mask, the second TOI mask, and the third TOI mask referred to in this application have the same size and the same number of pixels as the infrared image.

[0057] Furthermore, each pixel within the target area of ​​the first TOI mask corresponds to a pixel in the infrared image whose pixel value falls within the range of pixel values ​​of interest, and each pixel outside the target area corresponds to a pixel in the infrared image whose pixel value falls outside the range of pixel values ​​of interest. That is, for a pixel in the infrared image whose pixel value is between pix_lo and pix_hi, the corresponding pixel value of the first TOI mask at that pixel is equal to 1; the pixel value of the first TOI mask at other pixel positions is equal to 0.

[0058] Continue to refer to Figure 2 Then, in step 204, the target area is highlighted in the infrared image based on the first TOI mask, that is, the target area is distinguished from the background and highlighted in the infrared image.

[0059] Specifically, highlighting a target region in an infrared image can refer to performing at least one of the following operations on the target region in the infrared image: coloring, matting, or edge extraction. For example... Figures 4 to 6 As shown, Figure 4 In the infrared image shown, the target is colored red. Figure 5 In the infrared image shown, the target is cut out and displayed; the target is white and the background is black. Figure 6 The infrared image shown displays the outline of the target, which is displayed in white, while the rest is in black.

[0060] It should be noted that the target is colored red in this embodiment for illustrative purposes only. In practice, the target can be colored with any appropriate color as needed, such as green, yellow, blue, or other colors. This application does not impose any restrictions on this.

[0061] In a non-limiting embodiment, if the infrared image contains a high-temperature object outside the region of interest (ROI), the temperature will transition from high to low at the boundary between the high-temperature object and the lower-temperature background. Pixel values ​​in this transition zone typically fall within the ROI range, causing the first TOI mask to include this transition zone within the target area. Therefore, when highlighting the target later, the high-temperature object will also be highlighted; for example, a ring around the high-temperature object will be colored and cut out, and edges will appear around it after edge extraction. However, since the temperature of the high-temperature object is outside the ROI and it is not part of the target, it should not actually be highlighted.

[0062] Since the high-low temperature transition zone appears as a narrow strip surrounding the high-temperature object in the image, the high-low temperature transition zone can be removed from the first TOI mask by performing a morphological opening operation on the first TOI mask to obtain the second TOI mask.

[0063] Please refer to the details. Figure 7 , Figure 7 The infrared image shown in Figure a includes a kettle and a person. The kettle's temperature is approximately 70°C, and the person's surface temperature is approximately 35°C. The region of interest (ROI) is set to temp_lo=34°C and temp_hi=36°C. Because there is a gradual temperature transition zone around the hot object (kettle), and a portion of this transition zone overlaps with the ROI, a first TOI mask without morphological opening operations (such as...) is used. Figure 7As shown in a1, subsequent target highlighting operations are performed. For example, during coloring operations, the transition region around a high-temperature object will also be colored (e.g., ...). Figure 7 (As shown in b1); During the cutout operation, the transition area around the high-temperature object will also be cut out (e.g., Figure 7 (As shown in c1); During edge extraction, the transition area around the high-temperature object will also be drawn with edges (as shown in c1). Figure 7 As shown in d1), this led to a misoperation.

[0064] This embodiment uses a second TOI mask after morphological opening operations (such as...). Figure 7 As shown in a2, subsequent staining operations can solve this problem, allowing staining of human skin only within the temperature range of interest (e.g., as shown in a2). Figure 7 (as shown in b2), or, only the human target within the TOI temperature range can be cut out (e.g. Figure 7 (as shown in c2); or, only perform edge extraction on human targets within the TOI temperature range (e.g., Figure 7 (As shown in d2). This embodiment can prevent objects whose temperature is outside the temperature range of interest from being misidentified as targets, thus improving the accuracy of distinguishing targets from the background.

[0065] The morphological opening operation referred to in this embodiment is a basic operation in mathematical morphology, which is composed of two more fundamental operations combined in a specific order: first erosion, then dilation.

[0066] In a non-limiting embodiment, the target also has the problem of a temperature transition zone, so a morphological dilation operation can be performed on the second TOI mask to obtain a third TOI mask, in which the target area contains the complete target.

[0067] In this embodiment, by performing a morphological dilation operation on the second TOI mask, the area in the second TOI mask with a pixel value of 1 can be expanded by several pixels, thereby more completely including the thermal target in the third TOI mask. By highlighting the target area in the infrared image according to the third TOI mask, the subsequent coloring and matting transitions can be more natural, and the subsequent edge extraction can be coarser, more solid, and more continuous.

[0068] In this embodiment, the morphological dilation operation refers to enlarging or lengthening the foreground region (usually white pixels) in an image, causing its boundaries to expand outward.

[0069] Please refer to the details. Figure 8 , Figure 8The infrared image shown in Figure a includes a kettle and a person. The kettle's temperature is approximately 70°C, and the person's surface temperature is approximately 35°C. The regions of interest (TRI) are set to temp_lo=34°C and temp_hi=36°C. The second TOI mask and the effect of using the second mask to highlight the target area can be found in the following images: Figure 8 As shown in a2-d2. Correspondingly, the third TOI mask and the effect of using the third mask to highlight the target area can be found in the following diagrams. Figure 8 As shown in a3, b3, c3, and d3.

[0070] from Figure 8 As can be seen, compared to the second TOI mask, the target area in the third TOI mask is larger, the subsequent coloring and cutout transitions are more natural, the edge extraction is coarser, more solid and more continuous, and the target is highlighted better.

[0071] In a non-limiting embodiment, the target region can be colored in the infrared image to output a target image in which only the target is colored, such as... Figure 4 As shown. For the specific operational procedures of staining the target area, please refer to [the provided text]. Figure 9 .

[0072] In step 901, the pixel values ​​of each pixel in the infrared image are mapped to corresponding color values ​​to obtain a color image.

[0073] Specifically, infrared images are typically grayscale images. After being processed by a color palette, the infrared image becomes a color image (ir_rgb). For example, a predefined color lookup table, or color palette, maps the grayscale value of each pixel in the infrared image to an RGB triplet, outputting a three-channel color image.

[0074] In step 902, for each pixel in the target area, the pixel value of each pixel is determined to be the pixel value of the corresponding pixel in the color image.

[0075] In step 903, for each pixel outside the target area, the pixel value of each pixel is determined to be the pixel value of the corresponding pixel in the infrared image.

[0076] Specifically, iterate through each pixel (i,j) in the infrared image. If the pixel value mask_toi[i,j] of the corresponding position in the TOI mask is equal to 1, then the pixel value of the corresponding position in the target image is the pixel value of the corresponding position in the color image, and the corresponding three-channel values ​​are: ir_rgb_toi[i,j,0]=ir_rgb[i,j,0], ir_rgb_toi[i,j,1]=ir_rgb[i,j,1], ir_rgb_toi[i,j,2]=ir_rgb[i,j,2]; if mask_toi[i,j] is equal to 0, then the pixel value of the corresponding position in the target image is the pixel value of the corresponding position in the infrared image, and the corresponding three-channel values ​​are: ir_rgb_toi[i,j,0]=ir_gray[i,j], ir_rgb_toi[i,j,1]= ir_gray[i,j], ir_rgb_toi[i,j,2]= ir_gray[i,j].

[0077] It should be noted that since the size and number of pixels of the infrared image, TOI mask, and color image are the same, it is also possible to traverse each pixel in the TOI mask or color image. This application does not impose any restrictions on this.

[0078] In this embodiment, since only the content within the region of interest is colored in the entire infrared image, while the rest remains a black and white image, the target within the region of interest is highlighted, making it easier for the observer to find and lock onto the target.

[0079] In a non-limiting embodiment, the target region can be cut out from the infrared image to output a target image containing only the target, with a black background. Figure 5 As shown.

[0080] In this embodiment, the first TOI mask, the second TOI mask, or the third TOI mask is multiplied with the infrared image to obtain the target image.

[0081] In practice, since the TOI mask is a binary image, the effect of multiplying the TOI mask with the infrared grayscale image is to preserve the content within the region of interest in the infrared grayscale image, while the content outside the region of interest is all black. This makes the target within the region of interest stand out, making it easier for the observer to find and lock onto the target.

[0082] In a non-limiting embodiment, edge extraction of the target region can be performed in the infrared image to output a target image. The target image contains only the outline of the target, with a black background. Figure 6As shown. For the specific operational procedures of staining the target area, please refer to [the provided text]. Figure 10 .

[0083] Step 1001: Traverse the infrared image through a sliding window and calculate the maximum pixel value, the center pixel value, and the minimum pixel value within the sliding window.

[0084] Specifically, the size of the sliding window can be selected according to actual needs, such as 5×5 (unit: pixels), 3×3, 7×7, etc. The larger the sliding window, the coarser the outline of the target obtained by edge extraction; the smaller the sliding window, the finer the outline of the target obtained by edge extraction. The specific size of the sliding window can depend on factors such as image resolution and user preferences, and this application does not impose any restrictions on it.

[0085] By traversing the infrared image through a sliding window, the maximum pixel value pix_max, the minimum pixel value pix_min, and the center pixel value pix_cen within the sliding window are calculated.

[0086] Step 1002: Determine the edges of each object in the infrared image using at least one of the following methods to obtain a contour image:

[0087] Calculate the difference between the maximum and minimum pixel values;

[0088] Calculate the difference between the maximum pixel value and the center pixel value;

[0089] Calculate the difference between the center pixel value and the minimum pixel value.

[0090] In this embodiment, different forms of edges of the target can be extracted through different methods. Specifically, for Figure 11 In the infrared image shown in Figure a, the two sides of the target can be extracted by the difference between the maximum and minimum pixel values ​​(e.g., ...). Figure 11 As shown in b), the two sides are relatively thick and solid, and the range of the edge includes the width of several pixels inside and outside the infrared thermal target. It can be used to display independently in an infrared thermal imager, or it can be used to fuse with visible light images in an infrared and visible light fusion device.

[0091] for Figure 11 In the infrared image shown in Figure a, the inner edge of the target can be extracted by the difference between the center pixel value and the minimum pixel value (e.g., ...). Figure 11 As shown in Figure c), the inner edge is thinner, and the edge range is contained within the inner side of the infrared thermal target; it can be used to display independently in an infrared thermal imager, or to be fused with a visible light image in an infrared and visible light fusion device. Since the inner edge of the thermal target is completely contained within the infrared thermal target, it can both highlight the target and facilitate more accurate target locking in scenarios such as hunting.

[0092] for Figure 11 In the infrared image shown in Figure a, the outer edge of the target can be extracted by the difference between the maximum pixel value and the center pixel value (e.g., ...). Figure 11 As shown in d), the outer edge of the image is the same thickness as the inner edge of the thermal target, and its edge extends to encompass the outer side of the infrared thermal target. It can be used to display independently in an infrared thermal imager, or to fuse infrared and visible light images in a fusion device. Because the outer edge of the thermal target encompasses the outer side of the infrared thermal target, it both highlights the target and, when fused with a visible light image, does not obstruct the visible light image of the thermal target, thus allowing for better visualization of visible light image details.

[0093] In this embodiment, the contour image includes the edges of various objects in the infrared image. To highlight the edges of the target area, a TOI mask is also needed to filter the edges of the target area.

[0094] Continue to refer to Figure 11 In step 1003, the first TOI mask, the second TOI mask, or the third TOI mask is multiplied with the contour image to obtain the target image.

[0095] In this embodiment, since the TOI mask is a binary image, the image obtained by multiplying the TOI mask with the contour image can retain the content within the region of interest (ROI) in the contour image, while all content outside the ROI is black. Step 1003 can eliminate the contours of other areas outside the target area, retaining only the contours within the ROI, thereby highlighting the target and improving the distinction between the target and the background in the infrared image.

[0096] Please refer to Figure 12 , Figure 12 A target highlighting device 120 is shown, which may include:

[0097] The acquisition module 1201 is used to acquire the temperature region of interest and infrared images;

[0098] The conversion module 1202 is used to convert the region of interest into a range of pixel values ​​of interest according to the temperature pixel mapping curve, wherein the temperature pixel mapping curve is pre-calibrated.

[0099] TOI mask determination module 1203 is used to obtain a first region of interest (TOI) mask based on the range of pixel values ​​of interest and the pixel values ​​of each pixel in the infrared image. The first TOI mask includes a target area, where the pixel value of each pixel within the target area is 1 and the pixel value of each pixel outside the target area is 0.

[0100] The highlighting module 1204 is used to highlight the target area in the infrared image at least according to the first TOI mask.

[0101] In specific implementations, the aforementioned target highlighting device 120 may correspond to a chip with communication function in a terminal device, such as a system-on-a-chip (SOC), a baseband chip, etc.; or to a chip module in a terminal device that includes a chip with communication function; or to a chip module with a chip with data processing function; or to a terminal device.

[0102] Other relevant descriptions of the target highlighting device 120 can be found in the descriptions in the foregoing embodiments, and will not be repeated here.

[0103] Regarding the modules / units included in the various devices and products described in the above embodiments, they can be software modules / units, hardware modules / units, or a combination of both. For example, for various devices and products applied to or integrated into a chip, all of their modules / units can be implemented using hardware methods such as circuits, or at least some modules / units can be implemented using software programs that run on a processor integrated within the chip, while the remaining (if any) modules / units can be implemented using hardware methods such as circuits; for various devices and products applied to or integrated into a chip module, all of their modules / units can be implemented using hardware methods such as circuits, and different modules / units can be located in the same component (e.g., chip, circuit module, etc.) or different components of the chip module, or at least some modules / units can be implemented using hardware methods such as circuits. The implementation is achieved through a software program that runs on the processor integrated within the chip module. The remaining modules / units (if any) can be implemented using hardware methods such as circuits. For various devices and products applied to or integrated into terminal equipment, each of their modules / units can be implemented using hardware methods such as circuits. Different modules / units can be located in the same component (e.g., chip, circuit module, etc.) or different components within the terminal equipment. Alternatively, at least some modules / units can be implemented through a software program that runs on the processor integrated within the terminal equipment, while the remaining modules / units (if any) can be implemented using hardware methods such as circuits.

[0104] This application also discloses a storage medium, which is a computer-readable storage medium storing a computer program thereon. When the computer program is executed, it can perform the steps of the method shown in the foregoing embodiments. The storage medium may include read-only memory (ROM), random access memory (RAM), a magnetic disk, or an optical disk, etc. The storage medium may also include non-volatile memory or non-transitory memory, etc.

[0105] It should be understood that the term "and / or" in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Additionally, the character " / " in this article indicates that the preceding and following related objects have an "or" relationship.

[0106] In the embodiments of this application, "multiple" refers to two or more.

[0107] The descriptions of "first," "second," etc., appearing in the embodiments of this application are for illustrative purposes and to distinguish the objects being described. They have no order and do not indicate any special limitation on the number of devices in the embodiments of this application, nor do they constitute any limitation on the embodiments of this application.

[0108] The above embodiments can be implemented, in whole or in part, by software, hardware, firmware, or any other combination thereof. When implemented using software, the above embodiments can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer program are loaded or executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired or wireless means.

[0109] It should be understood that in the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0110] In the several embodiments provided in this application, it should be understood that the disclosed methods, apparatuses, and systems can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for example, the division of units is merely a logical functional division, and other division methods may exist in actual implementation; for example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0111] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0112] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can be physically included separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or in the form of hardware plus software functional units.

[0113] The integrated unit implemented as a software functional unit described above can be stored in a computer-readable storage medium. This software functional unit, stored in a storage medium, includes several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute some steps of the methods described in the various embodiments of this application.

[0114] While this application discloses the above information, it is not limited thereto. Any person skilled in the art can make various modifications and alterations without departing from the spirit and scope of this application; therefore, the scope of protection of this application shall be determined by the scope defined in the claims.

Claims

1. A target highlighting method, characterized in that, include: Acquire the temperature region of interest and infrared images; The temperature region of interest is converted into a range of pixel values ​​of interest based on the temperature pixel mapping curve, which is pre-calibrated. A first region of interest (TOI) mask is obtained based on the range of pixels of interest and the pixel values ​​of each pixel in the infrared image. The first TOI mask includes a target region, where the pixel value of each pixel within the target region is 1, and the pixel value of each pixel outside the target region is 0. The target region is highlighted in the infrared image at least according to the first TOI mask.

2. The target highlighting method according to claim 1, characterized in that, Each pixel within the target area corresponds to a pixel in the infrared image whose pixel value is within the range of the pixel value of interest, and each pixel outside the target area corresponds to a pixel in the infrared image whose pixel value is outside the range of the pixel value of interest.

3. The target highlighting method according to claim 1, characterized in that, After obtaining the first region of interest (TOI) mask in the infrared image based on the range of pixel values ​​of interest, the process further includes: A morphological opening operation is performed on the first TOI mask to remove the high and low temperature transition zone from the first TOI mask, resulting in a second TOI mask, which is used to highlight the target area.

4. The target highlighting method according to claim 3, characterized in that, Also includes: A morphological dilation operation is performed on the second TOI mask to obtain a third TOI mask, wherein the target region in the third TOI mask contains the complete target.

5. The target highlighting method according to claim 4, characterized in that, Highlighting the target region in the infrared image at least according to the first TOI mask includes: The target area is highlighted in the infrared image according to the third TOI mask.

6. The target highlighting method according to any one of claims 1 to 5, characterized in that, Highlighting the target region in the infrared image at least according to the first TOI mask includes: Perform at least one of the following operations on the target region in the infrared image: coloring, matting, or edge extraction.

7. The target highlighting method according to claim 6, characterized in that, The step of coloring the target region in the infrared image includes: The pixel values ​​of each pixel in the infrared image are mapped to corresponding color values ​​to obtain a color image; For each pixel within the target area, the pixel value of each pixel is determined to be the pixel value of the corresponding pixel in the color image; For each pixel outside the target area, the pixel value of each pixel is determined to be the pixel value of the corresponding pixel in the infrared image.

8. The target highlighting method according to claim 6, characterized in that, The step of cutting out the target region in the infrared image includes: The first TOI mask, the second TOI mask, or the third TOI mask is multiplied with the infrared image to obtain the target image.

9. The target highlighting method according to claim 6, characterized in that, The step of edge extraction of the target region in the infrared image includes: The infrared image is traversed through a sliding window, and the maximum pixel value, center pixel value, and minimum pixel value within the sliding window are calculated. The edges of each object in the infrared image are determined using at least one of the following methods to obtain a contour image: Calculate the difference between the maximum pixel value and the minimum pixel value; Calculate the difference between the maximum pixel value and the center pixel value; Calculate the difference between the center pixel value and the minimum pixel value; The first TOI mask, the second TOI mask, or the third TOI mask is multiplied with the contour image to obtain the target image.

10. A target highlighting device, characterized in that, include: The acquisition module is used to acquire the temperature region of interest and infrared images; The conversion module is used to convert the region of interest into a range of pixel values ​​of interest according to the temperature pixel mapping curve, wherein the temperature pixel mapping curve is pre-calibrated; The TOI mask determination module is used to obtain a first TOI mask based on the range of pixels of interest and the pixel values ​​of each pixel in the infrared image. The first TOI mask includes a target area, where the pixel value of each pixel within the target area is 1, and the pixel value of each pixel outside the target area is 0. A highlighting module is used to highlight the target region in the infrared image at least according to the first TOI mask.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that, The computer program, when executed by a processor, performs the steps of the target highlighting method according to any one of claims 1 to 9.

12. A computer program product comprising a computer program / instructions, characterized in that, When the computer program / instructions are executed by the processor, they implement the steps of the target highlighting method according to any one of claims 1 to 9.

13. A chip, the chip comprising at least one processor and an interface circuit, the interface circuit being connected to the at least one processor, characterized in that, The processor executes the steps of the target highlighting method according to any one of claims 1 to 9 by running program instructions.

14. An infrared night vision device, comprising a memory and a processor, wherein the memory stores a computer program executable on the processor, characterized in that, When the processor runs the computer program, it performs the steps of the target highlighting method according to any one of claims 1 to 9.

Images