Operation method executed by image processor

By generating a second screen display pattern containing a protected area and performing image processing on the remaining areas, the problem of low accuracy of screen display bits in the prior art is solved, and a more accurate and natural image processing effect is achieved.

CN119071452APending Publication Date: 2024-12-03NOVATEK MICROELECTRONICS CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310938695.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-06-02
Filing Date
2023-07-28
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

The low accuracy of existing screen display bits results in unnatural and discontinuous boundary protection in image processing, and block sampling may lose small user interface elements, resulting in serious errors.

Method used

By receiving a mixed image of the input image and the screen display pattern, a second screen display pattern containing a plurality of protected areas is generated, and image processing is performed on the remaining areas to generate an output image, ensuring the accuracy of the pixel value of the protected area, and adjusting the alpha Values ​​generate fine OSD images.

Benefits of technology

It realizes more accurate screen display bit processing, avoids loss and error of interface elements, and provides a more natural and continuous image processing effect.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119071452A_ABST
    Figure CN119071452A_ABST
Patent Text Reader

Abstract

Provided is an operation method executed by an image processor, comprising the following operations: receiving a mixed image comprising an input image and a first screen display pattern; and generating a second screen display pattern different from the first screen display pattern based on the mixed image. The second screen display pattern includes a plurality of protection areas of the input image, and the protection areas are adjacent to the first screen display pattern. The operation method further includes performing an operation of image processing on a plurality of remaining regions of the input image different from the protected region and an operation of generating an output image. The output image includes the second screen display pattern and a remaining region of the input image on which the image processing is performed. According to the operation method provided by the invention, the pixel-by-pixel screen display pattern with excellent accuracy is provided.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to methods of operation performed by image processors. More specifically, the present disclosure relates to methods of operation performed by image processors for image processing with optimized on-screen-display (OSD) resolution. Background Art

[0002] Existing on-screen display bits are not very accurate because these OSD bits are designed to operate in blocks, which may cause some problems in image processing. The low accuracy of the OSD bits causes unnecessary protection of the edges of the user interface, and once the background is processed by the image, it will produce unnatural and discontinuous areas. In addition, due to block sampling, some small user interface elements may be lost. Methods such as complex gamma functions (igamma), concatenating convolutional encoder-decoder (CCE), super-resolution imaging (SR), and three-dimensional lookup tables (3D LUT) require pixel-level accuracy, and losing OSD data or generating redundant OSD data may cause serious errors. Summary of the invention

[0003] The present disclosure provides an operation method performed by an image processor, comprising the following operations: receiving a mixed image including an input image and a first screen display pattern; and generating a second screen display pattern different from the first screen display pattern based on the mixed image. The second screen display pattern includes a plurality of protection areas of the input image, and the protection areas are adjacent to the first screen display pattern. The operation method further includes an operation of performing image processing on a plurality of remaining areas of the input image different from the protection areas and an operation of generating an output image. The output image includes the second screen display pattern and the remaining areas of the input image on which the image processing is performed.

[0004] In some embodiments, the second screen display pattern in the output image includes the first screen display pattern, and the protection area in the output image is surrounded by the first screen display pattern in the output image.

[0005] In some embodiments, a difference between a first pixel value in the protection area and a maximum value of a second pixel value in the first screen display pattern is within an adaptive range.

[0006] In some embodiments, a difference between the third pixel value in the remaining area and a maximum value of the second pixel values ​​in the first screen display pattern is outside the adaptive range.

[0007] In some embodiments, a first pixel having a first pixel value and a second pixel having a second pixel value are included in a block, wherein each of the second pixels is arranged in a corner of a respective one of the blocks.

[0008] In some embodiments, the pixel values ​​of the protection area of ​​the input image and the pixel values ​​of the protection area of ​​the output image are the same.

[0009] In some embodiments, the number of pixels included in the second screen display pattern is different from the number of pixels included in the first screen display pattern.

[0010] In some embodiments, the number of pixels included in the second screen display pattern is greater than the number of pixels included in the first screen display pattern.

[0011] In some embodiments, performing image processing on the remaining area includes performing color change processing on the remaining area.

[0012] In some embodiments, a first difference between a first pixel value in the protection area and a second pixel value in the first screen display pattern is smaller than a second difference between a third pixel value in the remaining area and the second pixel value in the first screen display pattern.

[0013] In some embodiments, the operating method further includes: generating a first screen display image and a fused image based on the mixed image; and generating a second screen display image based on the first pixel value of the first screen display image and the second pixel value of the fused image. Generating a second screen display pattern includes generating a second screen display pattern based on the second screen display image and the fused image.

[0014] In some embodiments, the second screen display map indicates locations of pixels in the fused image where the difference between the second pixel value and a maximum value of the first pixel value is within the adaptive range.

[0015] In some embodiments, generating a first screen display image and a fused image includes: generating the first screen display image by adjusting an alpha value in a third pixel value in the mixed image to have a first value, and generating the fused image by adjusting the alpha value to have a second value different from the first value.

[0016] In some embodiments, generating the second screen display image includes comparing a maximum value of a first portion of first pixel values ​​with a maximum value of a second portion of first pixel values ​​to obtain a first difference value. The first portion of the first pixel values ​​corresponds to a key pixel in the first screen display image, and the second portion of the first pixel values ​​corresponds to a non-key pixel in the first screen display image. Generating the second screen display image also includes comparing the first difference value with a first predetermined value; comparing the second predetermined value with a second difference value, wherein the second difference value is a difference between the maximum value of the first portion of first pixel values ​​and one of the second pixel values ​​corresponding to the pixel being verified in the fused image; and generating a third pixel value of the second screen display image in response to the comparison.

[0017] In some embodiments, the second predetermined value is equal to half of the first difference.

[0018] It is to be understood that both the foregoing general description and the following detailed description are provided by way of example and are intended to provide further explanation of the patent claims of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to make the above and other objects, features, advantages and embodiments of the present disclosure more clearly understood, the accompanying drawings are described as follows:

[0020] Figure 1 is a schematic diagram of an electronic device using an on screen display (OSD) technology according to some embodiments of the present disclosure;

[0021] Figure 2 According to some embodiments of the present disclosure, Figure 1 A schematic diagram of a flow chart of an operating method of an electronic device;

[0022] Figure 3 According to some embodiments of the present disclosure, Figure 2 A schematic diagram of the operations in the operation method;

[0023] Figure 4 is a schematic diagram of an input image according to some embodiments of the present disclosure;

[0024] Figure 5 is a schematic diagram of a mixed image according to some embodiments of the present disclosure;

[0025] Figure 6 A portion of a raw OSD map according to some embodiments of the present disclosure is shown;

[0026] Figure 7 illustrates a portion of a mixed image according to some embodiments of the present disclosure;

[0027] Figure 8 is a schematic diagram of an original OSD image according to some embodiments of the present disclosure;

[0028] Fig. 9 is a schematic diagram of a mixed image according to some embodiments of the present disclosure;

[0029] Fig.10 is a schematic diagram of a refined OSD map according to some embodiments of the present disclosure;

[0030] Fig.11 is a schematic diagram of an output image according to some embodiments of the present disclosure.

[0031]

Explanation of symbols

[0032] 10: Electronic devices

[0033] 110: Application Processor

[0034] 120: Image processor

[0035] 20: Operation method

[0036] 210: Part

[0037] 211: Initial OSD pattern

[0038] 211a: OSD pattern data

[0039] 211b: Alpha channel data

[0040] 212: Middle layer

[0041] 213: Input image

[0042] 214: Operation

[0043] 215: Mixed Images

[0044] 220: Part

[0045] 221: Operation

[0046] 222:Original OSD image

[0047] 223: Fusion Image

[0048] 224: Operation

[0049] 225: Fine OSD Image

[0050] 226: Operation

[0051] 227: Operation

[0052] 411:OSD pattern

[0053] 412: Middle layer

[0054] 413: Input image

[0055] 415:Mixed Images

[0056] 601: Block

[0057] 611: Reference pixel

[0058] 612: Pixels

[0059] 701: Block

[0060] 711-714: Key pixels

[0061] 715-716: non-critical pixels

[0062] 721: Pixels

[0063] 822: Original OSD image

[0064] 823: Fusion Image

[0065] 825: Fine OSD Image

[0066] 828: Output image

[0067] 829: Fine OSD pattern

[0068] 830: Protected Area

[0069] 831: Other areas DETAILED DESCRIPTION

[0070] Reference will now be made in detail to the present embodiments of the present disclosure, examples of which are illustrated in the accompanying drawings. Whenever possible, the same reference numerals are used in the drawings and the description to refer to the same or like parts.

[0071] Reference now Figure 1 . Figure 1The electronic device 10 includes an application processor (AP) 110 and an image processor 120. In some embodiments, the application processor 110 is used to generate mixed images by mixing an on-screen display (OSD) pattern, a designed intermediate layer, and an image of an input image, and further provide the mixed images to the image processor 120. The image processor 120 is used to generate an output image to include a pixel-wise OSD pattern based on an analyzed OSD map associated with the OSD pattern and blending images, wherein the OSD pattern and the blending image are generated based on the mixed image decoding. Due to the pixel-wise accuracy of the OSD pattern, it can be applied to a wide range of scenarios for image processing effect protection, which has significant advantages over alternative methods that lack the same accuracy.

[0072] Reference now Figure 2 . Figure 2 According to some embodiments of the present disclosure, Figure 1 It should be understood that for other embodiments of the method, the following may be used: Figure 2 Additional operations are provided before, during, and after the processes shown, and some of the operations described below may be replaced or eliminated. The order of the operations / processes may be interchanged. In the various views and illustrative embodiments, the same reference numerals are used to represent the same elements. The method of operation 20 includes the following references Figure 1 and Figures 3 to 10 The electronic device 10 is described with reference to parts 210 and 220 .

[0073] According to some embodiments, in part 210, the application processor 110 of the electronic device 10 generates a mixed image 215 by blending an initial OSD pattern 211 and an input image 213 with an intermediate layer 212 in operation 214. In other words, the mixed image 215 includes the initial OSD pattern 211 and the input image 213.

[0074] For example, Figure 3 As shown, it shows that some embodiments according to the present disclosure correspond to Figure 22 is a schematic diagram of operation 214 in the operation method 20, wherein the initial OSD pattern 211 formed by fusing the OSD pattern data 211a and the alpha channel data 211b is further combined with the image data of the intermediate layer 212 and the image data of the input image 213 to obtain a mixed image 215. In some embodiments, the initial OSD pattern 211 includes user interface (UI) information overlaid on the input image 213, and is also referred to as a UI layer.

[0075] In some embodiments, each of the OSD pattern data 211a and the input image 213 includes data for a color channel (e.g., red (R), green (G), and blue (B)). The alpha channel data 211b is used to define transparency by grayscale values. The intermediate layer 212 also includes alpha channel data and color channel data. Therefore, in some embodiments of the mixed image 215 having RGB channels, the pixel value of one color channel of each pixel in the mixed image 215 is represented by the following equation (1):

[0076] L MIXED =(L input (1-α i )+L i α i )(1-α UI )+L UI α UI

[0077] =L input (1-α UI )+L UI α UI -L input α i (1-α UI )+L i α i (1-α UI )…(1)

[0078] Where L input corresponds to the value of a color channel of a corresponding pixel in the input image 213, L i Corresponding to the value of a color channel of a corresponding pixel in the intermediate layer 212, α i The alpha value of the alpha channel of a corresponding pixel in the intermediate layer 212, L UI The value of a color channel corresponding to a corresponding pixel in the initial OSD pattern 211, and α UI The alpha value of the alpha channel corresponding to a corresponding pixel in the initial OSD pattern 211 .

[0079] The configuration of the color channels is provided for illustrative purposes. Various implementation configurations are within the contemplated scope of the present disclosure. For example, in some embodiments, the color model may include a CMYK (Cyan, Magenta, Yellow, and Black) model, an HSV (Hue, Saturation, and Value) model, a YUV (Luminance, U and V) or other suitable color models.

[0080] Reference now Figures 4 to 5 According to some embodiments of the present disclosure, Figure 4 is a schematic diagram of the input image 413, Figure 5 is a schematic diagram of mixed image 415. In some embodiments, input image 413 is configured relative to, for example, input image 213, and mixed image 415 is configured relative to, for example, mixed image 215.

[0081] For illustration, the mixed image 415 includes an OSD pattern 411 , an intermediate layer 412 , and an input image 413 , wherein the intermediate layer 412 includes reference points schematically symbolized by dots.

[0082] After generating the mixed image, refer again to Figure 2 In part 220, the image processor 120 receives the mixed image 215 (eg, Figure 5 The mixed image 415 in the image) generates the original OSD image 222 and the fused image 223.

[0083] Specifically, in operation 221, the image processor 120 decodes the mixed image 215 to extract OSD information and color image information. For example, the image processor 120 adjusts the alpha value α i So that it has a value (e.g., “1”) in equation (1), and the pixel value of each pixel is expressed as follows:

[0084] L ROSD =L UI α UI

[0085] Where L ROSD The value corresponding to a corresponding pixel in the original OSD image 222 (eg, Figure 8 An original OSD image 822 generated based on the mixed image 415 is schematically shown.

[0086] In some embodiments, Figure 6As shown, a portion of the original OSD image 222 is shown, and the original OSD image 222 includes a plurality of blocks 601, each block 601 consisting of 8 pixels, a length of 4 pixels, and a width of 2 pixels. According to some embodiments, the pixel value (e.g., L_ROSD) of a reference pixel 611 (located at the upper left (LT) of a block 601) in a block 601 contains OSD information and represents the OSD information of other pixels 612 in the same block 601. In other words, the remaining pixels 612 in the block 601 have the same pixel value as the reference pixel 611. It should be noted that all pixels within the block share the same alpha value. For illustration, when a pixel in the mixed image 415 having the same pixel coordinates as the reference pixel 611 is within an OSD pattern (e.g., OSD pattern 411), the 1-bit pixel value of the reference pixel 611 may be "1". Therefore, the entire block 601 is rendered as "bright", as shown in FIG. Figure 8 In contrast, when a pixel in the mixed image 415 is outside the OSD pattern, the one-bit pixel value of the reference pixel 611 may be "0". Thus, the entire block 601 is rendered "dark", as shown in FIG. Figure 8 shown.

[0087] In addition, the image processor 120 adjusts the alpha value α i has a zero value in equation (1), and the pixel value of each pixel is expressed as follows:

[0088] L BLEND =L input (1-α UI )+L UI α UI

[0089] Where L BLEND Corresponding to the fused image 223 (eg, generated based on the mixed image 415 Fig. 9 In some embodiments, OSD information (i.e., L UI α UI = 0) has the same pixel value as the corresponding region in the input image 213. Figure 4 and Fig. 9 , the corresponding area in the input image 413 and the area in the fused image 823 that does not contain OSD information have the same pixel value.

[0090] Reference again Figure 2In operation 224, the image processor 120 further generates a fine OSD map 225 based on the original OSD map 222 and the fused image 223. In some embodiments, the pixel value of the pixel being verified in the fused image 223 is compared with the pixel values ​​of pixels in neighboring blocks (e.g., six blocks) in the original OSD map 222 to generate values ​​for pixels having the same pixel coordinates in the fine OSD map 225, which are around the pixel to be verified in the fused image 223 and correspond to reference pixels in the original OSD map 222. In some embodiments, pixels having non-zero values ​​in the fine OSD map 225 indicate that the pixels having the same pixel coordinates in the fused image 223 belong to a fine OSD pattern (e.g., Fig.10 A refined OSD image 825 generated based on the mixed image 415 is schematically shown.

[0091] Specifically, for example, referring to the portion of the fused image 223 shown in FIG. Figure 7 , the upper leftmost pixel of each block 701 is referred to as a reference pixel, and key pixels (circled pixels) 711-714 are identified as belonging to an OSD pattern (e.g., OSD pattern 411) via the original OSD map 222. In some embodiments, the pixel values ​​of the key pixels 711-714 in the original OSD map 222 are "1", while the pixel values ​​of the non-key pixels (no circled pixels) 715-716 in the original OSD map 222 are "0".

[0092] The image processor 120 identifies whether the pixel belongs to the OSD pattern based on two rules. In some embodiments, the pixels that meet the rules in the fused image 223 (and / or the mixed image 215) have similar colors. The first rule indicates that the difference between the maximum value of the pixel value of the key pixel and the maximum value of the pixel value of the non-key pixel is within an adaptive range, for example, less than a predetermined value (e.g., 220.) The second rule indicates that the difference between the maximum value of the pixel value of the key pixels 711-714 and the pixel value of the pixel being verified (e.g., pixel 721) is within an adaptive range, for example, less than half of the maximum value of the pixel value of the key pixel and the maximum value of the pixel value of the non-key pixel.

[0093] For example, Figure 7As shown, regarding the first rule, the image processor 120 compares the maximum value of the pixel values ​​of the key pixels 711-714 and the maximum value of the pixel values ​​of the non-key pixels 715-716 to obtain a difference. The difference between the maximum value of the pixel values ​​of the key pixels 711-714 and the maximum value of the pixel values ​​of the non-key pixels 715-716 is equal to 110 (i.e., the pixel value "120" of the key pixel 714 minus the pixel value "10" of the non-key pixel 715), which is less than the predetermined value "220". Therefore, the first rule is satisfied.

[0094] Regarding the second rule, the maximum value of the pixel values ​​of the key pixels 711-714 is 120, and the maximum value of the pixel values ​​of the non-key pixels 715-716 is 10. The difference between the maximum value of the pixel values ​​of the key pixels 711-714 (i.e., "120") and the pixel value of the pixel 721 (i.e., "100") is equal to 20, which is less than half of the difference between the maximum value of the pixel values ​​of the key pixels 711-714 and the maximum value of the pixel values ​​of the non-key pixels 715-716 (i.e., "55"). Therefore, the second rule is satisfied.

[0095] Based on the above discussion, when the pixel value of pixel 721 satisfies the first and second rules, pixel 721 is verified to be included in the OSD pattern. Therefore, the pixel corresponding to pixel 721 in the fine OSD map 225 has a non-zero value and is rendered as "bright", such as Fig. 9 In other words, the fine OSD map 225 indicates the pixel positions in the fused image 223, where the difference between the pixel values ​​of these pixels in the fused image 223 and the maximum pixel value of the key pixels 711-714 is within the self-adjusting range.

[0096] Furthermore, in some embodiments, Fig. 9 and Fig.10 As shown, with the configuration of the present disclosure, pixels that are adjacent to the OSD pattern 411 and have a color similar to the OSD pattern 411 (e.g., pixels around the letter "S") are identified as belonging to the OSD pattern and are referred to as the protection area. In contrast, pixels that do not satisfy the first rule and the second rule are referred to as the remaining area. For example, when the difference between the maximum value and the pixel value of pixel 721 exceeds the adaptive range, for example, greater than half of the maximum difference and the minimum difference between the pixel values ​​of the key pixels 711-714 and the non-key pixels 715-716. Pixel 721 belongs to the remaining area.

[0097] The configuration of the adaptive range is provided for illustration purposes. Various implementations are within the contemplated scope of the present disclosure.

[0098] After obtaining the fine OSD image 225, the image processor 120 performs operation 226 to generate a fine OSD pattern including a protection area based on the fused image 223 and the fine OSD image 225, and further performs operation 227 to perform image processing on the remaining area of ​​the fused image 223 to generate an output image 228. In some embodiments, performing image processing includes performing color change processing on the remaining area. In different embodiments, image processing includes image stylization, color correction, image filtering, or other suitable processing.

[0099] For example, refer to Figures 9 to 11 ,according to Fig. 9 The fusion image 823 and Fig.10 The refined OSD image 825 generates a Fig.11 The fine OSD pattern 829 in the output image 828 of FIG. 828 is shown in FIG. 829. In some embodiments, the fine OSD pattern 829 is different from the OSD pattern 411. In various embodiments, the number of pixels included in the fine OSD pattern 829 is different from the number of pixels included in the OSD pattern 411.

[0100] Specifically, if Fig.11 As illustratively shown in FIG. 8 , the fine OSD pattern 829 includes the OSD pattern 411 and a protection area 830 that is very close to a portion of the OSD pattern 411. The number of pixels included in the fine OSD pattern 829 is greater than the number of pixels included in the OSD pattern 411. Fig.11 , the protection area 830 is surrounded by the OSD pattern 411. The pixel values ​​of the pixels of the protection area 830 are the same as the pixel values ​​of the pixels having the same pixel coordinates in the fused image 823. In an embodiment where the corresponding area in the input image 413 and the area in the fused image 823 do not contain OSD information having the same pixel value, the pixel values ​​of the pixels of the protection area 830 are the same as the pixel values ​​of the pixels having the same pixel coordinates in the input image 413. In other words, some areas of the input image 413 corresponding to the protection area 830 are “protected”, and their image data are retained in the output image 828.

[0101] In some embodiments, the output image 828 includes the remaining area 831 where the image processing is performed. Fig. 9 and Fig.11 As shown, except for the area corresponding to the fine OSD pattern 829, Fig. 9 The rest of the area in the Fig.11 The remaining area 831 is shown in the figure.

[0102] In some methods, the transmitted user interface (UI) information includes OSD (screen display) information, which is integrated into 4×2 blocks. This integration method is not very accurate because as long as there is UI information in the upper left corner of the 4x2 block, the remaining 7 points will be marked as having UI information. In addition, the sampling method used for integration is only performed once per 4x2 block, which may ignore subtle UI information. Therefore, the remaining 7 points are determined based on whether there is UI in the upper left corner of the OSD, which leads to a high possibility of generating redundant data or causing information loss.

[0103] Compared to some methods, the present disclosure is directed to optimizing an OSD image and fusing it with a color map (e.g., an input image). By utilizing the fact that the upper left corner of a block of the original OSD image contains accurate OSD information and comparing color image data, each pixel is verified by neighboring key pixels corresponding to an OSD pattern, thus providing a pixel-by-pixel OSD pattern with excellent accuracy.

[0104] Although the present disclosure has been described in considerable detail with reference to certain embodiments thereof, other embodiments are possible. Therefore, the spirit and scope of the appended claims should not be limited to the description of the embodiments contained herein.

[0105] It is obvious to those skilled in the art that various modifications and variations can be made to the structure of the present disclosure without departing from the scope or spirit of the present disclosure. In view of the foregoing, the present disclosure is intended to cover modifications and variations of the present disclosure that fall within the scope of the following patents.

Claims

1. An operation method performed by an image processor, characterized in that: Include: Receiving a mixed image including an input image and a first screen display pattern; generating a second screen display pattern different from the first screen display pattern based on the mixed image, wherein the second screen display pattern includes a plurality of protection areas of the input image, wherein the plurality of protection areas are adjacent to the first screen display pattern; Performing an image processing on a plurality of remaining areas of the input image other than the plurality of protection areas; as well as An output image is generated, wherein the output image includes the second screen display pattern and the remaining regions of the input image on which the image processing is performed.

2. The operating method according to claim 1, characterized in that: The second screen display pattern in the output image includes the first screen display pattern, and the plurality of protection areas in the output image are surrounded by the first screen display pattern in the output image.

3. The operating method according to claim 1, characterized in that: A plurality of differences between a plurality of first pixel values ​​in the plurality of protection areas and a maximum value of a plurality of second pixel values ​​in the first screen display pattern are within an adaptive range.

4. The operating method according to claim 3, characterized in that: A plurality of difference values ​​between the plurality of third pixel values ​​in the plurality of remaining areas and the maximum value among the plurality of second pixel values ​​in the first screen display pattern are outside the adaptive range.

5. The operating method according to claim 3, characterized in that: A plurality of first pixels having the plurality of first pixel values ​​and a plurality of second pixels having the plurality of second pixel values ​​are included in a plurality of blocks, wherein each of the plurality of second pixels is arranged in a corner of a corresponding one of the plurality of blocks.

6. The operating method according to claim 1, characterized in that: The multiple pixel values ​​of the multiple protection areas of the input image are the same as the multiple pixel values ​​of the multiple protection areas of the output image.

7. The operating method according to claim 1, characterized in that: A number of pixels included in the second screen display pattern is different from a number of pixels included in the first screen display pattern.

8. The operating method according to claim 7, characterized in that: The number of the plurality of pixels included in the second screen display pattern is greater than the number of the plurality of pixels included in the first screen display pattern.

9. The operating method according to claim 1, characterized in that: Performing the image processing on the plurality of remaining regions comprises: A color changing process is performed on the remaining regions.

10. The operating method according to claim 1, characterized in that: The multiple first differences between the multiple first pixel values ​​in the multiple protection areas and the multiple second pixel values ​​in the first screen display pattern are smaller than the multiple second differences between the multiple third pixel values ​​in the multiple remaining areas and the multiple second pixel values ​​in the first screen display pattern.

11. The operating method according to claim 1, characterized in that: Further including: Generating a first screen display image and a fused image based on the mixed image; and generating a second screen display image based on a plurality of first pixel values ​​of the first screen display image and a plurality of second pixel values ​​of the fused image, The generating of the second screen display pattern includes generating the second screen display pattern based on the second screen display image and the fused image.

12. The operating method according to claim 11, characterized in that: The second screen display image indicates locations of a plurality of pixels within an adaptive range of a plurality of differences between the plurality of second pixel values ​​and a maximum value among the plurality of first pixel values ​​in the fused image.

13. The operating method according to claim 11, characterized in that: Generating the first screen display image and the fused image comprises: The first screen display image is generated by adjusting a plurality of alpha values ​​in a plurality of third pixel values ​​in the mixed image to have a first value, and The fused image is generated by adjusting the plurality of alpha values ​​to have a second value different from the first value.

14. The operating method according to claim 11, characterized in that: Generating the second screen display image includes: comparing a maximum value of a first part of the plurality of first pixel values ​​with a maximum value of a second part of the plurality of first pixel values ​​to obtain a first difference value, wherein the first portion of the plurality of first pixel values ​​corresponds to a plurality of key pixels in the first screen display image, and the second portion of the plurality of first pixel values ​​corresponds to a plurality of non-key pixels in the first screen display image; comparing the first difference with a first predetermined value; comparing a second predetermined value to a second difference value, wherein the second difference value is a difference between the maximum value of the first portion of the plurality of first pixel values ​​and one of the plurality of second pixel values ​​corresponding to a pixel being verified in the fused image; as well as In response to the comparison, a plurality of third pixel values ​​of the second screen display image are generated.

15. The operating method according to claim 14, characterized in that: The second predetermined value is equal to half of the first difference.