Image display brightness compensation method and device, equipment, storage medium and program product

By obtaining and processing grayscale picture brightness data at the maximum target brightness, determining the target area and performing grayscale compensation, the problem of poor low grayscale brightness compensation in DBV ultra-low mode is solved, and the brightness uniformity of the AMOLED screen is improved and stability.

CN119152805APending Publication Date: 2024-12-17GLENFLY TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411268804.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-10
Publication Date
2024-12-17

AI Technical Summary

Technical Problem

The prior art has poor brightness compensation effect in the DBV ultra-low mode, which cannot effectively solve the problem of uneven brightness introduced by the AMOLED screen manufacturing process.

Method used

By obtaining the camera exposure time of each grayscale picture at the maximum target brightness, controlling the shooting device to capture and obtain brightness data, determining the target area, calculating and performing the air and time domain processing of the grayscale compensation value, performing brightness compensation, only for the required ones The area is compensated to avoid the worse the more you make up.

Benefits of technology

Improve the brightness compensation effect, avoid unnecessary brightness compensation, and enhance the uniformity and stability of image display.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119152805A_ABST
    Figure CN119152805A_ABST
Patent Text Reader

Abstract

The invention relates to an image display brightness compensation method and device, equipment, a storage medium and a program product. The method comprises the following steps: acquiring camera exposure time of each to-be-shot gray scale picture under the maximum target brightness; controlling a shooting device to shoot each gray scale picture according to the camera exposure time, and obtaining brightness data of each shot gray scale picture; according to the brightness data of each gray-scale image, determining a target area in each gray-scale image, the target area being an area to be subjected to brightness compensation; calculating a gray scale compensation value of the target area according to the brightness data of each gray scale picture; and performing brightness compensation on the target area according to the gray scale compensation value of the target area. By adopting the method, the brightness compensation effect can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of image display technology, and in particular to a method, device, equipment, storage medium and program product for compensating image display brightness. Background Art

[0002] Active-Matrix Organic Light-Emitting Diodes (AMOLED) screens have the characteristics of wide color gamut, wide viewing angle, and independent light emission, and are widely used in the field of image display. In order to eliminate the uneven display brightness of AMOLED screens caused by the manufacturing process, an image display brightness compensation algorithm is usually used to compensate the display brightness of the AMOLED screen.

[0003] In the related art, the image display brightness compensation algorithm is mainly for the compensation of the display brightness value in the normal mode. The compensation of the low grayscale image display brightness in the DBV ultra-low mode is more complicated, and the effect of using the current image display brightness compensation algorithm to compensate the low grayscale brightness in the DBV ultra-low mode is poor. Summary of the invention

[0004] Based on this, it is necessary to provide a method, device, equipment, storage medium and program product for compensating image display brightness that can improve the image display brightness of the brightness compensation effect in order to solve the above technical problems.

[0005] In a first aspect, the present application provides a method for compensating image display brightness, comprising:

[0006] Obtain the camera exposure time of each grayscale image to be captured at the maximum target brightness;

[0007] Controlling the shooting device to shoot each grayscale picture according to the camera exposure time, and obtaining brightness data of each grayscale picture shot;

[0008] Determining a target area in each grayscale image according to the brightness data of each grayscale image, wherein the target area is an area to be subjected to brightness compensation;

[0009] Calculating the grayscale compensation value of the target area according to the brightness data of each grayscale image;

[0010] Brightness compensation is performed on the target area according to the grayscale compensation value of the target area.

[0011] In one of the embodiments, after acquiring the brightness data of each captured grayscale image, the method further includes:

[0012] Generating a grayscale brightness curve of each grayscale picture according to the brightness data of each grayscale picture;

[0013] Verifying the validity of the brightness data of each grayscale picture according to the grayscale brightness curve of each grayscale picture, and determining a verification result;

[0014] If the verification result is valid, the step of determining the target area in each grayscale picture according to the brightness data of each grayscale picture is performed;

[0015] If the verification result is invalid, each grayscale image is re-photographed.

[0016] In one embodiment, verifying the validity of the brightness data of each grayscale picture according to the grayscale brightness curve of each grayscale picture and determining the verification result includes:

[0017] If the grayscale brightness curves of the grayscale images do not intersect, then determining that the verification result of the validity of the brightness data is valid;

[0018] If the grayscale brightness curves of any two grayscale images intersect, the verification result of the validity of the brightness data is determined to be invalid.

[0019] In one embodiment, determining the target area in each grayscale image according to the brightness data of each grayscale image includes:

[0020] Dividing each of the grayscale images into a plurality of processing areas;

[0021] Determining the boundary strengths of the plurality of processing areas according to the differences between the brightness data respectively corresponding to the plurality of processing areas and the standard target brightness;

[0022] According to the boundary strengths of the plurality of processing regions, target regions in the respective grayscale images are determined.

[0023] In one embodiment, the standard target brightness is the average brightness of pixels in the central area of ​​the area block corresponding to the processing area.

[0024] In one embodiment, performing brightness compensation on the target area according to the grayscale compensation value of the target area includes:

[0025] Performing spatial domain processing on the grayscale compensation value of the target area to obtain a spatial domain template of the target area;

[0026] Performing time domain processing on the spatial domain template to obtain a reordered template;

[0027] According to the reordered template, rounding and / or carrying the grayscale compensation value of the target area to obtain an adjusted grayscale compensation value;

[0028] Brightness compensation is performed on the target area according to the adjusted grayscale compensation value.

[0029] In one embodiment, performing spatial domain processing on the grayscale compensation value of the target area to obtain the spatial domain template of the target area includes:

[0030] Determining grayscale compensation values ​​corresponding to a plurality of pixel sub-regions of the target region from the grayscale compensation values ​​of the target region;

[0031] Summing the decimal parts of the grayscale compensation values ​​respectively corresponding to the plurality of pixel sub-regions to obtain an initial weight;

[0032] Determining the airspace weight of the target area according to the weight value range of the initial weight;

[0033] The spatial domain template is generated according to the spatial domain weight of the target area.

[0034] In one embodiment, performing time domain processing on the spatial domain template to obtain a reordered template includes:

[0035] Get the preset frame refresh mode;

[0036] According to the preset frame refresh mode, the carry position of the spatial domain weight in the spatial domain template is adjusted to obtain the reordered template.

[0037] In a second aspect, the present application provides a device for compensating image display brightness, comprising:

[0038] An acquisition module is used to acquire the camera exposure time of each grayscale picture to be photographed under the maximum target brightness; control the shooting device to shoot each grayscale picture according to the camera exposure time, and acquire the brightness data of each grayscale picture shot;

[0039] A filtering module, used to determine a target area in each grayscale image according to the brightness data of each grayscale image, wherein the target area is an area to be subjected to brightness compensation;

[0040] The compensation module is used to calculate the grayscale compensation value of the target area according to the brightness data of each grayscale image; adjust the weight of the grayscale compensation value of the target area through spatial domain processing and temporal domain processing, and perform brightness compensation on the target area according to the adjusted weight and the grayscale compensation value of the target area.

[0041] In one of the embodiments, the filtering module is further used to generate a grayscale brightness curve of each grayscale picture based on the brightness data of each grayscale picture; verify the validity of the brightness data of each grayscale picture based on the grayscale brightness curve of each grayscale picture to determine the verification result; if the verification result is valid, execute the step of determining the target area in each grayscale picture based on the brightness data of each grayscale picture; if the verification result is invalid, re-shoot each grayscale picture.

[0042] In one of the embodiments, the filtering module is further used to determine that the verification result of the validity of the brightness data is valid if the grayscale brightness curves of the various grayscale images do not intersect; if the grayscale brightness curves of any two grayscale images intersect, then the verification result of the validity of the brightness data is invalid.

[0043] In one of the embodiments, the filtering module is also used to divide each grayscale image into multiple processing areas; determine the boundary strength of the multiple processing areas based on the difference between the brightness data corresponding to the multiple processing areas and the standard target brightness; and determine the target area in each grayscale image based on the boundary strength of the multiple processing areas.

[0044] In one embodiment, the standard target brightness is the average brightness of pixels in the central area of ​​the area block corresponding to the processing area.

[0045] In one of the embodiments, the compensation module is further used to perform spatial domain processing on the grayscale compensation value of the target area to obtain a spatial domain template of the target area; perform time domain processing on the spatial domain template to obtain a reordered template; round and / or carry the grayscale compensation value of the target area according to the reordered template to obtain an adjusted grayscale compensation value; and perform brightness compensation on the target area according to the adjusted grayscale compensation value.

[0046] In one of the embodiments, the compensation module is further used to determine the grayscale compensation values ​​corresponding to multiple pixel sub-regions of the target area from the grayscale compensation values ​​of the target area; sum the decimal parts of the grayscale compensation values ​​corresponding to the multiple pixel sub-regions to obtain initial weights; determine the spatial domain weight of the target area based on the weight value range of the initial weight; and generate the spatial domain template based on the spatial domain weight of the target area.

[0047] In one of the embodiments, the compensation module is further used to obtain a preset frame refresh mode; according to the preset frame refresh mode, the carry position of the spatial domain weight in the spatial domain template is adjusted to obtain the reordered template.

[0048] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the above-mentioned image display brightness compensation method when executing the computer program.

[0049] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the above-mentioned method for compensating image display brightness.

[0050] In a fifth aspect, the present application also provides a computer program product, including a computer program, which implements the above-mentioned image display brightness compensation method when executed by a processor.

[0051] The above-mentioned image display brightness compensation method, device, equipment, storage medium and program product first obtain the camera exposure time of each grayscale picture to be shot at the maximum target brightness, and control the shooting equipment to shoot each grayscale picture according to the camera exposure time, and obtain the brightness data of each grayscale picture shot. Secondly, according to the brightness data of each grayscale picture, determine the target area in each grayscale picture, and the target area is the area to be brightness compensated. Thirdly, according to the brightness data of each grayscale picture, calculate the grayscale compensation value of the target area. Finally, according to the grayscale compensation value of the target area, perform brightness compensation on the target area. Since the grayscale compensation value is not calculated for all areas in the grayscale picture, but only for the target area in the grayscale picture that needs to be brightness compensated, brightness compensation protection is performed on the area that does not need brightness compensation, thereby avoiding the problem of worsening with compensation and improving the brightness compensation effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0053] Figure 1 A diagram of an application environment of a method for compensating image display brightness provided in an embodiment of the present application;

[0054] Figure 2 A schematic diagram of a flow chart of a method for compensating image display brightness provided in an embodiment of the present application;

[0055] Figure 3 A grayscale brightness curve of a grayscale image provided in an embodiment of the present application;

[0056] Figure 4 Another grayscale brightness curve of a grayscale image provided in an embodiment of the present application;

[0057] Figure 5 A schematic diagram of screen division provided in an embodiment of the present application;

[0058] Figure 6 A schematic diagram of brightness data provided in an embodiment of the present application;

[0059] Figure 7 A schematic diagram of a grayscale compensation value of a target area provided in an embodiment of the present application;

[0060] Figure 8 A schematic diagram of a decimal part of a grayscale compensation value of a target area provided in an embodiment of the application;

[0061] Fig. 9 A schematic diagram of an airspace template provided in an embodiment of the present application;

[0062] Fig.10 A schematic diagram of another airspace template provided in an embodiment of the present application;

[0063] Fig.11 A schematic flow chart of another method for compensating image display brightness provided in an embodiment of the present application;

[0064] Fig.12 A schematic flow chart of another method for compensating image display brightness provided in an embodiment of the present application;

[0065] Fig.13 A schematic flow chart of another method for compensating image display brightness provided in an embodiment of the present application;

[0066] Fig.14 A structural block diagram of a device for compensating image display brightness provided in an embodiment of the present application;

[0067] Fig.15 An internal structure diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0068] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0069] First, the related technology will be described below.

[0070] Active-Matrix Organic Light-Emitting Diodes (AMOLED) screens have the characteristics of wide color gamut, wide viewing angle, and independent light emission, and are widely used in the field of image display. However, in the manufacturing process of AMOLED screens, due to factors such as the non-uniformity of amorphous silicon (A-SI), unstable air pressure in the annealing chamber during the electron beam evaporation (ELA) stage, interference between parallel and scanning directions caused by the optical system, the formation of CVD films, and platform vibration, a large number of display brightness unevenness (Mura) defects may be introduced into AMOLED screens.

[0071] In order to eliminate the uneven display brightness of the AMOLED screen caused by the manufacturing process, the compensation algorithm of the image display brightness is usually used to compensate the display brightness of the AMOLED screen. The compensation of Mura is affected by the display brightness. Usually, the conduction of the pixels in the AMOLED screen is controlled by the Metal-Oxide-Semiconductor Field-Effect Transistor (MOSFET) device. The MOSFET device works in the saturation region. The conduction current of the MOSFET is affected by the threshold voltage. As the display brightness decreases. The pixel in the AMOLED corresponds to the critical state of the MOSFET device working in the saturation region and the linear region, an unstable display effect may occur, resulting in serious color cast and split screen phenomenon of the AMOLED screen.

[0072] In the related art, the compensation algorithm for display brightness is mainly for the compensation of the display brightness value in the normal mode. The compensation of the low grayscale image display brightness in the DBV ultra-low mode is more complicated, and the effect of using the current image display brightness compensation algorithm to compensate the low grayscale brightness in the DBV ultra-low mode is poor.

[0073] To solve the above technical problems, the embodiments of the present application provide a method, device, equipment, storage medium and program product for compensating image display brightness. Grayscale compensation values ​​are not calculated for all areas in the grayscale picture, but only for the target area in the grayscale picture that needs brightness compensation. Brightness compensation protection is performed for the area that does not need brightness compensation, thereby avoiding the problem of worsening with more compensation and improving the brightness compensation effect.

[0074] The following describes an application scenario of the image display brightness compensation method.

[0075] The image display brightness compensation method provided in the embodiment of the present application can be applied to Figure 1 In the application environment shown, the shooting device 101 communicates with the processing device 102. The data storage system can store data that the processing device 102 needs to process. The data storage system can be integrated on the processing device 102, or placed on the cloud or other network servers.

[0076] The processing device 102 can first obtain the camera exposure time of each grayscale picture to be shot under the maximum target brightness, and control the shooting device 101 to shoot each grayscale picture according to the camera exposure time, and obtain the brightness data of each grayscale picture shot. Secondly, the processing device 102 can determine the target area in each grayscale picture according to the brightness data of each grayscale picture, and the target area is the area to be brightness compensated. Thirdly, the processing device 102 can calculate the grayscale compensation value of the target area according to the brightness data of each grayscale picture. Finally, the processing device 102 can perform brightness compensation on the target area according to the grayscale compensation value of the target area.

[0077] Among them, the shooting device 101 can be a camera, a video camera, etc. The processing device 102 can be a terminal or a server. The terminal can be, but is not limited to, various personal computers, laptops, smart phones, tablet computers, Internet of Things devices and portable wearable devices. The Internet of Things devices can be smart speakers, smart TVs, smart air conditioners, smart car devices, projection devices, etc. Portable wearable devices can be smart watches, smart bracelets, head-mounted devices, etc. The head-mounted devices can be virtual reality (VR) devices, augmented reality (AR) devices, smart glasses, etc. The server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud computing services.

[0078] In an exemplary embodiment, Figure 2 As shown, a method for compensating image display brightness is provided, and the method is applied to Figure 1 The processing device in is taken as an example to illustrate, including S201-S205:

[0079] S201, obtaining the camera exposure time of each grayscale picture to be shot under the maximum target brightness.

[0080] In the present application, before compensating the image display brightness, the processing device needs to first capture each grayscale image, and determine the grayscale compensation value of each displayed grayscale based on the brightness data of each grayscale image, so as to use each grayscale compensation value for brightness compensation.

[0081] The camera exposure time of each grayscale image to be captured is a preset exposure parameter of the shooting device, which can be indicated by the user or generated by the estimated brightness or displayed grayscale of the grayscale image. The lower the estimated brightness or displayed grayscale of the grayscale image, the longer the camera exposure time of the grayscale image to be captured.

[0082] In some embodiments, three camera exposure times are usually required for the display grayscale corresponding to each grayscale image, and each camera exposure time corresponds to a color channel. For example, if the display grayscales corresponding to the grayscale images to be captured are [16, 32, 96, 160, 192, 224], and each display grayscale is divided into three color channels including R / G / B, the processing device can obtain 18 camera exposure times.

[0083] It should be understood that the above-mentioned maximum target brightness can be specifically set according to actual conditions. For example, the maximum target brightness can be 10 nit, that is, the display screen corresponding to the grayscale image is in a low display mode.

[0084] S202: Controlling a shooting device to shoot each grayscale picture according to the camera exposure time, and obtaining brightness data of each grayscale picture shot.

[0085] In this step, after the processing device obtains the camera exposure time of each grayscale image to be captured under the maximum target brightness, the shooting device can be controlled to capture each grayscale image according to the camera exposure time, and the brightness data of each captured grayscale image can be obtained.

[0086] The brightness data of the grayscale image includes brightness data of a plurality of pixels in the grayscale image.

[0087] In some embodiments, different grayscale images correspond to different display grayscales. For example, multiple grayscale images may correspond to multiple display grayscales such as 16, 32, 96, 160, 192, 224, etc. Since each grayscale is divided into three color channels of R, G, and B, when shooting each grayscale image showing the grayscale, the brightness data corresponding to the three color channels of R / G / B may be shot respectively.

[0088] In some embodiments, after acquiring the brightness data of each captured grayscale picture, the processing device may generate a grayscale brightness curve of each grayscale picture according to the brightness data of each grayscale picture. Subsequently, the processing device verifies the validity of the brightness data of each grayscale picture according to the grayscale brightness curve of each grayscale picture, and determines the verification result. If the verification result is valid, the processing device continues to perform the subsequent steps of determining the target area in each grayscale picture according to the brightness data of each grayscale picture. If the verification result is invalid, the processing device re-shoots each grayscale picture.

[0089] Exemplarily, if the grayscale brightness curves of the grayscale images do not intersect, the processing device can determine that the verification result of the validity of the brightness data is valid. If the grayscale brightness curves of any two grayscale images intersect, the processing device can determine that the verification result of the validity of the brightness data is invalid.

[0090] For example, Figure 3 A grayscale brightness curve of a grayscale image provided in an embodiment of the present application, Figure 4 Another grayscale brightness curve of a grayscale image provided in an embodiment of the present application. Figure 3 As shown in FIG. 1 , if the grayscale brightness curves of two or more grayscale images intersect, the validity check result can be determined to be invalid. Figure 4 As shown, the grayscale brightness curves of the various grayscale images do not intersect with each other, and the validity verification result can be determined to be valid.

[0091] S203 . Determine a target area in each grayscale image according to the brightness data of each grayscale image, where the target area is an area to be subjected to brightness compensation.

[0092] In this step, when the processing device controls the shooting device to shoot each grayscale picture according to the camera exposure time and obtains the brightness data of each grayscale picture, the target area in each grayscale picture can be determined according to the brightness data of each grayscale picture.

[0093] It should be understood that the above process of determining the target area in each grayscale picture according to the brightness data of each grayscale picture is a process of filtering the area in the grayscale picture that does not need to be corrected.

[0094] In some embodiments, the processing device may divide each grayscale image into a plurality of processing areas. Secondly, the processing device may determine the boundary strength of the plurality of processing areas according to the difference between the brightness data corresponding to the plurality of processing areas and the standard target brightness. Finally, the processing device may determine the target area in each grayscale image according to the boundary strength of the plurality of processing areas.

[0095] It should be understood that the above processing area can be a 2x2 area, that is, each processing area can include four pixel sub-areas. The four processing areas can form a region block, and the four pixel sub-areas at the center of the region block can form a central region.

[0096] For example, Figure 5 A schematic diagram of screen division provided in an embodiment of the present application, such as Figure 5As shown, a 1080x2400 screen can be divided into multiple 4x4 blocks, each block includes four processing areas, each processing area includes four pixel sub-areas, and the central four pixel sub-areas of the block area are the central area of ​​the block area. That is, the central area of ​​block area 1 includes four pixel sub-areas N1, N2, N3, and N4, and the central area of ​​area 2 includes four pixel sub-areas M1, M2, M3, and M4.

[0097] In some embodiments, the standard target brightness is the average brightness of pixels in the central area of ​​the area block corresponding to the processing area.

[0098] In some embodiments, the processing device may obtain the difference between the brightness data corresponding to each processing area and the standard target brightness by taking the average value of the brightness data of each pixel sub-area in the processing area and then subtracting it from the standard target brightness. Subsequently, the difference between the brightness data corresponding to each processing area and the standard target brightness is compared with the target standard brightness error threshold to obtain the boundary strength of the processing area.

[0099] For example, Figure 6 A schematic diagram of brightness data provided in an embodiment of the present application. Figure 6 For example, the differences between the brightness data corresponding to the four processing areas and the standard target brightness can be ΔB1, ΔB2, ΔB3, and ΔB4, respectively. The standard target brightness of the area blocks corresponding to the four processing areas can be lumi target ΔB1 can be determined by formula (1), ΔB2 can be determined by formula (2), ΔB3 can be determined by formula (3), and ΔB4 can be determined by formula (4).

[0100]

[0101] Exemplarily, if the target standard brightness error threshold is ΔT, the difference ΔBi between the brightness data corresponding to each processing area in the area block and the standard target brightness can be compared with the target standard brightness error threshold. If ΔBi is greater than ΔT, the boundary strength is increased by 1, and the initial value of the boundary strength is 0. After traversing each processing area in the area block, the boundary strength of the area block can be obtained. The boundary strength is then judged. If BS=0, it means that the brightness of multiple processing areas in the area block is similar to the target standard brightness, and there is no need to perform brightness compensation on the area block. If BS is greater than 0, it means that the brightness of multiple processing areas in the area block is greatly different from the target standard brightness, and a brightness compensation operation needs to be performed on the area block, then the area block is the target area.

[0102] S204: Calculate the grayscale compensation value of the target area according to the brightness data of each grayscale image.

[0103] In this step, after the processing device obtains the brightness data of multiple grayscale images captured at the target shooting brightness, the grayscale compensation value of each pixel corresponding to different display grayscales can be determined according to the brightness data of the multiple grayscale images.

[0104] The brightness data of the grayscale image includes brightness data of a plurality of pixels in the grayscale image.

[0105] In some embodiments, the processing device may first solve a preset grayscale-brightness relationship curve function according to the brightness data of multiple pixels in multiple grayscale images, and determine the relationship parameters in the grayscale-brightness relationship curve. Secondly, the processing device may generate a grayscale difference function according to the relationship parameters in the grayscale-brightness relationship curve. Thirdly, the processing device may obtain standard brightness data for different display grayscales. Finally, the processing device may input the standard brightness data for different display grayscales and the brightness data of multiple pixels in the grayscale images corresponding to different display grayscales into the grayscale difference function, and solve to obtain the grayscale compensation values ​​of each pixel corresponding to different display grayscales.

[0106] The standard brightness data is the brightness data of the central area of ​​the corresponding grayscale image. Exemplarily, the brightness data of the central area may be the average value of the brightness data of the central 40×40 pixels.

[0107] Exemplarily, formula (5) is a set of equations corresponding to the grayscale-brightness relationship curve function. By inputting the display grayscale and corresponding brightness data of each pixel of the R, G, and B color channels into formula (5), the relationship parameters gamma1 and b1 in the grayscale-brightness relationship curve can be solved.

[0108]

[0109] Among them, gray1[i] is the value of the i-th grayscale display, lum1[i] is the brightness data corresponding to the i-th grayscale pixel, i∈[16,32,64,128,192,224]. The brightness corresponding to the center area of ​​the screen lum_mid[i] is the brightness data of the center area of ​​the grayscale screen.

[0110] Exemplarily, the processing device can also solve other relationship data gamma and b in the grayscale-brightness relationship curve by bringing the display grayscale of each pixel of the R, G, and B color channels and the corresponding central area brightness data into formula (5).

[0111] Exemplarily, after solving the relationship parameters in the grayscale brightness relationship curve, the processing device may construct a grayscale difference function based on the relationship parameters gamma1 and b1. The grayscale difference function may be as shown in formula (6).

[0112]

[0113] in, is the grayscale compensation value, gamma1 and b1 are the relationship parameters in the grayscale brightness relationship curve, gray1[i] is the value of the i-th display grayscale, i∈[16,32,64,128,192,224].

[0114] Exemplarily, after generating the grayscale difference function, the processing device can input standard brightness data of different display grayscales and brightness data of multiple pixels in the grayscale picture corresponding to different display grayscales into the grayscale difference function to solve the grayscale compensation value of each pixel corresponding to the different display grayscales.

[0115] In some embodiments, when solving the grayscale compensation value of each pixel corresponding to different display grayscales, the solution may be performed with color channels as dimensions.

[0116] For example, taking the R channel as an example, the standard brightness data of different display grayscales and the brightness data of multiple pixels of the R channel corresponding to different display grayscales can be input into the grayscale difference function to solve the grayscale compensation value of the display grayscale 16. Displays the grayscale compensation value of grayscale 32 Displays grayscale compensation value of grayscale 96 Display grayscale compensation value of grayscale 128 Displays the grayscale compensation value of grayscale 192 Displays the grayscale compensation value of grayscale 224

[0117] For example, taking the G channel as an example, the standard brightness data of different display grayscales and the brightness data of multiple pixels of the G channel corresponding to different display grayscales can be input into the grayscale difference function to solve the grayscale compensation value of the display grayscale 16. Displays the grayscale compensation value of grayscale 32 Displays grayscale compensation value of grayscale 96 Display grayscale compensation value of grayscale 128 Displays the grayscale compensation value of grayscale 192 Displays the grayscale compensation value of grayscale 224

[0118] S205 , performing brightness compensation on the target area according to the grayscale compensation value of the target area.

[0119] In this step, after the processing device calculates the gray-scale compensation value of the target area according to the brightness data of each gray-scale image, it can perform brightness compensation on the target area according to the gray-scale compensation value of the target area.

[0120] In some embodiments, the processing device can first perform spatial domain processing on the gray-scale compensation value of the target area to obtain the spatial domain template of the target area. Secondly, the processing device can perform temporal domain processing on the spatial domain template to obtain the re-ordered template. Thirdly, the processing device can round and / or carry the gray-scale compensation value of the target area according to the re-ordered template to obtain the adjusted gray-scale compensation value. Finally, the processing device can perform brightness compensation on the target area according to the adjusted gray-scale compensation value.

[0121] The following describes how to perform spatial domain processing and temporal domain processing.

[0122] In some embodiments, the processing device can determine the gray-scale compensation values corresponding to multiple pixel sub-areas of the target area from the gray-scale compensation value of the target area. Subsequently, the processing device can sum the decimal parts of the gray-scale compensation values corresponding to the multiple pixel sub-areas to obtain the initial weight, and determine the spatial domain weight of the target area according to the weight value range where the initial weight is located. Finally, the processing device can generate a spatial domain template according to the spatial domain weight of the target area.

[0123] Exemplarily, Figure 7 is a schematic diagram of the gray-scale compensation value of a target area provided by an embodiment of the present application, Figure 8 is a schematic diagram of the decimal part of the gray-scale compensation value of a target area provided by an embodiment of the application. As Figure 7 and Figure 8 shown, the decimal parts of the gray-scale compensation values of the target area can be added to obtain the initial weight of 5.7. Preset each weight value range, including 0 < weight <= 4, 4 < weight <= 8, 8 < weight < 12, 12 < weight <= 16. If the initial weight is 0 < weight <= 4, the spatial domain weight weight is equal to 4; if the initial weight is 4 < weight <= 8, the spatial domain weight weight is equal to 8; if the initial weight is 8 < weight < 12, the spatial domain weight weight is 12; if the initial weight is 12 < weight <= 16, the spatial domain weight weight is equal to 16. Since the initial weight is 5.7, the spatial domain weight weight of the above target area is 8.

[0124] For example, after obtaining the spatial weight of the 4x4 target area, 16 frames can be defined as a cycle, and when each frame is displayed, the spatial weight of the corresponding 4x4 target area remains unchanged. For example, if the spatial weight is 4, 4 out of the 16 pixels in the 4x4 area are selected to be added by 1.

[0125] Exemplarily, after the spatial weight is fixed, a spatial template for the 4x4 target area of ​​16 frames can be generated, and different pixel positions can be defined for each frame. Exemplarily, if the spatial weight is 4, it can be defined that only one pixel is displayed in each row and column. If the spatial weight is 8, it can be defined that only 2 pixels are displayed in each row and column. If the spatial weight is 12, it can be defined that only 3 pixels are displayed in each row and column; if the spatial weight is 16, it can be defined that only 4 pixels are displayed in each row and column.

[0126] Fig. 9 A schematic diagram of an airspace template provided in an embodiment of the present application, Fig.10 A schematic diagram of another airspace template provided in an embodiment of the present application, Fig. 9 The airspace weight of the airspace template in is 8. Fig.10 The spatial weight of the spatial template in is 4. For example, Fig. 9 In the spatial domain template shown, the target area of ​​the first frame can be a template that displays line 1 to line 4 and subpixel 1 to suppixel 4. Grayscale indicates that the grayscale compensation value of the pixel at this position is added by 1, and white indicates that the grayscale compensation value of the pixel at this position is directly taken as an integer. The display area of ​​the second frame can be a template that displays line 1 to line 4 and subpixel 5 to suppixel 8. The display area of ​​the third frame can be a template that displays line 1 to line 4 and subpixel 9 to suppixel 12. By analogy, the display area of ​​the sixteenth frame can be a template that displays line 13 to line 16 and subpixel 13 to suppixel 16.

[0127] In some embodiments, after completing the spatial domain processing and obtaining the spatial domain template of the target area, the spatial domain template can be subjected to time domain processing to obtain a reordered template. The processing device can obtain a preset frame refresh mode. Subsequently, the processing device can adjust the carry position of the spatial domain weight in the spatial domain template according to the preset frame refresh mode to obtain a reordered template.

[0128] It should be understood that time domain processing is to select a fixed frame refresh mode, adjust the spatial weight carry position in the spatial template, rearrange it, and then perform brightness compensation.

[0129] Exemplarily, according to the reordered template, rounding and / or carrying out the grayscale compensation value of the target area can be simplified to processing by formula (7), thereby obtaining the adjusted grayscale compensation value.

[0130]

[0131] Among them, data_value is the adjusted grayscale compensation value, is the grayscale compensation value before adjustment, floor means rounding down, dither_func means time domain and spatial domain processing, x and y are the compensated pixel coordinates, which are used to obtain the weight carry information and belong to the spatial domain independent variable, frame means the current frame number information, which is used to obtain the loop position in the time domain and belongs to the time domain independent variable.

[0132] In the present application, the decimal error of the grayscale compensation value can be eliminated through time domain processing and spatial domain processing. Compared with the rounding operation of the grayscale compensation value in the related art, the accuracy of the grayscale compensation value can be improved.

[0133] The method for compensating the image display brightness provided in the embodiment of the present application first obtains the camera exposure time of each grayscale picture to be shot at the maximum target brightness, and controls the shooting device to shoot each grayscale picture according to the camera exposure time, and obtains the brightness data of each grayscale picture shot. Secondly, according to the brightness data of each grayscale picture, the target area in each grayscale picture is determined, and the target area is the area to be brightness compensated. Thirdly, according to the brightness data of each grayscale picture, the grayscale compensation value of the target area is calculated. Finally, according to the grayscale compensation value of the target area, brightness compensation is performed on the target area. Since the grayscale compensation value is not calculated for all areas in the grayscale picture, but only for the target area in the grayscale picture that needs to be brightness compensated, brightness compensation protection is performed on the area that does not need brightness compensation, thereby avoiding the problem of worsening with compensation and improving the brightness compensation effect.

[0134] The following describes how to verify the validity of the brightness data of each grayscale image. Fig.11 A flow chart of another method for compensating image display brightness provided in an embodiment of the present application is shown as follows: Fig.11 As shown, the image display brightness compensation method includes S301-S309:

[0135] S301, obtaining the camera exposure time of each grayscale picture to be shot under the maximum target brightness.

[0136] S302: Control the shooting device to shoot each grayscale picture according to the camera exposure time, and obtain brightness data of each grayscale picture shot.

[0137] S303 , generating a grayscale brightness curve of each grayscale picture according to the brightness data of each grayscale picture.

[0138] S304 , verifying the validity of the brightness data of each grayscale picture according to the grayscale brightness curve of each grayscale picture, and determining a verification result.

[0139] S305: Determine whether the verification result is valid.

[0140] If yes, execute S307, if no, execute S306.

[0141] S306, reshooting each grayscale image.

[0142] S307 , determining a target area in each grayscale image according to the brightness data of each grayscale image, where the target area is an area to be subjected to brightness compensation.

[0143] S308 , calculating the grayscale compensation value of the target area according to the brightness data of each grayscale image.

[0144] S309: Perform brightness compensation on the target area according to the grayscale compensation value of the target area.

[0145] In the present application, the grayscale compensation value is not calculated for all areas in the grayscale picture, but only for the target area in the grayscale picture that needs brightness compensation. Brightness compensation protection is performed for the area that does not need brightness compensation, thereby avoiding the problem of worsening brightness with more compensation and improving the brightness compensation effect.

[0146] The following describes how to determine the target area in each grayscale image. Fig.12 A flowchart of another method for compensating image display brightness provided in an embodiment of the present application is shown as follows: Fig.12 As shown, the image display brightness compensation method includes S401-S407:

[0147] S401, obtaining the camera exposure time of each grayscale picture to be shot under the maximum target brightness.

[0148] S402: Controlling a shooting device to shoot each grayscale image according to the camera exposure time, and obtaining brightness data of each grayscale image shot.

[0149] S403, dividing each grayscale image into a plurality of processing areas.

[0150] S404: Determine the boundary strengths of the plurality of processing areas according to the difference between the brightness data corresponding to the plurality of processing areas and the standard target brightness.

[0151] S405 , determining the target area in each grayscale image according to the boundary strengths of the multiple processing areas.

[0152] S406: Calculate the grayscale compensation value of the target area according to the brightness data of each grayscale image.

[0153] S407: Perform brightness compensation on the target area according to the grayscale compensation value of the target area.

[0154] The following describes how to perform brightness compensation on the target area. Fig.12 A flowchart of another method for compensating image display brightness provided in an embodiment of the present application is shown as follows: Fig.13 As shown, the image display brightness compensation method includes S501-S508:

[0155] S501: Obtain the camera exposure time of each grayscale picture to be shot under the maximum target brightness.

[0156] S502: Control the shooting device to shoot each grayscale picture according to the camera exposure time, and obtain brightness data of each grayscale picture shot.

[0157] S503 . Determine a target area in each grayscale image according to the brightness data of each grayscale image, where the target area is an area to be subjected to brightness compensation.

[0158] S504: Calculate the grayscale compensation value of the target area according to the brightness data of each grayscale image.

[0159] S505 , performing spatial domain processing on the grayscale compensation value of the target area to obtain a spatial domain template of the target area.

[0160] S506: Perform time domain processing on the spatial domain template to obtain a reordered template.

[0161] S507 . Rounding and / or carrying out the grayscale compensation value of the target area according to the reordered template to obtain an adjusted grayscale compensation value.

[0162] S508: Perform brightness compensation on the target area according to the adjusted grayscale compensation value.

[0163] The method for compensating the image display brightness provided in the embodiment of the present application first obtains the camera exposure time of each grayscale picture to be shot at the maximum target brightness, and controls the shooting device to shoot each grayscale picture according to the camera exposure time, and obtains the brightness data of each grayscale picture shot. Secondly, according to the brightness data of each grayscale picture, the target area in each grayscale picture is determined, and the target area is the area to be brightness compensated. Thirdly, according to the brightness data of each grayscale picture, the grayscale compensation value of the target area is calculated. Finally, according to the grayscale compensation value of the target area, brightness compensation is performed on the target area. Since the grayscale compensation value is not calculated for all areas in the grayscale picture, but only for the target area in the grayscale picture that needs to be brightness compensated, brightness compensation protection is performed on the area that does not need brightness compensation, thereby avoiding the problem of worsening with compensation and improving the brightness compensation effect.

[0164] It should be understood that, although the steps in the flowcharts involved in the above embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0165] Based on the same inventive concept, the embodiment of the present application also provides an image display brightness compensation device for implementing the image display brightness compensation method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in the embodiments of one or more image display brightness compensation devices provided below can refer to the limitations of the image display brightness compensation method above, and will not be repeated here.

[0166] In an exemplary embodiment, Fig.14 As shown, a compensation device 600 for image display brightness is provided, comprising: an acquisition module 601, a filtering module 602 and a compensation module 603, wherein:

[0167] The acquisition module 601 is used to acquire the camera exposure time of each grayscale picture to be shot under the maximum target brightness; control the shooting device to shoot each grayscale picture according to the camera exposure time, and acquire the brightness data of each grayscale picture shot.

[0168] The filtering module 602 is used to determine a target area in each grayscale image according to the brightness data of each grayscale image, where the target area is an area to be brightness compensated.

[0169] The compensation module 603 is used to calculate the grayscale compensation value of the target area according to the brightness data of each grayscale image; adjust the weight of the grayscale compensation value of the target area through spatial domain processing and temporal domain processing, and perform brightness compensation on the target area according to the adjusted weight and the grayscale compensation value of the target area.

[0170] In one of the embodiments, the filtering module 602 is further used to generate a grayscale brightness curve for each grayscale picture based on the brightness data of each grayscale picture; verify the validity of the brightness data of each grayscale picture based on the grayscale brightness curve of each grayscale picture, and determine the verification result; if the verification result is valid, execute the step of determining the target area in each grayscale picture based on the brightness data of each grayscale picture; if the verification result is invalid, re-shoot each grayscale picture.

[0171] In one embodiment, the filtering module 602 is also used to determine that the verification result of the validity of the brightness data is valid if the grayscale brightness curves of each grayscale image do not intersect; if the grayscale brightness curves of any two grayscale images intersect, the verification result of the validity of the brightness data is invalid.

[0172] In one embodiment, the filtering module 602 is also used to divide each grayscale image into multiple processing areas; determine the boundary strength of the multiple processing areas based on the difference between the brightness data corresponding to the multiple processing areas and the standard target brightness; and determine the target area in each grayscale image based on the boundary strength of the multiple processing areas.

[0173] In one embodiment, the standard target brightness is the average brightness of pixels in the central area of ​​the area block corresponding to the processing area.

[0174] In one embodiment, the compensation module 603 is further used to perform spatial domain processing on the grayscale compensation value of the target area to obtain a spatial domain template of the target area; perform time domain processing on the spatial domain template to obtain a reordered template; round and / or carry the grayscale compensation value of the target area according to the reordered template to obtain an adjusted grayscale compensation value; and perform brightness compensation on the target area according to the adjusted grayscale compensation value.

[0175] In one embodiment, the compensation module 603 is also used to determine the grayscale compensation values ​​corresponding to multiple pixel sub-regions of the target area from the grayscale compensation values ​​of the target area; sum the decimal parts of the grayscale compensation values ​​corresponding to the multiple pixel sub-regions to obtain the initial weight; determine the spatial weight of the target area according to the weight value range of the initial weight; and generate a spatial template according to the spatial weight of the target area.

[0176] In one of the embodiments, the compensation module 603 is further used to obtain a preset frame refresh mode; according to the preset frame refresh mode, the carry position of the spatial domain weight in the spatial domain template is adjusted to obtain a reordered template.

[0177] Each module in the above-mentioned image display brightness compensation device can be implemented in whole or in part by software, hardware and a combination thereof. Each of the above-mentioned modules can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.

[0178] In an exemplary embodiment, a computer device is provided. The computer device can process a device. The processing device is a server or a terminal. The internal structure diagram thereof can be as follows: Fig.15 As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a method for compensating the brightness of an image display is implemented.

[0179] Those skilled in the art will understand that Fig.15 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0180] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the above-mentioned image display brightness compensation method when executing the computer program.

[0181] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the above-mentioned image display brightness compensation method is implemented.

[0182] In one embodiment, a computer program product is provided, including a computer program, which implements the above-mentioned image display brightness compensation method when executed by a processor.

[0183] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0184] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0185] The above embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A method for compensating image display brightness, It is characterized in that The method comprises: Obtain the camera exposure time of each grayscale image to be captured at the maximum target brightness; Controlling the shooting device to shoot each grayscale picture according to the camera exposure time, and obtaining brightness data of each grayscale picture shot; Determining a target area in each grayscale image according to the brightness data of each grayscale image, wherein the target area is an area to be subjected to brightness compensation; Calculating the grayscale compensation value of the target area according to the brightness data of each grayscale image; Brightness compensation is performed on the target area according to the grayscale compensation value of the target area.

2. The method according to claim 1, It is characterized in that After acquiring the brightness data of each captured grayscale image, the method further includes: Generating a grayscale brightness curve of each grayscale picture according to the brightness data of each grayscale picture; Verifying the validity of the brightness data of each grayscale picture according to the grayscale brightness curve of each grayscale picture, and determining a verification result; If the verification result is valid, the step of determining the target area in each grayscale picture according to the brightness data of each grayscale picture is performed; If the verification result is invalid, each grayscale image is re-photographed.

3. The method according to claim 2, It is characterized in that The verifying the validity of the brightness data of each grayscale picture according to the grayscale brightness curve of each grayscale picture and determining the verification result includes: If the grayscale brightness curves of the grayscale images do not intersect, then determining that the verification result of the validity of the brightness data is valid; If the grayscale brightness curves of any two grayscale images intersect, the verification result of the validity of the brightness data is determined to be invalid.

4. The method according to claim 1, It is characterized in that The step of determining the target area in each grayscale image according to the brightness data of each grayscale image comprises: Dividing each of the grayscale images into a plurality of processing areas; Determining the boundary strengths of the plurality of processing areas according to the differences between the brightness data respectively corresponding to the plurality of processing areas and the standard target brightness; According to the boundary strengths of the plurality of processing regions, target regions in the respective grayscale images are determined.

5. The method according to claim 4, It is characterized in that The standard target brightness is the average brightness of pixels in the central area of ​​the area block corresponding to the processing area.

6. The method according to claim 1, It is characterized in that The performing brightness compensation on the target area according to the grayscale compensation value of the target area includes: Performing spatial domain processing on the grayscale compensation value of the target area to obtain a spatial domain template of the target area; Performing time domain processing on the spatial domain template to obtain a reordered template; According to the reordered template, rounding and / or carrying the grayscale compensation value of the target area to obtain an adjusted grayscale compensation value; Brightness compensation is performed on the target area according to the adjusted grayscale compensation value.

7. The method according to claim 6, It is characterized in that The performing spatial domain processing on the grayscale compensation value of the target area to obtain the spatial domain template of the target area includes: Determining grayscale compensation values ​​corresponding to a plurality of pixel sub-regions of the target region from the grayscale compensation values ​​of the target region; Summing the decimal parts of the grayscale compensation values ​​respectively corresponding to the plurality of pixel sub-regions to obtain an initial weight; Determining the airspace weight of the target area according to the weight value range of the initial weight; The spatial domain template is generated according to the spatial domain weight of the target area.

8. The method according to claim 6, It is characterized in that The performing time domain processing on the spatial domain template to obtain a reordered template includes: Get the preset frame refresh mode; According to the preset frame refresh mode, the carry position of the spatial domain weight in the spatial domain template is adjusted to obtain the reordered template.

9. A device for compensating image display brightness, It is characterized in that The device comprises: An acquisition module is used to acquire the camera exposure time of each grayscale picture to be photographed under the maximum target brightness; control the shooting device to shoot each grayscale picture according to the camera exposure time, and acquire the brightness data of each grayscale picture shot; A filtering module, used to determine a target area in each grayscale image according to the brightness data of each grayscale image, wherein the target area is an area to be subjected to brightness compensation; The compensation module is used to calculate the grayscale compensation value of the target area according to the brightness data of each grayscale image; adjust the weight of the grayscale compensation value of the target area through spatial domain processing and temporal domain processing, and perform brightness compensation on the target area according to the adjusted weight and the grayscale compensation value of the target area.

10. A computer device comprising a memory and a processor, wherein the memory stores a computer program. It is characterized in that When the processor executes the computer program, the steps of the method according to any one of claims 1 to 8 are implemented.

11. A computer-readable storage medium having a computer program stored thereon, It is characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.

12. A computer program product comprising a computer program, It is characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.