Image correction method and under-screen system

Abstract

The present application is applicable to the technical field of image processing, and provides a correction method for interference fringes and an under-screen system, the correction method comprising: obtaining interference fringes images at different shooting distances; obtaining the image to be corrected, and calculating the depth value of each pixel to be corrected in the image to be corrected; in the interference fringes images at different shooting distances, selecting the interference fringes image corresponding to the depth value of each pixel to be corrected as the target interference fringes image corresponding to each pixel to be corrected; extracting the first pixel value of the target coordinate position in the target interference fringes image; and correcting the second pixel value of each pixel to be corrected according to the first pixel value corresponding to each pixel to be corrected to obtain a corrected image. The above scheme reduces the problem of poor quality of the collected image caused by interference fringes by correcting each pixel to be corrected separately.

Description

Technical Field

[0001] The present application belongs to the technical field of image processing, and in particular, relates to an image correction method and an under-screen system. Background Art

[0002] As mobile phone manufacturers continue to optimize full-screen phones, under-screen cameras have become standard for most mobile phones. Under-screen cameras usually use an illumination light source to fill in the target object through the display screen to capture high-quality images.

[0003] However, due to the physical characteristics of the display screen, the light beam emitted by the illumination light source is divided into two beams through the display screen. One beam is emitted directly through the display screen, and the other beam is reflected on the display screen and emitted after multiple reflections. The two beams meet and overlap in the target area, generating interference fringes, resulting in poor image quality captured by the under-screen camera. Summary of the invention

[0004] In view of this, the embodiments of the present application provide an image correction method, an under-screen system, and a computer-readable storage medium, which can solve the problem that two light beams meet and overlap in the target area, generating interference fringes, resulting in poor image quality captured by the under-screen camera.

[0005] A first aspect of an embodiment of the present application provides an image correction method, the correction method comprising:

[0006] Obtain interference fringe images at different shooting distances; the interference fringe images refer to images obtained by the acquisition module when the illumination light source is irradiated on the target plane through the display screen to form interference fringes; the interference fringe images are used to reflect the first pixel values ​​of the interference fringes at different coordinate positions;

[0007] Acquire an image to be corrected, and calculate the depth value of each pixel to be corrected in the image to be corrected;

[0008] Selecting, from the interference fringe images at different shooting distances, the interference fringe image corresponding to the depth value of each pixel to be corrected as the target interference fringe image corresponding to each pixel to be corrected;

[0009] Extracting a first pixel value of a target coordinate position in the target interference fringe image; the target coordinate position refers to a coordinate position of a pixel point to be corrected corresponding to the target interference fringe image in the image to be corrected;

[0010] According to the first pixel value corresponding to each pixel to be corrected, the second pixel value of each pixel to be corrected is corrected to obtain a corrected image.

[0011] A second aspect of an embodiment of the present application provides an under-screen system, including a display screen, an illumination light source, a collection module, a processor, and a memory, wherein:

[0012] The illumination light source is used to emit an infrared light beam to a target area through the display screen; the target area includes a target plane;

[0013] The acquisition module is used to receive the light signal reflected by the target area and then transmitted through the display screen and obtain the infrared image of the target area, and transmit it to the processor; the infrared image includes the image to be corrected and the interference fringe image;

[0014] The processor is used to correct the infrared image using a preset interference fringe image and the correction method described in any one of the first aspects above;

[0015] The memory is used to store the interference fringe images at different shooting distances and a computer program that can be run on the processor.

[0016] A third aspect of an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the correction method described in the first aspect are implemented.

[0017] Compared with the prior art, the beneficial effect of the embodiments of the present application is that since the interference fringes are usually light and dark, and the positions of interference fringes of different depths are different. Therefore, the present application matches the target interference fringe image corresponding to each pixel to be corrected in the image to be corrected. And according to the target coordinate position of each pixel to be corrected, a first pixel value is obtained in the target interference fringe image. The pixel to be corrected is corrected according to the first pixel value (since the first pixel value of the interference fringes at different coordinate positions can be well reflected in the target interference fringe image, the pixel to be corrected can be corrected based on the first pixel value in the target interference fringe image). The above scheme reduces the problem of poor quality of the collected image caused by interference fringes by correcting each pixel to be corrected separately. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0019] Figure 1 A schematic flow chart of a correction method for interference fringes provided by the present application is shown;

[0020] Figure 2 A schematic diagram of a curve of the translation variation of interference fringes provided in the present application is shown;

[0021] Figure 3 A schematic diagram of a shooting distance division strategy provided by the present application is shown;

[0022] Figure 4 A specific schematic flow chart of step 103 in a correction method for interference fringes provided by the present application is shown;

[0023] Figure 5 A schematic diagram of target coordinate position provided by the present application is shown;

[0024] Figure 6 A specific schematic flow chart of step 105 in a correction method for interference fringes provided by the present application is shown;

[0025] Figure 7 A specific schematic flow chart of step 1051 in a correction method for interference fringes provided by the present application is shown;

[0026] Figure 8 A specific schematic flow chart of step 1052 in a correction method for interference fringes provided by the present application is shown;

[0027] Fig. 9 is a schematic diagram of an under-screen system provided by an embodiment of the present invention;

[0028] Fig.10 A schematic diagram of a processor functional architecture provided by the present application is shown. DETAILED DESCRIPTION

[0029] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0030] In order to better understand the technical problem solved by this application, the above background technology is further explained here:

[0031] Interference refers to the phenomenon that the superposition of two (or more) waves with the same amplitude, frequency and fixed phase causes the redistribution of vibration intensity. In the superposition area of ​​the waves, the amplitude increases in some places and decreases in others, and the vibration intensity appears in a fixed distribution of strong and weak in space, forming interference fringes.

[0032] In the prior art, during the imaging process of the under-screen camera, when the illumination light source passes through the display screen, a first light beam and a second light beam are generated, and there is a fixed phase difference between the first light beam and the second light beam, and then the first light beam and the second light beam will stably interfere with each other in the target area, generating interference fringes, and the interference fringes will scale with the change of shooting distance. The interference fringes in the image captured by the acquisition module (i.e., the under-screen camera) at different shooting distances will shift in the parallax direction.

[0033] In view of this, the embodiments of the present application provide a correction method for interference fringes, an under-screen system, and a computer-readable storage medium, which can solve the above-mentioned technical problems.

[0034] Figure 1 A schematic flow chart of a correction method for interference fringes provided by the present application is shown. The correction method is applied to a terminal device with an under-screen camera. The correction method includes the following steps:

[0035] Step 101, obtaining interference fringe images at different shooting distances; the interference fringe image refers to an image obtained by an acquisition module when an illumination light source is irradiated through a display screen to form interference fringes on a target plane; the interference fringe image is used to reflect the first pixel value of the interference fringes at different coordinate positions.

[0036] As is known to all, the interference fringes at different shooting distances only have a shift in distribution position in the image, and their size will not change. The interference fringes at the same shooting distance have the same distribution position in the image. If the distribution position of the interference fringes in the image (that is, the first pixel value at different coordinate positions) can be determined, the interference fringes can be eliminated. Therefore, based on the above rules, this application obtains interference fringe images at different shooting distances to adaptively correct the first pixel points of different depth values ​​in the image to be corrected.

[0037] In one embodiment, in order to better reflect the first pixel value of the interference fringes at different coordinate positions, a plane with a white background and uniform surface texture is preferably used as the target plane. The target plane is used to reflect the interference fringes generated by the illumination light source passing through the display screen (the illumination light source includes but is not limited to infrared light or laser light source), and the size of the target plane is larger than the framing range of the acquisition module (the acquisition module refers to a module used to collect light information, such as a camera, etc.) at different shooting distances.

[0038] In front of the acquisition module, a target plane perpendicular to the optical axis of the acquisition module is placed. The acquisition module collects the interference fringes appearing on the target plane to obtain an interference fringes image.

[0039] In one embodiment, the division strategy for different shooting distances can be uniform division or non-uniform division, and the intervals for different shooting distances can be preset according to the correction precision. Figure 2 ,Depend on Figure 2 It can be seen that the variation of fringe translation and shooting distance show a downward trend in curve, that is, when the target plane moves forward and backward along the optical axis in the area close to the acquisition module, the variation of interference fringe translation on the target plane is large. When the target plane moves forward and backward along the optical axis in the area far from the acquisition module, the variation of interference fringe translation on the target plane is small.

[0040] Therefore, based on the above rules, the division strategy of different shooting distances in this application is "close to close and far to sparse", such as Figure 3 As shown, as the target plane moves away from the image, the sampling positions of the target plane gradually become sparse, so as to scientifically divide the distribution density of the shooting distance.

[0041] As an optional embodiment of the present application, at the same shooting distance, one or more original images may be collected as interference fringe images. When there are multiple interference fringe images, multiple frames may be averaged to obtain the interference fringe image.

[0042] As an optional embodiment of the present application, after obtaining the interference fringe image, the interference fringe image may be preprocessed to improve the image quality of the interference fringe image, thereby obtaining a more refined correction effect. The preprocessing includes image processing means such as noise reduction or gray value adjustment.

[0043] Step 102: Acquire an image to be corrected, and calculate the depth value of each pixel to be corrected in the image to be corrected.

[0044] The image to be corrected of the target area is obtained, and the depth values ​​of multiple pixels to be corrected in the image to be corrected are calculated. According to the depth values ​​of different pixels to be corrected, the interference fringe images corresponding to the different pixels to be corrected are obtained (it can be understood that, as can be seen from the above content, the positions of the interference fringes in the image corresponding to different shooting distances are different. The depth values ​​between different pixels to be corrected are different, so it is necessary to match the corresponding interference fringe images for each pixel to be corrected one by one).

[0045] In one embodiment, the methods for obtaining the depth value include but are not limited to the following three methods:

[0046] Method ①: The illumination light source projects a structured light beam to the target area, and the acquisition module receives the light beam reflected from the target area and forms an electrical signal, which is then transmitted to the processor. The processor processes the electrical signal, calculates the intensity information reflecting the light beam to form a structured light pattern, and finally performs matching calculation or triangulation calculation based on the structured light pattern to obtain the depth values ​​of multiple pixels to be corrected.

[0047] Method ②: The illumination light source projects an infrared beam to the target area, and the acquisition module receives the beam reflected from the target area and forms an electrical signal, which is then transmitted to the processor. The processor processes the electrical signal to calculate the phase difference, and based on the phase difference, indirectly calculates the flight time taken for the beam to be emitted from the illumination light source to be received by the camera. The depth values ​​of multiple pixels to be corrected are calculated based on the flight time. It should be understood that the infrared beam may include pulsed and continuous wave types, which are not limited here.

[0048] Method ③: The illumination light source projects an infrared pulse beam to the target area, and the acquisition module receives the beam reflected from the target area and forms an electrical signal, which is then transmitted to the processor. The processor counts the electrical signal to obtain a waveform histogram, and directly calculates the flight time from the illumination light source to the camera based on the histogram, and calculates the depth values ​​of multiple pixels to be corrected based on the flight time.

[0049] As an optional embodiment of the present application, after the image to be corrected is acquired, preprocessing can be performed on the image to be corrected to improve the image quality of the image to be corrected, thereby obtaining a more refined correction effect. The preprocessing includes image processing means such as noise reduction or gray value adjustment.

[0050] Step 103 : selecting, from the interference fringe images at different shooting distances, the interference fringe image corresponding to the depth value of each pixel to be corrected as the target interference fringe image corresponding to each pixel to be corrected.

[0051] like Figure 2 As shown, due to the influence of the distribution interval of the shooting distance, the shooting distance and the depth value may be equal or unequal. It can be understood that if the distribution interval of different shooting distances is small enough, each depth value can correspond to the same shooting distance.

[0052] In one embodiment, when there is a shooting distance equal to the depth value among the different shooting distances, the interference fringe image corresponding to the shooting distance equal to the depth value is selected as the target interference fringe image.

[0053] In another embodiment, when there is no shooting distance equal to the depth value among the different shooting distances, the following optional embodiment is performed:

[0054] As an optional embodiment of the present application, step 103 includes the following steps 1031 to 1032. Figure 4 , Figure 4 A specific schematic flow chart of step 103 in a method for correcting interference fringes provided in the present application is shown.

[0055] For each pixel to be corrected, perform the following steps respectively:

[0056] Step 1031 : Selecting a target shooting distance having a minimum difference with the depth value from among the different shooting distances.

[0057] As an optional embodiment of the application, there may be two target shooting distances with the smallest depth value difference, that is, the depth value is at the center of adjacent shooting distances. Figure 2 It can be seen that the farther the shooting distance is, the smaller the fringe shift variation is. Therefore, when there are two minimum target shooting distances, the largest shooting distance of the two is selected as the target shooting distance.

[0058] Step 1032: Using the interference fringe image corresponding to the target shooting distance as the target interference fringe image.

[0059] It can be understood that the above condition "when there is a shooting distance equal to the depth value among the different shooting distances" is also applicable to step 1031 and step 1032, that is, under this condition, the difference between the shooting distance and the depth value is 0.

[0060] Step 104 , extracting a first pixel value of a target coordinate position in the target interference fringe image; the target coordinate position refers to a coordinate position of a pixel point to be corrected corresponding to the target interference fringe image in the image to be corrected.

[0061] For each pixel to be corrected, the first pixel value of the target coordinate position is extracted in the corresponding target interference fringe image. For example, if the target coordinate position of the pixel to be corrected is (156, 256), the first pixel value at the coordinate position (156, 256) in the target interference fringe image is extracted.

[0062] For a better explanation of step 104, see Figure 5, taking the pixel a to be corrected, the pixel b to be corrected and the pixel c to be corrected in the image to be corrected as examples. The target interference fringe image corresponding to the pixel a to be corrected is the first target interference fringe image where the pixel d1 is located. The target interference fringe image corresponding to the pixel b to be corrected is the second target interference fringe image where the pixel d2 is located. The target interference fringe image corresponding to the pixel c to be corrected is the third target interference fringe image where the pixel d3 is located. For the pixel a to be corrected, it is necessary to extract the pixel d1 in the first target interference fringe image (the coordinate position of the pixel a to be corrected is the same as that of the pixel d1). For the pixel b to be corrected, it is necessary to extract the pixel d2 in the second target interference fringe image (the coordinate position of the pixel b to be corrected is the same as that of the pixel d2). For the pixel c to be corrected, it is necessary to extract the pixel d3 in the third target interference fringe image (the coordinate position of the pixel c to be corrected is the same as that of the pixel d3). It should be understood that after traversing each pixel point in the image to be corrected, the corresponding pixel points in the target interference fringe image can be integrated into a new frame of target interference fringe image, and the new interference fringe image can be used to perform the next operation; the next operation can also be performed directly using the pixel points in the target interference fringe, which is not limited here.

[0063] It should be noted that Figure 5 This is just an example. Figure 5 There is no limitation on the number of target interference fringe images, the number of pixels to be corrected in the image to be corrected, and their positions.

[0064] Step 105: Correct the second pixel value of each pixel to be corrected according to the first pixel value corresponding to each pixel to be corrected to obtain a corrected image.

[0065] Since the interference fringe image can reflect the first pixel value of the interference fringe at different coordinate positions. The pixel values ​​of the pixels located in the dark fringe area need to be increased, and the pixel values ​​of the pixels located in the bright fringe area need to be weakened. Therefore, the second pixel value of each pixel to be corrected can be corrected according to the first pixel value at different coordinate positions to obtain the corrected image. The correction method includes the following two correction methods:

[0066] The first correction method: calculate the proportional relationship between all the first pixel values, adjust the second pixel value of each pixel to be corrected according to the proportional relationship, and obtain the corrected image. For example: assuming that the three first pixel values ​​are 100, 150 and 200 respectively, the proportional relationship between the three first pixel values ​​is 2:3:4. Multiply the second pixel value of the pixel to be corrected corresponding to each of the three first pixel values ​​by 1 / 2, 1 / 3 and 1 / 4 respectively to obtain the corrected image (here it is only assumed that there are only three first pixel points in the image). However, since the pixel values ​​of the pixels in the dark area need to be increased and the pixel values ​​of the pixels in the bright area need to be weakened. If the first method is used for correction, the correction effect is poor. Only the high pixel values ​​in the bright area can be suppressed, so the present application provides a better second correction method.

[0067] The second correction method: as shown in the following optional embodiment:

[0068] As an optional embodiment of the present application, step 105 includes the following steps 1051 to 1052. Figure 6 , Figure 6 A specific schematic flow chart of step 105 in a method for correcting interference fringes provided in the present application is shown.

[0069] Step 1051: normalize all the first pixel values ​​to obtain a first correction parameter corresponding to each pixel to be corrected.

[0070] Since the interference fringes are alternating light and dark fringes, the pixel values ​​in the bright fringes are higher, and the pixel values ​​in the dark fringes are lower. Therefore, this application normalizes each pixel value to be corrected in the interference fringes image to obtain the first correction parameter corresponding to each pixel point to be corrected. The specific process is as follows:

[0071] As an optional embodiment of the present application, step 1051 includes the following steps A1 to A2. Figure 7 , Figure 7 A specific schematic flow chart of step 1051 in a method for correcting interference fringes provided in the present application is shown.

[0072] Step A1, obtaining the maximum first pixel value among all the first pixel values.

[0073] Step A2: divide each of the first pixel values ​​by the maximum first pixel value to obtain a first correction parameter corresponding to each pixel to be corrected.

[0074] The following formula is used for each first pixel to obtain the first correction parameter corresponding to each pixel to be corrected:

[0075]

[0076] Where M represents the maximum first pixel value, I a represents the first correction parameter, I b represents the first pixel value. The first correction parameter obtained by the above formula is in the range of [0,1].

[0077] Step 1052: Correct the second pixel value of each pixel to be corrected according to the first correction parameter corresponding to each pixel to be corrected to obtain a corrected image.

[0078] According to step 103, the depth value and the shooting distance may be equal or unequal. If they are unequal, then execute steps B1 to B2 in the following optional embodiment. If they are equal, then execute step B3 in the following optional embodiment. The specific execution steps are shown in the following optional embodiment:

[0079] As an optional embodiment of the present application, step 1052 includes the following steps B1 to B2. Figure 8 , Figure 8 A specific schematic flow chart of step 1052 in a method for correcting interference fringes provided in the present application is shown.

[0080] For each pixel to be corrected, the following steps are performed to obtain a corrected image:

[0081] Step B1, if the shooting distance of the target interference fringe image corresponding to the pixel to be corrected is not equal to the depth value of the pixel to be corrected, then the first correction parameter is substituted into the first preset formula to obtain the second correction parameter.

[0082] Since there is a difference between the depth value and the shooting distance, the first correction parameter needs to be corrected using the first preset formula.

[0083] The first preset formula is as follows:

[0084]

[0085] Among them, I a represents the first correction parameter, I b represents the second correction parameter, L a Indicates the shooting distance of the target interference fringe image corresponding to the pixel to be corrected, L b Indicates the depth value of the pixel to be corrected.

[0086] Step B2: dividing the second pixel value of the pixel to be corrected by the second correction parameter to obtain a corrected image.

[0087] In step B2, the second pixel value of each pixel to be corrected may be divided by the second correction parameter corresponding to each pixel to be corrected to obtain a corrected image. Alternatively, the second pixel value of each pixel to be corrected may be divided by the second correction parameter corresponding to each pixel to be corrected and multiplied by a preset adjustment coefficient (the adjustment coefficient is used to adjust the correction strength and may be preset according to the actual application scenario) to obtain a corrected image.

[0088] It can be understood that when the correction parameter approaches 1, the correction amplitude is low. When the correction parameter approaches 0, the correction amplitude is high. Therefore, the second correction method can suppress the pixel value of the bright fringe area and increase the pixel value of the dark fringe area, thereby achieving an excellent correction effect.

[0089] Step B3: if the shooting distance of the target interference fringe image corresponding to the pixel to be corrected is equal to the depth value of the pixel to be corrected, the second pixel value of the pixel to be corrected is divided by the first correction parameter to obtain a corrected image.

[0090] In this embodiment, based on each pixel to be corrected in the image to be corrected, the target interference fringe image corresponding to each pixel to be corrected is matched. And according to the target coordinate position of each pixel to be corrected, the first pixel value is obtained in the target interference fringe image. The pixel to be corrected is corrected according to the first pixel value (since the first pixel value of the interference fringe at different coordinate positions can be well reflected in the target interference fringe image, the pixel to be corrected can be corrected based on the first pixel value in the target interference fringe image). The above scheme reduces the problem of poor quality of the collected image caused by interference fringes by correcting each pixel to be corrected separately.

[0091] Fig. 9 Schematic diagram of an under-screen system provided by an embodiment of the present invention. Fig. 9 As shown, the under-screen system 90 of this embodiment includes an irradiation light source 91, a collection module 92, a processor 93, a memory 94 and a display screen 95, wherein:

[0092] An irradiation light source 91 emits an infrared beam to a target area 96 through a display screen 95;

[0093] The acquisition module 92 receives the light signal reflected by the target area and then transmitted through the display screen 105 and obtains the infrared image of the target area 96 and transmits it to the processor 93;

[0094] Processor 93, used to correct the infrared image using a preset interference fringe image and the interference fringe correction method described in any of the above embodiments;

[0095] The memory 94 is used to store interference fringe images at different shooting distances and a computer program that can be run on the processor.

[0096] It should be noted that when any module of the illumination light source 91 and the acquisition module 92 is under the display screen 95, if the infrared image acquired by the acquisition module 92 contains interference fringes, the above-mentioned interference fringes correction method can still be used to correct the infrared image, and there is no limitation here.

[0097] In one embodiment, if the illumination light source 91 emits a structured light beam to the target area 96 through the display screen 95, the under-screen system 90 also includes a floodlight module 107, and the floodlight module 97 projects a floodlight beam to the target area 96 through the display screen 95. The acquisition module 92, on the one hand, receives the structured light signal reflected by the target area and transmits it to the processor 93 to obtain the depth value of the target area, and on the other hand, receives the floodlight signal reflected by the target area to form an infrared image, and further corrects the infrared image according to the above method.

[0098] It should be understood that if the illumination light source 91 emits an infrared light beam to the target area 96 through the display screen 95, the under-screen system 90 does not need to perform fill light illumination, and the acquisition module can directly acquire the infrared image and further correct the infrared image according to the above method.

[0099] In one embodiment, the processor 93 performs the steps in the interference fringe correction method embodiment. More specifically, the steps can be performed by one or more units in the processor 93 to complete the present application. The split unit (see Fig.10 , Fig.10 The specific execution functions of a processor functional architecture diagram provided by the present application are as follows:

[0100] An acquisition unit 1001 is used to acquire an infrared image of a target area acquired by an acquisition module;

[0101] A depth calculation unit 1002 is used to calculate the depth value of each pixel to be corrected in the infrared image;

[0102] A first selection unit 1003 is used to select, from the interference fringe images at different shooting distances stored in the memory, the interference fringe image corresponding to the depth value of each pixel to be corrected as the target interference fringe image corresponding to each pixel to be corrected;

[0103] The second selection unit 1004 is used to extract a first pixel value of a target coordinate position in the target interference fringe image; the target coordinate position refers to the coordinate position of a pixel point to be corrected corresponding to the target interference fringe image in the infrared image;

[0104] The correction unit 1005 is used to correct the second pixel value of each pixel to be corrected according to the first pixel value corresponding to each pixel to be corrected, so as to obtain a corrected image.

[0105] The present application provides an under-screen system, which matches the target interference fringe image corresponding to each pixel to be corrected in the infrared image. And according to the target coordinate position of each pixel to be corrected, a first pixel value is obtained in the target interference fringe image. The pixel to be corrected is corrected according to the first pixel value (since the first pixel value of the interference fringe at different coordinate positions can be well reflected in the target interference fringe image, the pixel to be corrected can be corrected based on the first pixel value in the target interference fringe image). The above scheme reduces the problem of poor quality of the collected image caused by interference fringes by correcting each pixel to be corrected separately.

[0106] Those skilled in the art will appreciate that the under-screen system includes but is not limited to the above modules and the above combinations. Fig. 9 It is only an example of an under-screen system and does not constitute a limitation of an under-screen system. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the under-screen system may also include input and output devices, network access devices, buses, etc.

[0107] The camera module includes an acquisition module and an illumination light source. The illumination light source includes a light source and an optical component (the optical component may include a diffractive optical element, etc.). The light source may be an edge emitting laser (EEL), a vertical cavity surface emitting laser (VCSEL), or a light source array composed of multiple light sources. The light beam emitted by the light source may be visible light, infrared light, or ultraviolet light, etc. The light beam emitted by the light source may form a uniform, random, or specially designed intensity distribution projection pattern on a reference plane. The camera includes modules such as an image sensor and a lens unit. The lens unit receives part of the light beam reflected back by the object and forms an image on the image sensor. The image sensor may be an image sensor composed of a charge coupled device (CCD), a complementary metal oxide semiconductor (CMOS), an avalanche diode (AD), or a single photon avalanche diode (SPAD).

[0108] The processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0109] The memory may be an internal storage unit of the under-screen system, such as a hard disk or memory of the under-screen system. The memory may also be an external storage device of the under-screen system, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the under-screen system. Furthermore, the memory may also include both an internal storage unit and an external storage device of the under-screen system. The memory is used to store the computer program and other programs and data required by the roaming control device. The memory may also be used to temporarily store data that has been output or is to be output.

[0110] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0111] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0112] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0113] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.

[0114] An embodiment of the present application provides a computer program product. When the computer program product runs on a mobile terminal, the mobile terminal can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0115] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device that can carry the computer program code to the camera / live detection device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electric carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0116] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0117] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0118] In the embodiments provided in the present application, it should be understood that the disclosed devices / network equipment and methods can be implemented in other ways. For example, the device / network equipment embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0119] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed over multiple network units.

[0120] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0121] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0122] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to monitoring, depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is monitored" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is monitored" or "in response to monitoring [described condition or event]", depending on the context.

[0123] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0124] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0125] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A method for correcting interference fringes, characterized in that: The correction method comprises: Obtain interference fringe images at different shooting distances; the interference fringe images refer to images obtained by the acquisition module when the illumination light source is irradiated on the target plane through the display screen to form interference fringes; the interference fringe images are used to reflect the first pixel values ​​of the interference fringes at different coordinate positions; Acquire an image to be corrected, and calculate the depth value of each pixel to be corrected in the image to be corrected; Selecting, from the interference fringe images at different shooting distances, the interference fringe image corresponding to the depth value of each pixel to be corrected as the target interference fringe image corresponding to each pixel to be corrected; Extracting a first pixel value of a target coordinate position in the target interference fringe image; the target coordinate position refers to a coordinate position of a pixel point to be corrected corresponding to the target interference fringe image in the image to be corrected; According to the first pixel value corresponding to each pixel to be corrected, the second pixel value of each pixel to be corrected is corrected to obtain a corrected image, including: obtaining the maximum first pixel value among all the first pixel values; dividing each of the first pixel values ​​by the maximum first pixel value to obtain a first correction parameter corresponding to each pixel to be corrected; performing the following steps for each pixel to be corrected to obtain a corrected image: if the shooting distance of the target interference fringe image corresponding to the pixel to be corrected is not equal to the depth value of the pixel to be corrected, substituting the first correction parameter into a first preset formula to obtain a second correction parameter; The first preset formula is as follows: Among them, I a represents the first correction parameter, I b represents the second correction parameter, L a Indicates the shooting distance of the target interference fringe image corresponding to the pixel to be corrected, L b Indicates the depth value of the pixel to be corrected; Dividing the second pixel value of the pixel to be corrected by the second correction parameter to obtain a corrected image; If the shooting distance of the target interference fringe image corresponding to the pixel to be corrected is equal to the depth value of the pixel to be corrected, the second pixel value of the pixel to be corrected is divided by the first correction parameter to obtain a corrected image.

2. The calibration method according to claim 1, characterized in that: The step of selecting, from the interference fringe images at different shooting distances, the interference fringe image corresponding to the depth value of each pixel to be corrected as the target interference fringe image corresponding to each pixel to be corrected comprises: For each pixel to be corrected, perform the following steps respectively: Among the different shooting distances, select a target shooting distance having the smallest difference with the depth value; The interference fringe image corresponding to the target shooting distance is used as the target interference fringe image.

3. The calibration method according to claim 2, characterized in that: The selecting, from among the different shooting distances, a target shooting distance having a minimum difference with the depth value comprises: If the depth value is at the center of the adjacent shooting distances, the maximum shooting distance among the adjacent shooting distances is used as the target shooting distance.

4. An under-screen system, characterized in that: It includes a display screen, a lighting source, a collection module, a processor and a memory, wherein: The illumination light source is used to emit an infrared light beam to a target area through the display screen; the target area includes a target plane; The acquisition module is used to receive the light signal reflected by the target area and then transmitted through the display screen, and obtain the infrared image of the target area, and transmit it to the processor; The processor is used to correct the infrared image using a preset interference fringe image and the correction method described in any one of claims 1 to 3; The memory is used to store the interference fringe images at different shooting distances and a computer program that can be run on the processor.

5. The under-screen system according to claim 4, characterized in that: If the light beam emitted by the illumination light source to the target area through the display screen is a structured light beam, the under-screen system also includes a floodlight module for projecting a floodlight beam to the target area, and the acquisition module acquires the floodlight signal reflected by the target area and obtains the infrared image of the target plane.

6. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the correction method according to any one of claims 1 to 3 are implemented.

Images