Interference fringe correction method and under-screen system

Abstract

The present application is applicable to the technical field of image processing, and provides a correction method for interference fringes and an under-screen system, the correction method comprising: obtaining a correction parameter set for different shooting distances; obtaining an image to be corrected, and calculating the average depth value of the image to be corrected; selecting a target correction parameter set corresponding to the average depth value in the correction parameter set for different shooting distances; correcting the first pixel value of the pixel to be corrected located at the different coordinate positions in the image to be corrected according to the different target correction parameters corresponding to the different coordinate positions in the target correction parameter set, to obtain a corrected image. In the above manner, the first pixel value of the pixel to be corrected at different coordinate positions is adjusted based on the average depth value of the image to be corrected, so as to reduce the defect of poor quality of the collected image caused by interference fringes.

Description

Technical Field

[0001] The present application belongs to the technical field of image processing, and in particular, relates to a correction method for interference fringes and an under-screen system. Background Art

[0002] As mobile phone manufacturers continue to optimize full-screen phones, under-screen camera modules will become standard features of most mobile phones. The imaging principle of the under-screen camera module is as follows: the irradiation light source (e.g., infrared laser, etc.) in the under-screen camera module fills the target area with light through the screen, and the acquisition module (e.g., camera) in the under-screen camera module captures the illuminated object to obtain an infrared image.

[0003] However, due to the physical characteristics of the display screen, the light beam emitted by the irradiation light source is divided into multiple beams through the screen. Some beams are directly emitted through the display screen, while other beams have different phase delays due to reflections on the display screen, etc. Multiple beams meet and overlap in the target area, generating interference fringes, resulting in poor quality of the collected image. Summary of the invention

[0004] In view of this, the embodiments of the present application provide a method for correcting interference fringes, an under-screen system, and a computer-readable storage medium, which can solve the technical problem that multiple light beams meet and overlap in the target area, generate interference fringes, and result in poor quality of the captured image.

[0005] A first aspect of an embodiment of the present application provides a method for correcting interference fringes, the correction method comprising:

[0006] Acquire a correction parameter set for different shooting distances; the correction parameter set includes different correction parameters corresponding to different coordinate positions;

[0007] Acquire an image to be corrected, and calculate an average depth value of the image to be corrected; the average depth value refers to an average value of depth values ​​corresponding to a plurality of pixels to be corrected in the image to be corrected;

[0008] Selecting a target correction parameter set corresponding to the average depth value from among the correction parameter sets of different shooting distances;

[0009] According to the different target correction parameters corresponding to the different coordinate positions in the target correction parameter set, the first pixel values ​​of the pixels to be corrected located at the different coordinate positions in the image to be corrected are corrected to obtain a corrected image.

[0010] A second aspect of an embodiment of the present application provides an under-screen system based on interference fringe correction, characterized in that it includes a display screen, an irradiation light source, a collection module, a processor and a memory, wherein:

[0011] The illumination light source is used to emit a light beam to a target area through the display screen;

[0012] The acquisition module is used to receive the light signal reflected by the target area and then transmitted through the display screen, and obtain the infrared image of the target area, and transmit it to the processor;

[0013] The processor is used to correct the infrared image using a preset correction parameter set and the interference fringe correction method recorded in any of the above-mentioned embodiment schemes.

[0014] The memory is used to store the correction parameter set and a computer program executable on the processor.

[0015] A third aspect of an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the correction method described in the first aspect are implemented.

[0016] Compared with the prior art, the embodiments of the present application have the following beneficial effects: since interference fringes are usually light and dark, and the positions of interference fringes in the image to be corrected at different depth values ​​are different, the present application selects a target correction parameter set according to the average depth value of the image to be corrected. And according to the target correction parameter set, the target correction parameters corresponding to the pixels to be corrected at different coordinate positions are obtained, and the first pixel values ​​of the pixels to be corrected are corrected according to the target correction parameters. In the above manner, the first pixel values ​​of the pixels to be corrected at different coordinate positions in the image to be corrected are adjusted based on the target correction parameter set corresponding to the average depth value, thereby reducing the defect of poor quality of the collected image caused by interference fringes. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0018] Figure 1 A schematic flow chart of a correction method for interference fringes provided by the present application is shown;

[0019] Figure 2 A specific schematic flow chart of step 101 in a correction method for interference fringes provided by the present application is shown;

[0020] Figure 3 A schematic diagram of a curve of the translation variation of interference fringes provided in the present application is shown;

[0021] Figure 4 A schematic diagram of a shooting distance division strategy provided by the present application is shown;

[0022] Figure 5 A specific schematic flow chart of step 1012 in a correction method for interference fringes provided by the present application is shown;

[0023] Figure 6 A specific schematic flow chart of step 103 in a correction method for interference fringes provided by the present application is shown;

[0024] Figure 7 A specific schematic flow chart of step 103 in a correction method for interference fringes provided by the present application is shown;

[0025] Figure 8 A schematic diagram of the correction process provided by the present application is shown;

[0026] Fig. 9 A specific schematic flow chart of step 104 in a correction method for interference fringes provided by the present application is shown;

[0027] Fig.10a A schematic diagram of light reflection provided by the present application is shown;

[0028] Fig.10b A schematic diagram of light reflection provided by the present application is shown;

[0029] Fig.11 is a schematic diagram of an under-screen system provided by an embodiment of the present invention;

[0030] Fig.12 A schematic diagram of a processor functional architecture provided by the present application is shown. DETAILED DESCRIPTION

[0031] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0032] In order to better understand the technical problem solved by this application, the above background technology is further explained here:

[0033] Interference refers to the phenomenon that the superposition of two (or more) waves with the same amplitude, frequency and fixed phase causes the redistribution of vibration intensity. In the superposition area of ​​the waves, the amplitude increases in some places and decreases in others, and the vibration intensity appears in a fixed distribution of strong and weak in space, forming interference fringes.

[0034] In the prior art, during the imaging process, when the light source of the under-screen camera module (which includes an irradiation light source and a collection module) passes through the display screen, a first light beam and a second light beam are generated, and there is a fixed phase difference between the first light beam and the second light beam, and then the first light beam and the second light beam will stably interfere on the receiving plane (i.e., the target area), generating interference fringes, which will scale with the change of the shooting distance between the target area and the under-screen camera module. The interference fringes in the infrared image collected by the collection module at different shooting distances are translated in the parallax direction.

[0035] In view of this, the embodiments of the present application provide a correction method for interference fringes, an under-screen system, and a computer-readable storage medium, which can solve the above-mentioned technical problems.

[0036] See also Figure 1 , Figure 1 FIG. 1 is a schematic flow chart of a method for correcting interference fringes provided by the present application. Figure 1 As shown, the correction method includes the following steps:

[0037] Step 101, obtaining a correction parameter set for different shooting distances; the correction parameter set includes different correction parameters corresponding to different coordinate positions.

[0038] As is known to all, the interference fringes of different shooting distances only have a shift in the distribution position in the image, and their size will not change. The interference fringes of the same shooting distance have the same distribution position in the image. If the distribution position of the interference fringes in the image can be determined, the interference fringes can be eliminated. Therefore, based on the above rules, this application obtains a set of correction parameters for different shooting distances to adaptively correct the pixels to be corrected in the image to be corrected. Among them, the strategy for dividing different shooting distances can be uniform division and non-uniform division, and the intervals for different shooting distances can be preset according to the correction fineness.

[0039] The correction parameter set is the correction parameters corresponding to different coordinate positions in the image corresponding to the same target plane. The correction parameters are used to enhance pixel values, weaken pixel values, or no correction is required (i.e., the correction parameter is 1). Among them, since the interference fringes are alternating light and dark fringes, the pixel values ​​of the pixels located in the dark fringes area need to be enhanced, and the pixel values ​​of the pixels located in the bright fringes area need to be weakened.

[0040] In step 101, the correction parameter set may be pre-stored data. When executing step 101, it is only necessary to obtain the correction parameter set pre-stored in the memory.

[0041] In step 101, the correction parameter set may also be obtained through the following optional embodiments (wherein the pre-stored correction parameter set may also be pre-calculated through the following optional embodiments):

[0042] As an optional embodiment of the present application, step 101 includes the following steps 1011 to 1012. Figure 2 , Figure 2 A specific schematic flow chart of step 101 in a method for correcting interference fringes provided in the present application is shown.

[0043] Step 1011, collecting multiple interference fringe images at different shooting distances; the interference fringe image refers to an image obtained by a collection module when a light source is irradiated through a display screen onto a target plane to form interference fringes; the shooting distance refers to the distance between a plane perpendicular to the optical axis of the collection module and the collection module; the interference fringe image is used to reflect the second pixel value of the interference fringes at different coordinate positions.

[0044] In front of the camera module under the screen, a target plane is placed perpendicular to the optical axis of the acquisition module or the optical axis of the irradiation light source. The target plane can be used to display the interference fringes generated by the irradiation light source passing through the screen (the irradiation light source includes but is not limited to lasers or LEDs), and the size of the target plane is larger than the framing range of the acquisition module at different shooting distances. The acquisition module collects the interference fringes appearing on the target plane to obtain an interference fringes image.

[0045] In order to better reflect the second pixel values ​​of the interference fringes at different coordinate positions, a plane with a white background and uniform surface texture is preferably used as the target plane.

[0046] The division strategy for different shooting distances can be uniform division or non-uniform division, and the intervals for different shooting distances can be preset according to the correction precision. It is difficult to detect that when the target plane moves forward and backward along the optical axis in an area close to the acquisition module, the translation change of the interference fringes on the target plane is large. When the target plane moves forward and backward along the optical axis in an area far from the acquisition module, the translation change of the interference fringes on the target plane is small. See Figure 3 , Figure 3 Schematic diagram of the interference fringe translation variation curve provided by the present application is shown. Figure 3 The variation of the fringe shift as shown shows a decreasing trend with the shooting distance.

[0047] Therefore, based on the above rules, the application divides different shooting distances into "close and dense, far and sparse". Figure 4 , Figure 4 FIG. 2 shows a schematic diagram of a shooting distance division strategy provided by the present application. Figure 4 As shown in the figure, as the target plane moves away from the acquisition module, the sampling positions of the target plane gradually become sparse, so as to scientifically divide the distribution density of the shooting distance.

[0048] As an optional embodiment of the present application, at the same shooting distance, one or more original images may be collected as interference fringe images. When there are multiple interference fringe images, multiple frames may be averaged to obtain the interference fringe image.

[0049] As an optional embodiment of the present application, after obtaining the interference fringe image, the interference fringe image may be preprocessed to improve the image quality of the interference fringe image, thereby obtaining a more refined correction effect. The preprocessing includes image processing means such as noise reduction or gray value adjustment.

[0050] Step 1012, normalizing the second pixel value of each initial pixel point in the interference fringe image one by one to obtain the correction parameter sets corresponding to the different shooting distances.

[0051] Since the interference fringes are alternating light and dark fringes, the pixel value of the bright fringes area is higher, and the pixel value of the dark fringes area is lower. Therefore, the present application normalizes the second pixel value of each initial pixel point in the interference fringes image to obtain the correction parameter set corresponding to each of the different shooting distances. The specific process is as follows:

[0052] As an optional embodiment of the present application, step 1012 includes the following steps A1 to A2. Figure 5 , Figure 5 A specific schematic flow chart of step 1012 in a method for correcting interference fringes provided in the present application is shown.

[0053] The interference fringe image corresponding to each shooting distance performs the following steps to obtain the correction parameter sets corresponding to different shooting distances:

[0054] Step A1, obtaining the maximum second pixel value in the interference fringe image.

[0055] Step A2: dividing the second pixel value of each initial pixel point in the interference fringe image by the maximum second pixel value to obtain the correction parameter set.

[0056] The following formula is used for each initial pixel point in the interference fringe image to obtain the correction parameter set:

[0057]

[0058] Where M represents the maximum second pixel value, I a represents the correction parameter in the correction parameter set, I b The second pixel value representing the initial pixel.

[0059] The correction parameter ranges of different coordinate positions in the correction parameter set obtained by the above formula are between [0, 1].

[0060] Step 102, obtaining an image to be corrected, and calculating an average depth value of the image to be corrected; the average depth value refers to an average value of depth values ​​corresponding to a plurality of pixels to be corrected in the image to be corrected.

[0061] The image to be corrected of the target area is obtained, and the depth values ​​of multiple pixels to be corrected in the image to be corrected are calculated, and then the depth values ​​of the multiple pixels to be corrected are averaged to obtain an average depth value.

[0062] There are three ways to calculate the depth values ​​of multiple pixels to be corrected:

[0063] Method ①: The irradiation light source projects a structured light beam to the target area, and the acquisition module receives the light beam reflected from the target area and forms an electrical signal. The electrical signal is transmitted to the processor, which processes the electrical signal and calculates the intensity information reflecting the light beam to form a structured light pattern. Finally, matching calculation or triangulation calculation is performed based on the structured light pattern to obtain the depth values ​​of multiple pixels to be corrected.

[0064] Method ②: The irradiation light source projects an infrared beam to the target area, and the acquisition module receives the beam reflected from the target area and forms an electrical signal. The electrical signal is transmitted to the processor, which processes the electrical signal to calculate the phase difference, and based on the phase difference indirectly calculates the flight time taken for the beam to be emitted from the irradiation light source to be received by the acquisition module, and further calculates the depth values ​​of multiple pixels to be corrected based on the flight time. It should be understood that the infrared beam may include pulse type and continuous wave type, which is not limited here.

[0065] Method ③: The irradiation light source projects an infrared pulse beam to the target object, and the acquisition module receives the beam reflected by the target object and forms an electrical signal. The electrical signal is transmitted to the processor, which counts the electrical signal to obtain a waveform histogram, and directly calculates the flight time from the irradiation light source to the acquisition module based on the histogram, and further calculates the depth values ​​of multiple pixels to be corrected based on the flight time.

[0066] Step 103: Select a target correction parameter set corresponding to the average depth value from the correction parameter sets at different shooting distances.

[0067] It is understandable that if the distribution interval of different shooting distances is small enough, each average depth value may correspond to an equal shooting distance. If the distribution interval of different shooting distances is not small enough, the average depth value and the shooting distance may not be completely equal. When there is a shooting distance equal to the average depth value among the different shooting distances, the target correction parameter set corresponding to the shooting distance equal to the average depth value is selected.

[0068] When there is no shooting distance equal to the average depth value among the different shooting distances, the following optional embodiments are performed:

[0069] As an optional embodiment of the present application, step 103 includes the following steps 1031 to 1032. Figure 6 , Figure 6 A specific schematic flow chart of step 103 in a method for correcting interference fringes provided in the present application is shown.

[0070] Step 1031 : Selecting, from among the different shooting distances, a first shooting distance having a minimum difference with the average depth value.

[0071] Step 1032: Use the correction parameter set corresponding to the first shooting distance as the target correction parameter set corresponding to the average depth value.

[0072] It can be understood that the above condition “if the distribution intervals of different shooting distances are small enough” is also applicable to step 1031 and step 1032 , that is, the difference is 0 under this condition.

[0073] Step 104: correct the first pixel values ​​of the pixels to be corrected located at the different coordinate positions in the image to be corrected according to the different target correction parameters corresponding to the different coordinate positions in the target correction parameter set to obtain a corrected image.

[0074] Since the depth values ​​of different pixels to be corrected in the corrected image are different, and the shooting distance (that is, the depth value) of the correction parameters in the correction parameter set is unified, the depth values ​​between different pixels to be corrected and their corresponding correction parameters may be inconsistent. In order to make the depth values ​​between the pixels to be corrected and the corresponding correction parameters consistent, this application converts each target correction parameter, and the conversion process is shown in the following embodiment:

[0075] As an optional embodiment of the present application, step 104 includes the following steps B1 to B2. Figure 7 , Figure 7 A specific schematic flow chart of step 103 in a method for correcting interference fringes provided in the present application is shown.

[0076] Step B1, substituting the target correction parameter set into a first preset formula to obtain a first correction parameter set.

[0077] Since there is a difference between the average depth value and the shooting distance, the target correction parameter set needs to be corrected using the first preset formula.

[0078] The first preset formula is as follows:

[0079]

[0080] Among them, I a represents the target correction parameter in the target correction parameter set, I b represents the first correction parameter of the first correction parameter set, L a represents the shooting distance corresponding to the first correction parameter set, L b represents the average depth value.

[0081] Step B2: correcting the first pixel values ​​of the pixels to be corrected located at the different coordinate positions in the image to be corrected according to the different first correction parameters corresponding to the different coordinate positions in the first correction parameter set, to obtain a corrected image.

[0082] In step B2, the first pixel values ​​of the plurality of pixels to be corrected may be divided by the first correction parameters corresponding to the plurality of pixels to be corrected, so as to obtain a corrected image.

[0083] In step B2, the first pixel values ​​of multiple pixels to be corrected can also be divided by the first correction parameters corresponding to the multiple pixels to be corrected, and multiplied by a preset adjustment coefficient (the adjustment coefficient is used to adjust the correction intensity and can be preset according to the actual application scenario) to obtain a corrected image.

[0084] To better illustrate the calibration process in step B2, see Figure 8 , Figure 8 Schematic diagram of the correction process provided by the present application is shown. Figure 8As shown, take the pixel a to be corrected, the pixel b to be corrected and the pixel c to be corrected in the image to be corrected as an example. The image to be corrected corresponds to a unique correction parameter set (i.e., the target correction parameter set). It can be understood that the correction parameter set is also an image, except that the second pixel values ​​at different coordinate positions in the image are correction parameters. Among them, the coordinate positions of the pixel a to be corrected are the same as those of the pixel d1, the coordinate positions of the pixel b to be corrected are the same as those of the pixel d2, and the coordinate positions of the pixel c to be corrected are the same as those of the pixel d3. The first pixel value of the pixel a to be corrected is divided by the second pixel value of the pixel d1 (i.e., the correction parameter) to obtain the corrected pixel A. The first pixel value of the pixel b to be corrected is divided by the second pixel value of the pixel d2 (i.e., the correction parameter) to obtain the corrected pixel B. The first pixel value of the pixel c to be corrected is divided by the second pixel value of the pixel d3 (i.e., the correction parameter) to obtain the corrected pixel C.

[0085] It should be noted that Figure 8 This is just an example. Figure 8 There is no limitation on the number of correction pixels in the correction parameter set, the number of to-be-corrected pixels in the to-be-corrected image, and their positions.

[0086] As an optional embodiment of the present application, step 104 includes the following steps C1 to C4. Fig. 9 , Fig. 9 A specific schematic flow chart of step 104 in a method for correcting interference fringes provided in the present application is shown.

[0087] Step C1, calculating the parallax between the interference fringe image corresponding to the target correction parameter set and the image to be corrected according to a second preset formula.

[0088] In the under-screen camera module, the acquisition module and the irradiation light source are usually aligned, that is, they are in different positions. Fig.10a , Fig.10a Schematic diagram of light reflection provided by the present application is shown. Fig.10a As shown in the figure, the straight line represents the target plane. When the irradiation light source emits light and illuminates the target plane, the light is reflected from the target plane to the acquisition module. Since the acquisition module and the irradiation light source are in different positions, the paths of the emitted light and the reflected light are different. However, since the average depth value may not match the completely equal shooting distance, if the average depth value is not equal to the shooting distance, there will be a certain difference in the coordinate position of the correction parameter. Please refer to Fig.10b , Fig.10b Schematic diagram of light reflection provided by the present application is shown. Fig.10bAs shown in the figure, the irregular shape is the target area (i.e., foreground) in the image to be corrected, and point a maps to a pixel point in the image to be corrected. The straight line represents the target plane. Since the paths of the emitted light and the reflected light are different, if the camera corrects the first pixel at point a with the correction parameters of point p2 that matches the reflected light, the result will be wrong (the first pixel at point a should be corrected with the correction parameters of point P1).

[0089] Based on the above considerations, the present application reconstructs the target correction parameter set (i.e., reconstructs the mapping relationship between the correction parameters and the coordinate positions in the target correction parameter set to correct the position deviation. This enables the correction parameters at point p1 to be used to correct the first pixel at point a).

[0090] First, the parallax generated by the illumination light source and the camera position is calculated according to the second preset formula, and the second preset formula is as follows:

[0091]

[0092] Wherein, d represents the parallax, L a Indicates the shooting distance corresponding to the target correction parameter set, L b represents the average depth value, b represents the optical axis distance between the camera and the illumination light source in the camera module, and f represents the focal length of the camera module.

[0093] Step C2, adding the disparity to the coordinate position value of each second pixel point in the target correction parameter set to obtain a second correction parameter set.

[0094] If the parallax is in the X-axis direction, the X-axis value in the coordinate position is added with the parallax to obtain a second correction parameter set.

[0095] If the parallax is in the Y-axis direction, the Y-axis value in the coordinate position is added to the parallax to obtain a second correction parameter set.

[0096] It is worth noting that when the acquisition module is at the same position as the irradiation light source, there is no need to perform steps C1 to C2.

[0097] Step C3, substituting the second correction parameter set into a third preset formula to obtain the third correction parameter set.

[0098] The third preset formula is as follows:

[0099]

[0100] Among them, I c represents the second correction parameter set, I d represents the third correction parameter set, L a represents the shooting distance corresponding to the target correction parameter set, Lb Indicates the average depth value.

[0101] Step C4, correcting the first pixel values ​​of the pixels to be corrected located at the different coordinate positions in the image to be corrected according to the different second correction parameters corresponding to the different coordinate positions in the third correction parameter set, to obtain a corrected image.

[0102] Step C2 to step C4 are the same as step B1 to step B2 in the above optional embodiment. Please refer to step B1 to step B2 in the above optional embodiment for details, and will not be repeated here.

[0103] In this embodiment, a target correction parameter set is obtained by the average depth value of the first pixel. According to the second pixel position of the first pixel, a target correction parameter in the target correction parameter set is obtained, and the first pixel value of the first pixel is corrected according to the target correction parameter. In the above manner, the first pixel value of the first pixel at different positions is adjusted based on the average depth value to reduce the problem of poor quality of the collected image caused by interference fringes.

[0104] Fig.11 Schematic diagram of an under-screen system provided by an embodiment of the present invention. Fig.11 As shown, the under-screen system 110 of this embodiment includes an irradiation light source 111, a collection module 112, a processor 113, a memory 114 and a display screen 115, wherein:

[0105] An irradiation light source 111 is used to emit an infrared light beam to a target area 116 through a display screen 115;

[0106] The acquisition module 112 is used to receive the light signal reflected by the target area and then transmitted through the display screen 115 and obtain the infrared image of the target area 116 to transmit to the processor 113;

[0107] The processor 113 is used to correct the infrared image using a preset correction parameter set and the interference fringe correction method described in any of the above embodiments;

[0108] The memory 114 is used to store a correction parameter set and a computer program executable on the processor.

[0109] It should be noted that when any module of the illumination light source 111 and the acquisition module 112 is under the display screen 115, if the infrared image acquired by the acquisition module 112 contains interference fringes, the above-mentioned interference fringes correction method can still be used to correct the infrared image, and there is no limitation here.

[0110] In one embodiment, if the illumination light source 111 emits a structured light beam to the target area 116 through the display screen 115, the under-screen system 110 also includes a floodlight module 117, and the floodlight module 117 projects a floodlight beam to the target area 116 through the display screen 115. The acquisition module 112, on the one hand, receives the structured light signal reflected by the target area and transmits it to the processor 113 to obtain the depth value of the target area, and on the other hand, receives the floodlight signal reflected by the target area to form an infrared image, and further corrects the infrared image according to the above method.

[0111] It should be understood that if the illumination light source 111 emits an infrared light beam to the target area 116 through the display screen 115, the under-screen system 110 does not need to perform fill light illumination, and the acquisition module can directly acquire infrared images and further correct the infrared images according to the above method.

[0112] In one embodiment, the processor 113 performs the steps in the interference fringe correction method embodiment. More specifically, the steps can be performed by one or more units in the processor 113 to complete the present application. The divisible units (see Fig.12 , Fig.12 The specific execution functions of a processor functional architecture diagram provided by the present application are as follows:

[0113] An acquisition unit 121 is used to acquire an infrared image of a target area acquired by an acquisition module;

[0114] The depth calculation unit 122 is used to calculate the average depth value of the infrared image; the average depth value refers to the average value of the depth values ​​corresponding to the multiple pixels to be corrected in the infrared image;

[0115] A selection unit 123, configured to select a target correction parameter set corresponding to the average depth value from the correction parameter sets of different shooting distances stored in the memory;

[0116] The correction unit 124 is used to correct the first pixel value of the pixel point to be corrected located at the different coordinate positions in the infrared image according to the different target correction parameters corresponding to the different coordinate positions in the target correction parameter set, so as to obtain a corrected image.

[0117] The present application provides an under-screen system based on interference fringe correction, which selects a target correction parameter set according to the average depth value of the infrared image. According to the target correction parameter set, the target correction parameters corresponding to the pixels to be corrected at different coordinate positions are obtained, and the first pixel values ​​of the pixels to be corrected are corrected according to the target correction parameters. In the above method, the first pixel values ​​of the pixels to be corrected at different coordinate positions in the infrared image are adjusted based on the target correction parameter set corresponding to the average depth value, thereby reducing the defect of poor quality of the collected image caused by interference fringes.

[0118] Those skilled in the art will appreciate that the under-screen system includes but is not limited to the above modules and the above combinations. Fig.11 It is merely an example of an under-screen system and does not constitute a limitation of an under-screen system. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components.

[0119] The camera module includes an acquisition module and an irradiation light source. The irradiation light source includes a light source and an optical component (the optical component may include a diffractive optical element, etc.). The light source may be an edge emitting laser (EEL), a vertical cavity surface emitting laser (VCSEL) or other light sources, or a light source array composed of multiple light sources, and the light beam emitted by the light source may be visible light, infrared light or ultraviolet light, etc. The light beam emitted by the light source may form a uniform, random or specially designed intensity distribution projection pattern on the reference plane. The acquisition module includes modules such as an image sensor and a lens unit, and the lens unit receives part of the light beam reflected back by the object and images it on the image sensor. The image sensor may be an image sensor composed of a charge coupled device (CCD), a complementary metal oxide semiconductor (CMOS), an avalanche diode (AD) or a single photon avalanche diode (SPAD).

[0120] The processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0121] The memory may be an internal storage unit of the under-screen system, such as a hard disk or memory of the under-screen system. The memory may also be an external storage device of the under-screen system, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the under-screen system. Furthermore, the memory may also include both an internal storage unit and an external storage device of the under-screen system. The memory is used to store the computer program and other programs and data required by the roaming control device. The memory may also be used to temporarily store data that has been output or is to be output.

[0122] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0123] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0124] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0125] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.

[0126] An embodiment of the present application provides a computer program product. When the computer program product runs on a mobile terminal, the mobile terminal can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0127] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device that can carry the computer program code to the camera / live detection device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electric carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0128] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0129] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0130] In the embodiments provided in the present application, it should be understood that the disclosed devices / network equipment and methods can be implemented in other ways. For example, the device / network equipment embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0131] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed over multiple network units.

[0132] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0133] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0134] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to monitoring, depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is monitored" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is monitored" or "in response to monitoring [described condition or event]", depending on the context.

[0135] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0136] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0137] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A method for correcting interference fringes, characterized in that: The correction method comprises: Acquire a correction parameter set for different shooting distances; the correction parameter set includes different correction parameters corresponding to different coordinate positions; Acquire an image to be corrected, and calculate an average depth value of the image to be corrected; the average depth value refers to an average value of depth values ​​corresponding to a plurality of pixels to be corrected in the image to be corrected; Selecting a target correction parameter set corresponding to the average depth value from among the correction parameter sets of different shooting distances; According to the different target correction parameters corresponding to the different coordinate positions in the target correction parameter set, the first pixel values ​​of the pixels to be corrected located at the different coordinate positions in the image to be corrected are corrected to obtain a corrected image.

2. The calibration method according to claim 1, characterized in that: The step of obtaining a correction parameter set for different shooting distances includes: Collecting multiple interference fringe images at different shooting distances; the interference fringe image refers to an image obtained by a collection module when a light source is irradiated on a target plane through a display screen to form interference fringes; the shooting distance refers to the distance between a plane perpendicular to the optical axis of the collection module and the collection module; the interference fringe image is used to reflect the second pixel value of the interference fringes at different coordinate positions; The second pixel value of each initial pixel point in the interference fringe image is normalized one by one to obtain the correction parameter sets corresponding to the different shooting distances.

3. The calibration method according to claim 2, characterized in that: The step of normalizing the second pixel value of each initial pixel point in the interference fringe image one by one to obtain the correction parameter sets corresponding to the different shooting distances includes: Obtaining a maximum second pixel value in the interference fringe image; The correction parameter set is obtained by dividing the second pixel value of each initial pixel point in the interference fringe image by the maximum second pixel value.

4. The calibration method according to claim 1, characterized in that: The step of selecting a target correction parameter set corresponding to the average depth value from among the correction parameter sets at different shooting distances comprises: Among the different shooting distances, select a first shooting distance having the smallest difference with the average depth value; The correction parameter set corresponding to the first shooting distance is used as the target correction parameter set corresponding to the average depth value.

5. The calibration method according to claim 1, characterized in that: The step of correcting the first pixel value of the pixel point to be corrected located at the different coordinate positions in the image to be corrected according to the different target correction parameters corresponding to the different coordinate positions in the target correction parameter set to obtain the corrected image includes: Substituting the target correction parameter set into a first preset formula to obtain a first correction parameter set; The first preset formula is as follows: Among them, I a represents the target correction parameter in the target correction parameter set, I b represents the first correction parameter of the first correction parameter set, L a represents the shooting distance corresponding to the first correction parameter set, L b represents the average depth value; According to different first correction parameters corresponding to the different coordinate positions in the first correction parameter set, first pixel values ​​of the pixels to be corrected located at the different coordinate positions in the image to be corrected are corrected to obtain a corrected image.

6. The calibration method according to claim 1, characterized in that: The step of correcting the first pixel value of the pixel point to be corrected located at the different coordinate positions in the image to be corrected according to the different target correction parameters corresponding to the different coordinate positions in the target correction parameter set to obtain the corrected image includes: Calculating the parallax between the interference fringe image corresponding to the target correction parameter set and the image to be corrected according to a second preset formula; The second preset formula is as follows: Wherein, d represents the parallax, L a Indicates the shooting distance corresponding to the target correction parameter set, L b represents the average depth value, b represents the optical axis distance between the camera and the illumination light source in the camera module, and f represents the focal length of the camera module; Adding the disparity to the coordinate position value of each second pixel point in the target correction parameter set to obtain a second correction parameter set; Substituting the second correction parameter set into a third preset formula to obtain a third correction parameter set; The third preset formula is as follows: Among them, I c represents the second correction parameter set, I d represents the third correction parameter set, L a represents the shooting distance corresponding to the target correction parameter set, L b represents the average depth value; According to the different second correction parameters corresponding to the different coordinate positions in the third correction parameter set, the first pixel values ​​of the pixels to be corrected located at the different coordinate positions in the image to be corrected are corrected to obtain a corrected image.

7. The calibration method according to claim 6, characterized in that: The step of correcting the first pixel values ​​of the pixels to be corrected located at the different coordinate positions in the image to be corrected according to the different second correction parameters corresponding to the different coordinate positions in the third correction parameter set to obtain the corrected image includes: The first pixel value of the pixel to be corrected is divided by the second correction parameter corresponding to the pixel to be corrected to obtain a corrected image.

8. An under-screen system based on interference fringe correction, characterized in that: It includes a display screen, a light source, a collection module, a processor and a memory, wherein: The illumination light source is used to emit an infrared light beam to a target area through the display screen; The acquisition module is used to receive the light signal reflected by the target area and then transmitted through the display screen, and obtain the infrared image of the target area, and transmit it to the processor; The processor is used to correct the infrared image using a preset correction parameter set and the correction method described in any one of claims 1 to 7; The memory is used to store the correction parameter set and a computer program executable on the processor.

9. The under-screen system according to claim 8, characterized in that: If the light beam emitted by the illumination light source to the target area through the display screen is a structured light beam, the under-screen system also includes a floodlight module for projecting a floodlight beam to the target area, and the acquisition module acquires the floodlight signal reflected by the target area and obtains the infrared image of the target area.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the correction method according to any one of claims 1 to 7 are implemented.

Images