Under-screen camera dazzle light removing device, method and equipment and storage medium

Abstract

The invention provides an under-screen camera dazzle light removing device, method and equipment and a storage medium. The under-screen camera dazzle light removing device comprises a visible light layer, an invisible light layer, an image sensor and a dazzle light removing module which are connected in sequence. The visible light layer comprises a plurality of visible light devices; the invisible light layer comprises a plurality of invisible light devices; each visible light device is vertically aligned with one invisible light device; the visible light device is used for emitting visible light; the invisible light device is used for emitting invisible light; an image sensor for generating an initial RAW image; the initial RAW image is generated based on the receiving light intensity of visible light and the receiving light intensity of invisible light; the receiving light intensity of the visible light is the initial light intensity of the visible light received by the image sensor; the receiving light intensity of the invisible light is the initial light intensity of the invisible light received by the image sensor; and the dazzle light removing module is used for generating a target RAW image. According to the technical scheme, dazzle light can be removed in the RAW domain, and then the image quality is improved.

Description

Technical Field

[0001] The present application relates to the technical field of electronic equipment, and in particular to an under-screen camera glare removal device, method, equipment and storage medium. Background Art

[0002] The under-screen camera technology is to hide the front camera under the display screen to achieve a full-screen design. However, this design brings a significant problem, namely glare. Since the under-screen camera needs to capture images through the display screen, and the transmittance of the display screen is limited, coupled with the complexity of the screen material and structure, light is easily scattered and reflected when passing through the screen, resulting in glare. However, glare has a serious impact on the imaging quality of the under-screen camera. Specifically, glare can cause light spots, halos or rainbow glare in the image, which will cover the background information and reduce the clarity and contrast of the image. Especially under strong light sources, the RGB (Red, Green, Blue) color images captured by the under-screen camera will have severe rainbow glare, which will surround the light source in circles, greatly reducing the image quality.

[0003] In order to solve the above problems, in the related technology, a high-transmittance screen is designed, and algorithm optimization is used to remove diffraction stripes, brighten the picture, and remove glare to improve picture quality.

[0004] In the above method, diffraction fringes and image highlighting are relatively easy to remove through algorithms. However, the glare problem caused by the luminous screen is relatively difficult to remove through algorithms, thereby reducing image quality. Summary of the invention

[0005] The embodiments of the present application provide a device, method, equipment and storage medium for removing glare from an under-screen camera, which can remove glare in the RAW domain, thereby improving image quality. The technical solution is as follows:

[0006] According to a first aspect of an embodiment of the present application, a glare removal device for an under-screen camera is provided, the device comprising:

[0007] A visible light layer, an invisible light layer, an image sensor and a glare removal module are connected in sequence; the visible light layer includes a plurality of visible light devices; the invisible light layer includes a plurality of invisible light devices; each of the visible light devices is vertically aligned with an invisible light device;

[0008] The visible light device is used to emit visible light;

[0009] The invisible light device is used to emit invisible light; the initial light intensity of the visible light and the initial light intensity of the invisible light are in a preset ratio; the invisible light is light of a preset frequency;

[0010] The image sensor is used to generate an initial RAW image; the initial RAW image is generated based on the received light intensity of the visible light and the received light intensity of the invisible light; the received light intensity of the visible light is the initial light intensity of the visible light received by the image sensor; the received light intensity of the invisible light is the initial light intensity of the invisible light received by the image sensor;

[0011] The de-glare module is used to generate a target RAW image; the target RAW image is obtained based on the difference between the received light intensity of the visible light and the received light intensity of the glare of the visible light; the received light intensity of the glare of the visible light is the product of the received light intensity of the invisible light and the preset ratio.

[0012] In some embodiments, the visible light device includes any one of a first visible light device, a second visible light device, a third visible light device, and a fourth visible light device;

[0013] The first visible light device is used to emit visible red light;

[0014] The second visible light device is used to emit visible green light;

[0015] The third visible light device is used to emit visible blue light;

[0016] The fourth visible light device is used to emit visible yellow light.

[0017] In some embodiments, the invisible light device includes any one of a first invisible light device, a second invisible light device, a third invisible light device, and a fourth invisible light device;

[0018] The first invisible light device is used to emit a first invisible light;

[0019] The second invisible light device is used to emit a second invisible light;

[0020] The third invisible light device is used to emit a third invisible light;

[0021] The fourth invisible light device is used to emit fourth invisible light.

[0022] In some embodiments, each of the first visible light devices is vertically aligned with one of the first invisible light devices; each of the second visible light devices is vertically aligned with one of the second invisible light devices; each of the third visible light devices is vertically aligned with one of the third invisible light devices; and each of the fourth visible light devices is vertically aligned with one of the fourth invisible light devices.

[0023] In some embodiments, the image sensor includes a first area, a second area, a third area and a fourth area; the first area includes k first photosensitive areas and (4-k) second photosensitive areas; the second area includes k third photosensitive areas and (4-k) fourth photosensitive areas; the third area includes k third photosensitive areas and (4-k) fourth photosensitive areas; the fourth area includes k fifth photosensitive areas and (4-k) sixth photosensitive areas; k is an integer greater than or equal to 1 and less than or equal to 4.

[0024] In some embodiments, the first photosensitive area includes a plurality of first photosensitive devices; the first photosensitive devices are used to receive the initial light intensity of the visible red light;

[0025] The second photosensitive area includes a plurality of second photosensitive devices; the second photosensitive devices are used to receive the initial light intensity of the first invisible light;

[0026] The third photosensitive area includes a plurality of third photosensitive devices; the third photosensitive devices are used to receive the initial light intensity of the visible green light;

[0027] The fourth photosensitive area includes a plurality of fourth photosensitive devices; the fourth photosensitive devices are used to receive the initial light intensity of the second invisible light;

[0028] The fifth photosensitive area includes a plurality of fifth photosensitive devices; the fifth photosensitive devices are used to receive the initial light intensity of the visible blue light;

[0029] The sixth photosensitive area includes a plurality of sixth photosensitive devices; the sixth photosensitive devices are used to receive the initial light intensity of the third invisible light.

[0030] In some embodiments, the first region includes k first photosensitive regions and (4-k) second photosensitive regions; the second region includes k third photosensitive regions and (4-k) fourth photosensitive regions; the third region includes k seventh photosensitive regions and (4-k) eighth photosensitive regions; the fourth region includes k fifth photosensitive regions and (4-k) sixth photosensitive regions;

[0031] The seventh photosensitive area includes a plurality of seventh photosensitive devices; the seventh photosensitive device is used to receive the initial light intensity of the visible yellow light;

[0032] The eighth photosensitive area includes a plurality of eighth photosensitive devices; the eighth photosensitive devices are used to receive the initial light intensity of the fourth invisible light.

[0033] In some embodiments, the initial RAW image includes a first sub-image, a second sub-image, a third sub-image, and a fourth sub-image.

[0034] In some embodiments, the image sensor is further used to:

[0035] obtaining the first sub-image based on the received light intensity of the visible red light in the first area and the received light intensity of the first invisible light;

[0036] obtaining the second sub-image based on the received light intensity of the visible green light in the second area and the received light intensity of the second invisible light;

[0037] obtaining the third sub-image based on the received light intensity of the visible green light in the third area and the received light intensity of the second invisible light;

[0038] The fourth sub-image is obtained based on the received light intensity of the visible blue light in the fourth area and the received light intensity of the third invisible light.

[0039] In some embodiments, the image sensor is further used to:

[0040] obtaining the first sub-image based on the received light intensity of the visible red light in the first area and the received light intensity of the first invisible light;

[0041] obtaining the second sub-image based on the received light intensity of the visible green light in the second area and the received light intensity of the second invisible light;

[0042] obtaining the third sub-image based on the received light intensity of the visible yellow light in the third area and the received light intensity of the fourth invisible light;

[0043] The fourth sub-image is obtained based on the received light intensity of the visible blue light in the fourth area and the received light intensity of the third invisible light.

[0044] In some embodiments, the de-glare module is further used for:

[0045] The first sub-image is divided into a first visible light area and a first invisible light area; the second sub-image is divided into a second visible light area and a second invisible light area; the third sub-image is divided into a third visible light area and a third invisible light area; the fourth sub-image is divided into a fourth visible light area and a fourth invisible light area.

[0046] In some embodiments, the first visible light area indicates the received light intensity of the visible red light of k first photosensitive areas; the first invisible light area indicates the received light intensity of the first invisible light of (4-k) second photosensitive areas; the second visible light area indicates the received light intensity of the visible green light of k third photosensitive areas; the second invisible light area indicates the received light intensity of the second invisible light of (4-k) fourth photosensitive areas; the third visible light area indicates the received light intensity of the visible green light of k third photosensitive areas; the third invisible light area indicates the received light intensity of the second invisible light of (4-k) fourth photosensitive areas; the fourth visible light area indicates the received light intensity of the visible blue light of k fifth photosensitive areas; the fourth invisible light area indicates the received light intensity of the third invisible light of (4-k) sixth photosensitive areas.

[0047] In some embodiments, the first visible light area indicates the received light intensity of the visible red light of k first photosensitive areas; the first invisible light area indicates the received light intensity of the first invisible light of (4-k) second photosensitive areas; the second visible light area indicates the received light intensity of the visible green light of k third photosensitive areas; the second invisible light area indicates the received light intensity of the second invisible light of (4-k) fourth photosensitive areas; the third visible light area indicates the received light intensity of the visible yellow light of k third photosensitive areas; the third invisible light area indicates the received light intensity of the fourth invisible light of (4-k) fourth photosensitive areas; the fourth visible light area indicates the received light intensity of the visible blue light of k fifth photosensitive areas; the fourth invisible light area indicates the received light intensity of the third invisible light of (4-k) sixth photosensitive areas.

[0048] In some embodiments, the de-glare module is further used for:

[0049] Obtaining a first RAW image based on the first visible light region, the second visible light region, the third visible light region, and the fourth visible light region;

[0050] obtaining a second RAW image based on the first invisible light area, the second invisible light area, the third invisible light area, and the fourth invisible light area;

[0051] The target RAW image is obtained based on a difference between the first RAW image and the second RAW image.

[0052] In some embodiments, the initial light intensity of the visible red light is equal to the product of the initial light intensity of the first invisible light and a first preset ratio;

[0053] The initial light intensity of the visible green light is equal to the product of the initial light intensity of the second invisible light and a second preset ratio;

[0054] The initial light intensity of the visible blue light is equal to the product of the initial light intensity of the third invisible light and a third preset ratio;

[0055] The initial light intensity of the visible yellow light is equal to the product of the initial light intensity of the fourth invisible light and a fourth preset ratio.

[0056] In some embodiments, the de-glare module is further used for:

[0057] A first target sub-image is obtained based on the difference between the received light intensity of the first visible light area and the received light intensity of the glare of the first visible light area; the received light intensity of the glare of the first visible light area is the product of the received light intensity of the first invisible area and the first preset ratio;

[0058] A second target sub-image is obtained based on the difference between the received light intensity of the second visible light area and the received light intensity of the glare in the second visible light area; the received light intensity of the glare in the second visible light area is the product of the received light intensity of the second invisible area and the second preset ratio;

[0059] A third target sub-image is obtained based on the difference between the received light intensity of the third visible light area and the received light intensity of the glare in the third visible light area; the received light intensity of the glare in the third visible light area is the product of the received light intensity of the third invisible area and the second preset ratio;

[0060] A fourth target sub-image is obtained based on the difference between the received light intensity of the fourth visible light region and the received light intensity of the glare in the fourth visible light region; the received light intensity of the glare in the fourth visible light region is the product of the received light intensity of the fourth invisible region and the third preset ratio;

[0061] The first target sub-image, the second target sub-image, the third target sub-image and the fourth target sub-image are used as first target RAW images.

[0062] In some embodiments, the de-glare module is further used for:

[0063] A first target sub-image is obtained based on the difference between the received light intensity of the first visible light area and the received light intensity of the glare of the first visible light area; the received light intensity of the glare of the first visible light area is the product of the received light intensity of the first invisible area and the first preset ratio;

[0064] A second target sub-image is obtained based on the difference between the received light intensity of the second visible light area and the received light intensity of the glare in the second visible light area; the received light intensity of the glare in the second visible light area is the product of the received light intensity of the second invisible area and the second preset ratio;

[0065] A third target sub-image is obtained based on the difference between the received light intensity of the third visible light area and the received light intensity of the glare in the third visible light area; the received light intensity of the glare in the third visible light area is the product of the received light intensity of the third invisible area and the fourth preset ratio;

[0066] A fourth target sub-image is obtained based on the difference between the received light intensity of the fourth visible light region and the received light intensity of the glare in the fourth visible light region; the received light intensity of the glare in the fourth visible light region is the product of the received light intensity of the fourth invisible region and the third preset ratio;

[0067] The first target sub-image, the second target sub-image, the third target sub-image and the fourth target sub-image are used as second target RAW images.

[0068] According to a second aspect of an embodiment of the present application, a method for removing glare from an under-screen camera is provided, the method comprising:

[0069] emits visible light;

[0070] Emitting invisible light; the initial light intensity of the visible light and the initial light intensity of the invisible light are in a preset ratio; the invisible light is light of a preset frequency;

[0071] Generate an initial RAW image; the initial RAW image is generated based on the received light intensity of the visible light and the received light intensity of the invisible light; the received light intensity of the visible light is the initial light intensity of the visible light received by the image sensor; the received light intensity of the invisible light is the initial light intensity of the invisible light received by the image sensor;

[0072] Generate a target RAW image; the target RAW image is obtained based on the difference between the received light intensity of the visible light and the received light intensity of the glare of the visible light; the received light intensity of the glare of the visible light is the product of the received light intensity of the invisible light and the preset ratio.

[0073] According to a third aspect of an embodiment of the present application, a computer device is provided, comprising a processor and a memory, wherein the memory is used to store at least one program, and the at least one program is loaded by the processor and executed by a method for deglareing an under-screen camera.

[0074] According to a fourth aspect of an embodiment of the present application, a computer-readable storage medium is provided, in which at least one program is stored. The at least one program is loaded and executed by a processor to implement a method for deglareing an under-screen camera.

[0075] In an embodiment of the present application, an embodiment of the present application provides a method for removing glare from an under-screen camera, and a visible light layer, an invisible light layer, an image sensor, and a glare removal module are sequentially arranged below the screen. The initial light intensity of the visible light is arranged to be in a fixed ratio with the initial light intensity of the corresponding invisible light. Then, the received light intensity of the invisible light of the image sensor is the received light intensity of the glare of the invisible light, and then based on the fixed ratio and the received light intensity of the glare of the invisible light, the received light intensity of the glare of the visible light can be determined. Based on the difference between the received light intensity of the visible light of the image sensor and the received light intensity of the glare of the visible light, the target RAW image is obtained. Thereby, glare removal is achieved in the RAW domain, thereby improving image quality. BRIEF DESCRIPTION OF THE DRAWINGS

[0076] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0077] Figure 1 is a schematic diagram of an implementation environment provided according to an embodiment of the present application;

[0078] Figure 2 is a structural schematic diagram of an under-screen camera deglare device provided according to an embodiment of the present application;

[0079] Figure 3 is a schematic diagram of the arrangement structure of the photosensitive devices of the first image sensor provided in an embodiment of the present application;

[0080] Figure 4is a schematic diagram of the arrangement structure of the photosensitive devices of the second image sensor provided in an embodiment of the present application;

[0081] Figure 5 is a schematic diagram of the arrangement structure of the photosensitive devices of the third image sensor provided in an embodiment of the present application;

[0082] Figure 6 is a schematic diagram of the arrangement structure of the photosensitive devices of the fourth image sensor provided in an embodiment of the present application;

[0083] Figure 7 It is a flowchart of a method for removing glare from an under-screen camera provided in an embodiment of the present application;

[0084] Figure 8 is a schematic diagram of the structure of a terminal provided according to an embodiment of the present application;

[0085] Fig. 9 It is a structural diagram of a server provided according to an embodiment of the present application. DETAILED DESCRIPTION

[0086] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0087] Here, exemplary embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application.

[0088] In this application, the terms "first", "second", etc. are used to distinguish between identical or similar items with substantially the same effects and functions. It should be understood that there is no logical or temporal dependency between "first", "second", and "nth", nor is there a limitation on the quantity and execution order. It should also be understood that although the following description uses the terms first, second, etc. to describe various elements, these elements should not be limited by the terms.

[0089] These terms are only used to distinguish one element from another element. For example, without departing from the scope of various examples, a first action can be referred to as a second action, and similarly, a second action can also be referred to as a first action. Both the first action and the second action can be actions, and in some cases, can be separate and different actions.

[0090] Here, at least one means one or more than one, for example, at least one action can be one action, two actions, three actions, or any other action that is an integer greater than or equal to one. And multiple means two or more than two, for example, multiple actions can be two actions, three actions, or any other action that is an integer greater than or equal to two.

[0091] Figure 1 It is a schematic diagram of an implementation environment provided according to an embodiment of the present application, and the implementation environment may include a terminal 101 and a server 102.

[0092] In the terminal 101, an under-screen camera is provided.

[0093] The terminal 101 may be a smart phone with an under-screen camera, a wearable device, a personal computer, a laptop, a tablet computer, a smart TV, a car terminal, etc.

[0094] The server 102 may be a single server, a server cluster consisting of multiple servers, or a cloud processing center.

[0095] The terminal 101 is connected to the server 102 via a wired or wireless network.

[0096] In some embodiments, the wireless network or wired network uses standard communication technology and / or protocol. The network is usually the Internet, but it can also be any network, including but not limited to any combination of local area network (LAN), metropolitan area network (MAN), wide area network (WAN), mobile, wired or wireless network, private network or virtual private network. In some embodiments, the data exchanged through the network is represented by technology and / or format including HyperText Mark-up Language (HTML), Extensible Markup Language (XML), etc. In addition, conventional encryption technologies such as Secure Socket Layer (SSL), Transport Layer Security (TLS), Virtual Private Network (VPN), Internet Protocol Security (IPsec) can also be used to encrypt all or some links. In other embodiments, customized and / or dedicated data communication technology can also be used to replace or supplement the above data communication technology.

[0097] Before describing the embodiments of the present application in detail, the terms involved are first explained.

[0098] 1. Under-screen camera: Under-screen camera technology is a technology that hides the front camera under the phone screen. When the camera is not in use, it is hidden under the screen.

[0099] 2. Visible light layer: The visible light layer includes multiple OLEDs (Organic Light-Emitting Diodes). Each OLED is an independent light-emitting unit that can be controlled individually. This means that the brightness and color of each OLED can be precisely controlled, thereby achieving high contrast and color saturation. By adjusting the luminous intensity and color of different OLEDs, OLEDs can display colorful images and videos. Each OLED in the visible light layer is used to emit visible light. The transparency of the visible light layer ensures that visible light can pass through smoothly.

[0100] 3. Invisible light layer: The visible light layer includes multiple OLEDs. The OLEDs in the invisible light layer are used to emit invisible light. The transparency of the invisible light layer ensures that the invisible light can pass through smoothly.

[0101] 4. Image sensor: The working principle of the image sensor is mainly based on the photoelectric effect. Photons enter the sensor through the lens and are absorbed by photoelectric devices such as photodiodes in the sensor to generate electrons. These electrons are collected and converted into electrical signals, which are amplified and processed to form a digital image.

[0102] 5. Photosensitive device: When light passes through the camera and hits the surface of the photosensitive device, the photosensitive device generates a corresponding number of electrons (charges) according to the amount of light received. These charges are then converted into voltage signals, which are converted into digital signals through an analog-to-digital converter (ADC) to ultimately form image data.

[0103] 6. RAW image: RAW image itself is a digital representation of light intensity information. Specifically, RAW data is the unprocessed output of the image sensor, which represents the light intensity of different lights received by each photosensitive device on the image sensor, arranged in a specific order (such as Bayer format RGGB, BGGR, GRBG, GBRG). The image sensor converts the light signal into an electrical signal, and then converts it into a digital signal through a digital-to-analog converter. These digital signals constitute the RAW image data. It records the original light intensity information of each pixel.

[0104] 7.RGB image: RGB image is an image based on the combination of three primary colors: red (Red), green (Green) and blue (Blue).

[0105] Figure 2It is a structural schematic diagram of an under-screen camera de-glare device 200 provided according to an embodiment of the present application. The device includes: a visible light layer 201, an invisible light layer 202, an image sensor 203 and a de-glare module 204 connected in sequence; the visible light layer 201 includes a plurality of visible light devices; the invisible light layer 202 includes a plurality of invisible light devices.

[0106] In some embodiments, referring to the screen of the terminal, from the screen downward, there are a visible light layer 201, an invisible light layer 202, an image sensor 203, and a de-glare module 204. The image sensor 203 includes a plurality of photosensitive devices and a camera. The de-glare module 204 is also electrically connected to an ISP (Image Signal Processor) 300.

[0107] In some embodiments, in order to make the light emitted by the visible light layer 201 and the light emitted by the invisible light layer 202 propagate along their respective normals respectively without interfering with each other. In an embodiment of the present application, each visible light device is vertically aligned with an invisible light device; the visible light device is used to emit visible light; the invisible light device is used to emit invisible light. Thereby, the visible light passes through the visible light layer 201 and the invisible light in turn and propagates to the image sensor 203, and the visible light and the invisible light do not interfere with each other during the propagation process, so as to facilitate the determination of the initial light intensity of the visible light and the initial light intensity of the invisible light. For example, each visible light device and each invisible light device are OLED. It should be noted that light intensity can also be expressed as the intensity of luminescence.

[0108] In one example, the visible light device includes any one of a first visible light device, a second visible light device, a third visible light device, and a fourth visible light device. Optionally, after the screen is powered on, the first visible light device is used to emit visible red light; the second visible light device is used to emit visible green light; the third visible light device is used to emit visible blue light; and the fourth visible light device is used to emit visible yellow light.

[0109] In one example, the invisible light device includes any one of a first invisible light device, a second invisible light device, and a third invisible light device. Optionally, after the screen is powered on, the invisible light device includes any one of a first invisible light device, a second invisible light device, a third invisible light device, and a fourth invisible light device; the first invisible light device is used to emit a first invisible light; the second invisible light device is used to emit a second invisible light; the third invisible light device is used to emit a third invisible light; the fourth invisible light device is used to emit a fourth invisible light. For example: the first invisible light is long-wave infrared. The second invisible light is medium-wave infrared. The third invisible light is short-wave infrared. The fourth invisible light is also short-wave infrared.

[0110] In one example, the resolution of the visible light layer 201 and the invisible light layer 202 is the same. Specifically, each first visible light device is vertically aligned with a first invisible light device; each second visible light device is vertically aligned with a second invisible light device; each third visible light device is vertically aligned with a third invisible light device; each fourth visible light device is vertically aligned with a fourth invisible light device. Thus, the visible red light emitted by each first visible light device does not interfere with the first invisible light emitted by a first invisible light device vertically aligned below.

[0111] In some embodiments, the initial light intensity of the visible light and the initial light intensity of the invisible light are in a preset ratio; the invisible light is light of a preset frequency.

[0112] In one example, the initial light intensity of the visible red light is equal to the product of the initial light intensity of the first invisible light and the first preset ratio; the initial light intensity of the visible green light is equal to the product of the initial light intensity of the second invisible light and the second preset ratio. The initial light intensity of the visible blue light is equal to the product of the initial light intensity of the third invisible light and the third preset ratio. Optionally, by adjusting the current of the circuit, the ratio between the initial light intensity of the visible red light and the initial light intensity of the first invisible light is controlled. Similarly, the ratio between the initial light intensity of the visible green light and the initial light intensity of the second invisible light can be obtained. And the ratio between the initial light intensity of the visible blue light and the initial light intensity of the third invisible light. It should be noted that the method of adjusting the current of the circuit can be obtained from the relevant technology, and the embodiments of the present application will not be repeated. For example: the initial light intensity of the visible red light = the first preset ratio × the initial light intensity of the first invisible light. The initial light intensity of the visible green light = the second preset ratio × the initial light intensity of the second invisible light. The initial light intensity of the visible blue light = the third preset ratio × the initial light intensity of the third invisible light.

[0113] In one example, the visible red light and the first invisible light are used as examples for explanation. A first visible light device emits visible red light. The visible red light passes through the visible light layer 201 and the invisible light layer 202 in sequence and propagates to the image sensor 203. A first invisible light device emits a first invisible light. The first invisible light passes through the invisible light layer 202 and propagates to the image sensor 203. According to the above embodiment, it can be known that the initial light intensity of the visible red light received by the image sensor 203 is equal to the product of the initial light intensity of the first invisible light received by the image sensor 203 and the first preset ratio.

[0114] In some embodiments, the image sensor 203 is used to generate an initial RAW image; the initial RAW image is generated based on the received light intensity of the visible light and the received light intensity of the invisible light; the received light intensity of the visible light is the initial light intensity of the visible light received by the image sensor 203; the received light intensity of the invisible light is the initial light intensity of the invisible light received by the image sensor 203.

[0115] In some embodiments, for the convenience of calculation, and to make the initial RAW image conform to the RGGB arrangement rule. Among them, the RGGB arrangement rule is also the Bayer array. The structures of each area in the image sensor 203 are the same. Specifically, the number of visible light devices in each area is the same, and the number of invisible light devices in each area is also the same. Optionally, the image sensor 203 includes a first area, a second area, a third area and a fourth area; the first area includes k first photosensitive areas and (4-k) second photosensitive areas; the second area includes k third photosensitive areas and (4-k) fourth photosensitive areas; the third area includes k third photosensitive areas and (4-k) fourth photosensitive areas; the fourth area includes k fifth photosensitive areas and (4-k) sixth photosensitive areas; k is an integer greater than or equal to 1 and less than or equal to 4.

[0116] Figure 3 It is a schematic diagram of the arrangement structure of the photosensitive devices of the first image sensor provided according to an embodiment of the present application.

[0117] Combine the following Figure 3 The arrangement structure of the photosensitive device is exemplified.

[0118] In one example, the number of first photosensitive areas included in the first area is the same as the number of second photosensitive areas. The number of third photosensitive areas included in the second area is the same as the number of fourth photosensitive areas. The number of third photosensitive areas included in the third area is the same as the number of fourth photosensitive areas. The number of fifth photosensitive areas included in the fourth area is the same as the number of sixth photosensitive areas. For example: k=2. The first area includes 2 first photosensitive areas and 2 second photosensitive areas; the second area includes 2 third photosensitive areas and 2 fourth photosensitive areas; the third area includes k third photosensitive areas and 2 fourth photosensitive areas; the fourth area includes 2 fifth photosensitive areas and 2 sixth photosensitive areas.

[0119] Figure 4 It is a schematic diagram of the arrangement structure of the photosensitive devices of the second image sensor provided according to the embodiment of the present application.

[0120] Combine the following Figure 4 The arrangement structure of the photosensitive device is exemplified.

[0121] In one example, the position of the first photosensitive area is swapped with the position of the second photosensitive area. The position of the third photosensitive area is swapped with the position of the fourth photosensitive area. The position of the fifth photosensitive area is swapped with the position of the sixth photosensitive area. For example, when k=2, Figure 3 The arrangement structure of the photosensitive devices in the device is adjusted.

[0122] Figure 5 It is a schematic diagram of the arrangement structure of the photosensitive devices of the third image sensor provided according to an embodiment of the present application.

[0123] Combine the following Figure 5 The arrangement structure of the photosensitive device is exemplified.

[0124] In one example, in a scenario where the received light intensity of visible light needs to be enhanced, the number of first photosensitive areas included in the first zone is greater than the number of second photosensitive areas. The number of third photosensitive areas included in the second zone is greater than the number of fourth photosensitive areas. The number of third photosensitive areas included in the third zone is greater than the number of fourth photosensitive areas. The number of fifth photosensitive areas included in the fourth zone is greater than the number of sixth photosensitive areas. That is, for each zone, the photosensitive area corresponding to visible light is increased. Correspondingly, the photosensitive area corresponding to invisible light is reduced. For example: k=3. Then the first zone includes 3 first photosensitive areas and 1 second photosensitive area; the second zone includes 3 third photosensitive areas and 1 fourth photosensitive area; the third zone includes 3 third photosensitive areas and 1 fourth photosensitive area; the fourth zone includes 3 fifth photosensitive areas and 1 sixth photosensitive area.

[0125] In some embodiments, since the embodiments of the present application provide a visible light layer and an invisible light layer, in order to achieve simultaneous reception of visible light and invisible light. The image sensor is provided with a photosensitive area for receiving visible light. And a photosensitive area for receiving invisible light. The first photosensitive area includes a plurality of first photosensitive devices; the first photosensitive device is used to receive the initial light intensity of visible red light; the second photosensitive area includes a plurality of second photosensitive devices; the second photosensitive device is used to receive the initial light intensity of the first invisible light; the third photosensitive area includes a plurality of third photosensitive devices; the third photosensitive device is used to receive the initial light intensity of visible green light; the fourth photosensitive area includes a plurality of fourth photosensitive devices; the fourth photosensitive device is used to receive the initial light intensity of the second invisible light; the fifth photosensitive area includes a plurality of fifth photosensitive devices; the fifth photosensitive device is used to receive the initial light intensity of visible blue light; the sixth photosensitive area includes a plurality of sixth photosensitive devices; the sixth photosensitive device is used to receive the initial light intensity of the third invisible light.

[0126] Figure 6 It is a schematic diagram of the arrangement structure of the photosensitive devices of the fourth image sensor provided according to an embodiment of the present application.

[0127] Combine the following Figure 6 The arrangement structure of the photosensitive device is exemplified.

[0128] In some embodiments, in order to adapt to the scene that requires visible yellow light, a photosensitive area that can receive visible yellow light and a photosensitive area that can receive fourth invisible light are set. Specifically, the first area includes k first photosensitive areas and (4-k) second photosensitive areas; the second area includes k third photosensitive areas and (4-k) fourth photosensitive areas; the third area includes k seventh photosensitive areas and (4-k) eighth photosensitive areas; the fourth area includes k fifth photosensitive areas and (4-k) sixth photosensitive areas. The seventh photosensitive area includes a plurality of seventh photosensitive devices; the seventh photosensitive device is used to receive the initial light intensity of the visible yellow light; the eighth photosensitive area includes a plurality of eighth photosensitive devices; the eighth photosensitive device is used to receive the initial light intensity of the fourth invisible light.

[0129] In some embodiments, since in the embodiments of the present application, the received light intensity received by the image sensor includes the received light intensity of visible light and the received light intensity of invisible light. Therefore, the generated initial RAW image includes both the received light intensity of visible light and the received light intensity of invisible light. Optionally, corresponding to the first area, the second area, the third area and the fourth area, the initial RAW image includes a first sub-image, a second sub-image, a third sub-image and a fourth sub-image. Among them, the first sub-image corresponds to the first area. The second sub-image corresponds to the second area. The third sub-image corresponds to the third area. The fourth sub-image corresponds to the fourth area.

[0130] In the first example, the image sensor is further used to: obtain a first sub-image based on the received light intensity of the visible red light in the first area and the received light intensity of the first invisible light. Obtain a second sub-image based on the received light intensity of the visible green light in the second area and the received light intensity of the second invisible light. Obtain a third sub-image based on the received light intensity of the visible green light in the third area and the received light intensity of the second invisible light. Obtain a fourth sub-image based on the received light intensity of the visible blue light in the fourth area and the received light intensity of the third invisible light.

[0131] In the second example, the image sensor is further used to: obtain a first sub-image based on the received light intensity of the visible red light in the first area and the received light intensity of the first invisible light. Obtain a second sub-image based on the received light intensity of the visible green light in the second area and the received light intensity of the second invisible light. Obtain a third sub-image based on the received light intensity of the visible yellow light in the third area and the received light intensity of the fourth invisible light. Obtain a fourth sub-image based on the received light intensity of the visible blue light in the fourth area and the received light intensity of the third invisible light.

[0132] In some embodiments, a de-glare module is used to generate a target RAW image; the target RAW image is obtained based on the difference between the received light intensity of visible light and the received light intensity of the glare of visible light; the received light intensity of the glare of visible light is the product of the received light intensity of invisible light and a preset ratio.

[0133] In some embodiments, the de-glare module is also used to: divide the first sub-image into a first visible light area and a first invisible light area; divide the second sub-image into a second visible light area and a second invisible light area; divide the third sub-image into a third visible light area and a third invisible light area; and divide the fourth sub-image into a fourth visible light area and a fourth invisible light area.

[0134] In the first example, the first visible light region indicates the received light intensity of visible red light of k first photosensitive areas; the first invisible light region indicates the received light intensity of first invisible light of (4-k) second photosensitive areas; the second visible light region indicates the received light intensity of visible green light of k third photosensitive areas; the second invisible light region indicates the received light intensity of second invisible light of (4-k) fourth photosensitive areas; the third visible light region indicates the received light intensity of visible green light of k third photosensitive areas; the third invisible light region indicates the received light intensity of second invisible light of (4-k) fourth photosensitive areas; the fourth visible light region indicates the received light intensity of visible blue light of k fifth photosensitive areas; and the fourth invisible light region indicates the received light intensity of third invisible light of (4-k) sixth photosensitive areas.

[0135] In the second example, the first visible light region indicates the received light intensity of visible red light of k first photosensitive areas; the first invisible light region indicates the received light intensity of first invisible light of (4-k) second photosensitive areas; the second visible light region indicates the received light intensity of visible green light of k third photosensitive areas; the second invisible light region indicates the received light intensity of second invisible light of (4-k) fourth photosensitive areas; the third visible light region indicates the received light intensity of visible yellow light of k third photosensitive areas; the third invisible light region indicates the received light intensity of fourth invisible light of (4-k) fourth photosensitive areas; the fourth visible light region indicates the received light intensity of visible blue light of k fifth photosensitive areas; and the fourth invisible light region indicates the received light intensity of third invisible light of (4-k) sixth photosensitive areas.

[0136] In some embodiments, the de-glare module is further used to: obtain a first RAW image based on the first visible light region, the second visible light region, the third visible light region, and the fourth visible light region; use the first invisible light region, the second invisible light region, the third invisible light region, and the fourth invisible light region as the second RAW image; and obtain a target RAW image based on the difference between the first RAW image and the second RAW image.

[0137] In one example, for the convenience of calculation, the received light intensity of visible red light of the first sub-image is separated from the initial RAW image. The received light intensity of visible green light of the second sub-image and the third sub-image is separated from the initial RAW image respectively. The received light intensity of visible blue light of the fourth sub-image is separated from the initial RAW image. Then the received light intensity of visible red light of the first sub-image is merged. The received light intensity of visible green light of the second sub-image and the third sub-image is merged respectively. The received light intensity of visible blue light of the third sub-image is merged to obtain the first RAW image. The received light intensity of the first invisible light of the first sub-image is separated from the initial RAW image; the received light intensity of the second invisible light of the second sub-image and the third sub-image is separated from the initial RAW image respectively; the received light intensity of the third invisible light of the fourth sub-image is separated from the initial RAW image. Then the received light intensity of the first invisible light of the first sub-image is merged. The received light intensity of the second invisible light of the second sub-image and the third sub-image is merged respectively; the received light intensity of the third invisible light of the fourth sub-image is merged to obtain the second RAW image.

[0138] For example: when k=2. Separate the two visible red light receiving intensities of the first sub-image from the initial RAW image. Separate the two visible green light receiving intensities of the second sub-image and the third sub-image from the initial RAW image. Separate the two visible blue light receiving intensities of the fourth sub-image from the initial RAW image. Then merge the two visible red light receiving intensities of the first sub-image. Separate the two visible green light receiving intensities of the second sub-image and the third sub-image. Merge the two visible blue light receiving intensities of the third sub-image to obtain the first RAW image. Separate the two first invisible light receiving intensities of the first sub-image from the initial RAW image; separate the second invisible light receiving intensities of the second sub-image and the third sub-image from the initial RAW image; separate the third invisible light receiving intensities of the fourth sub-image from the initial RAW image. Then merge the two first invisible light receiving intensities of the first sub-image. The two second invisible light receiving intensities of the second sub-image and the third sub-image are respectively combined; and the two third invisible light receiving intensities of the fourth sub-image are combined to obtain a second RAW image.

[0139] It should be understood that the received light intensity of the photosensitive device is a part of the initial light intensity of the light emitted by the OLED. The following explanation is given by taking the first photosensitive device and the second photosensitive device as examples. The received light intensity of the visible red light received by the first photosensitive device is a part of the initial light intensity of the visible red light emitted by the OLED. The received light intensity of the first invisible light received by the second photosensitive device is a part of the initial light intensity of the first invisible light emitted by the OLED. And the photosensitive device can determine the magnitude of the received light intensity. In other words, the first photosensitive device can determine the magnitude of the received light intensity of the visible red light. The second photosensitive device can also determine the magnitude of the received light intensity of the first invisible light. It should be noted that the method for the photosensitive device to determine the magnitude of the received light intensity can be obtained from the relevant technology, and the embodiments of the present application will not be repeated.

[0140] In the first example, the de-glare module is also used to: obtain a first target sub-image based on the difference between the received light intensity of the first visible light area and the received light intensity of the glare of the first visible light area; the received light intensity of the glare of the first visible light area is the product of the received light intensity of the first invisible area and the first preset ratio. Obtain a second target sub-image based on the difference between the received light intensity of the second visible light area and the received light intensity of the glare of the second visible light area; the received light intensity of the glare of the second visible light area is the product of the received light intensity of the second invisible area and the second preset ratio. Obtain a third target sub-image based on the difference between the received light intensity of the third visible light area and the received light intensity of the glare of the third visible light area; the received light intensity of the glare of the third visible light area is the product of the received light intensity of the third invisible area and the second preset ratio. Obtain a fourth target sub-image based on the difference between the received light intensity of the fourth visible light area and the received light intensity of the glare of the fourth visible light area; the received light intensity of the glare of the fourth visible light area is the product of the received light intensity of the fourth invisible area and the third preset ratio. The first target sub-image, the second target sub-image, the third target sub-image and the fourth target sub-image are taken as the first target RAW image.

[0141] Optionally, the received light intensity of the glare corresponding to the first invisible light is the received light intensity of the first invisible light. The received light intensity of the glare corresponding to the second invisible light is the received light intensity of the second invisible light. The received light intensity of the glare of the third invisible light is the received light intensity of the third invisible light. The received light intensity of the glare of the fourth invisible light is the received light intensity of the fourth invisible light. Then, when the product of the initial light intensity of the first invisible light and the first preset ratio is equal to the initial light intensity of the visible red light. Since the initial light intensity of the glare corresponding to the first invisible light is proportional to the initial light intensity of the first visible light, the initial light intensity of the glare corresponding to the visible red light is proportional to the initial light intensity of the visible red light. Then the received light intensity of the glare of the visible red light is the product of the received light intensity of the first invisible light and the first preset ratio. Similarly, the received light intensity of the glare of the visible green light is the product of the received light intensity of the second invisible light and the second preset ratio; the received light intensity of the glare of the visible blue light is the product of the received light intensity of the third invisible light and the third preset ratio.

[0142] For example: the received light intensity of the glare of visible red light = the received light intensity of the first invisible light × the first preset ratio. The received light intensity of the glare of visible yellow light = the received light intensity of the second invisible light × the second preset ratio. The received light intensity of the glare of visible blue light = the received light intensity of the third invisible light × the third preset ratio.

[0143] In the second example, the de-glare module is also used to: obtain a first target sub-image based on the difference between the received light intensity of the first visible light area and the received light intensity of the glare of the first visible light area; the received light intensity of the glare of the first visible light area is the product of the received light intensity of the first invisible area and the first preset ratio. Based on the difference between the received light intensity of the second visible light area and the received light intensity of the glare of the second visible light area, obtain a second target sub-image; the received light intensity of the glare of the second visible light area is the product of the received light intensity of the second invisible area and the second preset ratio. Based on the difference between the received light intensity of the third visible light area and the received light intensity of the glare of the third visible light area, obtain a third target sub-image; the received light intensity of the glare of the third visible light area is the product of the received light intensity of the third invisible area and the fourth preset ratio. Based on the difference between the received light intensity of the fourth visible light area and the received light intensity of the glare of the fourth visible light area, obtain a fourth target sub-image; the received light intensity of the glare of the fourth visible light area is the product of the received light intensity of the fourth invisible area and the third preset ratio. The first target sub-image, the second target sub-image, the third target sub-image and the fourth target sub-image are used as the second target RAW image.

[0144] Similarly, the received light intensity of the glare light corresponding to the visible yellow light is the product of the received light intensity of the fourth invisible light and the fourth preset ratio.

[0145] For example: the received light intensity of the glare light corresponding to the visible yellow light=the received light intensity of the fourth invisible light×the fourth preset ratio.

[0146] In some embodiments, the RAW target image is output to the ISP, which processes the RAW target image to obtain a de-glare RGB image, thereby improving user satisfaction.

[0147] It should be noted that: when the under-screen camera de-glare device provided in the above embodiment executes the corresponding steps, it only uses the division of the above-mentioned functional modules as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0148] In an embodiment of the present application, a visible light layer, an invisible light layer, an image sensor, and a de-glare module are sequentially arranged below the screen. The initial light intensity of the visible light is arranged to be in a fixed ratio with the initial light intensity of the corresponding invisible light. Then, the received light intensity of the invisible light of the image sensor is the received light intensity of the glare of the invisible light, and then based on the fixed ratio and the received light intensity of the glare of the invisible light, the received light intensity of the glare of the visible light can be determined. The difference between the received light intensity of the visible light of the image sensor and the received light intensity of the glare of the visible light is taken as the target RAW image. Thereby, glare removal is achieved in the RAW domain, thereby improving image quality.

[0149] Figure 7 1 is a flow chart of a method for removing glare from an under-screen camera according to an embodiment of the present application. Figure 7 As shown, in the embodiment of the present application, the application is described by taking the application on a terminal with an under-screen camera as an example. The method comprises the following steps:

[0150] In step 701, the terminal emits visible light.

[0151] In step 702, the terminal emits invisible light; the initial light intensity of the visible light and the initial light intensity of the invisible light are in a preset ratio.

[0152] The invisible light is light of a preset frequency.

[0153] In step 703, the terminal generates an initial RAW image.

[0154] In some embodiments, the initial RAW image is generated based on the received light intensity of the visible light and the received light intensity of the invisible light; the received light intensity of the visible light is the initial light intensity of the visible light received by the image sensor; the received light intensity of the invisible light is the initial light intensity of the invisible light received by the image sensor;

[0155] In step 704 , the terminal generates a target RAW image.

[0156] In some embodiments, the target RAW image is obtained based on the difference between the received light intensity of visible light and the received light intensity of the glare of visible light; the received light intensity of the glare of visible light is the product of the received light intensity of invisible light and a preset ratio.

[0157] In some embodiments, the visible light device includes any one of a first visible light device, a second visible light device, a third visible light device, and a fourth visible light device;

[0158] A first visible light device, used to emit visible red light;

[0159] A second visible light device, used for emitting visible green light;

[0160] A third visible light device, configured to emit visible blue light;

[0161] The fourth visible light device is used to emit visible yellow light.

[0162] In some embodiments, the invisible light device includes any one of a first invisible light device, a second invisible light device, a third invisible light device, and a fourth invisible light device;

[0163] A first invisible light device, used for emitting a first invisible light;

[0164] A second invisible light device, used for emitting a second invisible light;

[0165] A third invisible light device, used for emitting a third invisible light;

[0166] The fourth invisible light device is used to emit a fourth invisible light.

[0167] In some embodiments, each first visible light device is vertically aligned with a first invisible light device; each second visible light device is vertically aligned with a second invisible light device; each third visible light device is vertically aligned with a third invisible light device; and each fourth visible light device is vertically aligned with a fourth invisible light device.

[0168] In some embodiments, the image sensor includes a first area, a second area, a third area and a fourth area; the first area includes k first photosensitive areas and (4-k) second photosensitive areas; the second area includes k third photosensitive areas and (4-k) fourth photosensitive areas; the third area includes k third photosensitive areas and (4-k) fourth photosensitive areas; the fourth area includes k fifth photosensitive areas and (4-k) sixth photosensitive areas; k is an integer greater than or equal to 1 and less than or equal to 4.

[0169] In some embodiments, the first photosensitive area includes a plurality of first photosensitive devices; the first photosensitive devices are used to receive an initial light intensity of visible red light;

[0170] The second photosensitive area includes a plurality of second photosensitive devices; the second photosensitive devices are used to receive the initial light intensity of the first invisible light;

[0171] The third photosensitive area includes a plurality of third photosensitive devices; the third photosensitive devices are used to receive the initial light intensity of the visible green light;

[0172] The fourth photosensitive area includes a plurality of fourth photosensitive devices; the fourth photosensitive devices are used to receive the initial light intensity of the second invisible light;

[0173] The fifth photosensitive area includes a plurality of fifth photosensitive devices; the fifth photosensitive devices are used to receive the initial light intensity of the visible blue light;

[0174] The sixth photosensitive area includes a plurality of sixth photosensitive devices; the sixth photosensitive devices are used to receive the initial light intensity of the third invisible light.

[0175] In some embodiments, the first region includes k first photosensitive regions and (4-k) second photosensitive regions; the second region includes k third photosensitive regions and (4-k) fourth photosensitive regions; the third region includes k seventh photosensitive regions and (4-k) eighth photosensitive regions; the fourth region includes k fifth photosensitive regions and (4-k) sixth photosensitive regions;

[0176] The seventh photosensitive area includes a plurality of seventh photosensitive devices; the seventh photosensitive devices are used to receive the initial light intensity of the visible yellow light;

[0177] The eighth photosensitive area includes a plurality of eighth photosensitive devices; the eighth photosensitive devices are used to receive the initial light intensity of the fourth invisible light.

[0178] In some embodiments, the initial RAW image includes a first sub-image, a second sub-image, a third sub-image, and a fourth sub-image.

[0179] In some embodiments, the method further comprises:

[0180] The received light intensity of the visible red light in the first area and the received light intensity of the first invisible light are used as a first sub-image;

[0181] The received light intensity of the visible green light and the received light intensity of the second invisible light in the second area are used as a second sub-image;

[0182] The received light intensity of the visible green light in the third area and the received light intensity of the second invisible light are used as a third sub-image;

[0183] The received light intensity of the visible blue light in the fourth area and the received light intensity of the third invisible light are used as the fourth sub-image.

[0184] In some embodiments, the method further comprises:

[0185] The received light intensity of the visible red light in the first area and the received light intensity of the first invisible light are used as a first sub-image;

[0186] The received light intensity of the visible green light and the received light intensity of the second invisible light in the second area are used as a second sub-image;

[0187] The received light intensity of the visible yellow light in the third area and the received light intensity of the fourth invisible light are used as a third sub-image;

[0188] The received light intensity of the visible blue light in the fourth area and the received light intensity of the third invisible light are used as the fourth sub-image.

[0189] In some embodiments, the method further comprises:

[0190] The first sub-image is divided into a first visible light region and a first invisible light region; the second sub-image is divided into a second visible light region and a second invisible light region; the third sub-image is divided into a third visible light region and a third invisible light region; and the fourth sub-image is divided into a fourth visible light region and a fourth invisible light region.

[0191] In some embodiments, the first visible light region indicates the received light intensity of visible red light of k first photosensitive regions; the first invisible light region indicates the received light intensity of first invisible light of (4-k) second photosensitive regions; the second visible light region indicates the received light intensity of visible green light of k third photosensitive regions; the second invisible light region indicates the received light intensity of second invisible light of (4-k) fourth photosensitive regions; the third visible light region indicates the received light intensity of visible green light of k third photosensitive regions; the third invisible light region indicates the received light intensity of second invisible light of (4-k) fourth photosensitive regions; the fourth visible light region indicates the received light intensity of visible blue light of k fifth photosensitive regions; and the fourth invisible light region indicates the received light intensity of third invisible light of (4-k) sixth photosensitive regions.

[0192] In some embodiments, the first visible light region indicates the received light intensity of visible red light of k first photosensitive regions; the first invisible light region indicates the received light intensity of first invisible light of (4-k) second photosensitive regions; the second visible light region indicates the received light intensity of visible green light of k third photosensitive regions; the second invisible light region indicates the received light intensity of second invisible light of (4-k) fourth photosensitive regions; the third visible light region indicates the received light intensity of visible yellow light of k third photosensitive regions; the third invisible light region indicates the received light intensity of fourth invisible light of (4-k) fourth photosensitive regions; the fourth visible light region indicates the received light intensity of visible blue light of k fifth photosensitive regions; and the fourth invisible light region indicates the received light intensity of third invisible light of (4-k) sixth photosensitive regions.

[0193] In some embodiments, the method further comprises:

[0194] taking the first visible light region, the second visible light region, the third visible light region, and the fourth visible light region as a first RAW image;

[0195] taking the first invisible light region, the second invisible light region, the third invisible light region, and the fourth invisible light region as a second RAW image;

[0196] The difference between the first RAW image and the second RAW image is used as the target RAW image.

[0197] In some embodiments, the initial light intensity of the visible red light is equal to the product of the initial light intensity of the first invisible light and the first preset ratio;

[0198] The initial light intensity of the visible green light is equal to the product of the initial light intensity of the second invisible light and the second preset ratio;

[0199] The initial light intensity of the visible blue light is equal to the product of the initial light intensity of the third invisible light and the third preset ratio;

[0200] The initial light intensity of the visible yellow light is equal to the product of the initial light intensity of the fourth invisible light and the fourth preset ratio.

[0201] In some embodiments, the method further comprises:

[0202] A first target sub-image is obtained based on a difference between the received light intensity of the first visible light region and the received light intensity of the glare in the first visible light region; the received light intensity of the glare in the first visible light region is the product of the received light intensity of the first invisible region and a first preset ratio;

[0203] A second target sub-image is obtained based on the difference between the received light intensity of the second visible light region and the received light intensity of the glare in the second visible light region; the received light intensity of the glare in the second visible light region is the product of the received light intensity of the second invisible region and the second preset ratio;

[0204] A third target sub-image is obtained based on the difference between the received light intensity of the third visible light region and the received light intensity of the glare in the third visible light region; the received light intensity of the glare in the third visible light region is the product of the received light intensity of the third invisible light region and the second preset ratio;

[0205] A fourth target sub-image is obtained based on the difference between the received light intensity of the fourth visible light region and the received light intensity of the glare in the fourth visible light region; the received light intensity of the glare in the fourth visible light region is the product of the received light intensity of the fourth invisible region and the third preset ratio;

[0206] The first target sub-image, the second target sub-image, the third target sub-image and the fourth target sub-image are taken as the first target RAW image.

[0207] In some embodiments, the method further comprises:

[0208] A first target sub-image is obtained based on a difference between the received light intensity of the first visible light region and the received light intensity of the glare in the first visible light region; the received light intensity of the glare in the first visible light region is the product of the received light intensity of the first invisible region and a first preset ratio;

[0209] A second target sub-image is obtained based on the difference between the received light intensity of the second visible light region and the received light intensity of the glare in the second visible light region; the received light intensity of the glare in the second visible light region is the product of the received light intensity of the second invisible region and the second preset ratio;

[0210] A third target sub-image is obtained based on the difference between the received light intensity of the third visible light region and the received light intensity of the glare in the third visible light region; the received light intensity of the glare in the third visible light region is the product of the received light intensity of the third invisible region and a fourth preset ratio;

[0211] A fourth target sub-image is obtained based on the difference between the received light intensity of the fourth visible light region and the received light intensity of the glare in the fourth visible light region; the received light intensity of the glare in the fourth visible light region is the product of the received light intensity of the fourth invisible region and the third preset ratio;

[0212] The first target sub-image, the second target sub-image, the third target sub-image and the fourth target sub-image are used as the second target RAW image.

[0213] In an embodiment of the present application, a visible light layer, an invisible light layer, an image sensor, and a de-glare module are sequentially arranged below the screen. The initial light intensity of the visible light is arranged to be in a fixed ratio with the initial light intensity of the corresponding invisible light. Then, the received light intensity of the invisible light of the image sensor is the received light intensity of the glare of the invisible light, and then based on the fixed ratio and the received light intensity of the glare of the invisible light, the received light intensity of the glare of the visible light can be determined. The difference between the received light intensity of the visible light of the image sensor and the received light intensity of the glare of the visible light is taken as the target RAW image. Thereby, glare removal is achieved in the RAW domain, thereby improving image quality.

[0214] In addition, the under-screen camera deglare method provided in the above-mentioned embodiment and the under-screen camera deglare device embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0215] An embodiment of the present application further provides a computer device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, and the processor implements the above method when executing the computer program.

[0216] Taking computer equipment as the terminal as an example, Figure 8This is a schematic diagram of the structure of a terminal provided in an embodiment of the present application, see Figure 8 The terminal 800 may be a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III), an MP4 player (Moving Picture Experts Group Audio Layer IV), a laptop computer or a desktop computer. The terminal 800 may also be called a user device, a portable terminal, a laptop terminal, a desktop terminal or other names.

[0217] Typically, the terminal 800 includes a processor 801 and a memory 802 .

[0218] The processor 801 may include one or more processing cores, such as a 4-core processor, a 5-core processor, etc. The processor 801 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 801 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 801 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 801 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0219] The memory 802 may include one or more computer-readable storage media, which may be non-transitory. The memory 802 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 802 is used to store at least one program code, which is used to be executed by the processor 801 to implement the process provided by the method embodiment of the present application for the terminal execution in the above method.

[0220] In some embodiments, the terminal 800 may further optionally include: a peripheral device interface 803 and at least one peripheral device. The processor 801, the memory 802 and the peripheral device interface 803 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 803 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a display screen 804, a camera assembly 805, an audio circuit 806 and a power supply 807.

[0221] The peripheral device interface 803 can be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 801 and the memory 802. In some embodiments, the processor 801, the memory 802, and the peripheral device interface 803 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 801, the memory 802, and the peripheral device interface 803 can be implemented on a separate chip or circuit board, which is not limited in the embodiments of the present application.

[0222] The display screen 804 is used to display the UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. When the display screen 804 is a touch display screen, the display screen 804 also has the ability to collect touch signals on the surface or above the surface of the display screen 804. The touch signal can be input to the processor 801 as a control signal for processing. At this time, the display screen 804 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 804 can be one, set on the front panel of the terminal 800; in other embodiments, the display screen 804 can be at least two, respectively set on different surfaces of the terminal 800 or in a folding design; in other embodiments, the display screen 804 can be a flexible display screen, set on the curved surface or folding surface of the terminal 800. Even, the display screen 804 can also be set to a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 804 can be made of materials such as LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode, organic light-emitting diode).

[0223] The camera assembly 805 is used to capture images or videos. In some embodiments, the camera assembly 805 includes a front camera and a rear camera. Typically, the front camera is disposed on the front panel of the terminal, and the rear camera is disposed on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 805 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0224] The audio circuit 806 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 801 for processing. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the terminal 800. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 801 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 806 may also include a headphone jack.

[0225] The power supply 807 is used to power various components in the terminal 800. The power supply 807 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 807 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0226] Those skilled in the art will understand that Figure 8 The structure shown in the figure does not constitute a limitation on the terminal 800, and the terminal 800 may include more or less components than those shown in the figure, or combine some components, or adopt a different component arrangement.

[0227] Take the computer device as a server as an example. Fig. 9It is a structural diagram of a server provided in an embodiment of the present application. The server 900 may have relatively large differences due to different configurations or performances, and may include one or more processors (Central Processing Units, CPU) 901 and one or more memories 902, wherein the one or more memories 902 store at least one computer program, and the at least one computer program is loaded and executed by the one or more processors 901 to implement the above-mentioned under-screen camera deglare method. Of course, the server 900 may also have components such as a wired or wireless network interface, a keyboard, and an input and output interface for input and output. The server 900 may also include other components for implementing device functions, which will not be repeated here.

[0228] The embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium includes a stored computer program, wherein when the computer program is running, the device where the computer-readable storage medium is located is controlled to execute the above method. Optionally, the computer-readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a compact disc (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, etc.

[0229] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware, or by a program to instruct the relevant hardware, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0230] The above are only optional embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. A glare reduction device for an under-screen camera, characterized in that: include: A visible light layer, an invisible light layer, an image sensor, and a de-glare module connected in sequence; The visible light layer includes a plurality of visible light devices; the invisible light layer includes a plurality of invisible light devices; each of the visible light devices is vertically aligned with one of the invisible light devices; The visible light device is used to emit visible light; The invisible light device is used to emit invisible light; the initial light intensity of the visible light and the initial light intensity of the invisible light are in a preset ratio; the invisible light is light of a preset frequency; The image sensor is used to generate an initial RAW image; The initial RAW image is generated based on the received light intensity of the visible light and the received light intensity of the invisible light; the received light intensity of the visible light is the initial light intensity of the visible light received by the image sensor; the received light intensity of the invisible light is the initial light intensity of the invisible light received by the image sensor; The de-glare module is used to generate a target RAW image; the target RAW image is obtained based on the difference between the received light intensity of the visible light and the received light intensity of the glare of the visible light; the received light intensity of the glare of the visible light is the product of the received light intensity of the invisible light and the preset ratio.

2. The device according to claim 1, characterized in that The visible light device includes any one of a first visible light device, a second visible light device, a third visible light device and a fourth visible light device; The first visible light device is used to emit visible red light; The second visible light device is used to emit visible green light; The third visible light device is used to emit visible blue light; The fourth visible light device is used to emit visible yellow light.

3. The device according to claim 2, characterized in that The invisible light device includes any one of a first invisible light device, a second invisible light device, a third invisible light device, and a fourth invisible light device; The first invisible light device is used to emit a first invisible light; The second invisible light device is used to emit a second invisible light; The third invisible light device is used to emit a third invisible light; The fourth invisible light device is used to emit fourth invisible light.

4. The device according to claim 3, characterized in that Each of the first visible light devices is vertically aligned with a first invisible light device; each of the second visible light devices is vertically aligned with a second invisible light device; each of the third visible light devices is vertically aligned with a third invisible light device; and each of the fourth visible light devices is vertically aligned with a fourth invisible light device.

5. The device according to claim 3, characterized in that The image sensor includes a first area, a second area, a third area and a fourth area; the first area includes k first photosensitive areas and (4-k) second photosensitive areas; the second area includes k third photosensitive areas and (4-k) fourth photosensitive areas; the third area includes k third photosensitive areas and (4-k) fourth photosensitive areas; the fourth area includes k fifth photosensitive areas and (4-k) sixth photosensitive areas; k is an integer greater than or equal to 1 and less than or equal to 4.

6. The device according to claim 5, characterized in that The first photosensitive area includes a plurality of first photosensitive devices; the first photosensitive devices are used to receive the initial light intensity of the visible red light; The second photosensitive area includes a plurality of second photosensitive devices; the second photosensitive devices are used to receive the initial light intensity of the first invisible light; The third photosensitive area includes a plurality of third photosensitive devices; the third photosensitive devices are used to receive the initial light intensity of the visible green light; The fourth photosensitive area includes a plurality of fourth photosensitive devices; the fourth photosensitive devices are used to receive the initial light intensity of the second invisible light; The fifth photosensitive area includes a plurality of fifth photosensitive devices; the fifth photosensitive devices are used to receive the initial light intensity of the visible blue light; The sixth photosensitive area includes a plurality of sixth photosensitive devices; the sixth photosensitive devices are used to receive the initial light intensity of the third invisible light.

7. The device according to claim 5, characterized in that The first area includes k first photosensitive areas and (4-k) second photosensitive areas; the second area includes k third photosensitive areas and (4-k) fourth photosensitive areas; the third area includes k seventh photosensitive areas and (4-k) eighth photosensitive areas; the fourth area includes k fifth photosensitive areas and (4-k) sixth photosensitive areas; The seventh photosensitive area includes a plurality of seventh photosensitive devices; the seventh photosensitive device is used to receive the initial light intensity of the visible yellow light; The eighth photosensitive area includes a plurality of eighth photosensitive devices; the eighth photosensitive devices are used to receive the initial light intensity of the fourth invisible light.

8. The device according to claim 7, characterized in that The initial RAW image includes a first sub-image, a second sub-image, a third sub-image, and a fourth sub-image.

9. The device according to claim 8, characterized in that The image sensor is further used for: obtaining the first sub-image based on the received light intensity of the visible red light in the first area and the received light intensity of the first invisible light; obtaining the second sub-image based on the received light intensity of the visible green light in the second area and the received light intensity of the second invisible light; obtaining the third sub-image based on the received light intensity of the visible green light in the third area and the received light intensity of the second invisible light; The fourth sub-image is obtained based on the received light intensity of the visible blue light in the fourth area and the received light intensity of the third invisible light.

10. The device according to claim 8, characterized in that The image sensor is further used for: obtaining the first sub-image based on the received light intensity of the visible red light in the first area and the received light intensity of the first invisible light; obtaining the second sub-image based on the received light intensity of the visible green light in the second area and the received light intensity of the second invisible light; obtaining the third sub-image based on the received light intensity of the visible yellow light in the third area and the received light intensity of the fourth invisible light; The fourth sub-image is obtained based on the received light intensity of the visible blue light in the fourth area and the received light intensity of the third invisible light.

11. The device according to claim 8, characterized in that The de-glare module is also used for: The first sub-image is divided into a first visible light area and a first invisible light area; the second sub-image is divided into a second visible light area and a second invisible light area; the third sub-image is divided into a third visible light area and a third invisible light area; the fourth sub-image is divided into a fourth visible light area and a fourth invisible light area.

12. The device according to claim 11, characterized in that The first visible light region indicates the received light intensity of the visible red light of k first photosensitive areas; the first invisible light region indicates the received light intensity of the first invisible light of (4-k) second photosensitive areas; the second visible light region indicates the received light intensity of the visible green light of k third photosensitive areas; the second invisible light region indicates the received light intensity of the second invisible light of (4-k) fourth photosensitive areas; the third visible light region indicates the received light intensity of the visible green light of k third photosensitive areas; the third invisible light region indicates the received light intensity of the second invisible light of (4-k) fourth photosensitive areas; the fourth visible light region indicates the received light intensity of the visible blue light of k fifth photosensitive areas; The fourth invisible light region indicates the received light intensity of the third invisible light of (4-k) the sixth photosensitive areas.

13. The device according to claim 11, characterized in that The first visible light region indicates the received light intensity of the visible red light of k first photosensitive areas; the first invisible light region indicates the received light intensity of the first invisible light of (4-k) second photosensitive areas; the second visible light region indicates the received light intensity of the visible green light of k third photosensitive areas; the second invisible light region indicates the received light intensity of the second invisible light of (4-k) fourth photosensitive areas; the third visible light region indicates the received light intensity of the visible yellow light of k third photosensitive areas; the third invisible light region indicates the received light intensity of the fourth invisible light of (4-k) fourth photosensitive areas; the fourth visible light region indicates the received light intensity of the visible blue light of k fifth photosensitive areas; The fourth invisible light region indicates the received light intensity of the third invisible light of (4-k) the sixth photosensitive areas.

14. The device according to claim 11, characterized in that The de-glare module is also used for: Obtaining a first RAW image based on the first visible light region, the second visible light region, the third visible light region, and the fourth visible light region; obtaining a second RAW image based on the first invisible light area, the second invisible light area, the third invisible light area, and the fourth invisible light area; The target RAW image is obtained based on a difference between the first RAW image and the second RAW image.

15. The device according to claim 14, characterized in that The initial light intensity of the visible red light is equal to the product of the initial light intensity of the first invisible light and a first preset ratio; The initial light intensity of the visible green light is equal to the product of the initial light intensity of the second invisible light and a second preset ratio; The initial light intensity of the visible blue light is equal to the product of the initial light intensity of the third invisible light and a third preset ratio; The initial light intensity of the visible yellow light is equal to the product of the initial light intensity of the fourth invisible light and a fourth preset ratio.

16. The device according to claim 15, characterized in that The de-glare module is also used for: A first target sub-image is obtained based on the difference between the received light intensity of the first visible light area and the received light intensity of the glare of the first visible light area; the received light intensity of the glare of the first visible light area is the product of the received light intensity of the first invisible area and the first preset ratio; obtaining a second target sub-image based on a difference between the received light intensity of the second visible light region and the received light intensity of the glare in the second visible light region; The received light intensity of the glare in the second visible light area is the product of the received light intensity in the second invisible light area and the second preset ratio; A third target sub-image is obtained based on the difference between the received light intensity of the third visible light area and the received light intensity of the glare in the third visible light area; the received light intensity of the glare in the third visible light area is the product of the received light intensity of the third invisible area and the second preset ratio; obtaining a fourth target sub-image based on a difference between the received light intensity of the fourth visible light region and the received light intensity of the glare of the fourth visible light region; The received light intensity of the glare in the fourth visible light region is the product of the received light intensity in the fourth invisible light region and the third preset ratio; The first target sub-image, the second target sub-image, the third target sub-image and the fourth target sub-image are used as first target RAW images.

17. The device according to claim 15, characterized in that The de-glare module is also used for: A first target sub-image is obtained based on the difference between the received light intensity of the first visible light area and the received light intensity of the glare of the first visible light area; the received light intensity of the glare of the first visible light area is the product of the received light intensity of the first invisible area and the first preset ratio; obtaining a second target sub-image based on a difference between the received light intensity of the second visible light region and the received light intensity of the glare in the second visible light region; The received light intensity of the glare in the second visible light area is the product of the received light intensity in the second invisible light area and the second preset ratio; A third target sub-image is obtained based on the difference between the received light intensity of the third visible light area and the received light intensity of the glare in the third visible light area; the received light intensity of the glare in the third visible light area is the product of the received light intensity of the third invisible area and the fourth preset ratio; obtaining a fourth target sub-image based on a difference between the received light intensity of the fourth visible light region and the received light intensity of the glare of the fourth visible light region; The received light intensity of the glare in the fourth visible light region is the product of the received light intensity in the fourth invisible light region and the third preset ratio; The first target sub-image, the second target sub-image, the third target sub-image and the fourth target sub-image are used as second target RAW images.

18. A method for removing glare from an under-screen camera, characterized in that: include: emits visible light; Emitting invisible light; the initial light intensity of the visible light and the initial light intensity of the invisible light are in a preset ratio; the invisible light is light of a preset frequency; Generate an initial RAW image; the initial RAW image is generated based on the received light intensity of the visible light and the received light intensity of the invisible light; the received light intensity of the visible light is the initial light intensity of the visible light received by the image sensor; the received light intensity of the invisible light is the initial light intensity of the invisible light received by the image sensor; Generate a target RAW image; the target RAW image is obtained based on the difference between the received light intensity of the visible light and the received light intensity of the glare of the visible light; the received light intensity of the glare of the visible light is the product of the received light intensity of the invisible light and the preset ratio.

19. A computer device, characterized in that: The computer device includes a processor and a memory, the memory is used to store at least one program, and the at least one program is loaded by the processor and executed by the under-screen camera deglare method as described in claim 18.

20. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores at least one program, and the at least one program is loaded and executed by the processor to implement the under-screen camera deglare method as described in claim 18.

Images