A camera terminal, a camera method and a computer readable storage medium

Abstract

Embodiments of the present application provide a kind of camera terminal, camera method and computer readable storage medium, at least two camera areas are formed on display screen, the aperture of the light transmission array hole of each camera area is different;Light transmission array hole includes: the arrangement of the line and pixel array in display screen forms several holes;Camera is set below each camera area, camera is set below each camera area, camera shoots image, forms the corresponding camera image of each camera area;The corresponding camera image of each camera area is fused to reduce noise, forms target image, in some implementation process, it has the effect of improving the imaging quality of image, improves user selfie experience.

Description

TECHNICAL FIELD

[0001] The embodiment of the present application relates to the terminal field, in particular, to a camera terminal, a camera method and a computer readable storage medium. BACKGROUND

[0002] With the rapid development of terminals, more and more terminals use full screens, and the under-screen camera becomes a mainstream setting. However, in order to ensure that the corresponding area is normally displayed, the display pixel (RGB pixel array) and the driving pixel display line must be reserved. Only the through-hole array between the pixel array and the line can normally pass the light and irradiate on the camera, but the pixel array and the driving line block most of the light of the camera scene. After the light wave encounters an obstacle, it will deviate from the straight propagation law in geometric optics more or less, and the light passing through the through-hole array will cause diffraction problems, resulting in bright spots or bright lines in the image received by the camera, and the imaging quality of the camera is affected. SUMMARY

[0003] The camera terminal, the camera method and the computer readable storage medium provided by the embodiment of the present application solve the technical problem that the imaging quality is affected by light diffraction.

[0004] The embodiment of the present application provides a camera terminal, which comprises a display screen and a camera; at least two camera areas are formed on the display screen, and the aperture of the light transmission array hole of each camera area is different; the light transmission array hole comprises a plurality of holes formed by the arrangement of the line and the pixel array in the display screen;

[0005] The camera is arranged below each camera area to shoot the light passing through the light transmission array hole of the camera area.

[0006] The embodiment of the present application further provides a camera method applied to the above-mentioned camera terminal, and the camera method comprises the following steps.

[0007] When the camera is arranged below each camera area, the camera shoots an image to form a camera image corresponding to each camera area.

[0008] The camera images corresponding to each camera area are fused to form a target image.

[0009] The embodiment of the present application further provides a computer storage medium, and the computer readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the steps of the camera method.

[0010] According to the camera terminal, the camera method and the computer storage medium provided by the embodiment of the present application, at least two camera areas are formed on the display screen, and the aperture of the light transmission array hole of each camera area is different; the light transmission array hole includes a plurality of holes formed by the arrangement of the circuit and the pixel array in the display screen; the camera is arranged below each camera area, and when the camera is arranged below each camera area, the camera shoots an image to form a corresponding camera image of each camera area; the corresponding camera images of each camera area are fused after noise reduction to form a target image, and in some implementation processes, the imaging abnormality caused by the diffraction phenomenon can be reduced, the imaging quality of the image is improved, and the user selfie experience is improved.

[0011] Other features and corresponding advantages of the present application are set forth in the latter part of the specification, and it is to be understood that at least some of the advantages can be readily implemented by the present application. BRIEF DESCRIPTION OF DRAWINGS

[0012] Figure 1 A cross-sectional view of the under-screen camera area in the first example of the camera terminal of the embodiment of the present application;

[0013] Figure 2 A cross-sectional view of the under-screen camera area in the second example of the camera terminal of the embodiment of the present application;

[0014] Figure 3 A schematic view of the first camera area in the second example of the camera terminal of the embodiment of the present application;

[0015] Figure 4 A schematic view of the second camera area in the second example of the camera terminal of the embodiment of the present application;

[0016] Figure 5 A cross-sectional view of the under-screen camera area in the third example of the camera terminal of the embodiment of the present application;

[0017] Figure 6 A basic flowchart of the camera method of the embodiment of the present application;

[0018] Figure 7 A detailed flowchart of the camera method of the embodiment of the present application;

[0019] Figure 8 A detailed flowchart of the camera method of the embodiment of the present application;

[0020] REFERENCE SIGNS:

[0021] Display screen 1, first camera 2, second camera 3, first camera area 4, second camera area 5, slider 6, groove 7. DETAILED DESCRIPTION

[0022] In order to make the objectives, technical solutions and advantages of the present application clearer, further detailed description will be made to the embodiments of the present application in combination with the accompanying drawings. It should be understood that the specific embodiments described herein are only used to explain the present application and should not be used to limit the present application.

[0023] Embodiment one:

[0024] In order to solve the technical problem that the imaging quality is affected by light diffraction, the present application provides a camera terminal, which will be described below in combination with embodiments.

[0025] The camera terminal provided by the embodiment of the present application comprises a display screen and a camera, at least two camera areas are formed on the display screen, and the aperture of the light transmission array of each camera area is different; the light transmission array hole comprises a plurality of holes formed by the arrangement of the lines and the pixel array in the display screen. The camera is arranged below each camera area to shoot the light passing through the light transmission array hole of the camera area. The aperture of the light transmission array of each camera area can be changed by at least one of the following methods: adjusting the voltage, adjusting the current, and adjusting by mechanical method. In order to ensure the uniformity of display, the light-emitting pixels and the lines are uniformly distributed, that is, the size and shape of the light transmission hole are consistent.

[0026] In some examples, the display screen forms at least two camera areas, and the aperture of the light transmission array hole of each camera area is different, which can include that the display screen forms at least two camera areas at different times, each camera area is located at a first preset position, and the aperture of the light transmission array hole formed at the first preset position of the display screen at different times is different; the camera is arranged below each camera area, which includes that the camera is fixedly arranged below the first preset position.

[0027] In some examples, the display screen forms at least two camera areas, which can include that the display screen has at least two preset positions corresponding to at least two camera areas; and the camera is arranged below each camera area, which includes that at least two cameras are fixedly arranged below at least two preset positions.

[0028] In some examples, the camera terminal may also include a sliding connecting component, which includes a slider and a groove. When at least two preset positions on the display screen correspond to at least two camera areas, the camera being positioned below each camera area may include: one camera being positioned below any one of the at least two preset positions, the camera being fixedly connected to the slider, and the camera sliding along the groove to below each camera area according to preset control commands. The path traversed by the groove passes directly below each camera area. In other examples, if there are more than two camera areas, such as three camera areas, the camera being positioned below each camera area may also include: one camera being positioned below any one of the three preset positions, the camera being fixedly connected to the slider, and the camera sliding along the groove to below another camera area according to preset control commands. The path traversed by the groove passes directly below two camera areas. A separate camera may also be positioned below the other camera area.

[0029] The camera terminal provided in this invention forms at least two camera areas on a display screen, each with a different aperture of its light-transmitting array aperture. The light-transmitting array aperture comprises several holes formed by the arrangement of lines and pixel arrays within the display screen. A camera is positioned below each camera area to capture light passing through the light-transmitting array aperture of that area. This solves the technical problem of light diffraction affecting image quality, reduces imaging anomalies caused by diffraction, and improves image quality.

[0030] For ease of understanding, the camera terminal provided in this embodiment will be described exemplarily below with reference to the accompanying drawings.

[0031] Please see Figure 1 The example shown, Figure 1 This is a cross-sectional view of the under-display camera area of ​​a camera terminal according to Embodiment 1 of the present invention. The camera terminal includes a display screen 1, a first camera 2, and a second camera 3. Two camera areas, namely a first camera area 4 and a second camera area 5, are respectively set at two preset positions on the display screen 1. The apertures of the light-transmitting array holes in the two camera areas are different. The light-transmitting array holes include several holes formed by the arrangement of lines and pixel arrays within the display screen 1. The first camera 2 is located directly below the first camera area 4, and the second camera 3 is located directly below the second camera area 5.

[0032] Please see Figure 2 The example shown, Figure 2Another under-screen camera area profile of a camera terminal is provided for the first embodiment of the present application, the camera terminal comprising a display screen 1 and a first camera 2, two camera areas are formed on the display screen at different times, each camera area is located at a first preset position, and the aperture of the light transmission array hole formed on the display screen at different times at the first preset position is different. The camera is fixedly arranged below the first preset position. Among them, the camera area with different apertures at the same position, at the first time, the aperture of the first camera area 4 can be set as the first preset aperture, as shown in Figure 3 , which is a schematic diagram of the first camera area magnification, the black line area is the pixel array and the circuit, and the white area is the light transmission hole. At the second time, the aperture of the second camera area 5 can be set as the second preset aperture, as shown in Figure 4 . Among them, the only difference between the first camera area 4 and the second camera area 5 is that the size of the light transmission aperture is different, and the other designs are the same. The first time and the second time can be preset by the developer of the camera terminal or the user. The first preset aperture and the second preset aperture can be set as needed, and the general aperture is between several microns and hundreds of microns (not more than 0.0001 meters).

[0033] Please refer to the example shown in Figure 5 , Figure 5 The under-screen camera area profile of the camera terminal in the third example provided for the first embodiment of the present application, the camera terminal comprises a display screen 1, a first camera 2 and a sliding connection component. The sliding connection component comprises a sliding block 6 and a groove 7. When the three preset positions on the display screen correspond to three camera areas, the first camera 2 arranged below each camera area can include: the first camera 2 is arranged below the preset position of the first camera area, the first camera 2 is fixedly connected with the sliding block 6, and the first camera 2 slides to below each camera area according to the preset control instruction. The path through the groove passes through the directly below each camera area.

[0034] Embodiment II

[0035] In order to solve the technical problem that the imaging quality is affected by light diffraction, the present application provides a camera shooting method, which will be described below in combination with the embodiments.

[0036] Please refer to Figure 6 , Figure 6 The basic flowchart of the camera shooting method in the second embodiment of the present application, the method is applied to the camera terminal in the above-mentioned first embodiment, and the method comprises:

[0037] S601, when the camera is arranged below each camera area, the camera shoots an image to form a corresponding camera image of each camera area.

[0038] Wherein due to the different aperture of the light transmission array hole of each camera area, the diffraction spot distribution is also different. The light intensity distribution of the diffraction light on the image plane can be expressed as:

[0039]

[0040] Wherein k is a constant, a is the radius of the aperture, J1(x) is the first Bessel function, and θp is the angular radius.

[0041] S602, the camera image corresponding to each camera area is fused to form a target image.

[0042] In some examples, the camera image corresponding to each camera area is fused to form a target image can include: comparing the camera image corresponding to each camera area, determining the overlapping photo imaging range in each camera image, and fusing the noise reduction of each photo in the overlapping photo imaging range to form a target image. And fusing the noise reduction of each photo in the overlapping photo imaging range to form a target image can include: dividing each photo in the overlapping photo imaging range into a plurality of image units respectively, and the division position of each image unit of each photo is the same. The image units at the same position of each photo are compared, the image units with the smallest or no diffraction spot area are output, and the output images are fused to form a target image. Since the photos are taken under different apertures of each camera area, the diffraction spot distribution on the same image in the pictures of different camera areas is different. By comparing multiple photos, the same image unit may have diffraction spots in some photos and no diffraction spots in some photos, and normal images are selected to replace the diffraction spots or part of the diffraction spots (only part of the normal images covered by the diffraction spots are found). After all image units are processed in the same way, a new photo without diffraction spots is synthesized.

[0043] In other examples, the camera image corresponding to each camera area is fused to form a target image can include: comparing the camera image corresponding to each camera area, obtaining each photo area in the overlapping photo imaging range and each photo area in the non-overlapping photo imaging range; fusing the noise reduction of each photo area in the overlapping photo imaging range to form a noise reduction fusion image; and splicing each photo area in the non-overlapping photo imaging range with the noise reduction fusion image to form a target image. And fusing the noise reduction of each photo area in the overlapping photo imaging range to form a noise reduction fusion image can include: dividing each photo in the overlapping photo imaging range into a plurality of image units respectively, and the division position of each image unit of each photo is the same. The image units at the same position of each photo are compared, the image units with the smallest or no diffraction spot area are output, and the output images are fused to form a noise reduction fusion image.

[0044] For example, the photos taken by different display areas can be placed on the same image plane (two groups of photos taken by two display areas are taken as an example below), and the definition of the same image plane is that the imaging plane has the same magnification or reduction ratio of the photographed object. On the image plane, the imaging ranges of the two groups of photos can be completely overlapped or deviated, the overlapping area of the two groups of photos is determined first, and the image information outside the overlapping area is directly spliced into the final photo or discarded. As for the image in the overlapping area of the two groups of photos, the image is divided into a plurality of minimum image units. The number of minimum image units can be determined according to the processing capacity of the system, and the shape can be rectangular or other shapes. Generally, all image units can cover the overlapping area of the two groups of photos. The diffraction spot distribution position and shape of the two groups of photos in the overlapping area are different, and the diffraction spot shape and size in the same position of the minimum image unit of the two groups of photos are different. The two groups of images in the same position of the minimum image unit are compared with the spot images stored in the system, and the image with the smallest spot area or without a spot is reserved as the output image of the minimum image unit. All output images are spliced into a complete output photo of the overlapping area and saved.

[0045] The photographing method provided by the embodiment of the present application, when the camera is arranged below each photographing area, the camera photographs images to form photographing images corresponding to each photographing area, and the photographing images corresponding to each photographing area are fused to form a target image. The technical problem that the imaging quality is affected by light diffraction is solved, the imaging anomaly caused by the diffraction phenomenon is reduced, the imaging quality of the image is improved, and the selfie experience of the user can be improved.

[0046] Embodiment three

[0047] The photographing method of the present application reduces the imaging anomaly caused by the diffraction phenomenon and improves the imaging quality of the image. In order to facilitate understanding, the photographing method of the present application will be specifically described in combination with an application scenario.

[0048] Please refer to Figure 7 , Figure 7 The photographing method in the embodiment three of the present application is a detailed flowchart, and the method is applied to the photographing terminal in the embodiment one. The method comprises the following steps.

[0049] S701, when the camera is arranged below each photographing area, the camera photographs images to form photographing images corresponding to each photographing area.

[0050] S702, the imaging ranges of the photos that overlap in each photographing image are determined according to the photographing images corresponding to each photographing area.

[0051] S703, respectively segmenting each photo in the overlapped photo imaging range into a plurality of image units.

[0052] S704, comparing the image units at the same position of each photo, outputting the image unit with the smallest or no light spot area, and fusing the output images to form a target image.

[0053] The camera shooting method provided by the embodiment of the present application, when the camera is arranged below each camera shooting area, the camera shoots images to form camera images corresponding to each camera shooting area, determines the overlapped photo imaging range in each camera image according to the camera images corresponding to each camera shooting area, respectively segments each photo in the overlapped photo imaging range into a plurality of image units, compares the image units at the same position of each photo, outputs the image unit with the smallest or no light spot area, and fuses the output images to form a target image. The technical problem that the imaging quality is affected by light diffraction is solved, the imaging abnormality caused by diffraction phenomenon is reduced, and the imaging quality of the image is improved.

[0054] Embodiment four:

[0055] The camera shooting method of the present application reduces the imaging abnormality caused by diffraction phenomenon and improves the imaging quality of the image. In order to facilitate understanding, the camera shooting method of the present application is specifically described below in combination with an application scenario.

[0056] Please refer to Figure 8 , Figure 8 The camera shooting method in the fourth embodiment of the present application is a detailed flowchart, the method is applied to the camera shooting terminal in the first embodiment described above, and the method comprises the following steps:

[0057] S801, when the camera is arranged below each camera shooting area, the camera shoots images to form camera images corresponding to each camera shooting area.

[0058] S802, comparing the camera images corresponding to each camera shooting area to obtain each photo area in the overlapped photo imaging range and each photo area in the non-overlapped photo imaging range.

[0059] S803, respectively segmenting each photo in the overlapped photo imaging range into a plurality of image units.

[0060] S804, comparing the image units at the same position of each photo, outputting the image unit with the smallest or no light spot area, and fusing the output images to form a noise reduction fusion image.

[0061] S805, splicing each photo area in the non-overlapped photo imaging range and the noise reduction fusion image to form a target image.

[0062] The photographing method provided by the embodiment of the present application, when the camera is arranged below each photographing area, the camera captures images to form photographing images corresponding to each photographing area, and determines the overlapping photograph imaging range in each photographing image according to the photographing images corresponding to each photographing area. Each photograph in the overlapping photograph imaging range is divided into a plurality of image units. The image units at the same position of each photograph are compared, and the image unit with the smallest spot area or without a spot is outputted. A denoising fusion image is formed by fusing each output image. Each photograph area in the non-overlapping photograph imaging range is spliced with the denoising fusion image to form a target image. The technical problem that the imaging quality is affected by light diffraction is solved, the imaging abnormality caused by the diffraction phenomenon is reduced, the imaging quality of the image is improved, and the under-screen photographing picture with more information and higher image quality is obtained.

[0063] Embodiment five:

[0064] The embodiment also provides a computer readable storage medium including a volatile or non-volatile, removable or non-removable medium implemented in any method or technology for storing information, such as computer readable instructions, data structures, computer program modules or other data. The computer readable storage medium includes but is not limited to RAM (Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable read only memory), flash memory or other memory technology, CD-ROM (Compact Disc Read-Only Memory), digital versatile disc (DVD) or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device, or any other medium that can be used to store desired information and can be accessed by a computer.

[0065] The computer readable storage medium in the embodiment can be used to store one or more computer programs, and the one or more computer programs stored therein can be executed by the processor to implement at least one step of the photographing method in the above-mentioned embodiments two to four.

[0066] It will be apparent to those skilled in the art that all or some of the steps, functions, procedures, modules and / or blocks described in the above-disclosed methods can be implemented as software (which can be written in computer program code), firmware, hardware (e.g., an application specific integrated circuit), or a combination thereof. In hardware implementations, the division of functionality between the above-described blocks, modules or components can not correspond to physical divisions. For example, one physical component can serve the function of multiple blocks, or one block can be spread over several physical components. Some or all of the physical components can be implemented in software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or in hardware, or in a combination of software and hardware.

[0067] Furthermore, as will be apparent to one of ordinary skill in the art, communications media typically embody computer-readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and can include any information delivery media. Accordingly, the present application is not limited to any particular hardware and software combination.

Claims

1. A camera terminal, the camera terminal comprising: Display screen and camera; At least two camera areas are formed on the display screen, and the aperture of the light-transmitting array holes in each camera area is different; The light-transmitting array aperture includes: a plurality of holes formed by the arrangement of lines and pixel arrays within the display screen; The camera is positioned below each of the camera areas to capture light passing through the light-transmitting array apertures of the camera areas; The display screen forms at least two camera areas, and the aperture of the light-transmitting array hole of each camera area is different, including: the display screen forms at least two camera areas at different times, each camera area is located at a first preset position, and the aperture of the light-transmitting array hole formed at the first preset position at different times is different; The camera being positioned below each of the camera areas includes: the camera being fixedly positioned below the first preset position.

2. The camera terminal as described in claim 1, characterized in that, The different aperture diameters of the light-transmitting array holes in each of the aforementioned camera areas include: changing the aperture diameter of the light-transmitting array holes in each of the aforementioned camera areas through at least one of the following methods: By adjusting the voltage; By adjusting the current; Adjusted mechanically.

3. A camera method, wherein the camera method is applied to a camera terminal as described in any one of claims 1-2, the camera method comprising: When the camera is positioned below each of the camera areas, the camera captures images to form camera images corresponding to each of the camera areas; The camera images corresponding to each of the camera areas are denoised and fused to form the target image.

4. The imaging method as described in claim 3, wherein the step of denoising and fusing the imaging images corresponding to each of the imaging areas to form a target image includes: The camera images corresponding to each camera area are compared to determine the overlapping image range of each camera image; the photos within the overlapping image range are denoised and fused to form the target image.

5. The imaging method as described in claim 4, wherein the step of noise reduction and fusion of the photos within the overlapping imaging range to form the target image comprises: Each of the photographs is divided into several image units, and the image units of each photograph are divided at the same position. Image units at the same location in each photo are compared, and the image unit with the smallest spot area or no spot is output. The output images are then fused to form the target image.

6. The imaging method as described in claim 3, wherein the step of denoising and fusing the imaging images corresponding to each of the imaging areas to form a target image includes: Compare the camera images corresponding to each of the camera areas to obtain each photo area within the overlapping photo imaging range and each photo area within the non-overlapping photo imaging range; The noise reduction of each photo region within the overlapping photo imaging range is fused to form a noise-reduced fused image; The target image is formed by stitching together the non-overlapping image imaging ranges of each photo region with the noise-reduced fused image.

7. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores one or more computer programs, which can be executed by one or more processors to implement the steps of the imaging method as described in any one of claims 3 to 6.

Images