An electronic device

By placing a camera and light-directing element on the side of the display panel away from the light-emitting surface, and using the camera's photoelectric conversion chip to collect fingerprint image information, the problem of low accuracy in under-display fingerprint recognition is solved, achieving high-accuracy fingerprint recognition and high screen-to-body ratio electronic device design.

CN114495181BActive Publication Date: 2025-11-11HUAWEI TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202011262385.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-11-12
Publication Date
2025-11-11
Estimated Expiration
2040-11-12

AI Technical Summary

Technical Problem

Current under-display fingerprint recognition technology has a low fingerprint recognition accuracy, which affects the user experience.

Method used

A camera and a light-directing element are set on the side of the display panel away from the light-emitting surface. The photoelectric conversion chip in the camera receives the light reflected from the fingerprint recognition area, and the light-directing element transmits the light to the photoelectric conversion chip to realize fingerprint image acquisition. The application of the photoelectric conversion chip is switched in different working states by the switching control module.

Benefits of technology

It improves the accuracy of fingerprint recognition, enhances hardware integration, reduces costs, and eliminates the need for an additional photoelectric conversion chip for fingerprint recognition.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114495181B_ABST
    Figure CN114495181B_ABST
Patent Text Reader

Abstract

This application provides an electronic device. The electronic device includes a display panel, a camera, a fingerprint recognition light source, and a light-directing element. The transmittance of a first display area in the display panel is greater than that of a second display area, the second display area including a fingerprint recognition area. The camera, fingerprint recognition light source, and light-directing element are all located on the side of the display panel opposite to its light-emitting surface. The camera includes a photoelectric conversion chip, and the camera is disposed on the side of the first display area opposite to its light-emitting surface. The fingerprint recognition light source is used to direct light towards the fingerprint recognition area during the fingerprint recognition stage. The light-directing element is used to transmit the light reflected by the touch subject pressing the fingerprint recognition area to the photoelectric conversion chip during the fingerprint recognition stage. During the fingerprint recognition stage, fingerprint image information can be acquired using the photoelectric conversion chip of the camera, thereby achieving fingerprint recognition. The photoelectric conversion chip in the camera has high imaging quality and accuracy, which can improve the fingerprint recognition accuracy.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention belongs to the field of display technology, and more specifically relates to an electronic device. Background Technology

[0002] As the demand for higher screen-to-body ratios in electronic displays increases, the concept of full-screen displays has emerged. For electronic products with fingerprint recognition capabilities, traditional capacitive fingerprint recognition solutions require a capacitive chip, which affects the screen-to-body ratio when placed on the front of the product. Therefore, to improve the screen-to-body ratio and achieve a full-screen display, most mainstream products now use under-display fingerprint recognition technology.

[0003] In-display fingerprint recognition primarily utilizes the principle of light reflection. When a finger is pressed against the fingerprint recognition area on the screen, the light emitted by the fingerprint recognition light source illuminates the entire surface of the finger. This light is reflected by the finger and re-enters the screen, ultimately reaching the photoelectric conversion element beneath the screen. The photoelectric conversion element then captures the fingerprint image, thus enabling fingerprint recognition. However, current in-display optical fingerprint recognition solutions still suffer from low fingerprint recognition accuracy, impacting user experience. Summary of the Invention

[0004] In view of this, this application provides an electronic device to solve the technical problem of low fingerprint recognition accuracy in the prior art.

[0005] This application provides an electronic device, which includes a display panel, a camera, a fingerprint recognition light source, and a light steering element; the display panel includes a first display area and a second display area, the light transmittance of the first display area is greater than the light transmittance of the second display area, and the second display area includes a fingerprint recognition area;

[0006] The camera, fingerprint recognition light source, and light deflector are all located on the side of the display panel opposite to its light-emitting surface; among them,

[0007] The camera includes a photoelectric conversion chip and is located on the side of the first display area opposite to its light-emitting surface;

[0008] A fingerprint recognition light source is used to direct light toward the fingerprint recognition area during the fingerprint recognition process;

[0009] A light deflector is used to transmit the light reflected from the touch subject pressing the fingerprint recognition area to the photoelectric conversion chip during the fingerprint recognition stage.

[0010] In the electronic device provided in this application embodiment, the camera is positioned on the side of the first display area away from its light-emitting surface, realizing an under-display camera solution. A light-directing element is provided below the display panel, which can transmit the light reflected from the touch subject within the fingerprint recognition area to the photoelectric conversion chip of the camera. During the fingerprint recognition stage, the photoelectric conversion chip in the camera can receive the fingerprint detection light used for fingerprint recognition, thereby enabling the acquisition of fingerprint image information using the photoelectric conversion chip in the camera, and thus achieving fingerprint recognition. The photoelectric conversion chip in the camera has high imaging quality and accuracy, which can improve the fingerprint recognition accuracy. Moreover, in this application embodiment, the photoelectric conversion chip in the camera can be applied in both the camera shooting stage and the fingerprint recognition stage, improving hardware integration. There is no need to additionally set up a photoelectric conversion chip for fingerprint recognition, which can reduce costs.

[0011] Furthermore, the electronic device also includes a fingerprint processing module, an image processing module, and a switching control module; the switching control module is used to control the fingerprint processing module to electrically connect with the photoelectric conversion chip when the electronic device is working in the fingerprint recognition stage; the switching control module is also used to control the image processing module to electrically connect with the photoelectric conversion chip when the electronic device is working in the stage of calling the camera to take pictures; the fingerprint processing module is used to receive the image information acquired by the photoelectric conversion chip after receiving light and perform fingerprint recognition; the image processing module is used to receive the image information acquired by the photoelectric conversion chip after receiving light and perform image imaging of the object being photographed.

[0012] In practical applications, the switching control module is connected to the application processor chip of the electronic device. The application processor chip sends control signals to the switching control module, which then determines the operating state of the electronic device based on the received signals. Based on this operating state, the switching control module controls the electrical connection between the fingerprint processing module and the photoelectric conversion chip, or the image processing module and the photoelectric conversion chip. This allows the photoelectric conversion chip to be used in different operating states of the electronic device.

[0013] Specifically, the fingerprint processing module includes an acquisition unit and a processor. The acquisition unit is used during a single fingerprint recognition process to: when the fingerprint recognition light source is turned on, obtain a first image based on the light signal collected by the photoelectric conversion chip, and send the first image to the processor. The first image includes fingerprint image information and background image information. When the fingerprint recognition light source is turned off, obtain a second image based on the light signal collected by the photoelectric conversion chip, and send the second image to the processor. The second image includes background image information. The processor performs differential processing on the first image and the second image to obtain a fingerprint image.

[0014] During a single fingerprint recognition operation, the fingerprint recognition light source is turned on and off once. When the light source is on, the photoelectric conversion chip receives the fingerprint detection light transmitted to it via the light deflector and the ambient light that penetrates the first display area and reaches the chip. The resulting image information includes both fingerprint and background image information. When the light source is off, the chip only receives the ambient light that penetrates the first display area and reaches it. Therefore, the image signal acquired by the chip only includes the background image information. Differential processing of the first and second images yields the fingerprint image, thereby eliminating interference from ambient light and improving fingerprint recognition accuracy.

[0015] Specifically, the camera also includes a lens assembly located on the side of the photoelectric conversion chip closest to the display panel. The lens assembly has a certain light-focusing effect; the fingerprint detection light emitted from the light-directing element is focused onto the photoelectric conversion chip after passing through the lens assembly, reducing light loss and ensuring light utilization.

[0016] Specifically, the light-deflecting element and lens group are misaligned. During the imaging phase, this prevents the light-deflecting element from blocking the light that has penetrated the first display area and is directed towards the camera, thus ensuring that imaging performance is not affected.

[0017] Furthermore, the light-directing element is located between the fingerprint recognition area and the first display area. Specifically, the light-directing element includes an incident light side and an exit light side. The incident light side is close to the fingerprint recognition area, and the exit light side is close to the camera. This ensures that during the fingerprint recognition phase, the light reflected by the touch subject within the fingerprint recognition area can enter the light-directing element and be transmitted to the photoelectric conversion chip in the camera through the action of the light-directing element.

[0018] In one embodiment, the light-directing element includes a first reflective portion and a second reflective portion disposed opposite to each other. The opposing surfaces of the first and second reflective portions are both reflective surfaces. The second reflective portion is located on the side of the first reflective portion away from the display panel, and a certain distance is spaced between the reflective surfaces of the first and second reflective portions. Optionally, the medium separating the first and second reflective portions is air. This embodiment, through the arrangement of the first and second reflective portions, ensures that light, after entering the light-directing element, undergoes multiple reflections on the reflective surfaces of the first and second reflective portions, thereby transmitting the light to the photoelectric conversion chip of the camera.

[0019] Furthermore, at the end near the fingerprint recognition area, the second reflective portion extends beyond the edge of the first reflective portion; thus, the reflective surface of the second reflective portion can easily receive the light reflected by the touch subject within the fingerprint recognition area, ensuring that all fingerprint detection light reflected by the touch subject can enter the light deflecting element, reducing the loss of fingerprint detection light. At the end near the first display area, the first reflective portion extends beyond the edge of the second reflective portion, thereby ensuring that the light can be directed to the photoelectric conversion chip after passing through the light deflecting element, improving the transmission efficiency of fingerprint detection light by the light deflecting element.

[0020] In another embodiment, the light-directing element is an optical waveguide, which includes an incident surface and an exiting surface. The incident surface is located at the end closer to the fingerprint recognition area and faces the fingerprint recognition area; the exiting surface is located at the end closer to the first display area and faces the photoelectric conversion chip. As a whole structure, the optical waveguide is more stable, its light transmission performance is more reliable, and the light loss during transmission is small. This ensures that the photoelectric conversion chip receives a sufficiently large amount of fingerprint detection light, thereby guaranteeing the accuracy of fingerprint detection.

[0021] Specifically, the display panel includes a substrate and a light-emitting device layer. The light-emitting device layer is located on the side of the substrate away from the camera, and includes multiple light-emitting devices. The density of light-emitting devices in the first display area is less than the density of light-emitting devices in the second display area. In this embodiment, by reducing the density of light-emitting devices in the first display area, the light transmittance of the first display area is improved, thereby ensuring the imaging effect when the camera is used for shooting.

[0022] The electronic device provided in this application has the following advantages: A light-directing element is provided on the side of the display panel away from the light-emitting surface. This light-directing element can transmit the light reflected by the touch subject within the fingerprint recognition area to the photoelectric conversion chip of the camera. During the fingerprint recognition stage, the photoelectric conversion chip in the camera can receive the fingerprint detection light used for fingerprint recognition, thereby realizing the acquisition of fingerprint image information using the camera's photoelectric conversion chip, and thus achieving fingerprint recognition. In the embodiments of this application, the photoelectric conversion chip in the camera can be applied in both the stage of shooting with the camera and the fingerprint recognition stage, improving hardware integration. There is no need to additionally set up a photoelectric conversion chip for fingerprint recognition, which can reduce costs. Moreover, the photoelectric conversion chip in the camera has high imaging quality and accuracy, which can improve the fingerprint recognition accuracy. Attached Figure Description

[0023] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0024] Figure 1 This is a schematic diagram of an under-display fingerprint recognition solution in related technologies;

[0025] Figure 2 A top view schematic diagram of an electronic device provided in an embodiment of this application;

[0026] Figure 3 for Figure 2 A schematic diagram of a cross-section at the position of the tangent AA';

[0027] Figure 4 for Figure 2 Another cross-sectional view at the position of the tangent BB';

[0028] Figure 5 Another top view schematic diagram of the electronic device provided in the embodiments of this application;

[0029] Figure 6 for Figure 2 Another cross-sectional diagram at the position of the tangent AA';

[0030] Figure 7 for Figure 2 Another cross-sectional diagram at the location of the tangent AA';

[0031] Figure 8 A flowchart of a fingerprint recognition method provided in an embodiment of this application;

[0032] Figure 9 A flowchart illustrating the fingerprint recognition process of an electronic device provided in this application embodiment;

[0033] Figure 10 A modular schematic diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0034] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0035] The terminology used in the embodiments of this invention is for the purpose of describing particular embodiments only and is not intended to limit the invention. The singular forms “a,” “the,” and “the” as used in the embodiments of this invention and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise.

[0036] Figure 1 This is a schematic diagram of an under-display fingerprint recognition solution, such as... Figure 1 As shown, a fingerprint photoelectric conversion chip 20 and a fingerprint recognition light source 30 are disposed below the display area of ​​the display panel 10. When a finger is pressed on the fingerprint recognition area, the light emitted by the fingerprint recognition light source 30 penetrates the display panel 10 and is reflected by the finger. The light reflected by the finger then penetrates the display panel 10 again and is received by the fingerprint photoelectric conversion chip 20. When the light emitted by the fingerprint recognition light source 30 shines on the finger, both the valleys and ridges of the fingerprint can reflect the light. The amount of light reflected by the valleys and the amount of light reflected by the ridges are different. Therefore, the photosensitive device in the fingerprint photoelectric conversion chip 20 generates different signal quantities after receiving the light reflected from the valleys or ridges of the fingerprint. Thus, the valleys and ridges of the fingerprint are identified based on the magnitude of the signal quantities generated by multiple photosensitive devices, thereby forming a fingerprint image. In optical fingerprint recognition technology, a corresponding fingerprint photoelectric conversion chip is required to receive the light reflected from the fingerprint. Figure 1 The diagram illustrates a scheme where the fingerprint photoelectric conversion chip is located on the back side of the display panel. In under-display fingerprint recognition solutions, the light used for fingerprint recognition needs to pass through the display panel twice before being received by the fingerprint photoelectric conversion chip. However, the light transmittance of the display panel is limited, thus limiting the amount of light that can be received by the fingerprint photoelectric conversion chip. Given this limited amount of light that the fingerprint photoelectric conversion chip can receive, its photosensitivity and accuracy become the main factors affecting fingerprint recognition accuracy.

[0037] Based on this, embodiments of this application provide an electronic device including an under-display camera. The photoelectric conversion chip in the under-display camera receives fingerprint detection light, thereby achieving fingerprint recognition. Compared to conventional fingerprint photoelectric conversion chips, the photoelectric conversion chip in the camera offers higher imaging quality and accuracy, thus improving fingerprint recognition accuracy. Specific embodiments will be used to illustrate this application in detail below.

[0038] Figure 2 This is a top view schematic diagram of an electronic device provided in an embodiment of this application. Figure 3 for Figure 2 A schematic diagram of a cross-section at the position of the tangent AA'.

[0039] like Figure 2 and Figure 3As shown, the electronic device includes a display panel 101, a camera 102, a fingerprint recognition light source 103, and a light steering element 104. The display panel 101 includes a display area 1 and a non-display area 2, with the non-display area 2 surrounding the display area 1. The display area 1 includes a first display area 11 and a second display area 12. The light transmittance of the first display area 11 is greater than that of the second display area 12; here, light transmittance is understood as the light transmittance per unit area. The second display area 12 includes a fingerprint recognition area 121. Figure 3 The diagram also shows a protective cover 105 in the electronic device, which is used to protect the display panel 101.

[0040] The camera 102, the fingerprint recognition light source 103, and the light steering element 104 are all located on the back side of the display panel 101; wherein, the back side of the display panel 101 is understood as the side away from the light-emitting surface of the display panel 101.

[0041] The camera 102 is disposed on the side of the first display area 11 opposite to its light-emitting surface. The camera includes a photoelectric conversion chip 1021 and a lens group 1022 (schematically shown in the figure), with the lens group 1022 located on the side of the photoelectric conversion chip 1021 closer to the display panel 101. The lens group 1022 includes one or more lenses. Optionally, the lens group 1022 includes multiple stacked lenses, with different lens groups having different functions, such as focusing lens groups, zoom lens groups, and compensation lens groups. The photoelectric conversion chip 1021 is a complementary metal-oxide-semiconductor (CMOS) chip, and includes multiple photosensitive devices arranged in an array. The photosensitive devices have a photoelectric conversion function, used to receive light and convert the light signal into an electrical signal. In this embodiment, the camera 102 is disposed on the side of the first display area 11 opposite to its light-emitting surface, that is, the camera 102 is disposed below the display area 1, realizing an under-display camera solution, which can improve the screen-to-body ratio. Camera 102 is used as a front-facing camera. When the camera is not used in the application, the first display area 11 can display images normally. When the camera needs to be used, the first display area 11 can be controlled to remain closed. Ambient light passes through the first display area 11 and is received by the photoelectric conversion chip 1021 in camera 102. The photoelectric conversion chip 1021 collects image information and then forms an image. The transmittance of the first display area 11 is set to be greater than that of the second display area 12 to ensure that camera 102 can receive sufficient ambient light during the application, thus ensuring the image quality of camera 102.

[0042] When the electronic device is operating in the fingerprint recognition phase, the fingerprint recognition light source 103 is activated when a touch object (such as a user's finger) touches or presses the fingerprint recognition area 121. A pressure sensor can be used to sense the user's operation on the fingerprint recognition area. When the user touches or presses the fingerprint recognition area, or when the user's finger is placed on the fingerprint recognition area, the user's finger applies a certain force to the display panel. The pressure sensor determines the user's operation on the fingerprint area by sensing this force. After the fingerprint recognition light source 103 is activated, the light emitted by the fingerprint recognition light source 103 shines on the fingerprint recognition area 121, illuminating it. For example, in the locked screen state or other application scenarios during fingerprint recognition detection, the light emitted by the fingerprint recognition light source 103 towards the fingerprint recognition area 121 can be reflected by the user's finger. The amount of light reflected by the valleys and ridges of the fingerprint is different, resulting in different signal quantities generated by the photosensitive device in the photoelectric conversion chip 1021 after receiving the light reflected from the valleys or ridges of the fingerprint. The fingerprint's valleys and ridges are identified based on the differences in signal magnitude generated by multiple photosensitive devices, thus forming a fingerprint image and completing fingerprint recognition detection. The relative positions of the fingerprint recognition light source 103 and the fingerprint recognition area 121 in the figure are only schematic representations. In one embodiment, the fingerprint recognition light source 103 can be located directly below the fingerprint recognition area 121. In another embodiment, the fingerprint recognition light source 103 and the fingerprint recognition area 121 are offset, that is, when viewing the electronic device from a top-down angle, the fingerprint recognition light source 103 is located diagonally below the fingerprint recognition area. In practical applications, the relative positions of the fingerprint recognition light source 103 and the fingerprint recognition area 121 can be rationally designed according to specific design requirements. Simultaneously, the light emission angle of the fingerprint recognition light source 103 should be designed to ensure that the light emitted by the fingerprint recognition light source 103 can reach the fingerprint recognition area 121, so that when the user's finger touches or presses the fingerprint recognition area 121 during the fingerprint recognition stage, the light can illuminate the user's finger.

[0043] A light-directing element 104 is used to transmit the light reflected from the touch subject pressing the fingerprint recognition area 121 to the photoelectric conversion chip 1021 during the fingerprint recognition phase. For example... Figure 3The schematic optical path diagram illustrates that during the fingerprint recognition stage, after the fingerprint recognition light source 103 is turned on, the light emitted by the fingerprint recognition light source 103 is directed towards the fingerprint recognition area 121. The light penetrates the display panel 101, is reflected by the touch subject M touching the fingerprint recognition area 121, and then returns to the display panel 101. Through the action of the light-directing element 104, the light reflected by the touch subject M is transmitted to the photoelectric conversion chip 1021, thereby enabling the photoelectric conversion chip 1021 in the camera 102 to acquire fingerprint image information. Then, the photoelectric conversion chip 1021 sends the fingerprint image information to the fingerprint processing module, which processes the fingerprint image signal to achieve fingerprint recognition. In other words, in this embodiment, the photoelectric conversion chip in the camera can acquire image information of the object being photographed when the camera is invoked, and it can also be used in the fingerprint recognition function to acquire fingerprint image information.

[0044] In this embodiment of the application, the photoelectric conversion chip is used to receive fingerprint detection light transmitted to it by the light deflection element when the electronic device is working in the fingerprint recognition stage, so as to collect light signals and obtain fingerprint image information.

[0045] The photoelectric conversion chip is also used to receive light emitted by the object being photographed when the electronic device is in the stage of using a camera to take pictures, in order to collect light signals and obtain image information of the object. The object being photographed reflects or scatters ambient light. When the camera is used to take pictures, the light reflected or scattered by the surface of the object penetrates the first display area and is received by the photoelectric conversion chip. The object being photographed is equivalent to a light source, and the light emitted by the object is understood as the light reflected or scattered by its surface.

[0046] Specifically, the electronic device provided in this application includes a fingerprint processing module, an image processing module, and a switching control module. The switching control module, in response to the electronic device operating in the fingerprint recognition phase, controls the fingerprint processing module to electrically connect with the photoelectric conversion chip. The fingerprint processing module receives the light signal collected by the photoelectric conversion chip and processes the light signal to obtain fingerprint image information. The switching control module is also used in response to the electronic device operating in the phase of calling the camera for image capture. In this phase, the image processing module receives the light signal collected by the photoelectric conversion chip and processes it to obtain image information of the captured object. In practical applications, the switching control module is connected to the application processor chip of the electronic device. The application processor chip sends control signals to the switching control module, which determines the operating state of the electronic device based on the received control signals. Based on the operating state of the electronic device, the switching control module then controls the fingerprint processing module to electrically connect with the photoelectric conversion chip, or controls the image processing module to electrically connect with the photoelectric conversion chip. This enables the application of the photoelectric conversion chip in different operating states of the electronic device.

[0047] The electronic device provided in this application embodiment has a higher light transmittance in the first display area than in the second display area. By placing the camera below the first display area, an under-display camera solution is achieved, which can improve the screen-to-body ratio. A light-directing element is provided below the display panel, which can transmit the light reflected from the touch subject in the fingerprint recognition area to the photoelectric conversion chip of the camera. That is, during the fingerprint recognition stage, the photoelectric conversion chip in the camera can receive the fingerprint detection light used for fingerprint recognition, thereby realizing the acquisition of fingerprint image information using the photoelectric conversion chip in the camera, and thus achieving fingerprint recognition. In this application embodiment, the photoelectric conversion chip in the camera can be used in both the camera shooting stage and the fingerprint recognition stage, improving hardware integration. There is no need to set up an additional photoelectric conversion chip for fingerprint recognition, which can reduce costs. Moreover, the photoelectric conversion chip in the camera has high imaging quality and accuracy, which can improve the fingerprint recognition accuracy.

[0048] The light-directing element 104 is disposed on the side of the display panel 101 opposite to the light-emitting surface, by... Figure 2 The top view shows that the light-directing element 104 is located between the fingerprint recognition area 121 and the camera 102. The camera 102 is located below the first display area 11, meaning the light-directing element 104 is located between the fingerprint recognition area 121 and the first display area 11. The light-directing element 104 includes a light-incident side (not shown) and a light-exit side (not shown), with the light-incident side closer to the fingerprint recognition area 121 and the light-exit side closer to the camera 102. This ensures that during the fingerprint recognition phase, the light reflected by the touch subject within the fingerprint recognition area can enter the light-directing element and, through the action of the light-directing element, be transmitted to the photoelectric conversion chip in the camera.

[0049] Specifically, such as Figure 3 As illustrated, camera 102 also includes lens group 1022. During the fingerprint recognition stage, light emitted from fingerprint recognition light source 103 is directed towards fingerprint recognition area 121. Light reflected by the touch subject M within fingerprint recognition area 121 enters light deflecting element 104. After passing through light deflecting element 104, the light penetrates lens group 1022 and then illuminates photoelectric conversion chip 1021. Lens group 1022 in camera 102 has a light-focusing function; the fingerprint detection light emitted from light deflecting element 104 is focused onto photoelectric conversion chip after passing through lens group 1022, reducing light loss and ensuring light utilization.

[0050] Further reference Figure 3As shown, the light-directing element 104 and the lens group 1022 are misaligned. This ensures that during the fingerprint recognition stage, the fingerprint detection light after passing through the light-directing element 104 can illuminate the photoelectric conversion chip 1021 after passing through the lens group 1022. At the same time, it prevents the light-directing element 104 from blocking the light that penetrates the first display area 11 and shines on the camera 102, ensuring that the imaging performance is not affected when the camera is used for shooting.

[0051] Specifically, in one embodiment, at the end of the light-directing element near the first display area, the edge of the light-directing element is flush with the edge of the lens group. In this embodiment, the light-directing element is close enough to the camera that most of the fingerprint detection light after being directed by the light-directing element can be directed by the lens group and then illuminate the photoelectric conversion chip, ensuring the accuracy of fingerprint recognition detection. At the same time, the placement of the light-directing element does not affect the imaging performance when the camera is used for shooting.

[0052] Specifically, the display panel in the electronic device provided in this application embodiment is an organic light-emitting display panel. Figure 4 for Figure 2 Another cross-sectional diagram at the location of the tangent line BB'. (See diagram below.) Figure 4 As shown, the display panel 101 includes a substrate 21, and an array layer 22, a light-emitting device layer 23, and an encapsulation layer 24 located on the substrate 21. The light-emitting device layer 23 includes multiple light-emitting devices 40, each comprising an anode 41, a light-emitting layer 42, and a cathode 43 stacked sequentially. The anode 41 is a metal reflective electrode, and the cathode 43 is a transparent electrode. When the light-emitting device 40 is operating, light emitted from the light-emitting layer 42 is emitted through the cathode 43, thus emitting light. The light-emitting device layer 23 also includes a pixel definition layer 50, which is used to space adjacent light-emitting devices 40. The array layer 22 includes pixel circuits 221, which are used to drive the light-emitting devices 40 to emit light. Figure 4 Only one transistor T in pixel circuit 221 is shown in the diagram. Encapsulation layer 24 protects the light-emitting device 40 in light-emitting device layer 23 by isolating it from water and oxygen, thus ensuring the lifespan of the light-emitting device 40. In one embodiment, the encapsulation layer is a thin-film encapsulation, comprising at least one inorganic encapsulation layer and at least one organic encapsulation layer. In another embodiment, the encapsulation layer is a rigid encapsulation, comprising an encapsulation cover plate, which is bonded to the array layer with a sealing adhesive.

[0053] Figure 4 The diagram also illustrates a protective cover 105. Optionally, the display panel 101 may also include a touch module located on the side of the encapsulation layer away from the display layer, thereby enabling touch functionality of the electronic device.

[0054] In the electronic device provided in this application embodiment, the light transmittance of the first display area of ​​the display panel is greater than the light transmittance of the second display area. In one embodiment, the size of the light-emitting device in the first display area is set smaller than the size of the light-emitting device in the second display area, thereby increasing the light transmittance of the first display area, wherein the size of the light-emitting device is understood as the area of ​​a single light-emitting device. In another embodiment, the density of the light-emitting devices in the first display area is set smaller than the density of the light-emitting devices in the second display area, thereby increasing the light transmittance of the first display area.

[0055] Furthermore, the transmittance of the first display area and the second display area mentioned in this application refer to the transmittance per unit area. In the embodiments of this application, both the first display area and the fingerprint recognition area are partial areas within the display area, and the fingerprint recognition area belongs to the second display area. The camera is located on the side of the first display area opposite to its light-emitting surface; that is, the camera corresponds to the first display area. When the camera is used for shooting, ambient light needs to penetrate the first display area before being received by the camera. In this embodiment, the transmittance of the first display area is set to be greater than that of the second display area, thereby increasing the transmittance of the first display area to ensure the imaging effect when the camera is used for shooting. The fingerprint recognition area is used to implement the under-display optical fingerprint recognition function. During the fingerprint recognition stage, the fingerprint recognition light source is turned on, and the light emitted by the fingerprint recognition light source is directed towards the fingerprint recognition area. Then, after being reflected by the user's finger within the fingerprint recognition area, it is reflected back to the display panel. Therefore, the fingerprint recognition area also needs to have a certain transmittance.

[0056] In one embodiment, Figure 5 This is another top view schematic diagram of the electronic device provided in an embodiment of this application. (See diagram below.) Figure 5 As shown, the electronic device includes three cameras: a first camera 102-1, a second camera 102-2, and a third camera 102-3. All three cameras are located on the side of the first display area 11 opposite to the light-emitting surface of the display area. In this embodiment, the electronic device has three front-facing cameras. Optionally, the first camera 102-1 is the main camera, the second camera 102-2 is a wide-angle camera, and the third camera 102-3 is a depth-sensing camera. The cameras, fingerprint recognition light source, and light-directing element are all located on the back side of the display panel 101. During fingerprint recognition, after sensing the user's finger touch or press, the fingerprint recognition light source 103 is turned on, shining light into the fingerprint recognition area 121. The user's finger reflects the light within the fingerprint recognition area 121, and the light-directing element 104 transmits the reflected light to the photoelectric conversion chip 1021 of the first camera 102-1. Figure 5 The relative positions of the three cameras are only shown schematically.

[0057] It should be noted that the number of front-facing cameras in the electronic device is not limited in the embodiments of this application. In embodiments where the electronic device includes two or three front-facing cameras, or even more front-facing cameras, only one is used as the main camera. In the technical solution of this application, by setting the relative position of the main camera and the light-directing element, the light reflected by the touch subject in the fingerprint recognition area is transmitted to the photoelectric conversion chip of the camera used as the main camera.

[0058] in addition, Figure 1 and Figure 5 In this embodiment, the positions of the first display area and the fingerprint recognition area within the display area are shown schematically. In practice, the positions of the first display area and the fingerprint recognition area can be set according to specific design needs.

[0059] Specifically, in one embodiment, Figure 6 for Figure 2 Another cross-sectional diagram at the location of the tangent AA'. (See diagram below.) Figure 6 As shown, the light-directing element 104 includes a first reflective portion 61 and a second reflective portion 62 disposed opposite to each other. The opposing surfaces of the first reflective portion 61 and the second reflective portion 62 are both reflective surfaces. The second reflective portion 62 is located on the side of the first reflective portion 61 away from the display panel 101, and a certain distance h is spaced between the reflective surfaces of the first reflective portion 61 and the second reflective portion 62 in a direction e perpendicular to the display panel 101. In this embodiment, the size of h is not limited, as long as it ensures that the light, after entering the light-directing element 104, can undergo multiple reflections and propagate on the reflective surfaces of the first reflective portion 61 and the second reflective portion 62. Optionally, the medium separating the first reflective portion 61 and the second reflective portion 62 is air.

[0060] As shown in the diagram, the light deflecting element 104 is located at one end near the fingerprint recognition area 121. The second reflective portion 62 extends beyond the edge of the first reflective portion 61, so that the reflective surface of the second reflective portion 62 can easily receive the light reflected from the touch subject within the fingerprint recognition area 121, ensuring that all fingerprint detection light reflected from the touch subject can enter the light deflecting element 104, reducing the loss of fingerprint detection light. Figure 6As illustrated, the light-directing element 104 is located at one end near the first display area 11, with the first reflective portion 61 extending beyond the edge of the second reflective portion 62. Light reflected from the touch subject first strikes the second reflective portion 62, and then undergoes multiple reflections on the reflective surfaces of the first and second reflective portions 61 and 62 respectively within the light-directing element 104. Finally, after reflection by the first reflective portion 61, the light strikes the photoelectric conversion chip 1021, ensuring that the light reaches the photoelectric conversion chip 1021 after being processed by the light-directing element 104 and is received by the photoelectric conversion chip 1021.

[0061] In another embodiment, Figure 7 for Figure 2 Another cross-sectional diagram at the location of the tangent AA'. (See diagram below.) Figure 7 As shown, the light-directing element 104 is an optical waveguide 70. The optical waveguide 70 is a medium device that guides light to propagate therein. The optical waveguide 70 includes an incident surface 71 and an exit surface 72. The incident surface 71 is located at the end of the optical waveguide 70 near the fingerprint recognition area 121, and the exit surface 72 is located at the end of the optical waveguide 70 near the first display area 11. Both the incident surface 71 and the exit surface 72 are inclined surfaces. The incident surface 71 faces the fingerprint recognition area 121 to ensure that all light reflected from the touch subject within the fingerprint recognition area 121 can enter the optical waveguide 70 through the incident surface 71. The exit surface 72 faces the photoelectric conversion chip 1021 to ensure that after the light is transmitted through the optical waveguide 70, it can illuminate the photoelectric conversion chip 1021 after being emitted from the exit surface 72, thereby realizing the acquisition of fingerprint image information using the photoelectric conversion chip of the camera. In this embodiment, an optical waveguide is used as a light-directing element. As an integral structure, the optical waveguide is more stable and its performance in transmitting light is more reliable. The light loss during transmission in the optical waveguide is small, which ensures that the amount of fingerprint detection light received by the photoelectric conversion chip is large enough, thereby ensuring the accuracy of fingerprint detection.

[0062] This application embodiment includes a camera and a light-directing element disposed on the back side of the display panel. The camera includes a photoelectric conversion chip. During the fingerprint recognition stage, the light-directing element can transmit the light reflected by the touch subject touching the fingerprint recognition area to the photoelectric conversion chip of the camera, enabling the acquisition of fingerprint image information using the photoelectric conversion chip of the camera. Since the first display area corresponding to the under-display camera has high light transmittance, during the fingerprint recognition stage, the photoelectric conversion chip of the camera receives not only the fingerprint detection light transmitted by the light-directing element for fingerprint recognition, but also the ambient light that penetrates the first display area and strikes the photoelectric conversion chip. Therefore, ambient light can interfere with the acquisition of the fingerprint image. Based on this, this application embodiment also provides a fingerprint recognition method that can be applied to the electronic device provided in this application embodiment to eliminate the interference of ambient light on fingerprint detection and improve the accuracy of fingerprint recognition.

[0063] Figure 8 A flowchart of the fingerprint recognition method provided in the embodiments of this application is shown below. Figure 8 As shown, fingerprint recognition methods include:

[0064] Step S101: During a fingerprint recognition process: The fingerprint recognition light source is turned on. The photoelectric conversion chip receives the fingerprint detection light transmitted to it via the light deflector and the ambient light that penetrates the first display area and reaches the photoelectric conversion chip. The photoelectric conversion chip collects the light signal to obtain a first image, which includes fingerprint image information and background image information. The fingerprint image information is obtained by the photoelectric conversion chip receiving the fingerprint detection light transmitted to it via the light deflector, and the background image information is obtained by the photoelectric conversion chip receiving the ambient light that penetrates the first display area and reaches the photoelectric conversion chip. The fingerprint recognition light source is then turned off. The photoelectric conversion chip receives the ambient light that penetrates the first display area and reaches the photoelectric conversion chip. The photoelectric conversion chip collects the light signal to obtain a second image, which includes the background image information. The order in which the fingerprint recognition light source is turned on and off is not limited.

[0065] Step S102: Perform differential processing on the first image and the second image to obtain a fingerprint image.

[0066] During a fingerprint recognition operation, the fingerprint recognition light source is turned on and off once. When the light source is on, the photoelectric conversion chip receives the fingerprint detection light transmitted to it via the light deflector and the ambient light that penetrates the first display area and reaches the chip. The resulting image information includes both fingerprint and background image information. When the light source is off, the chip only receives the ambient light that penetrates the first display area, and the resulting image signal includes only the background image information. Differential processing of the first and second images yields the fingerprint image, thus eliminating interference from ambient light. Further processing, such as feature extraction and comparison, improves fingerprint recognition accuracy.

[0067] Specifically, the electronic device provided in this application embodiment also includes a pressure sensor. The pressure sensor is used to detect the pressure on the fingerprint recognition area to determine whether the user has touched or pressed the fingerprint recognition area, so as to trigger fingerprint detection. When the fingerprint recognition area is detected to be touched or pressed, the fingerprint recognition detection working stage is entered. Figure 9 This is a flowchart illustrating a fingerprint recognition process for an electronic device provided in an embodiment of this application. Figure 9 As shown, firstly, pressure detection is performed on the fingerprint recognition area. When pressure is detected, the fingerprint recognition light source is turned on. Then, the photoelectric conversion unit in the camera collects the light signal to obtain the first image. Next, the fingerprint recognition light source is turned off, and the photoelectric conversion unit in the camera collects the light signal to obtain the second image. Then, the first and second images are differentially processed to obtain the fingerprint image. Subsequent processing, such as feature extraction and comparison, can be performed on the fingerprint image to achieve fingerprint recognition.

[0068] Furthermore, Figure 10 This is a modular schematic diagram of an electronic device provided in an embodiment of this application. (See attached diagram.) Figure 10 As shown, the electronic device provided in this application embodiment further includes a fingerprint processing module 200, an image processing module 300, and a switching control module 400. The switching control module is used to control the fingerprint processing module to electrically connect with the photoelectric conversion chip when the electronic device is operating in the fingerprint recognition stage, and also to control the image processing module to electrically connect with the photoelectric conversion chip when the electronic device is operating in the stage of calling the camera for image capture. The fingerprint processing module 200 is used to receive image information acquired by the photoelectric conversion chip 1021 after receiving light during the fingerprint recognition stage, obtain a fingerprint image, and then process the fingerprint image to achieve fingerprint recognition. The image processing module 300 is used to receive image information of the object being photographed acquired by the photoelectric conversion chip 1021 after receiving light when the camera 102 is called, and to perform image formation based on the image information.

[0069] The fingerprint processing module 200 includes an acquisition unit 210 and a processor 220; wherein,

[0070] During a fingerprint recognition process, the acquisition unit 210 is used to obtain a first image based on the light signal collected by the photoelectric conversion chip when the fingerprint recognition light source is turned on. The first image includes fingerprint image information and background image information. The fingerprint image information is obtained by the photoelectric conversion chip receiving fingerprint detection light transmitted to the photoelectric conversion chip 1021 through the light deflection element. The background image information is obtained by the photoelectric conversion chip receiving ambient light that penetrates the first display area and is incident on the photoelectric conversion chip 1021. The acquisition unit 210 is also used to obtain a second image based on the light signal collected by the photoelectric conversion chip 1021 when the fingerprint recognition light source is turned off. The second image includes background image information. The acquisition unit 210 then sends the first image and the second image to the processor 220.

[0071] The processor 220 is used to perform differential processing on the first image and the second image to obtain a fingerprint image. The processor 220 is also used to perform feature extraction, recognition and comparison and other processing on the fingerprint image to realize fingerprint recognition.

[0072] When driving the electronic device: During the fingerprint recognition stage, the photoelectric conversion chip 1021 is electrically connected to the fingerprint processing module 200 to enable the fingerprint processing module 200 to receive image information acquired by the photoelectric conversion chip 1021; during the stage of calling the camera for shooting, the photoelectric conversion chip 1021 is electrically connected to the shooting processing module 300 to enable the shooting processing module 300 to receive image information of the object being photographed acquired by the photoelectric conversion chip 1021. This allows the photoelectric conversion chip in the camera to be used in both the camera shooting stage and the fingerprint recognition stage, improving hardware integration. It eliminates the need for an additional photoelectric conversion chip for fingerprint recognition, reducing costs. Furthermore, the photoelectric conversion chip in the camera has high imaging quality and accuracy, improving fingerprint recognition accuracy.

[0073] The electronic devices provided in this application embodiment can be, for example, mobile phones, tablet computers, laptops, e-readers, televisions, and other electronic devices.

[0074] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

[0075] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. An electronic device, characterized in that, The electronic device includes a display panel, a camera, a fingerprint recognition light source, and a light-directing element; The display panel includes a first display area and a second display area, wherein the light transmittance of the first display area is greater than that of the second display area, and the second display area includes a fingerprint recognition area. The camera, the fingerprint recognition light source, and the light deflecting element are all located on the side of the display panel opposite to its light-emitting surface; wherein, The camera includes a photoelectric conversion chip, and the camera is disposed on the side of the first display area opposite to its light-emitting surface; The fingerprint recognition light source is used to direct light toward the fingerprint recognition area during the fingerprint recognition stage; The light-directing element is used to transmit the light reflected by the touch subject pressing the fingerprint recognition area to the photoelectric conversion chip during the fingerprint recognition stage.

2. The electronic device according to claim 1, characterized in that, The electronic device also includes a fingerprint processing module, a camera processing module, and a switching control module; The switching control module is used to control the fingerprint processing module to be electrically connected to the photoelectric conversion chip when the electronic device is working in the fingerprint recognition stage; the switching control module is also used to control the shooting processing module to be electrically connected to the photoelectric conversion chip when the electronic device is working in the stage of calling the camera to take pictures. The fingerprint processing module is used to receive image information acquired by the photoelectric conversion chip after it receives light, and to perform fingerprint recognition; The imaging processing module is used to receive image information acquired by the photoelectric conversion chip after it receives light, and to perform imaging of the object being photographed.

3. The electronic device according to claim 2, characterized in that, The fingerprint processing module includes an acquisition unit and a processor; wherein... The acquisition unit is used to: when the fingerprint recognition light source is turned on, obtain a first image based on the light signal collected by the photoelectric conversion chip, and send the first image to the processor, wherein the first image includes fingerprint image information and background image information; when the fingerprint recognition light source is turned off, obtain a second image based on the light signal collected by the photoelectric conversion chip, and send the second image to the processor, wherein the second image includes background image information; The processor is used to perform differential processing on the first image and the second image to obtain a fingerprint image.

4. The electronic device according to claim 1, characterized in that, The camera also includes a lens group located on the side of the photoelectric conversion chip closer to the display panel.

5. The electronic device according to claim 4, characterized in that, The light-directing element and the lens group are misaligned.

6. The electronic device according to claim 1, characterized in that, The light-directing element is located between the fingerprint recognition area and the first display area.

7. The electronic device according to claim 1, characterized in that, The light-directing element includes a first reflective portion and a second reflective portion arranged opposite to each other. The opposing surfaces of the first reflective portion and the second reflective portion are both reflective surfaces. The second reflective portion is located on the side of the first reflective portion away from the display panel, and there is a certain distance between the reflective surfaces of the first reflective portion and the reflective surfaces of the second reflective portion.

8. The electronic device according to claim 7, characterized in that, At one end near the fingerprint recognition area, the second reflective portion extends beyond the edge of the first reflective portion; At one end near the first display area, the first reflective portion extends beyond the edge of the second reflective portion.

9. The electronic device according to claim 1, characterized in that, The light-directing element is an optical waveguide, which includes an incident surface and an exit surface. The light-incident surface is located at one end close to the fingerprint recognition area, and the light-incident surface faces the fingerprint recognition area; The light-emitting surface is located at one end close to the first display area, and the light-emitting surface faces the photoelectric conversion chip.

10. The electronic device according to claim 1, characterized in that, The display panel includes a substrate and a light-emitting device layer, wherein the light-emitting device layer is located on the side of the substrate away from the camera, and the light-emitting device layer includes a plurality of light-emitting devices; The density of the light-emitting devices in the first display area is less than the density of the light-emitting devices in the second display area.

Citation Information

Patent Citations

  • Electronic device with fingerprint identification function

    CN105469030A

  • Electronic equipment and display device

    CN111726502A