Image sensing method

Abstract

The present invention relates to an image sensing method, which is applied to the anti-counterfeiting identification of fingerprint recognition under the screen of a display device. First, the image sensor is divided into sensing blocks; then, the display device is divided into display blocks corresponding to the sensing blocks, and the display blocks include light-emitting blocks; then, the light-emitting colors of each display block and the color coordinate values ​​of each light-emitting color are defined; then, each sensing block senses the intensity of the image light that is irradiated from the display block to the reference object and the object to be tested and then reflected to the sensing block; then, the anti-counterfeiting reference color information of the reference object is generated through calculation and logged into the system; thereafter, when sensing the object to be tested, the sensing intensity of each block is first obtained, and the color information of the object to be tested is generated through calculation; finally, the above color information is compared with the anti-counterfeiting reference color information. In this way, the present invention provides a high-efficiency anti-counterfeiting identification without increasing the production cost of the anti-counterfeiting identification module.

Description

[0001] This application claims priority to U.S. patent application No. 63 / 078,356, filed September 15, 2020. Technical Field

[0002] The present invention relates to an image sensing method, and more particularly to an image sensing method for fingerprint image recognition. Background Art

[0003] Fingerprint recognition technology has developed to the point where it's standard in most smartphones. Its advantages lie in the fact that fingerprints are unique to the human body and are complex enough for authentication. Furthermore, to increase reliability, simply register and authenticate more fingerprints, up to ten fingers, each unique. Furthermore, today's fingerprint scanning is incredibly fast and easy to use, a key reason why fingerprint recognition technology has captured a significant portion of the market.

[0004] Under-screen optical fingerprint recognition is currently widely used in AMOLED displays, but it is expected that in the future, under-screen optical fingerprint recognition may also be applied to LCD displays with LED backlights. The reason is that the self-luminescence of various panels can now be used to project light onto the point where the finger contacts the panel, and the sensor receives the reflected light for fingerprint recognition, greatly increasing the application scope and applicability of under-screen optical fingerprint recognition.

[0005] However, fingerprint recognition isn't completely secure. People leave their fingerprints in public places every day, making it easy for someone to obtain or copy them. Once a fingerprint is recovered and used, a person's device and information security could be compromised. Furthermore, unlike passwords, which can be reset even if they're cracked, fingerprints can't be reset.

[0006] Currently, many anti-counterfeiting methods have been proposed, such as using infrared light sources to detect microvascular structures in the finger, exploiting the three-dimensional properties of the finger for peripheral computing, and creating color filters or polarization layers on the pixels of optical sensors for comparison. However, many of these methods require additional infrared light sources or optical coatings, which increases production costs. Therefore, achieving high-performance anti-counterfeiting fingerprint recognition without increasing the production cost of fingerprint recognition modules is a key issue.

[0007] Therefore, the inventors of this case came up with the present invention after observing the above-mentioned deficiencies. Summary of the Invention

[0008] The present invention provides an image sensing method that uses the specific skin color, as evidenced by the absorption and reflection of specific light wavelengths, to verify the authenticity of a fingerprint and the identity of the registered fingerprint holder. This image sensing method provides high-performance anti-counterfeiting identification without increasing the production cost of the anti-counterfeiting identification module.

[0009] To achieve the above objectives, the present invention provides an image sensing method that divides an image sensor into one or more sensing blocks, and divides a display device into one or more display blocks corresponding to the sensing blocks. Each sensing block senses the intensity of image light reflected from a different display block after irradiating a reference object and an object to be tested. The method also defines color coordinate values ​​for the luminous color of each display block. The image light intensity and color coordinate values ​​are combined and calculated to obtain anti-counterfeiting reference color information of the reference object and color information of the object to be tested, and the color information is then compared with the anti-counterfeiting reference color information. The invention relates to an anti-counterfeiting identification method for under-screen fingerprint recognition applied to a display device, wherein the display device has a display panel and an image sensor, wherein the display panel has a display area, and the image sensor overlaps with the display area accordingly. The image sensing method comprises the following steps: a division step, wherein the image sensor is divided into a plurality of sensing blocks; a corresponding step, wherein the display area is divided into a plurality of display blocks according to the sensing blocks, wherein the plurality of display blocks include at least one luminous block, wherein the area of ​​the luminous block is smaller than the area of ​​the sensing block; a definition step, wherein the luminous color of each of the display blocks is defined and a color coordinate value of the luminous color; a reference sensing step, wherein the plurality of display blocks are simultaneously illuminated, and then each of the plurality of sensing blocks senses the light irradiated from each of the plurality of display blocks to a reference object. a reference image light intensity reflected from the plurality of sensing blocks after being irradiated by the plurality of display blocks; a reference color calculation step of generating anti-counterfeiting reference color information through the color coordinate value and the reference image light intensity; a logging step of logging the anti-counterfeiting reference color information into the system and generating an anti-counterfeiting reference range through the anti-counterfeiting reference color information; a sensing step of simultaneously emitting light from the plurality of display blocks, and the plurality of sensing blocks sensing an image light intensity reflected from the plurality of display blocks after being irradiated onto an object to be detected; a calculation step of generating color information through the color coordinate value and the image light intensity; and a comparison step of determining that the color information is consistent with the anti-counterfeiting reference color information when the color information is within the anti-counterfeiting reference range, and otherwise determining that the color information is inconsistent with the anti-counterfeiting reference color information.

[0010] Preferably, according to the image sensing method of the present invention, the light-emitting block includes a first light-emitting block and a second light-emitting block, the light-emitting color of the first light-emitting block is selected from one of red light, green light, and blue light, and the light-emitting color of the second light-emitting block is selected from another of red light, green light, and blue light.

[0011] Preferably, according to the image sensing method of the present invention, the display block further includes a third light-emitting block, the light-emitting color of the third light-emitting block is selected from one of red light, green light, and blue light, and the light-emitting color of the third light-emitting block is different from that of the first light-emitting block and the second light-emitting block.

[0012] Preferably, according to the image sensing method of the present invention, the logging in step is one or more logging in to the system, but the present invention is not limited thereto.

[0013] Preferably, according to the image sensing method of the present invention, the anti-counterfeiting reference color is an average value of the anti-counterfeiting reference color information of the login system, but the present invention is not limited thereto.

[0014] Preferably, according to the image sensing method of the present invention, the anti-counterfeiting reference interval is manually set, but the present invention is not limited thereto.

[0015] Preferably, according to the image sensing method of the present invention, the anti-counterfeiting reference interval is the difference between the maximum value and the minimum value of the anti-counterfeiting reference color information in the system registration table and the average value. However, the present invention is not limited thereto.

[0016] Preferably, according to the image sensing method of the present invention, the display panel is one of an organic light emitting diode display panel and a micro light emitting diode display panel, but the present invention is not limited thereto.

[0017] Furthermore, to achieve the above-mentioned object, the present invention provides another image sensing method, which is applied to anti-counterfeiting identification of fingerprint recognition under the screen of a display device, wherein the display device has a display panel and an image sensor, the display panel has a display area, and the image sensor overlaps with the display area accordingly, and the image sensing method comprises the following steps: a division step, dividing the image sensor into one or more sensing blocks; a corresponding step, dividing the display area into a plurality of display blocks according to the sensing blocks; a definition step, defining a plurality of luminous colors and color coordinate values ​​of the plurality of luminous colors; a reference sensing step, wherein the plurality of display blocks are sequentially irradiated with at least two of red light, green light and blue light, and each of the plurality of sensing blocks senses the light reflected from each of the plurality of display blocks after being sequentially irradiated with a reference object. a reference image light intensity of the plurality of sensing blocks; a reference color calculation step, generating anti-counterfeiting reference color information through the color coordinate value and the reference image light intensity; a logging step, logging the anti-counterfeiting reference color information into the system and generating an anti-counterfeiting reference range through the anti-counterfeiting reference color information; a sensing step, wherein the plurality of display blocks are sequentially irradiated with at least two of red light, green light, and blue light, and the plurality of sensing blocks sense an image light intensity that is reflected from the plurality of display blocks to the plurality of sensing blocks after being irradiated onto a test object; a calculation step, generating color information through the color coordinate value and the image light intensity; and a comparison step, determining that the color information is consistent with the anti-counterfeiting reference color information when the color information is within the anti-counterfeiting reference range, and otherwise determining that the color information is inconsistent with the anti-counterfeiting reference color information.

[0018] Preferably, according to the image sensing method of the present invention, the logging in step is one or more logging in to the system, but the present invention is not limited thereto.

[0019] Preferably, according to the image sensing method of the present invention, the anti-counterfeiting reference color is an average value of the anti-counterfeiting reference color information of the login system, but the present invention is not limited thereto.

[0020] Preferably, according to the image sensing method of the present invention, the anti-counterfeiting reference interval is manually set, but the present invention is not limited thereto.

[0021] Preferably, according to the image sensing method of the present invention, the absolute value of the anti-counterfeiting reference interval is an average value of the maximum value minus the minimum value of the anti-counterfeiting reference color information in the system registry, but the present invention is not limited thereto.

[0022] Preferably, according to the image sensing method of the present invention, the absolute value of the anti-counterfeiting reference interval is one of 1 times, 2 times, and 3 times the standard deviation of the anti-counterfeiting reference color information in the system registry, but the present invention is not limited thereto.

[0023] Preferably, according to the image sensing method of the present invention, the display panel is one of an organic electroluminescent display panel, an organic light emitting diode display panel, and a micro light emitting diode display panel, but the present invention is not limited thereto.

[0024] In summary, the image sensing method and display device provided by the present invention primarily divide an image sensor into one or more sensing blocks, and divide a display device into one or more display blocks corresponding to the sensing blocks, so that each sensing block senses the intensity of image light reflected from a different display block after being irradiated by a reference object and an object to be detected. The image light intensity and color coordinate values ​​are then combined and calculated to obtain anti-counterfeiting reference color information of the reference object and the color information of the object to be detected, and the color information is then compared with the anti-counterfeiting reference color information. Thus, the image sensing method of the present invention can successfully provide a high-performance anti-counterfeiting identification system without increasing the production cost of the anti-counterfeiting identification module.

[0025] In order to enable those skilled in the art to understand the purpose, features and effects of the present invention, the present invention is described in detail through the following specific embodiments and the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 is a schematic diagram of a display device according to the present invention;

[0027] Figure 2 A schematic diagram illustrating how the display block according to the present invention illuminates an object to be measured and then reflects light to the sensing block;

[0028] Figure 3 is an exemplary schematic diagram of a display device according to the present invention;

[0029] Figure 4 is another exemplary schematic diagram of a display device according to the present invention;

[0030] Figure 5 A flowchart illustrating the steps of performing the image sensing method of the present invention;

[0031] Figure 6 is a schematic diagram of a display device according to a first embodiment of the present invention;

[0032] Figure 7 is another schematic diagram of an image sensor according to the first embodiment of the present invention;

[0033] Figure 8 A flowchart illustrating the steps of performing the image sensing method according to the first embodiment of the present invention;

[0034] Figure 9 is a schematic diagram of a display device according to a second embodiment of the present invention;

[0035] Figure 10 FIG2 is a flow chart illustrating the steps of executing the image sensing method according to the second embodiment of the present invention.

[0036] Explanation of symbols:

[0037] 1: Display device

[0038] 100: Display panel

[0039] 11: Display area

[0040] 111: Display block

[0041] 112: Luminous block

[0042] 1121: first light-emitting block

[0043] 1122: Second light-emitting block

[0044] 1123: The third light-emitting block

[0045] 12: Unit pixel

[0046] 121: Red light unit pixel

[0047] 122: Green light unit pixel

[0048] 123: Blue light unit pixel

[0049] 13: Arithmetic unit

[0050] 131: Storage unit

[0051] 132: comparison unit

[0052] 200: Image sensor

[0053] 21: Sensing block

[0054] 211: First sensing block

[0055] 212: Second sensing block

[0056] 213: Third sensing block

[0057] 300: Object to be tested

[0058] R: Red light

[0059] G: Green light

[0060] B: Blue light

[0061] S1: Division step

[0062] S2: corresponding steps

[0063] S3: Definition Steps

[0064] S4: Reference Sensing Step

[0065] S5: Reference color calculation step

[0066] S6: Login step

[0067] S7: Sensing step

[0068] S8: Operation steps

[0069] S9: comparison step

[0070] S1': Division step

[0071] S2': corresponding steps

[0072] S3': Definition Step

[0073] S4': Reference Sensing Step

[0074] S5': Reference color generation step

[0075] S6': Reference color registration step

[0076] S7': Reference color calculation step

[0077] S8': Reference color interval calculation step

[0078] S9': Sensing step

[0079] S 10 ': Operation steps

[0080] S 11 ':Comparison step

[0081] S1”: Divide steps

[0082] S2”: corresponding steps

[0083] S3": Definition Steps

[0084] S4": Reference sensing step

[0085] S5": Base color calculation step

[0086] S6”: Login steps

[0087] S7": Sensing step

[0088] S8": Operation steps

[0089] S9”: comparison step DETAILED DESCRIPTION

[0090] The present invention will now be described more fully below with reference to the accompanying drawings in which exemplary embodiments of the present invention are shown. The advantages and features of the present invention and how they are achieved will become apparent from the exemplary embodiments described in more detail below with reference to the accompanying drawings. However, it should be noted that the present invention is not limited to the following exemplary embodiments, but can be implemented in various forms. Therefore, the exemplary embodiments are provided only to disclose the present invention and to enable those skilled in the art to understand the categories of the present invention. In the drawings, exemplary embodiments of the present invention are not limited to the specific examples provided herein and are exaggerated for clarity.

[0091] The terms used herein are intended only to illustrate specific embodiments and are not intended to limit the present invention. Unless the context clearly indicates otherwise, the terms "a," "an," and "the" used herein are intended to include a plurality of forms. The terms "and / or" used herein include any and all combinations of one or more of the relevant listed items. It should be understood that when a component is said to be "connected" or "coupled" to another component, the component may be directly connected or coupled to the other component or there may be intermediate components.

[0092] Similarly, it should be understood that when a component (e.g., a layer, region, or substrate) is referred to as being "on" another component, the component can be directly on the other component or intervening components may be present. In contrast, the term "directly" means that there are no intervening components. It should be further understood that when the terms "include" and "comprising" are used herein, they indicate the presence of stated features, integers, steps, operations, components, and / or elements, but do not preclude the presence or addition of one or more other features, integers, steps, operations, components, and / or groups thereof.

[0093] Furthermore, exemplary embodiments in the detailed description will be illustrated using cross-sectional views that serve as idealized exemplary views of the inventive concept. Accordingly, the shapes of the exemplary views may be modified based on manufacturing techniques and / or tolerable errors. Therefore, exemplary embodiments of the inventive concept are not limited to the specific shapes shown in the exemplary views but may include other shapes that may be produced based on manufacturing processes. The illustrated regions in the drawings are of a general nature and are used to illustrate specific shapes of components. Therefore, they should not be considered as limiting the scope of the inventive concept.

[0094] It should also be understood that although the terms "first," "second," "third," etc. may be used herein to describe various components, these components should not be limited to these terms. These terms are merely used to distinguish between the various components. Thus, a first component in some embodiments may be referred to as a second component in other embodiments without departing from the teachings of the present invention. The exemplary embodiments of the aspects of the inventive concepts illustrated and described herein include their complementary counterparts. Throughout this specification, the same reference numerals or the same indicators represent the same components.

[0095] Furthermore, exemplary embodiments are described herein with reference to cross-sectional and / or plan views, which are idealized, exemplary illustrations. Therefore, deviations from the illustrated shapes due to, for example, manufacturing techniques and / or tolerances are to be expected. Therefore, exemplary embodiments should not be considered limited to the shapes of regions illustrated herein, but are intended to encompass deviations in shape due to, for example, manufacturing. Therefore, the regions illustrated in the figures are schematic, and their shapes are not intended to illustrate the actual shape of regions of a device or to limit the scope of exemplary embodiments.

[0096] Figure 1 Schematic diagram of a display device according to the present invention. Figure 1 As shown, the display device 1 according to the present invention includes: a display panel 100 , a display area 11 , a unit pixel 12 , and an image sensor 200 .

[0097] Specifically, see Figure 1 As shown, the display panel 100 according to the present invention has a display area 11, and the display area 11 includes a plurality of unit pixels 12. The plurality of unit pixels 12 include a red light unit pixel 121, a green light unit pixel 122, and a blue light unit pixel 123, wherein the red light unit pixel 121 emits red light R, the green light unit pixel 122 emits green light G, and the blue light unit pixel 123 emits blue light B. However, the present invention is not limited thereto.

[0098] The display panel 100 may be a liquid crystal display panel, an organic light-emitting diode (OLED) display panel, or a micro-LED display panel, but the present invention is not limited thereto.

[0099] Specifically, the wavelength of the red light R according to the present invention may be between 620 nm and 750 nm, but the present invention is not limited thereto.

[0100] Specifically, the wavelength of the green light G according to the present invention may be between 495 nm and 570 nm, but the present invention is not limited thereto.

[0101] Specifically, the wavelength of the blue light B according to the present invention may be between 450 nm and 495 nm, but the present invention is not limited thereto.

[0102] Specifically, the image sensor 200 according to the present invention is disposed on the display panel 100 . The image sensor 200 correspondingly overlaps with the display area 11 , and the image sensor 200 may have one or more sensing blocks 21 .

[0103] Specifically, see Figure 1 The display area 11 includes one or more display blocks 111 corresponding to the sensing block 21 , wherein the display block 111 includes at least one light-emitting block.

[0104] It should be further explained that the display block 111 according to the present invention can be a discontinuous adjacent area, and the multiple display blocks 111 can be a collection of areas consisting of all unit pixels 12 in the display area 11 that emit the same light, but the present invention is not limited to this.

[0105] Figure 2 This is a schematic diagram illustrating how the display block according to the present invention illuminates the object to be tested and then reflects light to the sensing block. Figure 2 As shown, when the object under test touches the display device according to the present invention, the display block 111 according to the present invention can emit an emission light R to the object under test 300 through the light-emitting block 112, and the emission light R is reflected by the object under test 300 to the sensing block 21, so that the sensing block 21 senses and generates an image light intensity.

[0106] Specifically, after the sensing block 21 senses the intensity of the image light irradiated from the display block 111 to the object under test 300 and then reflected back to the sensing block 21, the user can define the color coordinate values ​​of the luminous color of each display block 111 by defining the luminous color of each display block 111. It should be further noted that the color coordinate values ​​in this specification are all expressed in CIE color coordinates, but the present invention is not limited to this.

[0107] In this way, the display device according to the present invention can combine the image light intensity sensed by each sensing block 21 and the color coordinate value of the luminous color of each display block 111 to obtain the anti-counterfeiting reference color information and color information of the reference image and the object to be detected 300, respectively, and compare the color information with the anti-counterfeiting reference color information, thereby providing a high-efficiency anti-counterfeiting identification.

[0108] It should be further explained that the light-emitting block 112 may include a first light-emitting block 1121 and a second light-emitting block 1122. The first light-emitting block emits one selected from red light R, green light G, and blue light B, and the second light-emitting block emits another selected from red light R, green light G, and blue light B. However, the present invention is not limited thereto.

[0109] It is worth mentioning that the light-emitting block 112 may further include a third light-emitting block that emits one light selected from red light R, green light G, and blue light B, and the light-emitting color of the third light-emitting block is different from that of the first light-emitting block and the second light-emitting block. However, the present invention is not limited thereto.

[0110] See also Figure 3 and Figure 4 . Figure 3 is an exemplary schematic diagram of a display device according to the present invention; Figure 4 FIG. 1 is another exemplary schematic diagram of a display device according to the present invention. Figure 3 and Figure 4 As shown, taking the image sensor 200 as being divided into a plurality of sensing blocks 21 as an example, the sensing block 21 includes a first sensing block 211 and a second sensing block 212. The display area 11 of the display panel 100 is correspondingly divided into a plurality of display blocks 111 according to the plurality of sensing blocks 21. The display block 111 includes a first display block 1111 and a second display block 1112. The first sensing block 211 corresponds to the first display block 1111, and the second sensing block 212 corresponds to the second display block 1112. It is worth mentioning that, for the sake of convenience, the following description will be based on the assumption that the first display block 1111 only includes the red light unit pixel 121 among the plurality of unit pixels 12. The first sensing block 211 senses the first image light intensity generated by the reflection of the first emission light (not shown) emitted by the first display block 1111 on the object to be measured 300. Therefore, the first emission light is defined as red light R, and the color coordinate value of the first emission light is denoted by R(x r ,y r ), the first image light intensity is represented by I R However, the present invention is not limited thereto, the first display block 1111 may include one or a combination of the red unit pixel 121 , the green unit pixel 122 , and the blue unit pixel 123 , and the first emission light may be emission light with any wavelength.

[0111] In addition, for the sake of convenience, the following description will be based on the assumption that the second display block 1112 includes only the green light unit pixel 122 among the plurality of unit pixels 12. The second sensing block 212 senses the second emission light (not shown) emitted by the second display block 1112 and reflected by the object to be measured 300 to generate the second image light intensity. Therefore, the second emission light is defined as green light G, and the color coordinate value of the second emission light is denoted by G(x g ,y g ), the second image light intensity is represented by I G However, the present invention is not limited thereto, the second display block 1112 may include one or a combination of the red unit pixel 121 , the green unit pixel 122 , and the blue unit pixel 123 , and the second emission light may be emission light with any wavelength.

[0112] Specifically, the display device 1 according to the present invention may further include a computing unit coupled to the image sensor 200, wherein the computing unit calculates the image intensity I according to the first image light intensity I R and the second image light intensity I G , and the first light receiving ratio a and the second light receiving ratio b are calculated by the following formulas (1) and (2), but the present invention is not limited thereto.

[0113] R(a)=I R / (I R +I G )………(1)

[0114] G(b)=I G / (I R +I G )………(2)

[0115] Specifically, the computing unit according to the present invention calculates the color coordinate value R(x r ,y r ) and the first light receiving ratio a and the color coordinate value G(x g ,y g ) and the second light receiving ratio b are used to calculate color information through the following formulas (3) and (4). The color coordinate value of the color information is represented by S(x, y), but the present invention is not limited to this.

[0116] x=ax r +bx g ………(3)

[0117] y=ay r +by g ………(4)

[0118] It should be further explained that the sensing block 21 according to the present invention can be further divided into a third sensing block. The display block 111 can include a third display block corresponding to the third sensing block, and the third display block can only include blue light unit pixels. The third display block can emit a third emission light to the object under test 300. The third emission light is different from the first emission light and the second emission light. The image generated by the third emission light is sensed by the third sensing block, and the third sensing block generates a third image light intensity. In terms of accuracy, when the image sensor 200 is divided into more sensing blocks 21, each sensing block 21 can combine to generate color information S(x, y) that is closer to the original color of the object under test 300. However, this may also increase computational complexity and cost, thereby reducing the recognition speed of the image sensor 200. Users can choose the most appropriate method based on their needs, but the present invention is not limited to this.

[0119] See also Figure 5 As shown, Figure 5 FIG1 is a flow chart illustrating the steps of executing the image sensing method of the present invention. Figure 5 As shown, the present invention further provides an image sensing method, which can be applied to the above-mentioned display device 1, and the image sensing method includes the following steps:

[0120] In the division step S1 , the image sensor 200 is divided into a plurality of sensing blocks 21 , and then the corresponding step S2 is performed.

[0121] Corresponding to step S2 , the display area 11 of the display panel 100 is divided into a plurality of display blocks 111 according to the sensing block 21 . The display block 111 includes at least one light-emitting block 112 . The area of ​​the light-emitting block 112 is smaller than that of the sensing block 21 . Then, the definition step S3 is performed.

[0122] In the definition step S3 , the luminous color of each display block 111 is defined, and the color coordinate value of the luminous color of each display block 111 is defined. Then, the reference sensing step S4 is performed.

[0123] In the reference sensing step S4 , each display block 111 emits light simultaneously, and each sensing block 21 senses the intensity of the reference image light that is irradiated from the display block 111 to the reference object and then reflected to the sensing block 21 . Then, the reference color calculation step S5 is performed.

[0124] In the reference color calculation step S5 , anti-counterfeiting reference color information is generated using the color coordinate value and the reference image light intensity, and then the registration step S6 is performed.

[0125] In the logging step S6, the anti-counterfeiting reference color information is logged into the system, and a pseudo reference interval is generated according to the anti-counterfeiting reference color information, and then the sensing step S7 is performed.

[0126] In the sensing step S7 , each display block 111 emits light simultaneously, and each sensing block 21 senses the intensity of the image light that is irradiated from the display block 111 to the object under test 300 and then reflected to the sensing block 21 , and then the calculation step S8 is performed.

[0127] In the calculation step S8 , color information is generated by the color coordinate value and the image light intensity, and then a comparison step S9 is performed.

[0128] In the comparison step S9 , when the color information is within the anti-counterfeiting reference range, the color information is determined to be consistent with the anti-counterfeiting reference color information; otherwise, the color information is determined to be inconsistent with the anti-counterfeiting reference color information.

[0129] For example, see Figure 5 , and match Figures 1 to 4 As shown. First, a division step S1 is performed to divide the image sensor 200 into a plurality of sensing blocks 21, wherein the sensing block 21 includes a first sensing block 211 and a second sensing block 212; then, a corresponding step S2 is performed to divide the display area 11 of the display panel 100 into a plurality of display blocks 111 according to the sensing block 21, wherein the display block 111 includes a first display block 1111 and a second display block 1112, wherein the first sensing block 211 corresponds to the first display block 1111, and the second sensing block 212 corresponds to the second display block 1112; then, a definition step S3 is performed to define the first emission light emitted by the first display block 1111 including only the red light unit pixel 121 as red light, and the color coordinate value of the first emission light is R(x r ,y r ), and the second emission light emitted by the second display block 1112 including only the green unit pixel 122 is defined as green light and the color coordinate value of the second emission light is G(x g ,y g ); then perform the reference sensing step S4, the first display block 1111 and the second display block 1112 emit light at the same time, and the first sensing block 211 senses the first emission light emitted by the first display block 1111 to the first reference image light intensity I generated by the reflection of the reference object R ', and the second sensing block 212 senses the second emission light emitted by the second display block 1112 to the second reference image light intensity I generated by the reflection of the reference object G '; Then perform the reference color calculation step S5, according to the color coordinate value of the first emitted light R (x r ,y r ) and the color coordinate value of the second emitted light is G(x g ,y g ), and the first reference image light intensity I generated by the first sensing block 211R ' and the second reference image light intensity I generated by the second sensing block 212 G ', the anti-counterfeiting reference color information and the color coordinate value S'(x',y') of the anti-counterfeiting reference color information are generated by combining the above formulas (1) to (4); then the logging step S6 is executed, the color coordinate value S'(x',y') of the anti-counterfeiting reference color information is logged into the system, and the anti-counterfeiting reference interval is generated according to the color coordinate value S'(x',y') of the anti-counterfeiting reference color information; then the sensing step S7 is executed, the first display block 1111 and the second display block 1112 are illuminated at the same time, and the first sensing block 211 senses the first image light intensity I generated by the first emission light emitted by the first display block 1111 and reflected by the object to be tested 300 R , and the second sensing block 212 senses the second image light intensity I generated by the second emission light emitted by the second display block 1112 and reflected by the object to be measured 300 G Then, the calculation step S8 is performed, according to the color coordinate value of the first emitted light R (x r ,y r ) and the color coordinate value of the second emitted light is G(x g ,y g ), and the first image light intensity I generated by the first sensing block 211 R The second image light intensity I generated by the second sensing block 212 G , the color information and the color coordinate value S(x,y) of the color information are generated by combining the above formulas (1) to (4); finally, a comparison step S9 is performed. When the color coordinate value S(x,y) of the color information is within the anti-counterfeiting reference interval, the color coordinate value S(x,y) of the color information is determined to be consistent with the color coordinate value S'(x',y') of the anti-counterfeiting reference color information. Otherwise, the comparison unit determines that the color coordinate value S(x,y) of the color information is inconsistent with the color coordinate value S'(x',y') of the anti-counterfeiting reference color information.

[0130] It should be further explained that the anti-counterfeiting reference interval according to the present invention can be generated by big data analysis of data classified, counted, and summarized from a large number of real finger fingerprint images, but the present invention is not limited thereto.

[0131] It is worth mentioning that according to the image sensing method of the present invention, the login step S6 can be one or more logins, that is, the image sensing method provided by the present invention can repeatedly execute the above-mentioned reference sensing step S4, reference color calculation step S5, and login step S6, and its method and principle are the same as described above, and will not be repeated here. In addition, the sensing method of the present invention can also execute the login step S6 only once. It is understandable that the image sensing method according to the present invention can store a large amount of anti-counterfeiting reference color information, so the anti-counterfeiting reference color information according to the present invention can be the average value of multiple anti-counterfeiting reference color information, as shown in the following formula (5). Moreover, the absolute value of the anti-counterfeiting reference interval according to the present invention can be the average value of the maximum value minus the minimum value of the multiple anti-counterfeiting reference color information in the system registry, as shown in the following formula (6). It is understandable that the anti-counterfeiting reference interval according to the present invention can be half of the extreme value difference, but the present invention is not limited to this.

[0132]

[0133] It is worth mentioning that the anti-counterfeiting reference interval according to the present invention can be an interval set arbitrarily by humans, and the absolute value of the anti-counterfeiting reference interval can be, but is not limited to, one of 1 times, 2 times, and 3 times the standard deviation σ of the anti-counterfeiting reference color information in the system registry, as shown in the following formula (8). The calculation formula of the standard deviation σ is shown in the following formula (7). According to the three sigma law, all values ​​consistent with the anti-counterfeiting reference color information will fall within the range of plus or minus three standard deviations σ of the average value of the anti-counterfeiting reference color information. Therefore, when the color coordinate value S(x, y) of the color information is in the anti-counterfeiting reference interval, the display device 1 can accurately determine that the color coordinate value S(x, y) of the color information is consistent with the color coordinate value S'(x', y') of the anti-counterfeiting reference color information. However, the present invention is not limited to this.

[0134]

[0135] (aσ x ,aσ y ),a=1or2 or3…………(8)

[0136] Therefore, the image sensing method provided by the present invention can successfully provide a high-performance anti-counterfeiting identification without increasing the production cost of the anti-counterfeiting identification module.

[0137] (First embodiment)

[0138] Hereinafter, a first embodiment of a display device 1 according to the present invention will be described with reference to the drawings.

[0139] See also Figure 6 As shown, Figure 6FIG. 1 is a schematic diagram of a display device according to a first embodiment of the present invention. Figure 6 As shown, a display device 1 according to a first embodiment of the present invention is applied to a fingerprint sensing system. The display device 1 includes: a display panel 100, a display area 11, a unit pixel 12, an image sensor 200, a computing unit 13, a storage unit 131, and a comparison unit 132.

[0140] Specifically, see Figure 6 As shown, the display panel 100 according to the first embodiment of the present invention has a display area 11, and the display area 11 includes a plurality of unit pixels 12, and the plurality of unit pixels 12 include a red light unit pixel 121, a green light unit pixel 122, and a blue light unit pixel 123, wherein the red light unit pixel 121 emits red light R, the green light unit pixel 122 emits green light G, and the blue light unit pixel 123 emits blue light B, but the present invention is not limited to this.

[0141] Specifically, the image sensor 200 according to the first embodiment of the present invention is disposed on the display panel 100 . The image sensor 200 overlaps with the display area 11 , and the image sensor 200 has a plurality of sensing blocks 21 . However, the present invention is not limited thereto.

[0142] See also Figure 7 As shown, Figure 7 FIG. 1 is another schematic diagram of an image sensor according to the first embodiment of the present invention. Figure 7 As shown, according to the first embodiment of the present invention, the image sensor 200 is divided into a plurality of sensing blocks 21, wherein the sensing blocks 21 include a first sensing block 211, a second sensing block 212, and a third sensing block 213. The display area 11 of the display panel 100 is correspondingly divided into a plurality of display blocks 111 according to the plurality of sensing blocks 21, wherein the display block 111 includes a first display block 1111, a second display block 1112, and a third display block 1113. The first sensing block 211 corresponds to the first display block 1111, the second sensing block 212 corresponds to the second display block 1112, and the third sensing block 213 corresponds to the third display block 1113.

[0143] Specifically, see Figure 7 As shown, the display area 11 includes one or more display blocks 111 corresponding to the sensing block 21, wherein the display block 111 includes at least one light-emitting block 112, and the area of ​​the light-emitting block 112 is smaller than that of the sensing block 21. In this embodiment, the first sensing block 211 includes a first light-emitting block 1121, the second sensing block 212 includes a second light-emitting block 1122, and the third sensing block 213 includes a third light-emitting block 1123, but the present invention is not limited thereto.

[0144] Specifically, the first display block 1111 includes only the red light unit pixel 121 among the plurality of unit pixels 12. The first sensing block 211 senses the first emitted light emitted by the first display block 1111 and reflected by the object to be measured 300 to generate a first image light intensity. Therefore, the first emitted light is defined as red light R, and the color coordinate value of the first emitted light is denoted by R(x r ,y r ), the first image light intensity is represented by I R However, the present invention is not limited thereto.

[0145] Specifically, the second display block 1112 includes only the green light unit pixel 122 among the plurality of unit pixels 12. The second sensing block 212 senses the second emission light emitted by the second display block 1112 and reflected by the object to be measured 300 to generate a second image light intensity. Therefore, the second emission light is defined as green light G. The color coordinate value of the second emission light is denoted by G(x g ,y g ), the second image light intensity is represented by I G However, the present invention is not limited thereto.

[0146] Specifically, the third display block 1113 includes only the blue light unit pixel 123 among the plurality of unit pixels 12. The third sensing block 213 senses the third emitted light emitted by the third display block 1113 and reflected by the object to be measured 300 to generate a third image light intensity. Therefore, the third emitted light is defined as blue light B, and the color coordinate value of the third emitted light is denoted by B(x b ,y b ), the third image light intensity is represented by I B However, the present invention is not limited thereto.

[0147] Specifically, the operation unit 13 according to the first embodiment of the present invention is coupled to the image sensor 200. The operation unit 13 calculates the image intensity I according to the first image light intensity. R , the second image light intensity I G , and the third image light intensity I B , and the first light receiving ratio a, the second light receiving ratio b, and the third light receiving ratio c are calculated by the following formulas (9), (10), and (11), but the present invention is not limited thereto.

[0148] R(a)=I R / (I R +I G +I B )………(9)

[0149] G(b)=I G / (I R +IG +I B )………(10)

[0150] B(c)=I B / (I R +I G +I B )………(11)

[0151] Specifically, the calculation unit 13 according to the first embodiment of the present invention calculates the color coordinate value R(x r ,y r ) and the first light receiving ratio a, the color coordinate value G(x g ,y g ) and the second light receiving ratio b, and the color coordinate value B(x b ,y b ) and the third light receiving ratio c are used to calculate the color information S(x, y) through the following formulas (12) and (13), but the present invention is not limited thereto.

[0152] x=ax r +bx g +cx b ………(12)

[0153] y=ay r +by g +cy b ………(13)

[0154] It should be further explained that the display device 1 according to the first embodiment of the present invention can use a reference object to enable the first sensing block 211 to sense the first emitted light R (x r ,y r ) is emitted to the reference object and generates a first reference image light intensity I R ', the second sensing block 212 senses the second emitted light G(x g ,y g ) is emitted to the reference object and generates a second reference image light intensity I G ', and the third sensing block 213 senses the third emitted light B(x b ,y b ) is emitted to the reference object and generates a third reference image light intensity I B ', and the calculation unit 13 generates formula (9), formula (10), and formula (11) in combination with the above formula to calculate the first light receiving ratio a, the second light receiving ratio b, and the third light receiving ratio c. Finally, according to the color coordinate value R(x r ,y r) and the first light receiving ratio a, the color coordinate value G(x g ,y g ) and the second light receiving ratio b, and the color coordinate value B(x b ,y b ) and the third light receiving ratio c, the color coordinate value S'(x',y') of the anti-counterfeiting reference color information is generated through the above formula (12) and formula (13), but the present invention is not limited thereto.

[0155] Specifically, the storage unit 131 according to the first embodiment of the present invention is used to store the color coordinate value S'(x',y') of the anti-counterfeiting reference color information and the color coordinate value S(x,y) of the color information. The storage unit 131 can be a volatile memory, or the storage unit 131 can be a non-volatile memory. The volatile memory can be a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDR SDRAM), etc., but the present invention is not limited thereto.

[0156] Specifically, according to the first embodiment of the present invention, the comparison unit 132 is coupled to the storage unit 131. The comparison unit 132 generates an anti-counterfeiting reference interval based on the anti-counterfeiting reference color information. Thus, whenever the user needs to unlock the device, the comparison unit 132 uses the color coordinate value S'(x', y') of the anti-counterfeiting reference color information as a reference to perform calculations according to the following formula (14), and makes judgments according to the following formula (15). When the color information S(x, y) is within the anti-counterfeiting reference interval, the image sensor 200 determines that the color coordinate value S(x, y) of the color information is consistent with the color coordinate value S'(x', y') of the anti-counterfeiting reference color information. Otherwise, the image sensor 200 determines that the color coordinate value S(x, y) of the color information is inconsistent with the color coordinate value S'(x', y') of the anti-counterfeiting reference color information.

[0157] S ′ -S=(x ′ -x,y ′ -y)………(14)

[0158] |S’ - S| ≤ anti-counterfeiting reference range………(15)

[0159] It should be further noted that, in this embodiment, the absolute value of the anti-counterfeiting reference range can be the average value obtained by subtracting the minimum value from the maximum value among the multiple anti-counterfeiting reference color information in the system registry. Or, the absolute value of the anti-counterfeiting reference range can be one of 1 times, 2 times, and 3 times the standard deviation σ of the anti-counterfeiting reference color information in the system registry. It can be understood that when the color coordinate value S(x, y) of the color information is the same as the color coordinate value S'(x', y') of the anti-counterfeiting reference color information, after subtracting the color coordinate value S(x, y) of the color information from the color coordinate value S'(x', y') of the anti-counterfeiting reference color information, the x coordinate and the y coordinate therein will be less than the average value obtained by subtracting the minimum value from the maximum value or 1 to 3 times the standard deviation σ. However, the present invention is not limited thereto.

[0160] Please refer to Figure 8 as shown Figure 8 is a flowchart showing the steps of implementing the image sensing method of the first embodiment of the present invention. As Figure 8 shown, the present invention further provides an image sensing method, which can be applied to the display device 1 of the first embodiment. The image sensing method includes the following steps:

[0161] Partition step S1', the image sensor 200 is partitioned into multiple sensing blocks 21, and then the corresponding step S2' is executed.

[0162] Corresponding step S2', the display area 11 of the display panel 100 is correspondingly partitioned into multiple display blocks 111 according to the sensing blocks 21. The display block 111 includes at least one light-emitting block 112, and the area of the light-emitting block 112 is smaller than the area of the sensing block 21. Then the definition step S3' is executed.

[0163] Definition step S3', define the light-emitting color of each display block 111, and define the color coordinate value of the light-emitting color of each display block 111. Then the reference sensing step S4' is executed.

[0164] Reference sensing step S4', each display block 111 emits light simultaneously, and each sensing block 21 senses the intensity of the reference image light reflected from the display block 111 to the reference object and then to the sensing block 21. Then the reference color calculation step S5' is executed.

[0165] Reference color generation step S5', generate anti-counterfeiting reference color information through the color coordinate value and the intensity of the reference image light. Then the reference color calculation step S6' is executed.

[0166] In the reference color registration step S6 ′, the anti-counterfeiting reference color information is registered in the system, and then the reference color calculation step S7 ′ is performed.

[0167] In the reference color calculation step S7', the color coordinate values ​​S(x, y) of the multiple color information stored in the storage unit 131 and the color coordinate value S'(x', y') of the anti-counterfeiting reference color information are averaged with the anti-counterfeiting reference color information to obtain the anti-counterfeiting reference color information, and then the anti-counterfeiting reference interval calculation step S8' is performed.

[0168] In the anti-counterfeiting reference interval calculation step S8 ′, an anti-counterfeiting reference interval is generated according to the anti-counterfeiting reference color information, and then a sensing step S9 ′ is performed.

[0169] In the sensing step S9', each display block 111 emits light simultaneously, and each sensing block 21 senses the intensity of the image light that is irradiated from the display block 111 to the object under test 300 and then reflected to the sensing block 21, and then the calculation step S is performed. 10 '.

[0170] Operation step S 10 ', generate color information through color coordinate value and image light intensity, and then perform comparison step S 11 '.

[0171] Comparison step S 11 ', when the color information is within the anti-counterfeiting reference range, the color information is determined to be consistent with the anti-counterfeiting reference color information; otherwise, the color information is determined to be inconsistent with the anti-counterfeiting reference color information.

[0172] For example, see Figure 6 , and match Figure 5 As shown. First, a division step S1' is performed to divide the image sensor 200 into a plurality of sensing blocks 21, wherein the sensing block 21 includes a first sensing block 211, a second sensing block 212, and a third sensing block 213; then, a corresponding step S2' is performed to divide the display area 11 of the display panel 100 into a plurality of display blocks 111 according to the sensing block 21, wherein the display block 111 includes a first display block 1111, a second display block 1112, and a third display block 1113, wherein the first sensing block 211 corresponds to the first display block 1111, the second sensing block 212 corresponds to the second display block 1112, and the third sensing block 213 corresponds to the third display block 1113; then, a definition step S3' is performed to define the first emission light emitted by the first display block 1111 including only the red light unit pixel 121 as red light, and the color coordinate value of the first emission light is R(x r ,y r), the second emission light emitted by the second display block 1112 including only the green unit pixel 122 is defined as green light and the color coordinate value of the second emission light is G(x g ,y g ), the third emission light emitted by the third display block 1113 including only the blue unit pixel 123 is defined as blue light B and the color coordinate value of the third emission light is denoted by B(x b ,y b ) indicates that; then, the reference sensing step S4' is performed, the first display block 1111, the second display block 1112, and the third display block 1113 emit light simultaneously, the first sensing block 211 senses the first emission light emitted by the first display block 1111 to reflect the reference object to generate a first reference image light intensity I R ', the second sensing block 212 senses the second emission light emitted by the second display block 1112 and reflected by the reference object to generate a second reference image light intensity I G ', the third sensing block 213 senses the third emission light emitted by the third display block 1113 and reflects to the reference object to generate a second reference image light intensity I B '; Then, the reference color generation step S5' is performed, according to the color coordinate value of the first emitted light R (x r ,y r ), the color coordinate value of the second emitted light is G(xg,yg), and the color coordinate value of the third emitted light is B(x b ,y b ), and the first reference image light intensity I generated by the first sensing block 211 R ', the second reference image light intensity I generated by the second sensing block 212 G ', and the third reference image light intensity I generated by the third sensing block 213 B', the calculation unit 13 generates anti-counterfeiting reference color information and the color coordinate value S'(x', y') of the anti-counterfeiting reference color information according to the above formula (9) to formula (13); then the reference color registration step S6' is executed, and the color coordinate value S'(x', y') of the anti-counterfeiting reference color information is logged into the system and stored in the storage unit 131; then the reference color calculation step S7' is executed, and the color coordinate values ​​S(x, y) of the plurality of color information stored in the storage unit 131 and the color coordinate value S'(x', y') of the anti-counterfeiting reference color information are combined with the anti-counterfeiting reference color information through The above formula (5) is combined and calculated, and the average value is taken as the anti-counterfeiting reference color information; then the anti-counterfeiting reference interval calculation step S8' is performed, and the anti-counterfeiting reference interval is generated by combining and calculating at least one of the above formulas (6) to (8) according to the anti-counterfeiting reference color information, and then the sensing step S9' is performed; then the sensing step S9' is performed, the first display block 1111, the second display block 1112, and the third display block 1113 are illuminated at the same time, and the first sensing block 211 senses the first emission light emitted by the first display block 1111 to be reflected by the object to be tested 300 to generate a first image light intensity I R , and the second sensing block 212 senses the second emission light emitted by the second display block 1112 and reflects to the object under test 300 to generate a second image light intensity I G The third sensing block 213 senses the third emission light emitted by the third display block 1113 and reflects to the object under test 300 to generate a second reference image light intensity I B Then perform the operation step S8 ', through the operation unit 13, which is based on the color coordinate value of the first emitted light R (x r ,y r ), the color coordinate value of the second emitted light is G(x g ,y g ), and the color coordinate value of the third emitted light is B(x b ,y b ), and the first image light intensity I generated by the first sensing block 211 R , the second image light intensity I generated by the second sensing block 212 G , and the third reference image light intensity I generated by the third sensing block 213 B, the color information and the color coordinate value S(x,y) of the color information are generated by combining the above formulas (9) to (13); finally, the comparison step S9' is performed. Through the above formula (14), when the color coordinate value S(x,y) of the color information is within the anti-counterfeiting reference interval, it is determined that the color coordinate value S(x,y) of the color information is consistent with the color coordinate value S'(x',y') of the anti-counterfeiting reference color information; otherwise, the comparison unit determines that the color coordinate value S(x,y) of the color information is inconsistent with the color coordinate value S'(x',y') of the anti-counterfeiting reference color information.

[0173] It should be further explained that the anti-counterfeiting reference interval according to the present invention can be generated by big data analysis of data classified, counted, and summarized from a large number of real finger fingerprint images, but the present invention is not limited thereto.

[0174] It is worth noting that, according to the image sensing method of the first embodiment of the present invention, the reference color registration step S6' can be performed once or multiple times. That is, the image sensing method provided by the present invention can repeatedly perform the aforementioned reference sensing step S4', reference color generation step S5', and reference color registration step S6'. The methods and principles for performing these steps are the same as those described above and will not be repeated here. It is understood that the image sensing method according to the present invention can store a large amount of security reference color information in the storage unit 131. Therefore, the security reference interval according to the present invention can be the average of multiple security reference color information, but the present invention is not limited to this.

[0175] It is worth mentioning that the anti-counterfeiting reference interval according to the first embodiment of the present invention can be an interval set arbitrarily by humans, or the anti-counterfeiting reference interval can be the difference between the maximum and minimum values ​​and the average value of the multiple anti-counterfeiting reference color information in the system registry, but the present invention is not limited to this.

[0176] Thus, based on the display device 1 of the first embodiment of the present invention and in combination with the image sensing method provided by the present invention, the reference image and the image to be measured can be obtained in the first emission light R(x r ,y r ), the second emitted light G(x g ,y g ), and the third emitted light B(x b ,y b ) and calculates the anti-counterfeiting reference color information and color information through the calculation unit 13. Finally, the comparison unit determines whether the color of the object to be tested is consistent with the reference object to achieve the purpose of anti-counterfeiting, providing a high-efficiency anti-counterfeiting identification.

[0177] Other examples of the display device 1 are provided below so that those skilled in the art can more clearly understand possible variations. Components indicated by the same component symbols as those in the above-mentioned embodiment are substantially the same as those in the above-mentioned reference embodiment. Figure 5 and Figure 6 The components, features, and advantages that are the same as those of the display device 1 will not be described in detail.

[0178] (Second embodiment)

[0179] Hereinafter, a second embodiment of the display device 1 of the present invention will be described with reference to the drawings.

[0180] See also Figure 9 As shown, Figure 9 FIG2 is a schematic diagram of a display device according to a second embodiment of the present invention. The main difference between the second embodiment and the first embodiment is that the second embodiment divides the image sensor 200 into a sensing block 21, and divides the display area 11 into a first display block 1111, a second display block 1112, and a third display block 1113 based on the red unit pixels 121, the green unit pixels 122, and the blue unit pixels 123, respectively. The first display block 1111 includes all red unit pixels 121 in the display area 11, the second display block 1112 includes all green unit pixels 122 in the display area 11, and the third display block 1113 includes all blue unit pixels 123 in the display area 11. Furthermore, the display block 111 sequentially emits a first emission light, a second emission light, and a third emission light.

[0181] Specifically, see Figure 9 As shown, first, the sensing block 21 senses the first emission light emitted by the first display block 1111 and reflects to the object under test 300 to generate a first image light intensity. Therefore, the first emission light is defined as red light R, and the color coordinate value of the first emission light is represented by R(x r ,y r ), the first image light intensity is represented by I R Then, the sensing block 21 senses the second emission light emitted by the second display block 1112 to the object to be measured 300 and reflects to generate a second image light intensity, so the second emission light is defined as green light G, and the color coordinate value of the second emission light is G(x g ,y g ), the second image light intensity is represented by I G Finally, the sensing block 21 senses the third emission light emitted by the third display block 1113 to the object to be measured 300 and reflects to generate a third image light intensity. Therefore, the third emission light is defined as blue light B, and the color coordinate value of the third emission light is expressed as B(x b ,yb ), the third image light intensity is represented by I B It is understood that the materials and other characteristics of the image sensor 200 according to the second embodiment of the present invention are similar to those of the image sensor 200 according to the first embodiment of the present invention, and are not described in detail herein.

[0182] It should be further explained that the display block 111 according to the second embodiment of the present invention includes at least one light-emitting block 112, wherein the area of ​​the light-emitting block 112 is not limited to the area of ​​the sensing block 21. The light-emitting block 112 can be larger than the area of ​​the multiple sensing blocks 21, but the present invention is not limited thereto.

[0183] It is worth mentioning that the number of red unit pixels 121, green unit pixels 122, and blue unit pixels 123 included in the multiple unit pixels 12 currently available on the market may not be the same based on efficiency and service life considerations. For the sake of convenience, the following description assumes that the number of green unit pixels 122 is twice that of red unit pixels 121 and blue unit pixels 123. This is only an exemplary description, but the present invention is not limited to this.

[0184] Specifically, the operation unit 13 according to the second embodiment of the present invention is coupled to the image sensor 200. The operation unit 13 calculates the image intensity I according to the first image light intensity. R , the second image light intensity I G , and the third image light intensity I B , and the first light receiving ratio a, the second light receiving ratio b, and the third light receiving ratio c are calculated using the following formulas (16), (17), and (18), however, the present invention is not limited thereto. It is understood that the parameters in the following formulas can be adjusted according to the number of red light unit pixels 121, green light unit pixels 122, and blue light unit pixels 123. The following is an example based on the assumption that the number of green light unit pixels 122 is twice that of red light unit pixels 121 and blue light unit pixels 123. A person skilled in the art can make various changes and adjustments based on the following formulas, which are not listed here.

[0185] R(a)=I R / (I R +2*I G +I B )………(16)

[0186] 2*G(b)=2*I G / (I R +2*I G +I B )………(17)

[0187] B(c)=I B / (I R +2*I G +I B )………(18)

[0188] Specifically, the calculation unit 13 according to the second embodiment of the present invention calculates the color coordinate value R(x r ,y r ) and the first light receiving ratio a, the color coordinate value G(x g ,y g ) and the second light receiving ratio b, the color coordinate value B(x b ,y b ) and the third light receiving ratio c are used to calculate the color information S(x,y) through the following formulas (19) and (20), but the present invention is not limited thereto.

[0189] x=ax r +bx g +cx b ………(19)

[0190] y=ay r +by g +cy b ………(20)

[0191] Thus, the image sensor 200 according to the second embodiment of the present invention not only achieves the same functionality as the first embodiment, but also provides a different structure. Effectively, the second embodiment produces color information S(x, y) with improved resolution. Furthermore, it overcomes the risk of color information S(x, y) deviation caused by the mutual influence between the first sensing block 211, the second sensing block 212, and the third sensing block 213 in the first embodiment. However, the second embodiment has the disadvantage of requiring multiple image sensing operations. Users can choose the most appropriate method based on their needs, but the present invention is not limited thereto.

[0192] To further understand the structural features, applied technical means, and intended effects of the second embodiment of the present invention, the following description of the use of the present invention is provided. It is believed that this will provide a deeper and more detailed understanding of the present invention, as follows:

[0193] See Figure 10 As shown, Figure 10 FIG2 is a flowchart illustrating the steps of executing the image sensing method according to the second embodiment of the present invention. Figure 10 As shown, the present invention further provides an image sensing method, which can be applied to the display device 1 of the second embodiment. The image sensing method includes the following steps:

[0194] In the division step S1 ″, the image sensor 200 is divided into one or more sensing blocks 21 , and then the corresponding step S2 ″ is performed.

[0195] Corresponding to step S2 ″, the display area 11 of the display panel 100 is divided into a plurality of display blocks 111 according to the sensing blocks 21 , and then a defining step S3 ″ is performed.

[0196] In the definition step S3 ″, each luminous color is defined, and the color coordinate value of the luminous color of each display block 111 is defined, and then a reference sensing step S4 ″ is performed.

[0197] In the reference sensing step S4 ″, each display block 111 emits light in sequence, and the sensing block 21 senses the intensity of the reference image light sequentially irradiated from the display blocks 111 to the reference object and then reflected to the sensing block 21 , and then the reference color calculation step S5 ″ is performed.

[0198] In the reference color calculation step S5 ″, anti-counterfeiting reference color information is generated by using the color coordinate value and the reference image light intensity, and then a registration step S6 ″ is executed.

[0199] In the logging step S6 ″, the anti-counterfeiting reference color information is logged into the system, and an anti-counterfeiting reference interval is generated according to the anti-counterfeiting reference color information, and then the sensing step S7 ″ is performed.

[0200] In the sensing step S7 ″, each display block 111 emits light in sequence, and the sensing block 21 senses the intensity of the image light sequentially irradiated from the display blocks 111 to the DUT 300 and then reflected to the sensing block 21 , and then the calculation step S8 ″ is performed.

[0201] In the calculation step S8 ″, color information is generated by the color coordinate value and the image light intensity, and then a comparison step S9 ″ is performed.

[0202] In the comparison step S9 ”, when the color information is within the anti-counterfeiting reference range, the color information is determined to be consistent with the anti-counterfeiting reference color information; otherwise, the color information is determined to be inconsistent with the anti-counterfeiting reference color information.

[0203] For example, see Figure 8 , and match Figure 7As shown. First, a division step S1" is performed to divide the image sensor 200 into a sensing block 21; then, a corresponding step S2" is performed to divide the red unit pixel 121, the green unit pixel 122, and the blue unit pixel 123 in the display area 11 of the display panel 100 into a first display block 1111, a second display block 1112, and a third display block 1113 respectively; then, a definition step S3" is performed to define the first emission light emitted by the first display block 1111 including only the red unit pixel 121 as red light, and the color coordinate value of the first emission light is R(x r ,y r ), the second emission light emitted by the second display block 1112 including only the green unit pixel 122 is defined as green light and the color coordinate value of the second emission light is G(x g ,y g ), the third emission light emitted by the third display block 1113 including only the blue unit pixel 123 is defined as blue light B and the color coordinate value of the third emission light is denoted by B(x b ,y b ) indicates that the reference sensing step S4 is then performed. The first display block 1111, the second display block 1112, and the third display block 1113 emit light in sequence. The sensing block 21 first senses the first emission light emitted by the first display block 1111 and reflected by the reference object to generate a first reference image light intensity I R ', the sensing block 21 then senses the second emission light emitted by the second display block 1112 and reflected by the reference object to generate a second reference image light intensity I G ', the sensing block 21 finally senses the third emission light emitted by the third display block 1113 and reflects to the reference object to generate a third reference image light intensity I B '; Then perform the reference color calculation step S5", according to the color coordinate value of the first emitted light R (x r ,y r ), the color coordinate value of the second emitted light is G(x g ,y g ), and the color coordinate value of the third emitted light is B(x b ,y b ), and the first reference image light intensity I generated by the sensing block 21 in sequence R ', the second reference image light intensity I G ', and the third reference image light intensity I B', the anti-counterfeiting reference color information and the color coordinate value S'(x',y') of the anti-counterfeiting reference color information are generated by combining the above formulas (16) to (20); then the logging step S6' is executed to log the color coordinate value S'(x',y') of the anti-counterfeiting reference color information into the system, and the anti-counterfeiting reference interval is generated according to the color coordinate value S'(x',y') of the anti-counterfeiting reference color information; then the sensing step S6' is executed to sequentially emit light, wherein the sensing block 21 first senses the first emitted light emitted by the first display block 1111 to the object to be tested 300 and reflects to generate the first image light intensity I R The sensing block 21 then senses the second light emitted by the second display block 1112 and reflected by the object to be measured 300 to generate a second image light intensity I G Finally, the sensing block 21 senses the third light emitted by the third display block 1113 and reflects to the object under test 300 to generate a third image light intensity I B Then, the calculation step S8 is performed, and the color coordinate value of the first emitted light is R(x r ,y r ), the color coordinate value of the second emitted light is G(x g ,y g ), and the color coordinate value of the third emitted light is B(x b ,y b ), and the first image light intensity I generated by the sensing block 21 in sequence R , the second image light intensity I G , and the third image light intensity I B The color information of the object to be tested 300 is generated by combining the above formulas (16) to (20), and the color coordinate value S(x, y) of the color information is finally compared with step S9". When the color coordinate value S(x, y) of the color information is within the anti-counterfeiting reference range, the color coordinate value S(x, y) of the color information is determined to be consistent with the color coordinate value S'(x', y') of the anti-counterfeiting reference color information. Otherwise, the comparison unit determines that the color coordinate value S(x, y) of the color information is inconsistent with the color coordinate value S'(x', y') of the anti-counterfeiting reference color information.

[0204] It is understandable that persons having ordinary knowledge in the technical field to which the present invention belongs can make various changes and adjustments based on the above examples, which are not listed here one by one.

[0205] Finally, the technical features of the present invention and the technical effects that can be achieved are summarized as follows:

[0206] Firstly, based on the display device 1 of the present invention and in combination with the image sensing method provided by the present invention, a high-performance anti-counterfeiting identification system is successfully provided without increasing the production cost of the anti-counterfeiting identification module.

[0207] Secondly, the image sensor 200 according to the present invention can obtain the first image light intensity I of the object to be measured under the first emission light and the second emission light through only one image sensing. R And the second image light intensity I G , and calculates and generates color information S(x, y) with sufficient anti-counterfeiting power through the calculation unit 15, thereby providing a high-efficiency anti-counterfeiting identification.

[0208] Thirdly, the image sensor 200 according to the second embodiment of the present invention can further improve the resolution of the image sensor 200 according to the present invention when applied to a fingerprint recognition environment through multiple image sensing operations.

[0209] The above is an explanation of the implementation of the present invention through specific embodiments. Those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification.

[0210] The above description is only a preferred embodiment of the present invention and is not intended to limit the scope of the present invention. Any equivalent changes or modifications that do not depart from the spirit disclosed by the present invention should be included in the following patent scope.

Claims

1. An image sensing method, applied to anti-counterfeiting identification of an under-screen fingerprint recognition system of a display device, wherein the display device comprises a display panel and an image sensor, wherein the display panel has a display area, and the image sensor overlaps the display area. The image sensing method comprises the following steps: a dividing step of dividing the image sensor into a plurality of sensing blocks; a corresponding step of dividing the display area into a plurality of display blocks corresponding to the sensing block, wherein the plurality of display blocks include at least one light-emitting block, and the area of ​​the light-emitting block is smaller than the area of ​​the sensing block; a defining step of defining the luminous color of each display block and a color coordinate value of the luminous color; a reference sensing step, wherein the plurality of display blocks emit light simultaneously, and each of the plurality of sensing blocks senses an intensity of a reference image light which is reflected from each of the plurality of display blocks after being irradiated by a reference object to the plurality of sensing blocks; a reference color calculation step, generating anti-counterfeiting reference color information through the color coordinate value and the reference image light intensity; a logging step of logging the anti-counterfeiting reference color information into the system and generating an anti-counterfeiting reference interval based on the anti-counterfeiting reference color information; a sensing step, wherein the plurality of display blocks emit light simultaneously, and the plurality of sensing blocks sense the intensity of an image light that is irradiated from the plurality of display blocks to an object to be measured and then reflected to the plurality of sensing blocks; a calculation step of generating color information through the color coordinate value and the image light intensity; and A comparison step is performed to determine that the color information is consistent with the anti-counterfeiting reference color information when the color information is within the anti-counterfeiting reference range, and vice versa.

2. The image sensing method according to claim 1, wherein: The light emitting block includes a first light emitting block and a second light emitting block. The light emitting color of the first light emitting block is selected from one of red light, green light, and blue light. The light emitting color of the second light emitting block is selected from another one of red light, green light, and blue light.

3. The image sensing method according to claim 2, wherein: The display block further includes a third light-emitting block. The light-emitting color of the third light-emitting block is selected from one of red light, green light, and blue light. The light-emitting color of the third light-emitting block is different from that of the first light-emitting block and the second light-emitting block.

4. The image sensing method according to claim 1, wherein: The login step is to log in to the system one or more times.

5. The image sensing method according to claim 1, wherein: The anti-counterfeiting reference color is the average value of the anti-counterfeiting reference color information logged into the system.

6. The image sensing method according to claim 1, wherein: The anti-counterfeiting reference interval is set manually.

7. The image sensing method according to claim 1, wherein: The absolute value of the anti-counterfeiting reference interval is the average value of the maximum value minus the minimum value of the anti-counterfeiting reference color information in the system registry.

8. The image sensing method according to claim 1, wherein: The absolute value of the anti-counterfeiting reference interval is one of 1 times, 2 times, and 3 times the standard deviation of the anti-counterfeiting reference color information in the system registry.

9. The image sensing method according to claim 1, wherein: The display panel is one of an organic light emitting diode display panel and a micro light emitting diode display panel.

10. An image sensing method, applied to anti-counterfeiting identification of an under-screen fingerprint recognition system of a display device, wherein the display device comprises a display panel and an image sensor, wherein the display panel has a display area, and the image sensor overlaps with the display area. The image sensing method includes the following steps: a dividing step of dividing the image sensor into one or more sensing blocks; a corresponding step of dividing the display area into a plurality of display blocks according to the sensing block; A defining step of defining a plurality of luminous colors and color coordinate values ​​of the plurality of luminous colors; a reference sensing step, wherein the plurality of display blocks are sequentially irradiated with at least two of red light, green light, and blue light, and each of the plurality of sensing blocks senses an intensity of a reference image light reflected from each of the plurality of display blocks after being sequentially irradiated with a reference object; a reference color calculation step, generating anti-counterfeiting reference color information through the color coordinate value and the reference image light intensity; a logging step of logging the anti-counterfeiting reference color information into the system and generating an anti-counterfeiting reference interval based on the anti-counterfeiting reference color information; a sensing step, wherein the plurality of display blocks are sequentially irradiated with at least two of red light, green light, and blue light, and the plurality of sensing blocks sense the intensity of an image light that is irradiated from the plurality of display blocks to an object to be measured and then reflected to the plurality of sensing blocks; a calculation step of generating color information through the color coordinate value and the image light intensity; and A comparison step is performed to determine that the color information is consistent with the anti-counterfeiting reference color information when the color information is within the anti-counterfeiting reference range, and vice versa.

11. The image sensing method according to claim 10, wherein: The login step is to log in to the system one or more times.

12. The image sensing method according to claim 10, wherein: The anti-counterfeiting reference color is the average value of the anti-counterfeiting reference color information logged into the system.

13. The image sensing method according to claim 10, wherein: The anti-counterfeiting reference interval is set manually.

14. The image sensing method according to claim 10, wherein: The absolute value of the anti-counterfeiting reference interval is the average value of the maximum value minus the minimum value of the anti-counterfeiting reference color information in the system registry.

15. The image sensing method according to claim 10, wherein: The absolute value of the anti-counterfeiting reference interval is one of 1 times, 2 times, and 3 times the standard deviation of the anti-counterfeiting reference color information in the system registry.

16. The image sensing method according to claim 10, wherein: The display panel is one of an organic light emitting diode display panel and a micro light emitting diode display panel.

Images