Light sensing and computing integrated display unit, display array, and operation method and device thereof

Abstract

The present disclosure provides a display unit with integrated light sensing and computing, which includes a diode and a memristor. The diode is used to emit display light to realize the light-emitting display of the display unit; the memristor is connected to the diode. When the diode receives the detection light, it generates a response photocurrent to realize the light detection function of the display unit, so that the display unit has the effect of intelligent perception; the memristor is used to shunt the response photocurrent, thereby adjusting the light detection efficiency of the display unit to realize the computing function. The present invention can realize that the display unit has the functions of light emission, detection, and computing at the same time, that is, light sensing and computing are integrated, simple image recognition can be performed, and an array with intelligent perception function can be formed. In addition, the present disclosure also provides a display array with integrated light sensing and computing, an operation method thereof, and an electronic device, which do not require additional sensors and computing circuits, can reduce hardware costs, and are conducive to the miniaturization of portable electronic devices.

Description

Technical Field

[0001] The present disclosure relates to the field of display technology, and in particular to a light-sensing and computing integrated display unit, a display array and an operation method thereof, and an electronic device. Background Art

[0002] As the next generation display technology, micro light emitting diodes (Micro-LED for short) have the advantages of higher display quality, lower energy consumption, faster response speed, etc. Therefore, based on the mature LED industry, the preparation of micro inorganic light emitting diodes as light-emitting display units can have an irreplaceable position in the field of high brightness and high resolution display technology. Among them, Micro-LED not only has display function, but also has intelligent sensing function, which makes it far surpass display technologies such as liquid crystal display diodes (LCD for short) and organic light emitting diodes (OLED for short).

[0003] Since, in the prior art, diodes are mainly used for light-emitting functions, they cannot meet the requirements of detection and calculation, and therefore cannot achieve intelligent perception. Therefore, in order to achieve the purpose of display perception, existing display devices use additional sensor devices and computing circuits to achieve the functions of light-emitting-perception, which will not only greatly increase the hardware cost and running time, but also increase the volume and weight, which is an important problem in the miniaturization of portable devices. Summary of the invention

[0004] 1. Technical issues to be resolved

[0005] In order to solve at least one of the technical problems faced by the above-mentioned prior art, the embodiments of the present disclosure provide a display unit, a display array and its operation method, and an electronic device that simultaneously have light emitting, detection and computing functions (i.e., integrated light sensing and computing).

[0006] (II) Technical solution

[0007] One aspect of the disclosed embodiments provides a display unit with integrated light sensing and computing, which includes a diode and a memristor. The diode is used to emit display light to realize the light-emitting display of the display unit; the memristor is connected to the diode. When the diode receives the detection light, it generates a response photocurrent to realize the light detection function of the display unit, so that the display unit has the effect of intelligent perception; the memristor is used to shunt the response photocurrent, thereby adjusting the detection efficiency of the display unit to realize the computing function.

[0008] According to an embodiment of the present disclosure, a diode is connected in parallel with a memristor; or a diode is connected in series with a memristor.

[0009] According to an embodiment of the present disclosure, the display unit further includes a first end and a second end. The first end is used to receive a current pulse to drive a diode to emit light for display and / or adjust the resistance value of a memristor; the second end is arranged corresponding to the first end and is used to output a response photocurrent of the display unit and / or the resistance value of the memristor.

[0010] According to an embodiment of the present disclosure, when a diode is connected in parallel with a memristor, the first end is connected to the positive electrode of the diode and the memristor respectively, and the second end is correspondingly connected to the negative electrode of the diode and the memristor respectively; when a diode is connected in series with a memristor, the first end is connected to the positive electrode of the diode or the memristor, and the second end is correspondingly connected to the negative electrode of the memristor or the diode.

[0011] According to an embodiment of the present disclosure, the diode is a PIN structure diode; and the memristor includes an analog memristor.

[0012] Another aspect of the disclosed embodiment provides a display array with integrated light sensing and computing, which includes a plurality of the above-mentioned display units, a plurality of row lines and a plurality of column lines. The plurality of display units are used to realize the light-emitting display and light detection functions of the display array; the plurality of row lines are arranged side by side with each other along the first direction, and are used to apply current pulses to the corresponding plurality of display units to drive the plurality of display units to emit light and / or adjust the resistance value of the memristor; the plurality of column lines are arranged side by side with each other along the second direction, and are arranged to cross with the plurality of row lines in space, and are used to output the response photocurrent of the plurality of display units to realize the light detection function of the display array; wherein the first end of one of the plurality of display units is connected to one of the corresponding plurality of row lines, and the second end is connected to one of the corresponding plurality of column lines.

[0013] According to an embodiment of the present disclosure, the display array further includes a plurality of resistors, and the plurality of resistors are connected in series with the plurality of column lines and / or the plurality of row lines in a one-to-one correspondence to achieve output in response to photocurrent.

[0014] According to an embodiment of the present disclosure, the display array also includes a first output terminal and a second output terminal, the first output terminal corresponding to a plurality of resistors connected to a plurality of column lines of odd columns or a plurality of row lines of odd rows in the display array, for outputting a first output current; the second output terminal corresponding to a plurality of resistors connected to a plurality of column lines of even columns or a plurality of row lines of even rows in the display array, for outputting a second output current; wherein the combination of the first output current and the second output current is used to implement the calculation of a neural network matrix.

[0015] According to an embodiment of the present disclosure, the display array also includes a light-emitting array having a plurality of light-emitting units for emitting detection light; the plurality of light-emitting units correspond one-to-one to the plurality of display units, are spaced apart from each other, and are arranged adjacent to each other.

[0016] According to an embodiment of the present disclosure, the wavelength of the detection light emitted by the light emitting unit is smaller than the wavelength of the display light emitted by the display unit 100 .

[0017] According to an embodiment of the present disclosure, the light-emitting unit has a plurality of blue light diodes for emitting detection blue light; the diode of the display unit is a green light diode for absorbing the detection blue light to generate a response current; or the light-emitting unit has a plurality of green light diodes for emitting detection green light; the diode of the display unit is a red light diode for absorbing the detection green light to generate a response current.

[0018] Another aspect of the disclosed embodiments provides a method for operating the above-mentioned display array, which includes: applying a first current pulse to multiple row lines in the display array to enable multiple display units on multiple column lines corresponding to the multiple row lines to emit light; applying a second current pulse to the multiple row lines to enable resistance adjustment of the memristors of the multiple display units on the multiple column lines corresponding to the multiple row lines; based on the resistance adjustment of the memristors, the corresponding multiple display units receive detection light to generate response photocurrent, thereby realizing the light detection function of the display array, wherein the resistance of the memristors can be used to adjust the light detection efficiency of the display units; based on the response photocurrent, outputting a first output current and a second output current for calculation of the neural network matrix.

[0019] According to an embodiment of the present disclosure, in controlling the corresponding multiple display units to receive detection light to generate response photocurrent based on the resistance adjustment of the memristor, it includes: applying a positive voltage (i.e., reverse biasing the diode) to the column lines corresponding to the multiple display units to increase the photocurrent.

[0020] According to an embodiment of the present disclosure, the operating method further includes: applying a reset voltage to column lines corresponding to the plurality of display units so that the resistance value of the memristor is restored to a high resistance state.

[0021] Another aspect of an embodiment of the present disclosure provides an electronic device, comprising at least one display array as described above, for enabling the electronic device to have a fingerprint recognition function when implementing the above-mentioned operating method.

[0022] (III) Beneficial effects

[0023] The present disclosure provides a display unit with integrated light sensing and computing, which includes a diode and a memristor. The diode is used to emit display light to realize the light-emitting display of the display unit; the memristor is connected to the diode. When the diode receives the detection light, it generates a response photocurrent to realize the light detection function of the display unit, so that the display unit has the effect of intelligent perception; the memristor is used to shunt the response photocurrent, thereby adjusting the light detection efficiency of the display unit to realize the computing function. The present invention can realize that the display unit has the functions of light emission, detection, and computing at the same time, that is, light sensing and computing are integrated, simple image recognition can be performed, and an array with intelligent perception function can be formed. In addition, the present disclosure also provides a display array with integrated light sensing and computing, an operation method thereof, and an electronic device, which do not require additional sensors and computing circuits, can reduce hardware costs, and are conducive to the miniaturization of portable electronic devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1A An equivalent circuit diagram schematically showing a parallel structure of display units according to an embodiment of the present disclosure;

[0025] Figure 1B An equivalent circuit diagram schematically showing a series structure of display units according to an embodiment of the present disclosure;

[0026] Figure 2 The structure of the diode of the display unit of the embodiment of the present disclosure is schematically shown;

[0027] Figure 3 The structural equivalent circuit diagram of the display array of the embodiment of the present disclosure is schematically shown;

[0028] Figure 4 The corresponding Figure 3 Another structural equivalent circuit diagram of the display array of the embodiment of the present disclosure is shown;

[0029] Figure 5 The corresponding Figure 3 Another structural equivalent circuit diagram of the display array of the embodiment of the present disclosure is shown;

[0030] Figure 6 A diagram schematically showing the absorption wavelength relationship of three-primary color micro-light emitting diodes (Micro-LEDs) of a display unit of a display array of an embodiment of the present disclosure;

[0031] Figure 7 The corresponding Figure 5 The schematic diagram of the application of fingerprint recognition of a display array according to an embodiment of the present disclosure is shown;

[0032] Figure 8 A flow chart schematically illustrates the operation method of the display array according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0033] In order to make the objectives, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0034] It should be noted that the implementation methods not shown or described in the drawings or the text of the specification are all forms known to ordinary technicians in the relevant technical field and are not described in detail. In addition, the above definitions of various elements and methods are not limited to the various specific structures, shapes or methods mentioned in the embodiments, and ordinary technicians in the field can simply change or replace them.

[0035] It should also be noted that the directional terms mentioned in the embodiments, such as "upper", "lower", "front", "back", "left", "right", etc., are only reference directions of the drawings and are not intended to limit the scope of protection of the present disclosure. Throughout the drawings, the same elements are represented by the same or similar reference numerals. Conventional structures or configurations will be omitted when they may cause confusion in the understanding of the present disclosure.

[0036] Moreover, the shapes and sizes of the components in the figures do not reflect the real size and proportion, but only illustrate the contents of the embodiments of the present disclosure. In addition, in the claims, any reference symbols between brackets shall not be constructed as limiting the claims.

[0037] Furthermore, the word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements.

[0038] The ordinal numbers used in the specification and claims, such as "first", "second", "third", etc., to modify the corresponding elements, do not themselves mean that the elements have any ordinal numbers, nor do they represent the order of one element and another element or the order of manufacturing methods. The use of these ordinal numbers is only used to clearly distinguish a component with a certain name from another component with the same name.

[0039] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and set in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and in addition they may be divided into multiple submodules or subunits or subcomponents. All features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed in this manner may be combined in any combination, except that at least some of such features and / or processes or units are mutually exclusive. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature that provides the same, equivalent or similar purpose. Furthermore, in a unit claim that lists several devices, several of these devices may be embodied by the same hardware item.

[0040] Similarly, it should be understood that in order to streamline the present disclosure and aid in understanding one or more of the various disclosed aspects, in the above description of the exemplary embodiments of the present disclosure, the various features of the present disclosure are sometimes grouped together into a single embodiment, figure, or description thereof. However, this disclosed method should not be interpreted as reflecting the following intention: the claimed disclosure requires more features than the features explicitly recited in each claim. More specifically, as reflected in the claims below, the disclosed aspects lie in less than all the features of the single embodiment disclosed above. Therefore, the claims that follow the specific embodiment are hereby expressly incorporated into the specific embodiment, with each claim itself serving as a separate embodiment of the present disclosure.

[0041] In order to solve at least one of the technical problems faced by the above-mentioned prior art, the embodiments of the present disclosure provide a display unit, a display array and its operation method, and an electronic device that simultaneously have light-emitting, detection and computing functions (i.e., integrated light sensing and computing), so that it has intelligent perception functions such as image recognition.

[0042] like Figure 1A and Figure 1B As shown, one aspect of the embodiment of the present disclosure provides a display unit 100 integrating light sensing and computing, which includes a diode L and a memristor M. The diode L is used to emit display light to realize the light-emitting display of the display unit 100; the memristor M is connected to the diode L. When the diode L receives the detection light, it generates a response photocurrent to realize the light detection function of the display unit 100, so that the display unit 100 has the effect of intelligent perception; the memristor M is used to shunt the response photocurrent, thereby adjusting the light detection efficiency of the display unit 100 to realize the computing function.

[0043] The basic structure of the display unit 100 of the embodiment of the present disclosure is composed of a micro-light emitting diode L and a memristor M. The micro-light emitting diode L is a semiconductor electronic component with an electroluminescent effect, which can generally be composed of trivalent or pentavalent elements, and the emitted light includes visible light, infrared light and ultraviolet light. The display light in the embodiment of the present disclosure can be understood as visible light visible to the human eye, or it can be understood as invisible light that is visible to the human eye through a light detection device. The memristor M is a passive electronic component that can still "remember" the amount of charge that has passed through it before after the power is turned off.

[0044] Among them, in the state of light-emitting display, applying a current pulse to the diode L can make the diode L emit display light due to the passage of current, so that the display unit 100 emits light and displays. In the detection state, when the detection light irradiates the diode L, the diode L will generate a response photocurrent, and output it to the outside when the resistance value of the memristor is fixed, so that it also has the function of light detection. Furthermore, the output response photocurrent can be used to realize the neural network calculation of the display array composed of the display unit, so that it also has the calculation function.

[0045] Therefore, the display unit provided in the embodiment of the present disclosure can simultaneously have the functions of light emission, detection and calculation, realizing the integration of light sensing and calculation, and does not require additional sensors and computing circuits, which can reduce hardware costs and is conducive to the miniaturization of portable electronic devices.

[0046] like Figure 1A and Figure 1B As shown, according to an embodiment of the present disclosure, the diode L is connected in parallel with the memristor M; or the diode L is connected in series with the memristor M.

[0047] According to an embodiment of the present disclosure, the display unit 100 further includes a first terminal a and a second terminal b. The first terminal a is used to receive a current pulse to drive the diode L to emit light for display and / or adjust the resistance value of the memristor M; the second terminal b is set corresponding to the first terminal a, and is used to output the response photocurrent of the display unit 100 and / or the resistance value of the memristor.

[0048] like Figure 1A As shown, the memristor M is connected in parallel to the positive and negative ends of the micro-light emitting diode L. The positive or negative electrode of the micro-light emitting diode L can be the first end a or the second end b, which is not limited here. Accordingly, the memristor M can be connected in series with the diode L, such as Figure 1B As shown, the specific connection relationship can be referred to the following description.

[0049] like Figure 1A and Figure 1BAs shown, according to an embodiment of the present disclosure, when the diode L is connected in parallel with the memristor M, the first end a is connected to the positive electrode of the diode L and the memristor M respectively, and the second end is correspondingly connected to the negative electrode of the diode L and the memristor M respectively; when the diode L is connected in series with the memristor M, the first end a is connected to the positive electrode of the diode L or the memristor M, and the second end b is correspondingly connected to the negative electrode of the memristor M or the diode L.

[0050] According to an embodiment of the present disclosure, the diode L is a PIN structure diode; and the memristor M includes an analog memristor.

[0051] like Figure 2 As shown, each of the micro-LEDs L includes a P-type electrode 350, a hole supply layer 340, an active layer 330, an electron supply layer 320 and an N-type electrode 310 stacked in sequence, which are not described in detail. Accordingly, the resistance of the memristor M can be changed from 10 kilo-ohms to 500 kilo-ohms, and the setting voltage of the memristor can be between 1V and 2.5V.

[0052] Typically, a current pulse can be applied from the anode of the diode L to drive the diode L to emit light and display, and / or adjust the resistance value of the memristor M. Therefore, in the embodiment of the present disclosure, for example Figure 1A The first terminal a shown can be a positive terminal, and the corresponding second terminal b can be used as an output terminal of the response current and can be used as a cathode of the diode L.

[0053] Specifically, when used for light-emitting display, the second end b of the display unit 100 is grounded, and a current pulse of about 1 microsecond is injected into the first end a of the display unit 100 to drive the micro-light-emitting diode L to emit light. By adjusting the corresponding current pulse width, the light-emitting brightness of the micro-light-emitting diode L can be adjusted. The memristor M is equivalent to a parallel resistor. At this time, the first end a is the positive electrode of the display unit 100, and the second end b is the negative electrode of the display unit 100.

[0054] When used to adjust the resistance of the memristor M, a current pulse of about 100 nanoseconds is injected into the positive electrode (ie, the first end a) of the display unit 100 to write to the memristor M, and the resistance of the memristor M is adjusted by adjusting the corresponding current pulse width.

[0055] The positive electrode of the display unit 100 and the negative electrode of the display unit 100 (i.e., the first end b) are both grounded (i.e., in a zero bias state), and the micro-LED L is illuminated. At this time, since the micro-LED L is also a PIN structure, it can be regarded as a detector, which can generate a weak reverse photocurrent output under illumination. The magnitude of the output response photocurrent is proportional to the light intensity. Part of the current will flow to the parallel branch where the memristor M is located. The magnitude of the current passing through the memristor M is related to its resistance value. The remaining current will flow out from the positive electrode of the display unit 100. The memristor M can be regarded as the internal resistance of the detector. The magnitude of the current flowing out from the positive electrode of the display unit 100 is related to the light intensity applied to the micro-LED L and the resistance value of the memristor M, and the detection efficiency η can be adjusted:

[0056]

[0057] Wherein, i1 is the response photocurrent output by the display unit 100 , i0 is the response photocurrent generated by the micro light emitting diode L, R is the resistance value of the resistor corresponding to the display array, and r0 is the resistance value of the memristor M.

[0058] In addition, the positive electrode of the display unit 100 is not biased (i.e., grounded), and a small positive voltage of about 0.1V is applied to the negative electrode of the display unit 100 (i.e., a small reverse bias state). The external voltage can increase the responsiveness of the micro-light-emitting diode L to the light intensity of the detection light, making the output photocurrent larger than that in the zero-bias state, thereby reducing the influence of dark current noise and helping to improve the signal-to-noise ratio.

[0059] Furthermore, the positive pole of the display unit 100 is grounded, and a positive reset voltage is applied to the negative pole of the display unit 100. At this time, the micro light-emitting diode L is in a blocked state and does not emit light. Therefore, the current mainly flows through the branch where the memristor M is located. The memristor M is reverse biased and reset to a high resistance state for subsequent forward bias resistance adjustment.

[0060] like Figure 3-Figure 5As shown, another aspect of the embodiment of the present disclosure provides a display array 300 with integrated light sensing and computing, which includes a plurality of the above-mentioned display units 100, a plurality of row lines H1-H4, and a plurality of column lines L1-L4. The plurality of display units 100 are used to realize the light-emitting display and light detection functions of the display array 300; the plurality of row lines H1-H4 are arranged side by side with each other along the first direction f1, and are used to apply current pulses to the corresponding plurality of display units 100 to drive the plurality of display units 100 to emit light and display and / or adjust the resistance value of the memristor M; the plurality of column lines L1-L4 are arranged side by side with each other along the second direction f2, and are arranged to cross with the plurality of row lines H1-H4 in space, and are used to output the response photocurrent of the plurality of display units 100, and realize the light detection function of the display array 300; wherein the first end a of one of the plurality of display units 100 is connected to one of the corresponding plurality of row lines H1-H4, and the second end b is connected to one of the corresponding plurality of column lines L1-L4.

[0061] like Figure 3 As shown, the display array 300 is composed of the above-mentioned multiple display units 100, and the display array 3002 is a cross array of multiple micro-light emitting diodes L formed by the intersection of multiple row lines H1-H4 and multiple column lines L1-L4, wherein there are also multiple memristors M with a corresponding number of micro-light emitting diodes L. The multiple micro-light emitting diodes L are arranged on the cross array at intervals relative to the row lines or column lines as component elements of the display unit 100.

[0062] The plurality of display units 100 constituting the display array 300 are arranged with the first direction f1 and / or the second direction f2 as reference directions, wherein the first end a of the display unit 100 is connected to the corresponding row line, and the second end b is connected to the corresponding column line. Figure 3 As shown, X 1 The first terminal a (positive electrode) of the display unit 100 is connected to the row line H1, and the second terminal b (negative electrode) is connected to the column line L1. The specific components of the display unit 100 have been described above and will not be repeated here.

[0063] In addition, in the embodiments of the present disclosure, those skilled in the art should understand that the row lines H1-H4 and the column lines L1-L4 may be column lines H1-H4 and row lines L1-L4, or mutually intersecting oblique lines H1-H4 and oblique lines L1-L4 at different viewing angles. Moreover, the so-called intersection refers to the structural intersection in 3D space, and is not limited to the connection intersection of physical structures, which will not be described in detail here.

[0064] Based on the display unit 100 of the embodiment of the present disclosure, it can be seen that the display array 300 can also have the functions of light emission, detection and calculation (i.e., integrated light sensing and calculation), and does not require additional sensors and computing circuits, which can reduce hardware costs and is conducive to the miniaturization of portable electronic devices.

[0065] like Figure 3-Figure 5 As shown, according to an embodiment of the present disclosure, the display array 300 further includes a plurality of resistors R1-R4, which are connected in series with a plurality of column lines L1-L4 and / or a plurality of row lines H1-H4 in a one-to-one correspondence to realize output in response to photocurrent.

[0066] The resistance value of each of the multiple resistors R1-R4 can be about 1 kilo-ohm. Figure 3 and Figure 5 As shown, the second terminal b as the output terminal of each display unit 100 is connected to the column line corresponding to the output line of the response photocurrent, and the corresponding column line can be connected in series with the corresponding resistor to realize the calculation output of the response photocurrent. It should be noted that the output terminal can also be connected to the row line of the cross array, the input terminal (first terminal a) is connected to the column line of the cross array, and the corresponding resistor is connected in series to the row line; moreover, multiple resistors can also be connected in series to the column line and the row line at the same time, that is, the number of resistors corresponds to the sum of the number of column lines and row lines.

[0067] Among them, each resistor connected in series with the corresponding row line or column line can be connected to one end of the corresponding row line or column line and located at the edge of the display array to avoid affecting the structure of the display array, and facilitate the formation of a structure composed of multiple resistors and multiple display units, multiple row lines, and multiple column lines in the display array during the preparation process.

[0068] Based on the multiple resistors R1-R4 connected to the above-mentioned display unit 300, the display unit 300 can further improve the detection and calculation functions on the basis of luminous display and light detection, thereby realizing the basic calculation function of the response photocurrent, wherein the calculation function can be specifically used for the calculation of the neural network matrix.

[0069] like Figure 4As shown, according to an embodiment of the present disclosure, the display array 400 also includes a first output terminal A and a second output terminal B, the first output terminal A corresponds to a plurality of resistors R1-R4 connected to a plurality of column lines L1, L3, L5... of odd columns or a plurality of row lines H1, H3, H5... of odd rows in the display array 400, for outputting a first output current I1; the second output terminal B corresponds to a plurality of resistors connected to a plurality of column lines L2, L4, L6... of even columns or a plurality of row lines H2, H4, H6... of even rows in the display array 400, for outputting a second output current I2; wherein, the combination of the first output current I1 and the second output current I2 is used to implement calculation of a neural network matrix.

[0070] Among them, Figure 4 The display array 400 shown may be based on Figure 3 The display array 300 shown in the figure is a larger micro-LED array, which is a structure for realizing neural network recognition with simple hardware, and can be used as an input array of a neural network matrix. 1 , X 2 , X 3 ,...X 2m-1 , X 2m There are 2m display units 100 in total, that is, the number of display units 100 in the display array 400 in the embodiment of the present disclosure may be an even number. The connection method between each display unit 100 and the row and column lines is as described above and will not be repeated here.

[0071] Among them, Figure 3 and Figure 4 As shown, in the embodiment 400 of the present disclosure, a plurality of row lines are arranged along a first direction f1, a plurality of column lines are arranged along a second direction f2, and display units X are arranged sequentially on the row line H1 along the second direction f2. 1 , X 2 , X 3 ... wherein the output ends of the odd-numbered column lines L1, L3, L5, ... are connected together to form a first output end A, and the output ends of the even-numbered column lines L2, L4, L6, ... are connected together to form a second output end B, the first output end A is used to output a first output current I1, and the second output end B is used to output a second output current I2. That is, when the plurality of display units 100 correspondingly connected on the same column line are illuminated by the detection light, the generated respective response photocurrents can be output to the column line, and output to the corresponding first output end A or second output end B via the column line.

[0072] Therefore, the response photocurrent outputted by each column is the sum of the output response photocurrents of all display units 100 in the column, the first output current I1 of the first output terminal A is the output sum of the response photocurrents of the odd-numbered column lines, and the second output current I2 of the first output terminal B is the output sum of the response photocurrents of the even-numbered column lines.

[0073] According to an embodiment of the present disclosure, in the display array 400, two adjacent display units constitute a response unit for light detection, and the illumination intensity of the detection light corresponding to each response unit is approximately equal, so as to perform weighted multiplication and accumulation calculation on the input neural network image, thereby realizing neural network calculation.

[0074] like Figure 4 As shown, the display unit X 1 and X 2 The first response unit, display unit X 3 and X 4 A second response unit is formed, ..., a display unit X 2m-1 and X 2m The display units 100 in each response unit are close to each other and have a small space interval, so that the detection light received by the two display units in the same response unit can be approximately equal. Among them, the detection light S1, S2, ..., Sm is the pixel light corresponding to each response unit, which is used to realize the light detection function.

[0075] Therefore, due to the small spatial distance between adjacent column lines of the crossbar array, such as the display unit X in the response unit 1 and X 2 The received illumination can be regarded as approximately equal, which is pixel illumination S1. By analogy, the display unit X in the response unit can be obtained. 2m-1 and X 2m The corresponding pixel illumination is Sm.

[0076] In an embodiment of the present disclosure, for a display array 400 applied to neural network recognition, different detection efficiencies η presented by different display units 100 in different response units mean different weights, which can realize weighted multiplication and accumulation of input neural network images.

[0077] Therefore, the first output current I1 and the second output current I2 satisfy:

[0078] I 1 =η 1 S 1 +η 3 S 2 +…η 2m-1 S m (2)

[0079] I 2 =η 2 S 1 +η 4 S 2 +…η 2m S m (3)

[0080] Among them, η 1 , η 3 , ..., η 2m-1 is the light detection efficiency of each display unit corresponding to the odd-numbered columns in the response unit, η 2 , η 4 , ..., η 2m is the light detection efficiency of each display unit corresponding to the even-numbered columns in the same response unit, and the pixel illumination S1, S2, ..., Sm are the corresponding display units X 1 and X 2 The detection light intensity of the response unit and the corresponding display unit X 3 and X 4 The detected light intensity of the response unit, ..., the corresponding display unit X 2m-1 and X 2m The response unit detects light intensity.

[0081] It can be seen that the above formulas (2) and (3) can actually be:

[0082] I=η·S (4)

[0083] That is, the above formula (4) is:

[0084]

[0085] According to an embodiment of the present disclosure, based on the above formulas (2)-(5), the combination of the first output current I1 and the second output current I2 can be used for neural network recognition. Specifically, referring to formula (5), the corresponding recognition value can be determined according to the combination relationship of the output values ​​of preset I1 and I2. For example, when the output I1=0, I2=1, it is judged to be correct; when the output I1=0, I2=1, it is judged to be wrong. Therefore, the hardware structure of the display array 400 of the embodiment of the present disclosure can realize simple neural network recognition, that is, it can be used to judge whether it is correct based on the comparison of the output current I1 and the output current I2, that is, to obtain the corresponding recognition effect.

[0086] Therefore, in order to realize the computing function of the neural network of the embodiment of the present disclosure and achieve the effect of specifically identifying "right / wrong", the display array of the embodiment of the present disclosure can be two sets of output arrays (such as even columns and odd columns), and two different output results, namely the first output current I1 and the second output current I2, are obtained. Therefore, the display unit beams in the required display array 400 can be an even number. In this way, the display array of the embodiment of the present disclosure further realizes the function of identification and calculation on the basis of achieving light-emitting display and light detection, and can realize the design of integrated light sensing and calculation without other external computing circuits and devices.

[0087] In addition, it needs to be further explained that Figure 4 The method for obtaining the detection efficiency matrix η of each display unit 100 by the hardware structure of the display array 400 of the embodiment of the present disclosure is as follows: reset all memristors M in the display array 400 composed of the micro-light emitting diode array to a high resistance state, at which time the light detection efficiency η of the corresponding display unit is 1, and the response photocurrent generated by the micro-light emitting diode L of the corresponding display unit basically flows out to the external circuit, that is, the hardware structure can read the response photocurrent generated in the high resistance state of the memristor M to obtain image information. The obtained image information is subjected to software calculation, such as obtaining each weight value η after training by the back propagation algorithm. Finally, the weight η is written into the memristor M, so that the above-mentioned neural network matrix calculation can be performed on the image information, thereby completing the calculation function of the embodiment of the present disclosure.

[0088] like Figure 5-Figure 7 As shown, according to an embodiment of the present disclosure, the display array 500 further includes a light emitting array, which includes a plurality of light emitting units U1, U2, ..., for emitting detection light; the plurality of light emitting units U1, U2, ... and the plurality of display units X 1 , X 2 , ...are arranged one by one, spaced from each other and adjacent to each other.

[0089] In the embodiment of the present disclosure, the light emitting array is as follows Figure 5 As shown, the light-emitting array of the display array 500 provided in the embodiment of the present disclosure includes a plurality of light-emitting units U1, U2, ... arranged along a first direction f1 and a second direction f2, wherein, based on the display array 400 or 300, in space, a plurality of row lines h1-h4 are arranged along the first direction f1, and a plurality of column lines l1-l4 are arranged along the second direction f2, wherein each light-emitting unit may be a traditional light-emitting display unit, which is composed of a micro light-emitting diode L, and does not have a memristor M connected in parallel or in series with each other, and a first end (such as a positive electrode) of the diode L is connected to the row line h1, and a second end (such as a negative electrode) is connected to the column line l1, and emits light and displays after receiving a pulse current at the first end as an input end, so as to generate corresponding detection light.

[0090] Among them, each light-emitting unit is arranged between two adjacent display units in a spatial structure to achieve a one-to-one correspondence and to be arranged adjacent to each other with a spacing. That is, the number of light-emitting units can be equivalent to the number of display units. In the light detection state, the light-emitting unit is used as an emitting unit to emit detection light, and the adjacent display unit is used as a receiving unit of the detection light to receive pixel illumination. Since the light-emitting unit is between two adjacent display units, the pixel illumination received by the two adjacent display units is relatively close.

[0091] According to an embodiment of the present disclosure, the wavelength of the detection light emitted by the light emitting unit is smaller than the wavelength of the display light emitted by the display unit 100 .

[0092] According to an embodiment of the present disclosure, the light-emitting unit has a plurality of blue light diodes for emitting detection blue light; the diode of the display unit is a green light diode for absorbing the detection blue light to generate a response current; or the light-emitting unit has a plurality of green light diodes for emitting detection green light; the diode of the display unit is a red light diode for absorbing the detection green light to generate a response current.

[0093] The display light is the detection light of the display unit 100 (as an emission unit).

[0094] Furthermore, if Figure 6 The diagram shows the relationship between the absorption wavelengths of the red, green and blue primary color micro-LEDs of the embodiment of the present disclosure. Figure 5 The light emitting unit U1 and the display unit X disposed adjacent to and spaced from the light emitting unit U1 are shown. 1 and X 2 For example, since the micro-LED L is a PIN structure including a heterojunction, the energy of the light received when it is used as a detector is higher than the bandgap width of the active layer. 1 and X 2 When the micro-LED L is used as the receiving unit, the absorption band corresponding to the receiving unit must include the emission band of the diode of the light-emitting unit U1 as the transmitting unit, that is, the wavelength of the detection light of the transmitting unit U1 must be smaller than that of the receiving unit (display unit X 1 and X 2 )’s display light’s emission wavelength.

[0095] Generally, the micro-LED L has three primary colors: red, green and blue. The green micro-LED, i.e., MG (Micro-LED-Green), can absorb the light emitted by the blue micro-LED MB (Micro-LED-Blue), and the red micro-LED MR (Micro-LED-Red) can absorb the light emitted by the green micro-LED MG. Therefore, the blue micro-LED MB is used as the light-emitting unit U1, and the green micro-LED MG is used as the receiving unit (display unit X1). 1 and X 2 Alternatively, the green micro-LED MG is used as the light-emitting unit U1, and the red micro-LED MR is used as the receiving unit (display unit X1). 1 and X 2 ).

[0096] Based on the above contents, taking the implementation structure of full-screen fingerprint recognition of the intelligent electronic device 700 as an example, Figure 7 As shown, it includes light-emitting units U1 and U2, etc., and receiving units X arranged side by side and spaced apart from each other. 1 and X 2 The array layer 701 is formed. Among them, the transmitting units U1 and U2 emit detection light P1, which passes through the dielectric layer 702 and reaches the skin of the finger 703. The fingerprints at different positions on the surface of the finger 703 have different reflectivities, so the reflected light P2 with fingerprint information is reflected back (forming the corresponding fingerprint image) and finally reaches the receiving unit X. 1 and X 2 The diode L generates a corresponding photocurrent for array output calculation. The array layer emits light and receives the reflected fingerprint image at the same time. Figure 3-Figure 5 The display array structure shown is used for fingerprint recognition. Therefore, in the embodiment of the present disclosure, the detection light emitted by the light emitting unit is P1, and the detection light received by the display unit may be the reflected light P2 of the detection light P1.

[0097] The intelligent electronic device 700 may be an intelligent portable electronic device such as a mobile phone, an IPAD, a notebook computer, etc. The dielectric layer 702 may be a highly transparent light transmission layer, such as a glass layer.

[0098] Therefore, the display array of the embodiment of the present disclosure can realize hardware neural network matrix operations without complex structures or components such as external computing circuits, and further realize computing processes such as full-screen fingerprint recognition functions, thereby realizing integrated light sensing and computing.

[0099] like Figure 8 As shown, another aspect of the embodiment of the present disclosure provides an operation method of the above-mentioned display array, which includes steps S801-S804.

[0100] In step S801, a first current pulse is applied to a plurality of row lines in a display array to enable a plurality of display units on a plurality of column lines corresponding to the plurality of row lines to emit light for display;

[0101] In step S802, a second current pulse is applied to the plurality of row lines to adjust the resistance of the memristors of the plurality of display units on the plurality of column lines corresponding to the plurality of row lines;

[0102] In step S803, based on the resistance adjustment of the memristor, the corresponding multiple display units receive the detection light to generate a response photocurrent, thereby realizing the light detection function of the display array, wherein the resistance of the memristor can be used to adjust the light detection efficiency η of the display unit;

[0103] In step S804, based on the response photocurrent, a first output current and a second output current are output for calculation of a neural network matrix.

[0104] like Figure 3-Figure 5 In the display array shown, the column line L1 is grounded, and the row lines H1, H2, H3, H4, etc. are selected in sequence to operate the multiple display units on the column line L1. Similarly, the multiple display units on the column lines L2, L3, and L4 can be operated in sequence. 1 , X 2 ...the positive pole can be connected to the row line of the crossbar array, and the corresponding negative pole can be connected to the column line of the crossbar array.

[0105] In step S801, when used for display, a forward current pulse of about 1 microsecond is applied to the row line to drive the micro light emitting diode L to emit light, and the light brightness of the micro light emitting diode L is adjusted by adjusting the corresponding current pulse width.

[0106] In step S802, when adjusting the resistance of the memristor M, a forward current pulse of about 100 nanoseconds is applied to the row line where the display unit 100 is located, and the memristor M can be written so that the resistance of the memristor M is a fixed value in the following light detection-calculation process. The resistance of the memristor M is adjusted by adjusting the width of the corresponding input current pulse.

[0107] In step S803, the column line L1 and the row lines H1, H2, H3, H4 are grounded, and the multiple display units on the column line L1 are in a zero bias state. At this time, the display array is tested for light, and the micro-LEDs L in the display unit 100 respond to the light and generate a response photocurrent.

[0108] It should be noted that the different resistance values ​​of the memristor M in each of the display units 100 can make the detection efficiency η of the corresponding display unit different, and thus make the photocurrent output to the corresponding column line different. According to Kirchhoff's law, if the current passing through the resistor R1 on the column line L1 is the sum of the output currents of each display unit 100 on the column line L1, the current passing through the resistor R1 is measured, and analog / digital conversion (i.e., ADC) is performed, which can facilitate the processor connected to the display array to read the current. Therefore, by analogy, the column line L2, the column line L3, and the column line L4 are grounded in turn, and the current magnitudes passing through the resistor R2, the resistor R3, and the resistor R4 can be obtained respectively.

[0109] In step S804, after obtaining the above current magnitudes, the sum of the currents corresponding to the odd columns is the first output current, and the sum of the currents corresponding to the even columns is the second output current. The combination of the two can be applied to the calculation of the neural network matrix, thereby realizing the integration of light sensing and calculation.

[0110] Based on the operating method of the embodiment of the present disclosure described above, it can be seen that the display array of the embodiment of the present disclosure can simultaneously have the functions of light emission, detection and calculation (i.e., integrated light sensing and calculation), without the need for additional sensors and computing circuits, which can reduce hardware costs and is conducive to the miniaturization of portable electronic devices.

[0111] According to an embodiment of the present disclosure, in step S803, based on the resistance adjustment of the memristor, controlling the corresponding multiple display units to receive the detection light to generate a response photocurrent includes: applying a positive voltage (i.e., reverse biasing the diode) to the column lines corresponding to the multiple display units to increase the photocurrent.

[0112] In an embodiment of the present disclosure, in step S803, if the row lines H1, H2, H3, and H4 are grounded and the column line L1 is connected to a positive voltage less than 1V, the multiple display units on the column line L1 are all in a reverse biased state, thereby improving the responsiveness of each light-emitting diode L in the corresponding multiple display units 100, thereby increasing the size of the response photocurrent.

[0113] According to an embodiment of the present disclosure, the operating method further includes: applying a reset voltage to column lines corresponding to the plurality of display units 100 so that the resistance value of the memristor M is restored to a high resistance state.

[0114] In an embodiment of the present disclosure, after completing steps S801-S804, the row lines H1, H2, H3, and H4 can be grounded, and a positive reset voltage can be applied to the column line L1, which can be used to reset the memristors M in the multiple display units 100 in the column line L1 and restore them to a high-impedance state.

[0115] Therefore, the display array of the embodiment of the present disclosure can achieve repeated operations of light sensing calculation.

[0116] Another aspect of an embodiment of the present disclosure provides an electronic device, comprising at least one of the above-mentioned light-sensing and computing integrated display arrays, which is used to enable the electronic device to have a fingerprint recognition function when implementing the above-mentioned operating method.

[0117] The electronic device may be a mobile phone, IPAD, laptop computer or other intelligent portable electronic device with fingerprint recognition function.

[0118] According to the light sensing and computing integrated display unit, display array, operation method and electronic device of the embodiments of the present disclosure, it can be seen that the display array with a micro-light emitting diode array structure can simultaneously realize the functions of light emission, detection and computing, and can be used in technical fields such as image recognition and optical computing, as follows:

[0119] (1) The display unit can have the functions of light emission, detection and calculation at the same time, that is, light sensing and calculation are integrated, which can perform basic image recognition and form an array with intelligent sensing function.

[0120] (2) The light-emitting, detection and computing functions are realized within the display unit, and no complex external designs such as additional sensors and computing circuits are required, which can reduce hardware costs and is conducive to the miniaturization of portable devices.

[0121] (3) Calculation is realized while detection is performed, i.e. sensing and computing are integrated (e.g. Figure 3-Figure 5 The neural network calculation shown in the figure) can compress the original redundant data of the image, and the output data is changed from the image matrix to only output the current of each column, reducing the amount of data transmission, simplifying the subsequent image recognition calculation process, and improving the recognition speed.

[0122] Therefore, it can be seen that the display unit, display array, operation method and electronic device of the embodiments of the present disclosure can realize basic deep neural network matrix calculation through a hardware cross array, and may be applied to full-screen fingerprint recognition, optoelectronic fusion computing and other scenarios in the future. It has great potential for commercial applications and also has extremely high scientific research value.

[0123] So far, the embodiments of the present disclosure have been described in detail with reference to the accompanying drawings.

[0124] The specific embodiments described above further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above description is only a specific embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A display array integrating light sensing and computing, characterized in that: include: A display unit, wherein the display unit comprises: A diode, used for emitting display light to realize the light-emitting display of the display unit, wherein the diode generates a response photocurrent when receiving the detection light; a memristor connected in parallel with the diode, the memristor being used to shunt the response photocurrent and adjust the light detection efficiency of the display unit; A first end connected to the anode of the diode and the memristor; and A second end is connected to the diode and the cathode of the memristor, and is used to output the shunted response photocurrent of the display unit; A plurality of row lines are arranged side by side along a first direction, and are used to apply current pulses to the corresponding plurality of display units to drive the plurality of display units to emit light and / or adjust the resistance value of the memristor; and A plurality of column lines are arranged side by side with each other along the second direction and are arranged to cross with the plurality of row lines in space, and are used to output the superposition of the shunted response photocurrents of the plurality of display units to realize the light detection function of the display array. The first end of a display unit among the plurality of display units is connected to a row line of the corresponding plurality of row lines, and the second end is connected to a column line of the corresponding plurality of column lines. Wherein, the display array further comprises: A first output terminal, connected to a plurality of column lines of odd columns or a plurality of row lines of odd rows in the display array, for outputting a first output current; A second output terminal, connected to a plurality of column lines of even columns or a plurality of row lines of even rows in the display array, for outputting a second output current; The combination of the first output current and the second output current is used to implement the calculation of the neural network matrix.

2. The display array according to claim 1, characterized in that: Also includes: A plurality of resistors are connected in series with the plurality of column lines and / or the plurality of row lines in a one-to-one correspondence to realize the output of the shunted response photocurrent.

3. The display array according to claim 1, characterized in that: Also includes: A light emitting array having a plurality of light emitting units for emitting detection light; The plurality of light emitting units correspond to the plurality of display units one by one, are spaced from each other and are arranged adjacent to each other.

4. The display array according to claim 3, characterized in that: The wavelength of the detection light emitted by the light emitting unit is smaller than the wavelength of the display light emitted by the display unit.

5. The display array according to claim 3, characterized in that: The light emitting unit has a plurality of blue light diodes for emitting detection blue light; The diode of the display unit is a green light diode, which is used to absorb the detection blue light to generate a response current; or The light emitting unit has a plurality of green light diodes for emitting detection green light; The diode of the display unit is a red light diode, which is used to absorb the detected green light to generate a response current.

6. A method for operating a display array with integrated light sensing and computing according to any one of claims 1 to 5, characterized in that: include: Applying a first current pulse to a plurality of row lines in the display array to enable a plurality of display units on a plurality of column lines corresponding to the plurality of row lines to emit light for display; Applying a second current pulse to the plurality of row lines to adjust the resistance of the memristors of the plurality of display units on the plurality of column lines corresponding to the plurality of row lines; Based on the resistance adjustment of the memristor, the corresponding plurality of display units receive the detection light to generate a shunted response photocurrent, thereby realizing the light detection function of the display array; Based on the superposition of the shunted response photocurrents, the first output current and the second output current are output for calculation of the neural network matrix.

7. The operating method according to claim 6, characterized in that: The method of adjusting the resistance value of the memristor to control the corresponding display units to receive the detection light to generate the split response photocurrent includes: A positive voltage is applied to the column lines corresponding to the plurality of display units to increase the photocurrent.

8. The operating method according to claim 6, characterized in that: Also includes: A reset voltage is applied to the column lines corresponding to the plurality of display units so that the resistance value of the memristor is restored to a high resistance state.

9. An electronic device, characterized in that: The electronic device comprises at least one display array integrating light sensing and computing as claimed in any one of claims 1 to 5, and is used to enable the electronic device to have a fingerprint recognition function when implementing the operating method as claimed in any one of claims 6 to 8.

Images