Pupil information acquisition circuit and method, display device
By employing M infrared light sensors, N analog-to-digital converters, and multiplexing sub-circuits in VR/AR devices, the problems of large area and high power consumption of infrared photodiode-based analog-to-digital converters are solved, thereby improving signal transmission efficiency and user experience.
Patent Information
- Application Number
- CN202280000579.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-28
- Publication Date
- 2026-01-23
- Estimated Expiration
- 2042-03-28
AI Technical Summary
In existing VR/AR devices, infrared photodiodes with analog-to-digital converters require large areas, consume a lot of energy, and have low signal transmission efficiency, resulting in delayed human-computer interaction responses.
It employs M infrared light sensors, N analog-to-digital converters, and multiplexing sub-circuits. By having each of the m infrared light sensors share one analog-to-digital converter, the control signals are stored in a shift register and the signal channels are multiplexed through a data selector and a data delayer, thereby reducing the number of analog-to-digital converters and data lines.
It reduces the area footprint and power consumption of analog-to-digital converters, improves signal transmission efficiency, and enhances the user experience.
Smart Images

Figure CN117223037B_ABST
Abstract
Description
Technical Field
[0001] This disclosure belongs to the field of display technology, specifically relating to a pupil information acquisition circuit and method, and a display device. Background Technology
[0002] In recent years, Virtual Reality (VR) and Augmented Reality (AR) technologies have been gradually applied to fields such as display, gaming, and healthcare. With technological advancements, people's expectations for VR / AR are rising, and the interaction between users and VR / AR devices is no longer limited to traditional human-computer interaction methods such as touch and gestures. Therefore, eye-tracking technology has gradually become an important technology for enhancing the VR / AR device experience. Eye-tracking technology is an intelligent human-computer interaction technology that uses eye movements to control VR / AR devices. All operations can be completed simply by "looking," freeing up the hands and offering the fastest and most user-friendly human-computer interaction method.
[0003] Currently, eye-tracking technology primarily uses cameras, but its signal transmission speed is relatively low, leading to response delays. To overcome this delay issue in human-computer interaction, using infrared photodiodes to collect the user's pupil information for eye tracking has gradually become a trend. However, current VR / AR devices incorporate numerous infrared photodiodes, each equipped with an analog-to-digital converter (ADC) to scan the user's pupils. This requires a significant area to integrate the ADC, increasing power consumption and necessitating numerous data lines for signal transmission. This results in redundant data despite limited space utilization, increasing the data processing load on the ADC and impacting signal transmission efficiency. Summary of the Invention
[0004] This disclosure aims to at least solve one of the technical problems existing in the prior art, and to provide a pupil information acquisition circuit and method, and a display device.
[0005] In a first aspect, embodiments of this disclosure provide a pupil information acquisition circuit, wherein the pupil information acquisition circuit includes: M infrared light sensors, N analog-to-digital converters, and N multiplexing sub-circuits; M and N are both positive integers, and M is greater than N;
[0006] Each of the m infrared sensors is connected to the same analog-to-digital converter through one of the multiplexing sub-circuits; m is less than or equal to M;
[0007] Among the m infrared light sensors connected to the same analog-to-digital converter, the distance between the acquisition ranges of any two adjacent infrared light sensors is greater than the diameter of the pupil.
[0008] Optionally, the multiplexing sub-circuit includes: a shift register and a data selector;
[0009] The shift register is connected to the control signal terminal and the data selector, and is configured to store the control signal corresponding to the analog-to-digital converter.
[0010] The data selector is configured to control m infrared light sensors connected to the same analog-to-digital converter to collect pupil information according to a preset rule based on the control signal.
[0011] Optionally, the data selector includes: an encoder and one first information channel and m second information channels connected to the encoder;
[0012] The first information channel includes: a first transistor and a second transistor; the control electrode of the first transistor is connected to the signal output terminal of the encoder, the first electrode is connected to the first clock signal terminal, and the second electrode is connected to the control electrode of the second transistor; the control electrode of the second transistor is connected to the second electrode of the first transistor, the first electrode is connected to the analog-to-digital converter, and the second electrode is connected to m infrared light sensors.
[0013] The second information channel includes a third transistor and a fourth transistor; the control electrode of the third transistor is connected to the signal output terminal of the encoder, the first electrode is connected to the second clock signal terminal, and the second electrode is connected to the control electrode of the fourth transistor; the control electrode of the fourth transistor is connected to the second electrode of the third transistor, the first electrode is connected to the analog-to-digital converter, and the second electrode is connected to one corresponding infrared light sensor.
[0014] Optionally, the multiplexing sub-circuit further includes: m-1 data delay units;
[0015] The data delay device is configured to sequentially input the scanning signal to the corresponding m infrared light sensors according to a preset rule.
[0016] Optionally, the data delay unit includes: a fifth transistor, a sixth transistor, a seventh transistor, a first capacitor, a second capacitor, and a resistor; wherein the fifth transistor has the opposite polarity to the sixth transistor and the same polarity to the seventh transistor;
[0017] The control terminal of the fifth transistor is connected to the second clock signal terminal, the first terminal is connected to the second terminal of the fourth transistor, and the second terminal is connected to one end of the first capacitor;
[0018] One end of the first capacitor is connected to the second terminal of the fifth transistor, and the other end is connected to the first terminal of the sixth transistor;
[0019] The control terminal of the sixth transistor is connected to the second clock signal terminal, the first terminal is connected to the other end of the first capacitor, and the second terminal is connected to one end of the second capacitor and the first terminal of the seventh transistor.
[0020] One end of the second capacitor is connected to the second terminal of the sixth transistor, and the other end is grounded;
[0021] The control electrode of the seventh transistor is connected to the second clock signal terminal, the first electrode is connected to the second electrode of the sixth transistor, and the second electrode is connected to one end of the resistor and the corresponding infrared light sensor.
[0022] One end of the resistor is connected to the second terminal of the seventh transistor, and the other end is grounded.
[0023] Optionally, the data selector includes: an encoder and m second information channels connected to the encoder;
[0024] The second information channel includes a third transistor and a fourth transistor; the control electrode of the third transistor is connected to the signal output terminal of the encoder, the first electrode is connected to the second clock signal terminal, and the second electrode is connected to the control electrode of the fourth transistor; the control electrode of the fourth transistor is connected to the second electrode of the third transistor, the first electrode is connected to the analog-to-digital converter, and the second electrode is connected to one corresponding infrared light sensor.
[0025] Optionally, the infrared light sensor includes an infrared photodiode.
[0026] Optionally, the analog-to-digital converter is a one-bit analog-to-digital converter.
[0027] Secondly, embodiments of this disclosure provide a display device, wherein the display device includes the pupil information acquisition circuit as described above.
[0028] Optionally, the display device further includes: a display panel; the display panel having a central display area and a peripheral display area surrounding the central display area;
[0029] The pupil information acquisition circuit is located in the central display area or in the peripheral display area.
[0030] Optionally, the display device is a virtual reality display technology or an augmented reality display device.
[0031] Thirdly, embodiments of this disclosure provide a pupil information acquisition method, applied to the pupil information acquisition circuit provided above, wherein the pupil information acquisition method includes:
[0032] According to preset rules, the control signals are stored in the shift register;
[0033] According to the control signal, the m infrared light sensors connected to the same analog-to-digital converter are controlled to collect pupil information according to a preset rule.
[0034] Optionally, according to the control signal, controlling the m infrared light sensors connected to the same analog-to-digital converter to collect pupil information according to a preset rule includes:
[0035] According to the control signal, scan m infrared light sensors sequentially;
[0036] If one of the m infrared light sensors collects pupil information, then the remaining m-1 infrared light sensors are turned off, and only the corresponding one light sensor is used to collect pupil information. Attached Figure Description
[0037] Figure 1 This is a schematic diagram of the structure of an exemplary display device;
[0038] Figure 2 This is a schematic diagram of the structure of a pupil information acquisition circuit provided in an embodiment of the present disclosure;
[0039] Figure 3 This is a schematic diagram of the structure of a data selector provided in an embodiment of the present disclosure;
[0040] Figure 4 This is a schematic diagram of the structure of a data delay device provided in an embodiment of the present disclosure;
[0041] Figure 5 Timing diagram of each signal in the pupil information acquisition circuit provided in the embodiments of this disclosure;
[0042] Figure 6 This is a schematic diagram of another pupil information acquisition circuit provided in an embodiment of the present disclosure;
[0043] Figure 7 A schematic diagram of another data selector provided in an embodiment of this disclosure;
[0044] Figure 8 This is a schematic diagram of the structure of a display device provided in an embodiment of the present disclosure;
[0045] Figure 9 This is a flowchart illustrating a pupil acquisition method provided in an embodiment of the present disclosure. Detailed Implementation
[0046] To enable those skilled in the art to better understand the technical solutions of this disclosure, the disclosure will be further described in detail below with reference to the accompanying drawings and specific embodiments.
[0047] Unless otherwise defined, the technical or scientific terms used in this disclosure shall have the ordinary meaning understood by one of ordinary skill in the art to which this disclosure pertains. The terms “first,” “second,” and similar terms used in this disclosure do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Similarly, the terms “an,” “a,” or “the,” and similar terms do not indicate a quantity limitation, but rather indicate the presence of at least one. The terms “including,” “comprising,” or “containing,” and similar terms mean that the element or object preceding the word encompasses the elements or objects listed following the word and their equivalents, without excluding other elements or objects. The terms “connected,” “linked,” or similar terms are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. The terms “upper,” “lower,” “left,” and “right,” etc., are used only to indicate relative positional relationships, and these relative positional relationships may change accordingly when the absolute position of the described objects changes.
[0048] Figure 1 This is a schematic diagram of the structure of an exemplary display device, such as... Figure 1 As shown, the display device includes: a display panel 10; the display panel 10 has a central display area and a peripheral display area surrounding the central display area; a pupil information acquisition circuit 20 is disposed in the display panel 10. The pupil information acquisition circuit 20 can be disposed in the central display area to arrange a larger number of pupil information acquisition circuits 20, thereby improving the accuracy of pupil information acquisition. The pupil information acquisition circuit 20 can also be disposed in the peripheral display area, reflecting light containing pupil information and illuminating the peripheral display area through an optical structure. In the following description, the pupil information acquisition circuit 20 will be described as being disposed in the peripheral display area (e.g., ...). Figure 1 The following example will be used to illustrate this.
[0049] like Figure 1 As shown, the pupil information acquisition circuit 20 includes: multiple infrared light sensors 201 and multiple analog-to-digital converters 202; the infrared light sensors 201 and the analog-to-digital converters 202 are connected in a one-to-one correspondence.
[0050] In the pupil information acquisition circuit 20, the infrared light sensor 201 and the analog-to-digital converter 202 are connected one-to-one and are positioned close together to avoid affecting signal transmission due to excessive distance. During application, when the user observes the display panel on the display device, the infrared light sensor 201 can acquire the user's pupil information and convert the light signal into an analog voltage signal. The analog-to-digital converter 202 can then convert the analog voltage signal into a digital signal. For example, when the infrared light sensor 201 acquires the user's pupil information, the analog-to-digital converter 202 can output "1"; when the infrared light sensor 201 does not acquire the user's pupil information, the analog-to-digital converter 202 can output "0". This allows the user's pupil position to be determined, enabling human-computer interaction using pupil tracking technology.
[0051] However, in current display devices, to improve the accuracy of pupil information acquisition, a large number of infrared light sensors 201 are installed in the display panel 10, and each infrared light sensor 201 is equipped with an analog-to-digital converter 202 to scan the user's pupil. This requires a large area in the display device to integrate the analog-to-digital converter 202, increasing energy consumption and requiring more data lines for signal transmission. This results in a large amount of redundant data despite only using the available area, increasing the data processing load on the analog-to-digital converter 202, affecting signal transmission efficiency, and reducing the user experience.
[0052] To at least solve one of the aforementioned technical problems, this disclosure provides a pupil information acquisition circuit and method, and a display device. The pupil information acquisition circuit and method, and the display device provided in this disclosure will be further described in detail below with reference to the accompanying drawings and specific embodiments.
[0053] It should be noted that the transistors used in the embodiments of this disclosure can be thin-film transistors, field-effect transistors, or other devices with the same characteristics. Since the source and drain of the transistors are symmetrical, there is no distinction between them. In the embodiments of this disclosure, to distinguish the source and drain of the transistor, one of the terminals is called the first terminal, the other is called the second terminal, and the gate is called the control terminal. Furthermore, transistors can be classified into N-type and P-type according to their characteristics. When an N-type transistor is used, the first terminal is the source, the second terminal is the drain, and when the gate input is high, the source and drain are conducting; the opposite is true for P-type transistors. It is conceivable that using a P-type transistor is something that those skilled in the art can easily conceive of without inventive effort, and therefore it is also within the scope of protection of the embodiments of this disclosure.
[0054] In a first aspect, embodiments of this disclosure provide a pupil information acquisition circuit. Figure 2This is a schematic diagram of the structure of a pupil information acquisition circuit provided in an embodiment of the present disclosure, as shown below. Figure 2 As shown, the pupil information acquisition circuit 20 includes: M infrared light sensors 201, N analog-to-digital converters 202, and N multiplexing sub-circuits 203; M and N are both positive integers, and M is greater than N; every m infrared light sensors 201 are connected to the same analog-to-digital converter 202 through a multiplexing sub-circuit 203; m is less than or equal to M; among the m infrared light sensors 201 connected to the same analog-to-digital converter 202, the distance between the acquisition ranges of any two adjacent infrared light sensors 201 is greater than the diameter of the pupil.
[0055] It should be noted that in the embodiments disclosed herein and the following description, the example given is that m is 3, that is, every 3 infrared light sensors 201 reuse the same analog-to-digital converter 202. It can be understood that m can be any other value such as 4, 6, 8, etc., and can be set according to actual needs. However, in order to ensure the data processing efficiency of the analog-to-digital converter 202, the value of m cannot be too large.
[0056] In the pupil information acquisition circuit 20 provided in this embodiment, the number of infrared light sensors 201 is much greater than the number of analog-to-digital converters 202. Each m infrared light rays are multiplexed by a multiplexing sub-circuit 203 to reuse the same analog-to-digital converter 202. The multiplexing sub-circuit 203 controls the signal transmission between the m infrared light sensors and the same analog-to-digital converter 202 to achieve signal channel multiplexing. Therefore, the number of analog-to-digital converters 202 in the pupil information acquisition circuit 20 can be reduced, thereby reducing the area occupied by the analog-to-digital converters 202.
[0057] At the same time, the number of data signal lines connecting the infrared light sensor 201 and the analog-to-digital converter 202 can be reduced, avoiding the generation of redundant data, thereby reducing the data processing pressure on the analog-to-digital converter 202, and thus improving the efficiency of pupil information acquisition and enhancing the user experience.
[0058] In addition, among the m infrared light sensors 201 connected to the same analog-to-digital converter 202, the distance between the acquisition ranges of any two adjacent infrared light sensors 201 is greater than the diameter of the pupil. At any given time, only one infrared light sensor 201 can acquire the user's pupil information. The multiplexing sub-circuit 203 can control the signal transmission between the infrared light sensor 201 and the analog-to-digital converter 202, while the other infrared light sensors 201 are in a closed state. This enables centralized acquisition of pupil information, ensuring the efficiency of pupil information acquisition while reducing the energy consumption of pupil information acquisition.
[0059] In some embodiments, such as Figure 2As shown, the multiplexing sub-circuit 203 includes a shift register and a data selector MUX; the shift register is connected to the control signal terminal and the data selector MUX, and is configured to store the control signal corresponding to the analog-to-digital converter 202; the data selector MUX is configured to control m infrared light sensors 201 connected to the same analog-to-digital converter 202 to collect pupil information according to a preset rule based on the control signal.
[0060] Since multiple infrared sensors 201 are connected to the same analog-to-digital converter 202, a shift register can store the control signals to ensure timely, effective, and orderly input to the corresponding infrared sensors 201. When scanning of each infrared sensor 201 is required, the corresponding control signal is sent to the appropriate infrared sensor 201. The data selector MUX can control the m infrared sensors 201 connected to the same analog-to-digital converter 202 to collect pupil information according to preset rules. This ensures that at any given time, one analog-to-digital converter 202 processes only the pupil information collected by one corresponding infrared sensor 201, thus reducing the data processing load on the analog-to-digital converter 202, thereby improving the efficiency of pupil information acquisition and enhancing the user experience. It should be noted that each shift register corresponds to one analog-to-digital converter 202. In this embodiment, only one analog-to-digital converter 202 is shown. The connection relationship between the shift register and the analog-to-digital converter 202 is the same as described above. For example... Figure 2 The shift register 2 shown is connected to an analog-to-digital converter 202, and its implementation principle is the same as that described above, so it will not be repeated here.
[0061] Specifically, Figure 3 This is a schematic diagram of the structure of a data selector provided in an embodiment of the present disclosure, as shown below. Figure 3 As shown, the data selector MUX includes: an encoder and one first information channel and m second information channels connected to the encoder; the first information channel includes: a first transistor T1 and a second transistor T2; the gate of the first transistor T1 is connected to the signal output terminal of the encoder, the source is connected to the first clock signal terminal CLK_S, and the drain is connected to the gate of the second transistor T2; the gate of the second transistor T2 is connected to the drain of the first transistor T1, and the source is connected to the analog-to-digital converter 202 (…). Figure 3 (Not shown, only the signal input terminal IN is shown), the drain is connected to m infrared light sensors 201 ( Figure 3(Not shown, only the signal output terminal Output1 is shown); the second information channel includes: a third transistor T3 and a fourth transistor T4; the gate of the third transistor T3 is connected to the signal output terminal of the encoder, the source is connected to the second clock signal terminal CLK, and the drain is connected to the gate of the fourth transistor T4; the gate of the fourth transistor T4 is connected to the drain of the third transistor T3, and the source is connected to the analog-to-digital converter 202 (…). Figure 3 (Not shown, only the signal input terminal IN is shown), the drain is connected to the corresponding infrared light sensor 201. Figure 3 (Not shown in the diagram; only the signal output terminals Output2, 3, and 4 are shown).
[0062] In this embodiment, three infrared light sensors 201 are connected to the same data selector 2032. The encoder in the data selector MUX has four signal output terminals, which can output four signals: "00", "01", "11", and "10". These signals represent "scanning all three infrared light sensors sequentially", "scanning only the first infrared light sensor", "scanning only the second infrared light sensor", and "scanning only the third infrared light sensor", respectively. The signal channels can be divided into two types: a first signal channel that scans each infrared light sequentially, and a second signal channel that scans only one infrared light. By adjusting the control signal, one of the multiple infrared light sensors 201 can be made to collect pupil information while the others are turned off. This allows for centralized collection of pupil information, ensuring efficiency while reducing energy consumption. It also reduces the number of analog-to-digital converters 202 in the pupil information acquisition circuit 20, thereby reducing the area occupied by the analog-to-digital converters 202.
[0063] In some embodiments, such as Figure 2 As shown, the multiplexing sub-circuit also includes: m-1 data delay units Delay (labeled Delay1, Delay2, etc.); the data delay units Delay are configured to sequentially input the scanning signals to the corresponding m infrared light sensors 201 according to a preset rule.
[0064] Specifically, Figure 4 This is a schematic diagram of the structure of a data delay device provided in an embodiment of this disclosure, as shown below. Figure 4As shown, the data delay unit Delay includes: a fifth transistor T5, a sixth transistor T6, a seventh transistor T7, a first capacitor C1, a second capacitor C2, and a resistor R; wherein, the polarity of the fifth transistor T5 is opposite to that of the sixth transistor T6, and the polarity is the same as that of the seventh transistor T7; the gate of the fifth transistor T5 is connected to the second clock signal terminal CLK, the source is connected to the drain of the fourth transistor T4, and the drain is connected to one end of the first capacitor C1; one end of the first capacitor C1 is connected to the drain of the fifth transistor T5, and the other end is connected to the source of the sixth transistor T6; the gate of the sixth transistor T6 is connected to the second clock signal terminal CLK, the source is connected to the other end of the first capacitor C1, and the drain is connected to one end of the second capacitor C2 and the source of the seventh transistor T7; one end of the second capacitor C2 is connected to the drain of the sixth transistor T6, and the other end is grounded; the gate of the seventh transistor T7 is connected to the second clock signal terminal CLK, the source is connected to the drain of the sixth transistor T6, and the drain is connected to one end of the resistor R and a corresponding infrared light sensor 201. Figure 6 (Not shown, only the signal output terminal is shown); one end of resistor R is connected to the drain of the seventh transistor T7, and the other end is grounded.
[0065] The data delay unit Delay can delay the control signal input to the second clock signal terminal CLK, ensuring that the control signals input to the corresponding infrared light sensors 201 do not interfere with each other. This allows only one of the three infrared light sensors 201 multiplexing the same analog-to-digital converter 202 to collect pupil information at any given time, thus achieving centralized collection of pupil information. This reduces the energy consumption of pupil information collection while maintaining its efficiency. It also reduces the number of analog-to-digital converters 202 in the pupil information acquisition circuit 20, thereby reducing the area occupied by the analog-to-digital converters 202.
[0066] Figure 5 The timing diagrams of various signals in the pupil information acquisition circuit provided in the embodiments of this disclosure are shown below in conjunction with... Figure 5 The timing sequence of each signal shown further illustrates the working process of the pupil information acquisition circuit provided in this embodiment of the present disclosure.
[0067] First, CTR[0:1] is the control signal. A shift register stores the control signal corresponding to each analog-to-digital converter 202 in a separate register. Then, the control signal terminal Frame_ctr inputs a control signal to control the shift register to release data to the data selector MUX, thus controlling the data selector MUX. When the data selector MUX receives the control signal, it first generates a control signal through the encoder. Here, "00", "01", "11", and "10" represent "scanning 3 infrared sensors sequentially", "scanning only the first infrared sensor", "scanning only the second infrared sensor", and "scanning only the third infrared sensor", respectively. When the control signal is 00, the encoder outputs a high-level signal, the corresponding first transistor (NMOS) T1 is turned on, and the first clock signal terminal CLK_S can be the output of the data selector MUX. The same applies to other cases. IN is the sampling terminal of the analog-to-digital converter 202, and Output1 is the scan output. The analog-to-digital converter 202 continuously scans and samples according to the signal of the second clock signal terminal CLK, keeping it unchanged. This is achieved through the first clock signal terminal CLK_S and the two subsequent data delay units Delay. Figure 5 The control signals shown in the timing diagram enable the analog-to-digital converter 202 to perform scanning sampling, sampling the pupil information of the three infrared light sensors 201 according to a preset rule. Figure 2 The structure of the data delay unit Delay1 in the middle is as follows: Figure 4 As shown, this can be achieved Figure 5 The Delay1 signal in the code is used to implement the data delay function Delay2, which can be achieved by cascading two Delay1 data delay functions. In more cases, more Delay1 functions can be cascaded. Similarly, when the control signal is 01, Output2 and the sampling terminal of the analog-to-digital converter 202 are connected, allowing the analog-to-digital converter 202 to sample the first infrared light sensor 201 independently. The same applies when the control signals are 10 and 11.
[0068] The pupil information collected by the infrared light sensor 201 can be a light signal, which can be converted into an analog voltage signal. The analog voltage signal is transmitted to the analog-to-digital converter 202 and compared with the voltage signal at the reference voltage terminal V_ref. If the collected voltage signal and the voltage signal at the reference voltage terminal V_ref meet preset conditions, such as the potential of the collected voltage signal being higher than the potential of the voltage signal at the reference voltage terminal V_ref, then a digital signal "1" is output through the data signal output terminal Data, indicating that the pupil is located at the corresponding position of the infrared light sensor 201. The data analysis module (not shown in the figure) then analyzes and determines the position of the pupil, thereby realizing the eye-tracking function.
[0069] The pupil information acquisition circuit provided in this embodiment operates as follows: Initially, the CTR is 00, and all analog-to-digital converters (ADCs) 202 scan and sample. When an ADC 202 acquires a 0 value, the system sets the control signal CTR based on the position of the acquired 0. In the next frame, these control signals are sent to the shift register. This process requires n CLK times. The sampling mode of each ADC 202 in each frame depends on the CTR signal, switching once per frame. This allows for switching the scanning mode of the ADC 202 in a very short time. Thus, all ADCs 202 can be freely controlled via two lines, and centralized scanning can be achieved, discarding useless areas and scanning only useful areas. This greatly saves the area occupied by the ADCs 202 while ensuring the efficiency of pupil information acquisition.
[0070] Figure 6 This is a schematic diagram of another pupil information acquisition circuit provided in an embodiment of this disclosure. Figure 7 A schematic diagram of another data selector provided in an embodiment of this disclosure is shown below. Figure 6 and Figure 7 As shown, the data selector MUX includes: an encoder and m second information channels connected to the encoder; each second information channel includes: a third transistor T3 and a fourth transistor T4; the control terminal of the third transistor T3 is connected to the signal output terminal of the encoder, the first terminal is connected to the second clock signal terminal CLK, and the second terminal is connected to the control terminal of the fourth transistor T4; the control terminal of the fourth transistor T4 is connected to the second terminal of the third transistor T3, and the first terminal is connected to the analog-to-digital converter 202 (…). Figure 7 (Not shown, only the signal input terminal IN is shown), the second pole is connected to the corresponding infrared light sensor 201. Figure 7 (Not shown in the diagram; only the signal output terminals Output2, 3, and 4 are shown).
[0071] Figure 6 In the pupil information acquisition circuit shown, the CTR is still a 2-bit control signal, and... Figure 2 The difference in the pupil information acquisition circuit shown is that the data selector MUX has only three signal output terminals, reducing the number of states requiring scanning and detection by the three infrared light sensors 201. Figure 2(As shown in the CTR state of 00), the CTR control signal needs to transmit signals in real time to ensure that the three infrared light sensors 201 scan one by one. When CTR is 01, the first infrared light sensor 201 is detected; when CTR is 10, the second infrared light sensor 201 is detected; and when CTR is 11, the third infrared light sensor 201 is detected. During scanning, CTR continuously switches between the three states. When any infrared light sensor 201 reports a value of 1, CTR remains in the state of the corresponding infrared light sensor 201 until the detection signal reaches 0, then the scanning state resumes. In this way, the structure of the pupil information acquisition circuit is relatively simple, which can further reduce the number of data signal lines, reduce the generation of redundant signals, and at the same time reduce wiring difficulty and save manufacturing costs.
[0072] In some embodiments, the infrared light sensor 201 includes an infrared photodiode.
[0073] Infrared photodiodes have a relatively simple structure and can quickly acquire pupil information, thereby improving the efficiency of pupil information acquisition.
[0074] In some embodiments, analog-to-digital converter 202 is a one-bit analog-to-digital converter.
[0075] The analog-to-digital converter 202 has only 1 bit of memory. It can indicate whether the pupil is in the corresponding area by outputting 0 or 1. It can be implemented with only one comparator. Its circuit structure is simple and can reduce the area occupied by the analog-to-digital converter 202.
[0076] Secondly, embodiments of this disclosure provide a display device that includes a pupil acquisition circuit as provided in any of the above embodiments. Figure 8 This is a schematic diagram of the structure of a display device provided in an embodiment of the present disclosure, such as... Figure 8 As shown, the display device also includes: a display panel 10; the display panel 10 has a central display area and a peripheral display area surrounding the central display area; and a pupil information acquisition circuit 20 (the specific structure of which is shown in the figure). Figure 2 and Figure 6 (As shown) The pupil information acquisition circuit 20 can be placed in the central display area to accommodate a larger number of pupil information acquisition circuits, thereby improving the accuracy of pupil information acquisition. The pupil information acquisition circuit 20 can also be placed in the peripheral display area, using an optical structure to reflect light containing pupil information and illuminate the peripheral display area. Figure 8The diagram only shows the case where the pupil information acquisition circuit 20 is located in the peripheral display area. Specifically, the display device provided in this embodiment can be a virtual reality display technology or an augmented reality display device. The implementation principle and beneficial effects of the display device used in this embodiment are the same as the implementation principle and beneficial effects of the pupil information acquisition circuit provided in any of the above embodiments, and will not be repeated here.
[0077] Thirdly, this disclosure provides a pupil information acquisition method, which can be applied to the pupil information acquisition circuit provided in any of the above embodiments. Figure 9 This is a flowchart illustrating a pupil acquisition method provided in an embodiment of the present disclosure, as shown below. Figure 9 As shown, the pupil information acquisition method includes the following steps:
[0078] S901 stores the control signals into the shift register according to preset rules.
[0079] S902, according to the control signal, control m infrared light sensors connected to the same analog-to-digital converter to collect pupil information according to a preset rule.
[0080] In the pupil information acquisition method provided in this embodiment, each of the m infrared light sensors can reuse the same analog-to-digital converter (ADC). The control signal is adjusted via a shift register and a multiplexing sub-circuit to achieve signal channel multiplexing. Therefore, the number of ADCs in the pupil information acquisition circuit can be reduced, thereby reducing the area occupied by the ADCs.
[0081] In some embodiments, step S902 may specifically include: scanning m infrared light sensors sequentially according to a control signal; if one of the m infrared light sensors collects pupil information, then the remaining m-1 infrared light sensors are turned off, and only the corresponding light sensor is used to collect pupil information.
[0082] At any given time, only one infrared sensor can collect the user's pupil information. The multiplexing sub-circuit can control the signal transmission between the infrared sensor and the analog-to-digital converter, while the other infrared sensors are turned off. This allows for centralized collection of pupil information, ensuring efficiency while reducing energy consumption.
[0083] It is understood that the above embodiments are merely exemplary embodiments used to illustrate the principles of this disclosure, and this disclosure is not limited thereto. For those skilled in the art, various modifications and improvements can be made without departing from the spirit and substance of this disclosure, and these modifications and improvements are also considered to be within the scope of protection of this disclosure.
Claims
1. A pupil information acquisition circuit, wherein, The pupil information acquisition circuit includes: M infrared light sensors, N analog-to-digital converters, and N multiplexing sub-circuits; M and N are both positive integers, and M is greater than N; Each of the m infrared sensors is connected to the same analog-to-digital converter through one of the multiplexing sub-circuits; m is less than or equal to M; Among the m infrared light sensors connected to the same analog-to-digital converter, the distance between the acquisition ranges of any two adjacent infrared light sensors is greater than the diameter of the pupil; The multiplexing sub-circuit includes: a shift register and a data selector; The shift register is connected to the control signal terminal and the data selector, and is configured to store the control signal corresponding to the analog-to-digital converter. The data selector is configured to control m infrared light sensors connected to the same analog-to-digital converter to collect pupil information according to a preset rule based on the control signal. The data selector includes: an encoder and one first information channel and m second information channels connected to the encoder; The first information channel includes: a first transistor and a second transistor; the control electrode of the first transistor is connected to the signal output terminal of the encoder, the first electrode is connected to the first clock signal terminal, and the second electrode is connected to the control electrode of the second transistor; the control electrode of the second transistor is connected to the second electrode of the first transistor, the first electrode is connected to the analog-to-digital converter, and the second electrode is connected to m infrared light sensors. The second information channel includes a third transistor and a fourth transistor; the control electrode of the third transistor is connected to the signal output terminal of the encoder, the first electrode is connected to the second clock signal terminal, and the second electrode is connected to the control electrode of the fourth transistor; the control electrode of the fourth transistor is connected to the second electrode of the third transistor, the first electrode is connected to the analog-to-digital converter, and the second electrode is connected to one corresponding infrared light sensor.
2. The pupil information acquisition circuit according to claim 1, wherein, The multiplexing sub-circuit also includes: m-1 data delay units; The data delay device is configured to sequentially input the scanning signal to the corresponding m infrared light sensors according to a preset rule.
3. The pupil information acquisition circuit according to claim 2, wherein, The data delay unit includes: a fifth transistor, a sixth transistor, a seventh transistor, a first capacitor, a second capacitor, and a resistor; wherein the fifth transistor has the opposite polarity to the sixth transistor and the same polarity to the seventh transistor; The control terminal of the fifth transistor is connected to the second clock signal terminal, the first terminal is connected to the second terminal of the fourth transistor, and the second terminal is connected to one end of the first capacitor; One end of the first capacitor is connected to the second terminal of the fifth transistor, and the other end is connected to the first terminal of the sixth transistor; The control terminal of the sixth transistor is connected to the second clock signal terminal, the first terminal is connected to the other end of the first capacitor, and the second terminal is connected to one end of the second capacitor and the first terminal of the seventh transistor. One end of the second capacitor is connected to the second terminal of the sixth transistor, and the other end is grounded; The control electrode of the seventh transistor is connected to the second clock signal terminal, the first electrode is connected to the second electrode of the sixth transistor, and the second electrode is connected to one end of the resistor and the corresponding infrared light sensor. One end of the resistor is connected to the second terminal of the seventh transistor, and the other end is grounded.
4. The pupil information acquisition circuit according to claim 1, wherein, The infrared light sensor includes an infrared photodiode.
5. The pupil information acquisition circuit according to claim 1, wherein, The analog-to-digital converter is a one-bit analog-to-digital converter.
6. A display device, wherein, The display device includes a pupil information acquisition circuit as described in any one of claims 1 to 5.
7. The display device according to claim 6, wherein, The display device further includes: a display panel; the display panel having a central display area and a peripheral display area surrounding the central display area; The pupil information acquisition circuit is located in the central display area or in the peripheral display area.
8. The display device according to claim 6, wherein, The display device is a virtual reality display technology or an augmented reality display device.
9. A pupil information acquisition method, applied to the pupil information acquisition circuit as described in any one of claims 1 to 5, wherein, The pupil information acquisition method includes: According to preset rules, the control signals are stored in the shift register; According to the control signal, the m infrared light sensors connected to the same analog-to-digital converter are controlled to collect pupil information according to a preset rule.
10. The pupil information acquisition method according to claim 9, wherein, According to the control signal, controlling the m infrared light sensors connected to the same analog-to-digital converter to collect pupil information according to a preset rule includes: According to the control signal, scan m infrared light sensors sequentially; If one of the m infrared light sensors collects pupil information, then the remaining m-1 infrared light sensors are turned off, and only the corresponding one light sensor is used to collect pupil information.
Citation Information
Patent Citations
Fine-grained human body fatigue detection method based on embedded device and device thereof
CN111281403A
Low-cost massive sensor signal processing system
CN210321828U