Integrated drive apparatus and method of operation thereof

Abstract

An integrated driver device and an operating method thereof are provided. The integrated driver device includes a touch sensing circuit and an optical sensing circuit. The touch sensing circuit is configured to perform touch sensing in a plurality of touch sensing periods during a first frame. The optical sensing circuit is configured to perform optical sensing in at least one optical sensing period during the first frame to obtain an optical sensing signal for generating first ambient light information. The plurality of touch sensing periods and the at least one optical sensing period are non-overlapping.

Description

Technical Field

[0001] This invention relates to an integrated driving device configured to perform under-display fingerprint recognition. In particular, the under-display fingerprint recognition module in the integrated driving device can also be configured to detect ambient light. Background Technology

[0002] An ambient light sensor on an electronic device is used to sense the intensity of ambient light. These devices include mobile phones and other handheld electronic devices. For example, in a mobile phone, the ambient light sensor is typically located near the earpiece. The phone can automatically adjust the screen brightness based on the sensed ambient light information to maintain optimal visual quality while conserving power. The ambient light sensor can also be used in conjunction with other sensors to detect whether the phone is in a pocket, preventing accidental touches. Summary of the Invention

[0003] The optical sensing circuit of the integrated driving device of the present invention, used to perform under-display fingerprint recognition, can also be used to collect ambient light information.

[0004] This invention proposes an integrated driving device. The integrated driving device includes a touch sensing circuit and an optical sensing circuit. The touch sensing circuit is configured to perform touch sensing during multiple touch sensing periods within a first frame. The optical sensing circuit is configured to perform optical sensing during at least one optical sensing period within the first frame to obtain an optical sensing signal for generating first ambient light information. The multiple touch sensing periods and the at least one optical sensing period do not overlap.

[0005] This invention proposes an operation method for an integrated driving device. The integrated driving device includes a touch sensing circuit and an optical sensing circuit. The operation method includes: performing touch sensing by the touch sensing circuit during multiple touch sensing periods in a first frame; and performing optical sensing by the optical sensing circuit during at least one optical sensing period in the first frame to obtain an optical sensing signal for generating first ambient light information. The multiple touch sensing periods and the at least one optical sensing period do not overlap.

[0006] The optical sensing circuit of the integrated driving device of the present invention can be used to perform ambient light sensing. In this way, it is unnecessary to install an ambient light sensor in the handheld electronic device.

[0007] To make the above content easier to understand, several embodiments accompanied by the accompanying drawings are described in detail below. Attached Figure Description

[0008] The accompanying drawings, included to provide a further understanding of the invention, are incorporated in and constitute a part of this specification. The drawings illustrate exemplary embodiments of the invention and, together with the specification, serve to explain the principles of the invention.

[0009] Figure 1 This is a block diagram showing the system of the handheld electronic device of the present invention.

[0010] Figure 2 This is a schematic diagram that partially shows the circuitry of the sensing pixel array of the present invention.

[0011] Figure 3 This is a timing diagram of display driving, touch sensing, and optical sensing according to an embodiment of the present invention.

[0012] Figure 4 This is a timing diagram of display driving, touch sensing, and ambient light sensing according to an embodiment of the present invention.

[0013] Figure 5A This is a timing diagram of display driving, touch sensing, and ambient light sensing according to an embodiment of the present invention.

[0014] Figure 5B This is a timing diagram of display driving, touch sensing, and ambient light sensing according to an embodiment of the present invention.

[0015] Figure 6 This is a timing diagram of display driving, touch sensing, and ambient light sensing according to an embodiment of the present invention.

[0016] Figure 7A and Figure 7B These are timing diagrams for display driving, touch sensing, fingerprint sensing, and ambient light sensing, respectively, according to an embodiment of the present invention.

[0017] Figure 8 This is a schematic diagram showing the sensing area of ​​the sensing pixel array of a touch display panel according to an embodiment of the present invention.

[0018] Figure 9A It is based on the present invention Figure 8 A timing diagram of ambient light sensing in multiple sensing areas of the sensing pixel array in an embodiment.

[0019] Figure 9B This is a timing diagram of ambient light sensing in multiple sensing areas of a sensing pixel array according to an embodiment of the present invention.

[0020] Figure 10 This is a schematic block diagram showing a GOA circuit according to an embodiment of the present invention.

[0021] Figure 11A and Figure 11BEach of these is a schematic diagram illustrating the relationship between multiple light sensing cycles and corresponding sensing areas according to an embodiment of the present invention.

[0022] Figure 12A and Figure 12B Each of these is a schematic diagram illustrating the relationship between multiple light sensing cycles and corresponding sensing areas according to an embodiment of the present invention.

[0023] Figure 13 This is a schematic diagram showing ambient light sensing in multiple regions of a sensing pixel array according to an embodiment of the present invention.

[0024] Figure 14A This is a timing diagram of ambient light sensing according to an embodiment of the present invention.

[0025] Figure 14B This is a timing diagram of ambient light sensing according to an embodiment of the present invention.

[0026] Figure 15 This is a schematic waveform diagram illustrating the "fast skip" operation according to an embodiment of the present invention.

[0027] Figure 16 This is a flowchart of an operation method of an integrated drive device according to an embodiment of the present invention. Detailed Implementation

[0028] Reference will now be made in detail to exemplary embodiments of the invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same component reference numerals are used in the drawings and description to denote the same or similar parts.

[0029] In this invention, the aim is to perform ambient light sensing using an under-display optical sensor, and more particularly, an under-display fingerprint sensor. This eliminates the need for a separate ambient light sensor in handheld electronic devices.

[0030] Figure 1 This is a block diagram illustrating a system for the handheld electronic device of the present invention. (Refer to...) Figure 1The handheld electronic device 100 of the present invention includes a touch display panel 110, an integrated driver chip 120, and an application processor (AP) 130. Multiple under-display optical sensors are placed in a stacked structure of the touch display panel 110 to form an optical sensing pixel array (not shown). The integrated driver chip 120 includes an optical sensing circuit 121 and a Touch and Display Driver Integration (TDDI) circuit 122, which are integrated. The TDDI circuit 122 includes a touch sensing circuit 1221 and a display driver circuit 1222. The optical sensing circuit 121 can be used for fingerprint sensing, in which case the optical sensing pixel array in the touch display panel 110 is suitable for fingerprint sensing. However, in other embodiments, the optical sensing circuit 121 and the TDDI circuit 122 may also be separate chips, and the present invention is not limited thereto.

[0031] In the application of fingerprint sensing, the optical sensing pixel array in the touch display panel 110 receives reflected light from the finger, and the optical sensing circuit 121 reads the fingerprint sensing signal from the optical sensing pixel array and generates digital sensing data accordingly. In this invention, the optical sensing circuit 121 can be configured to perform optical sensing, including fingerprint sensing and ambient light sensing, and both the fingerprint sensing signal and the ambient light sensing signal are referred to as optical sensing signals.

[0032] In fingerprint sensing applications, digital sensing data generated by the optical sensing circuit 121 is transmitted to the application processor 130 of the handheld electronic device 100 via a Serial Peripheral Interface (SPI) bus. The application processor 130 can then generate one or more fingerprint images and perform fingerprint recognition accordingly. The TDDI circuit 122 transmits data via an integrated circuit bus (I... 2 The TDDI circuit 122 reports the touch coordinates to the application processor 130 via the C-bus and receives display data sent by the application processor 130 through the Mobile Industrial Processor Interface (MIPI). Simultaneously, the TDDI circuit 122 outputs a control signal to the optical sensing circuit 121 to control the optical sensing circuit 121 to read the fingerprint sensing signal. Considering that the optical sensing pixels are used for ambient light sensing, the ambient light sensing operation is basically the same as the fingerprint sensing operation, both including reset, exposure, and readout processes. The optical sensing circuit 121 is only turned on during optical sensing and is turned off at other times.

[0033] Figure 2 This is a schematic diagram partially showing the circuitry of the sensing pixel array of the present invention. (Refer to...) Figure 2The sensing pixel array in the touch display panel 110 includes multiple fingerprint sensors FC. Each fingerprint sensor FC includes a photosensitive component PD, a capacitor C, and transistors M1 to M3. The photosensitive component PD is configured to convert light signals into electrical signals. The photosensitive component PD is reverse biased between node N1 and a reference voltage Vref, and the capacitor C is also coupled between node N1 and the reference voltage Vref. Transistor M1 is controlled by a selection signal Sel, which selects the fingerprint sensor FC, allowing the output voltage Vout, as the sensing signal, to be read through the sensing line. Transistor M2 acts as a source follower. Transistor M3 is controlled by a reset signal Rest, resetting the voltage at the gate of source follower transistor M2 (i.e., node N1) to the operating voltage VDD. Transistor M4 acts as a current source, controlled by a bias voltage Vbias. When the photosensitive component PD is exposed to light, the capacitor C begins to discharge, causing the voltage at node N1 to drop. By turning on transistor M1, the output voltage Vout, which follows the voltage at node N1, is read out.

[0034] In one embodiment, a fingerprint sensor is embedded in a touch display panel 110 (e.g., an LCD panel). Pixel data voltage output and optical sensing signal input may share pins of an integrated driver chip 120. The integrated driver chip 120 performs display driving and optical sensing in a time-division multiplexing manner and provides switching signals to switch the connection between the sensing line or data line and the integrated driver chip 120. The optical sensing circuit 121 is also configured to provide timing control signals (including clock signals, start pulse signals, etc.) to the gate-on-array (GOA) driver circuitry on the touch display panel 110 to generate gate control signals for the sensing pixel array. Regarding fingerprint sensing, the optical sensing circuit 121 is configured to output multiple start pulse signals to the GOA circuitry on the touch display panel 110, and the GOA circuitry is configured to generate multiple reset signals and multiple select signals for multiple fingerprint sensing pixel rows in each of multiple sensing areas of the sensing pixel array. For each sensing area, the reset signals are used to sequentially reset the fingerprint sensing pixel rows of the sensing area, while the readout signals are used to sequentially read out the fingerprint sensing signals of the corresponding sensing pixels. In this way, the fingerprint sensing pixel rows can be controlled to perform procedures such as reset, exposure, and readout. Each fingerprint sensing pixel row begins exposure immediately after the reset operation is completed, and begins the readout operation after the exposure is completed, thereby generating a fingerprint sensing signal.

[0035] Figure 3 This is a timing diagram of display driving, touch sensing, and optical sensing according to an embodiment of the present invention. Figure 3 In this context, DP represents the display frame period during which the display driver is active, TP represents the touch frame period during which the touch sensor is active, and LP represents the display frame period during which the display driver is inactive (standby) and the optical sensor is active. (See also: [link to reference]) Figure 1 and Figure 3 Before fingerprint recognition, the application processor 130 can send a wake-up command to the optical sensing circuit 121 (see fine dashed line 101). The application processor 130 can also send a frame skipping command to the TDDI circuit 122 (see fine dashed line 102) to put the TDDI circuit 122 into frame skipping mode. FPR_EN represents the signal sent from the TDDI circuit 122 to the optical sensing circuit 121, informing the optical sensing circuit 121 when optical sensing can be performed. During the time interval when the signal FPR_EN is at a high voltage level, display driving and touch sensing are stopped and in standby mode. During the time interval when the signal FPR_EN is at a low voltage level, display driving and touch sensing are activated. By detecting the signal FPR_EN, the optical sensing circuit 121 can collect optical information during the time interval when the signal FPR_EN is at a high voltage level, thereby avoiding interference from display driving and touch sensing. After one or more fingerprint sensing cycles have been completed, the optical sensing circuit 121 sends an interrupt request (IRQ) signal to notify the application processor 130 (see dashed line 103) and returns to the standby state. At this point, the application processor 130 can instruct the TDDI circuit 122 to return to the active state.

[0036] It is worth noting that the frame skipping mode is a mode in which the TDDI circuit 122 performs display driving and touch sensing for N consecutive active periods and then enters M consecutive skipping periods, where N and M are each positive integers. During the M skipping periods, at least one of display driving and touch sensing is stopped, while the optical sensing circuit 121 can perform optical sensing during the M skipping periods. Simply put, after entering the frame skipping mode, the TDDI circuit 122 can first enter N active periods and then enter M skipping periods. Alternatively, the TDDI circuit 122 can also first enter M skipping periods and then enter N active periods.

[0037] In this invention, the optical sensing circuit 121 can perform not only fingerprint sensing but also ambient light sensing (commonly referred to as optical sensing). In one embodiment of the invention, neither display driving nor touch sensing is activated during optical sensing. In another embodiment of the invention, display driving is inactive during optical sensing, but touch sensing is still performed, and touch sensing and optical sensing are temporally regional. Reset and readout operations of optical sensing need to be performed during optical sensing, but are not limited to being completed within the same optical sensing period. The details of the display driving, touch sensing, and optical sensing (including fingerprint sensing and ambient light sensing) of the present invention will be described below using several embodiments. In the following embodiments, DP, TP, and LP represent the display driving period, touch sensing period, and optical sensing period, respectively. Depending on the different tasks assigned to the sensing pixel array, the term "optical sensing period" may refer to the fingerprint sensing period FP or the ambient light sensing period LS.

[0038] Figure 4 This is a timing diagram of display driving, touch sensing, and ambient light sensing according to an embodiment of the present invention. Figure 4 In this context, SYNC1 represents a frame synchronization signal, configured to indicate the start of a frame period, such as frames F1 to F4. SYNC2 represents a touch synchronization signal, configured to indicate a touch sensing period. In this embodiment, the period when the touch synchronization signal SYNC2 is at a high voltage level corresponds to the touch sensing period TP, while the period when the touch synchronization signal SYNC2 is at a low voltage level corresponds to the display driving period DP. The TDDI circuit 122 is also configured to generate a signal FPR_EN to notify the optical sensing circuit 121 that the ambient light sensing period LS can be performed.

[0039] Reference Figure 1 and Figure 4 In normal display mode with the backlight on, some touch sensing periods are used as ambient light sensing periods. For example... Figure 4As shown, the touch sensing period TP and the display driving period DP are mutually configured time sensing zones. The period from positions 401 to 404 is not used for touch sensing but serves as the ambient light sensing period LS. The TDDI circuit 122 outputs the signal FPR_EN to the optical sensing circuit 121 to notify the optical sensing circuit 121 that ambient light sensing can be performed during the period from positions 401 to 404 (i.e., the ambient light sensing period LS). During the ambient light sensing period LS, touch sensing is suspended, which prevents interference with the results of ambient light sensing. Based on the signal FPR_EN, the optical sensing circuit 121 also provides start pulse signals for different sensing zones and one or more clock signals to the GOA circuit on the touch display panel 110, so that the GOA circuit generates reset signals and selection signals for the ambient light sensing period, which includes reset, exposure, and readout operations. Thus, ambient light information can be obtained. Furthermore, although periods 401 to 404 are available, the present invention does not limit the number of available periods for ambient light sensing.

[0040] Figure 5A This is a timing diagram of display driving, touch sensing, and ambient light sensing according to an embodiment of the present invention. Figure 5A In the normal display mode with the backlight on, ambient light sensing is performed during the porch period P. The porch period P can be the pre-porch period between the end of the last data block (which can be display data or touch-sensitive data) of the previous frame period and the frame synchronization (Vsync) pulse of the current frame period. Alternatively, the porch period can be the post-porch period between the frame synchronization (Vsync) of the current frame period and the beginning of the first data block (which can be display data or touch-sensitive data) of the current frame period. Alternatively, the porch period P can be a combination of the pre-porch period and the post-porch period. Similarly, the TDDI circuit 122 outputs the signal FPR_EN to the optical sensing circuit 121 to notify the optical sensing circuit 121 of the period during which ambient light sensing (i.e., the ambient light sensing period LS) can be performed. Based on the signal FPR_EN, the optical sensing circuit 121 provides start pulse signals for different sensing zones and one or more clock signals to the GOA circuit on the touch display panel 110, so that the GOA circuit generates reset and selection signals for the ambient light sensing cycle, which includes reset, exposure, and readout operations. Ambient light information can thus be obtained. The number of available porch periods for ambient light sensing is not limited in this invention.

[0041] The length of the porch period P used for ambient light sensing is determined by the application processor 130. Figure 5B This is a timing diagram of display driving, touch sensing, and ambient light sensing according to an embodiment of the present invention. Figure 5B The length of the porch period P (see position 501) in frame period F2 is significantly longer than Figure 5AThe length of the porch period P in frame period F2. Figure 5A and Figure 5B In the illustrated embodiment, the porch period P within each frame period is configured for ambient light sensing. However, in other embodiments, ambient light sensing may also be performed periodically in M ​​porch periods P (whether consecutive or not) within every N frame periods.

[0042] Figure 6 This is a timing diagram of display driving, touch sensing, and ambient light sensing according to an embodiment of the present invention. (Refer to...) Figure 6 In the idle mode with the backlight off (meaning that the application processor 130 can enter a power-saving mode, and the display driver circuit 122 can also enter a power-saving mode), the touch sensing circuit 1221 is active, but the display driver circuit 1222 is inactive. Compared to the normal display mode with the backlight on, the frequency of touch sensing performed during the idle period may be reduced. In this embodiment, any period other than the touch sensing period TP can be used as the ambient light sensing period LS. In this embodiment, the TDDI circuit 122 outputs the signal FPR_EN to the optical sensing circuit 121 to notify the optical sensing circuit 121 of the period during which ambient light sensing can be performed. Based on the signal FPR_EN, the optical sensing circuit 121 provides start-up pulse signals and one or more clock signals for different sensing areas to the GOA circuit on the touch display panel 110 so that the GOA circuit generates reset signals and selection signals for the ambient light sensing period, which includes reset, exposure, and readout operations. Thus, ambient light information can be obtained. Although the signal FPR_EN in Figure 6 There is no marking in the text, but as mentioned above, the start point and length of LS during the ambient light sensing cycle can be determined by the application processor 130, and the application processor 130 can notify the TDDI circuit 122 to generate the signal FPR_EN.

[0043] Figure 7A and Figure 7B These are timing diagrams for display driving, touch sensing, fingerprint sensing, and ambient light sensing, respectively, according to an embodiment of the present invention. Similarly, the signal FPR_EN in... Figure 7A and Figure 7B There are no markings. See also: [reference needed] Figure 7A and Figure 7BDuring normal display mode, application processor 130 can send a wake-up command to optical sensing circuit 121 before fingerprint recognition. Additionally, application processor 130 can send a frame skipping command to TDDI circuit 122, causing TDDI circuit 122 to enter frame skipping mode. In this embodiment, fingerprint sensing is performed during a skipped period in frame skipping mode (e.g., its length is equivalent to two frame periods). In this embodiment, prior to fingerprint sensing, TP is occupied (meaning touch sensing is disabled) during one or more touch sensing periods (e.g., frame periods F2 and F3) to sense ambient light. Figure 7A In this context, ambient light sensing is performed during the ambient light sensing period LS in each frame's F2 and F3 periods. Figure 7B In this process, ambient light sensing is performed only during the ambient light sensing period LS within frame F2, which is two frame periods earlier than fingerprint sensing. Based on the ambient light information reported by the optical sensing circuit 121, the application processor 130 knows in advance whether the handheld electronic device 100 is in a bright or dark environment. Therefore, the application processor 130 can determine the length of the fingerprint sensor's exposure period in the subsequent fingerprint sensing phase. In cases where multiple ambient light sensing periods LS exist (e.g....), Figure 7A As shown, the application processor 130 can also calculate the ambient light information detected during multiple ambient light sensing periods (LS) to determine the length of the exposure period of the fingerprint sensor. In one embodiment, the ambient light information can also serve as the basis for adjusting the backlight brightness level of the touch display panel 110.

[0044] In detail, the optical sensing circuit 121 reports ambient light information (whether acquired in idle mode or normal display mode) after completing the readout operation. This allows the handheld electronic device 100 to know in advance whether the ambient light is strong or weak, and then dynamically determine the appropriate exposure period length for the fingerprint sensing cycle. If the ambient light is strong, a shorter exposure period can be set to avoid obtaining an overexposed fingerprint image. If the ambient light is weak, a longer exposure period can be set to avoid obtaining an insufficiently recognizable fingerprint image.

[0045] Figure 8 This is a schematic diagram showing the sensing area of ​​the sensing pixel array of a touch display panel according to an embodiment of the present invention. (Refer to...) Figure 8The sensing pixel array is divided into seven sensing areas 111_1 to 111_7 from top to bottom along the scanning direction D1. Each sensing area includes multiple fingerprint sensing pixel rows. AGO[1] to AGO[7] represent control signals provided from the optical sensing circuit 121 to the GOA circuit on the touch display panel, corresponding to the sensing area. Each control signal in AGO[1] to AGO[7] is configured to simultaneously reset or read out all fingerprint sensing pixel rows of its respective sensing area. In this embodiment, only one sensing area, such as sensing area 111_2, is configured for ambient light detection. During fingerprint sensing, all fingerprint sensing pixel rows of sensing area 111_2 are simultaneously opened (i.e., reset and read out) via the GOA circuit on the control panel. In other words, the fingerprint sensing pixel rows of sensing area 111_2 are reset at the same time, and then read out at the same time. In this case, the ambient light sensing signal read back through the sensing line is the sum of the ambient light sensing signals of multiple fingerprint sensing pixel rows. Ambient light information can be obtained by calculating the average brightness of the read-back ambient light sensor signal.

[0046] Figure 9A It is based on the present invention Figure 8 A timing diagram of ambient light sensing in multiple sensing areas of the sensing pixel array in an embodiment. Figure 9ASTV[1] to STV[7] represent the start pulse signals provided by the optical sensing circuit 121 to the GOA circuit, corresponding to the first sensing area 111_1 to the seventh sensing area 111_7. Each of the control signals AGOR[1] to AGOR[7] is configured to simultaneously reset all fingerprint sensing pixel rows in its respective sensing area. Each of the control signals AGOS[1] to AGOS[7] is configured to simultaneously read out all fingerprint sensing pixel rows in its respective sensing area. This means that different optical sensing signals of different fingerprint sensing pixel rows can be read out simultaneously through the sensing lines, instead of sequentially. Rest[1] to Rest[Y] represent the reset signals generated by the GOA circuit and are provided to the Y fingerprint sensing pixel rows of sensing area 111_2. Sel[1] to Sel[Y] represent the selection signals generated by the GOA circuit and are provided to the Y fingerprint sensing pixel rows of sensing area 111_2. Since only sensing area 111_2 is used for ambient light sensing, only the activation pulse signal STV[2] has an active activation pulse, and only the control signals AGOR[2] and AGOS[2] have active pulses. Activation pulse signals STV[1] and STV[3] to STV[7] have no active pulses. Control signals AGOR[1] and AGOR[3] to AGOR[7], and control signals AGOS[1] and AGOS[3] to AGOS[7] have no active pulses. During the ambient light sensing period of frame F_N, the active pulse of control signal AGOR[2] simultaneously pulls Rest[1] to Rest[Y] of sensing area 111_2 to a high level (active level). Thus, during ambient light sensing, all fingerprint sensing pixel rows of sensing area 111_2 are simultaneously reset. Next, by controlling the effective pulse of the signal AGOS[2], during an ambient light sensing period of one frame period F_N+k, where k can be 1 or any integer greater than 1, Sel[1] to Sel[Y] of the sensing area 111_2 are simultaneously pulled high (effective level). In this way, all fingerprint sensing pixel rows of the sensing area 111_2 are read out at the same time. Vout represents the output voltage (i.e., sensing signal) obtained from the sensing line. It can be seen that in order to perform ambient light sensing, multiple frame periods (frame period F_N to frame period F_N+k) are required due to the long exposure period. Taking K equal to 1 as an example, the requirement of two frame periods means that the end of the exposure period is within the second frame period, not that the exposure period occupies the entire two frame periods.

[0047] Nevertheless, the invention is not limited thereto. In other embodiments, any number and any location of fingerprint sensing pixel rows can be configured to be turned on simultaneously (i.e., reset and readout). For example, the fingerprint sensing pixel rows of the second sensing area 111_2 and the fifth sensing area 111_5 can be turned on simultaneously. Alternatively, the fingerprint sensing pixel rows of the second sensing area 111_2, the fourth sensing area 111_4, and the sixth sensing area 111_6 can be turned on simultaneously. Furthermore, in this invention, the number of ambient light sensing periods (LS) used for ambient light sensing within a frame period is not limited. However, at least one ambient light sensing period (LS) is required.

[0048] Figure 9B This is a timing diagram of ambient light sensing in multiple sensing areas of a sensing pixel array according to an embodiment of the present invention. Figure 9B This is also a further description Figure 8 The implementation scheme shown. The only difference between the two is that, in Figure 9B In this context, exposure is completed within one frame. (See reference...) Figure 9B The fingerprint sensor in the second sensing area 111_2 requires a shorter exposure period TE, so that an ambient light sensing cycle can be completed in just one frame period F_N.

[0049] Figure 10 This is a schematic block diagram showing a GOA circuit according to an embodiment of the present invention. (Refer to...) Figure 10 The touch display panel 110 is provided with a sensing pixel array 111 and a GOA circuit. The GOA circuit 112, located to the left of the sensing pixel array 111, represents one of several similar circuits used to generate a reset signal associated with a sensing area. Several circuits are also located to the right of the sensing pixel array 111, each similar to the GOA circuit 112, used to generate a selection signal associated with a sensing area. The GOA circuit 112 includes several shift register circuits. For example, the GOA circuit 112, based on the start pulse signal STV[2], the reset control signal AGOR[2], the first shift direction control signal U2D enabling the top-to-bottom direction, and the second shift direction control signal D2U enabling the bottom-to-top direction, sends a selection signal to the sensor. Figure 10 The second sensing area 111_2 outputs multiple reset signals from its sensing pixel row, including SR[n-1], SR[n], SR[n+1], etc. These two shift direction control signals are provided by the light sensing circuit 121 and are configured to control the shift register circuit of the GOA circuit 112 to output valid pulses sequentially downwards or upwards. In order to perform ambient light sensing, the reset signals SR[n-1], SR[n], SR[n+1] and all other reset signals related to the sensing area 111_2 are simultaneously pulled high (i.e., pulled to an effective level) by the reset control signal AGOR[2], thus enabling the realization of... Figure 9A or Figure 9B Such a reset operation timing. The reset signal Rest can be used to reset the GOA circuit 112 relative to the second sensing area 111_2.

[0050] To prevent inconsistent performance degradation among fingerprint sensors, the position of the sensing area used in different ambient light sensing cycles can be changed, for example... Figure 11A and Figure 11B The example shown. Figure 11A and Figure 11B Each of the above is a schematic diagram illustrating the relationship between multiple photosensitive cycles and corresponding sensing areas according to an embodiment of the present invention. A sensing pixel array can be divided into multiple sensing areas in both horizontal and vertical directions. Scan1 to ScanN represent multiple photosensitive cycles (or scan cycles) executed sequentially, each of Scan1 to ScanN being marked at the position of a corresponding photosensitive area. Figure 11A In the example, the optical sensing circuit 121 can initiate a first light sensing cycle Scan1 during the first frame period to generate first ambient light information, and initiate a second optical sensing cycle Scan2 during the second frame period (different from the first frame period) to generate second ambient light information, and so on. Since the sensing pixel array is divided not only vertically but also horizontally, the optical sensing circuit 121 can receive sensing signals from different sensing line groups for different ambient light sensing cycles. Figure 11A In the example, the sensing area is used from left to right and from top to bottom. The sensing areas can be completely different or partially different. Figure 11B This explains that the positions of the sensing areas used in each ambient light sensing cycle vary in different ways. The sensing areas in each row are used alternately from top to bottom, meaning that the sensing areas in odd-numbered rows are used sequentially from top to bottom, and then the sensing areas in even-numbered rows are used sequentially from top to bottom. Regarding the sensing areas in each row (whether odd or even), the positions of the sensing areas used in each ambient light sensing cycle change from left to right. The positions of the sensing areas used in each respective light sensing cycle can change sequentially or randomly.

[0051] Figure 12A and Figure 12B Each of these is a schematic diagram illustrating the relationship between multiple photosensitive cycles and corresponding sensing areas according to an embodiment of the present invention. Figure 12A and Figure 12B In this example, three sensing areas are used horizontally in each photosensing cycle. Scan1 to ScanN represent multiple photosensing cycles (or scan cycles) executed sequentially, and each of Scan1 to ScanN is marked at the position of its corresponding photosensitive area. (See reference...) Figure 12A The position of the sensing area used in each ambient light sensing cycle changes from top to bottom. (Refer to...) Figure 12BThe positions of the sensing areas used in each ambient light sensing cycle alternate from top to bottom, meaning that odd-numbered sensing areas are used sequentially from top to bottom, followed by even-numbered sensing areas. The positions of the sensing areas used in each respective light sensing cycle can change sequentially or randomly.

[0052] Figure 13 This is a schematic diagram illustrating ambient light sensing in multiple regions of a sensing pixel array according to an embodiment of the present invention. (Refer to...) Figure 13 Each sensing region 111_1 to 111_7 includes Y rows of fingerprint sensing pixels (Y is a positive integer), and a portion of the fingerprint sensing pixel rows in each sensing region are used for ambient light sensing. In this embodiment, only rows 1 to 3 of the fingerprint sensing pixel rows in each sensing region are used for ambient light sensing, and they can be designed to be activated sequentially or simultaneously. For each fingerprint sensing channel of the optical sensing circuit 121, the sensing signal obtained during a readout period can include a summary of the sensing results of multiple fingerprint sensing pixel rows. The optical sensing circuit 121 can perform average brightness calculation on the read-back sensing signal to obtain ambient light information.

[0053] Figure 14A This is a timing diagram of ambient light sensing according to an embodiment of the present invention. Figure 14A Further description Figure 13 In the illustrated embodiment, the first row of fingerprint sensing pixels in each sensing area is simultaneously activated by activation pulse signals STV[1] to STV[7], each activation pulse signal having a valid pulse. Reset signals Rest[1] to Rest[3] have valid pulses, thus resetting the first to third rows of fingerprint sensing pixels in each sensing area sequentially. Reset signals Rest[4] to Rest[Y] have no active pulses. Selection signals Sel[1] to Sel[3] have valid pulses, causing the first to third rows of fingerprint sensing pixels in each sensing area to be read out sequentially. Selection signals Sel[4] to Sel[Y] have no active pulses. As shown, the exposure period required for ambient light sensing is long enough that the readout operation cannot be completed within the same time period as the reset operation. Figure 14B This is a timing diagram of ambient light sensing according to an embodiment of the present invention. Figure 14B This is also a further description Figure 13 The embodiment shown. With Figure 14A In comparison, Figure 14B In this system, the exposure period required for ambient light sensing is very short, so that the reset and readout operations of the ambient light sensing cycle can be completed within a frame period F1.

[0054] In addition, the "Quick Skip" feature can be further integrated into... Figure 13 In the illustrated embodiment, the function of "quick skip" is to quickly scan unused rows of sensing pixels. Figure 15 This is a schematic waveform diagram illustrating the "fast skip" operation according to an embodiment of the present invention. (Refer to...) Figure 15 After the start pulse signal STV[X] is pulled up, the rows of sensing pixels are scanned. In one implementation, X is a positive integer, 1 ≤ X ≤ 7. It can be seen that the width of each pulse of the clock signal CLK in scan intervals SC1 and SC3 is reduced, allowing for rapid scanning of unused rows of sensing pixels. In scan interval SC2, the width of each pulse of the clock signal CLK remains normal, allowing for proper scanning of used rows of sensing pixels. Furthermore, the rows of fingerprint sensing pixels scanned within the same sensing area can be different (or not exactly the same) each time, to prevent excessive differences in performance degradation between fingerprint sensing pixels and other areas caused by long-term, fixed-position detection.

[0055] Figure 16 This is a flowchart illustrating an operation method of an integrated drive device according to an embodiment of the present invention. (See also:) Figure 1 and Figure 16 The integrated driving device includes at least an optical sensing circuit 121 and a touch sensing circuit 1221. In step S110, the touch sensing circuit 1221 performs touch sensing during multiple touch sensing periods within the first frame. In step S120, the optical sensing circuit 121 performs optical sensing during at least one optical sensing period within the first frame to obtain an optical sensing signal for generating first ambient light information. The touch sensing periods and optical sensing periods do not overlap.

[0056] In terms of hardware, the application processor 130, optical sensing circuit 121, touch sensing circuit 1221, and display driver circuit 1222 can be logic circuits implemented on integrated circuits. The related functions of the application processor 130, optical sensing circuit 121, touch sensing circuit 1221, and display driver circuit 1222 can be implemented in hardware using a hardware description language (e.g., Verilog HDL or VHDL) or other suitable programming languages. For example, the related functions of the application processor 130, optical sensing circuit 121, touch sensing circuit 1221, and display driver circuit 1222 can be implemented in various logic blocks, modules, and circuits of one or more controllers, microcontrollers, microprocessors, application-specific integrated circuits (ASICs), digital signal processors (DSPs), field-programmable gate arrays (FPGAs), and / or other processing units.

[0057] Regarding software and / or firmware, the functions of the application processor 130, optical sensing circuit 121, touch sensing circuit 1221, and display driver circuit 1222 can be implemented as program code. For example, the application processor 130, optical sensing circuit 121, touch sensing circuit 1221, and display driver circuit 1222 can be implemented using a general programming language (e.g., C, C++, or assembly language) or other suitable programming languages. The program code can be recorded / stored in a recording medium, including, for example, read-only memory (ROM), storage devices, and / or random access memory (RAM). A computer, central processing unit (CPU), controller, microcontroller, or microprocessor can read and execute the program code from the recording medium to implement the relevant functions. A "non-transitory computer-readable medium," such as magnetic tape, disk, card, semiconductor memory, programmable logic circuit, etc., can serve as a recording medium. Furthermore, the program can also be provided to the computer (or CPU) via any transmission medium (communication network, broadcast radio waves, etc.). This communication network is, for example, the Internet, wired communication, wireless communication, or other communication media.

[0058] In summary, the under-display fingerprint sensor of the present invention can be configured to perform not only fingerprint sensing but also ambient light sensing (commonly referred to as optical sensing). Furthermore, the backlight brightness of the handheld electronic device's screen can be dynamically adjusted based on the sensed ambient light information. Additionally, the length of the subsequent fingerprint recognition exposure period can be dynamically adjusted based on the sensed ambient light information. In this way, it is unnecessary to include a separate ambient light sensor in the handheld electronic device, and various applications can be performed based on the perceived ambient light information.

[0059] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. An integrated drive apparatus, characterized by, comprises: touch sensing circuitry configured to perform touch sensing in a plurality of touch sensing periods during a first display frame; and optical sensing circuitry configured to perform optical sensing in at least one optical sensing period during the first display frame to obtain an optical sensing signal for generating first ambient light information, wherein the plurality of touch sensing periods and the at least one optical sensing period are non-overlapping.

2. The integrated drive device of claim 1, wherein, The integrated driving device further comprises display driving circuitry configured to output data voltages in a plurality of display periods during the first display frame, wherein the plurality of display periods, the plurality of touch sensing periods and the at least one optical sensing period are non-overlapping.

3. The integrated drive device of claim 1, wherein, The integrated driving device further comprises display driving circuitry configured to output data voltages in a plurality of display periods during the first display frame, wherein the plurality of display periods and a plurality of sensing periods are arranged alternately, and wherein the plurality of touch sensing periods are part of the plurality of sensing periods, and the at least one optical sensing period is another part of the plurality of sensing periods.

4. The integrated drive device of claim 1, wherein, The integrated driving device further comprises display driving circuitry configured to output data voltages in a plurality of display periods during the first display frame, and not output data voltages in a porch period during the first display frame, and wherein the at least one optical sensing period and the porch period are overlapping.

5. The integrated drive device of claim 1, wherein, further comprising display driving circuitry configured to stop outputting data voltages during the first display frame.

6. The integrated driving device of claim 1, wherein the optical sensing circuitry is capable of performing fingerprint sensing, and is configured to not perform the fingerprint sensing during the first display frame.

7. The integrated drive device of claim 1, wherein, wherein the optical sensing circuitry is further configured to perform fingerprint sensing during a second display frame later than the first display frame according to the first ambient light information generated based on the optical sensing signal.

8. The integrated drive device of claim 7, wherein, wherein the optical sensing circuitry is further configured to determine a length of an exposure period of the fingerprint sensing according to the first ambient light information.

9. The integrated drive device of claim 8, wherein, wherein the length of the exposure period is inversely proportional to a light intensity indicated by the first ambient light information.

10. The integrated drive device of claim 1, wherein, wherein the integrated driving device is further configured to adjust a backlight brightness level according to the first ambient light information.

11. The integrated drive device of claim 1, wherein, wherein the optical sensing circuitry is configured to output a plurality of first control signals and a plurality of second control signals to control circuitry in the touch display panel, and wherein each of the plurality of first control signals is used to control when to simultaneously reset all sensor rows of a sensor region of an optical sensor array in the touch display panel, and each of the plurality of second control signals is used to control when to simultaneously read out the optical sensing signal from the all sensor rows of the sensor region.

12. The integrated drive device of claim 11, wherein, wherein the optical sensing circuitry is configured to output a plurality of start pulse signals to the control circuitry in the touch display panel.

13. The integrated drive device of claim 11, wherein, wherein the optical sensing circuit initiates an optical sensing period for generating the first ambient light information during the first display frame period with respect to the sensor region, and completes the optical sensing period during a second frame period later than the first display frame period.

14. The integrated drive device of claim 11, wherein, wherein the optical sensing circuit initiates an optical sensing period for generating the first ambient light information during the first display frame period with respect to the sensor region, and completes the optical sensing period during the first display frame period.

15. The integrated drive device of claim 11, wherein, wherein the optical sensing circuit initiates a first optical sensing period for generating the first ambient light information during the first display frame period, and initiates a second optical sensing period for generating second ambient light information during a second display frame period different from the first display frame period, and wherein the first optical sensing period and the second optical sensing period are with respect to different sensor regions of the optical sensor array.

16. The integrated drive device of claim 15, wherein, wherein the optical sensing circuit is further configured to receive a first number of the optical sensing signals generated in the first optical sensing period through a first portion of the optical sensing lines in the touch display panel, and to receive a second number of the optical sensing signals generated in the second optical sensing period through a second portion of the optical sensing lines in the touch display panel, and wherein the first portion of the optical sensing lines and the second portion of the optical sensing lines are completely different or partially different.

17. The integrated drive device of claim 1, wherein, wherein the optical sensing circuit is configured to output a plurality of initiation pulse signals corresponding to a plurality of sensing regions to a control circuit in a touch display panel during the first display frame period, wherein the plurality of initiation pulse signals are pulled to an initiation state at the same time, and wherein the control circuit generates a plurality of first control signals for sequentially resetting a first portion of a plurality of sensor rows of a sensor region according to each of the plurality of initiation pulse signals, and a plurality of second control signals for sequentially reading out the optical sensing signals from the first portion of the sensor rows of the sensor region according to each of the plurality of initiation pulse signals.

18. The integrated drive device of claim 17, wherein, wherein the optical sensing circuit initiates an optical sensing period for generating the first ambient light information during the first display frame period with respect to the sensor region, and completes the optical sensing period during a second display frame period later than the first display frame period.

19. The integrated drive device of claim 17, wherein, wherein the optical sensing circuit initiates an optical sensing period for generating the first ambient light information during the first display frame period with respect to the sensor region, and completes the optical sensing period during the first display frame period.

20. The integrated drive device of claim 17, wherein, wherein the optical sensing circuit initiates a first optical sensing period for generating the first ambient light information during the first display frame period, and initiates a second optical sensing period for generating second ambient light information during a second frame period different from the first display frame period, and wherein the first optical sensing period and the second optical sensing period are with respect to different sensor rows of an optical sensor array in the touch display panel.

21. An operating method of an integrated drive apparatus, characterized by, The integrated driving device includes touch sensing circuitry and optical sensing circuitry, and the operation method includes: performing touch sensing by the touch sensing circuitry in a plurality of touch sensing periods during a first display frame; and performing optical sensing by the optical sensing circuitry in at least one optical sensing period during the first display frame to obtain an optical sensing signal for generating first ambient light information, wherein the plurality of touch sensing periods and the at least one optical sensing period are non-overlapping.

22. The method of operating an integrated drive arrangement of claim 21, wherein, wherein the integrated driving device further includes display driving circuitry, and the operation method further includes: outputting data voltages by the display driving circuitry in a plurality of display periods during the first display frame, wherein the plurality of display periods, the plurality of touch sensing periods and the at least one optical sensing period are non-overlapping.

23. The method of operating an integrated drive arrangement of claim 21, wherein, wherein the integrated driving device further includes display driving circuitry, and the operation method further includes: outputting data voltages by the display driving circuitry in a plurality of display periods during the first display frame, wherein the plurality of display periods and a plurality of sensing periods are arranged alternately, and wherein the plurality of touch sensing periods are part of the plurality of sensing periods, and the at least one optical sensing period is another part of the plurality of sensing periods.

24. The method of operating an integrated drive arrangement of claim 21, wherein, The integrated driving device further includes display driving circuitry, and the operation method further includes: outputting data voltages by the display driving circuitry in a plurality of display periods during the first display frame, and not outputting data voltages in a porch period during the first display frame, wherein the at least one optical sensing period and the porch period are overlapping.

25. The method of operating an integrated drive arrangement of claim 21, wherein, wherein the integrated driving device further includes display driving circuitry, and the operation method further includes: stopping outputting data voltages by the display driving circuitry during the first display frame.

26. The method of operating an integrated drive arrangement of claim 21, wherein, wherein the optical sensing circuitry is capable of performing fingerprint sensing, and is configured to not perform the fingerprint sensing during the first display frame.

27. The method of operating an integrated drive arrangement of claim 21, wherein, further including: performing fingerprint sensing by the optical sensing circuitry during a second display frame later than the first display frame, according to the first ambient light information generated based on the optical sensing signal.

28. The method of operating an integrated drive arrangement of claim 27, wherein, further including: wherein the optical sensing circuitry determines a length of an exposure period of the fingerprint sensing according to the first ambient light information.

29. The method of operating an integrated drive arrangement of claim 28, wherein, wherein the length of the exposure period is inversely proportional to a light intensity indicated by the first ambient light information.

30. The method of operating an integrated drive arrangement of claim 21, wherein, further including: adjusting a backlight brightness level by the integrated driving device according to the first ambient light information.

31. The method of operating an integrated drive arrangement of claim 21, wherein, further including: outputting, by the optical sensing circuitry, a plurality of first control signals and a plurality of second control signals to control circuitry in the touch display panel, wherein each of the plurality of first control signals is used to control when to simultaneously reset all sensor rows of a sensor region of an optical sensor array in the touch display panel, and each of the plurality of second control signals is used to control when to simultaneously read out the optical sensing signal from the all sensor rows of the sensor region.

32. The method of operating an integrated drive arrangement of claim 31, wherein, further including: outputting, by the optical sensing circuit, a plurality of start-up pulse signals to the control circuit in the touch display panel.

33. The method of operating an integrated drive arrangement of claim 31, wherein, further comprising: starting, by the optical sensing circuit, an optical sensing period for generating the first ambient light information during the first display frame period with respect to the sensor region, and completing the optical sensing period in a second frame period later than the first display frame period.

34. The method of operating an integrated drive arrangement of claim 31, wherein, further comprising: starting, by the optical sensing circuit, an optical sensing period for generating the first ambient light information during the first display frame period with respect to the sensor region, and completing the optical sensing period in the first display frame period.

35. The method of operating an integrated drive arrangement of claim 31, wherein, further comprising: starting, by the optical sensing circuit, a first optical sensing period for generating the first ambient light information during the first display frame period, and starting a second optical sensing period for generating second ambient light information during a second display frame period different from the first display frame period, and wherein the first optical sensing period and the second optical sensing period are with respect to different sensor regions of the optical sensor array.

36. The method of operating an integrated drive arrangement of claim 35, wherein, further comprising: receiving, by the optical sensing circuit, a first number of the optical sensing signals generated in the first optical sensing period through a first portion of optical sensing lines in the touch display panel, and receiving a second number of the optical sensing signals generated in the second optical sensing period through a second portion of the optical sensing lines in the touch display panel, wherein the first portion of the optical sensing lines and the second portion of the optical sensing lines are completely different or partially different.

37. The method of operating an integrated drive device of claim 21, wherein, further comprising: outputting, by the optical sensing circuit, a plurality of start-up pulse signals to the control circuit in the touch display panel during the first display frame period, wherein the plurality of start-up pulse signals are pulled to a start-up state at the same time; and generating, by the control circuit, a plurality of first control signals for sequentially resetting a first portion of a plurality of sensor rows of a sensor region according to each of the plurality of start-up pulse signals, and a plurality of second control signals for sequentially reading out the optical sensing signals from the first portion of the sensor rows of the sensor region according to each of the plurality of start-up pulse signals.

38. The method of operating an integrated drive arrangement of claim 37, wherein, further comprising: starting, by the optical sensing circuit, an optical sensing period for generating the first ambient light information during the first display frame period with respect to the sensor region, and completing the optical sensing period in a second display frame period later than the first display frame period.

39. The method of operating an integrated drive arrangement of claim 37, wherein, further comprising: starting, by the optical sensing circuit, an optical sensing period for generating the first ambient light information during the first display frame period with respect to the sensor region, and completing the optical sensing period in the first display frame period.

40. The method of operating an integrated drive arrangement of claim 37, wherein, further comprising: starting, by the optical sensing circuit, a first optical sensing period for generating the first ambient light information during the first display frame period, and starting a second optical sensing period for generating second ambient light information in a second frame period different from the first display frame period, wherein the first optical sensing period and the second optical sensing period are with respect to different sensor rows of an array of optical sensors in the touch display panel.

Images