Touch coordinate reporting method, touch driving apparatus, and touch display device
By interpolating touch coordinates in touch display devices and determining the reporting time based on the display refresh rate, the problem of uneven touch coordinate reporting under high refresh rates is solved, achieving smoothness and accuracy of touch trajectory and meeting testing standards.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- BOE TECHNOLOGY GROUP CO LTD
- Filing Date
- 2024-12-09
- Publication Date
- 2026-06-18
Smart Images

Figure CN2024137674_18062026_PF_FP_ABST
Abstract
Description
Touch coordinate reporting method, touch driving device and touch display device Technical Field
[0001] This disclosure relates to the field of display technology, specifically to a touch coordinate reporting method, a touch driving device, and a touch display device. Background Technology
[0002] In some touch display products, a display cycle is divided into a display phase and a touch phase. The display phase shows the image, while the touch phase performs touch detection. During touch detection, the touch chip provides touch scanning signals to the touch electrodes on the touch display panel and receives the sensing signals generated by the touch electrodes. The processor determines the touch coordinates based on the sensing signals received by the touch chip and sends the touch coordinates to the system motherboard of the touch display product. This action of sending the touch coordinates is called the reporting action. Summary of the Invention
[0003] This disclosure presents a touch coordinate reporting method, a touch driving device, and a touch display device.
[0004] In a first aspect, this disclosure provides a touch coordinate reporting method, applied in a microprocessor of a touch display device, wherein the touch coordinate reporting method includes:
[0005] Receive the display synchronization signal and touch synchronization signal sent by the timing controller of the touch display device;
[0006] The current display refresh rate is determined based on the display synchronization signal; and the corresponding reporting time data is determined based on the display refresh rate.
[0007] According to the touch synchronization signal, the touch chip is controlled to perform touch detection during the touch period, and the touch coordinates are determined according to the detection data of the touch chip;
[0008] Based on the reported time data, the touch coordinates are reported to the main control module of the touch display device;
[0009] The reporting time data includes the reporting time interval between two adjacent touch coordinates, and the reporting time interval is less than or equal to 1 / fmax, where fmax is the maximum value that the display refresh rate can reach.
[0010] In some embodiments, the touch synchronization signal switches between a first level potential and a second level potential, and the touch coordinates include real touch coordinates and first interpolated touch coordinates;
[0011] Based on the touch synchronization signal, the touch chip is controlled to perform touch detection during the touch period, and the touch coordinates are determined based on the detection data from the touch chip, specifically including:
[0012] In response to the first level potential in the touch synchronization signal, the touch chip is controlled to perform touch detection;
[0013] In response to the detection data fed back by the touch chip for the i-th time, the i-th real touch coordinate is determined, and based on the reporting time data corresponding to the display refresh rate, and the i-th and (i-1)-th real touch coordinates, Q first interpolated touch coordinates located between the i-th and (i-1)-th real touch coordinates are determined; i is an integer, 1 < i ≤ N, N is the total number of detection data fed back by the touch chip in one touch process; Q is a positive integer;
[0014] The reporting time data also includes the value of Q; the reporting time of the i-th real touch coordinate is after the reporting time of the (i-1)-th real touch coordinate, and the reporting time of the first interpolated touch coordinate is between the reporting times of the two real touch coordinates adjacent to the first interpolated touch coordinate.
[0015] In some embodiments, the touch coordinates further include second interpolated touch coordinates;
[0016] The method of controlling the touch chip to perform touch detection during the touch period according to the touch synchronization signal, and determining the touch coordinates according to the detection data of the touch chip, further includes:
[0017] Determine at least Q second interpolated touch coordinates based on the last actual touch coordinate;
[0018] The reporting time of the second interpolated touch coordinate is after the reporting time of the last actual touch coordinate.
[0019] In some embodiments, at least two of the first interpolated touch coordinates are reported between the reporting times of two adjacent actual touch coordinates.
[0020] In some embodiments, reporting the touch coordinates to the main control module of the touch display device based on the reported time data specifically includes:
[0021] After determining the second actual touch coordinate, each touch coordinate is sequentially reported to the main control module according to the reporting time data.
[0022] In some embodiments, the reporting time interval Δt and the total number of times N of the touch coordinates are reported within 1 second satisfy the following relationship:
[0023] In some embodiments, for the same display refresh rate, the difference between any two reporting time intervals does not exceed 0.1ms.
[0024] In some embodiments, the reporting frequency of the touch coordinates is the same for different display refresh rates.
[0025] In some embodiments, the touch coordinate reporting method further includes:
[0026] An enable signal is sent to the main control module. The enable signal is at a working level during the reporting phase and at a non-working level during the non-reporting phase. The reporting phase is the phase of reporting one of the touch coordinates, and the non-reporting phase is the phase of not reporting the touch coordinates.
[0027] In some embodiments, the touch synchronization signal switches between a first level potential and a second level potential, and the touch coordinates include real touch coordinates and first interpolated touch coordinates;
[0028] In a single touch event, the reporting stage corresponding to the kth real touch coordinate is after the (k+1)th touch stage; k is a positive integer and is less than the total number of touch stages included in a single touch event.
[0029] In some embodiments, determining the corresponding reporting time data based on the display refresh rate specifically includes:
[0030] Based on the pre-stored correspondence between multiple display refresh rates and their corresponding reporting time data, the reporting time data corresponding to the current display refresh rate is determined.
[0031] Secondly, this disclosure also provides a touch driving device for use in a touch display device, the touch driving device comprising: a touch chip, a timing controller, and a microprocessor, wherein,
[0032] The timing controller is configured to generate a display synchronization signal and a touch synchronization signal with the same frequency based on the image data to be displayed.
[0033] The microprocessor is configured to send a first control signal to the touch chip during the touch phase, based on the touch synchronization signal.
[0034] The touch chip is configured to, in response to the first control signal, perform touch detection on the touch display panel and feed back the detection data to the microprocessor;
[0035] The microprocessor is further configured to: determine touch coordinates based on the detection data; determine the current display refresh rate based on the display synchronization signal; and report the touch coordinates to the main control module of the touch display device based on the display refresh rate.
[0036] Wherein, the reporting time interval between two adjacent touch coordinates is less than or equal to 1 / fmax, where fmax is the maximum value that the display refresh rate can reach.
[0037] In some embodiments, the microprocessor includes:
[0038] The time determination module is configured to determine the current display refresh rate based on the display synchronization signal, and to determine the corresponding reporting time data based on the display refresh rate.
[0039] The touch detection module is configured to send a first control signal to the touch chip during the touch phase according to the touch synchronization signal, and to determine the touch coordinates according to the detection data of the touch chip;
[0040] The reporting module is configured to report the touch coordinates to the main control module based on the reporting time data;
[0041] The reporting time data includes the reporting time interval between two adjacent touch coordinates.
[0042] In some embodiments, the touch synchronization signal switches between a first level potential and a second level potential, and the touch coordinates include real touch coordinates and first interpolated touch coordinates;
[0043] The touch detection module is specifically configured to send the first control signal to the touch chip in response to a first level potential in the touch synchronization signal; and
[0044] In response to the detection data fed back by the touch chip for the i-th time, the i-th real touch coordinate is determined, and based on the reporting time data corresponding to the display refresh rate, and the i-th and (i-1)-th real touch coordinates, Q first interpolated touch coordinates located between the i-th and (i-1)-th real touch coordinates are determined; i is an integer, 1 < i ≤ N, N is the total number of detection data fed back by the touch chip in one touch process; Q is a positive integer;
[0045] The reporting time data also includes the value of Q; the reporting time of the i-th real touch coordinate is after the reporting time of the (i-1)-th real touch coordinate, and the reporting time of the first interpolated touch coordinate is between the reporting times of the two real touch coordinates adjacent to the first interpolated touch coordinate.
[0046] In some embodiments, the touch coordinates further include second interpolated touch coordinates;
[0047] The touch detection module is also configured to determine at least Q second interpolated touch coordinates based on the last real touch coordinate;
[0048] The reporting time of the second interpolated touch coordinate is after the reporting time of the last actual touch coordinate.
[0049] In some embodiments, the reporting module reports at least two of the first interpolated touch coordinates between the reporting times of two adjacent real touch coordinates.
[0050] In some embodiments, the microprocessor is specifically configured to, after determining the second actual touch coordinate, sequentially report each of the touch coordinates to the main control module.
[0051] In some embodiments, the reporting time interval Δt and the total number of times N, in which the microprocessor reports the touch coordinates within 1 second, satisfy the following relationship:
[0052] In some embodiments, for the same display refresh rate, the difference between any two reporting time intervals does not exceed 0.1ms.
[0053] In some embodiments, the microprocessor reports the touch coordinates at the same frequency for different display refresh rates.
[0054] In some embodiments, the microprocessor is further configured to,
[0055] An enable signal is sent to the main control module. The enable signal is at a working level during the reporting phase and at a non-working level during the non-reporting phase. The reporting phase is the phase of reporting one of the touch coordinates, and the non-reporting phase is the phase of not reporting the touch coordinates.
[0056] In some embodiments, the touch synchronization signal switches between a first level potential and a second level potential, and the touch coordinates include real touch coordinates and first interpolated touch coordinates;
[0057] In a single touch event, the reporting stage corresponding to the kth real touch coordinate is after the (k+1)th touch stage; k is a positive integer and is less than the total number of touch stages included in a single touch event.
[0058] In some embodiments, the touch driving device further includes a memory, which stores a preset correspondence between multiple display refresh rates and corresponding reporting time data;
[0059] Specifically, the time determination module is configured to determine the current display refresh rate based on the display synchronization signal, and to retrieve the reporting time data corresponding to the current display refresh rate from the memory.
[0060] In some embodiments, the timing controller is specifically configured to determine whether the image data to be displayed is the same as the image data of the previous P frames. If they are the same, a display synchronization signal and a touch synchronization signal of a first frequency are generated; if they are different, a display synchronization signal and a touch synchronization signal of a second frequency are generated. The first frequency is less than the second frequency; P is a preset integer greater than 1.
[0061] Thirdly, this disclosure also provides a touch display device, comprising: a touch display panel and a touch driving device electrically connected to the touch display panel, wherein the touch driving device is the touch driving device described above. Attached Figure Description
[0062] The accompanying drawings are provided to further illustrate the present disclosure and form part of the specification. They are used together with the following detailed description to explain the present disclosure, but do not constitute a limitation thereof. In the drawings:
[0063] Figure 1 is a waveform diagram of the touch synchronization signal provided in some embodiments.
[0064] Figure 2 is a timing diagram of the touch synchronization signal and reporting time provided in some embodiments.
[0065] Figure 3A is a schematic diagram of a touch driving device provided in some embodiments of this disclosure.
[0066] Figure 3B is another schematic diagram of a touch driving device provided in some embodiments of this disclosure.
[0067] Figure 3C is a schematic diagram of a microprocessor provided in some embodiments of this disclosure.
[0068] Figure 4 is a schematic diagram of a touch display device provided in some embodiments of this disclosure.
[0069] Figure 5 is a timing diagram of the touch synchronization signal and reporting time provided in some embodiments of this disclosure.
[0070] Figure 6 is a signal timing diagram of the touch driving device provided in some embodiments of this disclosure at different display refresh rates.
[0071] Figure 7 is a signal timing diagram of the touch driving device provided in some other embodiments of this disclosure at different display refresh rates.
[0072] Figure 8 is a schematic diagram of a touch coordinate reporting method provided in some embodiments of this disclosure. Detailed Implementation
[0073] The specific embodiments of this disclosure will be described in detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are for illustration and explanation only and are not intended to limit this disclosure.
[0074] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this disclosure. All other embodiments obtained by those skilled in the art based on the described embodiments of this disclosure without creative effort are within the scope of protection of this disclosure.
[0075] Unless otherwise defined, the technical or scientific terms used in the embodiments of this disclosure should have the ordinary meaning understood by one of ordinary skill in the art to which this disclosure pertains. The terms "first," "second," and similar terms used in this disclosure do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Similarly, terms such as "comprising" or "including" mean that the element or object preceding the word encompasses the elements or objects listed following the word and their equivalents, without excluding other elements or objects. Terms such as "connected" or "linked" are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. Terms such as "upper," "lower," "left," and "right" are used only to indicate relative positional relationships; when the absolute position of the described object changes, the relative positional relationship may also change accordingly.
[0076] Figure 1 shows the waveform of the touch synchronization signal provided in some embodiments. As shown in Figure 1, each display cycle of the touch display panel includes an active display phase and a blanking phase, with at least a portion of the blanking phase serving as the touch phase. In embedded touch display panels (i.e., touch electrodes are located inside the display panel), a common driving mode is to display an image during the active display phase and perform touch detection during the touch phase. As shown in Figure 1, the timing controller (TCON) outputs a touch synchronization signal. The touch synchronization signal Tsync reaches a low level during the touch phase and a high level during the active display phase. When the touch synchronization signal reaches a low level, the microprocessor (MCU) controls the touch chip to perform touch detection; when the touch synchronization signal reaches a high level, the microprocessor controls the touch chip to output a display signal to drive the display panel to display.
[0077] Specifically, the display signal output by the touch chip can be a data signal output to the data line. When the touch chip performs touch detection, it can send touch drive signals to the touch electrodes in the display panel, receive the sensing signals generated by the touch electrodes, and send the sensing signals to the microprocessor. When a touch occurs at a certain position on the display panel, the sensing signal generated by the touch electrode at the corresponding position changes. Based on the changed sensing signal, the microprocessor can determine the touch coordinates and report the touch coordinates to the main control module (i.e., the system motherboard) of the touch display device. This allows the main control module to perform further processing based on the touch coordinates. For example, it can provide corresponding image data to the timing controller 200 based on the touch coordinates, thereby enabling the touch display panel 400 to display the corresponding screen according to the touch operation.
[0078] Understandably, in the event of a touch event, the microprocessor obtains a real touch coordinate for each touch detection performed by the touch chip (i.e., each touch stage). Therefore, the number of real touch coordinates generated per second is the same as the number of frames displayed per second (i.e., the display refresh rate, or display frequency). For example, when the display refresh rate is 60Hz, the microprocessor reports 60 real touch coordinates per second, resulting in a reporting rate of 60Hz. However, current specifications for touch display devices require the microprocessor's reporting rate to be higher than a certain value, for example, higher than 100Hz, so that the touch display product can more accurately capture the touch trajectory when the user performs continuous touch operations on the touch display panel (e.g., writing, drawing lines). Therefore, in addition to reporting real touch coordinates, the touch chip also generates interpolated touch coordinates based on the real touch coordinates and reports the interpolated touch coordinates. Specifically, in one example, the microprocessor reports an interpolated touch coordinate after each actual touch coordinate reporting time point. The last interpolated touch coordinate can be the same as the last actual touch coordinate; the remaining interpolated touch coordinates are obtained by interpolation based on the two preceding and following actual touch coordinates. By adding an interpolated touch coordinate after each actual touch coordinate, the final reporting rate can reach twice the display refresh rate. When the display refresh rate is 60Hz, the final reporting rate is 120Hz.
[0079] Figure 2 is a timing diagram of the touch synchronization signal and reporting time provided in some embodiments. As shown in Figure 2, X i X i+1 X i+2 Y represents the reporting time of the i-th, (i+1)-th, and (i+2)-th actual touch coordinates, respectively. i Y i+1 Y i+2These represent the reporting times for the i-th, i+1-th, and i+2-th interpolated touch coordinates, respectively. Specifically, after the microprocessor determines the (i+1)-th real touch coordinate based on the touch data fed back by the touch chip, it stores the (i+1)-th real touch coordinate and reports the i-th real touch coordinate to the system motherboard. The reporting time for the i-th real touch coordinate is Xi. In addition, based on the i-th and i+1-th real touch coordinates, the i-th interpolated touch coordinate is determined, and at time node Yi, the i-th interpolated touch coordinate is reported to the system motherboard. Yi is located after Xi, and the time interval between Yi and Xi is 5ms. After the microprocessor determines the (i+2)th real touch coordinate based on the touch data fed back by the touch chip, it stores the (i+2)th real touch coordinate and reports the (i+1)th real touch coordinate to the system motherboard. The reporting time node for the (i+1)th real touch coordinate is Xi+1. Additionally, based on the (i+1)th and (i+2)th real touch coordinates, the (i+1)th interpolated touch coordinate is determined and reported to the system motherboard at time node Yi+1. Yi+1 is after Xi+1, and the time interval between Yi+1 and Xi+1 is 5ms. This process continues; that is, each time the microprocessor obtains a real touch coordinate, it reports the previously obtained real touch coordinate and determines the interpolated touch coordinate based on the two obtained real touch coordinates. This interpolated touch coordinate is then reported 5ms after the reporting time node of the previous real touch coordinate. In this process, after reporting the last actual touch coordinate (denoted as the j-th actual touch coordinate), the j-th interpolated touch coordinate is reported after a certain time interval. The j-th interpolated touch coordinate can be the same as the j-th actual touch coordinate, or it can be determined by other methods.
[0080] Some touch display devices do not have a fixed refresh rate. For example, when the displayed image is constantly changing, the refresh rate is 60Hz; when the displayed image remains stationary for a long time, the refresh rate is reduced to 40Hz to reduce power consumption. Some testing standards for touch display devices require that the interval between adjacent reporting time points does not exceed a preset value, which is 1 / fmax, where fmax is the maximum achievable refresh rate. In the example above, the touch display device has both 60Hz and 40Hz refresh rates, so fmax is 60Hz. Correspondingly, the testing standard requires that the interval between adjacent reporting time points does not exceed 16.6ms, which helps the touch display device determine a smoother touch trajectory. According to the description of the reporting time nodes in Figure 2 above, when the display refresh rate is 60Hz, the interval between the reporting time nodes of two adjacent real touch coordinates is 16.6ms; the interval between the reporting time node of the interpolated touch coordinate and the previous real touch coordinate is 5ms, and the interval between the reporting time node of the interpolated touch coordinate and the next real touch coordinate is 11.6ms. When the display refresh rate is 40Hz, the interval between the reporting time nodes of two adjacent real touch coordinates is 25ms; the interval between the reporting time node of the interpolated touch coordinate and the previous real touch coordinate is 5ms, and the interval between the reporting time node of the interpolated touch coordinate and the next real touch coordinate is 20ms. These intervals exceed the aforementioned test requirement of 16.66ms, causing the touch display device to fail the test.
[0081] Figure 3A is a schematic diagram of a touch driving device provided in some embodiments of this disclosure, Figure 3B is another schematic diagram of a touch driving device provided in some embodiments of this disclosure, and Figure 4 is a schematic diagram of a touch display device provided in some embodiments of this disclosure. As shown in Figures 3A to 4, the touch driving device is used in a touch display device, which includes a touch display panel in addition to the touch driving device. The touch driving device 1 includes a touch chip 300, a timing controller 200, and a microprocessor 100. The timing controller 200 is configured to generate a display synchronization signal Vsync and a touch synchronization signal Tsync with the same frequency according to the image data to be displayed.
[0082] The display synchronization signal Vsync is used to control the display refresh rate of the touch display panel 400, and the touch synchronization signal Tsync is used to determine the effective display phase and touch phase of the touch display panel 400. The touch synchronization signal Tsync is a square wave signal, and it is in an effective level state during the touch phase and an ineffective level state during the effective display phase.
[0083] The microprocessor 100 is configured to send a first control signal to the touch chip 300 during the touch phase, based on the touch synchronization signal Tsync. The touch chip 300 is configured to, in response to the first control signal, perform touch detection on the touch display panel and feed back the detection data to the microprocessor 100. The microprocessor 100 is also configured to determine the touch coordinates based on the detection data from the touch chip 300; determine the current display refresh rate based on the display synchronization signal Vsync; and, based on the display refresh rate, report the touch coordinates to the main control module of the touch display device. A time interval exists between the reporting times of two adjacent touch coordinates, denoted as the reporting time interval, which is less than or equal to a preset value.
[0084] For example, the process by which the microprocessor 100 sends a first control signal to the touch chip 300 during the touch phase based on the touch synchronization signal Tsync specifically includes: when the touch synchronization signal Tsync is at a first level potential, the microprocessor 100 sends the first control signal to the touch chip 300 to control the touch chip 300 to perform touch detection. In one example, the touch chip 300 can be used as a source driver chip. In this case, the microprocessor 100 can also send a second control signal to the touch chip 300 when the touch synchronization signal Tsync is at a second level potential to control the touch chip 300 to output data signals for display.
[0085] In this embodiment, one of the first and second voltage levels is a high voltage level, and the other is a low voltage level. This embodiment uses a low voltage level as the first voltage level and a high voltage level as the second voltage level for illustration.
[0086] The display refresh rate is the frequency of the display synchronization signal Vsync. For example, if the display synchronization signal Vsync is a pulse signal, the display driver module drives the touch display panel 400 to display one frame of image for each pulse output by the timing controller 200. The display driver module may include a source driver chip and a gate driver circuit. The gate driver circuit provides a scan signal for each row of pixels in the touch display panel 400; the source driver chip provides a data signal for the pixels, and the magnitude of the data signal determines the brightness of the pixel. In one example, the microprocessor 100 can determine the period of the pulse signal based on the interval between two adjacent pulse signals, thereby determining the current frequency of the pulse signal, i.e., the current display refresh rate.
[0087] The maximum achievable refresh rate is fmax, with a default value of 1 / fmax. For example, if a touch display device can switch between 60Hz and 40Hz, then fmax is 60Hz, with a default value of 16.6ms; or if a touch display device can switch between 120Hz and 80Hz, then fmax is 120Hz, with a default value of 8.3ms.
[0088] It should be noted that there is a reporting time interval between every two adjacent touch coordinates, and each reporting time interval is less than a preset value. The reporting time intervals can be the same or different.
[0089] In this embodiment of the disclosure, the microprocessor 100 can determine the display refresh rate based on the display synchronization signal Vsync, and report the touch coordinates based on the display refresh rate. For various display refresh rates, the reporting time interval between two adjacent touch coordinates is less than 1 / fmax, thereby ensuring that the touch display device meets the test requirements and is conducive to the touch display device determining a smoother touch trajectory.
[0090] In some embodiments, the timing controller 200 is specifically configured to determine whether the image data to be displayed is the same as the image data of the previous P frames. If they are the same, a first frequency display synchronization signal Vsync and a touch synchronization signal Tsync are generated; if they are different, a second frequency display synchronization signal Vsync and a touch synchronization signal Tsync are generated. The first frequency is less than the second frequency; P is a preset integer greater than 1, for example, P is a preset integer between 3 and 100, or between 100 and 300, or between 300 and 500, or 7. That is, when the image of several consecutive frames does not change, the touch display panel 400 is driven to display at a lower refresh rate to reduce power consumption.
[0091] In one example, the first frequency is 2 / 3 of the second frequency. This embodiment of the disclosure uses a first frequency of 40Hz and a second frequency of 60Hz as an example.
[0092] Figure 3C is a schematic diagram of a microprocessor provided in some embodiments of this disclosure. As shown in Figure 3C, in some embodiments, the microprocessor may include: a time determination module 20, a touch detection module 30, and a reporting module 40. The time determination module 20 is configured to determine the current display refresh rate based on the display synchronization signal Vsync, and determine the corresponding reporting time data based on the display refresh rate. The touch detection module 30 is configured to control the touch chip 300 to perform touch detection during the touch phase based on the touch synchronization signal Tsync, and determine the touch coordinates based on the detection data of the touch chip 300. The reporting module 40 is configured to report the touch coordinates to the main control module of the touch display device based on the reporting time data. The reporting time data includes the reporting time interval between two adjacent touch coordinates, that is, the time interval between the reporting time nodes of two adjacent touch coordinates, and the reporting time interval is less than or equal to a preset value.
[0093] In some embodiments, as shown in FIG3B, the touch driving device 1 further includes a memory 500, which stores a plurality of preset correspondences between display refresh rates and corresponding reporting time data. The time determination module 20 is specifically configured to determine the current display refresh rate based on the display synchronization signal Vsync; and to obtain the reporting time data corresponding to the current display refresh rate from the memory 500.
[0094] In some embodiments, the touch synchronization signal Tsync switches between a first level potential and a second level potential, and the stage when the touch synchronization signal Tsync is at the first level potential is the touch stage. Touch coordinates include actual touch coordinates, first interpolated touch coordinates, and second interpolated touch coordinates. Specifically, the touch detection module 30 is configured to control the touch chip 300 to perform touch detection in response to the first level potential in the touch synchronization signal Tsync. For example, in response to the first level potential in the touch synchronization signal Tsync, the touch detection module 30 sends a first control signal to the touch signal, and the touch chip 300, in response to the first control signal, sends a touch drive signal to the touch electrodes on the touch display panel 400 and receives the touch sensing signal generated by the touch electrodes.
[0095] The touch detection module 30 is further configured to, in response to the detection data fed back by the touch chip 300 during the touch process, determine the i-th real touch coordinate; and, based on the reporting time data corresponding to the display refresh rate, and the i-th and (i-1)-th real touch coordinates, determine Q first interpolated touch coordinates located between the i-th and (i-1)-th real touch coordinates; and, based on at least the N-th real touch coordinates, determine Q second interpolated touch coordinates. i is an integer, 1 < i ≤ N, where N is the total number of detection data fed back by the touch chip 300 during one touch process, that is, the total number of real touch coordinates determined by the touch detection module 30 during one touch process. Q is a positive integer. The reporting time data also includes the number of first interpolated touch coordinates and the number of second interpolated touch coordinates between two adjacent real touch coordinates, i.e., the aforementioned Q value.
[0096] For example, there is a first interpolated touch coordinate between the i-th and (i-1)-th actual touch coordinates, located at the midpoint between them. Alternatively, there may be two first interpolated touch coordinates between the i-th and (i-1)-th actual touch coordinates, located at the trisection of the i-th and (i-1)-th actual touch coordinates. For example, the second interpolated touch coordinate can be the same as the last actual touch coordinate; or, for example, the second interpolated touch coordinate can be determined based on the last actual touch coordinate and the last first interpolated touch coordinate.
[0097] It should be noted that during the touch phase of each display cycle, the touch chip 300 performs touch detection on the touch display panel 400 and feeds back the detection data to the touch detection module 30. When the touch display panel 400 is touched, the touch detection module 30 can determine the actual touch coordinates based on the detection data from the touch chip 300; when the touch display panel 400 is not touched, the touch detection module 30 determines that the touch display panel 400 has not been touched based on the detection data from the touch chip 300. The above-mentioned touch process refers to the time period during which the touch display panel 400 is continuously touched. Specifically, if the touch detection module 30 can determine M actual touch coordinates based on the detection data fed back by the touch chip 300 in M consecutive touch phases, then the M display cycles corresponding to these M touch phases constitute a touch process. M is an integer greater than 1. For example, if the touch detection module 30 determines 10 real touch coordinates based on the detection data fed back by the touch chip 300 in the 1st to 10th touch stages, and determines that the touch display panel 400 did not touch in the 11th touch stage, then the touch process includes the 1st to 10th display cycles.
[0098] In some embodiments, when the microprocessor 100 reports coordinates, specifically after the touch detection module 30 determines the second real touch coordinate, it sequentially reports each real touch coordinate data, each first interpolated coordinate data, and each second interpolated coordinate data to the main control module according to the reporting time data. Specifically, the reporting time of the i-th real touch coordinate is after the reporting time of the (i-1)-th real touch coordinate; the reporting time of the first interpolated touch coordinate is between the reporting times of the two adjacent real touch coordinates, that is, the reporting times of the i-th and (i-1)-th real touch coordinates are between the reporting times of the i-th and (i-1)-th real touch coordinates. The reporting time of the second interpolated touch coordinate is after the reporting time of the N-th real touch coordinate.
[0099] Figure 5 is a timing diagram of the touch synchronization signal Tsync and the reporting time provided in some embodiments of this disclosure. In one example, as shown in Figure 5, X i X i+1 X i+2 Y represents the reporting time of the i-th, (i+1)-th, and (i+2)-th actual touch coordinates, respectively. i Y i+1 Y i+2 These are the reporting times for the i-th, i+1-th, and i+2-th first interpolated touch coordinates, respectively. When the display refresh rate is 60Hz, the display period is 16.6ms. There is a first interpolated touch coordinate between every two adjacent real touch coordinates, and a second interpolated touch coordinate after the last real touch coordinate. The reporting time interval between each first interpolated touch coordinate and the preceding real touch coordinate is 5ms, the reporting time interval between the second interpolated touch coordinate and the last real touch coordinate is 5ms, and the reporting time interval between each first interpolated touch coordinate and the following real touch coordinate is 11.6ms. Starting from the second real touch coordinate, the touch detection module 30 determines a first interpolated touch coordinate based on each determined real touch coordinate and the previous real touch coordinate. In addition, after the touch detection module 30 determines the second real touch coordinate, the reporting module 40 reports the first real touch coordinate, the first first interpolated touch coordinate, the second real touch coordinate, the second first interpolated touch coordinate, the third real touch coordinate, and the third first interpolated touch coordinate in sequence according to the above-mentioned time interval setting, until the last real touch coordinate and the second interpolated touch coordinate are reported.
[0100] Referring to Figure 5, when the display refresh rate is 40Hz, the display cycle is 16.6ms. There is a first interpolated touch coordinate between every two adjacent real touch coordinates, and a second interpolated touch coordinate after the last real touch coordinate. The reporting time interval between each first interpolated touch coordinate and the preceding real touch coordinate is 13ms, the reporting time interval between each second interpolated touch coordinate and the last real touch coordinate is 13ms, and the reporting time interval between each first interpolated touch coordinate and the following real touch coordinate is 12ms. The reporting process for each touch coordinate is similar to that at 60Hz, the only difference being the reporting time interval, which will not be elaborated here.
[0101] Figure 6 is a signal timing diagram of the touch driving device provided in some embodiments of this disclosure under different display refresh rates. As shown in Figure 6, for each display refresh rate, the microprocessor 100 can also send an enable signal TP_INT to the main control module. The enable signal TP_INT is at a working level during the reporting phase and at a non-working level during the non-reporting phase. The reporting phase refers to reporting a touch coordinate, and the non-reporting phase refers to the phase where the microprocessor 100 does not report the touch coordinate. Figure 6 illustrates this using a low effective level as an example. That is, the microprocessor 100 pulls the enable signal TP_INT low each time it reports a touch coordinate; then, it pulls the enable signal TP_INT high. The main control module can determine whether the microprocessor 100 has reported the touch coordinate based on the state of the enable signal TP_INT, thereby improving the accuracy of data transmission.
[0102] The time interval between two adjacent falling edges of the enable signal TP_INT is the reporting time interval for the corresponding two touch coordinates; similarly, the time interval between two adjacent rising edges of the enable signal TP_INT is also the reporting time interval for the corresponding two touch coordinates.
[0103] In some examples, during a single touch event, the reporting stage corresponding to the k-th actual touch coordinate is after the (k+1)-th touch stage; k is a positive integer and less than the total number of touch stages included in a single touch event. That is, the actual touch coordinates determined based on the detection data of the k-th touch stage are reported only after the (k+1)-th touch stage ends.
[0104] Figure 7 is a signal timing diagram of the touch driving device provided in some other embodiments of this disclosure at different display refresh rates. Figure 7(a) shows the timing of the touch synchronization signal Tsync, the enable signal TP_INT, and the reporting time of each touch coordinate when the display refresh rate is 60Hz. Figure 7(b) shows the timing of the touch synchronization signal Tsync, the enable signal TP_INT, and the reporting time of each touch coordinate when the display refresh rate is 40Hz. In some embodiments, the time interval Δt and the total number of touch coordinate reports N within 1 second satisfy the following relationship:
[0105] There is a time interval between each pair of adjacent touch coordinates being reported. These time intervals can be the same or different, but they all satisfy the formula described above. In this formula, 1 / N is the average time interval determined by the main control module. When the actual time interval satisfies the formula, it ensures that each touch coordinate is reported uniformly, resulting in a smoother capture of the touch trajectory by the touch display device.
[0106] In one example, for the same display refresh rate, the difference between any two reporting time intervals does not exceed 0.1ms, thereby further improving the uniformity of touch coordinate reporting. The reporting time interval is the interval between the reporting times of two adjacent touch coordinates. For example, the reporting times of any two adjacent touch coordinates are the same. For example, as shown in Figure 7, when the display refresh rate is 60Hz, there is a first interpolated touch coordinate between any two adjacent real touch coordinates, and a second interpolated touch coordinate after the last real touch coordinate. The reporting time interval between any two adjacent touch coordinates is 8.3ms. At this time, It meets the requirements of the above formula.
[0107] In some embodiments, the microprocessor 100 reports touch coordinates at the same frequency for different display refresh rates. Specifically, when the display refresh rate is at its minimum, there are at least two first interpolated touch coordinates between two adjacent actual touch coordinates. Here, "when the display refresh rate is at its minimum" refers to the minimum refresh rate achievable by the touch display device. As mentioned above, the timing controller can control the display synchronization signal to vary between a first frequency and a second frequency. If the first frequency is less than the second frequency, then the display refresh rate is at its minimum when the display refresh rate equals the first frequency.
[0108] Taking 40Hz and 60Hz display refresh rates as examples, assuming that at both refresh rates, there is a first interpolated touch coordinate between every two adjacent real touch coordinates, and that all touch coordinates at the same refresh rate are reported evenly. Then, at a refresh rate of 60Hz, the reporting rate is 120Hz, and the reporting time interval between two adjacent touch coordinates is 8.3ms; at a refresh rate of 40Hz, the reporting rate is 80Hz, and the reporting time interval between two adjacent touch coordinates is 12.5ms. Therefore, at the critical point of refresh rate switching, the reporting frequency is inconsistent, affecting touch detection and easily causing the touch display device to fail the test. In this embodiment, by increasing the number of first interpolated touch coordinates, the reporting rate is made the same at different refresh rates, thus ensuring the detection effect. When the display refresh rate is 60Hz, a first interpolated touch coordinate is set between every two adjacent real touch coordinates; the reporting time interval between every two adjacent touch coordinates is 8.3ms. When the display refresh rate is 40Hz, there are two first interpolated touch coordinates between every two adjacent real touch coordinates; some reporting time intervals are 8.3ms, and the rest are 8.4ms. In Figure 7, when the display refresh rate is 40Hz, Y... i+1 Y' i+1 Y represents the reporting time nodes of the two first interpolated touch coordinates between the (i+1)th and (i+2)th actual touch coordinates. i+2 Y' i+2 These are the reporting time points for the two first interpolated touch coordinates between the (i+2)th and (i+3)th actual touch coordinates, respectively. For example, between two adjacent actual touch coordinates, the reporting time interval between the first first interpolated touch coordinate and the previous actual touch coordinate is 8.3ms, the reporting time interval between two adjacent first interpolated touch coordinates is 8.4ms, and the reporting time interval between the second first interpolated touch coordinate and the subsequent actual touch coordinate is 8.3ms.
[0109] It should be noted that each touch coordinate is first determined by the touch detection module 30 and then reported by the reporting module 40. The reporting time and determination time of each touch node differ by approximately one display cycle. Therefore, in practical applications, the following situation may occur: With a display refresh rate of 60Hz, one first interpolated touch coordinate needs to be reported in the reporting interval between two adjacent real touch coordinates. Then, with a display refresh rate of 40Hz, two first interpolated touch coordinates need to be reported in the reporting interval between two adjacent real touch coordinates. However, in the first display cycle of 40Hz, only one first interpolated touch coordinate is determined. In this case, the first interpolated touch coordinate can be reported twice. Similarly, when the display refresh rate switches from 40Hz to 60Hz, one first interpolated touch coordinate needs to be reported in the first display cycle after the switch, but two first interpolated touch coordinates have already been determined. In this case, either first interpolated touch coordinate can be reported.
[0110] This disclosure also provides a touch coordinate reporting method for use in the microprocessor 100 of a touch display device, as shown in FIG8. The touch coordinate reporting method includes:
[0111] S1. Receive the display synchronization signal and touch synchronization signal sent by the timing controller 200.
[0112] S2. Determine the current display refresh rate based on the display synchronization signal; and determine the corresponding reporting time data based on the display refresh rate.
[0113] S3. Based on the touch synchronization signal, control the touch chip 300 to perform touch detection during the touch phase, and determine the touch coordinates based on the detection data of the touch chip 300.
[0114] S4. Based on the reported time data, the touch coordinates are reported to the main control module of the touch display device.
[0115] The reporting time data includes the reporting time interval between two adjacent touch coordinates. The time interval is less than or equal to 1 / fmax, where fmax is the maximum value that the display refresh rate can reach.
[0116] In some embodiments, the process of determining the reporting time data in step S2 specifically includes: determining the reporting time data corresponding to the current display refresh rate based on the pre-stored correspondence between multiple display refresh rates and corresponding reporting time data.
[0117] In some embodiments, the touch synchronization signal switches between a first level potential and a second level potential. Step S3 may specifically include:
[0118] S31. In response to the first level potential in the touch synchronization signal, the touch chip 300 is controlled to perform touch detection, so that the touch chip 300 feeds back detection data to the microprocessor 100 after each touch detection.
[0119] S32. In response to the detection data fed back by the touch chip 300 for the i-th time, determine the i-th real touch coordinate, and based on the reporting time data corresponding to the display refresh rate, and the i-th and (i-1)-th real touch coordinates, determine the Q-first interpolated touch coordinates located between the i-th and (i-1)-th real touch coordinates; Q is a positive integer. i is an integer, 1 < i ≤ N, where N is the total number of detection data fed back by the touch chip during one touch process.
[0120] The reporting time data also includes the value of Q; the reporting time of the i-th real touch coordinate is after the reporting time of the (i-1)-th real touch coordinate, and the reporting time of the first interpolated touch coordinate is between the reporting times of the two real touch coordinates adjacent to the first interpolated touch coordinate.
[0121] In some embodiments, the touch coordinates further include second interpolated touch coordinates. Step S3 further includes: determining at least Q second interpolated touch coordinates based on the last true touch coordinate. The reporting time of the second interpolated touch coordinates is after the reporting time of the last true touch coordinate.
[0122] In some embodiments, the microprocessor 100 reports at least two first interpolated touch coordinates between the reporting times of two adjacent real touch coordinates.
[0123] In some embodiments, step S4 may specifically include: after determining the second real touch coordinate, reporting each touch coordinate to the main control module in sequence according to the reporting time data.
[0124] In some embodiments, the reporting time interval Δt and the total number of touch coordinate reports N within 1 second satisfy the following relationship:
[0125] In some embodiments, for the same display refresh rate, the difference between any two reporting time intervals does not exceed 0.1ms. For different display refresh rates, the reporting frequency of touch coordinates is the same.
[0126] In some embodiments, the touch coordinate reporting method further includes: sending an enable signal to the main control module, wherein the enable signal is at a working level potential during the reporting phase and at a non-working level potential during the non-reporting phase; wherein the reporting phase is the phase of reporting a touch coordinate, and the non-reporting phase is the phase of not reporting a touch coordinate.
[0127] In a single touch operation, the microprocessor can determine a true touch coordinate based on the detection data from the touch chip at each touch stage. Specifically, the reporting stage corresponding to the k-th true touch coordinate occurs after the (k+1)-th touch stage; k is a positive integer and less than the total number of touch stages in a single touch operation.
[0128] The specific process of the touch coordinate reporting method can be found in the description of the touch driving device above, and will not be repeated here.
[0129] This disclosure also provides a touch display device. FIG4 is a schematic diagram of a touch display device provided in some embodiments of this disclosure. As shown in FIG4, the touch display device includes: a touch display panel 400 and the touch driving device 1 described above.
[0130] The touch chip 300 of the touch driver 1 can be set on the touch display panel 400, or it can be electrically connected to the touch display panel 400 through a flexible circuit board.
[0131] It is understood that the above embodiments are merely exemplary embodiments used to illustrate the principles of this disclosure, and this disclosure is not limited thereto. For those skilled in the art, various modifications and improvements can be made without departing from the spirit and substance of this disclosure, and these modifications and improvements are also considered to be within the scope of protection of this disclosure.
Claims
1. A touch coordinate reporting method, applied in the microprocessor of a touch display device, wherein, The touch coordinate reporting method includes: Receive the display synchronization signal and touch synchronization signal sent by the timing controller of the touch display device; The current display refresh rate is determined based on the display synchronization signal; and the corresponding reporting time data is determined based on the display refresh rate. According to the touch synchronization signal, the touch chip is controlled to perform touch detection during the touch period, and the touch coordinates are determined according to the detection data of the touch chip; Based on the reported time data, the touch coordinates are reported to the main control module of the touch display device; The reporting time data includes the reporting time interval between two adjacent touch coordinates, and the reporting time interval is less than or equal to 1 / fmax, where fmax is the maximum value that the display refresh rate can reach.
2. The touch coordinate reporting method according to claim 1, wherein, The touch synchronization signal switches between a first level potential and a second level potential, and the touch coordinates include real touch coordinates and first interpolated touch coordinates; Based on the touch synchronization signal, the touch chip is controlled to perform touch detection during the touch period, and the touch coordinates are determined based on the detection data from the touch chip, specifically including: In response to the first level potential in the touch synchronization signal, the touch chip is controlled to perform touch detection; In response to the detection data fed back by the touch chip for the i-th time, the i-th real touch coordinate is determined, and based on the reporting time data corresponding to the display refresh rate, and the i-th and (i-1)-th real touch coordinates, Q first interpolated touch coordinates located between the i-th and (i-1)-th real touch coordinates are determined; i is an integer, 1 < i ≤ N, N is the total number of detection data fed back by the touch chip in one touch process; Q is a positive integer; The reporting time data also includes the value of Q; the reporting time of the i-th real touch coordinate is after the reporting time of the (i-1)-th real touch coordinate, and the reporting time of the first interpolated touch coordinate is between the reporting times of the two real touch coordinates adjacent to the first interpolated touch coordinate.
3. The touch coordinate reporting method according to claim 2, wherein, The touch coordinates also include second interpolated touch coordinates; The method of controlling the touch chip to perform touch detection during the touch period according to the touch synchronization signal, and determining the touch coordinates according to the detection data of the touch chip, further includes: Determine at least Q second interpolated touch coordinates based on the last actual touch coordinate; The reporting time of the second interpolated touch coordinate is after the reporting time of the last actual touch coordinate.
4. The touch coordinate reporting method according to claim 2, wherein, At least two of the first interpolated touch coordinates are reported between the reporting times of two adjacent actual touch coordinates.
5. The touch coordinate reporting method according to claim 2, wherein, Based on the reported time data, the touch coordinates are reported to the main control module of the touch display device, specifically including: After determining the second actual touch coordinate, each touch coordinate is sequentially reported to the main control module according to the reporting time data.
6. The touch coordinate reporting method according to any one of claims 1 to 5, wherein, The reporting time interval Δt and the total number of times N of the touch coordinates are reported within 1 second satisfy the following:
7. The touch coordinate reporting method according to any one of claims 1 to 5, wherein, For the same display refresh rate, the difference between any two reporting time intervals shall not exceed 0.1ms.
8. The touch coordinate reporting method according to any one of claims 1 to 5, wherein, The reporting frequency of the touch coordinates is the same for different display refresh rates.
9. The touch coordinate reporting method according to any one of claims 1 to 5, wherein, The touch coordinate reporting method also includes: An enable signal is sent to the main control module. The enable signal is at a working level during the reporting phase and at a non-working level during the non-reporting phase. The reporting phase is the phase of reporting one of the touch coordinates, and the non-reporting phase is the phase of not reporting the touch coordinates.
10. The touch coordinate reporting method according to claim 9, wherein, The touch synchronization signal switches between a first level potential and a second level potential, and the touch coordinates include real touch coordinates and first interpolated touch coordinates; In a single touch event, the reporting stage corresponding to the kth real touch coordinate is after the (k+1)th touch stage; k is a positive integer and is less than the total number of touch stages included in a single touch event.
11. The touch coordinate reporting method according to any one of claims 1 to 5, wherein, The corresponding reporting time data is determined based on the display refresh rate, specifically including: Based on the pre-stored correspondence between multiple display refresh rates and their corresponding reporting time data, the reporting time data corresponding to the current display refresh rate is determined.
12. A touch driving device for use in a touch display device, wherein, The touch driving device includes: a touch chip, a timing controller, and a microprocessor, wherein... The timing controller is configured to generate a display synchronization signal and a touch synchronization signal with the same frequency based on the image data to be displayed. The microprocessor is configured to send a first control signal to the touch chip during the touch phase, based on the touch synchronization signal. The touch chip is configured to, in response to the first control signal, perform touch detection on the touch display panel and feed back the detection data to the microprocessor; The microprocessor is further configured to: determine touch coordinates based on the detection data; determine the current display refresh rate based on the display synchronization signal; and report the touch coordinates to the main control module of the touch display device based on the display refresh rate. Wherein, the reporting time interval between two adjacent touch coordinates is less than or equal to 1 / fmax, where fmax is the maximum value that the display refresh rate can reach.
13. The touch driving device according to claim 12, wherein, The microprocessor includes: The time determination module is configured to determine the current display refresh rate based on the display synchronization signal, and to determine the corresponding reporting time data based on the display refresh rate. The touch detection module is configured to send a first control signal to the touch chip during the touch phase according to the touch synchronization signal, and to determine the touch coordinates according to the detection data of the touch chip; The reporting module is configured to report the touch coordinates to the main control module based on the reporting time data; The reporting time data includes the reporting time interval between two adjacent touch coordinates.
14. The touch driving device according to claim 13, wherein, The touch synchronization signal switches between a first level potential and a second level potential, and the touch coordinates include real touch coordinates and first interpolated touch coordinates; The touch detection module is specifically configured to send the first control signal to the touch chip in response to the first level potential in the touch synchronization signal; as well as, In response to the detection data fed back by the touch chip for the i-th time, the i-th real touch coordinate is determined, and based on the reporting time data corresponding to the display refresh rate, and the i-th and (i-1)-th real touch coordinates, Q first interpolated touch coordinates located between the i-th and (i-1)-th real touch coordinates are determined; i is an integer, 1 < i ≤ N, N is the total number of detection data fed back by the touch chip in one touch process; Q is a positive integer; The reporting time data also includes the value of Q; the reporting time of the i-th real touch coordinate is after the reporting time of the (i-1)-th real touch coordinate, and the reporting time of the first interpolated touch coordinate is between the reporting times of the two real touch coordinates adjacent to the first interpolated touch coordinate.
15. The touch driving device according to claim 14, wherein, The touch coordinates also include second interpolated touch coordinates; The touch detection module is also configured to determine at least Q second interpolated touch coordinates based on the last real touch coordinate; The reporting time of the second interpolated touch coordinate is after the reporting time of the last actual touch coordinate.
16. The touch driving device according to claim 14, wherein, The reporting module reports at least two of the first interpolated touch coordinates between the reporting times of two adjacent actual touch coordinates.
17. The touch driving device according to any one of claims 12 to 16, wherein, The microprocessor is specifically configured to, after determining the second actual touch coordinate, report each touch coordinate sequentially to the main control module.
18. The touch driving device according to any one of claims 12 to 16, wherein, The reporting time interval Δt and the total number of times N, in which the microprocessor reports the touch coordinates within 1 second, satisfy the following relationship:
19. The touch driving device according to any one of claims 12 to 16, wherein, For the same display refresh rate, the difference between any two reporting time intervals shall not exceed 0.1ms.
20. The touch driving device according to any one of claims 12 to 16, wherein, The microprocessor reports the touch coordinates at the same frequency for different display refresh rates.
21. The touch driving device according to any one of claims 12 to 16, wherein, The microprocessor is also configured to, An enable signal is sent to the main control module. The enable signal is at a working level during the reporting phase and at a non-working level during the non-reporting phase. The reporting phase is the phase of reporting one of the touch coordinates, and the non-reporting phase is the phase of not reporting the touch coordinates.
22. The touch driving device according to claim 21, wherein, The touch synchronization signal switches between a first level potential and a second level potential, and the touch coordinates include real touch coordinates and first interpolated touch coordinates; In a single touch event, the reporting stage corresponding to the kth real touch coordinate is after the (k+1)th touch stage; k is a positive integer and is less than the total number of touch stages included in a single touch event.
23. The touch driving device according to any one of claims 13 to 16, wherein, The touch driving device also includes a memory, which stores a preset correspondence between multiple display refresh rates and corresponding reporting time data; Specifically, the time determination module is configured to determine the current display refresh rate based on the display synchronization signal, and to retrieve the reporting time data corresponding to the current display refresh rate from the memory.
24. The touch driving device according to any one of claims 12 to 16, wherein, The timing controller is specifically configured to determine whether the image data to be displayed is the same as the image data of the previous P frames. If they are the same, a display synchronization signal and a touch synchronization signal of the first frequency are generated; if they are different, a display synchronization signal and a touch synchronization signal of the second frequency are generated. The first frequency is less than the second frequency; P is a preset integer greater than 1.
25. A touch display device, wherein, include: A touch display panel and a touch driving device electrically connected to the touch display panel, wherein the touch driving device is the touch driving device according to any one of claims 12 to 24.