Touch scanning method and device, computer equipment and storage medium
By first performing a low-power first sampling scan during the refresh blank period and then performing a high-precision second sampling scan after detecting an interaction event, the problem of balancing touch response delay and software and hardware power consumption is solved, and the user experience is improved.
Patent Information
- Application Number
- CN202410339320.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-03-22
- Publication Date
- 2025-09-23
AI Technical Summary
Existing technologies make it difficult to optimize touch response latency while taking into account both software and hardware power consumption, resulting in a poor user experience.
During the refresh blank period of the touch display, a low-power first sampling scan is performed first. When an interaction event is detected, a high-precision second sampling scan is performed during the same refresh blank period to determine the specific information of the interaction event.
It significantly reduces the power consumption of software and hardware, while increasing the touch response speed, improving the user experience, and achieving a balance between response latency and power consumption.
Smart Images

Figure CN120686988A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of touch sampling technology, and in particular to a touch scanning method, apparatus, computer equipment, and storage medium. Background Art
[0002] With the rapid development and widespread adoption of mobile devices like smartphones and tablets, touchscreens, as the most crucial interface for human-computer interaction, are finding increasing use in a wide range of scenarios. As a crucial factor impacting user experience, optimizing touch response latency has become a pressing issue. Existing technologies often struggle to balance response latency with hardware and software power consumption. Summary of the Invention
[0003] To overcome the problems existing in the related art, the present disclosure provides a touch scanning method, apparatus, computer device and storage medium.
[0004] A first aspect of the present disclosure provides a touch scanning method, the method comprising:
[0005] Performing touch scanning based on the first sampling during a current refresh blank period of the touch display screen, wherein the touch scanning is used to collect interaction events of the touch display screen;
[0006] In response to the touch scan based on the first sample capturing an interaction event, performing touch scan based on the second sample during a current refresh blank period of the touch display screen;
[0007] The number of points collected by the second sampling in each sampling round is greater than the number of points collected by the first sampling in each sampling round, and / or the number of sampling rounds for the second sampling is greater than the number of sampling rounds for the first sampling.
[0008] Optionally, performing touch scanning based on the first sample during a current refresh blank period of the touch display screen includes:
[0009] In response to the touch display screen reaching a refresh blank period, touch scanning is performed based on the first sampling within a first duration, so that the difference between the duration of the refresh blank period and the first duration is greater than or equal to the execution duration of the touch scanning based on the second sampling.
[0010] Optionally, in response to the touch scanning based on the first sampling capturing an interaction event, performing touch scanning based on the second sampling during a current refresh blank period of the touch display screen includes:
[0011] In response to the touch scan based on the first sampling capturing an interaction event, touch scan is performed based on the second sampling within a second time period, so that the touch scan based on the second sampling is completed within the current refresh blank period.
[0012] Optionally, in response to the touch scanning based on the first sampling capturing an interaction event, performing touch scanning based on the second sampling during a current refresh blank period of the touch display screen includes:
[0013] In response to the touch scan based on the second sampling not being completed in the current refresh blank period, the current refresh blank period is extended so that the touch scan based on the second sampling is completed in the current refresh blank period.
[0014] Optionally, the refresh blank period includes a frame refresh blank period of the touch display screen.
[0015] Optionally, the method further includes:
[0016] In response to the touch scan based on the second sampling capturing an interaction event, performing touch scan based on the third sampling in each refresh blank period after the touch display screen;
[0017] The number of points collected by the third sampling in each sampling round is not less than the number of points collected by the second sampling in each sampling round, and / or the number of sampling rounds of the third sampling is not less than the number of sampling rounds of the second sampling.
[0018] Optionally, the method further includes:
[0019] In response to the touch scan based on the third sampling performed during a preset number of consecutive refresh blank periods not collecting any interaction events, a touch scan is performed based on the first sampling during each refresh blank period after the touch display screen.
[0020] Optionally, the touch scan based on the first sampling is used to determine whether the interaction event occurs on the touch display screen, and the touch scan based on the second sampling is used to determine the content of the interaction event, which includes the coordinates of the interaction event.
[0021] Optionally, the method further includes:
[0022] In response to the touch scanning based on the first sampling and / or the second sampling capturing the interaction event, the touch display screen is activated so that the touch display screen responds to the interaction event.
[0023] Optionally, the method further includes:
[0024] In response to the touch scanning based on the first sampling and / or the second sampling capturing the interaction event, an interrupt signal is sent to the processor, so that the processor responds to the interaction event.
[0025] A second aspect of the present disclosure provides a touch scanning device, the device comprising:
[0026] A first sampling module, configured to perform touch scanning based on a first sample during a current refresh blank period of the touch display screen, wherein the touch scanning is configured to collect interaction events of the touch display screen;
[0027] a second sampling module configured to, in response to the touch scanning based on the first sampling capturing an interaction event, perform touch scanning based on the second sampling during a current refresh blank period of the touch display screen;
[0028] The number of points collected by the second sampling in each sampling round is greater than the number of points collected by the first sampling in each sampling round, and / or the number of sampling rounds for the second sampling is greater than the number of sampling rounds for the first sampling.
[0029] Optionally, the first sampling module is configured to, when performing touch scanning based on the first sampling during the current refresh blank period of the touch display screen,:
[0030] In response to the touch display screen reaching a refresh blank period, touch scanning is performed based on the first sampling within a first duration, so that the difference between the duration of the refresh blank period and the first duration is greater than or equal to the execution duration of the touch scanning based on the second sampling.
[0031] Optionally, the second sampling module is configured to, in response to the touch scanning based on the first sampling capturing an interaction event, perform touch scanning based on the second sampling during a current refresh blank period of the touch display screen, to:
[0032] In response to the touch scan based on the first sampling capturing an interaction event, touch scan is performed based on the second sampling within a second time period, so that the touch scan based on the second sampling is completed within the current refresh blank period.
[0033] Optionally, the second sampling module is configured to, in response to the touch scanning based on the first sampling capturing an interaction event, perform touch scanning based on the second sampling during a current refresh blank period of the touch display screen, to:
[0034] In response to the touch scan based on the second sampling not being completed in the current refresh blank period, the current refresh blank period is extended so that the touch scan based on the second sampling is completed in the current refresh blank period.
[0035] Optionally, the refresh blank period includes a frame refresh blank period of the touch display screen.
[0036] Optionally, the device further includes:
[0037] a third sampling module, configured to, in response to the touch scanning based on the second sampling capturing an interaction event, perform touch scanning based on the third sampling in each refresh blank period after the touch display screen is activated;
[0038] The number of points collected by the third sampling in each sampling round is not less than the number of points collected by the second sampling in each sampling round, and / or the number of sampling rounds of the third sampling is not less than the number of sampling rounds of the second sampling.
[0039] Optionally, the device further includes:
[0040] A reset module is used to perform touch scanning based on the first sampling in each refresh blank period after the touch display screen in response to the touch scanning based on the third sampling performed during a preset number of consecutive refresh blank periods not collecting an interaction event.
[0041] Optionally, the touch scan based on the first sampling is used to determine whether the interaction event occurs on the touch display screen, and the touch scan based on the second sampling is used to determine the content of the interaction event, which includes the coordinates of the interaction event.
[0042] Optionally, the device further includes:
[0043] The first response module is configured to activate the touch display screen in response to the interaction event being collected by the touch scanning based on the first sampling and / or the second sampling, so that the touch display screen responds to the interaction event.
[0044] Optionally, the device further includes:
[0045] The second response module is configured to send an interrupt signal to the processor in response to the touch scanning based on the first sampling and / or the second sampling capturing the interaction event, so that the processor responds to the interaction event.
[0046] A third aspect of the present disclosure provides a computer program product, comprising a computer program / instruction, which implements the method described in the first aspect when executed by a processor.
[0047] A fourth aspect of the present disclosure provides a computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method described in the first aspect when executing the program.
[0048] A fifth aspect of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, which implements the method described in the first aspect when the program is executed by a processor.
[0049] The technical solutions provided by the embodiments of the present disclosure may have the following beneficial effects:
[0050] In an embodiment of the present disclosure, during the current refresh blank period of the touch display screen, a first sampling operation with a smaller number of sampling rounds or points collected in each sampling round is first performed. After the touch scan based on the first sampling captures an interaction event, a second sampling operation with a larger number of sampling rounds or points collected in each sampling round is performed during the same refresh blank period as the first sampling operation. Both the first sampling operation and the second sampling operation are used to perform touch scanning. The method provided by the present disclosure significantly reduces the power consumption of the method's software and hardware while increasing the touch response speed, thereby significantly improving the user experience and achieving a balance between software and hardware power consumption and touch response speed.
[0051] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0052] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0053] Figure 1 FIG. 4 is a flow chart of a touch scanning method according to some exemplary embodiments.
[0054] Figure 2 is a flow chart of another touch scanning method shown in some exemplary embodiments.
[0055] Figure 3 is a flow chart of yet another touch scanning method shown in some exemplary embodiments.
[0056] Figure 4 FIG. 1 is a schematic diagram illustrating an application of a touch scanning method according to some exemplary embodiments.
[0057] Figure 5 FIG. 4 is a block diagram of a touch scanning device showing some exemplary embodiments.
[0058] Figure 6 FIG. 4 is a hardware structure diagram of a computer device shown in some exemplary embodiments. DETAILED DESCRIPTION
[0059] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all possible embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
[0060] The terms used in this disclosure are for the purpose of describing specific embodiments only and are not intended to limit the disclosure. As used in this disclosure and the appended claims, the singular forms "a," "an," "the," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
[0061] It should be understood that although the terms first, second, third, etc. may be used in this disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from each other. For example, without departing from the scope of this disclosure, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining."
[0062] With the rapid development and widespread adoption of mobile devices like smartphones and tablets, touchscreens, as the most crucial interface for human-computer interaction, are finding increasing use in a wide range of scenarios. As a crucial factor impacting user experience, optimizing touch response latency has become a pressing issue. Existing technologies often struggle to balance response latency with hardware and software power consumption.
[0063] In view of this, the present disclosure provides a touch scanning method, apparatus, computer device, and storage medium.
[0064] Next, the embodiments of the present disclosure are described in detail.
[0065] The first aspect of the present disclosure provides a touch scanning method. Figure 1 , which includes the following steps:
[0066] Step S101, performing touch scanning based on a first sample during a current refresh blank period of the touch display screen, wherein the touch scanning is used to collect interaction events of the touch display screen;
[0067] Step S102: in response to the touch scan based on the first sample capturing an interaction event, performing touch scan based on the second sample during a current refresh blank period of the touch display screen;
[0068] The number of points collected by the second sampling in each sampling round is greater than the number of points collected by the first sampling in each sampling round, and / or the number of sampling rounds for the second sampling is greater than the number of sampling rounds for the first sampling.
[0069] For a touch screen display, the interaction event may refer to a contact event between a part of the human body and the touch screen display (i.e., a touch event), such as a joint touch event, a fingertip touch event, etc. The refresh blank period may refer to a row refresh blank period generated after the touch screen display completes a row refresh (i.e., after the display screen refreshes a row of pixels, it switches to the next row for refresh and generates a refresh blank period, which is also commonly referred to as Hsync Blanking), or a frame refresh blank period generated after the touch screen display completes a frame refresh (i.e., after the display screen completes a frame page refresh, it waits for the next frame refresh and generates a frame refresh blank period, which is also commonly referred to as Vsync Blanking; wherein, each frame refresh may be triggered by a vertical synchronization signal sent by a processor or other related components). Based on this, time-sharing multiplexing of the touch and display functions of the touch screen display can be achieved, reducing the difficulty of circuit design and increasing the service life of the touch screen display. Optionally, the above method can be executed during the frame refresh blank period of the touch display screen, so that the first sampling and the possible second sampling can be completed within the same refresh blank period without changing the refresh rhythm of the touch display screen, so as to minimize the aging speed and damage risk of the display screen.
[0070] The sampling (i.e., the first sampling, the second sampling, etc.) may refer to the specific sampling process performed on the touch display screen during the scanning process (i.e., touch scanning) of the touch display screen for detecting the interactive event. In the following text, “performing touch scanning based on the first sampling” may be referred to as “performing first sampling”, and “performing touch scanning based on the second sampling” may be referred to as “performing second sampling”, but the meaning of the representation remains unchanged. This scanning process is usually composed of multiple sampling rounds. In each sampling round, the execution module of the method can sample preset points on the touch display screen (for example, the screen is divided into 200 rows and 50 columns, and then in each sampling round, it is determined whether an interactive event occurs in the 10,000 grids composed of the 200 rows and 50 columns, and the 10,000 grids are the preset points), and then the above sampling rounds are repeated a preset number of times to obtain more samples and improve the signal-to-noise ratio. In other words, the accuracy of this scanning process (which can also be understood as the signal-to-noise ratio of the samples collected during the scanning process) is generally determined by two dimensions: the number of points collected in each sampling round, that is, the scanning granularity of each sampling round; and the number of sampling rounds (that is, the number of times the sampling process is repeated for the entire screen). Each sampling round is a complete execution unit of the scanning process for an area (such as the entire screen or a sub-area of the screen). For example, one sampling method may scan 50 points on the screen in each sampling round and repeat this process twice (that is, the number of sampling rounds is 2). Exemplarily, the first sampling can be the usual Doze Scan (or low-precision sampling), and the second sampling can be the usual Active Scan (or high-precision sampling) or a customized sampling. Optionally, when the second sampling is a customized sampling, the accuracy of the second sampling can be made between the Doze Scan and the Active Scan to achieve a better balance between response time, power consumption, and screen aging speed. In addition, the software algorithm corresponding to the second sampling can also be simplified on the basis of Active Scan (or other customized software algorithms can be used) to shorten the execution time of the second sampling as much as possible while ensuring the accuracy of the second sampling, so that the first sampling and the second sampling can be completed within the same refresh blank period without changing the original refresh rhythm of the display screen. It should be understood that the module for executing the above-mentioned scanning process can be composed of multiple multiplexing circuits (MUX) to improve the accuracy of the method. The description of this in the present disclosure is a description of the method at the overall level, and the present disclosure does not limit the specific implementation circuit. In addition, the dimensions for determining sampling accuracy are not limited to the above two dimensions. For example, in order to better enable the first sampling and the second sampling to be completed within the same refresh blank period, the software algorithms for the first sampling and the second sampling can be optimized, and this disclosure does not impose any restrictions on this.
[0071] In the embodiment of the present disclosure, during the current refresh blank period of the touch display screen, a first sampling with a lower number of sampling rounds or a lower number of points collected in each sampling round is first performed, and after the touch scan based on the first sampling collects an interaction event, a second sampling with a higher number of sampling rounds or a higher number of points collected in each sampling round is performed during the same refresh blank period as the first sampling. Based on this, when there is no interaction event on the screen, the first sampling with low software and hardware power consumption can be used to implement the scanning of interaction events, and once the first sampling collects an interaction event, the second sampling is immediately performed during the same refresh blank period to obtain more accurate interaction event information, thereby greatly reducing the software and hardware power consumption of the method. Compared with the solution of executing ActiveScan in the next refresh blank period after Doze Scan collects an interaction event, this method greatly improves the touch response speed, greatly improves the user experience, and achieves a balance between software and hardware power consumption and touch response speed.
[0072] In order to enable the first sampling and the possible second sampling to be completed within the same refresh blank period of the touch display screen, in some embodiments of the present disclosure, some optional methods are exemplarily provided, including the following three.
[0073] The first optional method: the touch scan is performed based on the first sample during the current refresh blank period of the touch display screen, including, in response to the touch display screen reaching the refresh blank period, performing the touch scan based on the first sample within a first duration, so that the difference between the duration of the refresh blank period and the first duration is greater than or equal to the execution duration of the touch scan based on the second sample.
[0074] In other words, in this method, the start time of the first sampling can be made close to the start time of the refresh blank period of the touch display screen, and by pre-setting the number of points collected by the first sampling in each sampling round and the number of sampling rounds, the first sampling and the possible second sampling can be completed within the first time period after the refresh blank period of the touch display screen starts.
[0075] The second optional method: in response to the touch scan based on the first sampling collecting an interaction event, performing the second sampling within the current refresh blank period of the touch display screen, including in response to the touch scan based on the first sampling collecting an interaction event, performing the second sampling within a second time period, so that the touch scan based on the second sampling is completed within the current refresh blank period.
[0076] Similarly, in this method, the start time of the second sampling can be made close to the time when the first sampling collects the interaction event, and by pre-setting the number of points collected by the second sampling in each sampling round and the number of sampling rounds, the second sampling can be completed within the second time period after the first sampling collects the interaction event, and the second sampling can be completed within the current refresh blank period.
[0077] A third optional method: in response to the touch scan based on the first sampling capturing an interaction event, a second sampling is performed within the current refresh blank period of the touch display screen, including, in response to the touch scan based on the second sampling not being completed within the current refresh blank period, extending the current refresh blank period so that the touch scan based on the second sampling is completed within the current refresh blank period.
[0078] Specifically, in response to the touch display screen being about to trigger the next refresh (for example, the touch display screen receives an instruction to trigger the next row refresh or frame refresh, or the conditions for triggering the next row refresh or frame refresh are met at the current moment) and the second sampling has not been completed, the triggering timing of the next refresh of the touch display screen can be delayed for a preset period of time, or the triggering timing can be corrected to the timing when the second sampling is completed, so that the second sampling can be completed within the same refresh blank period of the first sampling, thereby improving the touch response speed as much as possible while taking into account the power consumption of the method execution.
[0079] In some embodiments of the present disclosure, Figure 2 As shown, the method may further include:
[0080] S201: in response to the touch scan based on the second sampling capturing an interaction event, performing touch scan based on the third sampling in each refresh blank period after the touch display screen is touched;
[0081] The number of points collected by the third sampling in each sampling round is not less than the number of points collected by the second sampling in each sampling round, and / or the number of sampling rounds of the third sampling is not less than the number of sampling rounds of the second sampling.
[0082] For explanations about interactive events, refresh blank periods, number of points, and number of sampling rounds, please refer to the relevant parts in the previous text and will not be repeated here. The number of points and number of sampling rounds collected by the third sampling in each sampling round can be the same as the second sampling, or more than the second sampling. In other words, the sampling accuracy of the third sampling can be the same as the second sampling (the third sampling can also be completed directly based on the software and hardware configuration of the second sampling), or it can have a higher sampling accuracy than the second sampling. Exemplarily, when the second sampling is the usual Active Scan or a customized sampling between the Doze Scan and the Active Scan, the third sampling can be an Active Scan, or a customized sampling with the same or higher accuracy as the second sampling. In the above steps, in response to the second sampling collecting the interactive event, the third sampling is performed during the refresh blank period after the touch display screen to adapt to the user's next possible interactive operations (such as drag events, continuous click events), and while ensuring the touch response speed, improve the touch sampling accuracy.
[0083] In addition, when the first sampling or the second sampling captures the interaction event, the touch display screen can be activated (for example, an interrupt signal is sent to the control module of the touch display screen, or an interrupt signal is sent to the processor so that the processor controls the touch display screen to respond to the interaction event) to enable the touch display screen to respond to the interaction event (for example, resetting the screen off countdown, changing the refresh rate, changing the sampling accuracy of the touch sampling, etc.); an interrupt signal can also be sent to the processor so that the processor responds to the interaction event (for example, improving). This is to adapt to the user's next possible interaction operation, and while ensuring the touch response speed, the touch sampling accuracy is improved, thereby greatly improving the user experience.
[0084] In some embodiments of the present disclosure, the method may further include: Figure 3 The following steps are shown:
[0085] Step S301: In response to the fact that the touch scan based on the third sampling performed during a preset number (for example, N, where N is a positive integer) of consecutive refresh blank periods does not collect any interaction events, a touch scan based on the first sampling is performed during each refresh blank period after the touch display screen.
[0086] In other words, in step S201, after the second sampling collects an interaction event, the third sampling can be executed in the next refresh blank period (at this time, the first sampling and the second sampling can no longer be executed), so as to give the user a touch response with the highest response speed and response accuracy after detecting the user's interaction intention, thereby improving the user experience; and when the third sampling executed in a preset number of consecutive refresh blank periods collects an interaction event, it can be considered that the user has temporarily lost the interaction intention, then in the next refresh blank period, the first sampling can be executed, and after the first sampling collects the interaction event, the second sampling can be executed in the same refresh blank period (that is, re-execute the steps described in step S101, step S102 to step S201, step S301), thereby forming a complete progressive chain of "first sampling-second sampling-third sampling-return to first sampling" that is adapted to the user's interaction intention, minimizing the power consumption of the method's software and hardware, and reducing the aging speed of the screen.
[0087] In the aforementioned steps, the first sampling can be used to roughly determine the content of the user's interaction event, and the second sampling can be used to accurately determine the content of the user's interaction event. In some embodiments of the present disclosure, the first sampling can be used to determine whether the interaction event has occurred on the touch screen display, and the second sampling can be used to determine the content of the interaction event, including the coordinates of the interaction event. In other words, the first sampling can be more focused on determining whether the user currently has interaction intent, while the second sampling can be more focused on the signal-to-noise ratio of the collected samples. In extreme cases, the content of the interaction event can be determined not based on the first sampling, but only used to determine whether an interaction event has occurred (i.e., whether the user currently has interaction intent). If the user currently has interaction intent, the second sampling is immediately triggered to determine the detailed content of the interaction event initiated by the user, such as the coordinates of the interaction event and the body part corresponding to the interaction event. Based on this, the method can minimize the power consumption of software and hardware and the aging rate of related components when the user does not have interaction intent (especially in scenarios where the user does not have interaction intent for a long time, such as when watching a video), while also taking into account the touch response time after the user's interaction intent is detected, significantly improving the user experience.
[0088] The following combination Figure 4 The application diagram shown further illustrates at least one of the above embodiments. Figure 4In the example shown, the touch sampling process occurs during the frame refresh blank period, the scanning frequency of the sampling process is 100K (i.e., 10μs per scan), and the TP (Touch Panel) adopts a 1:5 scheme, that is, the screen is divided into 5 MUXs for scanning; the second sampling scans 12 rounds in each Mux, that is, the time required for the second sampling is 10μs*12 times*5(Mux)=600μs; the first sampling scans 2 rounds in each MUX, that is, the time required for the second sampling is 10μs*2 times*5(Mux)=100μs; if the hardware switching time from the first sampling to the second sampling (i.e., the configuration time of the device's hardware and software from the first sampling to the second sampling) is 200μs , the frame refresh blank period of the device is above 100μs+200μs+600μs=900μs, which can ensure that the first sampling and the possible second sampling can be completed within the same frame refresh blank period (in this case, the first duration in some of the aforementioned embodiments can be set to 100μs and the second duration can be set to 800μs). Since the frame refresh blank period is usually 1000μs to 2000μs, the above steps can greatly improve the touch response time and significantly enhance the user experience without affecting the aging speed of related components.
[0089] exist Figure 4 In the example shown in FIG, there is a gap between the start time of the first sampling and the start time of the frame refresh blank period, but this is only an exemplary description and is not limited in this disclosure. Figure 4 In the four frame refresh blank periods shown, the user places a finger on the touch screen after the second frame refresh blank period starts and before the first sampling corresponding to the second frame refresh blank period starts, thereby starting an interaction event. At this time, the first sampling corresponding to the second frame refresh blank period will collect the occurrence of the interaction event, and the second sampling will be performed in the same frame refresh blank period to determine the interaction event information with a higher signal-to-noise ratio (an interrupt signal can be sent to the processor at this time to enable the processor to respond to the interaction event, or an interrupt signal can be sent to the processor immediately after the first sampling collects the interaction event to obtain the shortest touch response time). In the third frame refresh blank period, since the first and second sampling in the second frame refresh blank period collect the interaction event, it can be assumed that the user still has the intention to interact, and the third sampling can be performed to obtain the highest sampling signal-to-noise ratio. However, since the user has removed the finger before the third sampling (the interaction event ends), the third sampling does not collect the interaction event. When the aforementioned N is set to 1, the first sampling can be performed in the fourth frame refresh blank period, and the method is executed again according to the logic of the aforementioned steps S101 and S102.
[0090] Based on experimental data, compared to executing Active during the next refresh blank period after Doze Scan detects an interaction event, this method can reduce average touch latency from 27.9ms to 11.3ms (16.6ms faster), significantly improving the user experience. For the specific details and beneficial effects of the above steps, please refer to the relevant sections of the previous embodiment and will not be repeated here.
[0091] Corresponding to the aforementioned method embodiments, the present disclosure also provides embodiments of a device and a terminal to which the device is applied.
[0092] The second aspect of the present disclosure provides a touch scanning device, see Figure 5 , the device comprises:
[0093] A first sampling module 501 is configured to perform touch scanning based on a first sampling during a current refresh blank period of the touch display screen, wherein the touch scanning is configured to collect interaction events of the touch display screen;
[0094] A second sampling module 502 is configured to, in response to the touch scanning based on the first sampling capturing an interaction event, perform touch scanning based on the second sampling during a current refresh blank period of the touch display screen;
[0095] The number of points collected by the second sampling in each sampling round is greater than the number of points collected by the first sampling in each sampling round, and / or the number of sampling rounds for the second sampling is greater than the number of sampling rounds for the first sampling.
[0096] Optionally, the first sampling module is configured to, when performing touch scanning based on the first sampling during the current refresh blank period of the touch display screen,:
[0097] In response to the touch display screen reaching a refresh blank period, touch scanning is performed based on the first sampling within a first duration, so that the difference between the duration of the refresh blank period and the first duration is greater than or equal to the execution duration of the touch scanning based on the second sampling.
[0098] Optionally, the second sampling module is configured to, in response to the touch scanning based on the first sampling capturing an interaction event, perform touch scanning based on the second sampling during a current refresh blank period of the touch display screen, to:
[0099] In response to the touch scan based on the first sampling capturing an interaction event, touch scan is performed based on the second sampling within a second time period, so that the touch scan based on the second sampling is completed within the current refresh blank period.
[0100] Optionally, the second sampling module is configured to, in response to the touch scanning based on the first sampling capturing an interaction event, perform touch scanning based on the second sampling during a current refresh blank period of the touch display screen, to:
[0101] In response to the touch scan based on the second sampling not being completed in the current refresh blank period, the current refresh blank period is extended so that the touch scan based on the second sampling is completed in the current refresh blank period.
[0102] Optionally, the refresh blank period includes a frame refresh blank period of the touch display screen.
[0103] Optionally, the device further includes:
[0104] a third sampling module, configured to, in response to the touch scanning based on the second sampling capturing an interaction event, perform a third sampling in each refresh blank period after the touch display screen;
[0105] The number of points collected by the third sampling in each sampling round is not less than the number of points collected by the second sampling in each sampling round, and / or the number of sampling rounds of the third sampling is not less than the number of sampling rounds of the second sampling.
[0106] Optionally, the device further includes:
[0107] A reset module is used to perform touch scanning based on the first sampling in each refresh blank period after the touch display screen in response to the touch scanning based on the third sampling performed during a preset number of consecutive refresh blank periods not collecting an interaction event.
[0108] Optionally, the touch scan based on the first sampling is used to determine whether the interaction event occurs on the touch display screen, and the touch scan based on the second sampling is used to determine the content of the interaction event, which includes the coordinates of the interaction event.
[0109] Optionally, the device further includes:
[0110] The first response module is configured to activate the touch display screen in response to the interaction event being collected by the touch scanning based on the first sampling and / or the second sampling, so that the touch display screen responds to the interaction event.
[0111] Optionally, the device further includes:
[0112] The second response module is configured to send an interrupt signal to the processor in response to the touch scanning based on the first sampling and / or the second sampling capturing the interaction event, so that the processor responds to the interaction event.
[0113] The implementation process of the functions and effects of each module in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, and will not be repeated here.
[0114] A third aspect of the present disclosure provides a computer program product, comprising a computer program / instruction, which implements the method described in the first aspect when executed by a processor.
[0115] For the device embodiments and computer program product embodiments, since they basically correspond to the method embodiments, the relevant parts can be referred to the partial description of the method embodiments. In addition, the device embodiments described above are merely illustrative, wherein the modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the disclosed solution. Those of ordinary skill in the art can understand and implement it without paying any creative work.
[0116] In a fourth aspect, the embodiment of the touch scanning device provided by the present disclosure can be applied to computer equipment. Figure 6 , which exemplarily shows a hardware schematic diagram of a computer device. For example, device 600 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
[0117] Device 600 may include one or more of the following components: a processing component 601 , a memory 602 , a power component 603 , a multimedia component 604 , an audio component 605 , an input / output (I / O) interface 606 , a sensor component 607 , and a communication component 608 .
[0118] The processing component 601 generally controls the overall operation of the device 600, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 601 may include one or more processors 609 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 601 may include one or more modules to facilitate interaction between the processing component 601 and other components. For example, the processing component 601 may include a multimedia module to facilitate interaction between the multimedia component 604 and the processing component 601.
[0119] The memory 602 is configured to store various types of data to support operations on the device 600. Examples of such data include instructions for any application or method operating on the device 600, contact data, phone book data, messages, pictures, videos, etc. The memory 602 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.
[0120] The power component 603 provides power to the various components of the device 600. The power component 603 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device 600.
[0121] The multimedia component 604 includes a screen that provides an output interface between the device 600 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor can not only sense the boundaries of the touch or sliding action, but also detect the duration and pressure associated with the touch or sliding operation. In some embodiments, the multimedia component 604 includes a front camera and / or a rear camera. When the device 600 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.
[0122] The audio component 605 is configured to output and / or input audio signals. For example, the audio component 605 includes a microphone (MIC), which is configured to receive external audio signals when the device 600 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 602 or transmitted via the communication component 608. In some embodiments, the audio component 605 also includes a speaker for outputting audio signals.
[0123] The I / O interface 606 provides an interface between the processing component 601 and peripheral interface modules, such as a keyboard, a click wheel, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.
[0124] The sensor assembly 607 includes one or more sensors for providing various aspects of status assessment for the device 600. For example, the sensor assembly 607 can detect the open / closed state of the device 600, the relative positioning of components, such as the display and keypad of the device 600. The sensor assembly 607 can also detect changes in the position of the device 600 or a component of the device 600, the presence or absence of user contact with the device 600, the orientation or acceleration / deceleration of the device 600, and temperature changes of the device 600. The sensor assembly 607 can also include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 607 can also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 607 can also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
[0125] The communication component 608 is configured to facilitate wired or wireless communication between the device 600 and other devices. The device 600 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, 4G or 5G or a combination thereof. In an exemplary embodiment, the communication component 608 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 608 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
[0126] In an exemplary embodiment, the device 600 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the touch scanning method of the above-mentioned computer device.
[0127] In a fifth aspect, the present disclosure, in an exemplary embodiment, further provides a non-transitory computer-readable storage medium including instructions, such as a memory 602 including instructions. The instructions can be executed by a processor 609 of a device 600 to implement the touch scanning method of the computer device described above. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, or the like.
[0128] The foregoing description describes specific embodiments of the present disclosure. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that described in the embodiments and still achieve the desired results. Furthermore, the processes depicted in the accompanying drawings do not necessarily require the specific order shown or the sequential order to achieve the desired results. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0129] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the inventions claimed herein. This disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art not claimed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the following claims.
[0130] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
[0131] The above description is only a preferred embodiment of the present disclosure and is not intended to limit the present disclosure. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present disclosure should be included in the scope of protection of the present disclosure.
Claims
1. A touch scanning method, characterized in that: The method comprises: Performing touch scanning based on the first sampling during a current refresh blank period of the touch display screen, wherein the touch scanning is used to collect interaction events of the touch display screen; In response to the touch scan based on the first sample capturing an interaction event, performing touch scan based on the second sample during a current refresh blank period of the touch display screen; The number of points collected by the second sampling in each sampling round is greater than the number of points collected by the first sampling in each sampling round, and / or the number of sampling rounds for the second sampling is greater than the number of sampling rounds for the first sampling.
2. The touch scanning method according to claim 1, wherein: The performing touch scanning based on the first sample during the current refresh blank period of the touch display screen includes: In response to the touch display screen reaching a refresh blank period, touch scanning is performed based on the first sampling within a first duration, so that the difference between the duration of the refresh blank period and the first duration is greater than or equal to the execution duration of the touch scanning based on the second sampling.
3. The touch scanning method according to claim 1, wherein: In response to the touch scanning based on the first sampling capturing the interaction event, performing touch scanning based on the second sampling during the current refresh blank period of the touch display screen includes: In response to the touch scan based on the first sampling capturing an interaction event, touch scan is performed based on the second sampling within a second time period, so that the touch scan based on the second sampling is completed within the current refresh blank period.
4. The touch scanning method according to claim 1, wherein: In response to the touch scanning based on the first sampling capturing the interaction event, performing touch scanning based on the second sampling during the current refresh blank period of the touch display screen includes: In response to the touch scan based on the second sampling not being completed in the current refresh blank period, the current refresh blank period is extended so that the touch scan based on the second sampling is completed in the current refresh blank period.
5. The touch scanning method according to claim 1, wherein: The refresh blank period includes a frame refresh blank period of the touch display screen.
6. The touch scanning method according to claim 1, wherein: The method further comprises: In response to the touch scan based on the second sampling capturing an interaction event, performing touch scan based on the third sampling in each refresh blank period after the touch display screen; The number of points collected by the third sampling in each sampling round is not less than the number of points collected by the second sampling in each sampling round, and / or the number of sampling rounds of the third sampling is not less than the number of sampling rounds of the second sampling.
7. The touch scanning method according to claim 6, wherein: The method further comprises: In response to the touch scan based on the third sampling performed during a preset number of consecutive refresh blank periods not collecting any interaction events, a touch scan is performed based on the first sampling during each refresh blank period after the touch display screen.
8. The touch scanning method according to claim 1, wherein: The touch scan based on the first sampling is used to determine whether the interaction event occurs on the touch display screen, and the touch scan based on the second sampling is used to determine the content of the interaction event, which includes the coordinates of the interaction event.
9. The touch scanning method according to claim 1, wherein: The method further comprises: In response to the touch scanning based on the first sampling and / or the second sampling capturing the interaction event, the touch display screen is activated so that the touch display screen responds to the interaction event.
10. The touch scanning method according to claim 1, wherein: The method further comprises: In response to the touch scanning based on the first sampling and / or the second sampling capturing the interaction event, an interrupt signal is sent to the processor, so that the processor responds to the interaction event.
11. A touch scanning device, characterized in that: The device comprises: A first sampling module, configured to perform touch scanning based on a first sample during a current refresh blank period of the touch display screen, wherein the touch scanning is configured to collect interaction events of the touch display screen; a second sampling module configured to, in response to the touch scanning based on the first sampling capturing an interaction event, perform touch scanning based on the second sampling during a current refresh blank period of the touch display screen; The number of points collected by the second sampling in each sampling round is greater than the number of points collected by the first sampling in each sampling round, and / or the number of sampling rounds for the second sampling is greater than the number of sampling rounds for the first sampling.
12. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instructions are executed by a processor, the method according to any one of claims 1 to 10 is implemented.
13. A computer device, characterized in that: The method comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method according to any one of claims 1 to 10 is implemented.
14. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 10 is implemented.