Method, device and equipment for measuring touch operation response time and storage medium

Abstract

The application discloses a method, device and equipment for measuring a touch operation response time and a storage medium. The method comprises the following steps: obtaining a trigger start time point and a trigger end time point, wherein the trigger start time point and the trigger end time point are generated by an external first sensing component in response to a touch screen trigger mechanism triggering a touch operation; obtaining a first time point at which the touch screen generates a touch event based on the touch operation; obtaining a second time point at which the touch screen generates a display change in response to the touch event; and determining a first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the first time point and the second time point. In this way, the accuracy of the measured response time is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of touch control, and in particular to a method and device for measuring response time of a touch operation, an electronic device, and a storage medium. BACKGROUND

[0002] An electronic device usually has a touch screen for displaying corresponding content and receiving a touch operation of a user to switch the content. The time from when the electronic device receives the touch to when the electronic device responds to the touch is extremely important. Within a range that can be perceived by a human body, shortening the response time can improve the touch experience of the user.

[0003] Therefore, how to accurately measure the response time is a problem that needs to be solved urgently. SUMMARY

[0004] The present application provides a method and device for measuring response time of a touch operation, an electronic device, and a storage medium, which can improve the accuracy of the measured response time.

[0005] In a first aspect, the present application provides a method for measuring response time of a touch operation, which includes: obtaining a trigger start time point and a trigger end time point; wherein the trigger start time point and the trigger end time point are generated by an external first sensing component in response to a touch mechanism triggering a touch operation on a touch screen; obtaining a first time point at which the touch screen generates a touch event based on the touch operation; obtaining a second time point at which the touch screen generates a display change in response to the touch event; and determining a first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the first time point, and the second time point.

[0006] In a second aspect, the present application provides a device for measuring response time of a touch operation, which includes: a first obtaining module configured to obtain a trigger start time point and a trigger end time point; wherein the trigger start time point and the trigger end time point are generated by an external first sensing component in response to a touch mechanism triggering a touch operation on a touch screen; a second obtaining module configured to obtain a first time point at which the touch screen generates a touch event based on the touch operation; a third obtaining module configured to obtain a second time point at which the touch screen generates a display change in response to the touch event; and a determining module configured to determine a first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the first time point, and the second time point.

[0007] In a third aspect, the present application provides an electronic device, which includes a processor, a memory, and a touch screen coupled to the processor. The memory stores a computer program, and the processor is configured to execute the computer program to implement the method for measuring response time of a touch operation provided in the above embodiments.

[0008] In a fourth aspect, an embodiment of the present application provides a measuring device for touch operation response time, the measuring device comprising: an electronic device, the electronic device comprising a touch screen; a first sensing component, in communication connection with the electronic device, configured to send, to the electronic device, a trigger start time point and a trigger end time point generated in response to a touch mechanism triggering a touch operation on the touch screen; wherein the electronic device is configured to acquire a first time point at which the touch screen generates a touch event based on the touch operation, and acquire a second time point at which the touch screen generates a display change in response to the touch event; and determine a first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the first time point and the second time point.

[0009] In a fifth aspect, an embodiment of the present application provides a computer readable storage medium, the computer readable storage medium storing a computer program, the computer program being executed by a processor to implement the measuring method for touch operation response time provided in the above embodiments.

[0010] The present application has the following beneficial effects: Different from the prior art, the present application provides a measuring method, device, equipment and storage medium for touch operation response time, the method determining a first response time corresponding to a touch operation by acquiring a trigger start time point and a trigger end time point of a first sensing component, and acquiring a first time point at which a touch screen generates a touch event, and acquiring a second time point at which the touch screen generates a display change, associating the response time with time points of each stage inside the electronic device of the touch screen, and improving the accuracy of the measured response time. BRIEF DESCRIPTION OF DRAWINGS

[0011] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed in the embodiment description. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0012] In the drawings:

[0013] Figure 1 is a flowchart of an embodiment of the measuring method for touch operation response time provided by the present application;

[0014] Figure 2 is a flowchart of another embodiment of the measuring method for touch operation response time provided by the present application;

[0015] Figure 3 is a flowchart of an embodiment of step 24 provided by the present application;

[0016] Figure 4 is a flowchart of an embodiment of step 241 provided in the present application;

[0017] Figure 5 is a flowchart of another embodiment of the method for measuring the touch operation response time provided in the present application;

[0018] Figure 6 is a flowchart of an embodiment of step 55 provided in the present application;

[0019] Figure 7 is a flowchart of another embodiment of the method for measuring the touch operation response time provided in the present application;

[0020] Figure 8 is a flowchart of another embodiment of the method for measuring the touch operation response time provided in the present application;

[0021] Figure 9 is a structural diagram of an embodiment of the measuring device for touch operation response time provided in the present application;

[0022] Figure 10 is a structural diagram of an embodiment of the electronic device provided in the present application;

[0023] Figure 11 is a structural diagram of another embodiment of the electronic device provided in the present application;

[0024] Figure 12 is a structural diagram of an embodiment of the measuring device provided in the present application;

[0025] Figure 13 is a structural diagram of an embodiment of the first sensing component provided in the present application;

[0026] Figure 14 is a structural diagram of another embodiment of the measuring device provided in the present application;

[0027] Figure 15 、 Figure 16 、 Figure 17 and Figure 18 is a schematic diagram of an application scenario of the method for measuring the touch operation response time provided in the present application;

[0028] Figure 19 is a structural diagram of another embodiment of the measuring device provided in the present application;

[0029] Figure 20 is a structural diagram of an embodiment of the computer readable storage medium provided in the present application. DETAILED DESCRIPTION

[0030] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. It can be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application. In addition, it should be noted that, for the convenience of description, only the parts related to the present application are shown in the drawings, but not all the structures. Based on the embodiments in the present application, all the other embodiments obtained by those skilled in the art without creative work are within the scope of the present application.

[0031] Reference herein to“an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase that the phrase in various places in the specification are not necessarily all referring to the same embodiment, or are necessarily mutually exclusive or alternative embodiments. It is explicitly and implicitly understood that the embodiments described herein are combinable.

[0032] Reference is made to Figure 1 , Figure 1 is a flowchart of an embodiment of a method for measuring a touch operation response time provided by the present application. The method comprises:

[0033] Step 11: obtaining a trigger start time point and a trigger end time point; wherein the trigger start time point and the trigger end time point are generated by an external first sensing component in response to a touch mechanism triggering a touch operation on a touch screen.

[0034] In some embodiments, the touch screen is part of an electronic device, which is used to provide interface display and touch function to enable the electronic device to interact with different operators. The touch screen can be a capacitive screen or a resistive screen.

[0035] The touch mechanism can be a mechanical arm, a touch pen, a finger, or any object that can trigger a touch operation on the touch screen.

[0036] In some embodiments, the first sensing component can be arranged on one side of the touch screen. For example, the first sensing component can include a proximity switch. When the touch mechanism triggers a touch operation on the touch screen, the touch mechanism approaches the proximity switch, and the proximity switch is triggered to generate a corresponding trigger start time point. When the touch mechanism moves away from the proximity switch, the proximity switch is closed to generate a trigger end time point.

[0037] The touch operation can be a sliding operation on the touch screen or a clicking operation on the touch screen.

[0038] Step 12: obtaining a first time point at which the touch screen generates a touch event based on the touch operation.

[0039] Wherein, when the touch operation, the touch screen will generate corresponding report point. The generation of the report point means that the touch event will be generated. Therefore, the electronic device can record the first time point of generating the touch event.

[0040] The report point is the coordinate value of the touch point corresponding to the touch operation detected by the touch screen, that is, the horizontal coordinate value and the vertical coordinate value. For example, when the user performs a sliding operation on the touch screen, the touch screen will continuously detect a plurality of touch points and report them, forming a plurality of report points.

[0041] Step 13: obtaining the second time point of the touch screen responding to the touch event and generating display change.

[0042] Wherein, after the generation of the touch event, the electronic device will generate corresponding processing based on the touch event. For example, based on the touch event, the display of the touch screen is switched. For example, from the current interface to another interface. For example, based on the touch event, the display of the corresponding region of the touch screen is switched, and the display of the corresponding region changes. For example, the color of the corresponding region changes.

[0043] Thus, the change of the touch screen can be monitored to obtain the second time point of the touch screen responding to the touch event and generating display change.

[0044] Step 14: based on the trigger start time point, the trigger end time point, the first time point and the second time point, determining the first response time corresponding to the touch operation.

[0045] Wherein, the trigger start time point, the trigger end time point and the first time point can be used to determine the time from the start of the touch operation to the generation of the touch event by the touch screen.

[0046] Because the trigger start time point, the trigger end time point and the first time point are determined, and when the touch operation, the corresponding report point will be generated on the touch screen, the position of the report point will be recorded at this time. Thus, the linear relationship can be determined based on the trigger start time point and the trigger end time point, and then the time point of the report point can be determined based on the recorded position of the report point. Then, the first time point and the time point of the report point are used to determine the time from the report point to the generation of the touch event based on the report point.

[0047] Then, the second time point and the first time point can be used to determine the time of responding to the touch event and generating display change.

[0048] Thus, the response time from the touch operation to the display change of the touch screen can be determined.

[0049] In an application scenario, the touch operation response time measurement method provided by the present application is applied to an electronic device, and the electronic device comprises a touch screen.

[0050] The electronic device is in communication connection with the first sensing component, for obtaining a trigger start time point and a trigger end time point; wherein the trigger start time point and the trigger end time point are generated by the external first sensing component in response to the trigger mechanism triggering the touch operation on the touch screen.

[0051] The electronic device internally obtains a first time point at which the touch screen generates a touch event based on the touch operation; and a second time point at which the touch screen generates a display change in response to the touch event; and determines a first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the first time point and the second time point.

[0052] In another application scenario, the method for measuring the touch operation response time provided by the present application is applied to a measuring device.

[0053] The processing device is in communication connection with the electronic device and the first sensing component respectively. The processing device is used for obtaining a trigger start time point and a trigger end time point; wherein the trigger start time point and the trigger end time point are generated by the external first sensing component in response to the trigger mechanism triggering the touch operation on the touch screen; and obtaining a first time point at which the touch screen of the electronic device generates a touch event based on the touch operation; obtaining a second time point at which the touch screen generates a display change in response to the touch event; and determining a first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the first time point and the second time point.

[0054] In the embodiment, by obtaining the trigger start time point and the trigger end time point of the first sensing component, and obtaining the first time point at which the touch screen generates a touch event, and obtaining the second time point at which the touch screen generates a display change, the first response time corresponding to the touch operation is determined by using the time points of each stage inside the electronic device of the touch screen and the time points of the first sensing component, the response time is associated with the time points of each stage inside the electronic device of the touch screen, and the accuracy of the measured response time can be improved.

[0055] Further, the response can be improved according to the time points of each stage inside the electronic device, so as to speed up the response time to the touch operation.

[0056] Referring to Figure 2 , Figure 2 is a flowchart of another embodiment of the method for measuring the touch operation response time provided by the present application. The method comprises:

[0057] Step 21: obtaining a trigger start time point and a trigger end time point; wherein the trigger start time point and the trigger end time point are generated by an external first sensing component in response to the touch mechanism triggering the touch screen to trigger a touch operation.

[0058] In some embodiments, the first sensing component includes a transmitter, a receiver and a communication module. The transmitter is used to transmit an optical signal, and the receiver is used to receive the optical signal. When the touch mechanism performs a touch operation on the touch screen, the receiver will be blocked from receiving the optical signal, and then the trigger start time point will be generated. After the touch mechanism moves away from the transmitter, the receiver will receive the optical signal again, and then the trigger end time point will be generated. Then the trigger start time point and the trigger end time point are sent to the corresponding processing device through the communication module. The processing device can be the electronic device itself that has the touch screen, or a separate processing device.

[0059] Step 22: obtaining a first time point at which the touch screen generates a touch event based on the touch operation.

[0060] Steps 21-22 have the same or similar technical solutions as the above-mentioned embodiments, and will not be described here.

[0061] Step 23: obtaining a third time point at which an external second sensing component is triggered; wherein the second sensing component is triggered by a display change of the touch screen.

[0062] The second sensing component can include a photoelectric sensor and a communication module. When the touch screen generates a display change, light change will occur. Therefore, the photoelectric sensor is used to detect whether the touch screen generates a display change. If yes, the photoelectric sensor is triggered, and the third time point at which the photoelectric sensor is triggered is recorded.

[0063] The photoelectric sensor and the communication module are connected, and the third time point is sent to the corresponding processing device through the communication module.

[0064] The third time point is used as the second time point in the above-mentioned embodiments.

[0065] Step 24: determining a first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the first time point and the third time point.

[0066] In some embodiments, referring to Figure 3 , step 24 can be the following flow:

[0067] Step 31: determining a first time period based on the trigger start time point, the trigger end time point and the first time point.

[0068] The trigger start time point and the trigger end time point can be used to calculate the time period from the trigger start to the trigger end of the touch mechanism, and based on the two time points, a linear relationship can be determined.

[0069] The time from the target of the touch screen to the generation of the target point is determined by linear interpolation.

[0070] In an application scenario, the touch operation is a sliding operation, and during the sliding process, corresponding points are generated. The touch screen generates subsequent corresponding touch events only after detecting the points. When the touch point is determined on the touch screen, the coordinates of the touch point can be known simultaneously. Thus, the time from the generation of the point to the generation of the touch event can be further determined according to the coordinates of the point.

[0071] In combination with Figure 4 The following is described:

[0072] Step 41: Obtain the coordinates of the point triggering the touch operation on the touch screen, and the first coordinates corresponding to the trigger start time point and the second coordinates corresponding to the trigger end time point.

[0073] Step 42: Determine the target time point of the generation of the point based on the coordinates of the point, the first coordinates, the second coordinates, the trigger start time point, and the trigger end time point.

[0074] It can be understood that during the sliding operation, the touch screen can only determine the coordinates of the point when the point is generated. Therefore, the related information of the first sensing component needs to be combined for calculation to obtain the target time point of the generation of the point.

[0075] For example, the sliding operation is uniform sliding or linear sliding. For example, the sliding speed gradually increases according to the proportion, or the sliding speed gradually decreases according to the proportion. Thus, when the trigger start time point and the trigger end time point are determined, the first coordinates corresponding to the trigger start time point and the second coordinates corresponding to the trigger end time point can be determined simultaneously. Then, according to the distance between the first coordinates and the second coordinates, in combination with the sliding proportion, the time required for sliding within a unit distance can be calculated. Further, the time of the generation of the point triggering the touch operation can be determined based on the coordinates of the point.

[0076] The time of the generation of the point triggering the touch operation can be before the trigger start time point, after the trigger end time point, or between the trigger start time point and the trigger end time point. After the sliding trajectory is determined by using the first coordinates, the second coordinates, the trigger start time point, and the trigger end time point, the generation time of any point can be determined.

[0077] Step 43: Determine the first time period by using the first time point and the target time point.

[0078] The first time period is obtained by subtracting the target time point from the first time point. The first time period can represent the time taken from the report point to the generation of the touch event.

[0079] Step 32: Determine the second time period based on the third time point and the first time point.

[0080] The second time period is obtained by subtracting the first time point from the third time point. The second time period can represent the time taken for the touch screen to respond to the touch event.

[0081] Step 33: Determine the first response time based on the first time period and the second time period.

[0082] The first response time is determined by adding the first time period and the second time period. The first response time represents the time taken for the touch screen to respond to the touch event.

[0083] In this embodiment, the first trigger start time point and the first trigger end time point of the first sensor component are obtained, as well as the first time point at which the touch screen generates a touch event. The third time point at which the second sensor component is triggered externally is obtained, and the first response time corresponding to the touch operation is determined. The time points of each stage inside the electronic device of the touch screen, the time points of the first sensor component and the second sensor component are used to determine the first response time corresponding to the touch operation, so that the response time is associated with the time points of each stage inside the electronic device of the touch screen, and the accuracy of the measured response time can be improved.

[0084] Furthermore, the response can be improved according to the time points of each stage inside the electronic device to speed up the response time to the touch operation.

[0085] Referring to Figure 5 , Figure 5 is a flowchart of another embodiment of the touch operation response time measurement method provided by the present application. The method comprises:

[0086] Step 51: Obtain the trigger start time point and the trigger end time point. The trigger start time point and the trigger end time point are generated by the external first sensor component in response to the touch mechanism triggering the touch operation on the touch screen.

[0087] Step 52: Obtain the first time point at which the touch screen generates a touch event based on the touch operation.

[0088] Steps 51-52 have the same or similar technical solutions as any of the above embodiments, and will not be described here.

[0089] Step 53: Obtain the fourth time point at which the target application in the electronic device corresponding to the touch screen receives the touch event.

[0090] Wherein, the touch screen is in communication connection with the processor of the electronic device, so that when the touch screen generates a touch event, the touch event is sent to the processor of the electronic device, and the processor loads a corresponding operating system. Wherein, the operating system can run a corresponding application program. Further, the relevant application of the operating system in the electronic device is processed. For example, the application program can be a game application program, a communication application program, etc.

[0091] Thus, the fourth time point when the target application in the electronic device receives the touch event can be recorded.

[0092] Step 54: obtaining a second time point when the touch screen generates a display change; wherein, the fourth time point is less than the second time point.

[0093] Step 54 has the same or similar technical solutions with any of the above embodiments, which will not be repeated here.

[0094] Step 55: determining the first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the first time point, the fourth time point and the second time point.

[0095] In some embodiments, referring to Figure 6 , step 55 can be the following flow:

[0096] Step 551: determining a first time period based on the trigger start time point, the trigger end time point and the first time point.

[0097] In an application scenario, the touch operation is a sliding operation, and in the sliding process, a corresponding report point is generated. The touch screen will generate a subsequent corresponding touch event only after detecting the report point. When determining the touch point on the touch screen, the coordinates of the touch point can be known synchronously. Thus, the time from the generation of the report point to the generation of the touch event can be further determined according to the coordinates of the report point.

[0098] Specifically, the coordinates of the report point triggering the touch operation on the touch screen, the first coordinates corresponding to the trigger start time point and the second coordinates corresponding to the trigger end time point are obtained.

[0099] Based on the coordinates of the report point triggering the touch operation, the first coordinates, the second coordinates, the trigger start time point and the trigger end time point, the target time point when the report point triggering the touch operation is generated is determined.

[0100] It can be understood that in the sliding operation, the touch screen can only determine the coordinates of the report point when the report point is generated. Therefore, the relevant information of the first sensing component needs to be combined for calculation to obtain the target time point when the report point is generated.

[0101] For example, the sliding operation is uniform sliding or linear regular sliding. For example, the sliding speed gradually increases in proportion or gradually decreases in proportion. Thus, when the trigger start time point and the trigger end time point are determined, the first coordinate corresponding to the trigger start time point and the second coordinate corresponding to the trigger end time point can be determined synchronously. Then, according to the distance between the first coordinate and the second coordinate, and in combination with the sliding proportion, the time required for sliding in a unit distance can be calculated. Further, the time at which the report point is generated can be determined based on the coordinate of the report point of the trigger touch operation.

[0102] The time at which the report point of the trigger touch operation is generated can be before the trigger start time point, after the trigger end time point, or between the trigger start time point and the trigger end time point. After the sliding track is determined by using the first coordinate, the second coordinate, the trigger start time point, and the trigger end time point, the time at which any report point is generated can be determined.

[0103] The first time point is subtracted from the target time point to obtain a first time period. The first time period can represent the time used from the generation of the report point to the generation of the touch event.

[0104] Step 552: determining a second time period based on the fourth time point and the first time point.

[0105] The fourth time point is subtracted from the first time point to obtain the second time period. The second time period can represent the time used from the generation of the touch event to the reception of the touch event by the target application.

[0106] Step 553: determining a third time period based on the fourth time point and the second time point.

[0107] The second time point is subtracted from the fourth time point to obtain the third time period. The third time period can represent the time used from the reception of the touch event by the target application to the generation of the display change by the target touch screen.

[0108] Step 554: determining a first response time based on the first time period, the second time period, and the third time period.

[0109] The first time period, the second time period, and the third time period are added to determine the first response time.

[0110] In the embodiment, the first response time corresponding to the touch operation is determined by obtaining the trigger start time point and the trigger end time point of the first sensing component, obtaining the first time point at which the touch screen generates a touch event, and obtaining the fourth time point at which the target application in the electronic device receives the touch event, the second time point at which the touch screen generates a display change. The first response time corresponding to the touch operation is determined by using the time points of each stage in the electronic device and the time points of the first sensor component, the response time is associated with the time points of each stage in the electronic device, and the accuracy of the measured response time can be improved.

[0111] Further, the response can be improved according to the time points of each stage in the electronic device to speed up the response time to the touch operation.

[0112] Referring to Figure 7 , Figure 7 is a flowchart of another embodiment of the touch operation response time measurement method provided by the present application. The method comprises:

[0113] Step 71: obtaining the trigger start time point and the trigger end time point; wherein the trigger start time point and the trigger end time point are generated by the first sensing component in response to the touch mechanism triggering the touch operation on the touch screen.

[0114] Step 72: obtaining the fifth time point at which the firmware corresponding to the touch screen responds to the touch operation.

[0115] After the firmware corresponding to the touch screen responds to the touch operation, the touch operation will be sent to the kernel of the electronic device, and the corresponding touch event will be generated by the kernel. Thus, the fifth time point at which the firmware responds to the touch operation can be determined.

[0116] Step 73: obtaining the first time point at which the kernel in the electronic device generates a touch event; wherein the fifth time point is less than the first time point.

[0117] The kernel in the electronic device can be a Linux-based kernel, or a kernel based on other operating systems, such as Windows operating system, IOS operating system, and Android operating system.

[0118] When the kernel generates a touch event, the corresponding application will be determined from the system according to the touch event, and then the touch screen will be color-rendered according to the touch event.

[0119] Step 74: obtaining the second time point at which the touch screen generates a display change in response to the touch event.

[0120] The touch screen responds to the touch event, renders colors on the corresponding pixel points, and the touch screen generates display changes. The photoelectric sensor can be used to monitor the display changes of the touch screen, and record the second time point of the display changes.

[0121] Step 75: Based on the trigger start time point, the trigger end time point, the fifth time point, the first time point and the second time point, the first response time corresponding to the touch operation is determined.

[0122] For example, based on the trigger start time point, the trigger end time point and the fifth time point, the first time period is determined.

[0123] Then, based on the first time point and the fifth time point, the second time period is determined.

[0124] Based on the second time point and the first time point, the third time period is determined.

[0125] Then, the first time period, the second time period and the third time period are added to determine the first response time.

[0126] In this embodiment, by obtaining the trigger start time point and the trigger end time point of the first sensor component, and the fifth time point of the corresponding firmware of the touch screen responding to the touch operation, the first time point of the kernel in the electronic device generating the touch event, and the second time point of the touch screen generating the display changes, the first response time corresponding to the touch operation is determined. The time points of each stage inside the electronic device of the touch screen and the time points of the first sensor component are used to determine the first response time corresponding to the touch operation, so that the response time is associated with the time points of each stage inside the electronic device of the touch screen, and the accuracy of the measured response time can be improved.

[0127] In some embodiments, after determining the first response time by using any of the above embodiments, the first response time needs to be verified. Based on this, refer to Figure 8 , Figure 8 is the flowchart of another embodiment of the touch operation response time measurement method provided by the present application.

[0128] Step 81: Receive the image stream from the touch operation to the display change of the touch screen.

[0129] In some embodiments, the image acquisition device is used to acquire the image stream from the touch operation of the touch mechanism to the display change of the touch screen.

[0130] Step 82: Based on the image stream, the second response time corresponding to the touch operation is determined.

[0131] Then, the trajectory of the touch operation of the touch mechanism on the touch screen in the image stream is fitted, and a second response time corresponding to the touch operation is determined according to a frame rate of the image acquisition device.

[0132] Step 83: The first response time is verified by using the second response time.

[0133] If the difference between the second response time and the first response time is greater than a set threshold, the measurement method of the first response time needs to be corrected.

[0134] If the difference between the second response time and the first response time is less than or equal to the set threshold, it is determined that the first response time meets the measurement requirement.

[0135] In an application scenario, the touch mechanism is a mechanical arm. The measurement process from the generation of the touch operation to the generation of the display change of the touch screen is recorded by using a high-speed camera; the trajectories of the mechanical arm and the dragged object are tracked by using openCV; the time trajectory motion curves corresponding to the mechanical arm and the dragged object are fitted according to the captured trajectories; the phase difference between the two curves is calculated; and the delay size between the object and the mechanical arm is converted according to the phase difference and the frame rate of the high-speed camera, so as to determine the second response time.

[0136] In the embodiment, the second response time is determined by the image detection, so as to verify the first response time, which can improve the accuracy of the first response time.

[0137] Referring to Figure 9 , Figure 9 is a structural schematic diagram of an embodiment of a touch operation response time measurement device provided by the present application. The touch operation response time measurement device 1000 comprises a first acquisition module 201, a second acquisition module 202, a third acquisition module 203, and a determination module 204.

[0138] The first acquisition module 201 is configured to acquire a trigger start time point and a trigger end time point. The trigger start time point and the trigger end time point are generated by an external first sensing component in response to the touch mechanism triggering the touch operation on the touch screen.

[0139] The second acquisition module 202 is configured to acquire a first time point at which the touch screen generates a touch event based on the touch operation.

[0140] The third acquisition module 203 is configured to acquire a second time point at which the touch screen generates a display change in response to the touch event.

[0141] The determination module 204 is configured to determine a first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the first time point, and the second time point.

[0142] In some embodiments, the third obtaining module 203 is further configured to obtain a third time point at which the second sensing component outside is triggered; the second sensing component is triggered by the display change of the touch screen; and the third time point is taken as the second time point.

[0143] Specifically, the determining module 204 is further configured to determine a first time period based on the trigger start time point, the trigger end time point and the first time point; determine a second time period based on the second time point and the first time point; and determine the first response time based on the first time period and the second time period.

[0144] In some embodiments, the third obtaining module 203 is further configured to obtain a fourth time point at which a target application in the electronic device corresponding to the touch screen receives the touch event;

[0145] The determining module 204 is further configured to determine the first response time of the touch operation based on the trigger start time point, the trigger end time point, the first time point, the fourth time point and the second time point.

[0146] Specifically, the determining module 204 is further configured to determine a first time period based on the trigger start time point, the trigger end time point and the first time point; determine a second time period based on the fourth time point and the first time point; determine a third time period based on the fourth time point and the second time point; and determine the first response time based on the first time period, the second time period and the third time period.

[0147] Specifically, the determining module 204 is further configured to obtain the coordinates of the touch point on the touch screen, the first coordinates corresponding to the trigger start time point and the second coordinates corresponding to the trigger end time point; determine a target time point generated by the touch point based on the coordinates of the touch point, the first coordinates, the second coordinates, the trigger start time point and the trigger end time point; and determine the first time period based on the first time point and the target time point.

[0148] In some embodiments, the second obtaining module 202 is further configured to obtain a fifth time point at which the firmware corresponding to the touch screen responds to the touch operation.

[0149] The determining module 204 is further configured to determine the first response time of the touch operation based on the trigger start time point, the trigger end time point, the fifth time point, the first time point and the second time point.

[0150] It can be understood that the electronic device 200 can implement the method of any of the above embodiments, which will not be described here.

[0151] Referring to Figure 10 , Figure 10This is a schematic diagram of an embodiment of the electronic device provided in this application. The electronic device 200 includes a processor 205, a memory 206 coupled to the processor 205, and a touchscreen 207. The memory 206 stores a computer program, and the processor 205 executes the computer program to implement the following method:

[0152] The system acquires the trigger start time and trigger end time; wherein the trigger start time and trigger end time are generated by the external first sensing component in response to the touch mechanism triggering a touch operation on the touch screen; and acquires the first time point at which the touch screen generates a touch event based on the touch operation; acquires the second time point at which the touch screen responds to the touch event and generates a display change; and determines the first response time corresponding to the touch operation based on the trigger start time, trigger end time, first time point, and second time point.

[0153] It is understood that the processor 205 is also used to execute computer programs to implement the methods of any of the above embodiments, which will not be described in detail here.

[0154] See Figure 11 , Figure 11 This is a schematic diagram of another embodiment of the electronic device provided in this application. The electronic device 200 may be, for example, a mobile electronic device, and may include: a memory 206, a processor (Central Processing Unit, CPU) 205, a circuit board (not shown), a power supply circuit, and a microphone 217. The circuit board is housed within the space enclosed by the housing; the processor 205 and the memory 206 are mounted on the circuit board; the power supply circuit supplies power to the various circuits or devices of the electronic device; the memory 206 stores executable program code; the processor 205 reads the executable program code stored in the memory 206 to run a computer program corresponding to the executable program code, thereby recognizing the aforementioned identification information to achieve unlocking and wake-up functions.

[0155] The electronic device may also include: a peripheral interface 208, an RF (Radio Frequency) circuit 210, an audio circuit 211, a speaker 216, a power management chip 213, an input / output (I / O) subsystem 214, other input / control devices 215, a touch screen 207, and an external port 209. These components communicate via one or more communication buses or signal lines 212. The touch screen 207 may be the display screen 10 in the aforementioned embodiments.

[0156] The memory 206 can be accessed by the processor 205, the peripheral interface 208, and the like, and can include a high-speed random access memory, and can further include a nonvolatile memory such as one or more disk storage devices, flash memory devices, or other volatile solid-state memory devices. The peripheral interface 208 can connect input and output peripherals of the device to the processor 205 and the memory 206.

[0157] The I / O subsystem 214 can connect input and output peripherals on the device, such as the touch screen 207 and other input / control devices 215, to the peripheral interface 208. The I / O subsystem 214 can include a display controller 2141 and one or more input controllers 2142 to control other input / control devices 215. The one or more input controllers 2142 receive electrical signals from or send electrical signals to the other input / control devices 215, which can include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, and so forth. In some embodiments, input controller(s) 2142 can be coupled to any of a keyboard, infrared port, USB port, and a pointing device such as a mouse.

[0158] The touch screen 207 is an input interface and an output interface between the user and the electronic device, and displays visual output to the user, which can include graphics, text, icons, video, and the like.

[0159] The display controller 2141 in the I / O subsystem 214 receives electrical signals from or sends electrical signals to the touch screen 207. The touch screen 207 detects contacts on the touch screen 207, and the display controller 2141 converts the detected contacts into interactions with user interface objects displayed on the touch screen 207, i.e., implements human-computer interaction, and the user interface objects displayed on the touch screen 912 can be icons of running games, icons of networking to corresponding networks, and the like.

[0160] The RF circuit 210 is mainly used to establish the communication between the mobile phone and the wireless network (i.e. network side), and realize the data receiving and sending between the mobile phone and the wireless network. For example, sending and receiving short messages, emails, etc. Specifically, the RF circuit 210 receives and sends RF signals, also known as electromagnetic signals, and converts electrical signals into electromagnetic signals or converts electromagnetic signals into electrical signals, and communicates with the communication network and other devices through the electromagnetic signals. The RF circuit 905 can include known circuits for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC (COder-DECoder) chip set, a Subscriber Identity Module (SIM), and the like.

[0161] The audio circuit 211 is mainly used to receive audio data from the peripheral interface 208, convert the audio data into electrical signals, and send the electrical signals to the speaker 216. The speaker 216 is used to restore the voice signal received by the mobile phone from the wireless network through the RF circuit 210 into sound and play the sound to the user. The power management chip 213 is used to power and manage the power supply for the processor 205, the I / O subsystem 214 and the hardware connected to the peripheral interface 208.

[0162] Referring to Figure 12 , Figure 12 is a structural schematic diagram of an embodiment of the measurement device for touch operation response time provided by the present application. The measurement device 1000 comprises: an electronic device 200, a first sensing assembly 300.

[0163] The electronic device 200 comprises a touch screen 207.

[0164] The first sensing assembly 300 is in communication connection with the electronic device 200, and is used to send, to the electronic device 200, a trigger start time point and a trigger end time point generated in response to the trigger of the touch operation of the touch screen by the touch mechanism.

[0165] The electronic device 200 is used to acquire a first time point at which the touch screen 207 generates a touch event based on the touch operation; acquire a second time point at which the touch screen 106 generates a display change in response to the touch event; and determine a first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the first time point and the second time point.

[0166] Referring to Figure 13 , the first sensing assembly 300 comprises a transmitter 301, a receiver 302 and a communication module 303.

[0167] The transmitter 301 and the receiver 302 are oppositely arranged on two sides of the touch screen 207, and the receiver can receive the optical signal sent by the transmitter 301.

[0168] The communication module 303 is connected with the receiver 302 and the electronic device 200 respectively, and is configured to receive the trigger start time point and the trigger end time point sent by the receiver 302, and send the trigger start time point and the trigger end time point to the electronic device 200.

[0169] In some embodiments, the transmitter 301 can be a laser transmitter, such as an infrared light transmitter. The receiver 302 is a photoelectric receiver, such as a photosensitive sensor, configured to receive the optical signal sent by the transmitter 301.

[0170] The first sensing assembly 300 is mainly used to accurately detect the time when the touch mechanism slides to a specific position of the touch screen. The implementation principle is that the photosensitive sensor can receive the optical signal of the laser transmitter.

[0171] The laser transmitter and the photosensitive sensor are respectively arranged on the left and right sides of the touch screen, and the laser signal is shot on the photosensitive sensor. When the touch mechanism slides on the touch screen, the first sensing assembly 300 can accurately capture the time when the touch screen enters and leaves the photosensitive sensor.

[0172] Further, the first sensing assembly 300 includes a control module (not shown in the figure), which is configured to control the transmitter 301, the receiver 302 and the communication module 303 to perform the above operations.

[0173] It can be understood that the measuring device 1000 can realize the method of any one of the above embodiments, which will not be described here.

[0174] Referring to Figure 14 , Figure 14 is a structural schematic diagram of another embodiment of the touch operation response time measuring device provided by the present application. The measuring device 1000 includes an electronic device 200, a first sensing assembly 300 and a second sensing assembly 400.

[0175] The second sensing assembly 400 is in communication connection with the electronic device 200, and is configured to send a third time point at which the second sensing assembly 400 is triggered to the electronic device 200; wherein the second sensing assembly is triggered by the display change of the touch screen.

[0176] The second sensing assembly 400 can include a photoelectric sensor (not shown in the figure) and a communication module (not shown in the figure). The photoelectric sensor is configured to monitor the display change of the touch screen, and further generate the third time point when triggered. The communication module is configured to send the third time point to the electronic device 200.

[0177] In an application scenario, the above-mentioned embodiments are combined Figures 15-18 to illustrate:

[0178] As shown in Figure 15 , the first sensing assembly 300 includes a transmitter 301, a receiver 302 and a communication module 303. The communication module 303 and the communication module of the electronic device 200 keep clock synchronization.

[0179] The transmitter 301 and the receiver 302 are oppositely arranged on both sides of the touch screen 207, and the receiver can receive the optical signal sent by the transmitter 301.

[0180] The electronic device 200 includes a touch screen 207 and a main body 240. The touch screen 207 includes a touch scanning module 2071, a firmware module 2072 and an interrupt module 2073. The main body 240 includes a communication module 245 and a system 242. The system 242 includes a kernel module 2421, a system framework 2422, a target application 2423 and a synthetic display module 244.

[0181] The communication module 303 of the first sensing assembly 300 is connected with the communication module 245, for sending the trigger start time point and the trigger end time point to the communication module 245.

[0182] The touch scanning module 2071 is used for scanning the touch point corresponding to the touch operation, to determine the related information of the touch point corresponding to the report point.

[0183] The firmware module 2072 is used for receiving the information of the report point sent by the touch scanning module 2071, and sending to the interrupt module 2073.

[0184] The interrupt module 2073 sends the information of the report point to the kernel module 2421.

[0185] The kernel module 2421 generates a touch event based on the report point information, and sends the touch event to the system framework 2422.

[0186] The system framework 2422 determines the corresponding target application 2423.

[0187] The target application 2423 controls the synthetic display module 244 based on the touch event, so that the synthetic display module 244 generates a corresponding signal.

[0188] The display module 244 sends a corresponding control signal to the touch screen 207, to control the touch screen 207 to change the display.

[0189] As shown in Figure 16 , first start the application to be tested, and then ask the user to authorize the clock synchronization. After receiving the authorization execution, the first sensing assembly 300 and the electronic device 200 are clock synchronized.

[0190] Then click start test to determine whether the electronic device is successfully connected. When the electronic device 200 is successfully connected, it is determined whether the first sensing component 300 is normal.

[0191] When the first sensing component 300 is normal, the mechanical arm is controlled to start sliding on the touch screen 207.

[0192] During the sliding process, the time point 1 when the mechanical arm enters the first sensing component 300 and the time point 2 when the mechanical arm leaves the first sensing component 300 are obtained.

[0193] Synchronously, during the sliding process, the firmware of the touch screen 207 scans touch data, thereby generating an interrupt signal. Based on the interrupt signal, the touch data is sent to the kernel module 241, the kernel module 241 generates a touch event, and records the time point 3.

[0194] Further, the touch event is reported to the system framework 242.

[0195] The system framework 242 dispatches the touch event to the target application 243.

[0196] The target application 243 executes the touch callback, and records the time point 4.

[0197] According to the time point 1, the time point 2, the time point 3 and the time point 4, the response time required from the generation of the touch to the response of the target application 243 can be determined. Specifically, the response time of each stage can be calculated.

[0198] Further, it is determined whether the test number is reached, and when the test number is reached, the test result of this time is counted.

[0199] As shown in Figure 17 , the second sensing component 400 can include a photoelectric sensor 401 and a communication module 402.

[0200] The communication module 402 is used to send the time point generated by the photoelectric sensor when triggered to the electronic device 200.

[0201] As shown in Figure 18 , first, start the application to be tested, and then ask the user to authorize clock synchronization. After receiving the authorization to execute, the second sensing component 400 and the electronic device 200 are clock-synchronized.

[0202] Then click start test to determine whether the electronic device 200 is successfully connected. When the electronic device is successfully connected, the mechanical arm sliding operation as in Figure 16 is performed.

[0203] The target application sends a color change command, and records the time point 5.

[0204] The synthetic display module 244 responds to the drawing and controls the touch screen to respond.

[0205] At this time, the second sensing component 400 senses the display change of the touch screen, and records the time point 6.

[0206] According to the time point 5 and the time point 6, the drawing display time can be determined.

[0207] Therefore, the overall response time can be determined according to the response time required by the touch to the target application 243 and the drawing display time.

[0208] It can be understood that the measuring device 1000 can implement the method of any of the above embodiments, which will not be repeated here.

[0209] Referring to Figure 19 , Figure 19 is a structural schematic diagram of another embodiment of the touch operation response time measuring device provided by the present application. The measuring device 1000 comprises an electronic device 200, a first sensing component 300 and a processing device 500.

[0210] The electronic device 200 and the processing device 500 are in communication connection, and the electronic device 200 comprises a touch screen 207.

[0211] The first sensing component 300 is in communication connection with the processing device 500, and is configured to send a trigger start time point and a trigger end time point generated in response to the touch mechanism triggering the touch operation of the touch screen to the processing device 500.

[0212] The processing device 500 is configured to acquire a first time point at which the touch screen 207 generates a touch event based on the touch operation, acquire a second time point at which the touch screen 207 generates a display change in response to the touch event, and determine a first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the first time point and the second time point.

[0213] It can be understood that the measuring device 1000 can implement the method of any of the above embodiments, which will not be repeated here.

[0214] In some embodiments, the measuring device 1000 can be designed in an automatic mode, combined with a big data function, to statistically determine the size and fluctuation of the delay of each stage of the electronic device 200.

[0215] Referring to Figure 20 , Figure 20 is a structural schematic diagram of an embodiment of the computer readable storage medium provided by the present application. The computer readable storage medium 220 stores a computer program 221, and the computer program 221, when executed by a processor, implements the following method:

[0216] acquire a trigger start time point and a trigger end time point, wherein the trigger start time point and the trigger end time point are generated by the first sensing component in response to the trigger mechanism triggering the touch screen to generate the touch operation; acquire a first time point at which the touch screen generates a touch event based on the touch operation; acquire a second time point at which the touch screen generates a display change in response to the touch event; and determine a first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the first time point, and the second time point.

[0217] It can be understood that the computer program 221, when executed by the processor, can implement the method of any of the above embodiments, which will not be repeated here.

[0218] In the several embodiments provided in the present application, it should be understood that the disclosed methods and devices can be implemented in other ways. For example, the device embodiments described above are only illustrative, and the division of the modules or units is only a logical function division, and there can be another division manner in actual implementation, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed.

[0219] The integrated units in the above other embodiments, if realized in the form of software function units and sold or used as independent products, can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application essentially or the parts that make contributions to the prior art or the whole or part of the technical solutions can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a plurality of instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor execute all or part of the steps of the methods described in the various embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various media that can store program codes.

[0220] The above description is only an embodiment of the present application, and does not limit the patent scope of the present application, and any equivalent structure or equivalent process transformation based on the content of the specification and drawings, or direct or indirect application in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A method for measuring touch operation response time, characterized in that, The method comprises: acquiring a trigger start time point and a trigger end time point; wherein the trigger start time point and the trigger end time point are generated by an external first sensing component in response to a touch mechanism triggering a touch operation on a touch screen; and acquiring a first time point at which the touch screen generates a touch event based on the touch operation; acquiring a second time point at which the touch screen generates a display change in response to the touch event; determining a first time period based on the trigger start time point, the trigger end time point and the first time point; determining a second time period based on the second time point and the first time point; determining a first response time based on the first time period and the second time period.

2. The method of claim 1, wherein, The acquiring of the second time point at which the touch screen generates a display change in response to the touch event comprises: acquiring a third time point at which an external second sensing component is triggered; wherein the second sensing component is triggered by the touch screen generating a display change; and taking the third time point as the second time point.

3. The method of claim 1, wherein, Before the acquiring of the second time point, the method comprises: acquiring a fourth time point at which a target application in an electronic device corresponding to the touch screen receives the touch event; The method further comprises: determining a second time period based on the fourth time point and the first time point; determining a third time period based on the fourth time point and the second time point; determining the first response time based on the first time period, the second time period and the third time period.

4. The method of claim 1, wherein, The determining of the first time period based on the trigger start time point, the trigger end time point and the first time point comprises: acquiring coordinates of a touch operation trigger point on the touch screen, and a first coordinate corresponding to the trigger start time point and a second coordinate corresponding to the trigger end time point; determining a target time point generated by the touch operation trigger point based on the coordinates of the touch operation trigger point, the first coordinate, the second coordinate, the trigger start time point and the trigger end time point; determining the first time period by using the first time point and the target time point.

5. The method of claim 1, wherein, Before the acquiring of the first time point, the method comprises: acquiring a fifth time point at which a firmware corresponding to the touch screen responds to the touch operation; The determining of the first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the first time point and the second time point comprises: determining the first response time corresponding to the touch operation based on the trigger start time point, the trigger end time point, the fifth time point, the first time point and the second time point.

6. The method according to any one of claims 1 to 5, characterized in that, The method further comprises: receiving an image stream from the generation of the touch operation to the generation of the display change by the touch screen; determining a second response time corresponding to the touch operation based on the image stream; verifying the first response time by using the second response time.

7. A device for measuring touch operation response time, characterized in that, The measuring device comprises: The first obtaining module is configured to obtain a trigger start time point and a trigger end time point, wherein the trigger start time point and the trigger end time point are generated by an external first sensing component in response to a touch mechanism triggering a touch operation on a touch screen. The second obtaining module is configured to obtain a first time point at which the touch screen generates a touch event based on the touch operation. The third obtaining module is configured to obtain a second time point at which the touch screen generates a display change in response to the touch event. The determining module is configured to determine a first time period based on the trigger start time point, the trigger end time point and the first time point, determine a second time period based on the second time point and the first time point, and determine a first response time based on the first time period and the second time period.

8. An electronic device, comprising: The electronic device includes a processor, a memory coupled to the processor, and a touch screen, the memory storing a computer program, and the processor is configured to execute the computer program to implement the method of any one of claims 1-6.

9. A device for measuring touch operation response time, characterized in that, The measuring device includes: An electronic device including a touch screen; A first sensing component in communication connection with the electronic device, configured to send a trigger start time point and a trigger end time point generated in response to a touch mechanism triggering a touch operation on the touch screen to the electronic device; The electronic device is configured to obtain a first time point at which the touch screen generates a touch event based on the touch operation, and obtain a second time point at which the touch screen generates a display change in response to the touch event; determine a first time period based on the trigger start time point, the trigger end time point and the first time point; determine a second time period based on the second time point and the first time point; and determine a first response time based on the first time period and the second time period.

10. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, and the computer program, when executed by a processor, implements the method of any one of claims 1-6.

Images