Touch screen point reporting event processing method, device and storage medium
By converting the touch coordinate information into the system protocol format and displaying screen operation gestures, the problem of low debugging efficiency of touch screen point events is solved, accurate time and position positioning is achieved, and debugging efficiency is improved.
Patent Information
- Application Number
- CN202010595207.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-06-28
- Publication Date
- 2025-08-26
- Estimated Expiration
- 2040-06-28
AI Technical Summary
In the prior art, the debugging efficiency of touch screen point events is low, and it is impossible to intuitively reflect the time of the point event occurrence and screen operation gestures.
By obtaining touch coordinate information and converting it into data formats supported by the system protocol, compiling and displaying the corresponding screen operation gestures, accurate positioning of time and position is achieved.
It improves the debugging efficiency of touch screen point-reporting events and can debug screen operation gestures more intuitively.
Smart Images

Figure CN113849075B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of terminal technology, and in particular to a touch screen point reporting event processing method, device and storage medium. Background Art
[0002] For touch screen electronic products, it is particularly important to debug the reporting events generated by the touch screen.
[0003] In related technologies, after a touch operation is performed on a touch screen, the touch coordinate information is reported in the form of a point reporting event. Debugging of touch screen point reporting events is based on the touch coordinate information reported by the touch operation on the screen. During debugging of touch screen point reporting events based on the touch coordinate information, it is necessary to determine the time of the point reporting event based on the touch coordinate information and calculate the screen operation gesture corresponding to the touch coordinate information. However, the touch coordinate information does not clearly reflect the time of the point reporting event and the screen operation gesture, making debugging of touch screen point reporting events inefficient. Summary of the Invention
[0004] In order to overcome the problems existing in the related art, the present disclosure provides a touch screen point reporting event processing method, device and storage medium.
[0005] According to a first aspect of an embodiment of the present disclosure, a method for processing a touch screen point reporting event is provided, comprising:
[0006] Acquire the touch coordinate information of the reporting event, convert the touch coordinate information into a data format supported by the system protocol and save it in the protocol file; compile the touch coordinate information in the protocol file, and restore and display the screen operation gesture corresponding to the touch coordinate information.
[0007] In one embodiment, the touch screen point reporting event processing method further includes:
[0008] The point reporting event is debugged based on the displayed screen operation gesture.
[0009] In another embodiment, compiling the touch coordinate information in the protocol file and restoring and displaying the screen operation gesture corresponding to the touch coordinate information includes:
[0010] Compile the touch coordinate information in the protocol file to obtain the screen operation gesture corresponding to the touch coordinate information and the first time when each touch coordinate point generated by the screen operation gesture occurs; based on the preset time zone information, convert the first time into a second time, and the second time is the time corresponding to the time zone where the screen operation gesture is displayed after restoration; display the screen operation gesture based on the second time.
[0011] In another embodiment, the touch screen point reporting event processing method further includes:
[0012] Invoking an application software interface function to provide a user interface, the user interface including a first interface for importing a point reporting event. Obtaining touch coordinate information of the point reporting event includes: obtaining a point reporting event imported based on the first interface, the point reporting event corresponding to pre-cached touch coordinate information.
[0013] In another embodiment, the user interface further includes a second interface for setting parameters for restoring the reporting point event, and the parameters for restoring the reporting point event at least include a system protocol.
[0014] In another embodiment, compiling the touch coordinate information in the protocol file includes:
[0015] The dot-dash line compilation function is called to compile the touch coordinate information in the protocol file to obtain the screen operation gesture corresponding to the touch coordinate information.
[0016] In another embodiment, displaying the screen operation gesture corresponding to the touch coordinate information includes:
[0017] An interface mapping function is called to display the screen operation gesture corresponding to the touch coordinate information on the display interface.
[0018] In another embodiment, the touch screen point reporting event processing method further includes: recording the displayed screen operation gesture in response to a screen recording operation instruction. Debugging the point reporting event based on the displayed screen operation gesture includes: debugging the point reporting event based on the recorded screen operation gesture.
[0019] According to a second aspect of an embodiment of the present disclosure, a touch screen point reporting event processing device is provided, comprising:
[0020] An acquisition unit is used to acquire the touch coordinate information of the reporting event, and convert the touch coordinate information into a data format supported by the system protocol and save it in a protocol file; a processing unit is used to compile the touch coordinate information in the protocol file and restore the screen operation gesture corresponding to the touch coordinate information; a display unit is used to display the screen operation gesture corresponding to the touch coordinate information.
[0021] In one embodiment, the touch screen point reporting event processing device further includes a debugging unit, and the debugging unit is used to debug the point reporting event based on the displayed screen operation gesture.
[0022] In another embodiment, the processing unit compiles the touch coordinate information in the protocol file and restores the screen operation gesture corresponding to the touch coordinate information in the following manner: compiling the touch coordinate information in the protocol file to obtain the screen operation gesture corresponding to the touch coordinate information and the first time at which each touch coordinate point generated by the screen operation gesture occurs; based on preset time zone information, converting the first time into a second time, the second time being the time corresponding to the time zone in which the screen operation gesture is displayed after restoration. The display unit is configured to display the screen operation gesture based on the second time.
[0023] In another embodiment, the display unit is further used to: call the application software interface function to provide a user interface, and the user interface includes a first interface for importing the reporting event.
[0024] The acquisition unit acquires the touch coordinate information of the reporting event in the following manner: acquiring the reporting event imported based on the first interface, the reporting event corresponding to the pre-cached touch coordinate information.
[0025] In another embodiment, the user interface further includes a second interface for setting parameters for restoring the reporting point event, and the parameters for restoring the reporting point event at least include a system protocol.
[0026] In another embodiment, the processing unit compiles the touch coordinate information in the protocol file in the following manner:
[0027] The dot-dash line compilation function is called to compile the touch coordinate information in the protocol file to obtain the screen operation gesture corresponding to the touch coordinate information.
[0028] In another embodiment, the display unit displays the screen operation gesture corresponding to the touch coordinate information in the following manner: calling an interface mapping function to display the screen operation gesture corresponding to the touch coordinate information on a display interface.
[0029] In another embodiment, the touch screen point reporting event processing device further includes a recording unit, the recording unit being configured to record the displayed screen operation gesture in response to a screen recording operation instruction, and the debugging unit being configured to debug the point reporting event based on the recorded screen operation gesture.
[0030] According to a third aspect of an embodiment of the present disclosure, a touch screen point reporting event processing device is provided, comprising:
[0031] a processor; a memory for storing instructions executable by the processor;
[0032] The processor is configured to execute the touch screen point reporting event processing method described in the first aspect or any one of the embodiments of the first aspect.
[0033] According to the fourth aspect of the embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided. When the instructions in the storage medium are executed by the processor of the mobile terminal, the mobile terminal can execute the touch screen point event processing method described in the first aspect or any one of the embodiments of the first aspect.
[0034] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects: by obtaining the touch coordinate information of the reporting event, converting the touch coordinate information into a data format supported by the system protocol and saving it in the protocol file, and compiling the touch coordinate information in the protocol file, restoring and displaying the screen operation gesture corresponding to the touch coordinate information, and realizing the restoration of the touch coordinate information displayed in the form of code text to the corresponding screen operation gesture, the time and touch position of the screen operation gesture can be accurately located.
[0035] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0036] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0037] Figure 1 The figure is a flowchart of a method for processing a touch screen point reporting event according to an exemplary embodiment.
[0038] Figure 2 The present invention is a flowchart illustrating an implementation of compiling touch coordinate information in a protocol file and restoring and displaying screen operation gestures corresponding to the touch coordinate information according to an exemplary embodiment.
[0039] Figure 3 The figure is a schematic diagram showing a process of processing a touch screen point reporting event by a processing device according to an exemplary embodiment.
[0040] Figure 4 The present invention is a block diagram showing a device for processing touch screen point reporting events according to an exemplary embodiment.
[0041] Figure 5 The present invention is a block diagram showing a device for processing touch screen point reporting events according to an exemplary embodiment.
[0042] Figure 6 The present invention is a block diagram showing a device for processing touch screen point reporting events according to an exemplary embodiment.
[0043] Figure 7 The present invention is a block diagram of a device for processing touch screen point reporting events according to an exemplary embodiment. DETAILED DESCRIPTION
[0044] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all possible embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
[0045] The disclosed embodiment provides a touch screen point reporting event processing method, which restores touch coordinate information displayed in code text form to a corresponding screen operation gesture, and accurately determines the occurrence time and touch position of the screen operation gesture.
[0046] Figure 1 FIG. 1 is a flow chart showing a method for processing a touch screen point reporting event according to an exemplary embodiment. Figure 1 As shown, the touch screen point reporting event processing method is used in an electronic device, which may be a device with a touch screen such as a terminal, and includes the following steps.
[0047] In step S11 , the touch coordinate information of the reporting event is obtained, and the touch coordinate information is converted into a data format supported by the system protocol and saved in a protocol file.
[0048] The point reporting event in the embodiment of the present disclosure can be understood as an event that carries touch coordinate information and is reported after a touch operation is performed on the touch screen.
[0049] Furthermore, the operating system that processes the point reporting event can be the same as or different from the operating system that originally generated the point reporting event. In the disclosed embodiments, to process the point reporting event, the acquired touch coordinate information is processed according to the system protocol format and converted into a data format supported by the system protocol. The system protocol refers to a protocol supported by the operating system of the electronic device that processes the point reporting event, such as an Android system protocol or an iOS system protocol.
[0050] In one implementation of the disclosed embodiment, protocol files corresponding to different system protocols can be created. After processing touch coordinates in a data format supported by the system protocol, they can be stored in the corresponding protocol file. Furthermore, multiple protocol files for the same system protocol can be stored in a database corresponding to the system protocol.
[0051] In step S12, the touch coordinate information in the protocol file is compiled, and the screen operation gesture corresponding to the touch coordinate information is restored and displayed.
[0052] In the embodiment of the present disclosure, the touch coordinate information in the protocol file can be compiled to obtain the screen operation gesture corresponding to the touch coordinate information, thereby realizing the restoration and display of the screen operation gesture.
[0053] The disclosed embodiment obtains the touch coordinate information of the reporting event, converts the touch coordinate information into a data format supported by the system protocol and saves it in the protocol file, compiles the touch coordinate information in the protocol file, restores and displays the screen operation gesture corresponding to the touch coordinate information, and realizes the restoration of the touch coordinate information displayed in the form of code text to the corresponding screen operation gesture, which can accurately locate the time and touch position of the screen operation gesture.
[0054] Furthermore, in the embodiments of the present disclosure, after the screen operation gesture is restored for the reporting event, the reporting event is debugged based on the displayed screen operation gesture, which can more intuitively debug the screen operation gesture. Therefore, the above-mentioned reporting event in the embodiments of the present disclosure can also be understood as the reporting event to be debugged and analyzed.
[0055] The following embodiments of the present disclosure will illustrate the implementation process of the touch screen point reporting event processing method involved in the above embodiments in combination with actual applications.
[0056] In one embodiment, the embodiment of the present disclosure may set an application software interface function, and provide a user interface (UI) to the user by calling the application software interface function. The user interface is used to interact with the user. In one example, the user interface includes an interface interface for importing point reporting events, hereinafter referred to as the first interface interface. The user can import a point reporting event containing touch coordinate information based on the first interface interface. The touch coordinate information contained in the point reporting event may be the touch coordinate information recorded and cached during the user's touch operation on the touch screen using a screen operation gesture. When obtaining the touch coordinate information of the point reporting event, the point reporting event imported based on the first interface interface can be obtained, and the point reporting event can be parsed to obtain the corresponding pre-cached touch coordinate information.
[0057] In one embodiment of the present disclosure, the user interface further includes an interface for setting parameters for restoring a time-based event, hereinafter referred to as a second interface. The parameters for restoring a time-based event in this embodiment of the present disclosure include at least the system protocol and may also include parameters for restoring a time-based event, such as time zone information.
[0058] In the embodiment of the present disclosure, the above-mentioned user interface can provide a user interface for human-computer interaction, and it is simple and easy for users to operate on the user interface.
[0059] The following embodiments of the present disclosure describe the screen operation gesture restoration and display process.
[0060] In one embodiment, the time information corresponding to the restored screen operation gesture when displayed may be inconsistent with the time information when the original screen operation gesture was generated. For example, the time zone information may be different, such as the time information of the Unix system and the Android system. In the embodiment of the present disclosure, each time zone information can be preset, and the time conversion can be performed when restoring the screen operation gesture. For example, the Unix system time can be converted to the Android system time.
[0061] Figure 2 This is a flowchart of an implementation of compiling touch coordinate information in a protocol file, restoring and displaying the screen operation gesture corresponding to the touch coordinate information according to an exemplary embodiment. Figure 2 As shown, the following steps are included:
[0062] In step S121 , the touch coordinate information in the protocol file is compiled to obtain the screen operation gesture corresponding to the touch coordinate information and the first time of each touch coordinate point generated by the screen operation gesture.
[0063] In the embodiment of the present disclosure, a dot-dash-line compilation function may be called to compile the touch coordinate information in the protocol file.
[0064] In the embodiment of the present disclosure, the first time may be understood as the time point corresponding to the touch coordinate point generated by the screen operation gesture in the original system.
[0065] In step S122 , the first time is converted into the second time based on the preset time zone information.
[0066] In the embodiment of the present disclosure, time zone information can be set separately for each protocol system, and time conversion between systems can be performed when restoring screen operation gestures.
[0067] The second time is the time corresponding to the time zone where the screen operation gesture is displayed after restoration. Alternatively, the second time can also be understood as the system time information of the system where the screen operation gesture is located after restoration.
[0068] In the embodiment of the present disclosure, the time conversion may be millisecond-level time conversion.
[0069] In step S123 , the restored screen operation gesture is displayed based on the second time.
[0070] In the embodiment of the present disclosure, an interface mapping function may be called to display the screen operation gesture corresponding to the restored touch coordinate information on the display interface.
[0071] In the disclosed embodiment, after the screen operation gesture is restored, the displayed screen operation gesture can be recorded to facilitate subsequent debugging of the point reporting event based on the recorded screen operation gesture. The recording of the screen gesture can be frame-level recording to achieve frame-level point reporting event debugging.
[0072] In the embodiment of the present disclosure, a screen recording operation instruction can be triggered by the user, and in response to the screen recording operation instruction, the displayed screen operation gesture is recorded. When debugging the reporting event later, the reporting event can be debugged based on the recorded screen operation gesture.
[0073] The implementation process of the touch screen point reporting event processing method involved in the above-mentioned embodiment of the present disclosure can be integrated into a processing device. Figure 3 FIG2 is a schematic diagram showing a process of processing a touch screen point reporting event by a processing device according to an exemplary embodiment. Figure 3 As shown, the processing device mainly includes a basic service application programming interface (Application Programming Interface, API), an inheritance function module and a UI interaction module.
[0074] The basic service API is primarily used to collect user data, such as system protocol information input by the user and touch coordinate information of point events. After collecting data, the basic service API converts the touch coordinate information into a data format supported by the system protocol and saves it in the protocol file. Figure 3 This shows a schematic diagram of the data processing process of the basic service API. Figure 3 As shown, after collecting the cached touch coordinates and importing the data corresponding to the touch coordinates, the data is processed according to the protocol format and the processed data is added to the protocol file (database).
[0075] Among them, the inheritance function module mainly inherits the existing system functions to compile the touch coordinate information in the protocol file. The inheritance function module can be understood as a code library for function implementation. The core is to parse the information displayed in text into intuitive picture information for the user without changing the original information. Among them, there are existing system functions such as the collection of Windows application software functions, Unix and Android time conversion functions, Android point reporting and line compilation functions, and desktop mapping functions. For example, the Windows application software function is combined to implement user interface settings. The first time to the second time is converted through the Unix and Android time conversion functions. The touch coordinate information in the protocol file is compiled through the Android point reporting and line compilation function to obtain the screen operation gesture corresponding to the touch coordinate information, as well as the first time of each touch coordinate point generated by the screen operation gesture. Through the desktop mapping function, a screen operation gesture display interface is generated and the screen operation gesture is displayed.
[0076] The UI interaction module is primarily used to dynamically control time and the corresponding desktop display. For example, if the screen operation gestures are point reporting and line drawing, the UI interaction module can control the display of the point reporting and line drawing tracks. The UI interaction module is also used to provide a user interface for users to operate and set the user interface interface for users to operate and input user data.
[0077] When the present disclosure applies the above-mentioned processing device to process the reporting event, after the basic service API collects the user data, the user data is imported through the user interface interface. After the imported user data is processed in the inherited function module, it is reported to the front end for display and restoration of the mobile phone desktop.
[0078] In this disclosed embodiment, touch coordinates are recorded in a protocol file during user use. This is then reported to the upper layer via the input subsystem, allowing for analysis of user click events. Furthermore, the system integrates with the Android platform's drawing layer, outputting code execution files to an application tool. Files containing coordinate information are then imported into the tool, which then analyzes the reported point trajectory and line strokes, simulating the user's machine, recreating user operating techniques, and accurately locating time and location, effectively enhancing the product experience.
[0079] Furthermore, when debugging screen operation gestures, the restored screen operation gestures can be used to accurately analyze each touch coordinate point generated by the screen operation gestures, saving time and improving development efficiency.
[0080] Based on the same concept, an embodiment of the present disclosure also provides a touch screen point reporting event processing device.
[0081] It is understandable that the touch screen point reporting event processing device provided by the embodiment of the present disclosure includes hardware structures and / or software modules corresponding to the execution of each function in order to realize the above functions. In combination with the units and algorithm steps of each example disclosed in the embodiment of the present disclosure, the embodiment of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiment of the present disclosure.
[0082] Figure 4 This is a block diagram of a touch screen point reporting event processing device according to an exemplary embodiment. Figure 4 The touch screen point reporting event processing device 100 includes an acquisition unit 101, a processing unit 102 and a display unit 103.
[0083] The acquisition unit 101 is configured to obtain the touch coordinate information of the point reporting event, convert the touch coordinate information into a data format supported by the system protocol, and save it in a protocol file. The processing unit 102 is configured to compile the touch coordinate information in the protocol file and restore the screen operation gesture corresponding to the touch coordinate information. The display unit 103 is configured to display the screen operation gesture corresponding to the touch coordinate information.
[0084] In one embodiment, the touch screen point reporting event processing device 100 further includes a debugging unit 104, such as Figure 5 The debugging unit 104 is used to debug the reporting event based on the displayed screen operation gesture.
[0085] In another embodiment, the processing unit 102 compiles the touch coordinate information in the protocol file and restores the screen operation gesture corresponding to the touch coordinate information in the following manner: compiling the touch coordinate information in the protocol file to obtain the screen operation gesture corresponding to the touch coordinate information and the first time when each touch coordinate point generated by the screen operation gesture occurred. Based on the preset time zone information, the first time is converted into a second time, and the second time is the time corresponding to the time zone in which the screen operation gesture is displayed after restoration. The display unit 103 is configured to display the screen operation gesture based on the second time.
[0086] In another embodiment, the display unit 103 is further configured to call an application software interface function and provide a user interface, wherein the user interface includes a first interface for importing a time reporting event.
[0087] The acquiring unit 101 acquires the touch coordinate information of the reporting event in the following manner: acquiring the reporting event imported based on the first interface, the reporting event corresponding to the touch coordinate information cached in advance.
[0088] In another embodiment, the user interface further includes a second interface for setting the reporting point event restoration parameters, and the reporting point event restoration parameters at least include the system protocol.
[0089] In another embodiment, the processing unit 102 compiles the touch coordinate information in the protocol file in the following manner:
[0090] Call the dot-dash line compilation function to compile the touch coordinate information in the protocol file to obtain the screen operation gesture corresponding to the touch coordinate information.
[0091] In another embodiment, the display unit 103 displays the screen operation gesture corresponding to the touch coordinate information in the following manner: calling an interface mapping function to display the screen operation gesture corresponding to the touch coordinate information on the display interface.
[0092] In another embodiment, the touch screen point reporting event processing device 100 further includes a recording unit 105, such as Figure 6 The recording unit 105 is used to record the displayed screen operation gesture in response to the screen recording operation instruction. The debugging unit 104 is used to debug the reporting event based on the recorded screen operation gesture.
[0093] Regarding the apparatus in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.
[0094] Figure 7 FIG2 is a block diagram of an apparatus 200 for processing touch screen point events according to an exemplary embodiment. For example, apparatus 200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
[0095] Reference Figure 7 , apparatus 200 may include one or more of the following components: a processing component 202 , a memory 204 , a power component 206 , a multimedia component 208 , an audio component 210 , an input / output (I / O) interface 212 , a sensor component 214 , and a communication component 216 .
[0096] The processing component 202 generally controls the overall operation of the device 200, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 202 may include one or more modules to facilitate interaction between the processing component 202 and other components. For example, the processing component 202 may include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.
[0097] The memory 204 is configured to store various types of data to support operations on the device 200. Examples of such data include instructions for any application or method operating on the device 200, contact data, phone book data, messages, pictures, videos, etc. The memory 204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.
[0098] The power component 206 provides power to the various components of the device 200. The power component 206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device 200.
[0099] The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 208 includes a front camera and / or a rear camera. When the device 200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.
[0100] The audio component 210 is configured to output and / or input audio signals. For example, the audio component 210 includes a microphone (MIC) that is configured to receive external audio signals when the device 200 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 204 or transmitted via the communication component 216. In some embodiments, the audio component 210 further includes a speaker for outputting audio signals.
[0101] I / O interface 212 provides an interface between processing component 202 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.
[0102] The sensor assembly 214 includes one or more sensors for providing various aspects of the status assessment of the device 200. For example, the sensor assembly 214 can detect the open / closed state of the device 200, the relative positioning of components, such as the display and keypad of the device 200. The sensor assembly 214 can also detect changes in the position of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration / deceleration of the device 200, and temperature changes of the device 200. The sensor assembly 214 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 214 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 214 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
[0103] The communication component 216 is configured to facilitate wired or wireless communication between the device 200 and other devices. The device 200 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
[0104] In an exemplary embodiment, the apparatus 200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described method.
[0105] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as the memory 204 including instructions, which can be executed by the processor 220 of the apparatus 200 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.
[0106] It is understood that in this disclosure, "plurality" refers to two or more than two, and other quantifiers are similar. "And / or" describes the association relationship of related objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the related objects before and after are in an "or" relationship. The singular forms "a", "the" and "the" are also intended to include the plural forms, unless the context clearly indicates otherwise.
[0107] It will be further understood that the terms "first," "second," and the like are used to describe various types of information, but such information should not be limited to these terms. These terms are used solely to distinguish information of the same type from one another and do not indicate a particular order or level of importance. In fact, the terms "first," "second," and the like are fully interchangeable. For example, first information could be referred to as second information, and similarly, second information could be referred to as first information without departing from the scope of this disclosure.
[0108] It is further understood that although operations are described in a particular order in the drawings in the embodiments of the present disclosure, this should not be construed as requiring that the operations be performed in the particular order shown or in a serial order, or that all of the operations shown be performed to obtain the desired results. In certain circumstances, multitasking and parallel processing may be advantageous.
[0109] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the following claims.
[0110] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims
1. A touch screen point reporting event processing method, characterized in that: include: Acquire the touch coordinate information of the reporting event, and convert the touch coordinate information into a data format supported by the system protocol and save it in a protocol file; Compile the touch coordinate information in the protocol file to obtain a screen operation gesture corresponding to the touch coordinate information, and a first time at which each touch coordinate point generated by the screen operation gesture occurs, where the first time is the time point corresponding to the touch coordinate point generated by the screen operation gesture in the original system; Based on the preset time zone information, convert the first time into a second time, where the second time is the time corresponding to the time zone in which the screen operation gesture is displayed after restoration; The screen operation gesture corresponding to the touch coordinate information is displayed based on the second time.
2. The method according to claim 1, characterized in that The method further comprises: The point reporting event is debugged based on the displayed screen operation gesture.
3. The method according to claim 1, characterized in that The method further comprises: Calling the application software interface function to provide a user interface, wherein the user interface includes a first interface for importing a reporting event; The step of obtaining the touch coordinate information of the reporting event includes: Acquire a point reporting event imported based on the first interface, wherein the point reporting event corresponds to pre-cached touch coordinate information.
4. The method according to claim 3, characterized in that The user interface also includes a second interface for setting the reporting point event restoration parameters, and the reporting point event restoration parameters at least include the system protocol.
5. The method according to claim 1, wherein The compiling of the touch coordinate information in the protocol file includes: The dot-dash line compilation function is called to compile the touch coordinate information in the protocol file to obtain the screen operation gesture corresponding to the touch coordinate information.
6. The method according to claim 1, characterized in that Displaying the screen operation gesture corresponding to the touch coordinate information includes: An interface mapping function is called to display the screen operation gesture corresponding to the touch coordinate information on the display interface.
7. The method according to claim 2, characterized in that The method further comprises: In response to a screen recording operation instruction, recording the displayed screen operation gesture; Debugging the reporting event based on the displayed screen operation gesture includes: The point reporting event is debugged based on the recorded screen operation gesture.
8. A touch screen point reporting event processing device, characterized in that: include: an acquiring unit, configured to acquire touch coordinate information of a point reporting event, and convert the touch coordinate information into a data format supported by a system protocol and save the data in a protocol file; a processing unit, configured to compile the touch coordinate information in the protocol file, obtain a screen operation gesture corresponding to the touch coordinate information, and a first time at which each touch coordinate point generated by the screen operation gesture occurs, wherein the first time is a time point corresponding to the touch coordinate point generated by the screen operation gesture in the original system; Based on the preset time zone information, convert the first time into a second time, where the second time is the time corresponding to the time zone in which the screen operation gesture is displayed after restoration; A display unit is configured to display a screen operation gesture corresponding to the touch coordinate information based on the second time.
9. The device according to claim 8, characterized in that The device further comprises a debugging unit, wherein the debugging unit is configured to: The point reporting event is debugged based on the displayed screen operation gesture.
10. The device according to claim 8, characterized in that The display unit is further configured to: Calling the application software interface function to provide a user interface, wherein the user interface includes a first interface for importing a reporting event; The acquisition unit acquires the touch coordinate information of the reporting event in the following manner: Acquire a point reporting event imported based on the first interface, wherein the point reporting event corresponds to pre-cached touch coordinate information.
11. The device according to claim 10, characterized in that The user interface also includes a second interface for setting the reporting point event restoration parameters, and the reporting point event restoration parameters at least include the system protocol.
12. The device according to claim 8, characterized in that The processing unit compiles the touch coordinate information in the protocol file in the following manner: The dot-dash line compilation function is called to compile the touch coordinate information in the protocol file to obtain the screen operation gesture corresponding to the touch coordinate information.
13. The device according to claim 8, characterized in that The display unit displays the screen operation gesture corresponding to the touch coordinate information in the following manner: An interface mapping function is called to display the screen operation gesture corresponding to the touch coordinate information on the display interface.
14. The device according to claim 9, characterized in that The apparatus further includes a recording unit, wherein the recording unit is configured to: In response to a screen recording operation instruction, recording the displayed screen operation gesture; The debugging unit is used to debug the reporting event based on the recorded screen operation gesture.
15. A touch screen point reporting event processing device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to execute the touch screen point reporting event processing method according to any one of claims 1 to 7.
16. A non-transitory computer-readable storage medium, which, when the instructions in the storage medium are executed by a processor of a mobile terminal, enables the mobile terminal to execute the touch screen point reporting event processing method according to any one of claims 1 to 7.
Citation Information
Patent Citations
Touch screen operation recognizing method, touch screen system operation and recognition debugging method and corresponding device
CN101788863A
Game operation recording and processing method and system for mobile terminal
CN106648397A
Gesture track simulation method and device and electronic equipment
CN107463331A
Method for reproducing touch track through log, terminal and computer readable storage medium
CN108009073A