Control method and apparatus for pointer of touch screen

Abstract

Disclosed are a control method and apparatus for a pointer of a touch screen. The method comprises: acquiring, in real time, data of a pointer drag operation performed by a user on an airborne operation device, wherein a pointer moving in response to the pointer drag operation is displayed on the touch screen, and the data of the pointer drag operation comprises, recorded on a frame-by-frame basis during the drag operation, a pointer drag movement amount of each frame and a pointer drag direction; and after the drag is released, for data of each frame, performing a reverse displacement operation with respect to the pointer drag movement amount on the basis of the pointer drag direction, in the frame-record sequence or the reverse sequence in the data of the pointer drag operation. The present invention is used for improving the control efficiency of the touch screen and enhancing user experience.

Description

Control method and device of touch screen pointer TECHNICAL FIELD

[0001] The present application relates to the field of mobile terminal touch control technology, and in particular to a control method and device of a touch screen pointer. BACKGROUND

[0002] This section is intended to provide background or context to the inventive embodiments recited in the claims. The description herein does not constitute admission that the background art is prior art nor does it constitute an indication that the background art is relevant to determining inventiveness.

[0003] With the development of computer technology, the user interface interaction mode has evolved from the "pointer" system in the PC era to the "touch" system in the mobile internet era. Traditional computer operating systems are designed based on the pointer system, with a mouse as the main control carrier, providing a high-precision control experience. However, after entering the mobile internet era, general mobile phone operating systems are optimized for touch control, characterized by a large screen area occupied by interface elements (such as icons and fonts), and most operations can be completed directly by fingers.

[0004] In recent years, more and more mobile screen devices (such as mobile phones, tablets, car screens, and education tablets) use mobile phone operating systems and appear in scenarios where users cannot directly touch the screen. In these cases, remote control is usually performed using air operation devices (such as touchpads and air mice). The operation mode of these devices is different from traditional touch operation, especially in terms of sliding and dragging operations, where users need to frequently move the pointer from one position to another and then manually move the pointer back to the starting position, which significantly reduces operation efficiency and affects user experience.

[0005] The main problem currently existing is that when using air operation devices away from touch screens, the process of operating touch-optimized interfaces through pointer control systems requires users to frequently manually move the pointer from the end point back to the starting point. This is manifested in:

[0006] 1. Low operation efficiency: When users need to perform sliding or dragging operations from point A to point B multiple times, they need to manually move the pointer from point B back to point A after each operation, increasing repetitive actions for users and thus reducing operation efficiency.

[0007] 2. Poor user experience: Since additional manual operations are required to return the pointer, the use of air operation devices is less intuitive and natural than direct touch control.

[0008] 3. Insufficient cross-platform compatibility: Existing solutions may not be applicable to all operating systems and devices, limiting the widespread use of touch screen control solutions. SUMMARY

[0009] The embodiment of the present application provides a control method of a touch screen pointer, which is used for solving the problem of low efficiency of manually moving back the pointer, improving the control efficiency of the touch screen, improving the user experience, and improving the cross-platform compatibility.

[0010] Real-time acquisition of pointer dragging operation data of a user on an air operation device; the touch screen displays a pointer moving in response to the pointer dragging operation; the pointer dragging operation data includes the pointer dragging movement amount and the pointer dragging direction of each frame recorded frame by frame in the dragging operation process; after the dragging is released, the data of each frame is reversely displaced based on the pointer dragging movement amount and the pointer dragging direction in the order or reverse order of frame recording in the pointer dragging operation data.

[0011] In an optional embodiment, the method further includes: cumulative, segmented cumulative or grouped processing of the pointer dragging movement amount of each frame recorded frame by frame in the dragging operation process, so as to obtain the total displacement amount or the segmented displacement amount of the pointer;

[0012] In an optional embodiment, after the dragging is released, the data of each frame is reversely displaced based on the pointer dragging movement amount and the pointer dragging direction in the order or reverse order of frame recording in the pointer dragging operation data, including: moving the pointer in the direction opposite to the total displacement amount or the segmented displacement amount, so that the pointer returns to the predetermined position or approaches the predetermined position in the form of one-time rebound, segmented rebound, equal-division rebound or simulated rebound time sequence visual effect.

[0013] In an optional embodiment, the pointer dragging operation data further includes a pointer dragging time interval; after the dragging is released, the data of each frame is reversely displaced based on the pointer dragging time interval and the pointer dragging direction in the order or reverse order of frame recording in the pointer dragging operation data.

[0014] In an optional embodiment, the method further includes: real-time acquisition of pointer dragging operation data of a user on an air operation device; the touch screen displays a pointer moving in response to the pointer dragging operation; the pointer dragging operation data includes the pointer dragging movement amount and the pointer dragging direction and the pointer dragging time interval of each frame recorded frame by frame in the dragging operation process; after the dragging is released, data of each frame is reversely displaced based on the pointer dragging time interval and the pointer dragging movement amount in the order or reverse order of frame recording in the pointer dragging operation data.

[0015] The embodiment of the present application further provides a control device of a touch screen pointer, which is used for solving the problem of low efficiency of manually moving the pointer back, improving the control efficiency of the touch screen, improving the user experience, and improving the cross- platform compatibility.

[0016] The pointer dragging operation data acquisition module is configured to acquire, in real time, pointer dragging operation data performed by a user on an air operation device; the pointer is displayed in the touch screen and moves in response to the pointer dragging operation; the pointer dragging operation data includes a pointer dragging movement amount of each frame in a dragging operation process recorded frame by frame, and a pointer dragging direction;

[0017] The reverse displacement module is configured to, after the dragging is released, displace the pointer dragging movement amount of each frame in the reverse order or the order of frame recording in the pointer dragging operation data based on the pointer dragging direction.

[0018] The pointer dragging operation data acquisition module is further configured to accumulate, segmentally accumulate, or group process the pointer dragging movement amount of each frame in the dragging operation process recorded frame by frame, so as to obtain a total displacement amount or a segmented displacement amount of the pointer.

[0019] The reverse displacement module is further configured to move the pointer in a direction opposite to the total displacement amount or the segmented displacement amount, so that the pointer returns to a predetermined position or approaches the predetermined position in a one-time rebound, segmented rebound, equal-division rebound, or simulated rebound time sequence visual effect manner.

[0020] The pointer dragging operation data further includes a pointer dragging time interval; the pointer dragging operation data acquisition module is further configured to, after the dragging is released, displace the pointer dragging movement amount of each frame based on the pointer dragging time interval and the pointer dragging direction in the reverse order or the order of frame recording in the pointer dragging operation data.

[0021] The embodiment of the present application further provides a control device of a touch screen pointer, which comprises:

[0022] The pointer dragging operation data acquisition module is configured to acquire, in real time, pointer draggingoperation data performed by a user on an air operation device; the pointer is displayed in the touch screenand moves in response to the pointer dragging operation; the pointer dragging operation data includes a pointer dragging movementamount of each frame in a dragging operation process recorded frame by frame, a pointer dragging direction, and a pointer dragging time interval;

[0023] The reverse displacement module is configured to, after the dragging is released, displace the pointerdragging movement amount of each frame based on the pointer dragging time interval and the pointer dragging direction in thereverse order or the order of frame recording in the pointer dragging operation data.

[0024] The embodiment of the present application further provides a computer device, which comprises a memory, a processor, and a computer program stored in the memory and capable of running on the processor; when the processor executes the computer program, the control method of the touch screen pointer is realized.

[0025] The embodiment of the present application also provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to realize the control method of the touch screen pointer.

[0026] The embodiment of the present application also provides a computer program product, which comprises a computer program, and the computer program is executed by a processor to realize the control method of the touch screen pointer.

[0027] In the embodiment of the present application, the pointer drag operation data of a user on an air operation device is acquired in real time; the pointer moving in response to the pointer drag operation is displayed on the touch screen; the pointer drag operation data comprises the pointer drag moving amount, the pointer drag direction and the pointer drag time interval of each frame recorded in the drag operation process; after the drag is released, the reverse displacement of the pointer drag moving amount of each frame is performed based on the pointer drag time interval and the pointer drag direction in the order or reverse order of the frame recording in the pointer drag operation data. The embodiment of the present application can record the operation track of the user completely and accurately by acquiring the detailed data of each frame of the user on the air operation device during the pointer drag operation, including the pointer drag moving amount, the direction and the time interval; when the user completes the drag operation, the reverse displacement operation is performed based on the recorded data, without the manual return of the pointer by the user, thereby avoiding the tedious manual return operation and directly improving the operation efficiency; the reverse displacement of the pointer drag moving amount is performed in the order or reverse order of the frame recording in the pointer drag operation data, which simulates the smooth experience similar to the direct touch, improves the satisfaction of the user using the air operation device to control the touch screen in the non-touch screen scene, and significantly improves the user experience; by focusing on the relative position change of the pointer in the operation process, without relying on the absolute position information of the device, the unified pointer control logic can be realized on different operation systems and various types of mobile screen devices, a cross-platform and highly compatible solution is provided, and the pointer control demand of diversified devices in the non-touch operation scene is met. BRIEF DESCRIPTION OF DRAWINGS

[0028] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or the prior art description. Obviously, the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor. In the drawings:

[0029] FIG. 1A is a flow diagram of a control method of a touch screen pointer in an embodiment of the present application;

[0030] FIG. 1B is a flow diagram of another control method of a touch screen pointer in an embodiment of the present application;

[0031] Fig. 2 is a specific example diagram of a control method of a touch screen pointer according to an embodiment of the present application;

[0032] Fig. 3 is a specific example diagram of a control method of a touch screen pointer according to an embodiment of the present application;

[0033] Fig. 4 is a specific example diagram of a control method of a touch screen pointer according to an embodiment of the present application;

[0034] Fig. 5 is a specific example diagram of a control method of a touch screen pointer according to an embodiment of the present application;

[0035] Fig. 6 is a specific example diagram of a control method of a touch screen pointer according to an embodiment of the present application;

[0036] Fig. 7 is a specific example diagram of a sliding record stage in a control method of a touch screen pointer according to an embodiment of the present application;

[0037] Fig. 8 is a specific example diagram of a data processing stage and a rebound execution stage in a control method of a touch screen pointer according to an embodiment of the present application;

[0038] Fig. 9 is a structural schematic diagram of a control device of a touch screen pointer according to an embodiment of the present application;

[0039] Fig. 10 is a schematic diagram of a computer device for controlling a touch screen pointer according to an embodiment of the present application. DETAILED DESCRIPTION

[0040] To make the objectives, technical solutions and advantages of the embodiments of the present application clearer, further detailed description will be given to the embodiments of the present application in combination with the drawings. Herein, the illustrative embodiments of the present application and the description thereof are used to explain the present application, but not as a limitation to the present application.

[0041] In the development history of computer technology, the user interface interaction mode has experienced the evolution from the "pointer" system in the PC era to the "touch" system in the mobile internet era. The computer operating system in the PC era is designed based on the pointer system, with a mouse as the main control carrier, to realize high-precision control. The mobile phone operating system in the mobile internet era is optimized for touch, with the feature that the interface elements (such as icons, fonts) take up a large proportion in the screen, and most operations can be completed directly by a finger.

[0042] However, with the development of technology, more and more mobile screen devices (such as mobile phones, tablets, car screens, educational tablets, etc.) using mobile phone operating systems appear in scenarios where users cannot directly touch the screen. In this case, remote control needs to be performed using an air operation device (such as a touchpad, a mouse, etc.). In such a system, horizontal sliding and vertical sliding are high-frequency operations of users. In these scenarios, the existing pointer system has a significant defect: when a user needs to perform a sliding or dragging operation from point A to point B multiple times, the pointer needs to be manually moved from point B back to point A after each operation, which greatly reduces the operation efficiency.

[0043] To solve the above problems, the embodiments of the present application provide a control method of a touch screen pointer to solve the problem of low efficiency of manual pointer movement, improve the control efficiency of the touch screen, improve the user experience, and improve the cross-platform compatibility.

[0044] FIG. 1A is a flowchart of a control method of a touch screen pointer according to an embodiment of the present application. As shown in FIG. 1A, the method can include the following steps:

[0045] In step S11, pointer dragging operation data performed by a user on an air operation device is acquired in real time; a pointer moving in response to the pointer dragging operation is displayed in the touch screen; and the pointer dragging operation data includes the pointer dragging movement amount and the pointer dragging direction of each frame recorded frame by frame during the dragging operation.

[0046] Specifically, a pointer is displayed in the touch screen, and the pointer is used to represent the current operation position of the user. When the user performs a pointer dragging operation through the air operation device, the pointer displayed in the touch screen moves in response to the pointer dragging operation to provide visual operation feedback to the user. During the pointer dragging operation, the dragging trajectory of the user is recorded frame by frame to form the pointer dragging operation data. Specifically, the pointer dragging operation data includes the pointer dragging movement amount and the pointer dragging direction of each frame recorded frame by frame during the dragging operation. The pointer dragging movement amount is used to represent the position change of the pointer between adjacent frames, and the pointer dragging direction is used to represent the moving direction of the pointer in the frame. By recording the pointer dragging movement amount and the pointer dragging direction frame by frame, operation data reflecting a complete pointer dragging process of the user can be obtained to provide a basis for subsequent back control.

[0047] In step S12, after the dragging is released, the data of each frame is reversely displaced based on the pointer dragging direction according to the order or reverse order of the frame recording in the pointer dragging operation data.

[0048] Specifically, for any frame of recorded data, the pointer dragging direction and the pointer dragging movement amount corresponding to the frame are read, the reverse displacement direction is determined based on the pointer dragging direction, and the pointer is controlled to move a displacement amount corresponding to the pointer dragging movement amount of the frame in a direction opposite to the pointer dragging direction of the frame, so as to form a reverse displacement corresponding to the frame. Subsequently, the reverse displacements corresponding to the frames are sequentially performed in the order or in reverse order, so that the pointer can move back in a direction opposite to the dragging process after the dragging is released, thereby returning to the predetermined position or approaching the predetermined position. Through the above method, after the user completes a pointer dragging operation, the pointer can be automatically controlled to perform a reverse displacement based on the frame-by-frame recorded dragging operation data, thereby reducing the user's operation of manually moving the pointer back to the starting position, and improving the interaction efficiency and use experience of the touch screen in the air operation device control scene.

[0049] The touch screen pointer control method provided by the embodiments of the present application can automatically perform reverse displacement control based on the frame-by-frame recorded pointer dragging operation data after the user completes a pointer dragging operation, thereby avoiding the problem that the user manually moves the pointer back to the starting position, improving the efficiency and fluency of the pointer operation, and being suitable for various air operation devices and touch screen application scenarios.

[0050] In one embodiment, the pointer dragging movement amount of each frame in the frame-by-frame recorded dragging operation process is accumulated, segmented and accumulated, or grouped, to obtain the total displacement amount or the segmented displacement amount of the pointer. Specifically, the system can add up the pointer dragging movement amounts recorded by the frames in chronological order, thereby obtaining the total displacement amount representing the overall displacement change of the current dragging operation; or the dragging process can be divided into multiple continuous segments according to a preset segmentation rule, and the pointer dragging movement amounts of the frames in each segment are added up respectively to obtain multiple segmented displacement amounts; or the system can divide a plurality of frame records into a group according to a preset grouping rule, and the pointer dragging movement amounts in each group are combined to obtain a grouped displacement amount. Through the above accumulation, segmented accumulation or grouping processing mode, the frame-by-frame fine-grained movement amount data can be converted into overall or local displacement description, providing displacement basis of different granularities for subsequent rebound control, so as to adapt to different interactive effect requirements.

[0051] In one embodiment, after the drag release, the reverse displacement of the pointer dragging movement amount of each frame is performed in the order or reverse order of the frame records in the pointer dragging operation data based on the pointer dragging direction, including: moving the pointer in the opposite direction of the total displacement amount or the segmented displacement amount, so that the pointer returns to the predetermined position or approaches the predetermined position in the form of one-time rebound, segmented rebound, equal-division rebound or simulated rebound time sequence visual effect. Specifically, when one-time rebound is adopted, the system can control the pointer to move a corresponding displacement amount in the opposite direction based on the total displacement amount; when segmented rebound is adopted, the system can control the pointer to sequentially complete multiple continuous rebound stages based on the segmented displacement amounts; when equal-division rebound is adopted, the system can divide the total displacement amount or a certain segmented displacement amount into several equal-division displacements, and control the pointer to rebound multiple times according to the equal-division displacements to form a smoother rebound process; when simulated rebound time sequence visual effect is adopted, the system can make the rebound process of the pointer present a time sequence change corresponding to or approximate to the dragging process in the displacement output, so that the pointer rebound is closer to the user's perception of natural interaction in visual presentation. Through the above-mentioned manner, diversified rebound forms and visual effect selection can be provided on the basis of ensuring that the pointer returns to the predetermined position or approaches the predetermined position, so as to improve the interaction fluency and user experience when the air operation device controls the touch screen.

[0052] In one embodiment, the pointer dragging operation data further includes a pointer dragging time interval; after the drag release, the reverse displacement of the pointer dragging movement amount of each frame is performed in the order or reverse order of the frame records in the pointer dragging operation data based on the pointer dragging time interval and the pointer dragging direction. Referring to FIG. 1B, FIG. 1B is a flowchart of another control method of a touch screen pointer in an embodiment of the present application. The method can include:

[0053] Step 101: real-time acquisition of pointer dragging operation data performed by a user on an air operation device; a pointer moving in response to the pointer dragging operation is displayed in the touch screen; the pointer dragging operation data includes the pointer dragging movement amount, the pointer dragging direction and the pointer dragging time interval of each frame in the dragging operation process recorded frame by frame;

[0054] Step 102: after the drag release, the reverse displacement of the pointer dragging movement amount of each frame is performed in the order or reverse order of the frame records in the pointer dragging operation data based on the pointer dragging time interval and the pointer dragging direction.

[0055] In the embodiment of the present application, real-time pointer drag operation data of a user on an air operation device is acquired; a pointer moving in response to the pointer drag operation is displayed on the touch screen; the pointer drag operation data includes the pointer drag movement amount, the pointer drag direction and the pointer drag time interval of each frame recorded frame by frame during the drag operation process; the reverse displacement of the pointer drag movement amount of each frame is performed based on the pointer drag time interval and the pointer drag direction in the order or reverse order of the frame recording in the pointer drag operation data. The embodiment of the present application can record the operation track of the user completely and accurately by acquiring the detailed data of each frame during the pointer drag operation of the user on the air operation device, including the pointer drag movement amount, the direction and the time interval; when the user completes the drag operation, the reverse displacement operation is performed based on the recorded data, without the need for the user to manually return the pointer, thereby avoiding the tedious manual return operation and directly improving the operation efficiency; the reverse displacement of the pointer drag movement amount is performed in the order or reverse order of the frame recording in the pointer drag operation data, to simulate the smooth experience similar to direct touch, improve the satisfaction of the user using the air operation device to control the touch screen in the non-touch screen scenario, and significantly improve the user experience; by focusing on the relative position change of the pointer during the operation process, without relying on the absolute position information of the device, the unified pointer control logic can be realized on different operation systems and various types of mobile screen devices, the automatic rebound control of the pointer is performed according to the set rebound mode association, thereby providing a cross-platform and highly compatible solution, and meeting the pointer control requirements of diversified devices in the non-touch operation scenario.

[0056] In the implementation, first, step 101 is performed: real-time pointer drag operation data of a user on an air operation device is acquired; a pointer moving in response to the pointer drag operation is displayed on the touch screen; the pointer drag operation data includes the pointer drag movement amount, the pointer drag direction and the pointer drag time interval of each frame recorded frame by frame during the drag operation process.

[0057] In the embodiment, the interaction signals between the air operation device and the touch screen are continuously monitored. When it is detected that the user operates the air operation device to generate a signal conforming to the starting characteristics of the pointer drag operation (such as the finger pressing and starting to move on the touchpad, or the specific key pressing and accompanying movement on the air mouse, etc.), the data acquisition process is immediately started. At the same time, the related data recording module is initialized to prepare for the frame-by-frame recording of the subsequent operation data.

[0058] At each time node in the operation process, the current time information is accurately acquired and marked as a time stamp. This time stamp is used for subsequent calculation of the time interval in the pointer drag operation process, and its recording accuracy needs to reach the degree of accurately reflecting the change of the pointer operation time, for example, to the millisecond level, thereby providing a strong basis for accurately analyzing the operation rhythm of the pointer.

[0059] The position information corresponding to the pointer on the touch screen is acquired. By comparing the changes of the position of the pointer in the two frames, the moving amount of the pointer in different directions is calculated. Assuming that the coordinate of the position of the pointer in the current frame is a set of values, and the coordinate of the position of the pointer in the previous frame is another set of values, the moving amount of the pointer in the horizontal direction and the vertical direction can be obtained by subtracting the coordinate values in the horizontal direction and the vertical direction. According to the positive and negative of the moving amount, the dragging direction of the pointer can be determined. If the moving amount in the horizontal direction is positive, it indicates that the pointer moves to the right in the horizontal direction; if it is negative, it indicates that the pointer moves to the left in the horizontal direction. Similarly, the positive and negative of the moving amount in the vertical direction can also determine the moving direction of the pointer in the vertical direction.

[0060] The moving amount of the pointer (including the horizontal and vertical directions) obtained at each time point, the dragging direction of the pointer (determined according to the positive and negative of the moving amount), and the corresponding timestamp are integrated into a complete set of pointer dragging operation data. Then, according to the time sequence, these data are stored in the cache area or special data storage structure designated by the system, so as to leave complete original data for subsequent data processing and analysis.

[0061] The state of the pointer operation is continuously monitored. When it is detected that the user operation of the air operation device generates a signal (such as the finger on the touchpad being lifted or a specific key on the mouse being released) that meets the end characteristic of the pointer dragging operation, the data acquisition operation is stopped. At this time, the frame-by-frame data of the whole process of the user's pointer dragging operation from the beginning to the end has been completely recorded.

[0062] The display of the pointer in the touch screen is closely related to the operation of the air operation device. When the air operation device sends a pointer moving instruction, the touch screen receives the instruction signal and updates the position of the pointer on the screen according to the relevant parameters in the instruction. The movement of the pointer on the screen is realized by adjusting the coordinate values in the screen coordinate system. For example, in a two-dimensional plane touch screen coordinate system, the initial position of the pointer has a specific coordinate value. When a instruction with a moving amount in the horizontal direction and no moving amount in the vertical direction is received, the coordinate value of the pointer in the horizontal direction will be updated according to the moving amount, while the coordinate value in the vertical direction remains unchanged, so as to realize the horizontal movement of the pointer on the screen.

[0063] The display of the pointer on the touch screen provides intuitive operation feedback for the user. By observing the position change of the pointer on the screen, the user can clearly understand the effect of their operation on the air operation device. The display attributes of the pointer, such as shape and color, can be adjusted according to system settings to adapt to different screen backgrounds and operation scenarios, ensuring that the pointer has good visibility in various situations. For example, when using a car-mounted screen in a bright outdoor environment, the pointer can use thick lines and bright colors to make it easy for the driver to see the pointer position; when using an educational tablet indoors, the style of the pointer can be customized according to the teaching content and interface style to make it coordinate with the overall visual effect, while not affecting the user's observation and operation perception of the pointer movement. This close connection between the pointer display and user operation and the good visual feedback mechanism ensure that the user can accurately and efficiently control the touch screen pointer through the air operation device, achieving smooth interaction with the touch screen content.

[0064] In one embodiment, FIG. 2 is a specific example diagram of a control method for a touch screen pointer in an embodiment of the present application, as shown in FIG. 2, real-time acquisition of pointer dragging operation data performed by the user on the air operation device includes:

[0065] Step 201: When it is detected that the user starts to perform pointer dragging operation on the air operation device, a start timestamp is generated.

[0066] Step 202: Record the pointer dragging movement and the pointer dragging time interval in the dragging operation process frame by frame until it is detected that the user stops performing pointer dragging operation on the air operation device; at the same time, add the corresponding timestamp to each frame of recorded data.

[0067] In the embodiment, the monitoring of the interaction between the air operation device and the touch screen is always maintained. Once the signal emitted by the air operation device is detected to match the characteristics of the user starting to perform pointer dragging operation, such as detecting that the finger is pressed in a specific way on the touchpad and moving, or a specific key on the air mouse is pressed and the movement signal is detected, the time acquisition operation is triggered immediately, the time information of the current time is accurately acquired, and it is defined as the start timestamp. This start timestamp serves as the time reference point for the entire pointer dragging operation data record, providing a key reference start value for subsequent calculation of pointer dragging related time intervals.

[0068] From the moment the pointer drag operation is detected, the state of the pointer is sampled at fixed time intervals (such as every few milliseconds for a frame). At each sampling time, the corresponding position information of the pointer on the touch screen is obtained, and the movement amount of the pointer relative to the previous frame position is calculated. At the same time, the timestamp of the current sampling time is recorded, which is compared with the timestamp recorded by the previous frame to calculate the time interval between the two, which is the pointer drag time interval.

[0069] Such frame-by-frame recording operation is continuously performed, and the movement amount of the pointer and the time interval data are continuously updated until the user stops the pointer drag operation. This process ensures complete recording of the entire pointer drag operation trajectory, providing detailed raw data for subsequent data processing and analysis.

[0070] At the same time of recording the movement amount of the pointer and the time interval data of each frame, the corresponding timestamp is added to the frame data. This timestamp is not only used to calculate the pointer drag time interval, but also serves as the time identifier of the entire data recording, so that each set of data can be accurately positioned on the time axis. The pointer drag movement amount, the pointer drag time interval, and the corresponding timestamp are integrated into a complete data unit, which is stored in the pre-initialized data structure in chronological order.

[0071] In one embodiment, FIG. 3 is a specific example diagram of a control method for a touch screen pointer in an embodiment of the present application, as shown in FIG. 3, the pointer drag movement amount and the pointer drag direction during the drag operation process are recorded frame by frame, including:

[0072] Step 301: recording the relative coordinate information corresponding to the pointer during the drag operation process frame by frame;

[0073] Step 302: taking the change value and the change value positive and negative of the relative coordinate information of each frame and the relative coordinate information of the next frame as the pointer drag movement amount and the pointer drag direction corresponding to the frame, respectively.

[0074] In one embodiment, FIG. 4 is a specific example diagram of a control method for a touch screen pointer in an embodiment of the present application, as shown in FIG. 4, the pointer drag time interval during the drag operation process is recorded frame by frame, including:

[0075] Step 401: recording the timestamp corresponding to the pointer during the drag operation process frame by frame;

[0076] Step 402: taking the time interval between the timestamp of each frame and the timestamp of the next frame as the pointer drag time interval corresponding to the frame.

[0077] In the embodiment, in the process of frame-by-frame recording of the pointer dragging operation, at each sampling time, the relative coordinate information of the pointer in the touch screen coordinate system is obtained through a special position detection means. This relative coordinate information is based on a specific fixed reference point on the screen (such as the top left corner vertex of the screen) or the previous frame pointer position, and the coordinate offset of the pointer in the horizontal and vertical directions relative to the reference point is calculated. For each sampling frame, the coordinate offset of the pointer in the horizontal and vertical directions is carefully recorded, thereby forming the complete relative coordinate information of the frame.

[0078] In order to ensure the continuity and accuracy of the recording of the relative coordinate information during the entire pointer dragging operation, a specific sampling strategy and data processing flow are adopted. Even if the pointer moves at a high speed or has slight jitter, the sampling strategy can ensure that the pointer position is sampled at an appropriate frequency, and the accurate relative coordinate information of each frame is obtained. The data processing flow is responsible for the arrangement and storage of the sampling data, preventing data loss or incorrect recording. In this way, the position of the pointer at each time point can be accurately captured, and the reliability of the recording of the relative coordinate information is ensured.

[0079] For the relative coordinate information recorded for each frame, the difference between the relative coordinates of the current frame and the relative coordinates of the next frame in the horizontal and vertical directions is calculated to determine the movement amount of the pointer in these two directions. Assuming that the relative coordinates of the current frame are a set of values and the relative coordinates of the next frame are another set of values, the movement amounts in the horizontal and vertical directions are obtained by corresponding calculation. These movement amount values can accurately reflect the position change amplitude of the pointer between the adjacent two frames.

[0080] The positive and negative values of the calculated movement amounts are used to determine the dragging direction of the pointer. If the horizontal direction movement amount is positive, it indicates that the pointer moves to the right in the horizontal direction; if it is negative, it indicates that the pointer moves to the left in the horizontal direction. Similarly, for the vertical direction movement amount, a positive value indicates that the pointer moves downward in the vertical direction, and a negative value indicates that the pointer moves upward. This method of determining the direction by the positive and negative values of the movement amount is simple and effective, and can accurately reflect the movement direction of the pointer in the two-dimensional plane.

[0081] When recording the data of the pointer dragging operation frame by frame, a timing device is used to obtain the current time information at each sampling time and mark it as a time stamp. The timing device has a certain accuracy, which can reach milliseconds or higher, ensuring accurate recording of the time of the pointer operation.

[0082] As the pointer dragging operation continues, the time stamp of each frame is recorded continuously, forming a time stamp sequence arranged in chronological order. This sequence completely records the time trajectory of the pointer during the entire operation process, and each time stamp is associated with corresponding pointer position information, movement amount, etc., to form a complete data record of the pointer dragging operation.

[0083] Taking the power dispatching center control large screen power system monitoring pointer as an example, the recorded timestamp sequence can clearly show the operation time sequence of the dispatcher when monitoring the power operation condition and adjusting the power parameters. Each time point from starting to pay attention to the power load of a certain area to making an adjustment decision is accurately recorded, which helps review the operation process.

[0084] For the recorded timestamp sequence, the difference between adjacent timestamps is calculated to determine the pointer dragging time interval. Assuming that the current frame timestamp is a specific time value and the next frame timestamp is another time value, the difference between the two is the pointer dragging time interval. This time interval reflects the time span of the pointer between the adjacent two frames, that is, the time rhythm in the moving process of the pointer.

[0085] The calculated pointer dragging time interval data has many applications in subsequent data processing and analysis. For example, when judging whether the user operation has a pause or slow movement situation, the time interval data is an important basis for judgment. If the time interval is long and the pointer movement is small, it may indicate that the user has a short stay or operation hesitation at a certain position.

[0086] In specific implementation, after step 101: real-time acquisition of pointer dragging operation data of the user on the air operation device, step 102 is performed: after the release of the dragging, the reverse displacement of the pointer dragging movement amount of each frame data is performed based on the pointer dragging time interval and the pointer dragging direction in the order or reverse order of the frame records in the pointer dragging operation data.

[0087] In one embodiment, it further includes:

[0088] For each frame record data, it is determined whether the frame record data is a target frame; the pointer dragging time interval corresponding to the target frame is greater than a first threshold value; the pointer dragging time interval of the target frame is modified to a preset time interval; the target frame in the pointer dragging operation data is replaced with the modified target frame to obtain modified pointer dragging operation data;

[0089] The reverse displacement of the pointer dragging movement amount of each frame data based on the pointer dragging time interval and the pointer dragging direction in the order or reverse order of the frame records in the pointer dragging operation data includes:

[0090] The reverse displacement of the pointer dragging movement amount of each frame data based on the pointer dragging time interval and the pointer dragging direction in the order or reverse order of the frame records in the modified pointer dragging operation data.

[0091] In the embodiment, after obtaining the complete pointer dragging operation data, detailed analysis and judgment are performed on each frame record data to determine whether the frame record data belongs to the target frame. The condition for determining that a frame is a target frame is that the corresponding pointer dragging time interval is greater than a first threshold. For example, when a remote control is used to control the pointer on a smart TV screen to perform channel switching, the movement of the pointer is recorded frame by frame. Some frames correspond to a pointer that stays at a position for a relatively long time, that is, the pointer dragging time interval is relatively large. When the time interval exceeds the first threshold, the frame meets the condition for determining a target frame. The first threshold is a time standard that is set in advance according to the actual operation scene and the characteristics of the pointer operation, and is used to screen operation frames that have specific time characteristics.

[0092] Once it is determined that a frame is a target frame, the pointer dragging time interval of the frame is modified to a preset time interval. The preset time interval is also a fixed time value that is set in advance according to the overall system requirements and the smoothness of the operation. After the modification of the pointer dragging time interval of the target frame is completed, the modified target frame is used to replace the corresponding target frame in the original pointer dragging operation data. Through the replacement operation, the modified pointer dragging operation data can be obtained. After the processing, the data that does not meet the regular time interval or affects the subsequent processing is optimized in the complete data record of the pointer dragging operation. The modified data can more accurately reflect the actual situation of the pointer operation.

[0093] When the reverse displacement of the pointer dragging movement amount is performed according to the sequence of the frame records in the modified pointer dragging operation data, the operation is to gradually push back from the first frame data. First, for the first frame data, the pointer dragging time interval and the pointer dragging direction information are obtained, and the direction of the reverse displacement is determined according to the pointer dragging direction. For example, if the pointer dragging direction is to move right in the horizontal direction, then the reverse displacement direction is to move left in the horizontal direction. Then, the corresponding waiting time is set according to the pointer dragging time interval recorded in the frame, and when the waiting time ends, the pointer is moved by the corresponding pointer dragging movement amount in the determined reverse displacement direction. Then, each subsequent frame data is processed in the same way. For example, in the scenario of using a smart watch to control the pointer on the screen of a mobile phone to browse a picture set, if the reverse displacement is performed in sequence, the pointer will move back from the last browsed picture position according to the previous browsing order, and each frame will accurately move a corresponding distance according to the corresponding time interval and reverse direction, achieving a step-by-step backtracking effect, simulating the process of the pointer returning in reverse according to the operation sequence, which helps to restore the operation path and better meets the user's needs in some application scenarios that require operation trajectory.

[0094] If the reverse displacement of the pointer dragging movement amount is performed in the reverse order of the frame records in the modified pointer dragging operation data, the operation is to process the last frame data first and then process the previous frames in sequence. First, the pointer dragging time interval, pointer dragging direction, and other key information of the last frame are obtained, and the reverse displacement direction is determined according to the pointer dragging direction. For example, if the pointer dragging direction is to move down in the vertical direction, then the reverse displacement direction is to move up in the vertical direction. Then, the waiting time is set according to the pointer dragging time interval of the last frame, and when the waiting time is up, the pointer is moved by the corresponding pointer dragging movement amount in the reverse displacement direction. After processing the last frame, the second last frame is processed, and the above steps of obtaining information, determining direction, setting waiting time, and moving pointer are repeated, and this cycle continues until the first frame data is processed. For example, in the scenario of using the air gesture (air operation device) of a mobile phone to control the screen pointer to quickly browse the content of a long list (such as a news list), the reverse displacement in reverse order can quickly return the pointer from the end of the list to the beginning, skipping the intermediate operation process, and more efficiently returning to the initial state. In scenarios where the operation efficiency is required and the specific operation path restoration is not too concerned, this method can reduce the user's waiting time and improve the convenience and smoothness of the operation.

[0095] The reverse displacement operation of the pointer dragging movement amount is based on the sequence or reverse sequence, so that the pointer can be reasonably returned after completing a dragging operation, the operation of the touch screen pointer is more in line with the user's operation expectation, the user experience is enhanced when using the air operation device to control the touch screen pointer, and the entire pointer operation process is logically and actually good.

[0096] In the above embodiment, when the user completes the dragging operation, the reverse displacement operation is performed based on the recorded data, and the user does not need to manually return the pointer, thereby avoiding the tedious manual return operation and directly improving the operation efficiency; in the process of determining the target frame and modifying the pointer dragging time interval and replacing the data to obtain the corrected pointer dragging operation data, for those target frames with small pointer movement amount and long time interval, the time interval is modified to the preset time interval, thereby avoiding the problem that the subsequent rebound calculation is too complex and time-consuming due to long time pause, speeding up the control speed and operation efficiency of the touch screen pointer, so that the pointer can perform the rebound operation more timely, and the user waiting time is reduced; the reverse displacement of the pointer dragging movement amount is performed in the sequence or reverse sequence of the frame record in the corrected pointer dragging operation data, which simulates the smooth experience similar to direct touch, improves the satisfaction of the user using the air operation device to control the touch screen in the non-touch screen scene, and significantly improves the user experience.

[0097] In one embodiment, for each frame record data, it is determined whether the frame record data is a target frame, including:

[0098] It is determined whether the pointer dragging time interval corresponding to the frame record data is greater than a first threshold value;

[0099] If yes, it is determined whether the pointer dragging movement amount corresponding to the frame record data is less than or equal to a second threshold value;

[0100] If yes, it is determined that the frame record data is a target frame.

[0101] In the embodiment, in a specific embodiment, for each frame record data that has been obtained, it is necessary to determine whether it is a target frame, and the first operation needed is a judgment operation based on the pointer dragging time interval.

[0102] The key information of the pointer drag time interval recorded in each frame of recorded data is viewed and compared with a preset first threshold. The recorded pointer drag time interval represents the time length of the pointer staying or moving in each operation stage. If the pointer drag time interval in a frame of recorded data is longer, such as exceeding the preset first threshold, the first threshold is a time standard set according to the consideration of longer pause time or special time node in daily operation, and when the limit is reached, the first condition of becoming the target frame is met, and further subsequent judgment is required.

[0103] When the pointer drag time interval corresponding to a frame of recorded data is greater than the first threshold, it is determined whether the pointer drag movement amount corresponding to the frame of recorded data is less than or equal to a second threshold.

[0104] In this frame of recorded data, the pointer drag movement amount reflects the position change amplitude of the pointer in the horizontal and vertical directions in the corresponding operation stage. If the pointer stays for a long time at a certain moment (which has met the condition of the time interval being greater than the first threshold), but at the same time, the position change of the pointer on the screen is also large (that is, the pointer drag movement amount exceeds the second threshold), it does not meet the requirements of the target frame. Only when the pointer drag movement amount is within a relatively small range, that is, less than or equal to the second threshold, on the basis of meeting the time interval condition, the second threshold is also set according to the actual operation scene and the definition of the small movement of the pointer, only in this way can it be determined that the frame of recorded data meets the characteristics of the target frame, and further determines it as the target frame.

[0105] By this way of first screening from the pointer drag time interval and then combining the pointer drag movement amount for secondary judgment, the target frames that truly meet the specific requirements and have special operation characteristics can be accurately found from numerous frames of recorded data, laying a foundation for subsequent data processing of these target frames and optimization of the entire touch screen pointer operation, and making the entire pointer control process more in line with various needs in actual application scenarios.

[0106] In one embodiment, for each frame of recorded data, it is determined whether the frame of recorded data is a target frame, including:

[0107] In the process of acquiring the pointer drag operation data of the user operating the device in the air, it is determined in real time whether the current frame of recorded data is a target frame;

[0108] Or, after detecting that the user stops performing the pointer drag operation on the device in the air, for each frame of recorded data, it is determined whether the frame of recorded data is a targeted frame.

[0109] In the above embodiment, in the process of acquiring the pointer drag operation data performed by the user on the air operation device, the target frame is determined immediately after each frame of data is recorded. The target frame is determined by comparing the pointer drag movement of the frame with the first threshold value and the pointer drag time interval of the frame with the second threshold value. If the pointer drag movement is less than or equal to the first threshold value and the pointer drag time interval is greater than the second threshold value, the frame is determined as the target frame. For example, in the scenario where the mobile device is projected to the smart TV and the pointer is controlled by the remote control (air operation device) to browse the webpage, if the first threshold value is set as a small movement distance value and the second threshold value is set as a relatively long time value, when the user slowly moves the pointer on the remote control and the pause time is relatively long, the recorded frame data may meet the target frame condition and is determined as the target frame in real time during the recording process. This real-time determination method can timely find the possible special frame and provide instant information for subsequent data processing.

[0110] Another determination of the target frame is after the user stops the pointer drag operation on the air operation device. At this time, each frame of the recorded pointer drag operation data is determined in sequence. The pointer drag movement of each frame is compared with the first threshold value and the pointer drag time interval is compared with the second threshold value. For example, after the electronic pen (air operation device) draws a figure on the electronic whiteboard and completes the drawing operation, the target frame determination is performed on each frame of data recorded during the entire drawing process. If the pointer movement of a certain frame of data is extremely small and the pause time is relatively long (meets the target frame condition), it is determined as the target frame at this stage. This post-determination method can analyze and determine the target frame from a global perspective after all the operation data is acquired, avoid the misjudgment caused by real-time determination, and ensure the accuracy of the target frame determination.

[0111] In one embodiment, further comprising:

[0112] Combining the pointer drag movement in the recorded data of the continuous target frames to obtain a combined frame;

[0113] Modifying the pointer drag time interval of the target frame to a preset time interval, comprising:

[0114] Modifying the pointer drag time interval of the combined frame to a preset time interval;

[0115] Replacing the target frame in the pointer drag operation data with the modified target frame to obtain the corrected pointer drag operation data, comprising:

[0116] Replacing the corresponding continuous target frames in the pointer drag operation data with the combined frame to obtain the corrected pointer drag operation data.

[0117] In the embodiment, after the merged frame is obtained, the pointer dragging time interval of the merged frame needs to be modified. Specifically, the pointer dragging time interval of the merged frame is modified to a preset time interval. The preset time interval is a fixed time value that is set in advance according to various factors in the design process of the entire touch screen pointer control method. For example, in a vehicle-mounted navigation system, when the driver operates the navigation screen pointer through the vehicle-mounted controller to search for a destination or adjust a route, and the like, if there are continuous target frames (for example, the pointer has multiple short pauses and small movements around a specific search result) that are merged into a merged frame through the previous steps, the pointer dragging time intervals of the original continuous target frames can be uneven and complex. By modifying the pointer dragging time interval of the merged frame to the preset time interval, the data can be made more regular and uniform, which facilitates subsequent analysis of the operation rhythm based on the data, provides a uniform time reference for pointer rebound and other related operations, avoids unnecessary difficulties in subsequent data processing and system function implementation caused by the differences and complexity of the original time intervals, and makes the entire data processing process smoother and more efficient.

[0118] After the modification of the pointer dragging time interval of the merged frame is completed, the next operation is data replacement, that is, the modified merged frame is used to replace the corresponding continuous target frames in the pointer dragging operation data, to obtain the corrected pointer dragging operation data.

[0119] In the original pointer dragging operation data, the continuous target frames each record the operation of the pointer in different small stages, and although they are associated, the data is relatively scattered and complex. After the previous merging and time interval modification, the continuous target frames are replaced by the merged frame, which is equivalent to integrating and optimizing the operation information carried by the scattered and internally related target frames. If the continuous target frames record multiple small movements and pauses of the pointer around a certain channel classification area, after the replacement of the merged frame, the corrected data is more concise and clear when reflecting the pointer operation in this stage. It can more accurately reflect the overall operation characteristics of the pointer in the area, and removes the redundant information that can be caused by the dispersion of multiple frames, so that subsequent analysis of the pointer operation trajectory or optimization of system response based on the operation data can be carried out based on more accurate and effective data, further improving the smoothness and rationality of the entire touch screen pointer operation process, and better meeting the operation expectations of users in the actual use process, and enhancing the operation experience of users.

[0120] In one embodiment, FIG. 5 is a specific schematic diagram of a touch screen pointer control method in an embodiment of the present application. As shown in FIG. 5, the pointer dragging movement amount in the recorded data of the continuous target frames is merged to obtain a merged frame, including:

[0121] Step 501: Based on the order of the timestamps of the data recorded in each frame, obtain the target frame with the earliest timestamp as the frame to be merged;

[0122] Step 502: Determine whether the next frame of the frame to be merged is the target frame;

[0123] Step 503: If so, merge the pointer drag movement of the frame to be merged and the next frame to obtain intermediate data;

[0124] Step 504: Replace the frame to be merged with the intermediate data, and repeat the above steps of determining whether the next frame of the intermediate data is the target frame and merging, until the next frame of the intermediate data is not the target frame or the intermediate data is greater than the third threshold; use the obtained intermediate data as the merged frame.

[0125] In this embodiment, a large amount of frame recording data is generated during the entire touchscreen pointer operation. For those data frames that meet specific conditions and are determined to be target frames, a merging operation needs to be performed according to certain rules to obtain merged frames. First, based on the timestamp of each frame recording data, the data is sorted and checked in chronological order. For example, in a scenario where a smart TV screen pointer is operated via remote control to switch channels and browse related program information, each pointer movement, pause, or other operation will generate corresponding timestamped frame recording data. From this data, the target frame with the earliest timestamp is found and identified as the frame to be merged. This frame to be merged becomes the basis for subsequent merging operations. It carries the operational characteristics of the pointer at a specific initial stage, such as the pointer's initial position near a channel icon and minor movements, providing initial data reference for subsequent merging operations with other consecutive target frames.

[0126] After identifying the frames to be merged, the next step is to check if the next frame is also a target frame. This step is crucial because only when the next frame is also a target frame can the prerequisite for further merging pointer drag movements be met. Continuing with the example of pointer operation on a TV screen, if the frame to be merged corresponds to a period where the pointer briefly hovers over a program details page with minimal movement, then when checking the next frame, it's necessary to determine if the pointer operation recorded in that frame also meets the criteria for a target frame. This means considering factors such as the pointer drag time interval and the amount of pointer movement, and whether these are within the preset range for becoming a target frame. Only when the next frame also meets the target frame conditions can the next merging operation proceed, ensuring the rationality of the merge and the correlation of the data, avoiding the incorrect merging of unrelated frame data, and preventing subsequent accurate analysis and processing of the overall pointer operation.

[0127] Once it's determined that the frame following the frame to be merged is also the target frame, the pointer drag movements of these two frames can be merged to obtain intermediate data. For example, the frame to be merged might have a certain horizontal pointer drag movement and a corresponding vertical movement, while the following frame also has corresponding horizontal and vertical movements. In this case, the horizontal movements of the two frames are added together to obtain the merged horizontal pointer drag movement. The same applies to the vertical direction. This calculation creates new intermediate data containing the merged pointer drag movement. This intermediate data integrates the pointer position changes of the two frames, more comprehensively reflecting the pointer's operational characteristics within this continuous small segment. This lays the foundation for subsequent continuous merging operations and the formation of the final merged frame, making the integration of continuous target frames more consistent with the actual pointer operation's continuity and integrity.

[0128] After obtaining the intermediate data, the frame to be merged is replaced with this intermediate data, updating the frame to the state represented by the intermediate data. Then, the steps of determining whether the next frame after the intermediate data is the target frame and merging are repeated. If the initially determined frame to be merged is updated after one merging operation, the next frame corresponding to the new intermediate data is checked to determine if it is still the target frame. If it is, the pointer dragging amount continues to be merged, and the intermediate data is continuously updated, continuing this loop process. However, this merging operation will not continue indefinitely, but has corresponding stopping conditions. That is, the merging operation will stop when the next frame of the intermediate data is no longer the target frame, that is, when a frame that does not meet the target frame determination conditions is encountered, or when the pointer dragging amount corresponding to the intermediate data generated during the merging process exceeds a pre-set third threshold (this third threshold is a limit determined by a combination of factors such as the reasonable pointer movement range and operation logic in actual operation to avoid the merged data being unreasonably too large or too small, which would affect subsequent judgments).

[0129] In one embodiment, the data of each frame is repositioned in the reverse order of the frame records in the pointer drag operation data, based on the pointer drag time interval and pointer drag direction, including:

[0130] When it is detected that the user has stopped the pointer drag operation on the air-operated device, an instruction is triggered to correct the order or reverse order of the frame records in the subsequent pointer drag operation data, and to perform a reverse displacement of the pointer drag movement amount for each frame of data based on the pointer drag time interval and pointer drag direction.

[0131] In this embodiment, when the user accurately detects that they have stopped dragging the pointer on the air-operated device, this critical event becomes the starting signal for triggering a series of subsequent operations. For example, after dragging a section of content in a document using a tablet computer with a stylus (air-operated device), the moment the stylus is lifted, the signal indicating that the operation has stopped is immediately captured. At this time, preparations for the pointer rebound operation are quickly initiated. Based on the order or reverse order of the frame records in the corrected pointer drag operation data, a reverse displacement operation is performed on each frame of data based on the pointer drag time interval and pointer drag direction. This triggering mechanism ensures that the reverse displacement operation is initiated promptly and accurately after the user completes a full drag operation, conforming to the logical sequence and expected effect of the user's operation.

[0132] In one embodiment, a sequence-based reverse displacement operation includes:

[0133] If the reverse displacement operation is performed according to the frame record order in the corrected pointer drag operation data, processing begins from the first frame. First, the pointer drag time interval and pointer drag direction information for the first frame, as well as the corresponding pointer drag movement amount for that frame, are obtained. The direction of the reverse displacement is determined based on the pointer drag direction; if the pointer drag direction is to the right (assuming a horizontal direction), the reverse displacement direction is to the left. Then, a waiting time is set according to the pointer drag time interval of that frame. After the waiting time expires, the pointer is moved by the corresponding pointer drag movement amount in the reverse displacement direction. For example, in a scenario where a smart TV remote control (over-the-air device) controls the screen pointer to browse a program list, if the pointer moves a certain distance to the right in the first frame, during the reverse displacement, after waiting for the corresponding time, the pointer will move the same distance to the left.

[0134] After processing the first frame, the second frame is processed sequentially. The steps of acquiring information, determining the reverse displacement direction, waiting for the specified time, and moving the pointer are repeated. This process is repeated for each frame of data until all frames have been processed. During this process, the pointer will gradually backtrack in the reverse order and by the reverse amount of movement compared to the previous dragging operation, achieving a reverse displacement from the end point to the starting point. This sequence-based reverse displacement operation can intuitively simulate the pointer bouncing back according to the reverse process of the operation sequence, and is suitable for scenarios with strict requirements on the operation sequence or where it is necessary to gradually restore the operation path.

[0135] In one embodiment, the reverse displacement operation based on the reverse order includes:

[0136] When choosing to perform a reverse displacement operation by reversing the frame records in the corrected pointer drag operation data, the operation starts from the last frame. First, the pointer drag time interval, pointer drag direction, and pointer drag distance of the last frame are obtained. Similarly, the reverse displacement direction is determined based on the pointer drag direction; for example, if the pointer drag direction is upward (assuming a vertical direction), then the reverse displacement direction is downward. Then, a waiting time is set according to the pointer drag time interval of that frame. After the waiting time expires, the pointer is moved by the corresponding pointer drag distance in the reverse displacement direction. For example, in a scenario where a mobile phone is used to control the screen pointer to select an image via air gestures (air-based operation device), if the pointer moved upward a certain distance in the last frame, during the reverse displacement, after waiting for the corresponding time, the pointer will move downward by the same distance.

[0137] After processing the last frame, the penultimate frame is processed. The steps of acquiring information, determining the reverse displacement direction, waiting time, and moving the pointer are repeated, operating on each frame of data sequentially from back to front. During this process, the pointer starts from the last operation position and gradually backtracks in the opposite direction to the operation sequence, quickly moving towards the starting position. This reverse displacement operation can return the pointer to the starting position faster in some situations, suitable for scenarios with high operational efficiency requirements and less concern for operation path details, such as quickly browsing a long list and returning to the top of the list. Reverse displacement can quickly move the pointer back to the starting position, reducing user waiting time and improving the user experience.

[0138] Whether based on sequential or reverse displacement, the entire process requires processing data for each frame, performing waiting and movement operations according to the pointer dragging time interval to ensure that the pointer's reverse displacement process is smooth and accurate, and can work well with other functions of the system (such as handling user interruption operations) to achieve efficient and smooth pointer control, meeting the needs of users in various scenarios of controlling touch screen pointers in air-operated devices.

[0139] In one embodiment, Figure 6 is a specific example diagram of a touch screen pointer control method according to an embodiment of the present invention. As shown in Figure 6, it further includes:

[0140] Step 601: During the process of reversing the pointer drag movement amount based on the pointer drag time interval for each frame of data, if the user is detected to perform another pointer drag operation, the pointer drag operation data performed by the user is obtained after the process of reversing the displacement is completed; the starting time of the pointer drag operation data performed again is the ending time of the process of reversing the displacement.

[0141] Step 602: Based on the data from the repeated pointer drag operation, perform the reverse displacement again.

[0142] In this embodiment, when performing a reverse displacement operation on the data of each frame based on the pointer dragging time interval according to predetermined rules, the entire process requires constant monitoring of the user's operation. For example, when using a tablet computer to control the screen pointer for text movement in document editing via a stylus (as an air-operated device), if the pointer begins to move in the reverse direction based on previously recorded data (i.e., moving back to the initial position), and it is detected that the user is dragging the pointer on the screen again with the stylus, the current reverse displacement operation will not be immediately interrupted, but will continue until the entire reverse displacement process is completed.

[0143] This approach ensures the integrity of each operation and the continuity of data recording. Only after the entire reverse displacement process is complete will the data for any subsequent pointer dragging operations be retrieved. This subsequent pointer dragging operation data has a specific starting recording time requirement: the exact moment the reverse displacement process ends. This means that from this specific moment, a new user operation is considered an independent and complete operation phase. All subsequent related data recordings will revolve around this starting point to clearly and accurately capture the user's new operational intent and various details during the operation, such as the pointer's direction of movement, the amount of movement, and the time interval between each operation. This provides an accurate data foundation for further data processing and the implementation of corresponding functions.

[0144] Once the user's subsequent pointer dragging data is successfully obtained, the next step is to perform a reverse displacement operation based on this new data. The purpose of this step is to ensure that the pointer can return to its original position reasonably according to the corresponding rules after the new operation phase ends, ensuring the continuity of the entire pointer operation process across different stages and conforming to the user's operating habits and expectations.

[0145] Based on the compiled data from the subsequent pointer dragging operation, the actual reverse displacement operation begins. Starting from the first frame of the new data, the pointer dragging time interval and direction information corresponding to that frame are obtained. The direction of the reverse displacement is determined based on the pointer dragging direction; for example, if the pointer dragging direction is to the right in the horizontal direction, then the reverse displacement direction is to the left in the horizontal direction. Then, a corresponding waiting time is set according to the pointer dragging time interval recorded in that frame. After the waiting time expires, the pointer moves the corresponding pointer dragging distance in the determined reverse displacement direction.

[0146] Next, following the same steps, the data for each subsequent frame—the second, third, and so on—is processed sequentially, allowing the pointer to gradually backtrack from the last position to the corresponding starting position. Through this complete reverse displacement operation, regardless of how many times the user performs pointer dragging operations at different stages, the pointer can be guaranteed to return to its correct position. This makes the entire touchscreen pointer control process more flexible and reliable, further enhancing the user experience when controlling the touchscreen pointer using an over-the-air device and meeting diverse practical application needs.

[0147] In one embodiment, it also includes:

[0148] During the process of reversing the pointer movement amount based on the pointer drag time interval for each frame of data, if a user's movement operation on the pointer is detected, the process of reversing the pointer movement amount based on the pointer drag time interval is stopped, and the pointer is controlled to respond to the pointer movement operation.

[0149] In the embodiment, when performing the reverse displacement operation of the pointer drag movement amount on the data of each frame based on the pointer drag time interval according to the established process, the entire process requires close attention and accurate monitoring of the user's operation at all times.

[0150] As the pointer begins its reverse displacement based on previously recorded frames of data—that is, moving backward according to the corresponding time intervals and in the reverse direction—the system continuously detects whether any new user actions have occurred. If, during this reverse displacement process, the system detects that the user has moved the pointer—for example, by pressing a button on the remote control and moving the pointer to a new position or changing its original trajectory—it will immediately respond and halt the current reverse displacement process based on the pointer dragging time intervals.

[0151] This is because a new pointer movement initiated by the user represents their latest operational intention. To ensure the immediacy of the operation and to meet the user's expectations, priority is given to ensuring the effective execution of the new operation. Therefore, the state is quickly switched to control the pointer in response to this new pointer movement operation.

[0152] Specifically, based on the user's specific commands issued through the air-operated device, such as the direction and speed of movement (this information is accurately captured through the interaction mechanism between the operating device and the screen), the position and movement of the pointer on the screen are adjusted in real time. This ensures that the pointer moves on the screen in the direction and rhythm desired by the user, as if the previous reverse displacement operation had never occurred. Guided by the user's new operation command, the pointer can move accurately and smoothly on the screen according to the new operation intention, thereby providing the user with a consistent and convenient operating experience. This meets the diverse requirements of users for touch screen pointer control at different times and under different needs, and ensures that the entire touch screen pointer operation process can flexibly cope with various situations and is not affected by previously unfinished operations.

[0153] The following is a specific embodiment to illustrate the specific application of the method of the present invention.

[0154] In a specific embodiment, a scheme for an automatic pointer bounce mechanism based on relative coordinates is presented, which mainly includes the following steps:

[0155] Figure 7 is a specific example of the sliding recording stage in a touch screen pointer control method according to an embodiment of the present invention. As shown in Figure 7, the sliding recording stage involves the following operations:

[0156] 1. Initial Operation Detection: Continuously monitor the user's interaction with the touchscreen via an air-operated device (such as a touchpad or air mouse). When the system detects that the user has started dragging a pointer on the touchscreen using the air-operated device, this point is designated as the starting point A. During this process, the movement of the pointer is continuously tracked and recorded.

[0157] 2. Movement Measurement Recording: During the dragging process from point A, the system accurately records the pointer's movement Δx and Δy in the horizontal (x-axis) and vertical (y-axis) directions each time a drag command is sent. This movement measurement data reflects the pointer's position change on the screen and is crucial foundational data for subsequent calculations and operations.

[0158] 3. Time Interval Recording: The system also records the time interval Δt between each command sent. This time interval data reflects the rhythm and speed of user operations, which is crucial for determining user behavior characteristics and optimizing subsequent bounce operations.

[0159] 4. Continue recording until the operation ends: Continue the above recording operation until the user releases the operating device at the endpoint B to complete the pointer drag operation, ensuring that all data in the entire operation process is fully recorded.

[0160] When a user drags a pointer on a touchscreen using an over-the-air device, each drag command is sent to move the pointer in the direction and distance desired by the user. For example, when using a touchpad to control the pointer on a computer screen to move a file icon, each dragging motion of the finger on the touchpad corresponds to a clear operational intent, the purpose of which is to change the pointer's position. Similarly, "each frame of recorded data" meticulously breaks down and records the entire pointer dragging operation process, recording the process sequentially according to fixed time intervals or operation stages. Each recorded frame of data corresponds to the user's action via the over-the-air device at that moment, causing a corresponding change in the pointer. This is essentially consistent with sending a drag command to drive pointer movement; both reflect the user's immediate action and intent during the operation.

[0161] Each drag-and-drop command is a discrete operation point on the timeline, and these operations are arranged sequentially to form the complete time sequence of the drag-and-drop operation. For example, when browsing a program list on a smart TV screen using a remote control, each time the user presses a button and moves the pointer, a drag-and-drop command is sent. These commands are distributed sequentially on the timeline of the operation. Each frame of recorded data is also recorded in chronological order, and each frame has a corresponding timestamp, marking its position within the entire operation. Therefore, from a temporal perspective, both represent the operation process at different points in time and have inherent consistency.

[0162] Each time a drag command is sent, the pointer's state inevitably changes accordingly, such as its position or speed. The "data recorded per frame" contains information such as the pointer's drag distance, drag direction, and drag time interval. This information provides a detailed record of the pointer's state changes after each drag command is sent. For example, when a drag command is sent to move the pointer from the left side of the screen to the right, the "data recorded per frame" records the distance the pointer moves (pointer drag distance), the direction it moves (pointer drag direction), and the time interval between adjacent frames (pointer drag time interval). This recorded data allows for a complete reconstruction of the effect of each drag command. The two are closely related in terms of recording the pointer's state and reflecting the operation results.

[0163] II. Figure 8 is a specific example diagram of the data processing stage and the bounce execution stage in a touch screen pointer control method according to an embodiment of the present invention. As shown in Figure 8, the data processing stage (including optimization processing) involves the following operations:

[0164] 1. Frame-by-Frame Analysis and Dwell Time Determination: In this specific embodiment, the pointer dragging time interval corresponding to the target frame is greater than a first threshold, and the corresponding pointer dragging movement is less than or equal to a second threshold. The recorded data is analyzed frame by frame. If, between two recording points, the pointer's movement distance in both the horizontal (Δx) and vertical (Δy) directions is less than a preset value, and the time interval Δt between these two recording points exceeds a preset value (e.g., 50ms), then it is determined that the user has lingered at this point for a long time. To optimize data processing and subsequent bounce operations, the dwell time can be set to a fixed time T1 (e.g., 30ms). This processing method reduces unnecessary time calculations, ensures accurate determination of the mouse stop state, and guarantees that the pointer movement will not be affected by the dwell state during subsequent frame data processing, making data processing more accurate and efficient.

[0165] 2. Continuous Dwell Time Handling: If continuous dwell times exist, meaning the movement distance between multiple consecutive recording points is less than a preset distance, the time of these consecutive frames is accumulated and processed as a single frame. The movement distance in this case is the accumulated distance of several consecutive frames, and the dwell time is also set to T1. This method allows for more reasonable handling of continuous dwell times, reduces data redundancy, further optimizes the data processing, and provides more accurate data support for subsequent bounce operations.

[0166] 3. Optimization of Excessive Drag Time (Extreme Cases): During data processing, if excessive drag time is detected, or even extreme cases where the pointer drags back and forth between A and B, measures will be taken to streamline the bounce time. In such situations, conventional algorithms would cause the pointer to move backwards for an extended period, severely impacting operational efficiency and user experience. Therefore, a specific algorithm analyzes and processes the recorded data. For example, after recording all movement data, before any reverse movement, it checks if the pointer has moved backwards. If so, the algorithm cancels out the forward movement distance. Then, within a certain time range, the cursor is moved to approximately return to its original position, avoiding unnecessary prolonged backward movement and improving operational efficiency.

[0167] III. Figure 8 is a specific example diagram of the data processing stage and the bounce execution stage in a touch screen pointer control method according to an embodiment of the present invention. As shown in Figure 8, the bounce execution stage involves the following operations:

[0168] 1. Delay Setting: After the user releases the device, a short delay T1 or longer (e.g., 50ms) is set. This delay primarily aims to reduce inaccurate cursor rebound caused by speed-dependent gain. During pointer dragging, the cursor may experience a gain effect due to speed changes; immediate rebound might lead to inaccurate positioning. An appropriate delay allows sufficient time for the cursor to stabilize, improving the accuracy of the rebound operation.

[0169] 2. Reverse Movement Execution: After the delay ends, the reverse movement operation is executed sequentially according to the previously recorded instructions at the original instruction intervals. That is, for the recorded horizontal movement amount Δx, a reverse movement of -Δx is executed; for the vertical movement amount Δy, a reverse movement of -Δy is executed. In this way, the pointer can be gradually moved from the endpoint B in the opposite direction to the previous drag, making the pointer gradually approach the starting point A.

[0170] 3. Rebound Completion Determination: After the reverse movement instruction is executed, the pointer should be able to return approximately to the starting point A. Here, "approximately" means that although there may be some errors during the processing, the above-mentioned recording, processing, and execution mechanisms can ensure that the pointer returns to the vicinity of the starting position within a reasonable error range, realizing the automatic rebound function of the pointer. This eliminates the need for the user to manually move the pointer back to the starting point, improving operational efficiency.

[0171] IV. Optimization Measures:

[0172] 1. Optimization of excessive drag time (repetition): As mentioned earlier, during the data processing stage, for situations where users drag for too long (including dragging back and forth), the algorithm is optimized to streamline the bounce time, ensuring that the pointer can return to the approximate starting position within a reasonable time, avoiding the impact on operation efficiency and user experience due to excessively long bounce process.

[0173] 2. User interruption handling:

[0174] (1) New drag gesture handling: If a new drag gesture is detected during the bounce process, the current bounce operation will be paused, and the new drag operation will be treated as a priority. The system will wait for the current bounce operation to complete before, based on the new pointer drag operation data, and following the aforementioned sliding record, data processing, and bounce execution process, redetermine the target bounce operation mode and execute the new pointer bounce operation. This ensures that the user's new operations are responded to promptly, while avoiding conflicts between old and new operations, thus guaranteeing the continuity and accuracy of the operation.

[0175] (2) Pointer Movement Handling: If the user is detected moving the pointer (rather than initiating a new drag gesture) during the bounce process, the bounce process will be stopped immediately, and the pointer movement operation will be responded to first. At this time, the pointer position will be updated according to the user's new pointer movement command, and after the pointer movement operation ends, it will be determined whether the bounce operation needs to be re-executed or processed according to the new operation procedure based on the pointer state and operation situation at that time. This flexible interruption handling mechanism can better adapt to various changes in the user's actual operation process, improving response speed and user experience.

[0176] In this specific embodiment, when the pointer is dragged, if there is a situation where it slides back and forth multiple times over a long period of time, the conventional rebound operation will cause the pointer to move in the opposite direction multiple times over a long period of time when it rebounds. This will inevitably reduce the operation efficiency and have an adverse impact on the user experience. Therefore, special algorithm optimization is required.

[0177] During the operation, a complete record of the pointer movement data is maintained throughout, including all information from the starting position to each intermediate position and the final ending position, such as changes in horizontal and vertical movement and the corresponding time sequence. Before executing the pointer rebound operation, an optimization algorithm is initiated. First, a comprehensive check is performed on all recorded movement data, focusing on determining whether the pointer has moved in the opposite direction during the dragging process. This determination of reverse movement is based on a precise analysis of the movement direction, determined by comparing the changes in the pointer's movement direction between adjacent data points.

[0178] Once reverse pointer movement is detected, special processing is implemented at the algorithm level to cancel out the reverse movement distance from the forward movement distance. For example, if the pointer moves 100 pixels in the positive x-axis direction first, and then moves 30 pixels in the negative x-axis direction, the optimized algorithm records the effective forward movement distance as 70 pixels (100-30). In this way, redundant movement calculations caused by back-and-forth sliding can be effectively reduced, simplifying the amount of data that needs to be processed during the bounce process.

[0179] After canceling out the reverse and forward movement distances, the cursor moves within a reasonable time range. This time range is determined by considering factors such as device performance, the real-time requirements of user operations, and the stability of pointer movement. Based on the remaining valid movement data, the pointer movement is controlled in a relatively smooth and efficient manner, bringing it closer to the starting position. Although the cursor may not return precisely to its initial position due to the cancellation process and various factors in actual operation, the optimized algorithm ensures that the cursor returns to a position close to the starting point, sufficient to meet the user's needs for continuing subsequent operations. This avoids the lengthy and complex reverse movement process caused by traditional bounce methods, significantly improving operational efficiency and user experience, making pointer control more intelligent and efficient in complex dragging scenarios.

[0180] This specific embodiment has the following technical effects:

[0181] 1. Improved operational efficiency

[0182] The automatic pointer return mechanism of this invention is implemented in relative coordinates. This feature allows users to move the pointer back to its starting point without manual intervention after performing pointer operations. For example, in scenarios involving frequent pointer dragging operations from point A to point B, such as browsing a long video list on a smart TV, after a user selects a video to play, the pointer automatically returns to its initial position without manual operation, thus greatly reducing repetitive operations. This automated return process saves user time, significantly improves work efficiency, and allows users to focus more on the task at hand rather than spending time adjusting the pointer position.

[0183] 2. User experience optimization

[0184] The automatic rebound mechanism simulates the feel of touch operation. When air-operated devices (such as touchpads, air mice, etc.) interact with a touchscreen, the automatic rebound behavior of the pointer is similar to the feeling of interface elements automatically resetting after a finger leaves the screen during direct touch operation. Taking in-vehicle infotainment as an example, when a driver uses air gestures to control the screen to select a navigation destination or change music tracks, the automatic rebound of the pointer to its starting position makes the operation more intuitive and natural, as if performing a direct touch operation on the screen. This reduces the discomfort caused by differences in operation methods, improves the convenience and comfort of operation for the driver during driving, and enhances user satisfaction with the entire interaction process.

[0185] 3. Cross-platform compatibility achieved

[0186] The relative coordinate-based implementation brings excellent cross-platform compatibility to this mechanism. Regardless of the operating system or different types of devices (such as mobile phones, tablets, in-vehicle screens, smart TVs, educational tablets, augmented reality, and virtual reality devices), this automatic pointer bounce mechanism works effectively. On different platforms and devices, relative coordinates focus on the relative movement of the pointer within the screen, rather than relying on the absolute position information of a specific device. This eliminates the need for developers to perform extensive customization for different operations and devices, reducing development costs and complexity, ensuring users enjoy a consistent pointer control experience across different devices and platforms, and improving the versatility and scalability of the technical solution.

[0187] 4. Enhanced flexibility and controllability

[0188] By providing optimization measures such as threshold settings and speed control, the bounce mechanism demonstrates a high degree of flexibility and controllability. Regarding threshold settings, for example, thresholds can be set for pointer drag duration and distance; different bounce modes can be automatically selected when the user operates within different threshold ranges. In terms of speed control, the pointer bounce speed can be adjusted according to different application scenarios and user operating habits. For example, on educational tablets, teachers may prefer a moderate pointer bounce speed during demonstrations so that students can clearly observe the pointer's movement trajectory; while when users are quickly browsing long lists, such as searching for programs on a smart TV, the pointer bounce speed can be appropriately increased to improve operational efficiency. This flexibility allows the bounce mechanism to better adapt to diverse user needs and operating scenarios, enhancing the mechanism's intelligence and customizability.

[0189] 5. Wide adaptability

[0190] This automatic pointer bounce mechanism is particularly suitable for applications requiring frequent swiping. When browsing long lists, such as product lists or news feeds on e-commerce platforms, the pointer automatically bounces back after repeated swiping, allowing users to quickly return to the top of the list for new browsing operations. During page turning, whether reading ebooks or viewing documents, the pointer bounces back to the starting position, facilitating the next page turn. When adjusting volume / brightness, such as on smart TVs or in-car systems, the pointer automatically bounces back after adjustments, preventing interference with subsequent operations due to pointer position changes. This broad adaptability allows this technology to play a vital role in many common interaction scenarios, improving the convenience and smoothness of user operations.

[0191] 6. Simulate finger swiping effect

[0192] This invention achieves an operation effect similar to direct touch control, effectively enhancing the user's natural interactive experience. During operation, the movement and rebound behavior of the pointer is similar to the feeling of sliding a finger on a screen. Taking augmented reality and virtual reality devices as examples, when users control the pointer through air-operated devices in virtual space, the pointer's automatic rebound simulates the operation logic of a finger on a virtual interface, making it easier for users to understand and adapt to the interaction methods in the virtual environment. It's as if users are directly interacting with virtual elements with their fingers, improving the user's immersion in the virtual scene and the naturalness of the operation, thus bridging the interaction distance between the user and the virtual interface.

[0193] This specific embodiment has the following innovative features:

[0194] 1. Advantages of automatic rebound achieved through relative coordinates

[0195] The key innovation of this invention lies in its use of relative coordinates to achieve automatic pointer return. Relative coordinates focus on the relative positional changes of the pointer within the screen coordinate system, overcoming many limitations compared to traditional absolute coordinates. In absolute coordinates, the pointer's position depends on the device's absolute physical location information, making pointer control logic complex and difficult to standardize across different devices or operating environments. For example, in some mobile devices, changes in screen orientation or differences in device hardware can lead to deviations in pointer position calculations under absolute coordinates, affecting the accuracy and consistency of user operations. The relative coordinates of this invention, by recording the pointer's movement (Δx and Δy) relative to the starting point and the operation time interval (Δt), can stably achieve automatic pointer return under different devices and operating scenarios, ensuring operational accuracy and reliability, and providing users with a more consistent and convenient pointer control experience.

[0196] 2. Recording and replaying commands enables precise rebound.

[0197] This invention achieves precise pointer rebound by recording and replaying movement commands, an innovative method that does not rely on the absolute position information of the device. During pointer operation, the movement amount (Δx and Δy) and the command time interval (Δt) of each drag command are precisely recorded. This recorded data becomes the key basis for pointer rebound. When the user releases the device, the pointer moves in the opposite direction (-Δx and -Δy) according to the recorded commands and the original command intervals, thus achieving precise pointer rebound from the end point to the starting point. This method avoids inaccurate rebound problems caused by differences in device hardware or different understandings of absolute position. For example, on different models of mobile phones or tablets, although the screen size, resolution, and other hardware parameters of the devices may differ, the rebound mechanism based on recording and replaying movement commands ensures that the pointer can rebound to near the starting position according to the expected trajectory on various devices, improving the accuracy and reliability of the rebound and making pointer control more precise and stable.

[0198] 3. Delay mechanism improves rebound accuracy

[0199] The introduction of a delay mechanism is another innovation of this invention, effectively reducing the inaccuracy of cursor rebound caused by speed-dependent gain. During pointer dragging, changes in cursor speed can cause speed-dependent gain effects, making it difficult to accurately control the initial speed and trajectory of the cursor during rebound, thus affecting the accuracy of the rebound. This invention sets a short delay (e.g., T1 or greater, such as 50ms) after the user releases the device. During this delay, the cursor speed and state can be stabilized, eliminating the influence of speed-dependent gain and preparing for subsequent precise rebound operations. Through this delay mechanism, the pointer rebound process can be initiated in a more stable and accurate state, ensuring the pointer returns to its starting position along the predetermined path and speed. This improves the accuracy and reliability of the rebound operation, allowing users to more accurately anticipate the pointer's rebound behavior during operation, thus enhancing the overall user experience.

[0200] 4. Optimization measures enhance the intelligence and adaptability of the rebound mechanism.

[0201] A series of optimization measures, such as bounce thresholds and speed control, significantly improve the intelligence and adaptability of the bounce mechanism. Setting bounce thresholds, such as thresholds for pointer drag duration and distance, automatically selects the appropriate bounce mode based on the characteristics of user operations. When users perform quick, short-range pointer operations, a fast and simple bounce mode can be selected based on the threshold; while for long-distance, complex pointer operations, a more suitable bounce mode is selected based on the threshold. Regarding speed control, the pointer bounce speed can be dynamically adjusted according to different application scenarios and user operating habits. In scenarios requiring rapid response, such as game operations or quick interface browsing, the bounce speed is increased; in scenarios requiring precise operation, such as drawing or fine-tuning settings, the bounce speed is decreased. These optimization measures enable the bounce mechanism to intelligently adapt to the needs of different user operations and application scenarios, providing more personalized and efficient pointer control services, and enhancing the practicality and flexibility of the technical solution.

[0202] 5. Cross-platform implementation ensures a consistent user experience.

[0203] Providing a cross-platform implementation solution is one of the key innovations of this invention, ensuring a consistent experience across different operating systems and devices. Based on relative coordinates and a unified pointer control logic, this invention can achieve the same automatic pointer return function across different mobile operating systems and various devices such as mobile phones, tablets, in-vehicle screens, smart TVs, educational tablets, augmented reality, and virtual reality devices. Regardless of the platform or device, users can experience similar operation methods and interactive experiences, reducing the learning cost for users switching between different devices. For example, when using in-vehicle infotainment systems and mobile phones, users expect consistent pointer operation and return, which increases user acceptance and satisfaction with the overall technical solution, promotes the widespread application of the technology across different fields and devices, and enhances the versatility and compatibility of the technical solution.

[0204] This specific embodiment has the following potential application scenarios:

[0205] 1. In-vehicle infotainment applications

[0206] In in-vehicle infotainment systems, the automatic pointer return mechanism of this invention plays a crucial role when drivers control the screen via air gestures. Since drivers need to concentrate on road conditions while driving, manually operating the screen is neither convenient nor safe. Through air-operated devices (such as touchpads on the in-vehicle center console or controllers with gesture recognition capabilities), drivers can easily control the pointer's movement on the screen to select navigation destinations, switch music tracks, adjust radio channels, or operate other in-vehicle applications. The automatic pointer return to its starting position allows drivers to quickly proceed to the next operation after completing one, without needing to manually adjust the pointer position, thus improving operational efficiency and driving safety. For example, during navigation, the pointer automatically returns after the driver selects a destination, facilitating immediate route planning or viewing other navigation information; during music playback, the pointer's return after adjusting the volume or switching songs makes operation smoother, reducing distractions caused by inconvenient operation and enhancing the driver's in-vehicle interactive experience.

[0207] 2. Applications on smart TVs or large-screen devices

[0208] For smart TVs or large-screen devices, users typically operate them using a remote control or air mouse. When browsing long lists (such as video program lists, application lists, or settings option lists), frequent swiping automatically returns the pointer to the top or beginning of the list, allowing users to quickly return and make new selections. For example, when watching online video platforms, after browsing numerous video programs, the pointer's return allows them to easily return to the top of the list to select new categories or filters; when setting smart TV parameters, the pointer automatically resets after adjusting various settings, facilitating the next setting operation. This automatic pointer return mechanism greatly improves the ease of operation when using smart TVs or large-screen devices, enabling users to interact with the device more efficiently and enjoy rich multimedia content and convenient device control.

[0209] 3. Educational tablet applications

[0210] In the education field, educational tablets offer teachers the convenience of remotely controlling screen content. Teachers can control the display of teaching materials, highlight key points, switch pages, or launch different teaching applications from different locations in the classroom using air-operated devices (such as a wireless stylus or remote control paired with the tablet). The automatic pointer return to its starting position helps teachers maintain continuity and efficiency in their operations. For example, when explaining electronic courseware, the pointer returns after the teacher marks a knowledge point, allowing them to immediately mark the next knowledge point or switch to the next page of the courseware; when using teaching software for interactive teaching, such as deriving mathematical formulas or drawing graphs, the pointer resets afterward for easy follow-up operations. This not only improves teachers' teaching efficiency but also makes the teaching process smoother, enhances students' understanding and attention to the teaching content, and provides a more efficient and convenient interactive method for modern education.

[0211] 4. Applications of Augmented Reality (AR) and Virtual Reality (VR) Devices

[0212] In augmented reality and virtual reality devices, the automatic pointer rebound mechanism of this invention provides a more natural way to interact with virtual interfaces. When users interact with the virtual interface in virtual space through a head-mounted device and a matching controller (as an air-operated device), the automatic rebound of the pointer simulates the feeling of a finger interacting with an object in the real world. For example, in AR games, after players use the controller to control the pointer to select game items or perform actions, the pointer rebound makes the operation more natural and smooth, enhancing the immersion of the game; in VR architectural design software, after designers use the pointer to select architectural elements and adjust the layout, the pointer automatically resets, facilitating the next round of design operations, improving design efficiency and the naturalness of interaction. This automatic pointer rebound mechanism in the virtual environment helps to shorten the distance between users and the virtual interface, allowing users to more naturally integrate into the virtual world, improving the user's interactive experience and work efficiency in AR and VR applications.

[0213] Of course, it is understood that there may be other variations of the above detailed process, and all such variations should fall within the protection scope of this invention.

[0214] In this embodiment of the invention, pointer dragging operation data performed by the user on the air-operated device is acquired in real time; the touch screen displays a pointer that moves in response to the pointer dragging operation; the pointer dragging operation data includes the pointer dragging movement amount, pointer dragging direction and pointer dragging time interval of each frame recorded frame by frame during the dragging operation process; after the drag is released, the pointer dragging movement amount of each frame is shifted in the reverse order of the frame recording in the pointer dragging operation data, based on the pointer dragging time interval and pointer dragging direction. This invention acquires detailed data for each frame during a user's pointer dragging operation on an air-operated device in real time, including pointer movement amount, direction, and time interval, enabling complete and accurate recording of the user's operation trajectory. After the user completes the dragging operation, a reverse displacement operation is performed based on this recorded data, eliminating the need for the user to manually return the pointer and avoiding tedious manual repositioning, thus directly improving operational efficiency. By performing the reverse displacement of the pointer dragging amount in the order or reverse order of the frame records in the pointer dragging operation data, a smooth experience similar to direct touch is simulated, improving user satisfaction when using an air-operated device to control a touch screen in non-touch screen scenarios, significantly enhancing the user experience. By focusing on the relative position change of the pointer during the operation process, rather than relying on the absolute position information of the device, a unified pointer control logic can be implemented across different operating systems and various types of mobile screen devices, providing a cross-platform, highly compatible solution that meets the diverse pointer control needs of devices in non-touch operation scenarios.

[0215] As mentioned above, this invention focuses on addressing a significant deficiency in the prior art: the frequent manual rewinding of the pointer from the endpoint to the starting point causes considerable inconvenience when users operate the touch interface using a pointer instead of the touchscreen. Based on this, the invention establishes the following specific objectives:

[0216] 1. Significantly Improve User Operation Efficiency: Committed to minimizing repetitive actions, innovative technologies enable automatic pointer return. For example, in applications such as smart TVs, when users frequently switch between different function menus using air-operated devices (such as remote controls), the pointer automatically returns to its initial position after each selection. This effectively avoids the extra time and effort spent manually adjusting the pointer, greatly accelerating the operation process and enabling users to complete more tasks per unit of time, significantly improving overall operational efficiency.

[0217] 2. Deeply Improve User Experience: Strive to create a user experience highly similar to direct touch control. During the interaction between the air-operated device and the touchscreen, the movement characteristics and rebound mechanism of the pointer have been carefully designed to closely resemble direct touch operation in terms of operational logic and visual feedback. For example, in in-vehicle infotainment, when the driver uses air gestures to control the screen to set navigation destinations or control music playback, the automatic rebound of the pointer is smooth and natural, providing the driver with an intuitive feeling as if they were directly touching the screen. This reduces discomfort caused by differences in operation methods, thereby comprehensively improving user satisfaction and comfort when using air-operated devices.

[0218] 3. Constructing a cross-platform, highly compatible solution: A universal technical framework meticulously crafted based on relative coordinates ensures seamless adaptation to various operating systems and diverse device types (including mobile phones, tablets, in-vehicle screens, smart TVs, educational tablets, augmented reality and virtual reality devices, etc.). In this way, regardless of the operating platform or device hardware configuration, users can enjoy a consistent and stable pointer control and rebound experience without the need for cumbersome customization settings or adjustments for different devices. This effectively reduces development costs and maintenance difficulty, greatly expanding the application scope and market potential of this invention.

[0219] 4. Precisely Achieves a Near-Finger-Sliding Effect: Through meticulous optimization of the pointer's movement trajectory, speed changes, and rebound mechanism, the system strives to achieve an operation effect that closely resembles a finger sliding directly on a touchscreen. In augmented reality or virtual reality interactive scenarios, when users operate the virtual interface using the accompanying controller, the pointer moves and rebounds in a highly natural and ergonomic manner, as if the user's finger were directly interacting with virtual elements. This effectively enhances the naturalness and immersion of the operation, allowing users to become more deeply integrated into the virtual interactive environment and improving the realism and smoothness of the interactive experience.

[0220] This invention also provides a control device for a touch screen pointer, as described in the following embodiments. Since the principle by which this device solves the problem is similar to the control method for a touch screen pointer, the implementation of this device can be found in the implementation of the control method for a touch screen pointer; repeated details will not be elaborated further.

[0221] This invention also provides a control device for a touch screen pointer to solve the problem of low efficiency in manually moving the pointer back, improve the control efficiency of the touch screen, enhance the user experience, and improve cross-platform compatibility. Figure 9 is a schematic diagram of the structure of a touch screen pointer control device according to an embodiment of this invention. As shown in Figure 9, the device includes:

[0222] The pointer drag operation data acquisition module 901 is used to acquire pointer drag operation data performed by the user on the air-operated device in real time; the touch screen displays a pointer that moves in response to the pointer drag operation; the pointer drag operation data includes the pointer drag movement amount and pointer drag direction of each frame recorded frame by frame during the drag operation process;

[0223] The reverse displacement module 902 is used to perform reverse displacement of the data of each frame based on the pointer drag direction after dragging and releasing, according to the order or reverse order of the frame records in the pointer drag operation data.

[0224] In one embodiment, the pointer drag operation data acquisition module 901 is further configured to accumulate, segmentally accumulate, or group the pointer drag movement amount of each frame during the drag operation recorded frame by frame, so as to obtain the total displacement amount or segmented displacement amount of the pointer.

[0225] In one embodiment, the reverse displacement module 902 is further configured to move the pointer in the opposite direction to the total displacement or segmented displacement, so that the pointer returns to or approaches the predetermined position in a manner that is a one-time rebound, a segmented rebound, an equally divided rebound, or a simulated rebound time series visual effect.

[0226] In one embodiment, the pointer drag operation data further includes a pointer drag time interval; the pointer drag operation data acquisition module 901 is also used to: after dragging is released, perform reverse displacement of the pointer drag movement amount on the data of each frame based on the pointer drag time interval and the pointer drag direction, in the order or reverse order of the frame records in the pointer drag operation data.

[0227] In one embodiment, the pointer drag operation data acquisition module 901 is further configured to acquire pointer drag operation data performed by the user on the air-operated device in real time; the touch screen displays a pointer that moves in response to the pointer drag operation; the pointer drag operation data includes the pointer drag movement amount, pointer drag direction and pointer drag time interval of each frame recorded frame by frame during the drag operation process; the reverse displacement module 902 is further configured to, after the drag is released, perform reverse displacement of the pointer drag movement amount of each frame of data based on the pointer drag time interval and pointer drag direction, in the order or reverse order of the frame recording in the pointer drag operation data.

[0228] In one embodiment, it also includes:

[0229] For each frame of recorded data, determine whether the recorded data of that frame is the target frame; the pointer drag time interval corresponding to the target frame is greater than a first threshold; modify the pointer drag time interval of the target frame to a preset time interval; replace the target frame in the pointer drag operation data with the modified target frame to obtain the corrected pointer drag operation data;

[0230] Based on the order or reverse order of the frame records in the pointer drag operation data, the data of each frame is shifted in the reverse direction based on the pointer drag time interval and pointer drag direction, including:

[0231] Based on the order or reverse order of the frame records in the corrected pointer drag operation data, the pointer drag movement amount of each frame is shifted in the opposite direction according to the pointer drag time interval and pointer drag direction.

[0232] In one embodiment, determining whether a frame of recorded data is a target frame for each frame of recorded data includes:

[0233] Determine whether the pointer drag time interval corresponding to the recorded data of this frame is greater than the first threshold;

[0234] If so, determine whether the pointer drag movement amount corresponding to the recorded data of that frame is less than or equal to the second threshold;

[0235] If so, then the recorded data in that frame is determined to be the target frame.

[0236] In one embodiment, determining whether a frame of recorded data is a target frame for each frame of recorded data includes:

[0237] During the process of acquiring pointer drag operation data performed by the user on the air-operated device, it is determined in real time whether the data recorded in the current frame is the target frame;

[0238] Alternatively, after detecting that the user has stopped dragging the pointer on the air-operated device, for each frame of recorded data, determine whether the recorded data of that frame is the target frame.

[0239] In one embodiment, it also includes:

[0240] The pointer dragging movement in the recorded data of consecutive target frames is merged to obtain a merged frame;

[0241] Modify the pointer drag interval of the target frame to a preset time interval, including:

[0242] Modify the pointer drag interval of the merged frames to the preset time interval;

[0243] Replace the target frame in the pointer drag operation data with the modified target frame to obtain the corrected pointer drag operation data, including:

[0244] Replace the corresponding consecutive target frames in the pointer drag operation data with the merged frames to obtain the corrected pointer drag operation data.

[0245] In one embodiment, the pointer drag movement amounts in the recorded data of consecutive target frames are merged to obtain a merged frame, including:

[0246] Based on the order of the timestamps of the data recorded in each frame, the target frame with the earliest timestamp is obtained as the frame to be merged;

[0247] Determine whether the frame following the frame to be merged is the target frame;

[0248] If so, the pointer drag movement of the frame to be merged and the next frame will be merged to obtain intermediate data;

[0249] Replace the frame to be merged with the intermediate data, and repeat the steps of determining whether the next frame of the intermediate data is the target frame and merging until the next frame of the intermediate data is not the target frame or the intermediate data is greater than the third threshold; use the obtained intermediate data as the merged frame.

[0250] In one embodiment, it also includes:

[0251] During the process of reversing the pointer movement amount based on the pointer drag time interval for each frame of data, if the user is detected to perform another pointer drag operation, the pointer drag operation data performed by the user is obtained after the process of reversing the displacement is completed; the starting time of the recording of the pointer drag operation data performed again is the ending time of the process of reversing the displacement.

[0252] Based on the data from the next pointer drag operation, perform the reverse displacement again.

[0253] In one embodiment, it also includes:

[0254] During the process of reversing the pointer movement amount based on the pointer drag time interval for each frame of data, if a user's movement operation on the pointer is detected, the process of reversing the pointer movement amount based on the pointer drag time interval is stopped, and the pointer is controlled to respond to the pointer movement operation.

[0255] This invention provides an embodiment of a computer device for implementing all or part of the above-described control method for a touchscreen pointer. The computer device specifically includes the following components:

[0256] The computer device comprises a processor, memory, a communications interface, and a bus; wherein the processor, memory, and communications interface communicate with each other via the bus; the communications interface is used to realize information transmission between related devices; the computer device can be a desktop computer, tablet computer, or mobile terminal, etc., and this embodiment is not limited thereto. In this embodiment, the computer device can be implemented with reference to the embodiments of the control method for implementing a touch screen pointer and the control device for implementing a touch screen pointer, the contents of which are incorporated herein by reference, and repeated details will not be described again.

[0257] Figure 10 is a schematic block diagram of the system configuration of a computer device 1000 according to an embodiment of this application. As shown in Figure 10, the computer device 1000 may include a central processing unit 1001 and a memory 1002; the memory 1002 is coupled to the central processing unit 1001. It is worth noting that Figure 10 is exemplary; other types of structures may also be used to supplement or replace this structure to implement telecommunications functions or other functions.

[0258] In one embodiment, the control function of the touch screen pointer can be integrated into the central processing unit 1001. The central processing unit 1001 can be configured to perform the following control:

[0259] The system acquires real-time pointer drag operation data performed by the user on the air-operated device; the touch screen displays a pointer that moves in response to the pointer drag operation; the pointer drag operation data includes the pointer drag movement amount and pointer drag direction of each frame recorded frame by frame during the drag operation; after the drag is released, the data of each frame is shifted in the reverse order of the frame recording in the pointer drag operation data based on the pointer drag direction.

[0260] In one embodiment, the central processing unit 1001 may also be configured to perform the following control:

[0261] The system acquires real-time pointer dragging operation data performed by the user on the air-operated device; the touch screen displays a pointer that moves in response to the pointer dragging operation; the pointer dragging operation data includes the pointer dragging movement amount, pointer dragging direction and pointer dragging time interval recorded frame by frame during the dragging operation process;

[0262] For each frame of recorded data, determine whether the recorded data of that frame is the target frame; the pointer drag movement amount corresponding to the target frame is less than or equal to the first threshold and the pointer drag time interval is greater than the second threshold; modify the pointer drag time interval of the target frame to a preset time interval; replace the target frame in the pointer drag operation data with the modified target frame to obtain the corrected pointer drag operation data;

[0263] Based on the order or reverse order of the frame records in the corrected pointer drag operation data, the pointer drag movement amount of each frame is shifted in the opposite direction according to the pointer drag time interval and pointer drag direction.

[0264] In another embodiment, the control device for the touch screen pointer can be configured separately from the central processing unit 1001. For example, the control device for the touch screen pointer can be configured as a chip connected to the central processing unit 1001, and the control function of the touch screen pointer can be realized through the control of the central processing unit.

[0265] As shown in Figure 10, the computer device 1000 may further include: a communication module 1003, an input unit 1004, an audio processor 1005, a display 1006, and a power supply 1007. It is worth noting that the computer device 1000 does not necessarily include all the components shown in Figure 10; furthermore, the computer device 1000 may also include components not shown in Figure 10, as can be found in existing technologies.

[0266] As shown in Figure 10, the central processing unit 1001, sometimes also referred to as a controller or operation control, may include a microprocessor or other processor device and / or logic device. The central processing unit 1001 receives input and controls the operation of various components of the computer device 1000.

[0267] The memory 1002 may be, for example, one or more of a cache, flash memory, hard drive, removable medium, volatile memory, non-volatile memory, or other suitable device. It can store the aforementioned device-related information, and may also store programs for executing that information. The central processing unit 1001 can execute the program stored in the memory 1002 to perform information storage or processing, etc.

[0268] Input unit 1004 provides input to central processing unit 1001. This input unit 1004 may be, for example, a keypad or touch input device. Power supply 1007 provides power to computer device 1000. Display 1006 displays images, text, and other display objects. This display may be, for example, an LCD display, but is not limited to this.

[0269] The memory 1002 can be a solid-state memory, such as a read-only memory (ROM), random access memory (RAM), a SIM card, etc. It can also be a memory that retains information even when power is off, can be selectively erased, and contains more data; examples of this type of memory are sometimes referred to as EPROMs. The memory 1002 can also be some other type of device. The memory 1002 includes a buffer memory 1021 (sometimes referred to as a buffer). The memory 1002 may include an application / function storage unit 1022 for storing application programs and function programs or processes for executing operations of the computer device 1000 via the central processing unit 1001.

[0270] The memory 1002 may also include a data storage unit 1023 for storing data, such as contacts, digital data, pictures, sounds, and / or any other data used by the computer device. The driver storage unit 1024 of the memory 1002 may include various drivers for the computer device for communication functions and / or for performing other functions of the computer device (such as messaging applications, address book applications, etc.).

[0271] The communication module 1003 is a transmitter / receiver that transmits and receives signals via the antenna 1008. The communication module (transmitter / receiver) 1003 is coupled to the central processing unit 1001 to provide input signals and receive output signals, which is the same as in a conventional mobile communication terminal.

[0272] Based on different communication technologies, multiple communication modules 1003 can be configured in the same computer device, such as cellular network modules, Bluetooth modules, and / or wireless LAN modules. The communication module (transmitter / receiver) 1003 is also coupled to a speaker 1009 and a microphone 1010 via an audio processor 1005 to provide audio output via the speaker 1009 and receive audio input from the microphone 1010, thereby realizing typical telecommunications functions. The audio processor 1005 may include any suitable buffer, decoder, amplifier, etc. Additionally, the audio processor 1005 is also coupled to a central processing unit 1001, enabling on-device recording via the microphone 1010 and on-device playback of stored sound via the speaker 1009.

[0273] This invention also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described method for controlling a touchscreen pointer.

[0274] This invention also provides a computer program product, which includes a computer program that, when executed by a processor, implements the above-described touch screen pointer control method.

[0275] In this embodiment of the invention, pointer dragging operation data performed by the user on the air-operated device is acquired in real time; the touch screen displays a pointer that moves in response to the pointer dragging operation; the pointer dragging operation data includes the pointer dragging movement amount, pointer dragging direction and pointer dragging time interval of each frame recorded frame by frame during the dragging operation process; after the drag is released, the pointer dragging movement amount of each frame is shifted in the reverse order of the frame recording in the pointer dragging operation data, based on the pointer dragging time interval and pointer dragging direction. This invention acquires detailed data for each frame during a user's pointer dragging operation on an air-operated device in real time, including pointer movement amount, direction, and time interval, enabling complete and accurate recording of the user's operation trajectory. After the user completes the dragging operation, a reverse displacement operation is performed based on this recorded data, eliminating the need for the user to manually return the pointer and avoiding tedious manual repositioning, thus directly improving operational efficiency. By performing the reverse displacement of the pointer dragging amount in the order or reverse order of the frame records in the pointer dragging operation data, a smooth experience similar to direct touch is simulated, improving user satisfaction when using an air-operated device to control a touch screen in non-touch screen scenarios, significantly enhancing the user experience. By focusing on the relative position change of the pointer during the operation process, rather than relying on the absolute position information of the device, a unified pointer control logic can be implemented across different operating systems and various types of mobile screen devices, providing a cross-platform, highly compatible solution that meets the diverse pointer control needs of devices in non-touch operation scenarios.

[0276] The specific embodiments described above further illustrate the purpose, technical solution, and beneficial effects of the present invention. It should be understood that the above descriptions are merely specific embodiments of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A control method of a touch screen pointer, characterized by, The method comprises: acquiring, in real time, pointer-dragging operation data of a user on an aerial operation device; displaying a pointer in the touch screen that moves in response to the pointer-dragging operation; the pointer-dragging operation data comprises the pointer-dragging movement amount and the pointer-dragging direction of each frame recorded frame by frame during the dragging operation; after the dragging is released, the data of each frame is reversely displaced based on the pointer-dragging direction according to the order or reverse order of the frame recording in the pointer-dragging operation data.

2. The method of claim 1, wherein, The method further comprises: cumulatively, piecewise or in groups, processing the pointer-dragging movement amount of each frame recorded frame by frame during the dragging operation to obtain the total displacement amount or piecewise displacement amount of the pointer.

3. The method of claim 2, wherein, After the dragging is released, the data of each frame is reversely displaced based on the pointer-dragging direction according to the order or reverse order of the frame recording in the pointer-dragging operation data, which comprises: moving the pointer in the direction opposite to the total displacement amount or piecewise displacement amount so that the pointer returns to the predetermined position or approaches the predetermined position in the form of one-time rebound, piecewise rebound, equal-division rebound or simulated rebound time sequence visual effect.

4. The method according to any one of claims 1 to 3, characterized in that, The pointer-dragging operation data further comprises a pointer-dragging time interval; After the dragging is released, the data of each frame is reversely displaced based on the pointer-dragging time interval and the pointer-dragging direction according to the order or reverse order of the frame recording in the pointer-dragging operation data.

5. The method of claim 4, wherein, The method further comprises: determining, for each frame record data, whether the frame record data is a target frame; the target frame corresponds to a pointer-dragging time interval greater than a first threshold value; modifying the pointer-dragging time interval of the target frame to a preset time interval; replacing the target frame in the pointer-dragging operation data with the modified target frame to obtain modified pointer-dragging operation data; After the dragging is released, the data of each frame is reversely displaced based on the pointer-dragging time interval and the pointer-dragging direction according to the order or reverse order of the frame recording in the pointer-dragging operation data, which comprises: After the dragging is released, the data of each frame is reversely displaced based on the pointer-dragging time interval and the pointer-dragging direction according to the order or reverse order of the frame recording in the modified pointer-dragging operation data.

6. The method of claim 5, wherein, Determining, for each frame record data, whether the frame record data is a target frame comprises: determining whether the pointer-dragging time interval corresponding to the frame record data is greater than a first threshold value; if yes, determining whether the pointer-dragging movement amount corresponding to the frame record data is less than or equal to a second threshold value; if yes, determining that the frame record data is a target frame.

7. The method according to claim 5 or 6, characterized in that Determining, for each frame record data, whether the frame record data is a target frame comprises: determining, in real time, whether the current frame record data is a target frame during the acquisition of the pointer-dragging operation data of the user on the aerial operation device; or, after detecting that the user stops the pointer-dragging operation on the aerial operation device, determining, for each frame record data, whether the frame record data is a target frame.

8. The method of claim 5 or 6, wherein, The method further comprises: merging the pointer-dragging movement amount in the record data of continuous target frames to obtain a merged frame; modifying the pointer-dragging time interval of the target frame to a preset time interval comprises: The pointer dragging time interval of the combined frame is modified to a preset time interval; The target frame in the pointer dragging operation data is replaced by the modified target frame to obtain modified pointer dragging operation data, including: The corresponding continuous target frame in the pointer dragging operation data is replaced by the combined frame to obtain the modified pointer dragging operation data.

9. The method according to any one of claims 1 to 8, characterized in that, The pointer dragging movement amount in the record data of the continuous target frame is combined to obtain a combined frame, including: In the order of the time stamp of each frame record data from early to late, a target frame with an earlier time stamp is obtained as a frame to be combined; It is determined whether the next frame of the frame to be combined is a target frame; If so, the pointer dragging movement amount of the frame to be combined and the next frame is combined to obtain intermediate data; The next frame of the intermediate data is determined whether it is a target frame, and the combination is performed until the next frame of the intermediate data is not a target frame or the intermediate data is greater than a third threshold value; the obtained intermediate data is taken as a combined frame.

10. The method of any one of claims 1-9, wherein, Further comprising: In the process of performing the reverse displacement of the pointer dragging movement amount of each frame data based on the pointer dragging time interval, if it is detected that the user performs the pointer dragging operation again, then after the process of the reverse displacement is completed, the pointer dragging operation data performed by the user again is obtained; the starting recording time of the pointer dragging operation data performed again is the ending time of the process of the reverse displacement; The reverse displacement is performed again based on the pointer dragging operation data performed again.

11. The method of any one of claims 1-10, wherein, Further comprising: In the process of performing the reverse displacement of the pointer dragging movement amount of each frame data based on the pointer dragging time interval, if it is detected that the user performs the movement operation of the pointer, the process of performing the reverse displacement of the pointer dragging movement amount based on the pointer dragging time interval is stopped, and the pointer is controlled to respond to the movement operation of the pointer.

12. A control device for a touch screen pointer, characterized in that Comprising: A pointer dragging operation data acquisition module is configured to acquire the pointer dragging operation data performed by the user on the air operation device in real time; The pointer is displayed in the touch screen to move in response to the pointer dragging operation; the pointer dragging operation data includes the pointer dragging movement amount and the pointer dragging direction of each frame in the dragging operation process recorded frame by frame; A reverse displacement module is configured to, after the dragging is released, perform the reverse displacement of the pointer dragging movement amount of each frame data based on the pointer dragging direction in the order or reverse order of the frame record in the pointer dragging operation data.

13. A computer device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, The processor executes the computer program to implement the method in any one of claims 1 to 11.

14. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, and the computer program is executed by the processor to implement the method in any one of claims 1 to 11.

15. A computer program product, characterised in that, The computer program product includes a computer program, and the computer program is executed by the processor to implement the method in any one of claims 1 to 11.

Images