Predictive control method, input system, and computer readable recording medium

Abstract

A predictive control method, an input system and a computer-readable recording medium. The predictive control method is applicable to a display showing an input motion signal, comprising: superimposing the coordinates corresponding to the input motion signal with the specific coordinates of the display; and predicting the input motion signal so that the display shows the coordinates predicted by the input motion signal. The present invention can save the time of the user moving the pointer signal and improve the accuracy of controlling the pointer signal on a large display.

Description

Technical Field

[0001] The present invention relates to a prediction method, and more particularly to a prediction control method, an input system and a computer-readable recording medium applicable to a display. Background Art

[0002] With the popularity of notebook computers, input devices include mouse, touch input, stylus, etc. In recent years, the size of monitors can be made larger and larger, and multiple large monitors can be spliced ​​into a display wall. These large monitors are usually placed in banks, hospitals or shopping malls. They may have touch functions. In addition to displaying information, some allow users to click on the information they want to read. Generally speaking, these large monitors are usually set on the wall, and ordinary users cannot connect to the large monitors through external computers for operation.

[0003] However, when a user wants to use an input device to achieve large-scale movement on a large display, the functions of existing input devices are limited. Whether it is fingers, eye tracking input technology, mouse, stylus or other current input devices, it is difficult to quickly and accurately move a large range on a large display. For example, fingers, eye tracking input technology, mouse, stylus or other current input devices, it is difficult to accurately and quickly drag a file displayed in the lower right corner of a large display to a specific position in the upper left corner.

[0004] Therefore, how to quickly, accurately and significantly move a pointer signal on a large display has become one of the problems to be solved in the art. Summary of the invention

[0005] In order to solve the above problems, an embodiment of the present disclosure provides a predictive control method. The predictive control method includes: receiving a pointer signal; and determining whether the pointer signal moves from an initial position to a direction; when it is determined that the pointer signal moves in the direction, the coordinates of the initial position are superimposed with the coordinates of the center of a display, and after the pointer signal moves to a predicted point and stops moving, the coordinates of a target point are calculated based on the coordinates of the center of the display and the coordinates of the predicted point, and the pointer signal moves to the target point.

[0006] In order to solve the above-mentioned problems, an embodiment of the present disclosure also provides a prediction control method suitable for a display to display an input motion signal. The prediction control method includes: overlapping the coordinates corresponding to the input motion signal with the specific coordinates of the display; and predicting the input motion signal so that the display displays the coordinates predicted by the input motion signal.

[0007] In order to solve the above-mentioned problems, one aspect of the present disclosure provides an input system. The input system includes an input and output interface and a prediction device. The input and output interface is used to receive a pointer signal. The prediction device includes a modeling device, a display block device, a pointer positioning device, a calculation prediction device and a mobile output device. The modeling device is used to determine whether the pointer signal moves from an initial position to a direction. The display block device is used to define a display center. When the modeling device determines that the pointer signal moves in a direction, the pointer positioning device overlaps the coordinates of the initial position with the coordinates of the display center. The calculation prediction device is used to calculate the coordinates of a target point based on the coordinates of the display center and the coordinates of the prediction point after the pointer signal moves to a prediction point and stops moving, and the pointer signal moves to the target point. The mobile output device is used to display the pointer signal moved to the target point on a display.

[0008] In order to solve the above problems, an aspect of the present disclosure further provides an input system. An input system is suitable for a display to display an input motion signal, and the input system includes: a pointer positioning device, the pointer positioning device is used to overlap the coordinates corresponding to the input motion signal with the specific coordinates of the display; and a calculation prediction device, the calculation prediction device is used to predict the input motion signal so that the display displays the coordinates predicted by the motion signal.

[0009] In order to solve the above-mentioned problems, an embodiment of the present disclosure provides a computer-readable recording medium for executing a predictive control method, which includes: receiving a pointer signal; and determining whether the pointer signal moves from an initial position to a direction; when it is determined that the pointer signal moves in a direction, superimposing the coordinates of the initial position with the coordinates of a display center, and after the pointer signal moves to a predicted point and stops moving, the coordinates of a target point are calculated based on the coordinates of the display center and the coordinates of the predicted point, and the pointer signal moves to the target point.

[0010] In order to solve the above-mentioned problems, an embodiment of the present disclosure further provides a computer-readable recording medium for executing a predictive control method, which includes: overlapping the coordinates corresponding to the input motion signal with specific coordinates of a display; and predicting the input motion signal so that the display displays the coordinates predicted by the motion signal.

[0011] The predictive control method, input system and computer-readable recording medium shown in the present invention can be used in the case of a large display, such as a large display in a square, a large wall optical touch panel, a display screen of a virtual reality system, a display wall, etc. The user can use a part of the large display, such as a lower accessible block, to apply a discontinuous movement pointer signal to control other blocks, and by predicting the pointer signal, the pointer signal can also be moved to the target point more quickly. This saves the user's time in moving the pointer signal and improves the accuracy of controlling the pointer signal on the large display. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 is a block diagram of an input system according to an embodiment of the present invention.

[0013] Figure 2 The flowchart of a predictive control method is shown according to an embodiment of the present invention.

[0014] Figure 3 FIG. 4 is a schematic diagram illustrating a center of a display according to an embodiment of the present invention.

[0015] Figure 4 The diagram is a schematic diagram illustrating coordinates of an initial position and coordinates of a display center according to an embodiment of the present invention.

[0016] Figure 5 The figure is a schematic diagram illustrating a time series prediction method of a long short-term memory recurrent neural network according to an embodiment of the present invention.

[0017] Figure 6 According to one embodiment of the present invention, a Figure 4 Schematic diagram of an enlarged view of block A.

[0018] Figure 7 It is a schematic diagram illustrating an optical touch application scenario according to an embodiment of the present invention.

[0019] Figure 8A to Figure 8C It is a schematic diagram illustrating an optical touch application scenario according to an embodiment of the present invention.

[0020] Fig. 9 The flowchart of a predictive control method is shown according to an embodiment of the present invention.

[0021] Main component symbols:

[0022] 100 Input System

[0023] SIG pointer signal

[0024] 10 Electronic devices

[0025] 11 Input and output interfaces

[0026] 12 Processor

[0027] 13 Storage Devices

[0028] 20 Prediction Device

[0029] 21 Modeling device

[0030] 22 Display block device

[0031] 23 Pointer positioning device

[0032] 24 Computational prediction device

[0033] 25 Mobile output device

[0034] 30 Display

[0035] 200, 900 Predictive Control Methods

[0036] 210~250、910~920 Steps

[0037] L Length

[0038] W Width

[0039] Blocks A to D

[0040] O Display Center

[0041] V' prediction point

[0042] v', v direction

[0043] V Pause Point

[0044] P Initial position

[0045] A' Long Short-Term Memory Recurrent Neural Network

[0046] G Target Point

[0047] r t-1 、r t Target area radius

[0048] FL0, FL1 files

[0049] FL2 Application

[0050] R Target area

[0051] R' Correction Area

[0052] h t-1 ~h t+n Output of a LSTM recurrent neural network

[0053] X t-1 ~X t+n coordinate

[0054] Aa Small display block

[0055] Pa, Pb position

[0056] O(0,0) coordinates of the center of the display

[0057] P(x p ,y p ) Coordinates of the initial position

[0058] V'(x v’ ,y v’ ) Coordinates of the predicted points

[0059] V(x v ,y v ) Coordinates of the stop point DETAILED DESCRIPTION

[0060] The following description is a preferred implementation of the invention, and its purpose is to describe the basic spirit of the invention, but it is not intended to limit the invention. The actual content of the invention must refer to the scope of the attached claims.

[0061] Please refer to Figure 1 and Figure 2 , Figure 1 FIG. 1 is a block diagram of an input system 100 according to an embodiment of the present invention. Figure 2 FIG. 2 is a flow chart of a predictive control method 200 according to an embodiment of the present invention.

[0062] In one embodiment, the input system of the present invention is suitable for displaying an input movement signal (e.g., a pointer signal SIG) on a display 30, and the input system includes a pointer positioning device 23 and a calculation prediction device 24. The pointer positioning device 23 is used to predict the input movement signal (e.g., the pointer signal SIG) so that the display 30 displays the coordinates predicted by the movement signal.

[0063] The following further Figure 1 and Figure 2 Describe the detailed technical features of this case.

[0064] In one embodiment, if Figure 1As shown, the input system 100 includes an electronic device 10 and a prediction device 20. In one embodiment, the electronic device 10 is, for example, a host, a server, a tablet, a laptop, a mobile phone, or other devices that can receive signals for calculation and storage. In one embodiment, the electronic device 10 includes an input and output interface 11, a processor 12, and a storage device 13. In one embodiment, the input and output interface 11 is, for example, a mouse signal receiver, a touch panel, or other interfaces that can be used to receive signals. In one embodiment, the storage device 13 can be implemented as a read-only memory, a flash memory, a floppy disk, a hard disk, an optical disk, a flash drive, a magnetic tape, a database accessible by a network, or a storage medium with the same function that a technician can easily think of. The storage device 13 can be used to store information about the pointer signal SIG at each time point, such as coordinate information.

[0065] In one embodiment, the prediction device 20 includes a modeling device 21 , a display segmentation device 22 , a pointer positioning device 23 , a calculation prediction device 24 and a motion output device 25 .

[0066] In one embodiment, the modeling device 21, the display segmentation device 22, the pointer positioning device 23, the calculation prediction device 24 and the mobile output device 25 can be implemented together or separately by a volume circuit such as a micro controller, a microprocessor, a digital signal processor, an application specific integrated circuit (ASIC) or a logic circuit.

[0067] In one embodiment, the operations or functions performed by the modeling device 21, the display segmentation device 22, the pointer positioning device 23, the calculation prediction device 24 and the motion output device 25 can be implemented by software or firmware, and the processor 12 is used to perform these operations.

[0068] In one embodiment, when the amount of computation is small, the processor 12 can execute the computations performed by the modeling device 21 , the display segmentation device 22 , the pointer positioning device 23 , the calculation prediction device 24 and the movement output device 25 .

[0069] In one embodiment, the pointer signal SIG is, for example, a mouse cursor signal, a finger touch signal, or a stylus touch signal, and usually displays a display position (e.g., the position of the mouse cursor on the display) corresponding to a physical position (e.g., the actual position of the mouse sliding on the desktop) on the display 30. The method of corresponding a physical position to a display position is a known technology, and thus will not be described in detail herein.

[0070] In one embodiment, the display 30 in the input system 100 may be a large display. In one embodiment, the input system 100 may include a plurality of displays 30. In one embodiment, the large display is, for example, a spliced ​​display wall, a large interactive touch display (e.g., 86 inches), an interactive touch electronic display billboard, and the like.

[0071] The following describes the prediction control method 200, which can be implemented by the input system 100. In one embodiment, the prediction control method 200 can be implemented by firmware, program code or software, and the program code or software is stored in a computer-readable recording medium, and the processor in the computer-readable recording medium can execute such firmware, program code or software.

[0072] In one embodiment, the pointer signal prediction function is turned on when the display 30 is pressed for more than three seconds by a finger or a stylus. In one embodiment, when the processor 12 receives a signal that the left and right buttons of the mouse are pressed twice at the same time, the processor 12 turns on the pointer signal prediction function. In one embodiment, the prediction control method 200 can be implemented by an executable file. After the input system 100 installs this executable file, an out of range movement function option will appear in the computer settings. When the out of range movement function option is selected, the processor 12 starts the prediction control method 200.

[0073] In one embodiment, when the option of the out-of-range movement function is selected, it can be preset to project the pointer signal SIG onto different display screens in a software-driven or hardware-driven manner such as automatically or by system prompt.

[0074] In step 210 , the input and output interface 11 is arranged to receive a pointer signal SIG.

[0075] For example, the input and output interface 11 is used to receive a mouse cursor signal and regard the mouse cursor signal as a pointer signal SIG.

[0076] In step 220 , the modeling device 21 or the processor 12 is used to determine whether the pointer signal SIG moves from an initial position to a direction.

[0077] In one embodiment, the direction may be any direction. In other words, as long as the modeling device 21 detects that the pointer signal SIG moves (for example, the displacement distance of the pointer signal SIG is greater than a Euclidean distance threshold), the process proceeds to step 230 .

[0078] In one embodiment, Euclidean distance is a commonly used distance definition, which is the real distance between two points in m-dimensional space (wherein the symbol m can be a value greater than 2). The Euclidean distance in two-dimensional and three-dimensional space is the distance between two points. In other words, the Euclidean distance can be used to measure the distance between two points in space.

[0079] In one embodiment, the display segmentation device 22 is used to define a display center O. Figure 3 FIG. 1 is a schematic diagram illustrating a display center O according to an embodiment of the present invention. Figure 3 It can be seen that the display block dividing device 22 is used to divide the display 30 into a midline of length L and a midline of width W, and the intersection of the two midlines is regarded as the display center O, and the coordinates of the display center O are defined as O(0,0). A person skilled in the art should understand that the display center can be defined according to actual operation, and the intersection of the straight line (not necessarily the midline of length L) and the horizontal line (not necessarily the midline of width L) is not necessarily located at the center of the display, but the intersection of the straight line and the horizontal line is regarded as the origin of the screen O(0,0).

[0080] In one embodiment, the display dividing device 22 divides the display 30 into four blocks A-D by the center line of the length L and the center line of the width W of the display 30 .

[0081] In one embodiment, if the modeling device 21 does not detect that the pointer signal SIG has moved, the process ends or the process goes to step 210 again.

[0082] In step 230 , when the modeling device 21 or the processor 12 determines that the pointer signal SIG moves in this direction, the pointer positioning device 23 or the processor 12 overlaps the coordinates of the initial position 21 with the coordinates O(0,0) of the center O of the display.

[0083] In one embodiment, the pointer positioning device 21 or the processor 12 sets the coordinates P (x p ,y p ) is defined as the origin O(0,0), so that the pointer positioning device SIG sets the coordinates P(x p ,y p ) overlaps with the coordinates O(0,0) of the center of the display. At this time, the coordinates P(x p ,y p ) is considered as P(0,0).

[0084] In one embodiment, Figure 4 The coordinates P(x p ,y p ) and the coordinates O(0,0) of the display center O. Figure 4In the example, the coordinates of the initial position P of the pointer positioning device 23 on the display 30 are P(x p ,y p In this step, the coordinates P(x p ,y p ) is regarded as the coordinate O(0,0) of the center O of the display, so that the coordinate of the initial position P overlaps with the coordinate O(0,0) of the center O of the display. In other words, the movement of the pointer signal SIG in the block D corresponds to the movement of the coordinate O(0,0) of the center O of the display. For example, the pointer signal SIG moves from the coordinate P(x p ,y p ) moves in direction v, it is regarded as the pointer signal SIG moving from the coordinate O(0,0) of the display center O to the direction v', and the vectors of direction v and direction v' are the same.

[0085] Thus, when the display 30 is large, the pointer signal SIG in the block D can be moved beyond the range to the block A. In other words, the movement of the pointer signal SIG in the block D is equivalent to the movement of the pointer signal SIG in the block A.

[0086] In step 240, the prediction device 24 or the processor 12 is used to calculate the prediction point V' according to the coordinate O(0,0) of the display center O and the coordinate V'(x v’ ,y v’ ) calculates the coordinates of a target point G, and the pointer signal SIG moves to the target point G.

[0087] In one embodiment, the pointer signal SIG moves to the target point G according to the coordinates of the target point G.

[0088] In one embodiment, the pointer signal SIG moves to a stop point V in the region D, whose coordinates are V(x v ,y v ), which is equivalent to the pointer signal SIG moving to the predicted point V' in area A, whose coordinates are V'(x v’ ,y v’ ). Thus, the movement of the pointer signal SIG in the area D can be moved beyond the range to the block A by the predictive control method 200, and the pointer signal SIG moves in the same manner as in the area D (the vectors of the directions v and v' are the same).

[0089] Therefore, when the display 30 is large, the pointer signal SIG only needs to be moved in the area D, and the pointer signal SIG can be moved from the block D to the block A without significantly moving the mouse, finger or other input device.

[0090] In one embodiment, the prediction device 24 or the processor 12 calculates the coordinate V' (xv’ ,y v’ ) Input a time series prediction method of a recurrent neural network with long short-term memory (RNNLSTM), and the time series prediction method of the recurrent neural network with long short-term memory outputs the coordinates of the target point G.

[0091] In one embodiment, Figure 5 is a schematic diagram of a time series prediction method 500 of a long short-term memory recurrent neural network according to an embodiment of the present invention. For example, a user double-clicks the left and right buttons of a mouse twice to start the prediction control method 200. When the pointer signal SIG of the mouse moves slightly, if the pointer signal SIG moves to point X t The calculation prediction device 24 can obtain the coordinate X of the pointer signal SIG at this time. t (x t ,y t ), the coordinate X of the previous history (the pause position at the previous time point or the previous click position) t-1 (x t-1 ,y t-1 ) is substituted into the long short-term memory recurrent neural network A', then the long short-term memory recurrent neural network A' outputs h t-1 , which represents the coordinate position at time t-1, and then h t-1 Substitute into the next long short-term memory recurrent neural network A' to predict the current coordinate X t The predicted output coordinate position h t , which represents the coordinate position at time t, and then repeat these steps. For example, the previous output h t and coordinate X t+1 (x t+1 ,y t+1 ) is substituted into the long short-term memory recurrent neural network A', then the long short-term memory recurrent neural network A' outputs h t+1 , which represents the predicted coordinate position at time t+1, and the previous output h t+1 and coordinate X t+2 (x t+2 ,y t+2 ) is substituted into the long short-term memory recurrent neural network A', then the long short-term memory recurrent neural network A' outputs h t+2 , which represents the predicted coordinate position at time t+2. Similarly, the previous output h t+n-1 and coordinate X t+n (x t+n ,y t+n ) is substituted into the long short-term memory recurrent neural network A', then the long short-term memory recurrent neural network A' outputs h t+n, which represents the predicted coordinate position at time t+n. In one embodiment, when the predicted coordinate position is the same as the actual position of the control pointer or the Euclidean distance is less than a convergence threshold, it is considered that the model of the long short-term memory recurrent neural network is trained.

[0092] In one embodiment, the timing prediction formula is X(t)=X(t-1)+Er(t), which can be one of the operations in the long short-term memory recurrent neural network A', where Er(t) represents the noise at the current time point t. In one embodiment, the size of different displays 30, the pointer signal SIG moving to different destinations, and the variables of the pointer signal SIG (such as the initial speed and the angle of moving the pointer signal SIG) are combined with the user's habit of moving the pointer signal SIG, and the predictive control method 200 adds the variables to the deep learning model (such as the long short-term memory recurrent neural network A') to train a model to predict the user's next target point.

[0093] It can be seen that when the pointer signal SIG has a targeted movement trend, the calculation prediction device 24 applies the time series prediction method 500 of the long short-term memory recurrent neural network to calculate and collect the coordinates of the pointer signal SIG, and establish a model for the pointer signal SIG to obtain potential features, and combine the time series algorithm to establish a prediction for the movement of the pointer signal SIG, for example, predicting Figure 4 The coordinates of the target point G in . The time series prediction method of the long short-term memory recurrent neural network is a known algorithm, so it will not be described here.

[0094] In one embodiment, the target point G is the position where the calculation prediction device 24 predicts that the user wants to move the pointer signal SIG to in the next step or in the end.

[0095] In step 250 , the motion output device 25 is used to display a pointer signal SIG moving to the target point G on a display 30 .

[0096] In one embodiment, the position of the target point G will become more accurate as the amount of data calculated by the time series of the long short-term memory recurrent neural network increases, and the data collected for each correction of the target point G' can be calculated by the change of the target area R'.

[0097] In one embodiment, the calculation prediction device 24 or the processor 12 calculates a Euclidean distance between the coordinates of the target point G and the coordinates of the modified target point G'. The calculation prediction device 24 or the processor 12 regards the Euclidean distance as a target area radius. When the target area radius is less than a minimum radius threshold (for example, the Euclidean distance is 0.1 units), the calculation prediction device 24 or the processor 12 outputs the coordinates of the modified target point G'.

[0098] In one embodiment, Figure 6According to one embodiment of the present invention, a Figure 4 When the time series prediction method 500 of the long short-term memory recurrent neural network is applied for the first time to estimate the coordinates of the target point G, the Euclidean distance can be calculated based on the coordinates of the target point G and the coordinates of the display center O (0,0), such as Figure 6 As shown, the radius of the target area from the target point G to the display center O is Wherein |GO| represents the operation of Euclidean distance. Before the next time the time series prediction method 500 of the long short-term memory recurrent neural network is applied to estimate the next target point, the user can correct the current target point G to the corrected target point G'. The goal is to take the minimum value of the Euclidean distance between the target point G and the corrected target point G'. When the Euclidean distance is equal to zero, it means that the prediction is completely accurate, the target point G and the corrected target point G' are the same point, and the target area radius of the target point G and the corrected target point G' at time point t is r t =min|GG'| t-1 , where |GG'| represents the Euclidean distance operation.

[0099] The target region R and the target point G will become more accurate as the amount of data of the time series input into the long short-term memory recurrent neural network increases, the range of the target region R will become smaller, the Euclidean distance between the target point G and the modified target point G' will become smaller, and the modified region R' will become smaller, which means that the prediction of the target point G is becoming more and more accurate. When the Euclidean distance between the target point G and the modified target point G' is less than a minimum radius threshold, for example, the target point G and the modified target point G' overlap, it means that the time series of the long short-term memory recurrent neural network has been trained very accurately, and the user does not need to correct the position of the target point G (no need to calculate the target area radius of the target point G and the modified target point G'), and the target point G can be directly displayed on the display 30.

[0100] In one embodiment, Figure 7 1 is a schematic diagram illustrating an optical touch application scenario according to an embodiment of the present invention. When the display 30 is a touch display, the stylus or finger can long press the file FL0 to generate a pointer signal SIG. In other words, when the calculation prediction device 24 or the processor 12 receives the pointer signal generated by long pressing an icon (for example, the icon represents a file FL0 or an application), and the long pressing time is greater than the time threshold (for example, 3 seconds), the calculation prediction device 24 or the processor 12 activates the out-of-range movement function, and the calculation prediction device 24 or the processor 12 prompts the pointer signal SIG to move the file FL0 located in the block D from the initial position P to the stop point V. When the stylus or finger leaves the display 30, the out-of-range movement function automatically moves the file FL0 to the predicted point V' in the block A corresponding to the block D, and then automatically moves to the target point G.

[0101] In one embodiment, Figure 8A to Figure 8C This is a schematic diagram of an optical touch application scenario according to an embodiment of the present invention. When the display 30 is a large touch display, for example, the display 30 is a large display or a display wall composed of multiple large displays, which is placed in a bank, hospital, shopping mall or other space, it can be a touch display to provide an interface to display information and interact with the user. In this case, since the display 30 is too large, the stylus or finger cannot click on block A. The stylus or finger can press and hold position Pa for three seconds to generate a pointer signal SIG, and the calculation prediction device 24 or the processor 12 activates the out-of-range movement function. The pointer signal SIG generated by the stylus or finger moves a short distance from position Pa to position Pb (such as Fig. 8A As shown), and stay at position Pb for three seconds, the processor 12 prompts the display 30 to display a small display block Aa in block D (as shown Figure 8B As shown in FIG. 1 , the small display block Aa is used to display icons (e.g., icons representing files or applications) in block A, and a stylus pen or a finger can click on a file FL1 or an application FL2 in block A in the small display block Aa in block D. Thus, even if the stylus pen or a finger cannot click on block A, the file FL1 or application FL2 in block A can be selected in block D by this method.

[0102] In one embodiment, if Figure 8C As shown, when the small display block Aa appears, the stylus (all touch devices can be used in this scenario) or finger can generate a pointer signal SIG to click on the file FL1 or application FL2 in the small display block Aa. Taking the file FL1 in the small display block Aa as an example, the pointer signal SIG clicks on the file FL1 in the small display block Aa and drags the file FL1 to the stop point V. At the same time, the processor 12 prompts the block C of the display 30 to correspond to the direction in which the file FL1 in the small display block Aa is dragged, and displays that the file FL1 is dragged from the center O of the display to the predicted point V' in the same direction. The calculation prediction device 24 then automatically moves the file FL1 to the target point G.

[0103] In one embodiment, the predictive control method 200 can be applied to the operation of a purposeful pointer signal. For example, the predictive control method 200 can predict the target area that the controller wants to operate in virtual reality and quickly move the pointer signal to the target area in the virtual space.

[0104] Fig. 99 is a flow chart of a prediction control method 900 according to an embodiment of the present invention. In one embodiment, the prediction control method of the present invention is applied to a display 30, and the display 30 displays an input motion signal (e.g., a pointer signal SIG). The prediction control method includes coinciding the coordinates corresponding to the input motion signal (e.g., the pointer signal SIG) with the specific coordinates of the display 30 (e.g., step 910), and predicting the input motion signal so that the display 30 displays the coordinates predicted by the motion signal (e.g., step 920). In one embodiment, the prediction control method can be implemented by a computer-readable recording medium.

[0105] The predictive control method, input system and computer-readable recording medium shown in the present invention can be used in the case of a large display, such as a large display in a square, a large wall optical touch panel, a display screen of a virtual reality system, a display wall, etc. The user can use a part of the large display, such as a lower accessible block, to apply a discontinuous movement pointer signal to control other blocks, and by predicting the pointer signal, the pointer signal can also be moved to the target point more quickly. This saves the user's time in moving the pointer signal and improves the accuracy of controlling the pointer signal on the large display.

Claims

1. A predictive control method, applicable to a display device displaying an input motion signal, the predictive control method comprising: Overlapping the coordinates corresponding to the input motion signal with specific coordinates of the display; as well as Predicting the input motion signal so that the display displays the coordinates predicted by the input motion signal; The predictive control method also includes: A processor defines the coordinates corresponding to the input motion signal as an origin and an initial position, so that a pointer positioning device defines the coordinates corresponding to the input motion signal as specific coordinates of the display, wherein the specific coordinates of the display are considered as coordinates of a center of the display; The step of predicting the input mobile signal further comprises: A pointer signal generated by long pressing a file is received by the processor; When the long press time is greater than a time threshold, the processor activates an out-of-range movement function; and The processor causes the pointer signal to move the file located at a first block from the initial position to a stop point; When a touch device leaves a touch display, the processor causes the over-range movement function to automatically move the document to a predicted point in a second block corresponding to the first block, and then automatically move to a target point, wherein the pointer signal represents the input movement signal.

2. The predictive control method according to claim 1, further comprising: The processor inputs the coordinates of the prediction point into a time series prediction method of a long short-term memory recurrent neural network, and the time series prediction method of the long short-term memory recurrent neural network outputs the coordinates of the target point.

3. The predictive control method as claimed in claim 1, wherein the step of predicting the input motion signal further comprises: Calculating a Euclidean distance between the coordinates of a target point and the coordinates of a modified target point, and regarding the Euclidean distance as a target area radius; When the radius of the target area is less than a minimum radius threshold, the coordinates of the modified target point are output.

4. The predictive control method as claimed in claim 1, wherein the step of predicting the input motion signal further comprises: The processor receives the pointer signal generated by long pressing a file; When the long-pressing time is greater than a time threshold, the processor causes the touch-sensitive display to display a small display block in a first block, and the small display block is used to display an icon appearing in a second block; The touch device is used to click the icon in the second block from the small display block in the first block.

5. The predictive control method according to claim 4, further comprising: By clicking the file in the small display block with the pointer signal and dragging the file to the pause point, the processor causes a third block of the display to correspond to the direction in which the file in the small display block is dragged, showing that the file is dragged from the center of the display in the same direction to the predicted point, and then automatically moving the file to the target point.

6. An input system, adapted for displaying an input motion signal on a display, the input system comprising: a pointer positioning device, the pointer positioning device being used to coincide the coordinates corresponding to the input motion signal with the specific coordinates of the display; as well as a calculation prediction device, the calculation prediction device is used to predict the input motion signal so that the display shows the coordinates predicted by the motion signal; The coordinates corresponding to the input movement signal are defined as an origin and regarded as an initial position, so that a pointer positioning device defines the coordinates corresponding to the input movement signal as specific coordinates of the display, wherein the specific coordinates of the display are regarded as coordinates of a center of the display; When the display is a touch-sensitive display, when the calculation prediction device receives a pointer signal generated by long pressing a file, and when the long pressing time is greater than a time threshold, the calculation prediction device activates an out-of-range movement function, and the pointer signal moves the file located in a first block from the initial position to a pause point. When a touch device leaves the touch-sensitive display, the out-of-range movement function automatically moves the file to a predicted point in a second block corresponding to the first block, and then automatically moves to a target point, wherein the pointer signal represents the input movement signal.

7. An input system as described in claim 6, wherein the calculation prediction device inputs the coordinates of the prediction point into a time series prediction method of a long short-term memory recurrent neural network, and the time series prediction method of the long short-term memory recurrent neural network outputs the coordinates of the target point.

8. An input system as described in claim 6, wherein the calculation prediction device calculates a Euclidean distance between the coordinates of a target point and the coordinates of a revised target point, and the calculation prediction device regards the Euclidean distance as a target area radius. When the target area radius is less than a minimum radius threshold, the calculation prediction device outputs the coordinates of the revised target point.

9. An input system as described in claim 6, wherein when the display is a touch-sensitive display, a touch device long-presses a file to generate a pointer signal, and when the long-press time is greater than a time threshold, the touch-sensitive display displays a small display block in a first block, and the small display block is used to display an icon appearing in a second block, and a touch device clicks on the icon in the second block in the small display block in the first block.

10. An input system as described in claim 9, wherein the pointer signal clicks the file in the small display block and drags the file to the stop point, a processor prompts a third block of the display corresponding to the direction in which the file in the small display block is dragged, and displays that the file is dragged from the center of the display in the same direction to the predicted point, and the calculation prediction device then automatically moves the file to the target point.

11. A computer-readable recording medium for executing a predictive control method, the predictive control method comprising: Coinciding a coordinate corresponding to an input motion signal with a specific coordinate of a display; as well as Predicting the input motion signal so that the display shows the coordinates predicted by the motion signal; The predictive control method also includes: A processor defines the coordinates corresponding to the input motion signal as an origin and an initial position, so that a pointer positioning device defines the coordinates corresponding to the input motion signal as specific coordinates of the display, wherein the specific coordinates of the display are considered as coordinates of a center of the display; The step of predicting the input mobile signal further comprises: A pointer signal generated by long pressing a file is received by the processor; When the long press time is greater than a time threshold, the processor activates an out-of-range movement function; and The processor causes the pointer signal to move the file located at a first block from the initial position to a stop point; When a touch device leaves a touch display, the processor causes the over-range movement function to automatically move the document to a predicted point in a second block corresponding to the first block, and then automatically move to a target point, wherein the pointer signal represents the input movement signal.

Images