Application program and display terminal for ring mouse gesture quickness

Abstract

According to the application program and the display terminal for ring mouse gesture shortcut, the application program comprises a Bluetooth transmission module, a gesture shortcut setting module, a gesture storage module, a gesture matching module and a shortcut execution module which are connected with a processing module, and the processing module is used for data processing; the Bluetooth transmission module is used for acquiring spatial motion data of the ring mouse through Bluetooth; the gesture quick setting module is used for associating a ring mouse gesture with a quick operation mode; the gesture storage module is used for storing finger ring mouse gesture data; the gesture matching module is used for comparing the spatial motion data with the finger ring mouse gesture data; and the shortcut execution module is used for executing the shortcut operation mode associated with the gesture when the gesture comparison is successful. The user can freely set the shortcut corresponding to the gesture through the application program, the operation function of the ring mouse is increased, and the user can operate the terminal more conveniently.

Description

Technical Field

[0001] The present invention relates to an application program and a display terminal, and in particular to an application program and a display terminal for quick ring mouse gestures. Background Art

[0002] A ring mouse, also known as an air mouse, is a mouse that is shaped like a ring and is worn on the finger. The ring mouse is equipped with sensors such as a gyroscope and an accelerometer. The sensors obtain the spatial motion data of the ring mouse, and then convert the spatial motion data into cursor control; the left mouse button commands, right mouse button commands, and mouse wheel commands are implemented through buttons.

[0003] In the prior art, the ring mouse is usually only used as a mouse, and does not involve gesture recognition, nor is there an application for setting gesture shortcuts. It can be seen that the prior art needs to be improved and perfected. Summary of the invention

[0004] In view of the above-mentioned deficiencies in the prior art, an object of the present invention is to provide an application and a display terminal for ring mouse gesture shortcuts, which add new functions to the ring mouse through the application and solve the problem of no gesture shortcut application.

[0005] The technical solution of the present invention is as follows:

[0006] An application for ring mouse gesture shortcuts, comprising:

[0007] A Bluetooth transmission module, a gesture shortcut setting module, a gesture storage module, a gesture matching module and a shortcut execution module connected to the processing module, wherein:

[0008] A processing module, used for data processing;

[0009] A Bluetooth transmission module is used to obtain the spatial motion data of the ring mouse via Bluetooth;

[0010] Gesture shortcut setting module, used to associate ring mouse gestures with shortcut operation methods;

[0011] A gesture storage module, used to store ring mouse gesture data;

[0012] A gesture matching module, used to compare spatial motion data with ring mouse gesture data;

[0013] The shortcut execution module is used to execute the shortcut operation mode associated with the gesture when the gesture comparison is successful.

[0014] An application for ring mouse gesture shortcuts as described above, wherein the gesture shortcut setting module includes a system shortcut setting unit and an application shortcut setting unit, wherein the system shortcut setting unit is used to set a system shortcut associated with the ring mouse gesture, and the application shortcut setting unit is used to set an application shortcut associated with the ring mouse gesture.

[0015] An application for ring mouse gesture shortcuts as described above, wherein the gestures corresponding to the ring mouse gesture data include one or more of moving the palm up, moving the palm down, clicking fingers downward, turning the palm over, drawing a circle clockwise, drawing a circle counterclockwise, moving the palm backward to make a fist, moving the palm forward to spread out, and drawing letters.

[0016] An application for ring mouse gesture shortcuts as described above, wherein the system operations corresponding to the system shortcuts include one or more of volume increase, volume decrease, display desktop, copy, paste, window minimize, window maximize and close current window.

[0017] An application for ring mouse gesture shortcuts as described above, wherein the application operations corresponding to the application shortcuts include one or more of opening the application, liking, following, watching in full screen, returning in full screen, increasing volume, decreasing volume, increasing brightness, decreasing brightness, playing next, playing previous, pausing and playing.

[0018] As described above, an application for ring mouse gesture shortcuts, wherein the Bluetooth transmission module also includes a Bluetooth connection status monitoring module and a Bluetooth matching module, wherein the Bluetooth connection status monitoring module is used to monitor whether the Bluetooth of the running display terminal is connected to the ring mouse, the running display terminal is the display terminal running this application, and the Bluetooth matching module is used to match or change the Bluetooth connection between the ring mouse and the running display terminal.

[0019] The above-mentioned application for ring mouse gesture shortcuts further includes a ring mouse power monitoring module for detecting and displaying the current power of the ring mouse.

[0020] As described above, an application for ring mouse gesture shortcuts also includes a gesture action video demonstration module, which is set in a one-to-one correspondence with the gesture and is used to demonstrate the gesture action in the corresponding gesture video.

[0021] The present invention also provides a display terminal running the above-mentioned application program for ring mouse gesture shortcut.

[0022] A display terminal as described above, wherein the display terminal is a mobile phone terminal, a tablet computer, an AR terminal, a VR terminal or / and a computer terminal.

[0023] Compared with the prior art, the present invention provides an application and display terminal for ring mouse gesture shortcuts, the application includes: a Bluetooth transmission module connected to a processing module, a gesture shortcut setting module, a gesture storage module, a gesture matching module and a shortcut execution module, wherein the processing module is used for data processing; the Bluetooth transmission module is used to obtain the spatial motion data of the ring mouse through Bluetooth; the gesture shortcut setting module is used for the association relationship between the ring mouse gesture and the shortcut operation mode; the gesture storage module is used to store the ring mouse gesture data; the gesture matching module is used to compare the spatial motion data with the ring mouse gesture data; and the shortcut execution module is used to execute the shortcut operation mode associated with the gesture when the gesture comparison is successful. Through the application of the present invention, users can freely set the shortcut corresponding to the gesture, increase the operation function of the ring mouse, and make it more convenient for users to operate the terminal. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 It is a connection diagram of application modules for ring mouse gesture shortcuts of the present invention;

[0025] Figure 2 The invention discloses an application program interface diagram for ring mouse gesture shortcut. DETAILED DESCRIPTION

[0026] The present invention provides an application and a display terminal for ring mouse gesture shortcuts. To make the purpose, technical solution and effect of the present invention clearer and more specific, the present invention is further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0027] See also Figure 1 and Figure 2 , Figure 1 It is a connection diagram of application modules for ring mouse gesture shortcuts of the present invention; Figure 2 This is an application program interface diagram for ring mouse gesture shortcuts of the present invention, such as Figure 1 and Figure 2As shown, an application for ring mouse gesture shortcuts of the present invention comprises: a Bluetooth transmission module 102 connected to a processing module 101, a gesture shortcut setting module 102, a gesture storage module 104, a gesture matching module 106 and a shortcut execution module 105, wherein the processing module 101 is used for data processing; the Bluetooth transmission module 102 is used to obtain the spatial motion data of the ring mouse through Bluetooth; the gesture shortcut setting module 102 is used for the association relationship between the ring mouse gesture and the shortcut operation mode; the gesture storage module 104 is used to store the ring mouse gesture data; the gesture matching module 106 is used to compare the spatial motion data with the ring mouse gesture data; and the shortcut execution module 105 is used to execute the shortcut operation mode associated with the gesture when the gesture comparison is successful. Specifically, the application of the present invention is installed in a display terminal, and the display terminal is a mobile phone terminal, a tablet computer, an AR terminal, a VR terminal or / and a computer terminal. The application of the present invention is used in conjunction with the ring mouse, and can identify the corresponding gesture action according to the spatial motion trajectory of the ring mouse, and then complete the shortcut operation according to the set relationship between the ring mouse gesture and the shortcut operation mode.The application of the present invention includes a Bluetooth transmission module 102 connected to a processing module 101, a gesture shortcut setting module 102, a gesture storage module 104, a gesture matching module 106 and a shortcut execution module 105. The processing module performs data processing, such as matching spatial motion data with ring mouse gesture data; after the display terminal is connected to the ring mouse via Bluetooth, the Bluetooth transmission module obtains the spatial motion data of the ring mouse via Bluetooth, and the spatial motion data includes linear motion data and rotational motion data. The linear motion data is obtained by a three-axis accelerometer, and the rotational motion data is obtained by a three-axis gyroscope. Correspondingly, the gesture data is composed of threshold values ​​of the linear motion data and the rotational motion data. For example, the linear motion data corresponding to the palm moving backward and making a fist is (-, >10cm) and the rotational motion data is (↓, >70°), where - represents moving backward and ↓ represents rotating downward; the gesture shortcut setting module can set the association between the ring mouse gesture and the shortcut operation mode, where the ring mouse gesture refers to the ring mouse gesture data, and there are many gestures corresponding to the ring mouse gesture data, such as moving the palm up, moving the palm down, clicking the finger downward, turning the palm over, drawing a circle clockwise, drawing a circle counterclockwise, moving the palm backward and making a fist, moving the palm forward and unfolding, and drawing letters, etc.; the shortcut operation mode includes system shortcuts and application shortcuts, and the system operations corresponding to the system shortcuts include volume up, volume down, etc. Reduce, show desktop, copy, paste, minimize window, maximize window and close current window, etc.; application operations corresponding to application shortcuts include opening application, liking, following, full screen viewing, full screen return, increasing volume, decreasing volume, increasing brightness, decreasing brightness, playing next one, playing previous one, pausing and playing, etc.; the gesture storage module stores ring mouse gesture data, and the ring mouse gesture data includes palm up gesture data, palm down gesture data, finger down click gesture data, palm flip gesture data, clockwise circle gesture data, counterclockwise circle gesture data, palm back fist gesture data, palm forward unfold gesture data and letter drawing gesture data According to the data, the letter drawing gesture data includes 26 letter gesture data, and the 26 letters refer to the 26 English letters; the gesture matching module compares the spatial motion data with the ring mouse gesture data. When the spatial motion data matches the ring mouse gesture data, the gesture matching is successful. For example, for the gesture matching of moving the palm backward and making a fist, if the spatial motion data meets the threshold range of the palm moving backward and making a fist gesture data, it can be determined that the gesture corresponding to the spatial motion data is the palm moving backward and making a fist; the quick execution module is started when the gesture matching is successful, and the quick operation mode associated with the matching gesture is executed on the display terminal, that is, the quick operation instruction of the quick operation mode is executed on the display terminal to realize quick control of the display terminal. The user can freely set the shortcut corresponding to the gesture through the application of the present invention, which increases the operation function of the ring mouse and makes it more convenient for the user to operate the terminal.

[0028] Based on the above-mentioned application for ring mouse gesture shortcuts, preferably, the gesture shortcut setting module includes a system shortcut setting unit and an application shortcut setting unit, wherein the system shortcut setting unit is used to set a system shortcut associated with the ring mouse gesture, and the application shortcut setting unit is used to set an application shortcut associated with the ring mouse gesture. Specifically, the shortcut operation mode is divided into two types: system shortcuts and application shortcuts. In order to enable users to clearly and conveniently set the shortcut operation mode, the present invention sets a system shortcut setting unit and an application shortcut setting unit. The system shortcut setting unit can set a system shortcut associated with the ring mouse gesture, and the application shortcut setting unit can set an application shortcut associated with the ring mouse gesture.

[0029] Based on the above-mentioned application for ring mouse gesture shortcuts, preferably, the gestures corresponding to the ring mouse gesture data include one or more of palm up, palm down, finger down click, palm flip, clockwise circle, counterclockwise circle, palm back to make a fist, palm forward to spread out, and letter drawing. Specifically, the gestures involved in the present invention are performed by a ring mouse, and the recognition of gestures is realized by the built-in sensor of the ring mouse, which is a three-axis gyroscope and a three-axis accelerometer, and the ring mouse is worn on the finger for use. It should be noted that, since the sensor is set inside the ring mouse and the ring mouse is worn on the finger, the ring mouse cannot complete more complex gesture recognition, such as multi-finger interactive gestures. Therefore, the gestures that the ring mouse can recognize are only based on the relative movement of a single finger and wrist. For example, the ring mouse can recognize the above gestures. Each gesture corresponds to a separate linear motion data threshold and rotational motion data threshold. For example, the linear motion data of the palm moving upward is (+, >10cm), and the rotational motion data is (N, <5°). The rotational motion data here is actually an error range, because the palm moving upward will cause an angle change, N means that the direction is not judged, and <5° means that the rotational motion data does not exceed 5°. The linear motion data and rotational motion data of other gestures are specific and will not be repeated here.

[0030] Based on the above-mentioned application for ring mouse gesture shortcuts, preferably, the system operations corresponding to the system shortcuts include one or more of volume increase, volume decrease, display desktop, copy, paste, window minimize, window maximize, and close current window. Specifically, there are many system shortcuts, which are usually triggered by key combinations, such as the shortcut to display desktop is win+d. System shortcuts can quickly control the system. By associating system shortcuts with ring mouse gestures, the system can be quickly controlled in the air through ring mouse gestures, which is simple and convenient, and is particularly suitable for multimedia teaching and conference PPT presentations.

[0031] Based on the above-mentioned application for ring mouse gesture shortcuts, preferably, the application operations corresponding to the application shortcuts include one or more of opening the application, liking, following, watching in full screen, returning in full screen, increasing volume, decreasing volume, increasing brightness, decreasing brightness, playing next, playing previous, pausing and playing. Specifically, there are many application shortcuts, and application shortcuts are mainly used on applications. For example, the shortcut for liking on Tik Tok is double-clicking the display screen. Application shortcuts can quickly control applications. By associating application shortcuts with ring mouse gestures, applications can be quickly controlled in the air through ring mouse gestures. It is simple and convenient, and is particularly suitable for projectors and televisions.

[0032] Based on the above-mentioned application for quick gesture of ring mouse, preferably, the Bluetooth transmission module also includes a Bluetooth connection status monitoring module 201 and a Bluetooth matching module, wherein the Bluetooth connection status monitoring module is used to monitor whether the Bluetooth of the running display terminal is connected to the ring mouse, and the running display terminal is the display terminal running this application, and the Bluetooth matching module is used to match or change the Bluetooth connection between the ring mouse and the running display terminal. Specifically, the Bluetooth connection status monitoring module 201 can monitor whether the Bluetooth of the running display terminal is connected to the ring mouse. If the ring mouse is not connected, it will be displayed as unconnected. Clicking the Bluetooth connection status monitoring module 201 can start the Bluetooth matching module. The Bluetooth matching module will pop up a dialog box for connecting the ring mouse. Clicking the connectable ring mouse to be connected can perform Bluetooth pairing. The Bluetooth matching module is used to match or change the Bluetooth connection between the ring mouse and the running display terminal. The connection status of the ring mouse can be known on the application of the present invention, and the Bluetooth connection between the ring mouse and the running display terminal can be matched or changed as needed, which is simple and convenient.

[0033] Based on the above-mentioned application for ring mouse gesture shortcuts, preferably, it also includes a ring mouse power monitoring module 202, which is used to detect and display the current power of the ring mouse. Specifically, the power monitoring module 202 is provided with a remaining power display subunit and a remaining time display subunit. The remaining power display subunit displays the remaining power as a percentage of the total power, and the remaining time display subunit displays the usable time of the ring mouse, which can be used for a minute. If the calculation result has a decimal, the decimal is omitted and only the integer part is displayed. It should be noted that there is another method for calculating the usable time, which is calculated based on the full power usage time, that is, the usable time = remaining power percentage * full power usage time. The usable time of the ring mouse is directly displayed in the application of the present invention, so that the user can intuitively obtain the battery power of the ring mouse, which is convenient for charging the ring mouse.

[0034] Based on the above-mentioned application for ring mouse gesture shortcuts, preferably, it also includes a gesture action video demonstration module, which is set in a one-to-one correspondence with the gesture, and is used to demonstrate the gesture action in the corresponding gesture video. Specifically, the gesture action video demonstration module includes a gesture demonstration video, which is set in a one-to-one correspondence with the gesture, and the user can play it by clicking. Setting the gesture demonstration video can enable the user to quickly know the action corresponding to the gesture.

[0035] Based on the above-mentioned application for ring mouse gesture shortcuts, preferably, it also includes a mode switching module 203. The mode switching module 203 can switch the use mode of the ring mouse. The use mode includes desktop mode and air mode. The desktop mode is the mouse use mode. The air mode includes the mouse use mode and the gesture control mode. In other words, the air mode activates the gesture shortcut setting module of the application based on the mouse use mode, that is, the shortcut operation method set in the application can be used.

[0036] The present invention also provides a display terminal, which runs an application for ring mouse gesture shortcuts as described above. Specifically, the display terminal runs the application of the present invention, and after the display terminal is connected to the ring mouse, the ring mouse can control the display terminal through gestures, and the display terminal is a mobile phone terminal, a tablet computer, an AR terminal, a VR terminal or / and a computer terminal.

[0037] In summary, the present invention provides an application and display terminal for ring mouse gesture shortcuts, the application includes: a Bluetooth transmission module connected to a processing module, a gesture shortcut setting module, a gesture storage module, a gesture matching module and a shortcut execution module, wherein the processing module is used for data processing; the Bluetooth transmission module is used to obtain the spatial motion data of the ring mouse via Bluetooth; the gesture shortcut setting module is used to associate the ring mouse gestures with shortcut operation modes; the gesture storage module is used to store the ring mouse gesture data; the gesture matching module is used to compare the spatial motion data with the ring mouse gesture data; and the shortcut execution module is used to execute the shortcut operation mode associated with the gesture when the gesture comparison is successful. Users can freely set the shortcuts corresponding to the gestures through the application of the present invention, which increases the operating functions of the ring mouse and makes it more convenient for users to operate the terminal.

[0038] It should be understood that the application of the present invention is not limited to the above examples. For ordinary technicians in this field, improvements or changes can be made based on the above description. All these improvements and changes should fall within the scope of protection of the claims attached to the present invention.

Claims

1. An application for ring mouse gesture shortcuts, characterized in that: include: A Bluetooth transmission module, a gesture shortcut setting module, a gesture storage module, a gesture matching module and a shortcut execution module connected to the processing module, wherein: A processing module, used for data processing; A Bluetooth transmission module is used to obtain the spatial motion data of the ring mouse via Bluetooth; Gesture shortcut setting module, used to associate ring mouse gestures with shortcut operation methods; A gesture storage module, used to store ring mouse gesture data; A gesture matching module, used to compare spatial motion data with ring mouse gesture data; The shortcut execution module is used to execute the shortcut operation mode associated with the gesture when the gesture comparison is successful.

2. The application for ring mouse gesture shortcut according to claim 1, characterized in that: The gesture shortcut setting module includes a system shortcut setting unit and an application shortcut setting unit, wherein the system shortcut setting unit is used to set a system shortcut associated with a ring mouse gesture, and the application shortcut setting unit is used to set an application shortcut associated with a ring mouse gesture.

3. The application for ring mouse gesture shortcut according to claim 1, characterized in that: The gestures corresponding to the ring mouse gesture data include one or more of moving the palm up, moving the palm down, clicking fingers downward, turning the palm over, drawing a circle clockwise, drawing a circle counterclockwise, moving the palm backward to make a fist, moving the palm forward to spread out, and drawing letters.

4. The application for ring mouse gesture shortcut according to claim 2, characterized in that: The system operations corresponding to the system shortcuts include one or more of volume increase, volume decrease, display desktop, copy, paste, window minimize, window maximize and close current window.

5. The application for ring mouse gesture shortcut according to claim 2, characterized in that: The application operations corresponding to the application shortcuts include one or more of opening the application, liking, following, watching in full screen, returning to full screen, increasing volume, decreasing volume, increasing brightness, decreasing brightness, playing next, playing previous, pausing and playing.

6. The application for ring mouse gesture shortcut according to claim 1, characterized in that: The Bluetooth transmission module also includes a Bluetooth connection status monitoring module and a Bluetooth matching module, wherein the Bluetooth connection status monitoring module is used to monitor whether the Bluetooth of the running display terminal is connected to the ring mouse, the running display terminal is the display terminal running this application, and the Bluetooth matching module is used to match or change the Bluetooth connection between the ring mouse and the running display terminal.

7. The application for ring mouse gesture shortcut according to claim 1, characterized in that: It also includes a ring mouse power monitoring module for detecting and displaying the current power of the ring mouse.

8. The application for ring mouse gesture shortcut according to claim 3, characterized in that: It also includes a gesture action video demonstration module, which is set in one-to-one correspondence with the gestures and is used to demonstrate the gesture actions in the corresponding gesture video.

9. A display terminal, characterized in that: Run an application for ring mouse gesture shortcuts as described in any one of claims 1-8.

10. A display terminal according to claim 9, characterized in that: The display terminal is a mobile phone terminal, a tablet computer, an AR terminal, a VR terminal or / and a computer terminal.

Images