A game interactive control system and method using gesture sensing

Abstract

The present invention discloses a gesture-sensing game interactive control method, comprising a central control system, a sub-control system, and a Bluetooth transmission system. The central control system comprises an external instruction system, a node preset database system, and a camera capture system. The central control system is connected to a node data error correction system, a log data storage system, and a server communication system. Through the provided camera motion capture system, when instructions from a gesture sensing system reach the central control system, the central control system is sent by the external instruction system to a game platform, and controls the operation and instructions of the game platform. Simultaneously, the central control system compares the correctness of the gesture sensing instructions through the camera motion capture system and the node data error correction system, thereby facilitating error correction of the data sent by the gesture sensing system, facilitating increased correct operability, and enhancing the operational experience.

Description

Technical Field

[0001] The present invention relates to the field of gesture sensing technology, and in particular to a gesture sensing game interactive control system and method. Background Art

[0002] Gesture sensing, also known as touch-free technology, mainly uses various sensors on the mobile phone to sense and process the user's operating gestures to complete a series of operations. This technology will first be applied to tablets, but the introduction of this technology also requires the cooperation of hardware, such as a more powerful graphics processor, two front cameras, etc. After touch sensing, gesture sensing technology has become a new research direction for many manufacturers. The principle of interactive games is mainly to sense the player's movements through the sensing system, and then analyze and calculate them to execute related game commands. Common interactive games are divided into two aspects according to the nature of the industry and user habits: home consumer interactive games and commercial interactive games.

[0003] With the development of science and technology, gesture sensing technology has become more mature. Existing gesture sensing generally uses cameras to capture the operator's gestures. Although this method is highly adaptable, it has a poor interactive experience. In general, it cannot accurately reflect the operator's true intentions. In addition, it cannot adapt to more complex and professional gestures and operations, resulting in inconvenience in operation and a poor experience. Based on this, we propose a gesture-sensing game interactive control method. Summary of the Invention

[0004] In response to the above problems, the present invention provides a gesture-sensing game interaction control system and method.

[0005] The technical solution of the present invention is: a gesture-sensing game interactive control system, including a central control system, a sub-control system and a Bluetooth transmission system, the central control system including an external instruction system, a node preset database system and a camera capture system, the central control system is connected to a node data error correction system, the central control system is connected to a log data storage system, the central control system is connected to a server communication system, the sub-control system includes a gesture sensing system and an accessory power supply system, the sub-control system is connected to a light signal programming system, the light signal programming system is connected to an indicator light signal system, the light signal programming system is connected to a gesture light auxiliary system, the light signal programming system is connected to a breathing light perception system, the sub-control system is connected to a data node storage system, the Bluetooth transmission system includes a Bluetooth transmission component system and a key conversion system, the Bluetooth transmission component system includes a transmission component A system and a transmission component B system, and the Bluetooth transmission system is connected to a node data cache system.

[0006] In a further technical solution, the camera capture system is connected to a node data error correction system.

[0007] The central control system compares the correctness of gesture sensing instructions through the camera motion capture system and the node data error correction system, which facilitates error correction of the data sent by the gesture sensing system, increases correct operability, and improves the operating experience.

[0008] In a further technical solution, the node preset database system includes a local database system and a cloud database system, and the central control system is connected to the cloud database system through a server communication system.

[0009] The data node storage system performs data communication node storage and gesture sensing system data that needs to be transmitted, and transmits it to the node preset database system. The node preset database system saves the local database to form the user's own usage habits and gesture preset commands, which is convenient for adapting to the game platform. Then, the data is uploaded to the cloud database through the server communication system to save the relevant instructions of the gesture sensing system, so that the system can learn different gesture operations and continuously optimize the operation instructions as big data.

[0010] In a further technical solution, the external instruction system includes an external instruction sending system and an external instruction receiving system.

[0011] The external command system is a necessary system for establishing device communication with the game platform. It can receive and send commands and real-time communication data to facilitate the control of interactive games.

[0012] In a further technical solution, the accessory power supply system is connected to the optical signal programming and control system.

[0013] The accessory power supply system supplies power to the optical signal programming and control system and the sensor group of the external accessory gloves. The optical signal programming and control system controls the indicator light signal system, breathing light perception system and gesture light assistance system respectively according to the gesture data, operation instructions and other relevant data collected by the sub-control system.

[0014] In a further technical solution, the gesture sensing system includes a joint node curvature system, a balance sensing system, an acceleration sensing system, a height difference sensing system and a gravity sensing system.

[0015] The sub-control system is located inside the accessory sensor glove. The core of the sensor glove is composed of multiple sensor components, including joint node curvature, balance sensing, acceleration sensing, height difference sensing and gravity sensing. When the gesture sensing system is running, the joint node curvature system transmits the collected curvature of the glove joint position and identifies the coordination between different fingers, such as making a fist and spreading the palm. The balance sensing system collects the rotation angle of the glove as a whole at this time, such as the direction of the palm and back of the hand. The acceleration sensing system collects the running acceleration of the glove itself. For example, when the arm is stretched out with a fist, the relative instantaneous movement speed of the glove is faster. The height difference sensing system and the gravity sensing system are used to determine the distance between the glove relative to the initial position and the two hands, and the gravity sensing system determines the direction, so that the whole can capture various gesture operation instructions, and the instructions are processed by the sub-control system and sent through the transmission component B system for real-time monitoring.

[0016] In a further technical solution, the transmission component A system is connected to the central control system, and the transmission component B system is connected to the sub-control system.

[0017] The transmission component A system and the transmission component B system respectively establish connection data through Bluetooth communication, realizing gesture control operations through short-range wireless communication, and the Bluetooth transmission system can be set in the computer device and the glove, which is convenient for establishing two key conversion systems and transmitting data through the transmission component A system and the transmission component B system respectively set in the computer device and the glove.

[0018] In a further technical solution, the data node storage system is connected to the transmission component A system and the node preset database system through the transmission component B system.

[0019] The sub-control system transmits the communication node storage and gesture sensing system data stored in the data node storage system to the node preset database system for storage. This storage method reaches the central control system through the transmission component B system and the transmission component A, and is distributed to the node preset database system by the central control system, and is stored in the local database and cloud database respectively by the node preset database system.

[0020] In a further technical solution, the central control system is connected to a drive adaptation bearing system.

[0021] The central control system is adapted and installed inside computers, tablet computers and mobile phones through a drive adaptation carrier system. The drive adaptation carrier system facilitates the storage of the entire system as software in the electronic device being used, and makes it adaptable to different electronic devices, facilitating the use of multiple devices and increasing adaptability.

[0022] This technology also provides a gesture-sensing game interactive control method, which includes the following steps:

[0023] S1: At the beginning of the interactive control phase of the gesture-sensing game, after the user puts on the sensor gloves, the central control system adapts to the computer, tablet computer, and mobile phone by driving the adapter carrier system. The central control system communicates with the game platform that needs to interact in real time and transmits and receives commands through the external command system, and obtains video reading permissions through the camera motion capture system and the device's camera hardware;

[0024] S2: When the game platform generates an instruction to the central control system through the external instruction system, the central control system will communicate in real time through the transmission component system A to the Bluetooth transmission system. The key conversion system inside the Bluetooth transmission system will encode the communication information and then cache the node data in the node data cache system. The Bluetooth transmission system will then send the information to the sub-control system via the transmission component system B.

[0025] S3: When the sub-control system receives the information, it first stores the data communication node storage and the instructions of the gesture sensing system that need to be transmitted in the data node storage system, and transmits them to the node preset database system. The node preset database system saves them through the local database, and the cloud database saves the instructions of the gesture sensing system. When the instructions of the gesture sensing system reach the central control system, the central control system sends them to the game platform through the external instruction system and controls the operation and instructions of the game platform. At the same time, the central control system compares the correctness of the gesture sensing instructions through the camera motion capture system and the node data error correction system.

[0026] S4: The gesture sensing system generates gesture command data. The gesture command data includes: the curvature of the glove joints collected by the joint node curvature system, the rotation angle of the glove collected by the balance sensing system, and the running acceleration of the glove collected by the acceleration sensing system. The gesture command data is processed by the sub-control system and sent to the central control system via the transmission component B system.

[0027] S5: The central control system transmits the processed gesture command data to the game platform through the external instruction system and performs gesture control.

[0028] Compared with the prior art, the present invention has the following beneficial effects:

[0029] 1. Through the camera motion capture system, when the gesture sensing system's instructions reach the central control system, the central control system sends them to the game platform through the external instruction system and controls the operation and instructions of the game platform. At the same time, the central control system compares the correctness of the gesture sensing instructions through the camera motion capture system and the node data error correction system, which facilitates error correction of the data sent by the gesture sensing system, increases correct operability, and improves the operating experience.

[0030] 2. Through the set gesture sensing system, when the gesture sensing system is running, the joint node curvature system transmits the collected curvature of the glove joint position and identifies the coordination between different fingers, such as making a fist and spreading the palm; the balance sensing system collects the rotation angle of the glove as a whole at this time, such as the direction of the palm and back of the hand; the acceleration sensing system collects the running acceleration of the glove itself, for example, when the arm is stretched out to punch, the relative instantaneous movement speed of the glove is faster; the height difference sensing system and the gravity sensing system are used to determine the distance between the glove and the initial position and the two hands, and the gravity sensing system determines the direction, so that the whole system can capture the instructions of various gesture operations.

[0031] 3. Through the light signal programming and control system, the light signal programming and control system controls the indicator light signal system, the breathing light perception system and the gesture light auxiliary system according to the gesture data and operation instructions and other related data collected by the sub-control system, so as to light up the various lamps set on the outside of the accessory gloves. For example, if there is no power or the Bluetooth connection is disconnected, the instruction will be displayed as flashing red or solid yellow. The breathing light is to add beauty to the overall structure and improve the visual experience. The gesture light is lit according to the gesture data, which is convenient for users to distinguish gesture instructions and provide a certain reference for the camera motion capture system to increase accuracy. This solution increases the overall convenience of use and improves the problems of poor operating feel and low accuracy of traditional gesture control, and has a good effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 This is a schematic diagram of the central control system block diagram of the present invention;

[0033] Figure 2 It is a schematic block diagram of the sub-control system of the present invention;

[0034] Figure 3 This is a schematic block diagram of the Bluetooth transmission system of the present invention;

[0035] Figure 4 is a schematic block diagram of a gesture sensing system of the present invention;

[0036] Figure 5 This is a schematic block diagram of the optical signal editing and control system of the present invention. DETAILED DESCRIPTION

[0037] The embodiments of the present invention will be further described below with reference to the accompanying drawings.

[0038] Example:

[0039] like Figure 1-Figure 5 As shown, a gesture-sensing game interactive control system includes a central control system, a sub-control system and a Bluetooth transmission system. The central control system includes an external instruction system, a node preset database system and a camera capture system. The central control system is connected to a node data error correction system, the central control system is connected to a log data storage system, the central control system is connected to a server communication system, the sub-control system includes a gesture sensing system and an accessory power supply system, the sub-control system is connected to an optical signal programming system, the optical signal programming system is connected to an indicator light signal system, the optical signal programming system is connected to a gesture light auxiliary system, the optical signal programming system is connected to a breathing light perception system, the sub-control system is connected to a data node storage system, the Bluetooth transmission system includes a Bluetooth transmission component system and a key conversion system, the Bluetooth transmission component system includes a transmission component A system and a transmission component B system, and the Bluetooth transmission system is connected to a node data cache system.

[0040] In another embodiment, Figure 1-Figure 5 As shown, the camera capture system is connected to the node data error correction system.

[0041] The central control system compares the correctness of gesture sensing instructions through the camera motion capture system and the node data error correction system, which facilitates error correction of the data sent by the gesture sensing system, increases correct operability, and improves the operating experience.

[0042] In another embodiment, Figure 1-Figure 5 As shown, the node preset database system includes a local database system and a cloud database system, and the central control system is connected to the cloud database system through a server communication system.

[0043] The data node storage system performs data communication node storage and gesture sensing system data that needs to be transmitted, and transmits it to the node preset database system. The node preset database system saves the local database to form the user's own usage habits and gesture preset commands, which is convenient for adapting to the game platform. Then, the data is uploaded to the cloud database through the server communication system to save the relevant instructions of the gesture sensing system, so that the system can learn different gesture operations and continuously optimize the operation instructions as big data.

[0044] In another embodiment, Figure 1-Figure 5 As shown, the external instruction system includes an external instruction sending system and an external instruction receiving system.

[0045] The external command system is a necessary system for establishing device communication with the game platform. It can receive and send commands and real-time communication data to facilitate the control of interactive games.

[0046] In another embodiment, Figure 1-Figure 5 As shown, the accessory power supply system is connected to the optical signal programming and control system.

[0047] The accessory power supply system supplies power to the optical signal programming and control system and the sensor group of the external accessory gloves. The optical signal programming and control system controls the indicator light signal system, breathing light perception system and gesture light assistance system respectively according to the gesture data, operation instructions and other relevant data collected by the sub-control system.

[0048] In another embodiment, Figure 1-Figure 5 As shown, the gesture sensing system includes a joint node curvature system, a balance sensing system, an acceleration sensing system, a height difference sensing system and a gravity sensing system.

[0049] The sub-control system is located inside the accessory sensor glove. The core of the sensor glove is composed of multiple sensor components, including joint node curvature, balance sensing, acceleration sensing, height difference sensing and gravity sensing. When the gesture sensing system is running, the joint node curvature system transmits the collected curvature of the glove joint position and identifies the coordination between different fingers, such as making a fist and spreading the palm. The balance sensing system collects the rotation angle of the glove as a whole at this time, such as the direction of the palm and back of the hand. The acceleration sensing system collects the running acceleration of the glove itself. For example, when the arm is stretched out with a fist, the relative instantaneous movement speed of the glove is faster. The height difference sensing system and the gravity sensing system are used to determine the distance between the glove relative to the initial position and the two hands, and the gravity sensing system determines the direction, so that the whole can capture various gesture operation instructions, and the instructions are processed by the sub-control system and sent through the transmission component B system for real-time monitoring.

[0050] In another embodiment, Figure 1-Figure 5 As shown, the transmission component A system is connected to the central control system, and the transmission component B system is connected to the sub-control system.

[0051] The transmission component A system and the transmission component B system respectively establish connection data through Bluetooth communication, realizing gesture control operations through short-range wireless communication, and the Bluetooth transmission system can be set in the computer device and the glove, which is convenient for establishing two key conversion systems and transmitting data through the transmission component A system and the transmission component B system respectively set in the computer device and the glove.

[0052] In another embodiment, Figure 1-Figure 5 As shown, the data node storage system is connected to the transmission component A system and the node preset database system through the transmission component B system.

[0053] The sub-control system transmits the communication node storage and gesture sensing system data stored in the data node storage system to the node preset database system for storage. This storage method reaches the central control system through the transmission component B system and the transmission component A, and is distributed to the node preset database system by the central control system, and is stored in the local database and cloud database respectively by the node preset database system.

[0054] In another embodiment, Figure 1-Figure 5 As shown, the central control system is connected to a drive adapter bearing system.

[0055] The central control system is adapted and installed inside computers, tablet computers and mobile phones through a drive adaptation carrier system. The drive adaptation carrier system facilitates the storage of the entire system as software in the electronic device being used, and makes it adaptable to different electronic devices, facilitating the use of multiple devices and increasing adaptability.

[0056] Example 2

[0057] Based on the game interaction control system of Example 1, this embodiment further provides a game interaction control method using gesture sensing, which includes the following steps:

[0058] S1: First, at the beginning of the interactive control stage of the gesture sensing game, through the sub-control system, the sub-control system is located inside the accessory sensor glove. The internal core of the sensor glove is composed of multiple sensor components such as joint node curvature, balance sensing, acceleration sensing, height difference sensing and gravity sensing. Then, when the user wears it, the central control system drives the adapter carrier system to be adapted and installed inside the computer, tablet computer and mobile phone. Then, the central control system communicates and transmits and receives instructions in real time with the game platform that needs to interact through the external command system, and obtains video reading permissions through the camera motion capture system and the camera hardware of the device. Subsequent control is carried out after the preparation stage.

[0059] S2: Then, when the game platform generates instructions to the central control system through the external instruction system, the central control system will communicate in real time through the transmission component A system into the Bluetooth transmission system. The key conversion system inside the Bluetooth transmission system will encode the communication information to prevent other nearby Bluetooth transmission protocols from affecting the transmission quality during operation. The short-term node data will then be cached in the node data cache system to facilitate the comparison and transmission of instruction information repeatedly obtained in a short period of time and data repeated a large number of times, thereby reducing the communication delay caused by the volatility of Bluetooth transmission between game interactions. The Bluetooth transmission system then sends the information to the sub-control system via the transmission component B system.

[0060] S3: Then, when the sub-control system receives the information, it first stores the data communication node and the gesture sensing system data that needs to be transmitted in the data node storage system, and transmits it to the node preset database system. The node preset database system saves the local database to form the user's own usage habits and gesture preset commands, which is convenient for adapting to the game platform. Then the cloud database saves the relevant instructions of the gesture sensing system, which is convenient for the system to learn different gesture operations and continuously optimize the operation instructions as big data. When the instructions of the gesture sensing system reach the central control system, the central control system is sent to the game platform by the external instruction system, and controls the operation and instructions of the game platform. At the same time, the central control system compares the correctness of the gesture sensing instructions through the camera motion capture system and the node data error correction system, which is convenient for correcting the data sent by the gesture sensing system, increasing the correct operability, and improving the operation experience.

[0061] S4: Secondly, when the gesture sensing system is running, the curvature of the glove joint position collected by the joint node curvature system is transmitted and combined with the recognition of the coordination between different fingers, such as making a fist and spreading the palm; the balance sensing system collects the rotation angle of the glove as a whole at this time, such as the direction of the palm and the back of the hand; the acceleration sensing system collects the running acceleration of the glove itself, for example, when the arm is stretched out to punch, the relative instantaneous movement speed of the glove is faster; the height difference sensing system and the gravity sensing system are used to determine the distance between the glove and the initial position and the two hands, and the direction is determined by the gravity sensing system, so that the whole can capture the instructions of various gesture operations, and the instructions are processed by the sub-control system and sent through the transmission component B system for real-time monitoring.

[0062] S5: Finally, the central control system transmits the gesture data and commands to the game platform through the external instruction system to facilitate gesture control. Then the accessory power supply system supplies power to the light signal programming and control system. The light signal programming and control system controls the indicator light signal system, the breathing light perception system and the gesture light auxiliary system according to the gesture data and operation instructions and other related data collected by the sub-control system, so that they light up various lamps set on the outside of the accessory gloves. For example, if there is no power or the Bluetooth connection is disconnected, the instruction will be displayed as flashing red or solid yellow. The breathing light is to add beauty to the overall structure and to enhance the visual experience. The gesture light is lit according to the gesture data, which is convenient for users to distinguish gesture instructions and provide a certain reference for the camera motion capture system to increase accuracy. This solution increases the overall convenience of use and improves the problems of poor operating feel and low accuracy of traditional gesture control, and has a good effect.

[0063] The above-described embodiments merely represent specific implementations of the present invention. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present invention. It should be noted that a person skilled in the art would be able to make numerous variations and improvements without departing from the spirit of the present invention, and all such variations and improvements fall within the scope of protection of the present invention.

Claims

1. A gesture-sensing game interactive control system, comprising a central control system, a sub-control system, and a Bluetooth transmission system, characterized in that: The central control system includes an external instruction system, a node preset database system and a camera capture system, and the central control system is connected to a node data error correction system, a log data storage system and a server communication system; the sub-control system includes a gesture sensing system and an accessory power supply system, and the sub-control system is connected to a light signal editing and control system and a data node storage system, and the light signal editing and control system is connected to an indicator light signal system, a gesture light auxiliary system and a breathing light perception system; The Bluetooth transmission system includes a Bluetooth transmission component system and a key conversion system. The Bluetooth transmission component system includes a transmission component A system and a transmission component B system. The Bluetooth transmission system is connected to a node data cache system, and the node data cache system is used to cache short-term communication node data. The external instruction system includes an external instruction sending system and an external instruction receiving system, and the external instruction system is used to establish device communication with the game platform, receive and send instructions and real-time communication data; The node preset database system includes a local database system and a cloud database system. The central control system is connected to the cloud database system via a server communication system. The node preset database system is used to save the local database, form the user's own usage habits and gesture preset commands, and adapt to the game platform; The camera capture system is connected to the node data error correction system, and the central control system compares the correctness of the gesture sensing instructions through the camera capture system and the node data error correction system; The accessory power supply system is connected to the light signal programming and control system, which is used to control the indicator light signal system, the breathing light perception system and the gesture light auxiliary system according to the gesture data and operation instructions collected by the sub-control system, so as to light up the lamps arranged on the outside of the accessory glove; The data node storage system is connected to the transmission component A system and the node preset database system through the transmission component B system. The data node storage system is used to store data of the data communication node storage and gesture sensing system; the gesture sensing system includes a joint node curvature system, a balance sensing system, an acceleration sensing system, a height difference sensing system and a gravity sensing system. The joint node curvature system is used to collect the curvature of the glove joint position and identify the coordination between different fingers, the balance sensing system is used to collect the rotation angle of the glove, the acceleration sensing system is used to collect the running acceleration of the glove, the height difference sensing system is used to determine the initial position of the glove and the distance between the two hands, and the gravity sensing system is used to determine the direction. The transmission component A system is connected to the central control system, and the transmission component B system is connected to the sub-control system. The transmission component A system is used to transmit the real-time communication of the central control system to the Bluetooth transmission system; the transmission component B system is used to send information from the Bluetooth transmission system to the sub-control system.

2. The gesture-sensing game interactive control system according to claim 1, characterized in that: The central control system is connected to a drive adaptation bearing system.

3. A gesture-sensing game interactive control method, characterized in that: The control method applies the gesture-sensing game interactive control system according to any one of claims 1-2, and comprises the following steps: S1: At the beginning of the interactive control phase of the gesture-sensing game, after the user puts on the sensor gloves, the central control system adapts to the computer, tablet computer, and mobile phone by driving the adapter carrier system. The central control system communicates with the game platform that needs to interact in real time and transmits and receives commands through the external command system, and obtains video reading permissions through the camera capture system and the device's camera hardware; S2: When the game platform generates an instruction to the central control system through the external instruction system, the central control system will communicate in real time through the transmission component system A to the Bluetooth transmission system. The key conversion system inside the Bluetooth transmission system will encode the communication information and then cache the communication node data in the node data cache system. The Bluetooth transmission system will then send the information to the sub-control system via the transmission component system B. S3: When the sub-control system receives the information, it first stores the data communication node storage and the instructions of the gesture sensing system that need to be transmitted in the data node storage system, and transmits them to the node preset database system. The node preset database system saves them through the local database, and the cloud database saves the instructions of the gesture sensing system. When the instructions of the gesture sensing system reach the central control system, the central control system sends them to the game platform through the external instruction system and controls the operation and instructions of the game platform. At the same time, the central control system compares the correctness of the gesture sensing instructions through the camera capture system and the node data error correction system; S4: The gesture sensing system generates gesture command data. The gesture command data includes: the curvature of the glove joints transmitted and collected by the joint node curvature system, the rotation angle of the glove at that time transmitted by the balance sensing system, and the acceleration of the glove itself transmitted by the acceleration sensing system. The gesture command data is processed by the sub-control system and then sent to the central control system via the transmission component B system. S5: The central control system transmits the processed gesture command data to the game platform through the external instruction system and performs gesture control.

Images