Wireless sound control gesture intelligent page turning pen method

Abstract

The invention discloses a wireless sound control gesture intelligent page-turning pen method, which comprises the following operation steps of: inserting a receiver of a page-turning pen into a USB (Universal Serial Bus) port of a computer, and pressing a switch key to start the page-turning pen; finger information is shot through an LED light source of the visual module, three-dimensional action information of fingers is obtained, the three-dimensional action information is compared with gesture information set in the system, and gesture recognition is carried out. The page turning pen slides on the six-axis gyroscope on the page turning pen, and the main control IC judges the corresponding sliding action by reading and writing six-axis data of the six-axis gyroscope; the voice recognition module receives a voice command and performs voice recognition, recognition information is transmitted to the main control IC, and the main control IC receives the voice command; the key is pressed, the key pressing frequency and the key pressing position of the key are judged through the main control IC, and corresponding key pressing data are given; laser emission is controlled through the master control IC, the battery transmits data to the master control IC through the booster circuit, data are received through the receiver, and instructions are executed on the computer. According to the method and the system, the software such as PPT can be quickly managed.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent page-turning pens, and specifically to a method for a wireless voice-controlled gesture intelligent page-turning pen. Background Art

[0002] A page-turning pen, also known as an electronic pointer, is a new type of electronic product specifically designed for computers and multimedia projectors. It has been widely used in developed countries such as Europe and the United States. In addition to the mapping function of a traditional laser pointer, it can also directly remotely control a computer or a multimedia projection device wirelessly by simply pressing the up and down page-turning buttons on the laser pen to achieve free page-turning and random presentation of slides, which is very convenient.

[0003] Page-turning pens are usually applied in public occasions such as teaching and meetings, and are used in conjunction with large screens, projectors, and computers. In addition to emitting a bright laser dot to indicate and prompt the terminal, etc., page-turning pens can also turn the pages forward and backward of a currently playing PPT presentation or speech script.

[0004] Currently, traditional page-turning pens are increasingly unable to meet the requirements of modern multimedia e-teaching. Traditional page-turning pens can only achieve page-turning control functions through button presses and contact gesture recognition. Contact gesture recognition requires contact with the hand bones and is prone to contact failure problems. With the development of technology, more functions are required when using page-turning pens.

[0005] Therefore, a method for a wireless voice-controlled gesture intelligent page-turning pen is proposed for the above problems. Summary of the Invention

[0006] The purpose of the present invention is to provide a method for a wireless voice-controlled gesture intelligent page-turning pen, and the operation steps include: Step 1: Insert the receiver of the page-turning pen into the USB port of the computer, and press the switch button to start the page-turning pen; Step 2: Visual gesture recognition: The LED light source of the visual module takes pictures of finger information, transmits the captured information to the main control IC, the main control IC identifies the finger area, obtains the three-dimensional motion information of the finger, and compares it with the gesture information set in the system for gesture recognition; Step 3: Sliding induction recognition: Slide on the six-axis gyroscope on the page-turning pen, and the main control IC judges the corresponding sliding action by reading and writing the six-axis data of the six-axis gyroscope; Step 3: Voice recognition: Receive voice commands through the voice recognition module and perform voice recognition, and transmit the recognized information to the main control IC, and the main control IC receives the voice command; Step 4: Button recognition: Press the button, and the main control IC judges the number of button presses and the button position of the button, and gives the corresponding button data; Step 5: After obtaining the corresponding operation instructions through Steps 2 to 4, control the laser emission through the main control IC. Meanwhile, the battery is transmitted to the main control IC through a boost circuit, and the data is transmitted through the 2.4 frequency carrier by the transmitter. The data is received by the receiver, and the corresponding instructions are executed on the computer.

[0007] Preferably, the operation steps further include the setting of a timer. The timing time of the timer is set through a button, and it is judged whether to enter the sleep state after the timing time is reached.

[0008] Preferably, the six-axis data of the six-axis gyroscope in Step 2 includes the data of the X-axis, Y-axis, Z-axis, RX-axis, RY-axis, and RZ-axis, and the six-axis gyroscope can measure the angular velocity and angular displacement of an object in real time to maintain the accuracy and stability of the six-axis gyroscope.

[0009] Preferably, the specific operation steps of Step 2 are to convert the angular velocity into a rotation vector using Euler's formula or quaternion formula, determine the gravity vector using the data of the accelerometer and other sensors, and calculate the attitude angle of the entity in space using the rotation vector and the gravity vector.

[0010] Preferably, when transmitting data in Step 5, the frequency of the radio frequency signal is adjusted by a 16m crystal oscillator capacitor to ensure the stability and accuracy of the signal.

[0011] Compared with the prior art, the beneficial effects of the present invention are as follows: 1. The present invention can perform visual gesture recognition. The LED light source of the visual module captures the information of the finger, transmits the captured information to the main control IC, and the main control IC identifies the finger area and obtains the three-dimensional motion information of the finger, and compares it with the gesture information set in the system to perform gesture recognition, which is different from the traditional contact gesture recognition and solves the problem that contact gesture recognition needs to contact the hand bones and is prone to contact failure.

[0012] 2. The present invention can perform speech recognition. The speech recognition module receives the voice command and performs speech recognition, and the recognized information is transmitted to the main control IC. The main control IC receives the voice command and issues a command through radio frequency technology. Then the receiver receives the command and uploads it to the computer through USB to realize the quick management of software such as PPT. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] FIG. 1 is a schematic diagram of the system structure of the present invention.

[0014] FIG. 2 is a schematic diagram of the method steps of the present invention. EMBODIMENT

[0015] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0016] As shown in the Figure 1 accompanying drawings, the system of the present invention includes a main control IC, a transmitter, a battery, a vision module, a six-axis gyroscope, a button, a laser, a voice recognition module, a 16m crystal oscillator capacitor, and a receiver. The main control IC is respectively connected to the battery, the vision module, the six-axis gyroscope, the button, the laser, and the voice recognition module. The main control IC is also connected to the battery through a boost circuit. The transmitter is connected to the receiver, and the receiver is inserted into the USB socket of the computer.

[0017] As shown in the Figure 2 accompanying drawings, a wireless voice-controlled gesture intelligent page-turning pen method provided by the present invention includes the following operation steps: Step 1: Insert the receiver of the page-turning pen into the USB port of the computer and press the switch button to start the page-turning pen. Step 2: Visual gesture recognition: The LED light source of the vision module captures the information of the finger, transmits the captured information to the main control IC. The main control IC identifies the finger area, obtains the three-dimensional motion information of the finger, compares it with the gesture information set in the system, and performs gesture recognition. Step 3: Sliding induction recognition: Slide on the six-axis gyroscope of the page-turning pen. The main control IC reads and writes the six-axis data of the six-axis gyroscope. The six-axis data of the six-axis gyroscope includes the data of the X-axis, Y-axis, Z-axis, RX-axis, RY-axis, and RZ-axis. The six-axis gyroscope can measure the angular velocity and angular displacement of an object in real time. Use Euler's formula or quaternion formula to convert the angular velocity into a rotation vector, and use the data of the accelerometer and other sensors to determine the gravity vector. Use the rotation vector and gravity vector to calculate the attitude angle of the entity in space and judge the corresponding sliding action. Step 3: Voice recognition: Receive a voice command through the voice recognition module and perform voice recognition. The recognized information is transmitted to the main control IC, and the main control IC receives the voice command. Step 4: Button recognition: Press the button. The main control IC judges the number of button presses and the button position of the button, and gives the corresponding button data, including the setting of the timer. Set the timing time by pressing the button, and judge whether to enter the sleep state after the timing time arrives. Step 5: After obtaining the corresponding operation instructions through Steps 2 to 4, control the laser emission through the main control IC. At the same time, the battery is transmitted to the main control IC through the boost circuit, and the data is transmitted through the transmitter by emitting a 2.4 frequency carrier wave, and the data is received through the receiver, and the corresponding instructions are executed on the computer.

[0018] Specifically, the measurable range of the six-axis gyroscope is ±250, ±500, ±1000° / second (dps), and the measurable range of the accelerometer is ±2, ±4, ±8g.

[0019] Preferably, when performing data transmission in Step 5, the frequency of the radio frequency signal is adjusted by a 16m crystal oscillator capacitor to ensure the stability and accuracy of the signal. Embodiment

[0020] Perform left and right page turning, and set the timing time to 40 minutes: Step 1: Insert the receiver of the page turning pen into the USB port of the computer, and press the switch button to start the page turning pen; Step 2: Visual gesture recognition: Make a left or right swipe page turning action with your finger. The LED light source of the visual module takes pictures of the finger information, transmits the captured information to the main control IC, and the main control IC identifies the finger area, obtains the three-dimensional motion information of the finger, and compares it with the gesture information set in the system to determine whether it is a left page turn or a right page turn, and perform gesture recognition; Step 3: Sliding induction recognition: Slide on the six-axis gyroscope on the page turning pen to make a page turning action. The main control IC reads and writes the six-axis data of the six-axis gyroscope. The six-axis data of the six-axis gyroscope includes the data of the X-axis, Y-axis, Z-axis, RX-axis, RY-axis, and RZ-axis. The six-axis gyroscope can measure the angular velocity and angular displacement of an object in real time. Use Euler's formula or quaternion formula to convert the angular velocity into a rotation vector, and use the data of the accelerometer and other sensors to determine the gravity vector, and calculate the attitude angle of the entity in space using the rotation vector and the gravity vector to determine the corresponding sliding action as a page turning action; Step 3: Voice recognition: Issue a page turning voice command, receive the voice command through the voice recognition module and perform voice recognition, and transmit the recognition information to the main control IC, and the main control IC receives the voice command; Step 4: Button recognition: Press the button, and the main control IC judges the number of button presses and the button position of the button, and gives the corresponding button data, including the setting of the timer. Set the timing time to 40 minutes through the button, and judge whether to enter the sleep state after 40 minutes; Step 5: After obtaining the corresponding operation instructions through Steps 2 to 4, control the laser emission through the main control IC. At the same time, the battery is transmitted to the main control IC through the boost circuit, and the data is transmitted through the transmitter by emitting a 2.4 frequency carrier wave, and the data is received through the receiver, and the corresponding instructions are executed on the computer.

[0021] Any technical solution using the technical solution of the present invention or designed by those skilled in the art inspired by the technical solution of the present invention and achieving the above technical effects shall fall within the protection scope of the present invention.

Claims

1. A method for a wireless voice-controlled gesture intelligent page-turning pen, Characterized in that: The operation steps include: Step 1: Insert the receiver of the page-turning pen into the USB port of the computer and press the switch button to start the page-turning pen; Step 2: Visual gesture recognition: The LED light source of the visual module takes pictures of the finger information, transmits the captured information to the main control IC, the main control IC identifies the finger area, obtains the three-dimensional motion information of the finger, and compares it with the gesture information set in the system for gesture recognition; Step 3: Sliding induction recognition: Slide on the six-axis gyroscope on the page-turning pen, and the main control IC judges the corresponding sliding action by reading and writing the six-axis data of the six-axis gyroscope; Step 3: Voice recognition: Receive voice commands through the voice recognition module and perform voice recognition, and the recognition information is transmitted to the main control IC, and the main control IC receives the voice command; Step 4: Button recognition: Press the button, and the main control IC judges the number of button presses and the button position of the button to give the corresponding button data; Step 5: After obtaining the corresponding operation instructions in Steps 2 to 4, control the laser emission through the main control IC. At the same time, the battery is transmitted to the main control IC through the boost circuit, and the 2.4 frequency carrier is transmitted through the transmitter to transmit data, and the data is received through the receiver, and the corresponding instructions are executed on the computer.

2. A method for a wireless voice-controlled gesture intelligent page-turning pen according to claim 1, Characterized in that: The operation steps further include the setting of a timer. The timing time of the timer is set through the button, and it is judged whether to enter the sleep state after the timing time is reached.

3. A method for a wireless voice-controlled gesture intelligent page-turning pen according to claim 1, Characterized in that: The six-axis data of the six-axis gyroscope in Step 2 include the data of the X-axis, Y-axis, Z-axis, RX-axis, RY-axis, and RZ-axis, and the six-axis gyroscope can measure the angular velocity and angular displacement of the object in real time to maintain the accuracy and stability of the six-axis gyroscope.

4. A method for a wireless voice-controlled gesture intelligent page-turning pen according to claim 1, Characterized in that: The specific operation steps of Step 2 are to convert the angular velocity into a rotation vector using Euler's formula or quaternion formula, determine the gravity vector using the data of the accelerometer and other sensors, and calculate the attitude angle of the entity in space using the rotation vector and the gravity vector.

5. A method for a wireless voice-controlled gesture intelligent page-turning pen according to claim 1, Characterized in that: When performing data transmission in Step 5, the frequency of the radio frequency signal is adjusted by a 16m crystal oscillator capacitor to ensure the stability and accuracy of the signal.

Images