Interaction method between page turning pen and PC (Personal Computer) terminal

Through the interaction method between the page turner and the PC, the transmitter collects gestures and voice data, the precise movement of the mouse cursor and a variety of operation instructions are achieved, solving the problem that the teacher cannot move freely during the demonstration process, and improving the teaching effect and interactivity.

CN119645238APending Publication Date: 2025-03-18GUANGZHOU SHANGCHEN ELECTRONIC
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202411601805.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-11
Publication Date
2025-03-18

AI Technical Summary

Technical Problem

In the multimedia projection classroom, teachers cannot move freely during the demonstration process, resulting in poor teaching results, and the existing page turner technology cannot perform voice command operations and screen writing.

Method used

Through an interactive method between the page turning pen and the PC terminal, the transmitter collects gesture action data and voice commands, and realizes the precise movement of the mouse cursor, the definition of action commands, the execution of voice commands, time reminders and document recording and downloading.

Benefits of technology

It realizes the teaching demonstration of teachers moving freely in the classroom, improves the teaching effect, and enhances the interactive and convenient teaching through voice commands and drawing board writing functions.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention relates to the technical field of page turning pens, and discloses an interaction method between a page turning pen and a PC (Personal Computer) terminal, which comprises the following steps: S1, obtaining a cursor position; s2, action instruction definition; s3, voice instruction definition; s4, setting time management; and S5, recording and downloading the document. According to the invention, mouse cursors in different modes can be accurately moved to set positions on a display screen through the emitter; specific content in a document can be specified through action instruction definition, voice playing or drawing board writing can be carried out, voice prompting can be carried out through the player, and therefore it is guaranteed that teaching speech is carried out smoothly, and teaching speech accidents are avoided; characters and graphs can be written on a demonstrated document or a display screen through a drawing board writing instruction; and the whole document content and the voice content can be recorded in the whole course, and the lecture including the image-text and the corresponding voice can be automatically generated, so that the student audience can conveniently scan the code to watch and download the document content after the teaching speech is finished.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of wireless presenters, and in particular to an interaction method between a wireless presenter and a PC. Background Art

[0002] At present, more and more colleges and universities are equipped with and using multimedia projection classrooms. Because of its rich images, sounds and texts, it is deeply loved by schools and students. However, its use also exposes a problem. In order to control the progress of the demonstration, the teacher must personally use the keyboard or mouse to operate the computer at close range. Therefore, during the demonstration, the teacher can only move in a small area near the computer, or even sit next to the computer. This not only limits the teacher's own activity space, but also increases the distance between the teacher and the students, making the originally vivid multimedia demonstration boring; the emergence of the page turning pen allows teachers to completely get rid of the constraints of space; through the interaction between the page turning pen and the PC, the teacher can walk around in the classroom during the entire teaching process, improving the teaching demonstration effect.

[0003] A Chinese patent discloses an interaction method between a multifunctional wireless presenter and a host end (publication number CN114546134A). In this patented technology, a main control module receives voice information collected by a microphone and performs voice recognition, generates control instructions and transmits them to a wireless communication module. Keywords include local magnification, focusing and laser, and control instructions include image local magnification instructions, image focusing instructions and laser point indication instructions; receives motion data collected by a six-axis gyroscope sensor and obtains corresponding angular velocity based on it, converts the angular velocity into coordinate data according to a preset ratio after calculation and processing, and transmits it to the wireless communication module to send the obtained control instructions and / or coordinate data to the receiver; the host end performs image display control according to the obtained control instructions and / or coordinate data transmitted by the receiver, but it cannot remind the operator of the content of the teaching speech, and cannot use different voice commands for operation, and it is inconvenient to write on the display screen. Summary of the invention

[0004] The purpose of the present invention is to provide an interaction method between a wireless presenter and a PC to solve the problems raised in the above-mentioned background technology.

[0005] To achieve the above object, the present invention provides the following technical solutions:

[0006] A method for interaction between a wireless presenter and a PC, comprising the following steps:

[0007] S1. Cursor position acquisition: The operator's gesture data is collected through a handheld transmitter, and the gesture data is received through a receiver inserted into the USB interface of the PC, its direction and displacement are identified, and the mouse cursor is moved to the set position on the display screen;

[0008] S2. Action command definition: Switch the mouse cursor mode through the handheld transmitter, and give corresponding action commands to the transmitter as needed. The transmitter senses the operator's actions and sends them to the receiver connected to the PC. The PC processes the received data and defines different actions as corresponding commands.

[0009] S3. Voice command definition: give corresponding voice commands to the transmitter as needed. The transmitter senses the operator's voice and sends it to the receiver connected to the PC. The PC processes the received data and defines different voices as corresponding commands.

[0010] S4. Time management settings: Set the time reminder mode on the PC side and set the time interval to remind the operator;

[0011] S5. Document recording and downloading: Before the document presentation, set the recording mode on the PC to record the entire document content and voice content. After the entire document content is presented, a handout containing pictures, texts and corresponding voices will be automatically generated and shared in the form of a QR code.

[0012] As a further solution of the present invention: in the step S1, the transmitter includes a motion sensing button, a light transmitter, a three-axis acceleration sensor, a three-axis gyroscope, a single-chip microcomputer, a player and a microphone, and the acquired gesture motion data includes three-axis acceleration and three-axis angular velocity.

[0013] As a further solution of the present invention: in the step S1, the mouse cursor mode includes a physical cursor mode and a digital cursor mode, the physical cursor mode includes a physical laser cursor, a physical spotlight beacon and a physical red dot cursor, and the digital cursor mode includes a digital laser cursor, a digital spotlight beacon and a digital red dot cursor; wherein, in the physical cursor mode, light emitted by the transmitter is irradiated onto the display screen, and the corresponding laser, spotlight and red dot are displayed from the outside of the display screen; and the digital laser mode displays the corresponding laser, spotlight and red dot from the inside of the display screen.

[0014] As a further solution of the present invention: in the step S2, the action instruction also includes specifying specific content in the document, and dragging, selecting, copying, pasting, and enlarging, bolding, circling and marking text and pictures on the specific content.

[0015] As a further solution of the present invention: in the step S2, the action instruction also includes voice playback. When editing a document, the corresponding text or picture in the document is annotated and hidden, the mouse cursor is used to specify specific content, and after the voice playback action is performed, the corresponding annotation content is played through the player.

[0016] As a further solution of the present invention: in the S2 step, the action instruction also includes drawing board writing. After the operator performs the drawing board writing action, text and graphics are written on the demonstration document or display screen; the writing method includes touch screen writing method and shortcut writing method. Among them, the touch screen writing method uses a touch screen as the display screen of the PC end, and writes directly on the touch screen of the PC end with a finger or the end of the transmitter; when using the shortcut writing method, the mouse cursor is moved to the display screen, and the writing action is directly performed in the air.

[0017] As a further solution of the present invention: in the step S3, the voice instructions include receiving voice instructions and interactive voice instructions, wherein the interactive voice instructions are used to wake up the instructions on the voice recognition menu, and the receiving voice instructions are used to obtain unknown voice instructions.

[0018] Compared with the prior art, the present invention has the following beneficial effects:

[0019] The present invention can accurately move the mouse cursor of different modes to the set position on the display screen through the transmitter; through the definition of action instructions, specific content in the document can be specified, voice playback or drawing board writing can be performed, and voice prompts can be given through the player, thereby ensuring that the teaching speech proceeds smoothly without causing teaching speech accidents; through the drawing board writing instructions, text and graphics can be written on the demonstration document or display screen; and the entire document content and voice content can be fully recorded, and handouts containing pictures, texts and corresponding voices can be automatically generated, so that students and listeners can scan the code to view and download the document content after the teaching speech. DETAILED DESCRIPTION

[0020] In an embodiment of the present invention, a method for interaction between a wireless presenter and a PC includes the following steps:

[0021] S1. Cursor position acquisition: The operator's gesture data is collected through a handheld transmitter, and the gesture data is received through a receiver inserted into the USB interface of the PC, its direction and displacement are identified, and the mouse cursor is moved to the set position on the display screen;

[0022] S2. Action command definition: Switch the mouse cursor mode through the handheld transmitter, and give corresponding action commands to the transmitter as needed, such as single-clicking or double-clicking the corresponding action sensing button. The transmitter senses the operator's action and sends it to the receiver connected to the PC, and the PC processes the received data; define different actions as corresponding commands, such as turning pages, forward, back, and window switching for PPT, Word, WPS, Adobe Acrobat, and other electronic documents during teaching presentations through different actions;

[0023] S3. Voice command definition: give corresponding voice commands to the transmitter as needed. The transmitter senses the operator's voice and sends it to the receiver connected to the PC. The PC processes the received data and defines different voices as corresponding commands.

[0024] S4. Time management settings: Set the time reminder mode on the PC side and set the time interval to remind the operator. For example, set a reminder 3 minutes or 5 minutes before the end of the get out of class or speech. When the corresponding time point is reached, the transmitter in the hand will receive a vibration reminder, so that the operator can control the rhythm of the teaching speech. Flashing can also be used to remind;

[0025] S5. Document recording and downloading: Before the document presentation, set the recording mode on the PC to record the entire document content and voice content. After the entire document content is presented, a handout containing pictures, texts and corresponding voices is automatically generated and shared in the form of a QR code, so that students and audience can scan the code to view and download the document content after the teaching speech.

[0026] Preferably, in step S1, the transmitter includes a motion sensing button, a light transmitter, a three-axis acceleration sensor, a three-axis gyroscope, a single-chip microcomputer, a player and a microphone, and the acquired gesture motion data includes three-axis acceleration and three-axis angular velocity.

[0027] Preferably, in step S1, the mouse cursor mode includes a physical cursor mode and a digital cursor mode, the physical cursor mode includes a physical laser cursor, a physical spotlight beacon and a physical red dot cursor, and the digital cursor mode includes a digital laser cursor, a digital spotlight beacon and a digital red dot cursor; wherein, in the physical cursor mode, light emitted by a transmitter is irradiated onto the display screen, and the corresponding laser, spotlight and red dot are displayed from the outside of the display screen; the digital laser mode displays the corresponding laser, spotlight and red dot from the inside of the display screen; for a projection screen, the physical cursor mode is preferred, and for an LCD screen, since the transparent screen surface reflects external light, the digital cursor mode is preferred.

[0028] Preferably, in step S2, the action instructions also include specifying specific content within the document, and dragging, selecting, copying, pasting, and enlarging, bolding, circling, and marking the specific content, so as to make it more eye-catching and highlight the key content, so as to facilitate the audience's understanding and deepen their memory, so as to obtain the best teaching speech effect.

[0029] Preferably, in step S2, the action instruction also includes voice playback. When editing a document, the corresponding text or picture in the document is annotated and hidden, that is, the annotated part is not displayed on the corresponding display screen. The mouse cursor is used to specify specific content, and after the voice playback action is performed, the corresponding annotation content is played through the player; the operator can receive the corresponding sound after being equipped with wireless headphones. Since the content displayed in the document is very limited, when the explanation corresponding to the content displayed in the document is forgotten during a teaching speech, a prompt can be given through the player, thereby ensuring that the teaching speech proceeds smoothly without causing teaching speech accidents.

[0030] Preferably, in step S2, the action instructions also include drawing board writing. After the operator performs the drawing board writing action, text and graphics are written on the demonstration document or display screen; the writing methods include touch screen writing method and shortcut writing method, wherein the display screen of the PC end adopted by the touch screen writing method is a touch screen, and the finger or the end of the transmitter is used to write directly on the touch screen of the PC end; when using the shortcut writing method, the mouse cursor is moved to the display screen, and the writing action is made directly in the air; at the same time, the written content can be cleared, and the color and size of the font can be adjusted.

[0031] Preferably, the voice commands include receiving voice commands and interactive voice commands, wherein the interactive voice commands are used to wake up the commands on the voice recognition menu; for example, if voice is needed to operate the PC, such as playing or ending a slide show, playing a slide show from the beginning or from a certain page, fast forward and rewind a video, adjust the volume, open a file explorer, open a custom web page, switch annotation lines, and switch mouse cursor mode;

[0032] Receiving voice commands are used to obtain unknown voice commands. For example, if you need to display the operator's speech on the display screen, click the recording button, collect the operator's voice through the microphone, and convert the audio data into corresponding text characters. For example, according to needs, the received Chinese voice can be converted into Chinese, English or Japanese text. For example, in the on-site interactive session, when information that is not on the document or knowledge that the operator does not understand appears, the web page data on the PC can be captured through voice to obtain data.

[0033] The above are only preferred specific implementation modes of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can make equivalent replacements or changes according to the technical solutions and inventive concepts of the present invention within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.

Claims

1. A method for interaction between a wireless presenter and a PC, characterized in that: The following steps are involved: S1. Cursor position acquisition: The operator's gesture data is collected through a handheld transmitter, and the gesture data is received through a receiver inserted into the USB interface of the PC, its direction and displacement are identified, and the mouse cursor is moved to the set position on the display screen; S2. Action command definition: Switch the mouse cursor mode through the handheld transmitter, and give corresponding action commands to the transmitter as needed. The transmitter senses the operator's actions and sends them to the receiver connected to the PC. The PC processes the received data and defines different actions as corresponding commands. S3, voice command definition: give corresponding voice commands to the transmitter as needed, the transmitter perceives the operator's voice and sends it to the receiver connected to the PC, and the PC processes the received data; And define different voices as corresponding instructions; S4. Time management settings: Set the time reminder mode on the PC side and set the time interval to remind the operator; S5. Document recording and downloading: Before the document presentation, set the recording mode on the PC to record the entire document content and voice content. After the entire document content is presented, a handout containing pictures, texts and corresponding voices will be automatically generated and shared in the form of a QR code.

2. The method for interaction between a wireless presenter and a PC according to claim 1, characterized in that: In the step S1, the transmitter includes a motion sensing button, a light transmitter, a three-axis acceleration sensor, a three-axis gyroscope, a single-chip microcomputer, a player and a microphone, and the acquired gesture motion data includes three-axis acceleration and three-axis angular velocity.

3. The method for interaction between a wireless presenter and a PC according to claim 1, characterized in that: In the S1 step, the modes of the mouse cursor include a physical cursor mode and a digital cursor mode. The physical cursor mode includes a physical laser cursor, a physical spotlight beacon and a physical red dot cursor. The digital cursor mode includes a digital laser cursor, a digital spotlight beacon and a digital red dot cursor. In the physical cursor mode, the light emitted by the transmitter is irradiated onto the display screen, and the corresponding laser, spotlight and red dot are displayed from the outside of the display screen; the digital laser mode displays the corresponding laser, spotlight and red dot from the inside of the display screen.

4. The method for interaction between a wireless presenter and a PC according to claim 1, characterized in that: In the step S2, the action instruction also includes specifying specific content in the document, and dragging, selecting, copying, pasting, and enlarging, bolding, circling, and marking text and images on the specific content.

5. The method for interaction between a wireless presenter and a PC according to claim 1, characterized in that: In the step S2, the action instruction also includes voice playback. When editing a document, the corresponding text or picture in the document is annotated and hidden, the mouse cursor is used to specify specific content, and after the voice playback action is performed, the corresponding annotation content is played through the player.

6. The method for interaction between a wireless presenter and a PC according to claim 1, characterized in that: In the S2 step, the action instructions also include drawing board writing. After the operator performs the drawing board writing action, text and graphics are written on the demonstration document or display screen; the writing methods include touch screen writing method and shortcut writing method. Among them, the touch screen writing method uses a touch screen as the display screen of the PC end, and writes directly on the touch screen of the PC end with a finger or the end of the transmitter; when using the shortcut writing method, move the mouse cursor to the display screen and make a writing action directly in the air.

7. The method for interaction between a wireless presenter and a PC according to claim 1, characterized in that: In the step S3, the voice instructions include receiving voice instructions and interactive voice instructions, wherein the interactive voice instructions are used to wake up the instructions on the voice recognition menu, and the receiving voice instructions are used to obtain unknown voice instructions.

Citation Information

Patent Citations

  • Interaction system and method for multifunctional page turning pen and host end

    CN114546134A