Off-line touch-and-talk and voice evaluation system and touch-and-talk pen

Abstract

The invention belongs to the technical field of point reading, and particularly relates to an offline point reading and voice evaluation system and a point reading pen, and the system is characterized in that the system comprises a loudspeaker used for broadcasting; the micro camera is used for acquiring the invisible two-dimensional code; the offline point reading unit is used for locally completing analysis of the invisible two-dimensional code and playing corresponding audio through a loudspeaker according to an analysis result; a microphone for collecting sound; the voice evaluation unit is used for locally completing analysis according to the sound collected by the microphone so as to carry out evaluation scoring through the loudspeaker; the miniature camera is connected with the offline point reading unit, the microphone is connected with the voice evaluation unit, and the offline point reading unit and the voice evaluation unit are both connected with the loudspeaker. According to the invention, through cooperation of the miniature camera, the offline point reading unit, the microphone and the voice evaluation unit, local operation can be carried out, offline point reading and voice evaluation can be carried out, networking is not needed, and convenient learning and teaching experience can be provided for users.

Description

Technical Field

[0001] The invention belongs to the technical field of point reading, and in particular relates to an off-line point reading and voice evaluation system and a point reading pen. Background Art

[0002] Point reading equipment is a learning aid that can perform functions such as voice playback, point reading, rereading, recording, etc. At present, traditional point reading equipment often requires an Internet connection to use, which limits the use scenarios.

[0003] For example, a previously disclosed voice interactive point reading device (application number CN201810713037.7) includes a point reading pen and a voice dialogue server wirelessly connected to the point reading pen. The user reads the invisible code on the point reading book through the point reading pen, and the corresponding recognition part will enter the active voice dialogue interaction corresponding to the invisible code; when the user enters the dialogue, the point reading pen sends the voice input by the user to the voice dialogue server, and the voice dialogue server performs voice recognition and natural language understanding on the voice file, selects the node information in the corresponding script according to the result of natural language understanding, and returns the parsed node information to the point reading pen. The point reading device needs to be connected to the Internet to be used, which limits the use scenario of the electronic device. Summary of the invention

[0004] In order to solve the above problems, the purpose of the present invention is to provide an offline point reading and voice evaluation system, which provides offline point reading and voice evaluation functions that run locally without the need for an Internet connection, providing users with a convenient learning and teaching experience.

[0005] In order to achieve the above object, the technical solution of the present invention is as follows.

[0006] An offline point reading and voice evaluation system, characterized by comprising:

[0007] A loudspeaker for making announcements;

[0008] A miniature camera for capturing invisible QR codes;

[0009] An offline point-reading unit for locally parsing the invisible QR code and playing the corresponding audio through a speaker according to the parsing result;

[0010] A microphone for collecting sound;

[0011] A voice evaluation unit for locally analyzing the sounds collected by a microphone to evaluate and score the sounds through a speaker;

[0012] The micro camera is connected to the offline point-reading unit, the microphone is connected to the voice evaluation unit, and the offline point-reading unit and the voice evaluation unit are both connected to the speaker.

[0013] In this offline point-reading and voice evaluation system, through the cooperation of a micro camera, an offline point-reading unit, a microphone and a voice evaluation unit, it can run locally to perform offline point-reading and voice evaluation without the need for an Internet connection, thus providing users with a convenient learning and teaching experience.

[0014] Furthermore, the system also includes a shell, and the speaker, micro camera, offline point-reading unit, microphone, and voice evaluation unit are all arranged in the shell.

[0015] Furthermore, the offline point-to-point reading unit includes: a decoding chip, a main control chip, and a storage chip for storing audio files;

[0016] The decoding chip parses the invisible QR code obtained by the micro camera to obtain the coded information in the invisible QR code; the main control chip obtains the audio file corresponding to the coded information from the storage chip according to the coded information obtained by the decoding chip, and controls the microphone to play it.

[0017] Furthermore, when the decoding chip parses the invisible two-dimensional code obtained by the micro camera, it performs denoising and gain on the invisible two-dimensional code image.

[0018] Furthermore, the speech evaluation unit converts the speech signal of the sound collected by the microphone into a digital signal, denoises and amplifies the digital signal, extracts MFCC features and imports the acoustic model to obtain phonetic symbols, and finally scores the phonetic symbols according to the evaluation algorithm and broadcasts them through the speaker.

[0019] Furthermore, the system also includes a power management chip and a lithium battery, the lithium battery is connected to the power management chip, and the power management chip is connected to the micro camera, the offline point-reading unit, the microphone, the speaker, and the voice evaluation unit.

[0020] A point reading pen, characterized in that the offline point reading and voice evaluation system is arranged in the point reading pen.

[0021] In the present invention, through the cooperation of a micro camera, an offline point-reading unit, a microphone and a voice evaluation unit, it can be run locally to perform offline point-reading and voice evaluation without the need for an Internet connection, thereby providing users with a convenient learning and teaching experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 It is a flowchart of offline point reading.

[0023] Figure 2 This is a flow chart of voice evaluation. DETAILED DESCRIPTION

[0024] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0025] This embodiment provides an offline point reading and voice evaluation system, including:

[0026] A loudspeaker for making announcements;

[0027] A miniature camera for capturing invisible QR codes;

[0028] An offline point-reading unit for locally parsing the invisible QR code and playing the corresponding audio through a speaker according to the parsing result;

[0029] A microphone for collecting sound;

[0030] A voice evaluation unit for locally analyzing the sounds collected by a microphone to evaluate and score the sounds through a speaker;

[0031] The micro camera is connected to the offline point-reading unit, the microphone is connected to the voice evaluation unit, and the offline point-reading unit and the voice evaluation unit are both connected to the speaker.

[0032] In this embodiment, the system further includes a housing, and the speaker, micro camera, offline point-reading unit, microphone, and voice evaluation unit are all arranged in the housing.

[0033] In this embodiment, the offline point-to-point reading unit includes: a decoding chip, a main control chip, and a storage chip for storing audio files;

[0034] The decoding chip parses the invisible QR code obtained by the micro camera to obtain the coded information in the invisible QR code; the main control chip obtains the audio file corresponding to the coded information from the storage chip according to the coded information obtained by the decoding chip, and controls the microphone to play it.

[0035] In this embodiment, when the decoding chip analyzes the invisible two-dimensional code acquired by the micro camera, it performs denoising and gain on the invisible two-dimensional code image.

[0036] In this embodiment, the speech evaluation unit converts the speech signal of the sound collected by the microphone into a digital signal, denoises and amplifies the digital signal, extracts MFCC features and imports the acoustic model to obtain phonetic symbols, and finally scores the phonetic symbols according to the evaluation algorithm and broadcasts them through the speaker.

[0037] In this embodiment, the system also includes a power management chip and a lithium battery. The lithium battery is connected to the power management chip, and the power management chip is connected to the micro camera, the offline point-reading unit, the microphone, the speaker, and the voice evaluation unit.

[0038] This embodiment also provides a point reading pen, in which the offline point reading and voice evaluation system is arranged.

[0039] Specifically, the point reading pen integrates point reading and voice evaluation functions, which can help users improve language learning efficiency. It can also be operated in a network-free environment and is suitable for a variety of occasions. And through invisible QR code technology, the accuracy of point reading and user experience are improved.

[0040] The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. An offline point reading and voice evaluation system, characterized in that: Included are: A loudspeaker for making announcements; A tiny camera for capturing invisible QR codes; An offline point-reading unit for locally parsing the invisible QR code and playing the corresponding audio through a speaker according to the parsing result; A microphone for collecting sound; A voice evaluation unit for locally analyzing the sounds collected by a microphone to evaluate and score the sounds through a speaker; The micro camera is connected to the offline point-reading unit, the microphone is connected to the voice evaluation unit, and the offline point-reading unit and the voice evaluation unit are both connected to the speaker.

2. The off-line point reading and voice evaluation system according to claim 1, characterized in that: The system also includes a shell, and the loudspeaker, micro camera, offline point-reading unit, microphone, and voice evaluation unit are all arranged in the shell.

3. The off-line point reading and voice evaluation system according to claim 1, characterized in that: The offline point-to-point reading unit package includes: a decoding chip, a main control chip, and a storage chip for storing audio files; The decoding chip analyzes the invisible QR code obtained by the micro camera to obtain the encoded information in the invisible QR code; The main control chip obtains the audio file corresponding to the coding information from the storage chip according to the coding information obtained by the decoding chip, and controls the microphone to play.

4. The off-line point reading and voice evaluation system according to claim 3 is characterized in that: When the decoding chip analyzes the invisible two-dimensional code obtained by the micro camera, it performs denoising and gain on the invisible two-dimensional code image.

5. The off-line point reading and voice evaluation system according to claim 1 is characterized in that: The speech evaluation unit converts the speech signal of the sound collected by the microphone into a digital signal, denoises and amplifies the digital signal, extracts MFCC features and imports the acoustic model to obtain phonetic symbols, and finally scores the phonetic symbols according to the evaluation algorithm and broadcasts them through the speaker.

6. The off-line point reading and voice evaluation system according to claim 1, characterized in that: The system also includes a power management chip and a lithium battery. The lithium battery is connected to the power management chip, and the power management chip is connected to a micro camera, an offline point-reading unit, a microphone, a speaker, and a voice evaluation unit.

7. A point reading pen, characterized in that: The reading pen is provided with the offline reading and voice evaluation system as described in any one of claims 1 to 6.

Images