A voice keyboard with a separate microphone

Abstract

The present invention relates to a voice keyboard, in particular to a voice keyboard with a separate microphone, comprising a host and a slave, wherein the host comprises a central control module, a host communication module and a host power management module, and the slave comprises a slave communication module, a slave power management module and an audio acquisition module; according to actual needs and obvious defect analysis, a set of dual-architecture system frameworks based on UART and BLE dual communication mechanisms and constructed according to the master-slave communication principles is summarized, and combined with audio acquisition, host control, etc., a complete set of master-slave dual-architecture technical implementation routes is provided; the technical solution provided by the present invention can effectively overcome the defects of the prior art that the normal sound pickup distance is greatly limited and the identity authentication mechanism between the microphone and the keyboard has poor security.

Description

Technical Field

[0001] The invention relates to a voice keyboard, in particular to a voice keyboard carrying a separate microphone. Background Art

[0002] A keyboard is a device for inputting instructions and data to operate computer equipment. It also refers to a group of function keys (such as a typewriter or computer keyboard) that are arranged by the system to operate a machine or device.

[0003] The keyboard is the most commonly used and most important input device. Through the keyboard, Chinese characters, English letters, numbers, punctuation marks, etc. can be input into the computer, so that commands can be issued to the computer, data can be input, etc. As time goes by, various independent products with shortcut functions have gradually appeared on the market, and they come with dedicated drivers and setting software, which can also realize personalized operations on compatible computers.

[0004] At present, voice keyboards on the market usually have a built-in microphone and independent voice software. The audio content collected by the microphone is transcribed into text through a recognition engine. This is the workflow of mainstream intelligent voice keyboards on the market. However, due to the size, weight and usage conditions of the keyboard itself, the normal sound pickup distance is greatly limited, especially in some conference occasions, which cannot meet the needs of users. Summary of the invention

[0005] 1. Technical issues to be solved

[0006] In view of the above-mentioned shortcomings of the prior art, the present invention provides a voice keyboard with a separate microphone, which can effectively overcome the defects of the prior art that the normal sound pickup distance is greatly limited and the security of the identity authentication mechanism between the microphone and the keyboard is poor.

[0007] (II) Technical solution

[0008] To achieve the above objectives, the present invention is implemented through the following technical solutions:

[0009] A voice keyboard with a separate microphone, comprising a host and a slave, wherein the host comprises a central control module, a host communication module and a host power management module, and the slave comprises a slave communication module, a slave power management module and an audio acquisition module;

[0010] The central control module receives the operation information of each submodule in the host and sends work instructions to each submodule, determines the current position of the slave based on the slave charging status, and controls the working status of the audio acquisition module by sending instructions to the slave communication module;

[0011] The host communication module is used to establish communication connections between the host and the slave, and between the host and the host computer, and upload the audio data to the host computer for audio analysis;

[0012] Host power management module, used to automatically switch power supply modes and monitor host battery power;

[0013] The slave communication module is used to establish a communication connection between the slave and the host, receive the audio data sent by the audio acquisition module and upload it to the host;

[0014] The slave power management module monitors the slave charging status and the slave battery power;

[0015] The audio acquisition module, under the premise of host scheduling, collects audio data through the microphone under the control of the slave button, and sends the collected audio data to the slave communication module.

[0016] Preferably, when the central control module determines that the slave is currently located in the charging compartment based on the charging status of the slave, the slave is awakened by one of the following methods: pressing a button on the slave, sending a start command from the host, or stopping charging by leaving the compartment.

[0017] Preferably, when the central control module determines that the slave is currently outside the charging compartment based on the charging status of the slave, the slave communication module starts the BLE broadcast, and after the host detects the BLE broadcast, it establishes a BLE connection with the slave communication module and sends a start instruction to the slave communication module.

[0018] Preferably, after the slave communication module receives the start instruction, the audio acquisition module enters the working state and detects whether there is a key action on the slave key;

[0019] If the slave button is pressed, the slave sends a button press command to the host, and the host sends an enable command to the slave communication module to enable the audio acquisition module. The slave starts to check the working status of the microphone, and sends a feedback command code to the host according to the working status of the microphone, turns on the microphone, and performs audio acquisition.

[0020] If the slave button is lifted, the slave sends a button lift command to the host, and the host sends a close command to the slave communication module to shut down the audio acquisition module. After receiving the close command, the slave turns off the microphone and completes the audio acquisition work.

[0021] Preferably, when the central control module determines that the slave is currently located in the charging bin based on the charging status of the slave, the communication between the host and the slave adopts serial communication; when the central control module determines that the slave is currently located outside the charging bin based on the charging status of the slave, the communication between the host and the slave adopts wireless communication;

[0022] The communication between the host and the host computer includes USB communication and wireless communication.

[0023] Preferably, when the communication between the host and the slave adopts serial communication, the identity authentication process of the host and the slave includes:

[0024] S1, the slave sends slave authentication information to the master;

[0025] S2, the host receives the slave authentication information and parses it, and generates the host authentication information based on the parsing result and sends it to the slave;

[0026] S3. The slave receives the host authentication information and verifies it, and sends the verification result to the host.

[0027] Preferably, the slave authentication information Challenge1 in S1 is generated using the following formula:

[0028]

[0029] Among them, S_ADDR is the slave MAC address, S_NAME is the slave device name, RAMDOM is a 16-byte random number generated by the slave, H represents a 32-bit hash operation, BLE_KEY is a 16-byte key generated during BLE pairing, AES represents a 16-byte reversible encryption operation, and ⊕ represents an XOR operation.

[0030] Preferably, in S2, the host receives the slave authentication information and parses it, and generates the host authentication information based on the parsing result and sends it to the slave, including:

[0031] The host obtains the decrypted value through the BLE_KEY key XOR this data with S_ADDR+S_NAME+H(S_ADDR+S_NAME) to get RAMDOM;

[0032] Use the following formula to generate host authentication information Challenge2:

[0033]

[0034] Among them, M_ADDR is the host MAC address, and M_NAME is the host device name.

[0035] Preferably, in S3, the slave receives the host authentication information and verifies it, and sends the verification result to the host, including:

[0036] The slave obtains the decrypted key through BLE_KEY XOR the data with M_ADDR+M_NAME+H(M_ADDR+M_NAME) to get RAMDOM, and compare it with the RAMDOM generated by itself;

[0037] If the two sets of data are consistent, the identity authentication is successful, otherwise the identity authentication fails and the authentication result is sent to the host.

[0038] Preferably, the host further comprises a key scanning module, which uses an 8*16 matrix for scanning, and after obtaining the results through row and column scanning, traverses the array to find the corresponding coding position and determine the key value.

[0039] (III) Beneficial effects

[0040] Compared with the prior art, the voice keyboard with a separate microphone provided by the present invention has the following beneficial effects:

[0041] 1) Based on actual needs and obvious defect analysis, a dual-architecture system framework is summarized based on the UART and BLE dual communication mechanism, and a dual-architecture system framework is built according to the master-slave communication principle. Combined with audio acquisition, host control, etc., a complete master-slave dual-architecture technology implementation route is provided;

[0042] 2) A movable microphone is integrated on the keyboard, and the audio acquisition module is separated, which can realize remote sound pickup of the keyboard without generating new connection devices with the host computer, greatly increasing the sound pickup distance of the keyboard and improving the practicality of the keyboard;

[0043] 3) Both the slave authentication information and the host authentication information in the identity authentication mechanism between the microphone and the keyboard contain random numbers, which greatly improves the security of the identity authentication mechanism between the microphone and the keyboard. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0045] Figure 1 It is a system schematic diagram of the present invention;

[0046] Figure 2 A schematic diagram of a process of communication between a host and a slave in the present invention;

[0047] Figure 3 It is a schematic diagram of the process of identity authentication when serial communication is used for communication between the host and the slave in the present invention;

[0048] Figure 4 The figure is a schematic diagram of the working process of the audio acquisition module in the present invention. DETAILED DESCRIPTION

[0049] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0050] A voice keyboard with a separate microphone, such as Figure 1 As shown, it includes a host and a slave, and the host includes a central control module, a host communication module and a host power management module;

[0051] The central control module receives the operation information of each submodule in the host and sends work instructions to each submodule, determines the current position of the slave based on the slave charging status, and controls the working status of the audio acquisition module by sending instructions to the slave communication module;

[0052] The host communication module is used to establish communication connections between the host and the slave, and between the host and the host computer, and upload the audio data to the host computer for audio analysis;

[0053] The host power management module is used to automatically switch the power supply mode (when powered by a lithium battery, it is controlled by the microcontroller pin to achieve low power consumption; when connected to a USB, it uses the USB power supply and disconnects the lithium battery power supply to prevent the USB from directly charging the lithium battery) and monitor the host battery power;

[0054] The host also includes a key scanning module, which uses an 8*16 matrix for scanning. After the row and column scanning obtains the results, it traverses the array to find the corresponding encoding position and determine the key value.

[0055] The slave includes a slave communication module, a slave power management module and an audio acquisition module;

[0056] The slave communication module is used to establish a communication connection between the slave and the host, receive the audio data sent by the audio acquisition module and upload it to the host;

[0057] The slave power management module monitors the slave charging status and the slave battery power;

[0058] The audio acquisition module (containing an independent main control chip and using an analog microphone to collect audio data) collects audio data through the microphone under the control of the slave button under the premise of host scheduling (the audio encoding format is 16-bit PCM, the sampling rate is 16kHz), and sends the collected audio data to the slave communication module.

[0059] When the central control module determines that the slave is currently in the charging bin based on the slave charging status, the slave is in SLEEP mode to reduce power consumption as much as possible. The slave is awakened by one of the following methods: the slave button, the host sending a start command, or stopping charging when leaving the bin.

[0060] When the central control module determines that the slave is currently outside the charging compartment based on the slave's charging status, the slave communication module starts the BLE broadcast. After the host detects the BLE broadcast, it establishes a BLE connection with the slave communication module and sends a start command to the slave communication module. When the host and the slave complete the BLE connection, the slave enters the IDLE mode to reduce power consumption and only sends heartbeat packets.

[0061] like Figure 2 As shown, when the central control module determines that the slave is currently located in the charging bin based on the charging status of the slave, serial communication is used for communication between the host and the slave; when the central control module determines that the slave is currently located outside the charging bin based on the charging status of the slave, wireless communication is used for communication between the host and the slave;

[0062] The communication between the host and the upper computer includes USB communication and wireless communication.

[0063] In the technical solution of the present application, the communication mode between the host and the slave is automatically switched, and the basis for determining which communication mode to use is: when the slave is placed in the charging compartment, the host will charge the slave, similar to the wireless Bluetooth headset charging compartment. Both the host and the slave can determine whether the current location of the slave is inside or outside the compartment by the charging status of the slave.

[0064] In the technical solution of the present application, the BLE connection between the host and the slave is paired at the factory and the user is not allowed to change it. At the same time, the UART connection also has identity authentication information, which the user is not allowed to change.

[0065] like Figure 3 As shown in the figure, when the communication between the host and the slave is carried out through serial communication, the identity authentication process of the host and the slave includes:

[0066] S1, the slave sends slave authentication information to the master;

[0067] S2, the host receives the slave authentication information and parses it, and generates the host authentication information based on the parsing result and sends it to the slave;

[0068] S3. The slave receives the host authentication information and verifies it, and sends the verification result to the host.

[0069] ① The slave authentication information Challenge1 (16 bytes) is generated using the following formula:

[0070]

[0071] Among them, S_ADDR is the slave MAC address (6 bytes), S_NAME is the slave device name (6 bytes), RAMDOM is a 16-byte random number generated by the slave, H represents a 32-bit hash operation, BLE_KEY is a 16-byte key generated during BLE pairing, AES represents a 16-byte reversible encryption operation, and ⊕ represents an XOR operation.

[0072] ②The host receives the slave authentication information and parses it, and generates host authentication information based on the parsing result and sends it to the slave, including:

[0073] The host obtains the decrypted value through the BLE_KEY key XOR this data with S_ADDR+S_NAME+H(S_ADDR+S_NAME) to get RAMDOM;

[0074] Use the following formula to generate host authentication information Challenge2:

[0075]

[0076] Among them, M_ADDR is the host MAC address (6 bytes), and M_NAME is the host device name (6 bytes).

[0077] ③ The slave receives the host authentication information and verifies it, and sends the verification results to the host, including:

[0078] The slave obtains the decrypted key through BLE_KEY XOR the data with M_ADDR+M_NAME+H(M_ADDR+M_NAME) to get RAMDOM, and compare it with the RAMDOM generated by itself;

[0079] If the two sets of data are consistent, the authentication is successful, otherwise the authentication fails and the authentication result is sent to the host. The authentication result length is only 1 byte, 1 represents successful authentication, and 0 represents failed authentication.

[0080] like Figure 4 As shown, after the slave communication module receives the start command, the audio acquisition module enters the working state and detects whether there is a key action on the slave key;

[0081] If the slave button is pressed, the slave sends a button press command to the host, and the host sends an enable command to the slave communication module to enable the audio acquisition module. The slave starts to check the working status of the microphone, and sends a feedback command code to the host according to the working status of the microphone, turns on the microphone, and performs audio acquisition.

[0082] If the slave button is lifted, the slave sends a button lift command to the host, and the host sends a close command to the slave communication module to shut down the audio acquisition module. After receiving the close command, the slave turns off the microphone and completes the audio acquisition work.

[0083] In the technical solution of this application, the function of the host power management module is:

[0084] 1) Detect the battery power of the host, collect data every five minutes, and send the test results to the host. If the power is lower than the minimum power threshold, the host sends a low power message to the host computer through the host communication module to remind the user to charge;

[0085] 2) Detect the charging status of the host. If charging, send the charging information to the host computer to inform the user that it is charging;

[0086] The function of slave power management module:

[0087] 1) Detect the battery power of the slave, collect data every five minutes, and send the test results to the host through the slave communication module. If the power is lower than the minimum power threshold, the host sends a low power message to the host through the host communication module to remind the user to charge;

[0088] 2) Monitor the charging status of the slave to assist in determining whether the slave is currently located inside or outside the warehouse.

[0089] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements will not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A voice keyboard with a separate microphone, characterized in that: It includes a host and a slave, wherein the host includes a central control module, a host communication module and a host power management module, and the slave includes a slave communication module, a slave power management module and an audio acquisition module; The central control module receives the operation information of each submodule in the host and sends work instructions to each submodule, determines the current position of the slave based on the slave charging status, and controls the working status of the audio acquisition module by sending instructions to the slave communication module; The host communication module is used to establish communication connections between the host and the slave, and between the host and the host computer, and upload the audio data to the host computer for audio analysis; Host power management module, used to automatically switch power supply modes and monitor host battery power; The slave communication module is used to establish a communication connection between the slave and the host, receive the audio data sent by the audio acquisition module and upload it to the host; The slave power management module monitors the slave charging status and the slave battery power; The audio acquisition module, under the premise of the host scheduling, collects audio data through the microphone through the control of the slave button, and sends the collected audio data to the slave communication module; When the central control module determines that the slave is currently located in the charging bin based on the charging status of the slave, the communication between the host and the slave adopts serial communication; when the central control module determines that the slave is currently located outside the charging bin based on the charging status of the slave, the communication between the host and the slave adopts wireless communication; The communication between the host and the host computer includes USB communication and wireless communication; When the communication between the host and the slave is carried out by serial communication, the identity authentication process of the host and the slave includes: S1, the slave sends slave authentication information to the master; S2, the host receives the slave authentication information and parses it, and generates the host authentication information based on the parsing result and sends it to the slave; S3, the slave receives the host authentication information and verifies it, and sends the verification result to the host; The slave authentication information Challenge1 in S1 is generated using the following formula: Challenge1=AES(RAMDOM⊕(S_ADDR+S_NAME+H(S_ADDR+ S_NAME)), BLE_KEY); Among them, S_ADDR is the slave MAC address, S_NAME is the slave device name, RAMDOM is the 16-byte random number generated by the slave, H represents the 32-bit hash operation, BLE_KEY is the 16-byte key generated during BLE pairing, AES represents the 16-byte reversible encryption operation, and ⊕ represents the XOR operation; In S2, the host receives the authentication information of the slave and parses it, and generates the host authentication information based on the parsing result and sends it to the slave, including: The host decrypts the data using the BLE_KEY key to obtain RAMDOM⊕(S_ADDR+S_NAME+H(S_ADDR+S_NAME)), and performs an XOR operation on the data with S_ADDR+S_NAME+H(S_ADDR+S_NAME) to obtain RAMDOM. Use the following formula to generate host authentication information Challenge2: Challenge2=AES(RAMDOM⊕(M_ADDR+M_NAME+H(M_ADDR +M_NAME)), BLE_KEY); Among them, M_ADDR is the host MAC address, and M_NAME is the host device name; In S3, the slave receives the host authentication information and verifies it, and sends the verification result to the host, including: The slave decrypts the data using the BLE_KEY key to obtain RAMDOM⊕(M_ADDR+M_NAME+H(M_ADDR+M_NAME)), performs an XOR operation on the data with M_ADDR+M_NAME+H(M_ADDR+M_NAME) to obtain RAMDOM, and compares it with the RAMDOM generated by itself. If the two sets of data are consistent, the identity authentication is successful, otherwise the identity authentication fails and the authentication result is sent to the host.

2. The voice keyboard with a separate microphone according to claim 1, characterized in that: When the central control module determines that the slave is currently located in the charging compartment based on the charging status of the slave, the slave is awakened by one of the following methods: pressing a button on the slave, sending a start command from the host, or stopping charging by leaving the compartment.

3. The voice keyboard with a separate microphone according to claim 2, characterized in that: When the central control module determines that the slave is currently outside the charging compartment based on the charging status of the slave, the slave communication module starts the BLE broadcast. After the host detects the BLE broadcast, it establishes a BLE connection with the slave communication module and sends a start instruction to the slave communication module.

4. The voice keyboard with a separate microphone according to claim 3, characterized in that: After the slave communication module receives the start instruction, the audio acquisition module enters the working state and detects whether there is a key action on the slave key; If the slave button is pressed, the slave sends a button press command to the host, and the host sends an enable command to the slave communication module to enable the audio acquisition module. The slave starts to check the working status of the microphone, and sends a feedback command code to the host according to the working status of the microphone, turns on the microphone, and performs audio acquisition. If the slave button is lifted, the slave sends a button lift command to the host, and the host sends a close command to the slave communication module to shut down the audio acquisition module. After receiving the close command, the slave turns off the microphone and completes the audio acquisition work.

5. The voice keyboard with a separate microphone according to claim 1, characterized in that: The host also includes a key scanning module, which uses an 8*16 matrix for scanning. After the row and column scanning obtains the result, the array is traversed to find the corresponding coding position and determine the key value.

Images