Voice interaction system based on bone conduction microphone device and control method thereof

Through the voice interaction system based on the bone conduction microphone device, voice signals are obtained and processed, converted into text information and stored, which solves the problem that users need to manually record information, and realizes convenient and efficient information recording and storage.

CN120075699APending Publication Date: 2025-05-30SHENZHEN RED ARROW TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202510233555.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-02-28
Publication Date
2025-05-30

AI Technical Summary

Technical Problem

In the prior art, users need to manually record information, and the information recording method is relatively traditional and inconvenient enough.

Method used

A voice interaction system based on a bone conduction microphone device is adopted to obtain a voice signal through a bone conduction microphone device, and transmit it to a terminal for analysis and processing, convert it into text information and store it.

Benefits of technology

It realizes information storage without the need for users to manually record information, improves information recording efficiency, reduces noise interference, and protects the privacy of external personnel.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120075699A_ABST
    Figure CN120075699A_ABST
Patent Text Reader

Abstract

The invention discloses a bone conduction microphone device-based voice interaction system, which comprises a bone conduction microphone device and a terminal, and is characterized in that the bone conduction microphone device is connected with the terminal and is used for acquiring a voice signal and transmitting the voice signal to the terminal so as to analyze and process the received voice signal through the terminal; and converting the voice signal into text information and storing the text information. According to the voice interaction system based on the bone conduction microphone device, the bone conduction microphone device is arranged to pick up the voice signal through mechanical vibration, external noise can be well eliminated, the voice signal can be accurately picked up, the voice frequency of external personnel is prevented from being picked up by mistake, privacy violation is avoided, and the user experience is improved. And the obtained voice signal is transmitted to the terminal for voice recognition and conversion to obtain the corresponding text information, so that subsequent classification and arrangement are facilitated, storage and recording are easy, and subsequent operation control and consulting are facilitated. The invention further discloses a control method of the voice interaction system based on the bone conduction microphone device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of artificial intelligence, and particularly to a voice interaction system based on a bone conduction microphone device and a control method thereof. Background Art

[0002] In the era of information explosion, users are exposed to a lot of information every day and also need to record important information to avoid omission. Currently, individuals often need to manually record and save information in notebooks, sticky notes, or mobile phones, which is a relatively traditional and inconvenient way. Summary of the Invention

[0003] The technical problem to be solved by the present invention is to provide a voice interaction system based on a bone conduction microphone device and a control method thereof, so as to save information without the need for users to manually record information.

[0004] In a first aspect, the present invention provides a voice interaction system based on a bone conduction microphone device, including a bone conduction microphone device and a terminal. The bone conduction microphone device is connected to the terminal and is used to acquire a voice signal and transmit it to the terminal, so that the terminal analyzes and processes the received voice signal, converts the voice signal into text information, and stores it.

[0005] In a second aspect, the present invention provides a control method for a voice interaction system based on a bone conduction microphone device, which is applied to the above-mentioned voice interaction system based on a bone conduction microphone device. The control method for the voice interaction system based on a bone conduction microphone device includes the following steps: the terminal receives the voice signal of the user picked up and transmitted by the bone conduction microphone device; the terminal preprocesses the received voice signal of the user and extracts the acoustic features of the voice signal; the terminal performs voice recognition on the preprocessed voice signal of the user to convert the voice signal into corresponding text information, recognizes the converted text information, and extracts key text information; determines whether the key text information is an instruction; when the key text information is an instruction, executes the instruction operation corresponding to the key text information; otherwise, stores the key text information.

[0006] The beneficial technical effects of the present invention are as follows: The voice interaction system based on the bone conduction microphone device of the present invention picks up voice signals through mechanical vibration by setting the bone conduction microphone device, has a strong ability to exclude external noise, makes the noise of the obtained voice signals low, facilitates the analysis and processing of voice signals, can accurately pick up voice signals, prevents the mis-picking of the audio of external personnel, avoids infringing on the privacy of external personnel, and transmits the obtained voice signals to the terminal for voice recognition conversion to obtain corresponding text information for subsequent classification and sorting, and is easy to store and record. Information can be saved without the user manually recording it, improving the information recording efficiency and facilitating subsequent operation control and access. The control method of the voice interaction system based on the bone conduction microphone device of the present invention also has the above functions. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0008] Figure 1 It is a schematic framework diagram of the voice interaction system based on the bone conduction microphone device provided by the present invention;

[0009] Figure 2 It is a schematic flow diagram of the control method of the voice interaction system based on the bone conduction microphone device provided by the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0010] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts fall within the scope of protection of the present invention.

[0011] Please refer to Figure 1 , Figure 1 It is a schematic framework diagram of the voice interaction system based on the bone conduction microphone device provided by the embodiments of the present invention. The voice interaction system 10 based on the bone conduction microphone device includes a bone conduction microphone device 11 and a terminal 12. The bone conduction microphone device 11 is connected to the terminal 12 and is used to acquire voice signals and transmit them to the terminal 12, so as to analyze and process the received voice signals through the terminal 12, convert the voice signals into text information and store them.

[0012] Among them, the terminal 12 includes, but is not limited to, mobile phones, tablets, laptop computers, and XR glasses. The terminal 12 can be connected to the bone conduction microphone device 11 through a connection line to obtain the voice signal picked up by the bone conduction microphone device 11. The terminal 12 can also be wirelessly connected to the bone conduction microphone device 11 through wireless communication to obtain the voice signal picked up by the bone conduction microphone device 11. The bone conduction microphone device 11 is an important component of the voice interaction system. It can be used to only collect the user's own voice and create a memo for the individual's voice through the terminal 12, enabling the user to record their thoughts and important information anytime and anywhere. Moreover, since the bone conduction microphone device 11 is in direct contact with the user's body, specifically the parts where human voice vibrations are generated and transmitted, such as the head, neck, face, and / or ears, etc., it mainly collects the vibration signals transmitted by the body, can effectively isolate external noises, has a natural noise reduction function, and can exclude the voice signals of external speakers when picking up voice signals, facilitating subsequent voice processing and also avoiding privacy issues. The voice interaction system 10 based on the bone conduction microphone device has a strong ability to exclude external noises by setting the bone conduction microphone device 11 to pick up voice signals through mechanical vibrations, resulting in a lower noise level of the obtained voice signal, facilitating the analysis and processing of the voice signal, enabling accurate picking up of the voice signal, preventing mis-picking of the audio of external personnel, avoiding infringement of the privacy of external personnel, and transmitting the obtained voice signal to the terminal 12 for voice recognition and conversion to obtain the corresponding text information for subsequent classification and sorting, which is easy to store and record, allowing information to be saved without the user manually recording the information, improving the information recording efficiency, and facilitating subsequent operation control and access.

[0013] Specifically, the bone conduction microphone device 11 includes a voice pickup and transmission module 111. The voice pickup and transmission module 111 includes a bone conduction microphone 112, a wireless communication module 113, and a power supply module 114. The bone conduction microphone 112 is used to contact the user to pick up the voice signal emitted by the user. The wireless communication module 113 is connected to the bone conduction microphone 112 and is used to send the picked-up voice signal emitted by the user to the terminal 12. The power supply module 114 is respectively connected to the bone conduction microphone 112 and the wireless communication module 113 to supply power to the bone conduction microphone 112 and the wireless communication module 113. Among them, the bone conduction microphone 112 contacts the voice vibration generation part or voice vibration transmission part of the user to pick up the voice signal through mechanical vibrations. The wireless communication module 113 can be a Bluetooth module or a WI-FI module. The terminal 12 can be equipped with a wireless unit to wirelessly communicate with the wireless communication module 113 to receive the voice signal emitted by the user picked up by the bone conduction microphone 112 sent by the wireless communication module 113. The power supply module 114 can be a rechargeable battery, a rechargeable capacitor, and / or a replaceable battery.

[0014] Specifically, the bone conduction microphone device 11 further includes a fixing structure, and the voice pickup and transmission module 111 is installed on the fixing structure so that the voice pickup and transmission module 111 contacts the user through the fixing structure, facilitating the pickup of the voice signal emitted by the user himself.

[0015] Specifically, the fixing structure is a temple of glasses, and the bone conduction microphone 112 is disposed at the joint where the temple of glasses contacts the user. Preferably, the voice pickup and transmission module 111 can be disposed on the side of the temple of glasses facing the user's head. Among them, a placement groove is formed on the side of the temple of glasses facing the user's head, and the voice pickup and transmission module 111 is installed in the placement groove, while the bone conduction microphone 112 can be exposed from the placement groove to contact the user.

[0016] Specifically, in some embodiments, the fixing structure can be a nose pad of glasses. The nose pad of glasses is installed on the side of the spectacle frame close to the user's nose, and the bone conduction microphone 112 is disposed at the joint where the nose pad of glasses contacts the user. The fixing structure is a nose pad of glasses for easy maintenance and replacement, and it can be applicable to different glasses.

[0017] Specifically, the fixing structure can be an ear hook for hanging on the user's ear, and the voice pickup and transmission module 111 is installed on the side of the ear hook facing the user's head. Preferably, the ear hook is arc-shaped so as to be hung on the user's ear and contact the head, facilitating the pickup of the voice signal emitted by the user himself.

[0018] Certainly, in other embodiments, the fixing structure can also be an adhesive patch. The voice pickup and transmission module 111 is connected to one side of the adhesive patch, and the other side of the adhesive patch is adhesively connected to the user, so that the voice pickup and transmission module 111 can be adhered to positions such as the user's head, neck, face or ear through the adhesive patch, which is convenient to use.

[0019] Specifically, the voice interaction system 10 based on the bone conduction microphone device further includes a feedback mechanism. The feedback mechanism is respectively connected to the voice pickup and transmission module 111 and the main controller of the terminal 12, and is used to detect the working state of the voice pickup and transmission module 111 and receive the feedback on the processing of the obtained voice signal by the main controller of the terminal 12. Among them, the terminal 12 includes a main controller for controlling the operation of the terminal 12. The feedback mechanism can be disposed on the bone conduction microphone device 11 and / or the terminal, so as to work according to the detected working state of the voice pickup and transmission module 111 and the received feedback on the processing of the voice signal by the main controller of the terminal 12, facilitating the user to learn about the working state of the voice interaction system 10 based on the bone conduction microphone device through the feedback mechanism on the bone conduction microphone device 11 and / or the terminal.

[0020] Specifically, the feedback mechanism includes at least one of a display lamp, a vibrator, or a microphone. The display lamp can represent the working state of the voice interaction system 10 based on the bone conduction microphone device through different lamp colors and / or blinking frequencies, and uses methods such as color change and / or blinking to provide feedback on the state of the bone conduction microphone, as well as the completion status of terminal instructions or the storage status of terminal information. It can be respectively used to represent the power status of the bone conduction microphone device 11, the working state of the bone conduction microphone device 11, the working state of the terminal 12 for converting voice to text and storing it, and the feedback after the terminal 12 executes the instruction operation obtained by converting voice to text. The display lamp includes but is not limited to an LED lamp. When the feedback mechanism is provided on the bone conduction microphone device 11, the display lamp can be an LED lamp. The LED lamp being constantly on can indicate that the bone conduction microphone device 11 is in a working state, the LED lamp blinking indicates that the bone conduction microphone device 11 is in a power shortage state, and the change in the color of the LED lamp represents the working state of the terminal 12 for converting voice to text and storing it or the feedback after the terminal 12 executes the instruction operation obtained by converting voice to text. When the feedback mechanism is provided on the terminal 12, such as a mobile phone, the display lamp can be a lighting lamp. The lighting lamp being constantly on can indicate that the bone conduction microphone device 11 is in a working state, the LED lamp blinking indicates that the bone conduction microphone device 11 is in a power shortage state, and the working state of the terminal 12 for converting voice to text and storing it or the feedback after the terminal 12 executes the instruction operation obtained by converting voice to text can be indicated by the screen of the terminal 12 blinking. The vibrator represents the working state of the voice interaction system 10 based on the bone conduction microphone device through different vibration frequencies, and can be respectively used to represent the power status of the bone conduction microphone device 11, the working state of the bone conduction microphone device 11, the working state of the terminal 12 for converting voice to text and storing it, and the feedback after the terminal 12 executes the instruction operation obtained by converting voice to text. The microphone represents the working state of the voice interaction system 10 based on the bone conduction microphone device by emitting different sounds, and can be respectively used to represent the power status of the bone conduction microphone device 11, the working state of the bone conduction microphone device 11, the working state of the terminal 12 for converting voice to text and storing it, and the feedback after the terminal 12 executes the instruction operation obtained by converting voice to text.

[0021] Refer to Figure 2 , Figure 2 which is a schematic flowchart of the control method of the voice interaction system based on the bone conduction microphone device of the present invention. The control method of the voice interaction system based on the bone conduction microphone device is applied to the above-mentioned voice interaction system based on the bone conduction microphone device, and includes the following steps:

[0022] S10. The terminal receives the voice signal of the user picked up and transmitted by the bone conduction microphone device;

[0023] S20. The terminal preprocesses the voice signal of the user received, and extracts the acoustic features of the voice signal; among them, the acoustic features of the voice signal include Mel Frequency Cepstrum Coefficient (MFCC), and there is a non-linear correspondence between the Mel Frequency Cepstrum Coefficient and the Hz frequency, so the corresponding Hz spectral features can be calculated through the Mel Frequency Cepstrum Coefficient.

[0024] S30. The terminal performs speech recognition on the preprocessed voice signal of the user to convert the voice signal into corresponding text information, recognizes the converted text information, and extracts key text information;

[0025] S40. Determine whether the key text information is an instruction;

[0026] S50. When the key text information is an instruction, execute the instruction operation corresponding to the key text information; otherwise, store the key text information.

[0027] Specifically, after the step S50, it further includes:

[0028] When executing the instruction operation corresponding to the key text information, feedback and confirm the instruction operation;

[0029] When storing the key text information, feedback and confirm the key text information.

[0030] Preferably, the terminal preprocesses the voice signal of the user received in the step S20, specifically:

[0031] The terminal sequentially performs noise reduction, signal enhancement, and frame segmentation processing on the voice signal of the user received.

[0032] Specifically, the recognizing the converted text information and extracting key text information in the step S30 includes:

[0033] The terminal performs intention recognition on the obtained text information through natural language understanding to analyze, summarize, and generalize the obtained text information, and extracts the generalized text information;

[0034] The terminal performs entity recognition on the obtained text information through natural language understanding and extracts entity information, where the entity information includes but is not limited to people, time, and place;

[0035] The terminal comprehensively uses the recognized and extracted information as the key text information; specifically, at this time: the terminal comprehensively uses the generalized text information obtained after intention recognition and the entity information including but not limited to people, time, and place extracted after entity recognition as the key text information.

[0036] Among them, intent recognition is used to judge the intent or purpose expressed in a sentence and is a technology in Natural Language Processing (NLP); entity recognition is used to identify and classify specific entities in text, such as person names, place names, organization names, dates, times, and currencies, etc., to structure the information in the text, which is beneficial to helping the computer understand and process the key information in natural language and is a technology in natural language processing. When the voice interaction system based on the bone conduction microphone device is applied to the scenario of controlling other intelligent hardware, the voice signal emitted by the user is an instruction voice, and the control method of the voice interaction system is as follows: the bone conduction microphone picks up the voice signal emitted by the user and transmits it to the terminal through the wireless communication module; the terminal preprocesses the received voice signal of the user and extracts the acoustic features of the voice signal; the terminal performs speech recognition on the preprocessed voice signal of the user to convert the voice signal into corresponding text information, the terminal performs intent recognition on the obtained text information through natural language understanding to analyze, summarize, and generalize the obtained text information, and extracts the generalized text information; the terminal performs entity recognition on the obtained text information through natural language understanding and extracts entity information; the terminal comprehensively uses the text information and entity information obtained after recognition as the key text information; it is judged that the key text information is an instruction, and the instruction corresponding to the key text information is executed, thereby controlling the work of other intelligent hardware, so that in addition to recording information, the voice interaction system also has the function of voice controlling other intelligent hardware.

[0037] When the voice interaction system based on the bone conduction microphone device is applied to the scenario of meetings or multi-person communication, the voice signal emitted by the user is a conversation voice, and the control method of the voice interaction system is as follows: the bone conduction microphone picks up the voice signal emitted by the user and transmits it to the terminal through the wireless communication module; the terminal preprocesses the received voice signal of the user and extracts the acoustic features of the voice signal; the terminal performs speech recognition on the preprocessed voice signal of the user to convert the voice signal into corresponding text information, the terminal performs intent recognition on the obtained text information through natural language understanding to analyze, summarize, and generalize the obtained text information, and extracts the generalized text information; the terminal performs entity recognition on the obtained text information through natural language understanding and extracts entity information; the terminal comprehensively uses the text information and entity information obtained after recognition as the key text information; it is judged that the key text information is the content of a meeting or conversation, and the key text information is stored, thereby realizing meeting recording or conversation recording, so that there is no need to manually write for meeting recording or conversation recording. Moreover, compared with picking up voice information through a traditional microphone, picking up voice according to mechanical vibration by the bone conduction microphone device can accurately pick up the voice signal of the user himself, ensuring the clarity and integrity of the text information obtained by converting the picked-up voice signal of the user himself, and effectively avoiding external noise interference.

[0038] Specifically, the voice interaction system based on the bone conduction microphone device can be applied to the scenario of recording meeting minutes. Before the terminal comprehensively uses the information obtained after recognition and extraction as key text information, it further includes:

[0039] The terminal performs text analysis on the obtained text information through natural language understanding to identify and extract meeting information; among them, the meeting information includes meeting topics and meeting decision points.

[0040] At this time, the terminal comprehensively uses the information obtained after recognition and extraction as key text information specifically as:

[0041] The terminal comprehensively uses the summarized text information obtained after intention recognition, the entity information including but not limited to people, time, and location obtained after entity recognition, and the meeting information obtained after text analysis as key text information. Among them, the summarized text information obtained after intention recognition can be the speech intention of the participants, including questions, suggestions, and decisions.

[0042] Specifically, after step S30, it further includes:

[0043] Generate a structured meeting minutes based on the obtained key text information. Among them, the key text information includes the summarized text information obtained after intention recognition, the entity information obtained after entity recognition, and the meeting information obtained after text analysis. The meeting minutes include meeting topics, time, people, agenda, discussion points, meeting decision points, and / or action items;

[0044] Perform grammar checking and format adjustment on the generated structured meeting minutes to obtain the meeting minutes after checking and adjustment, so as to improve the readability of the meeting minutes;

[0045] Store the meeting minutes after checking and adjustment.

[0046] Preferably, after performing grammar checking and format adjustment on the generated structured meeting minutes to obtain the meeting minutes after checking and adjustment, it further includes:

[0047] The terminal performs logical verification on the meeting minutes after checking and adjustment.

[0048] Preferably, the terminal can display the meeting minutes after logical verification so that users can invite participants to check the meeting minutes after logical verification according to their needs, so as to supplement and modify the meeting minutes after logical verification to obtain the final meeting minutes.

[0049] Moreover, users can apply to view their own text information according to their needs, or request authorization to view the corresponding meeting text information of other participants, or apply for authorization to view the complete corresponding meeting text information.

[0050] Continue to refer to Figure 2 , preferably, the control method of the voice interaction system based on the bone conduction microphone device further includes:

[0051] S101. Detect the working state of the bone conduction microphone device and receive the feedback of the main controller of the terminal on the processing of the obtained voice signal, so as to detect the power state of the bone conduction microphone device, the working state of the bone conduction microphone device, the working state of the terminal for converting voice into text and storing it, and the feedback after the terminal executes the instruction operation obtained by converting voice into text, so as to know the state of the bone conduction microphone and the completion situation of the terminal instruction or the terminal information storage situation.

[0052] In summary, the voice interaction system based on the bone conduction microphone device of the present invention picks up voice signals through mechanical vibration by setting the bone conduction microphone device, has a strong ability to exclude external noise, makes the noise of the obtained voice signal lower, is convenient for voice signal analysis and processing, can accurately pick up voice signals, and prevents mis-picking of the audio of external personnel, avoiding infringement of the privacy of external personnel. And by transmitting the obtained voice signal to the terminal for voice recognition conversion to obtain the corresponding text information, so as to facilitate subsequent classification and sorting, and is easy to store and record, the user can save information without manually recording information, improving the information recording efficiency, and facilitating subsequent operation control and access. The control method of the voice interaction system based on the bone conduction microphone device of the present invention also has the above functions.

[0053] The above is only the specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present invention can easily think of various equivalent modifications or substitutions, and these modifications or substitutions should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.

Claims

1. A voice interaction system based on a bone conduction microphone device, characterized in that: The invention comprises a bone conduction microphone device and a terminal. The bone conduction microphone device is connected to the terminal and is used to obtain a voice signal and transmit it to the terminal, so that the received voice signal is analyzed and processed by the terminal, and the voice signal is converted into text information and stored.

2. The voice interaction system based on the bone conduction microphone device according to claim 1, characterized in that: The bone conduction microphone device includes a voice pickup and transmission module, which includes a bone conduction microphone, a wireless communication module and a power supply module. The bone conduction microphone is used to contact with the user to pick up the voice signal emitted by the user. The wireless communication module is connected to the bone conduction microphone and is used to send the picked up voice signal emitted by the user to the terminal. The power supply module is respectively connected to the bone conduction microphone and the wireless communication module to supply power to the bone conduction microphone and the wireless communication module.

3. The voice interaction system based on the bone conduction microphone device according to claim 2, characterized in that: The bone conduction microphone device further comprises a fixing structure, and the voice pickup and transmission module is mounted on the fixing structure so that the voice pickup and transmission module contacts the user through the fixing structure.

4. The voice interaction system based on the bone conduction microphone device according to claim 3, characterized in that: The fixing structure is a nose pad of glasses, a glasses leg or an ear hook for hanging on the ear of a user.

5. The voice interaction system based on the bone conduction microphone device according to claim 3, characterized in that: The fixing structure is an adhesive sheet, the voice pickup and transmission module is connected to one side of the adhesive sheet, and the other side of the adhesive sheet is attached and connected to the user.

6. The voice interaction system based on the bone conduction microphone device according to claim 1, characterized in that: The voice interaction system based on the bone conduction microphone device also includes a feedback mechanism, which is respectively connected to the voice pickup and transmission module and the main controller of the terminal, and is used to detect the working status of the voice pickup and transmission module and receive feedback from the main controller of the terminal on the processing of the obtained voice signal.

7. The voice interaction system based on the bone conduction microphone device according to claim 6, characterized in that: The feedback mechanism includes at least one of a display light, a vibrator or a microphone.

8. A control method for a voice interaction system based on a bone conduction microphone device, characterized in that: The voice interaction system based on the bone conduction microphone device according to any one of claims 1 to 7, wherein the control method of the voice interaction system based on the bone conduction microphone device comprises the following steps: The terminal receives the user's voice signal picked up and transmitted by the bone conduction microphone device; The terminal pre-processes the received user's voice signal and extracts the acoustic features of the voice signal; The terminal performs speech recognition on the pre-processed user's speech signal to convert the speech signal into corresponding text information, recognizes the converted text information, and extracts key text information; Determine whether the key text information is an instruction; When the key text information is an instruction, the instruction operation corresponding to the key text information is executed; otherwise, the key text information is stored.

9. The control method of the voice interaction system based on the bone conduction microphone device according to claim 8, characterized in that: The terminal pre-processes the received user's voice signal, specifically: The terminal performs noise reduction, signal enhancement and frame division processing on the received user's voice signal in sequence.

10. The control method of the voice interaction system based on the bone conduction microphone device according to claim 8, characterized in that: The step of identifying the converted text information and extracting key text information includes: The terminal recognizes the intent of the obtained text information through natural language understanding, analyzes, summarizes and summarizes the obtained text information, and extracts the summarized text information; The terminal performs entity recognition on the obtained text information through natural language understanding and extracts entity information; The terminal integrates the information extracted after recognition as key text information.

11. The control method of the voice interaction system based on the bone conduction microphone device according to claim 10, characterized in that: Before the terminal integrates the information extracted after identification as key text information, it also includes: The terminal performs text analysis on the obtained text information through natural language understanding to identify and extract meeting information; wherein the meeting information includes meeting topics and meeting decision points.

12. The control method of the voice interaction system based on the bone conduction microphone device according to claim 11, characterized in that: The terminal performs speech recognition on the pre-processed user's speech signal to convert the speech signal into corresponding text information, recognizes the converted text information, and extracts key text information, further comprising: Generate structured meeting minutes based on the extracted key text information, where the key text information includes summarized text information, entity information and meeting information, and the meeting minutes include meeting topics, time, people, agenda, discussion points, meeting decision points and / or action items; Perform grammar check and format adjustment on the generated structured meeting minutes to obtain the checked and adjusted meeting minutes; Storage inspection and adjusted meeting minutes.

13. The control method of the voice interaction system based on the bone conduction microphone device according to claim 8, characterized in that: The control method further comprises: Detect the working status of the bone conduction microphone device and receive feedback from the main controller of the terminal on the processing of the obtained voice signal.