Intelligent voice recognition and recording digital conference system

Abstract

The invention provides an intelligent voice recognition and recording digital conference system, which comprises a voice recognition and transcription module, a recording module, an intelligent analysis module, a scene adaptation module and a report generation module, and is characterized in that a signal transmitting end of the voice recognition and transcription module is connected with a signal receiving end of the recording module. According to the invention, emotion analysis is carried out through the intelligent analysis module, and the scene adaptation module is combined to carry out automatic adaptation on the scene, so that the system not only significantly improves the conference experience, but also brings higher flexibility and intelligence, the intelligent analysis module can accurately capture the emotion change of participants, provides emotion guidance for the conference, and improves the conference experience. And the scene adaptation module automatically adjusts the conference setting and interaction mode according to the emotion changes and the actual demand of the current conference, thereby reducing the complexity and error of manual operation, enabling the conference process to be smoother and more efficient, and solving the problems in the prior art that the application scene is single, and only mechanical voice recognition and recording can be performed.

Description

Technical Field

[0001] The invention relates to a digital conference system, in particular to a digital conference system for intelligent voice recognition and recording, belonging to the technical field of digital conference systems. Background Art

[0002] Digital conference system is a conference system that integrates computer, communication, control, multimedia, image, audio and other technologies. It is the development direction of the new generation of advanced conference system. The system integrates multiple independent subsystems, such as network subsystem, projection display subsystem, audio subsystem, monitoring subsystem, conference speech subsystem, lighting effect subsystem and central control subsystem, and coordinates the work of each subsystem according to the conference agenda through the central control computer.

[0003] Digital conference systems can improve meeting efficiency, reduce manual recording errors, and provide valuable meeting data through intelligent analysis. Digital conference systems are generally composed of two parts: hardware and software. The hardware part includes voice recognition equipment, microphone arrays, high-definition cameras, display screens, etc. The software part is responsible for voice recognition, data processing, record storage, and meeting management.

[0004] A known Chinese authorized patent (Announcement No.: CN215453024U) discloses a digital conference system that uses a speech-to-text module to timely and completely record the speech content of conference participants, thereby reducing the loss of conference record content, improving the timeliness, completeness and accuracy of conference records, and greatly reducing the workload of staff and improving the efficiency of making conference records; However, when designing the above digital conference systems, they often focus on meeting basic conference needs, such as voice-to-text and screen sharing. Therefore, they have the problem of single application scenarios and can only perform mechanical voice recognition and recording. Therefore, a digital conference system with intelligent speech recognition and recording is proposed. Summary of the invention

[0005] In view of this, the present invention provides a digital conference system for intelligent speech recognition and recording to solve or alleviate the technical problems existing in the prior art and at least provide a beneficial option.

[0006] The technical solution of the embodiment of the present invention is implemented as follows: a digital conference system for intelligent speech recognition and recording, comprising a speech recognition and transcription module, a recording module, an intelligent analysis module, a scene adaptation module and a report generation module, wherein a signal sending end of the speech recognition and transcription module is connected to a signal receiving end of the recording module, a signal sending end of the recording module is connected to a signal receiving end of the intelligent analysis module, a signal sending end of the intelligent analysis module is connected to a signal receiving end of the scene adaptation module, and a signal sending end of the intelligent analysis module is connected to a signal receiving end of the report generation module; The speech recognition and transcription module is used to receive the audio signal of the conference room in real time and convert the speech content in the audio signal into text. The speech recognition and transcription module supports the recognition of multiple languages ​​and dialects. The recording module is used to record the text content transcribed by the speech recognition and transcription module in real time and save it as an electronic document. The recording module has a conference recording function for saving the audio content of the conference as an audio file. The recording module has a keyword marking function for marking key information in the electronic document. The intelligent analysis module is used to analyze the voice emotions in the conference recording, provide emotional feedback to the participants, and identify and extract different topics in the meeting, and automatically generate a topic list and corresponding content; The scenario adaptation module is used to adjust and optimize the functions and performance of the system according to different application scenarios, provide remote access functions, support real-time access and voice recognition recording of remote participants, provide specific interfaces and function options for each application scenario, and realize automatic adaptation of the scenario; The report generation module is used to automatically generate a meeting report based on the text record of the meeting, including the meeting content, key information and participants.

[0007] Further preferably, the automatic adaptation method of the scene comprises the following steps: Step 1: Environment and equipment monitoring: Use IP address positioning technology to identify the geographic location of participants and preliminarily determine the application scenario. By detecting the type of device used by the user and the access method, the system further refines the application scenario; Step 2: User behavior analysis: Analyze meeting invitations, schedules, and meeting topic information, preliminarily determine the type and purpose of the meeting, and select appropriate application scenarios; Step 3: User interaction behavior monitoring: Monitor user interaction behaviors, including speaking frequency, discussion participation, and voting results, and dynamically adjust application scenarios based on interaction behaviors; Step 4: Scenario matching: Analyze the user's usage history and preference settings, understand the user's needs and habits in different application scenarios, analyze and train user data, and use scenario matching algorithms to match scenarios; Step 5: Provide a user feedback mechanism: The user manually adjusts or confirms the application scenario identified by the system; Step 6: Set up the application scenario library: The application scenario library contains the characteristics, requirements and adaptation solutions of different scenarios. When a new application scenario is identified, the system compares and matches it with the existing scenarios in the library.

[0008] Further preferably, in step 4, the scene matching algorithm includes the following steps: S1: Obtain historical user behavior data, analyze and learn the historical user behavior data, and analyze user behavior characteristics and behavior patterns in different application scenarios; S2: Based on the results of historical data analysis, build a machine learning model and continuously adjust the model's parameters and structure to optimize the model; S3: During the meeting, the system collects user behavior data in real time and inputs it into the trained machine learning model for identification. The model determines the current application scenario based on the user's behavior characteristics and behavior patterns; S4: Based on the identified application scenario, the system automatically adjusts the functions and interface of the conference system; S5: Continuously collect new user behavior data and update the machine learning model based on the new user behavior data.

[0009] Further preferably, in step two, the user behavior analysis also includes collecting user behavior data in the conference system, including speaking frequency, discussion participation, voting results, and browsed content, extracting key features from the user behavior data, including speaking duration, discussion topics, and browsed content types, using a clustering analysis algorithm to analyze and identify user behavior characteristics, and preliminarily determining the current application scenario by analyzing user behavior patterns.

[0010] Further preferably, the intelligent analysis module constructs a sentiment model, utilizes natural language processing and sentiment analysis algorithms to perform sentiment tendency analysis on the content in the text record, identifies the emotional state of the participants in the meeting, and displays a statistical chart of the sentiment tendency through the interface of the conference system.

[0011] Further preferably, the signal sending end of the scene adaptation module is connected to a terminal support module; The terminal support module is used to provide an interface to users and support the access and operation of computer, tablet and mobile terminal devices.

[0012] Further preferably, the signal receiving end of the terminal support module is connected to a user authority management module: The user rights management module is used to set different user roles and rights, including moderators, participants and administrators.

[0013] Further preferably, the signal receiving end of the terminal support module is connected to a security module; The security module is used to encrypt the conference data using data encryption technology. The security module provides an access control function so that only authorized users can view and edit the conference data.

[0014] Further preferably, the signal sending end of the scene adaptation module is connected to an interaction module; The interactive module is used to provide real-time interactive functions, including online question and answer and online voting, to achieve interactive conferences.

[0015] Further preferably, the signal sending end of the report generation module is connected to the data storage module, and the signal sending end of the recording module and the signal sending end of the speech recognition and transcription module are both connected to the signal receiving end of the data storage module; The data storage module is used to manage conference data, including classifying, indexing and retrieving conference data.

[0016] Since the embodiment of the present invention adopts the above technical solution, it has the following advantages: the present invention performs emotion analysis through the intelligent analysis module, and automatically adapts the scene in combination with the scene adaptation module, so that the system not only significantly improves the meeting experience, but also brings higher flexibility and intelligence. The intelligent analysis module can accurately capture the emotional changes of the participants and provide emotional guidance for the meeting, while the scene adaptation module automatically adjusts the meeting settings and interaction methods according to these emotional changes and the actual needs of the current meeting. This dual intelligent mechanism makes the meeting more humane, can better meet the needs of the participants, and enhance the participants' sense of participation and satisfaction. Moreover, this automated and intelligent processing method also greatly improves the meeting efficiency, reduces the tediousness and errors of manual operations, makes the meeting process smoother and more efficient, and solves the problem of single application scenario and mechanical voice recognition and recording in the prior art.

[0017] The above summary is for illustrative purposes only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments and features described above, further aspects, embodiments and features of the present invention will be readily apparent by reference to the accompanying drawings and the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0019] Figure 1 This is a structural diagram of a digital conference system for intelligent speech recognition and recording according to the present invention; Figure 2 A flowchart of the steps of the automatic adaptation method of the scene of the present invention; Figure 3 The figure is a flowchart of the steps of the scene matching algorithm of the present invention. DETAILED DESCRIPTION

[0020] In the following, only some exemplary embodiments are briefly described. As those skilled in the art will appreciate, the described embodiments may be modified in various ways without departing from the spirit or scope of the present invention. Therefore, the drawings and descriptions are considered to be exemplary and non-restrictive in nature.

[0021] The embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0022] In the prior art, when designing digital conference systems, they often focus on meeting basic conference needs, such as voice-to-text, screen sharing, etc., so there are problems such as single application scenarios and only mechanical voice recognition and recording.

[0023] To do this, see Figure 1-3 , an embodiment of the present invention provides a digital conference system for intelligent speech recognition and recording, including a speech recognition and transcription module, a recording module, an intelligent analysis module, a scene adaptation module and a report generation module, wherein a signal sending end of the speech recognition and transcription module is connected to a signal receiving end of the recording module, a signal sending end of the recording module is connected to a signal receiving end of the intelligent analysis module, a signal sending end of the intelligent analysis module is connected to a signal receiving end of the scene adaptation module, and a signal sending end of the intelligent analysis module is connected to a signal receiving end of the report generation module; The speech recognition and transcription module is used to receive the audio signal of the conference room in real time and convert the speech content in the audio signal into text. The speech recognition and transcription module supports the recognition of multiple languages ​​and dialects. The speech recognition and transcription module supports speech recognition in multiple languages, including Chinese, English, French, Spanish, etc., to meet the needs of meetings in different language environments. For some dialects or areas with heavy accents, the system provides dialect recognition function to ensure the accuracy of recognition. The recording module is used to record the text content transcribed by the speech recognition and transcription module in real time and save it as an electronic document. The recording module has a conference recording function, which is used to save the audio content of the conference as an audio file. The recording module has a keyword marking function, which is used to mark key information in the electronic document; Based on the real-time transcription function, the recording module automatically records the text content converted from speech, and supports editing and saving. Participants can mark keywords or important information in the text records, which facilitates quick search later; The real-time transcription and recording functions greatly improve meeting efficiency and reduce the time and cost of manual recording; The intelligent analysis module is used to analyze the voice emotions in the conference recordings, provide emotional feedback to the participants, and identify and extract different topics in the meeting, automatically generate a topic list and corresponding content; the intelligent analysis module can analyze the voice emotions in the meeting, such as excitement, tension, calmness, etc., and provide emotional feedback to the participants; The scenario adaptation module is used to adjust and optimize the functions and performance of the system according to different application scenarios, provide remote access functions, support real-time access and voice recognition recording of remote participants, provide specific interfaces and function options for each application scenario, and realize automatic adaptation of the scenario; The digital conference system supports remote conference functions, which enable real-time access and voice recognition recording of remote participants through video conference software or telephone conference; In lectures and training sessions, the system provides projection and real-time text transcription functions, making it easier for participants to better understand and record the content; During business negotiations, the system provides recording and text recording functions to ensure that the content of the communication between the two parties is completely preserved and provide a reference for the subsequent signing of the agreement; The digital conference system also supports multiple group discussions at the same time and provides independent voice recognition and recording functions for each group; The report generation module is used to automatically generate a meeting report based on the text record of the meeting, including the meeting content, key information and participants, so as to facilitate subsequent review and sharing.

[0024] In one embodiment, the automatic scene adaptation method includes the following steps: Step 1: Environment and equipment monitoring: Use IP address positioning technology to identify the geographic location of participants and preliminarily determine the application scenario. By detecting the type of device used by the user and the access method, the system further refines the application scenario; Step 2: User behavior analysis: Analyze meeting invitations, schedules, and meeting topic information, preliminarily determine the type and purpose of the meeting, and select appropriate application scenarios; Step 3: User interaction behavior monitoring: Monitor user interaction behaviors, including speaking frequency, discussion participation, and voting results, and dynamically adjust application scenarios based on interaction behaviors; Step 4: Scenario matching: Analyze the user's usage history and preference settings, understand the user's needs and habits in different application scenarios, analyze and train user data, and use scenario matching algorithms to match scenarios; Step 5: Provide a user feedback mechanism: The user manually adjusts or confirms the application scenario identified by the system; Step 6: Set up the application scenario library: The application scenario library contains the characteristics, requirements and adaptation solutions of different scenarios. When a new application scenario is identified, the system compares and matches it with the existing scenarios in the library; The scene matching algorithm includes the following steps: S1: Obtain historical user behavior data, analyze and learn the historical user behavior data, and analyze user behavior characteristics and behavior patterns in different application scenarios; S2: Based on the results of historical data analysis, build a machine learning model and continuously adjust the model's parameters and structure to optimize the model; S3: During the meeting, the system collects user behavior data in real time and inputs it into the trained machine learning model for identification. The model determines the current application scenario based on the user's behavior characteristics and behavior patterns; S4: Based on the identified application scenario, the system automatically adjusts the functions and interface of the conference system; S5: Continuously collect new user behavior data and update the machine learning model based on the new user behavior data.

[0025] In one embodiment, in step two, user behavior analysis also includes collecting user behavior data in the conference system, including speaking frequency, discussion participation, voting results, and browsed content, extracting key features from the user behavior data, including speaking duration, discussion topics, and browsed content types, using a clustering analysis algorithm to analyze and identify user behavior features, and preliminarily determining the current application scenario by analyzing user behavior patterns.

[0026] In one embodiment, the intelligent analysis module constructs an emotion model, uses natural language processing and emotion analysis algorithms to analyze the emotion tendency of the content in the text record, identifies the emotional state of the participants in the meeting, displays a statistical chart of the emotion tendency through the interface of the conference system, and provides emotional feedback to the participants; The intelligent analysis module can also identify different topics in the meeting and automatically generate a list of topics and corresponding content to help participants better understand the core issues of the meeting.

[0027] In order to solve the problems existing in the prior art, the embodiment of the present invention provides a digital conference system for intelligent speech recognition and recording, and solves the problems through the above technical solutions: By performing sentiment analysis through the intelligent analysis module and automatically adapting the scene in combination with the scene adaptation module, the system not only significantly improves the meeting experience, but also brings higher flexibility and intelligence. The intelligent analysis module can accurately capture the emotional changes of participants and provide emotional guidance for the meeting, while the scene adaptation module automatically adjusts the meeting settings and interaction methods according to these emotional changes and the actual needs of the current meeting. This dual intelligent mechanism makes the meeting more humane, can better meet the needs of participants, and enhance the participants' sense of participation and satisfaction. In addition, this automated and intelligent processing method also greatly improves the efficiency of the meeting, reduces the tediousness and errors of manual operations, makes the meeting process smoother and more efficient, and solves the problem of single application scenarios and mechanical voice recognition and recording in the existing technology.

[0028] In one embodiment, the signal sending end of the scene adaptation module is connected to the terminal support module; The terminal support module is used to provide users with an interface that supports the access and operation of computers, tablets and mobile terminal devices. This allows users to choose appropriate devices to participate in meetings according to their needs, improving the ease of use and convenience of the system.

[0029] In one embodiment, the signal receiving end of the terminal support module is connected to the user rights management module: The user rights management module is used to set different user roles and permissions, including hosts, participants and administrators; by setting strict permission settings, data security can be ensured. The user rights management module also provides user authentication and access control.

[0030] In one embodiment, the signal receiving end of the terminal support module is connected to a security module; The security module is used to encrypt conference data using data encryption technology. The security module provides access control functions, and only authorized users can view and edit conference data, thereby ensuring the security and privacy of conference data. It also provides users with a more flexible and personalized operating experience.

[0031] In one embodiment, the signal sending end of the scene adaptation module is connected to the interaction module; The interactive module is used to provide real-time interactive functions, including online Q&A and online voting, to achieve interactive meetings, such as through display screens or participants' personal devices. By providing real-time interactive functions, such as online Q&A and voting, the interactivity and participation of the meeting are enhanced.

[0032] In one embodiment, the signal sending end of the report generation module is connected to the data storage module, and the signal sending end of the recording module and the signal sending end of the speech recognition and transcription module are both connected to the signal receiving end of the data storage module; The data storage module is used to manage conference data, including classification, indexing and retrieval of conference data. The data storage module is the key to protecting conference data from loss, damage or theft. By backing up data regularly, data can be quickly restored in the event of system failure, hardware failure or malicious attack, ensuring the integrity and security of conference information.

[0033] When the present invention is working: the user logs in to the system, sets different user roles and permissions through the user permission management module, sets corresponding hosts, participants and managers, and during the meeting, receives the audio signal of the conference room through the voice recognition and transcription module, converts the voice in the audio signal into text, and then the recording module records the text content and saves it as an electronic document, analyzes the conference recording through the intelligent analysis module, analyzes the voice emotions of the participants, and automatically extracts different topics in the meeting to automatically generate a topic list, automatically generates a meeting report through the report generation module, and then provides a specific interface and function options for each application scenario according to the scenario adaptation module to realize automatic adaptation of the scenario, and backs up and manages the data generated by the meeting through the data storage module.

[0034] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of various changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. A digital conference system for intelligent speech recognition and recording, comprising a speech recognition and transcription module, a recording module, an intelligent analysis module, a scene adaptation module and a report generation module, characterized in that: The signal sending end of the speech recognition and transcription module is connected to the signal receiving end of the recording module, the signal sending end of the recording module is connected to the signal receiving end of the intelligent analysis module, the signal sending end of the intelligent analysis module is connected to the signal receiving end of the scene adaptation module, and the signal sending end of the intelligent analysis module is connected to the signal receiving end of the report generation module; The speech recognition and transcription module is used to receive the audio signal of the conference room in real time and convert the speech content in the audio signal into text. The speech recognition and transcription module supports the recognition of multiple languages ​​and dialects. The recording module is used to record the text content transcribed by the speech recognition and transcription module in real time and save it as an electronic document. The recording module has a conference recording function for saving the audio content of the conference as an audio file. The recording module has a keyword marking function for marking key information in the electronic document. The intelligent analysis module is used to analyze the voice emotions in the conference recording, provide emotional feedback to the participants, and identify and extract different topics in the meeting, and automatically generate a topic list and corresponding content; The scenario adaptation module is used to adjust and optimize the functions and performance of the system according to different application scenarios, provide remote access functions, support real-time access and voice recognition recording of remote participants, provide specific interfaces and function options for each application scenario, and realize automatic adaptation of the scenario; The report generation module is used to automatically generate a meeting report based on the text record of the meeting, including the meeting content, key information and participants.

2. According to claim 1, a digital conference system for intelligent speech recognition and recording is characterized in that: The automatic adaptation method of the scene comprises the following steps: Step 1: Environment and equipment monitoring: Use IP address positioning technology to identify the geographic location of participants and preliminarily determine the application scenario. By detecting the type of device used by the user and the access method, the system further refines the application scenario; Step 2: User behavior analysis: Analyze meeting invitations, schedules, and meeting topic information, preliminarily determine the type and purpose of the meeting, and select appropriate application scenarios; Step 3: User interaction behavior monitoring: Monitor user interaction behaviors, including speaking frequency, discussion participation, and voting results, and dynamically adjust application scenarios based on interaction behaviors; Step 4: Scenario matching: Analyze the user's usage history and preference settings, understand the user's needs and habits in different application scenarios, analyze and train user data, and use scenario matching algorithms to match scenarios; Step 5: Provide a user feedback mechanism: The user manually adjusts or confirms the application scenario identified by the system; Step 6: Set up the application scenario library: The application scenario library contains the characteristics, requirements and adaptation solutions of different scenarios. When a new application scenario is identified, the system compares and matches it with the existing scenarios in the library.

3. According to claim 2, a digital conference system for intelligent speech recognition and recording is characterized in that: In step 4, the scene matching algorithm includes the following steps: S1: Obtain historical user behavior data, analyze and learn the historical user behavior data, and analyze user behavior characteristics and behavior patterns in different application scenarios; S2: Based on the results of historical data analysis, build a machine learning model and continuously adjust the model's parameters and structure to optimize the model; S3: During the meeting, the system collects user behavior data in real time and inputs it into the trained machine learning model for identification. The model determines the current application scenario based on the user's behavior characteristics and behavior patterns; S4: Based on the identified application scenario, the system automatically adjusts the functions and interface of the conference system; S5: Continuously collect new user behavior data and update the machine learning model based on the new user behavior data.

4. According to claim 3, a digital conference system for intelligent speech recognition and recording is characterized in that: In step two, the user behavior analysis also includes collecting user behavior data in the conference system, including speaking frequency, discussion participation, voting results, and browsed content, extracting key features from the user behavior data, including speaking duration, discussion topics, and browsed content types, and using a clustering analysis algorithm to analyze and identify user behavior features. By analyzing user behavior patterns, a preliminary judgment is made on the current application scenario.

5. A digital conference system for intelligent speech recognition and recording according to claim 4, characterized in that: The intelligent analysis module constructs an emotional model and uses natural language processing and emotional analysis algorithms to analyze the emotional tendency of the content in the text record, identifies the emotional state of the participants in the meeting, and displays a statistical chart of the emotional tendency through the interface of the conference system.

6. A digital conference system for intelligent speech recognition and recording according to claim 5, characterized in that: The signal sending end of the scene adaptation module is connected to the terminal support module; The terminal support module is used to provide an interface to users and support the access and operation of computer, tablet and mobile terminal devices.

7. A digital conference system for intelligent speech recognition and recording according to claim 6, characterized in that: The signal receiving end of the terminal support module is connected to the user authority management module: The user rights management module is used to set different user roles and rights, including moderators, participants and administrators.

8. The digital conference system for intelligent speech recognition and recording according to claim 7, characterized in that: The signal receiving end of the terminal support module is connected to a security module; The security module is used to encrypt the conference data using data encryption technology. The security module provides an access control function so that only authorized users can view and edit the conference data.

9. The digital conference system for intelligent speech recognition and recording according to claim 8, characterized in that: The signal sending end of the scene adaptation module is connected to the interaction module; The interactive module is used to provide real-time interactive functions, including online question and answer and online voting, to achieve interactive conferences.

10. The digital conference system for intelligent speech recognition and recording according to claim 9, characterized in that: The signal sending end of the report generation module is connected to the data storage module, and the signal sending end of the recording module and the signal sending end of the speech recognition and transcription module are both connected to the signal receiving end of the data storage module; The data storage module is used to manage conference data, including classifying, indexing and retrieving conference data.

Images