Real-time transcription system device and method based on a multi-language conference system

Abstract

The present application belongs to the technical field of conference transcription, and particularly relates to a real-time transcription system device and method based on a multi-language conference system, which comprises a multi-language conference system, a real-time transcription system, an Internet terminal, a self-defined program code and a self-defined extension plug-in, the multi-language conference system is provided with a syntax error compensation function, the multi-language conference system is provided with a paragraph self-definition function, the multi-language conference system is provided with a keyword display function, the multi-language conference system is provided with a multi-language insertion system, one end of the multi-language conference system is connected with the Internet terminal, and one end of the Internet terminal is connected with the real-time transcription device. The real-time transcription system device and method based on the multi-language conference system can complete text editing after transcription, so that the transcribed text is directly usable, and the text has strong watchability during viewing, thereby improving the work efficiency of participants on the transcribed text.

Description

Technical Field

[0001] This invention belongs to the field of conference transcription technology, specifically relating to a real-time transcription system device and method based on a multilingual conference system. Background Technology

[0002] When a company holds a meeting, relevant documents or files are usually printed out and distributed to all attendees. Attendees can browse the printed documents and listen to the speakers at the meeting to stay informed about the meeting's content. Meanwhile, the meeting secretary records the meeting content in real time, and the recorded text serves as the meeting minutes.

[0003] In recent years, specialized technologies have emerged that use the internet and computers to record and transcribe conference speakers' remarks, transmitting them in real time to the monitors of attendees, thus improving meeting efficiency.

[0004] However, existing real-time transcription systems for multilingual conferencing systems merely transcribe the speakers' remarks without modifying the content. The content is often lengthy and disorganized, requiring participants to spend considerable time understanding the transcribed information. Furthermore, while the transcription panel is operable, it lacks user-friendly customizable settings, further reducing meeting efficiency. Therefore, there is an urgent need to design a real-time transcription system and method for multilingual conferencing systems to address these issues. Summary of the Invention

[0005] The purpose of this invention is to provide a real-time transcription system device and method based on a multilingual conference system, in order to solve the problems mentioned in the background art. In the process of using existing real-time transcription systems for multilingual conference systems, the system merely transcribes the speech of the conference speaker in real time without modifying the content of the speech. The content of the speech is often lengthy and disorganized, and the participants need to spend a lot of time to understand the transcribed content. Furthermore, although the transcription panel is operable, it does not allow for convenient user preference settings, which reduces the efficiency of the meeting.

[0006] To achieve the above objectives, the present invention provides the following technical solution: a real-time transcription system device and method based on a multilingual conference system, comprising a multilingual conference system, a real-time transcription system, an internet terminal, custom program code, and custom extension plugins. The multilingual conference system includes a syntax error compensation function, a paragraph customization function, a keyword display function, and a multilingual insertion system. One end of the multilingual conference system is connected to the internet terminal, one end of the internet terminal is connected to the real-time transcription device, and the other end of the internet terminal is connected to the custom program code. The custom program code is configured by a network programmer on a computer device. The network programmer can add the custom program code to the custom extension plugins, and the custom extension plugins can be modified along with the multilingual conference system.

[0007] Preferably, one end of the real-time transcription system is connected to both the main system device and the secondary system device, and the other end of the main system device is connected to both the file insertion system and the voice acquisition system. The file insertion system and the voice acquisition system are both installed on the real-time transcription device. The output end of the main system device is equipped with a display delay function and a sound input system. The output end of the secondary system device is equipped with a voice broadcast function and a document organization function. The input end of the main system device is equipped with a document editing function and a key point summary function. The input end of the secondary system device is equipped with a content organization and summary function and a suggestion prompt function.

[0008] Preferably, the syntax error compensation function can analyze the transcribed sentences. By compensating for the transcribed sentences, the syntax error compensation function can improve the readability of the transcribed document. The paragraph customization function has reading preference settings, which can customize the length and spacing of paragraphs to conform to the reading habits of readers.

[0009] Preferably, the keyword display function can highlight the key points of each sentence, and the keyword display function can provide different marking schemes. The keyword display function can summarize the key points of the meeting by marking words. The multilingual insertion system can change the language text of the real-time transcription device. The paragraph customization function can correct the stable insertion system and the voice acquisition system in real time and change the language text of the real-time transcription system.

[0010] Preferably, the network programmer can write custom program code via computer, and the network programmer can install the custom program code on the custom extension plugin via Internet terminal. Users can download the custom program code on the custom extension plugin for use through the multilingual conferencing system. The installation of the custom extension plugin on the multilingual conferencing system expands the operability of the multilingual conferencing system.

[0011] Preferably, the main device of the system can delay the timeliness of the real-time transcription of the main screen and the secondary screen of the system through the display delay function to prevent users of the main device from making mistakes. The sound input system can be used to collect the sound of the users of the main device during the use of the real-time transcription device and use it on the secondary device of the system. The sound recorded by the sound input system will be set on the stable insertion system.

[0012] Preferably, the voice acquisition system can use the voice broadcast function through the stable insertion system. The voice broadcast function uses the voice recorded by the voice input system. The user of the main system device inputs the voice acquisition system into the real-time transcription system. By selecting the text, the text on the voice acquisition system is transmitted to the voice broadcast function, and the voice broadcast function reads the meeting content to the user of the secondary system device.

[0013] Preferably, the secondary system device can save the document transcribed on the user's screen. The document organization function will save the transcribed content of the meeting to a document at the end of the meeting. The secondary system device will find the title on the transcribed content, attach the date of transcription, form a folder, and place the saved document in the folder. The user of the secondary system device can package and compress the folder and send it to the document software.

[0014] Preferably, users of the real-time transcription system can promptly modify the transcribed content through the display delay function, and can also directly modify the voice acquisition system. Furthermore, after transcription is completed on the secondary device, users of the primary device can still modify the transcribed content through the document editing function. Users of the primary device can highlight key points in the transcribed document through the summary function, providing important information to users of the secondary devices.

[0015] Preferably, the secondary system device internally employs content organization and summarization to effectively integrate the transcribed content, providing users of the secondary system device with concise document presentations. The content organization and summarization also provides users of the secondary system device with convenient settings such as mind maps. The feedback prompt function can mark the content transcribed by the real-time transcription system and send prompts and modification opinions to the main system device. Users of the main system device can modify the transcribed content during the meeting through the markings in the feedback prompt function.

[0016] Compared with the prior art, the beneficial effects of the present invention are as follows: This real-time transcription system device and method based on a multilingual conference system, by combining a multilingual conference system with custom extension plugins, enables conference speakers and participants to use grammar error correction functions, paragraph customization functions, keyword display functions, and a multilingual insertion system to complete the editing of the transcribed text. This makes the transcribed text directly usable and highly readable. Furthermore, the multilingual conference system can improve the efficiency of participants in transcribing text by using custom extension plugins to modify internal documents and the multilingual conference system operating system.

[0017] The voice acquisition system set up in this invention enables speakers who frequently give speeches and people with special needs who cannot speak to give speeches and transcribe them. People who cannot speak can use the system's built-in voice system to speak through the voice broadcast function, while speakers who are tired of giving speeches can record their own voice through the voice input system and then read the text on the voice acquisition system through the voice broadcast function, thereby improving the real-time transcription capabilities of the multilingual conference system. Attached Figure Description

[0018] Figure 1 This is a block diagram of the multilingual conferencing system platform of the present invention.

[0019] Figure 2 This is a block diagram of the real-time transcription system platform of the present invention. Detailed Implementation

[0020] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0021] Please see the appendix Figure 1-2 The present invention provides several embodiments:

[0022] A real-time transcription system and method based on a multilingual conferencing system includes a multilingual conferencing system, a real-time transcription system, an internet terminal, custom program code, and custom extension plugins. The multilingual conferencing system is equipped with a syntax error compensation function, a paragraph customization function, a keyword display function, and a multilingual insertion system. One end of the multilingual conferencing system is connected to the internet terminal, one end of the internet terminal is connected to the real-time transcription device, and the other end of the internet terminal is connected to the custom program code. The custom program code is configured by a network programmer on a computer device. The network programmer can add the custom program code to the custom extension plugins, and the custom extension plugins can be modified along with the multilingual conferencing system.

[0023] The real-time transcription system is connected to both a main system device and a secondary system device at one end. The main system device is used by the speakers at the conference, and the secondary system device is used by the attendees. The main system device is connected to both a file insertion system and a voice acquisition system at the other end. Both the file insertion system and the voice acquisition system are installed on the real-time transcription device. The main system device has a display delay function and a sound input system at its output end. The secondary system device has a voice broadcast function and a document organization function at its output end. The main system device has a document editing function and a key point summary function at its input end. The secondary system device has a content organization and summary function and a feedback prompt function at its input end.

[0024] The grammar error correction function analyzes the transcribed sentences and improves the readability of the transcribed document by compensating for the errors. In the context of globalization, Chinese has become one of the most popular languages ​​in the world. However, Chinese learners often lack rich and systematic grammatical knowledge, and the influence of their mother tongue makes it difficult to accurately identify and correct grammatical errors. Therefore, a Chinese grammar correction system is essential. The paragraph customization function includes reading preference settings, allowing users to customize paragraph length and spacing to suit their reading habits and improve reading efficiency.

[0025] The keyword display function can highlight the key points of each sentence and provides different marking schemes. By marking words, the key points of the meeting can be accurately located and summarized. The multilingual insertion system can change the language text of the real-time transcription device. The paragraph customization function can correct the real-time insertion system and the voice acquisition system, change the language text of the real-time transcription system, and make it usable by people from different countries.

[0026] The network programmer can write custom program code on a computer and install it on a custom extension plugin via an internet terminal. Users can download and use the custom program code on the custom extension plugin through the multilingual conferencing system. The installation of the custom extension plugin on the multilingual conferencing system expands the operability of the system. The custom extension plugin can be installed by the network programmer or by the system terminal personnel of the multilingual conferencing system. The system terminal personnel of the multilingual conferencing system can also update the multilingual conferencing system, improving the ease of use of the multilingual conferencing system.

[0027] The system's main device can delay the real-time transcription of the main and secondary screens through a display delay function, preventing accidental opening of confidential documents by users of the main device and their leakage to the participants' displays. The voice input system can be used to collect the voice of users of the main device during the real-time transcription process, and the secondary device can select the system voice broadcast function and the voice input system voice for listening and use. The voice input system will be set on the stable insertion system.

[0028] The voice acquisition system can be used for voice broadcasting via a stable insertion system. The voice broadcasting function uses the voice recorded by the voice input system. The user of the main system device inputs the voice acquisition system into the real-time transcription system. By selecting the text, the text on the voice acquisition system is transmitted to the voice broadcasting function, which reads it aloud to the user of the secondary system device. When the speaker has a sore throat or cannot speak for special reasons, the voice acquisition system and voice broadcasting function can continue to read to the participants. At the same time, the voice acquisition system can directly transmit the text to the document processing function, improving the interactivity of the real-time transcription system.

[0029] The system's secondary device can save documents transcribed on the user's screen. The document organization function saves the transcribed content to a document at the end of the meeting. The secondary device will find the title on the transcribed content, attach the date of transcription, form a folder, and place the saved document in the folder. The user of the secondary device can package and compress the folder and send it to the document software to prevent document loss. The file system can be viewed again after the meeting to deepen the understanding of the meeting's central ideas.

[0030] The real-time transcription system allows users to promptly modify the transcribed content using the display delay function, and also enables direct modifications to the voice acquisition system. Furthermore, after transcription is completed on the secondary device, users on the primary device can still edit the transcribed content using the document editing function. Users on the primary device can highlight key points in the transcribed document using the summary function, providing crucial information to users on the secondary devices. Seeing these highlighted points allows attendees to better understand the core of the meeting and emphasize its focus.

[0031] The system's secondary device employs content organization and summarization to effectively integrate the transcribed content, providing users with concise presentations. This content organization and summarization also offers convenient user settings such as mind maps, enabling participants to more clearly understand the main ideas of the speakers. The feedback prompting function marks the content transcribed by the real-time transcription system and sends prompts and suggestions for improvement to the main system device. Users of the main system device can then modify the transcribed content during the meeting through these prompts, thus improving the overall meeting quality.

[0032] The uses of classroom interactive feedback systems include agile teaching methods that can promptly identify students' levels of understanding and their opinions on important issues; allowing teachers to understand students' learning progress in the same class, assess their comprehension, correct errors, and provide differentiated instruction to meet each student's specific learning needs. Classroom interactive feedback technology can be traced back to at least the 1960s, with the earliest relevant data dating back to 1970, when wired systems were already used to generate feedback data. In 1996, Rice University in the United States first used wireless feedback devices. By 2000, Harvard University's agile teaching method, also known as "personalized instruction," benefited greatly from the assistance of this feedback technology, which enabled its widespread adoption.

[0033] When in use, this system allows for the installation of custom extension plugins within a multilingual conferencing system. This allows for modifications to the operation interface of the real-time transcription device. Features such as syntax error correction, paragraph customization, keyword display, and multilingual insertion automatically correct documents transcribed by the device, specially mark keywords, and translate documents into various languages, improving meeting efficiency. Furthermore, custom program code edited by network programmers can be installed on the custom extension plugins via internet terminals, enhancing their functionality.

[0034] When in use, the system allows conference speakers to input their own voices through the voice input system. Two functions are available: a stable insertion system and a voice acquisition system for transcribing conference content. The voice acquisition system can use a voice broadcast function via a secondary device, which outputs pre-recorded audio from the voice input system, reducing the speaker's speaking time. The system allows for real-time speaking via the device's audio input and transmits the audio as a document without transcription, or transcribes it using the stable insertion system. The secondary device provides additional functions such as system input and feedback prompts, while the main device provides document editing and key point summaries, all of which greatly improve conference efficiency.

[0035] It will be apparent to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above, and that the invention can be implemented in other specific forms without departing from its spirit or essential characteristics. Therefore, the embodiments should be considered in all respects as exemplary and non-limiting, and the scope of the invention is defined by the appended claims rather than the foregoing description. Thus, all variations falling within the meaning and scope of equivalents of the claims are intended to be included within the present invention. No reference numerals in the claims should be construed as limiting the scope of the claims.

Claims

1. A real-time transcription system and method based on a multilingual conferencing system, comprising a multilingual conferencing system and a real-time transcription system, characterized in that: The multilingual conferencing system is equipped with a grammar error compensation function, a paragraph customization function, a keyword display function, and a multilingual insertion system. One end of the multilingual conferencing system is connected to an internet terminal, one end of which is connected to a real-time transcription device, and the other end of which is connected to custom program code. The custom program code is configured by a network programmer on a computer device, and the network programmer can add the custom program code to a custom extension plugin, which is used to extend the functionality of the multilingual conferencing system.

2. The real-time transcription system device and method based on a multilingual conferencing system according to claim 1, characterized in that: One end of the real-time transcription system is connected to both the main system device and the secondary system device. The other end of the main system device is connected to both the file insertion system and the voice acquisition system. The file insertion system and the voice acquisition system are both installed on the real-time transcription device. The output end of the main system device is equipped with a display delay function and a sound input system. The output end of the secondary system device is equipped with a voice broadcast function and a document organization function. The input end of the main system device is equipped with a document editing function and a key point summary function. The input end of the secondary system device is equipped with a content organization and summary function and a suggestion prompt function.

3. The real-time transcription system device and method based on a multilingual conferencing system according to claim 1, characterized in that: The syntax error compensation function can analyze the transcribed sentences and improve the readability of the transcribed document by compensating for the transcribed sentences. The paragraph customization function has reading preference settings, which can customize the length and spacing of paragraphs to suit the reading habits of readers.

4. The real-time transcription system device and method based on a multilingual conferencing system according to claim 3, characterized in that: The keyword display function can highlight the key points of each sentence. The keyword display function can provide different marking schemes. The keyword display function can summarize the key points of the meeting by marking words. The multilingual insertion system can change the language text of the real-time transcription device. The paragraph customization function can correct the stable insertion system and the voice acquisition system in real time and change the language text of the real-time transcription system.

5. The real-time transcription system device and method based on a multilingual conferencing system according to claim 4, characterized in that: The network programmer can write custom program code using a computer, and can install the custom program code on a custom extension plugin via an Internet terminal. Users can download and use the custom program code on the custom extension plugin through a multilingual conferencing system.

6. The real-time transcription system device and method based on a multilingual conferencing system according to claim 2, characterized in that: The main device of the system can delay the timeliness of real-time transcription of the main screen and the secondary screen of the system through the display delay function to prevent users of the main device from making mistakes. The sound input system can be used to collect the sound of the user of the main device during the use of the real-time transcription device and use it on the secondary device. The sound recorded by the sound input system will be set on the stable insertion system.

7. The real-time transcription system device and method based on a multilingual conferencing system according to claim 6, characterized in that: The voice acquisition system can be used for voice broadcasting through a stable insertion system. The voice broadcasting function uses the voice recorded by the voice input system. Users of the main system device can input the voice acquisition system into the real-time transcription system and transmit the text from the voice acquisition system to the voice broadcasting function by selecting it. The voice broadcasting function then reads the meeting content aloud to users of the secondary system device.

8. The real-time transcription system device and method based on a multilingual conferencing system according to claim 7, characterized in that: The secondary system device can save documents transcribed on the user's screen. The document organization function will save the transcribed content to a document at the end of the meeting. The secondary system device will find the title on the transcribed content, attach the date of transcription, form a folder, and place the saved document in the folder. The user of the secondary system device can package and compress the folder and send it to the document software.

9. The real-time transcription system device and method based on a multilingual conferencing system according to claim 8, characterized in that: Users of the real-time transcription system can promptly modify the transcribed content using the display delay function, and can also directly modify the voice acquisition system. Furthermore, after transcription is completed on the secondary device, users of the primary device can still modify the transcribed content using the document editing function. Users of the primary device can highlight key points in the transcribed document using the summary function, providing important information to users of the secondary devices.

10. The real-time transcription system device and method based on a multilingual conferencing system according to claim 9, characterized in that: The secondary system device employs content organization and summarization to effectively integrate the transcribed content, providing users with concise document presentations. This content organization and summarization also offers users convenient mind mapping features. A feedback prompt function allows users to mark the transcribed content and send prompts and modification suggestions to the main system device. Users of the main system device can then modify the transcribed content during meetings using these prompts.

Images