Electronic conference file management method and system

Abstract

The invention discloses an electronic conference file management method and system, and the method comprises the steps: starting a conference according to a conference agenda, and sequentially starting a conference unit corresponding to each spokesman; each conference unit acquires audio and video of a corresponding speaker through a pickup microphone and a camera and transmits the audio and the video to the conference host in real time, and the conference host transmits the audio to the sound amplification system for field sound amplification and transmits the video to the screen for displaying and playing; the audio is converted into a text in real time, timestamps are synchronously added into the audio and the video in combination with Beidou time service and network time service protocols, and then the audio, the video, the text and the timestamps are stored in real time to form all-media conference data; and the upper computer gathers the all-media conference data of each conference unit and performs classified storage to form an electronic conference file, so that a large amount of labor and time are saved, and the electronic conference file stored according to a preset rule is directly formed after the conference.

Description

Technical Field

[0001] The present invention relates to an electronic conference file management method and system, belonging to the technical field of audio and video conference systems. Background Art

[0002] At present, the technologies in audio, video encoding and decoding, transmission, storage, etc. in audio and video conference systems and related fields have been quite mature. Traditional local diffusion audio daisy-chain conference systems and remote video conference systems are often relatively independent and each complete their corresponding tasks. Although there have been attempts to integrate these two sets of systems to achieve the combination of the functions of the local daisy-chain audio sound reinforcement system and the remote video conference system, there is still a lack of substantial technologies and solutions in the aspects of the local daisy-chain audio sound reinforcement system, video conferencing, local camera tracking, and local systematic recording and practical file recording.

[0003] Specifically, the work of meeting records still requires a large number of personnel to sort out, summarize and collate at present, and only stays at the simple level of file storage. The large-scale local sound reinforcement and camera tracking conference system based on the local daisy-chain conference system can achieve clear on-site sound reinforcement for each participant, smooth conference agenda control and management functions, but in terms of meeting records, on-site quick note-taking by humans is still required, and at the same time, the audio equipment is responsible for the audio recording and video recording of the whole meeting. After the meeting, it takes a lot of time for humans to sort out the meeting records, and even some meetings are not sorted out, thus reducing the presentation of the meeting results and the effect of normal implementation.

[0004] In addition, the participants in large-scale meetings are often temporary participants. If the participants and assistant personnel cannot obtain the conference files in time, the expected conference effect cannot be achieved. Existing technologies often only have simple audio file storage, video file storage or separate agenda control, and do not design complete meeting form record content. Simply saving a file requires a huge amount of subsequent processing work, and many participants are temporary participants. After the meeting, they cannot obtain the corresponding meeting content in time according to their corresponding permissions and responsibilities. Therefore, there is a lack of a system that can solve the complete conference speech files such as audio recording, video recording, text recording, and time based on the agenda in the conference agenda.

[0005] In summary, after years of development, although the audio and video conference system has been mature, there are still substantial deficiencies in technologies and solutions in meeting records. Therefore, it is urgent to research and design a new electronic conference file management system. Summary of the Invention

[0006] In view of the above existing technical problems, the present invention provides an electronic conference file management method and system to solve technical problems such as conference agenda management, speech control, camera tracking, image transmission and storage, audio amplification and storage of a local sound reinforcement system, as well as speech-to-text conversion, audio and video preservation based on the conference agenda, so as to achieve the technical purpose of saving a large amount of labor and time and directly forming conference files after the conference.

[0007] To achieve the above technical purpose, the present invention provides an electronic conference file management method, including the following steps:

[0008] S1. Enter the conference information, participant information, and seat information on the host computer and bind them.

[0009] S2. Compile the conference agenda on the host computer according to the time axis, including speaking time, speaking order, topic name, sound reinforcement parameters, and screen projection materials.

[0010] S3. Start the conference according to the conference agenda and sequentially activate the conference unit corresponding to each speaker; each conference unit collects the audio and video of the corresponding speaker through a pickup microphone and a camera, and transmits the audio and video to the conference host in real time. The conference host then transmits the audio to the sound reinforcement system for on-site sound reinforcement and the video to the screen for display and playback; while collecting the audio and video, each conference unit converts the audio into text in real time, combines the Beidou time service and the network time service protocol, synchronously adds time stamps to the audio and video, and then stores the audio, video, text, and time stamps in real time to form all-media conference materials, and then sends the all-media conference materials to the host computer through the conference host.

[0011] S4. The host computer aggregates the all-media conference materials of each conference unit, including speaker information, speaking time, the speaker's audio, video, text, and time stamps, as well as screen projection materials, and classifies and stores all the all-media conference materials according to the conference agenda, conference time, participants, and speakers to form electronic conference files.

[0012] Further, for the method of the present invention, the step of sending the all-media conference materials to the host computer through the conference host includes the following steps:

[0013] Each conference unit judges the size and time of the stored file according to the storage space. When the file storage reaches the set value, it queries the bus data situation and judges whether there is data exceeding the set value being transmitted on the bus;

[0014] If so, the conference unit waits for a certain time and then queries the bus data situation again; if not, the conference unit sends the all-media conference materials to the conference host, and then the conference host sends them to the host computer.

[0015] Further, in the method of the present invention, if the administrator requests to view the audio and video during a speech, the corresponding conference unit will push the audio and video of the speaker to the host computer for display through the conference host.

[0016] Further, in the method of the present invention, when the audio and video stored in the conference unit cannot be sent to the conference host and the host computer in time, the conference unit and the conference host will perform timestamp synchronization and update the speech time point.

[0017] Moreover, the present invention also provides an electronic conference file management system, which utilizes the above-mentioned electronic conference file management method, and includes several conference units, a conference host, several sound reinforcement systems, a screen and a host computer; several conference units are connected in series and then connected to the conference host; the conference host is respectively connected to several sound reinforcement systems, the screen and the host computer.

[0018] Each conference unit includes a main control module, and an audio acquisition module, a video acquisition module, an audio-to-text module, a Beidou time service module, and a memory module respectively connected thereto;

[0019] Among them, the main control module is used to start the conference according to the conference agenda and sequentially turn on the conference units corresponding to each speaker; the audio acquisition module is used to collect the audio of the corresponding speaker through a pickup microphone and transmit the audio to the conference host in real time; the video acquisition module is used to collect the video of the corresponding speaker through a camera and transmit the video to the conference host in real time; the audio-to-text module is used to convert the audio into text in real time while collecting the audio and video; the Beidou time service module is used to add the timestamp to the audio and video in real time by combining Beidou time service and network time service protocol while collecting the audio and video; the memory module is used to store the audio, video, text and timestamp in real time to form all-media conference materials and send them to the conference host.

[0020] The conference host is used to transmit the audio to the sound reinforcement system for on-site sound reinforcement, and transmit the video to the screen for display and playback; and send the all-media conference materials to the host computer.

[0021] The host computer includes an input module and an archiving module;

[0022] Among them, the input module is used to input conference information, participant information and seat information and bind them; compile the conference agenda according to the time axis, including speech time, speech order, topic name, sound reinforcement parameters, and projection materials; the archiving module is used to summarize the all-media conference materials of each conference unit, including speaker information, speech time, the speaker's audio, video, text and timestamp, and projection materials, and classify and store all the all-media conference materials according to conference topics, conference time, participants, and speakers to form an electronic conference file.

[0023] In summary, the present invention provides an electronic conference file management system for a local sound reinforcement hand-in-hand conference system, which records conference audio, video, and text according to the conference agenda. During the conference speech, this system automatically generates electronic file records for each speaker and the entire conference, solving a series of technical problems in the local sound reinforcement system, such as conference agenda management, speech control, camera tracking, image transmission and storage, audio amplification and storage, and the preservation of agenda files for speech-to-text, audio, and video based on the conference agenda. Moreover, through the real-time transcription function of the local sound reinforcement voice, this system converts the voice content into text, and classifies and summarizes the information according to the conference agenda, speech order, speaker, speech time, speech duration, and video collection of individual speakers during the speech process. After the conference, a complete, clearly classified, and closely related electronic conference file is automatically generated according to the conference agenda.

[0024] This not only greatly saves labor and time costs, but also enables the formation of electronic conference files immediately after the conference. Personnel with different roles and permissions can copy or save their complete conference file information on-site, and has the following technical effects:

[0025] (1) Intelligent switching and tracking: The present invention automatically switches the pick-up microphone of the speaker and the conference camera tracking according to the conference agenda, and at the same time realizes the switching and recording of conference documents, PPT and other interfaces. Based on the timeline, it saves and classifies all the conference content of each speaker in real time, as well as the interactive information such as sign-in, voting, voting, and scoring of each participant.

[0026] (2) Conference file management: The conference records generated in real time by the system of the present invention are classified and divided according to the conference agenda and speech process, and it is easy to generate an all-media conference record sorted by the conference agenda or a conference agenda record classified by personnel, which is convenient for subsequent reference and management.

[0027] (3) Permission management and distribution: The system of the present invention provides a permission management function for conference documents to ensure the safety and accuracy of the record of real-time conference content and prevent the file from being tampered with. At the same time, the system also supports the distribution and invocation of conference documents according to permissions, meeting the needs of different roles for conference information.

[0028] Compared with the prior art, the technical advantages of the present invention are mainly reflected in the following aspects:

[0029] (a) Full-process automated conference recording, convenient and efficient: Compared with the existing conference system, the system of the present invention has a more convenient conference recording function, which does not require manual operation throughout the process, and can automatically form all the conference record information based on the agenda and individual speeches, greatly improving the efficiency and accuracy of conference recording.

[0030] (b) Overall recording and saving of information related to the meeting agenda: The system of the present invention manages the meeting according to the pre-set agenda, and can record and save in detail information such as the speaking time, speaking order, speaking position, corresponding camera images, and projected meeting documents of each participant. This overall recording and saving method makes the meeting content more complete and orderly, facilitating subsequent access and management.

[0031] (c) Implementing all-media recording and saving to form a complete meeting archive: Compared with traditional simple recording and broadcasting systems or simple sound reinforcement and speaking systems, the system of the present invention fully realizes the all-media recording and saving of documents, and can automatically form a complete meeting archive for this meeting and this department or institution without manual intervention. This not only facilitates work such as querying, filing, and archiving, but also improves the management efficiency and utilization value of meeting materials.

[0032] (d) The meeting record has a time stamp to ensure the fairness and reliability of the meeting: The meeting record automatically generated by the system of the present invention has a time stamp function, and the document saving time is consistent with the meeting time. The system of the present invention can cover the preservation of interactive information such as speaking operations, signing in, voting, and polling, effectively preventing post-meeting modification and tampering. This feature ensures the fairness and reliability of the meeting and provides strong support for meeting decisions. Description of the Drawings

[0033] Figure 1 It is a flow chart of the steps when the method of the present invention is implemented;

[0034] Figure 2 It is an interface diagram of the electronic meeting archive when the method of the present invention is implemented.

[0035] Figure 3 It is a structural schematic diagram when the system of the present invention is implemented;

[0036] Figure 4 It is a principle block diagram when the system of the present invention is implemented;

[0037] Figure 5 It is an electrical principle block diagram of the meeting unit when the system of the present invention is implemented. Detailed Embodiments

[0038] To make the objectives, technical solutions, and advantages of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below in conjunction with the embodiments of the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the scope of protection of the present invention.

[0039] Embodiment 1: As Figure 1As shown in the figure, this embodiment provides an electronic conference file management method, and the specific steps are introduced as follows.

[0040] S1. Enter the conference information, information of participants, and seat information on the host computer and bind them.

[0041] Specifically, before the conference, enter and bind the conference information, information of participants, and seat information in the host computer PC software respectively. The conference information includes the conference name, location, date, category, and level. Among them, the conference category includes seminars, bilateral and multilateral talks, and report speeches, which are used to control the speaker order and speech time management. The conference level includes primary, intermediate, and advanced. The information of participants includes name, position, work unit, and photo.

[0042] S2. Compile the conference agenda on the host computer according to the time axis, including the speech time, speech order, topic name, sound reinforcement parameters, and screen projection materials.

[0043] Specifically, the conference agenda is based on the time axis and is determined according to the nature, scale, level, topics, and information of participants of the conference before the conference, including the speech time, speech order, topic name, speech duration, speech mode, sound reinforcement parameters, screen projection materials, etc.

[0044] Moreover, after the information of participants is bound to the seat information, the names of the participants are displayed on the seat map, a seat map binding the participants and seats is generated, and the seat map is displayed on the screen to indicate the participants to take their seats according to the seats.

[0045] S3. After starting the conference, it includes the following sub-steps:

[0046] S3-1. Start the conference according to the conference agenda and sequentially turn on the conference unit corresponding to each speaker.

[0047] Specifically, the conference is started by the host or the conference chairperson, the meeting is held according to the conference agenda, and the speaker is invited to turn on the corresponding conference unit to speak according to the speech order. Specifically, during the progress of the conference agenda, turn on the pickup microphone and the conference camera in front of the speaker, project the corresponding files and images, and adjust the sound reinforcement system to ensure the most faithful restoration of the sound quality and tone adjustment on-site and maintain uniform on-site sound reinforcement. And the ways to turn on the conference unit include: the host turns on the pickup microphone of the conference unit corresponding to the speaker, the pickup microphone of the conference unit corresponding to the next speaker is automatically turned on after the previous speaker finishes speaking, and the speaker manually turns on the pickup microphone of the corresponding conference unit.

[0048] S3-2. Each conference unit collects the audio and video of the corresponding speaker through a pickup microphone and a camera, and transmits the audio and video to the conference host in real time. The conference host then transmits the audio to the sound reinforcement system for on-site sound reinforcement, and transmits the video to the screen for display and playback. While collecting the audio and video, each conference unit converts the audio into text in real time, and combines the Beidou time service and the network time service protocol to synchronously add timestamps to the audio and video. Then, the audio, video, text, and timestamps are stored in real time to form all-media conference materials.

[0049] During specific implementation, when the speaker starts speaking, the corresponding conference unit collects, transmits and projects the video of the speaker for display, and stores it, and also collects, transmits and amplifies the sound of the speaker, converts it into text, and stores it, and saves the video, audio, text, etc. to the all-media conference materials.

[0050] Specifically, when the conference unit in front of the speaker enters the speaking state, the pickup microphone and the conference camera of the conference unit are turned on to collect the audio and video of the speaker respectively. At the same time, the conference unit transmits the audio and video streams to the conference host, the conference host transmits the audio to several sound reinforcement systems, and the audio is amplified on-site through the sound reinforcement system, and the conference host transmits the video to the screen, and the video is displayed and played through the screen.

[0051] Moreover, when the speaker starts speaking, the voice of the speaker is converted into a digital PCM code stream and sent to the speech transcription engine. The speech transcription engine converts the voice into text and sends the text back to the conference unit, and the text is displayed and stored through the conference unit.

[0052] Meanwhile, the speaking action of the speaker triggers the real-time recording function of the conference unit. Combining the Beidou time service and the network time service protocol, the timestamp is saved to the video and audio, and the audio, video, and text are stored in the conference unit in real time as all-media conference materials.

[0053] In addition, information such as sign-in, projection, voting, and scoring saved in the conference unit is also saved to the all-media conference materials.

[0054] S3-3. Send the all-media conference materials to the host computer through the conference host.

[0055] During specific implementation, when the speaker finishes speaking, the conference unit in front of the speaker archives the complete all-media conference materials and sends them to the conference host. Then the conference host sends the received all-media conference materials to the host computer, and the host computer PC software archives and stores them.

[0056] In other embodiments, the step of sending the all-media conference materials to the host computer via the conference host includes the following steps: Each conference unit determines the size and time of the stored files according to the storage space, and when the file storage reaches the set value, queries the bus data situation and determines whether there is data exceeding the set value being transmitted on the bus.

[0057] Specifically, the bus data situation is mainly calculated based on the number of audio and video streams on the bus. Usually, one 1080P image and one 48K 24-bit audio are regarded as one stream, and one stream is about 8-10 Mbps. Therefore, a 100M network will not run a large number of streams simultaneously, and generally, it is controlled below 5 streams. Therefore, the conference unit needs to query how many streams are currently being transmitted by the conference host before sending data.

[0058] If there is data exceeding the set value being transmitted on the bus, that is, the number of streams transmitted by the conference host exceeds the set number, it means the network is busy or the bus is occupied. The conference unit does not immediately send data such as audio and video to the conference host, but waits for a certain time and then asks the conference host about the data situation again. At this time, the conference unit in the ongoing conference will send the synchronization information of the speech (including the time information and control information of the speech) and the progress time point (referring to the time progress situation of the speech, including the information of the conference unit currently speaking, and the time of the conference unit's speech, etc.) to the host computer via the conference host, and the status of the ongoing conference is still displayed on the host computer.

[0059] If there is no data exceeding the set value being transmitted on the bus, that is, the number of streams transmitted by the conference host is less than the set value, it means the conference unit can continue to send data such as audio and video to the conference host. At this time, the all-media conference materials stored in the conference unit are packaged and sent to the conference host, and then sent to the host computer via the conference host.

[0060] In other embodiments, when the audio and video streams stored in the conference unit have not been uploaded to the conference host and the host computer PC software, the conference unit will synchronize the time stamps with the conference host and update the speech time point. In this way, even during the idle time after the conference, the files transmitted from the conference host to the host computer are consistent with the time on the conference unit.

[0061] In other embodiments, if the administrator requests to view the audio and video of the person speaking, the corresponding conference unit will push the audio and video of the speaker to the host computer for display via the conference host. Specifically, during the conference, if the administrator needs to click to view the real-time video or audio, the corresponding conference unit will transmit the audio and video of the speaker to the conference host, and then send it to the host computer PC software via the conference host.

[0062] S4. The host computer summarizes the all-media conference materials of each conference unit, including speaker information, speaking time, the audio, video, and text of the speaker, as well as the screen projection materials, and classifies and stores all the all-media conference materials according to the conference topics, conference time, participants, and speakers to form an electronic conference file.

[0063] During specific implementation, after the last speaker finishes speaking, the audio data, video data, etc. of all conference units are sent to the host computer through the conference host. The host computer uses a PC as the management terminal and summarizes the speaker information, speaking time, the audio, video, and text of the speaker, as well as the screen projection materials corresponding to each conference unit through PC software, so as to form a set of electronic conference files and perform storage and document management on this set of electronic conference files.

[0064] Moreover, the host computer stores the electronic conference files according to the time axis and conference-related index information. The index information includes conference topics, conference time, participants, speakers, etc. Subsequently, the electronic conference files can be read and copied according to permissions. Specifically, after a regular conference is completed, video files and audio files are usually saved, but existing devices do not have the function of classifying conference files. However, the method of the present invention stores and saves the audio files and video files according to information such as conference topics, conference time, participants, and speakers during the conference. For example: when storing the electronic conference files according to the speaker, when speaker A makes a speech, the PC software of the host computer stores the collected audio, video, text, and timestamp of speaker A according to the set rules. And, there will be speech files of multiple speakers under each conference (including speaker information, speaking time, the audio, video, and text of the speaker, as well as the screen projection materials). For example: if there are speakers A, B, C, and D in this conference, then the PC software of the host computer will store the speech files of these four speakers in the electronic conference file of this conference.

[0065] As Figure 2 shown, through the above steps, a complete electronic conference file of this conference is finally formed, including conference information, conference agenda, and the topic names of each speaker, conference text records, speech recordings, and speech videos displayed according to the time axis. Moreover, the electronic conference file can be displayed on the display screen of the conference unit or on the host computer. It can not only view the speech text of the speaker, but also click to play the audio content and video content. In addition, the administrator can view the content of the electronic conference file in real time, and can also copy the electronic conference file to relevant personnel after the conference is completed.

[0066] In summary, the method of the present invention solves the problems of meeting agenda management, speech control, camera tracking, image transmission and storage, audio amplification and storage in the meeting system, as well as the preservation of agenda files of speech-to-text, audio, and video based on the meeting agenda, forming accurate and efficient electronic meeting files, and can form electronic meeting files classified and stored according to various custom rules such as based on a personnel list, based on a meeting list, and based on an agenda list, so as to facilitate archiving, retrieval, distribution, etc. Moreover, through unified time management and time stamps, it is ensured that the recorded meeting content will not be tampered with and the integrity of the meeting is maintained.

[0067] Embodiment 2: The system of the present invention.

[0068] In order to implement the functions of meeting agenda management and meeting file recording, as Figure 3 , Figure 4 shown, this embodiment provides an electronic meeting file management system, including a plurality of meeting units, a meeting host, a plurality of sound reinforcement systems, a screen, and a host computer; the plurality of meeting units are connected in series end to end and finally connected to the meeting host; the meeting host is respectively connected to the plurality of sound reinforcement systems, the screen, and the host computer, and the specific introduction is as follows.

[0069] (1) As Figure 4 shown, the meeting unit includes a main control module, and an audio acquisition module, a video acquisition module, an audio-to-text module, a Beidou time service module, a memory module, a display screen, and operation buttons respectively connected thereto.

[0070] Among them, the main control module is used to start the meeting according to the meeting agenda and sequentially turn on the meeting units corresponding to each speaker; the audio acquisition module is used to collect the audio of the corresponding speaker through a pickup microphone and transmit the audio to the meeting host in real time; the video acquisition module is used to collect the video of the corresponding speaker through a camera and transmit the video to the meeting host in real time; the audio-to-text module is used to convert the audio into text in real time while collecting the audio and video; the Beidou time service module is used to synchronously add time stamps to the audio and video while collecting the audio and video by combining Beidou time service and network time service protocols; the memory module is used to store the audio, video, text, and time stamps in real time, form all-media meeting materials, and send them to the meeting host.

[0071] Specifically in implementation, the meeting unit, as the core component of the system of the present invention, undertakes multiple key functions, including speech management, image display, audio acquisition and amplification, audio and video signal transmission, and display and prompt of various status information. Moreover, software functions of the meeting unit are also designed, covering multiple key links such as real-time image acquisition, speech-to-text, text back transmission and recording, audio and video merging, and data recording and transmission.

[0072] As Figure 5 shown, to meet the need of meeting records, the meeting unit needs to have powerful computing, storage and transmission capabilities. Its exterior includes a pickup microphone, a display screen, a meeting camera and operation buttons. Its interior uses a domestic RK3588 chip circuit, as well as a pickup microphone, a meeting camera, a Beidou timing module, an NVME SSD storage circuit, a display screen circuit, a button circuit, a PHY and switch circuit, a USB interface circuit, and other functional circuits that are respectively connected to the RK3588 chip circuit.

[0073] Among them, the main control module uses the RK3588 chip circuit to implement main control, audio and video encoding and decoding, storage and transmission functions, and at the same time realizes image acquisition of the meeting camera, audio data acquisition and conversion, NVME SSD memory drive, display screen drive and display, as well as control and management of the Beidou timing circuit and other peripheral interfaces, etc.

[0074] The audio acquisition module includes a pickup microphone and a CODEC audio circuit. The pickup microphone is connected to the CODEC audio circuit. The CODEC audio circuit is connected to the RK3588 chip circuit through an I2S interface, and the voice of the speaker is collected through the pickup microphone to ensure on-site sound amplification and recording-related operations. Then, the collected sound is converted into a digital audio I2S signal through the CODEC audio circuit, and this part of the data is processed and transmitted to the meeting host through a dedicated network cable.

[0075] The video acquisition module includes a meeting camera. The meeting camera is connected to the RK3588 chip circuit through an MIPI interface, and images are acquired using a conventional image format and then transmitted to the meeting host through a dedicated network cable.

[0076] The audio-to-text module uses an open-source transcription engine, which is developed and integrated through embedded software, so as to convert the collected speaker audio into text in real time, and this text can be used as subtitles.

[0077] The Beidou timing module includes a Beidou timing module and is connected to the RK3588 chip circuit through a UART interface to save timestamps into videos and audios. And, the Beidou timing module and the network circuit are combined to accurately time the system of the present invention, thereby synchronizing the clocks to ensure the accuracy of the speaking time during the meeting and the consistency of the recorded videos and sounds.

[0078] The memory module includes an NVME SSD storage circuit and is connected to the RK3588 chip circuit through a PCIE interface, and is used to save audio, video, and text in real time as all-media meeting materials, and save them in a conventional audio and video format.

[0079] The display screen circuit includes a 1080P high-definition display screen. As an important display and operation interface of the conference unit, the 1080P high-definition display screen realizes setting and interaction functions through embedded software, integrates the all-round control ability of the conference agenda, and covers core functions such as conference sign-in, voting, real-time document marking and annotation, and screen projection document display. It also supports interactive communication between front-row and back-row participants, such as instant operations like calling for service and requesting water, further enhancing the interactivity and convenience of the conference. During the conference process, the display screen can also realize the distribution and sharing of screen content, support multiple people to annotate simultaneously, promote collaboration and communication among participants, and be compatible with a variety of software operations, making information processing and task management during the conference more flexible and efficient.

[0080] It should be noted that constructing a complete electronic conference archive is the top priority of the present invention. To achieve this goal, the present invention has carefully designed a strategy for real-time saving and time-sharing uploading of the overall audio-video stream, effectively reducing the pressure on the hand-in-hand bus. During the conference, the system of the present invention will automatically adjust the length of data storage time according to the size of the internal storage space of the conference unit. Whenever a speech ends, the corresponding conference unit will query whether there is a large amount of data being transmitted on the bus. If the bus is idle, the audio-video data will be immediately uploaded to the conference host, and then the conference host will upload it to the upper computer PC software; if the bus is busy, the corresponding conference unit will continue to query until a suitable transmission opportunity is found.

[0081] Moreover, before the audio-video stream stored in the conference unit is transmitted to the conference host and the upper computer PC software, the corresponding conference unit and the conference host perform a timestamp synchronization operation to ensure the synchronous update of the speech time points. In this way, even if the file is transmitted during the idle time after the conference, its time information can be consistent with the time record on the conference unit, thus ensuring the integrity and accuracy of the electronic conference archive.

[0082] In addition, if the administrator in the conference hopes to view the ongoing audio and video, the system of the present invention will quickly transmit the audio-video signal of the conference unit to the conference host and further transmit it to the upper computer PC software for viewing.

[0083] In summary, with its powerful function set and user-friendly design, the conference unit has become an indispensable core device in the electronic conference archive system of the present invention, providing a solid technical support for the smooth progress and efficient management of the conference.

[0084] (2) The conference host is used to transmit the audio to the sound reinforcement system for on-site sound reinforcement, and transmit the video to the screen for display and playback; send all-media conference materials to the upper computer.

[0085] In specific implementation, the conference host, as the core of the electronic conference archive system, is responsible for the management and control of the overall conference unit. It not only manages the speaking agenda and device connections, but also is responsible for the transmission, storage, distribution, and summary classification of audio and video signals. Moreover, the conference host is closely connected to the upper computer, and through the dedicated PC software on the upper computer, the comprehensive management of the entire electronic conference archive system is realized.

[0086] It should be noted that an efficient daisy-chain connection method is adopted between the conference unit and the conference host. This connection method uses a dedicated cable, and its underlying design integrates network cat-6 network cable and a specific power supply line. Mainly, data is transmitted through the two data lines of the 6-category network cable according to the standard of 100M network. The other two signal lines are thickened to transmit power, ground wire, and supply power to the cascaded devices, enabling a single link to easily daisy-chain more than 30 conference units through a main cable hand in hand. This connection method not only realizes the stable transmission of audio, video, control signals, and data, but also greatly saves the wiring workload and material consumption in conference rooms and meeting halls, and improves the overall efficiency and convenience of the system.

[0087] (3) The sound reinforcement system is mainly used for on-site speaking sound reinforcement. According to different usage scenarios, this system usually includes a series of conventional devices such as audio processor equipment, mixing console, power amplifier, and speakers. These devices work together to ensure that the sound can be clearly and effectively transmitted to every corner of the site.

[0088] (4) The screen is used to display and play the seating chart, the video of the speaker, the screen-cast materials, etc.

[0089] (5) As Figure 4 shown, the upper computer includes an input module and an archive module. Among them, the input module is used to input conference information, participant information, and seating information and bind them; compile the conference agenda according to the time axis, including speaking time, speaking order, topic name, sound reinforcement parameters, and screen-cast materials. The archive module is used to summarize the all-media conference materials of each conference unit, including speaker information, speaking time, the audio, video, text, and timestamp of the speaker, as well as screen-cast materials, and classify and store all the all-media conference materials according to the conference agenda, conference time, participants, and speakers to form an electronic conference archive.

[0090] In specific implementation, the upper computer, as the computer for conference archive operation and management, is equipped with dedicated PC software, which is designed specifically for operators and conference managers and is used for efficient agenda editing, personnel information input, device management, and various functional operations and management during the conference process.

[0091] In addition, the host computer further includes: a query module and an expected distribution module. Among them, the query module is used to perform a retrieval function through the main meeting information, facilitating users and managers to search for relevant meeting files, and can query and display according to the meeting name, time, agenda, participants, and other content. The expected distribution module is used to forward audio and video content. According to user settings and the meeting agenda, it pushes the audio and video information collected by the meeting unit to the designated meeting unit for display, enabling the users of these meeting units to see the voice and image of the current speaker, as well as the speech subtitles, etc.

[0092] The technical solutions provided by the embodiments of the present invention have been introduced in detail above. Specific examples are used in this article to elaborate on the principle and implementation manner of the present invention. The description of the above embodiments is only used to help understand the method and its core idea of the present invention; at the same time, for those of ordinary skill in the art, according to the idea of the present invention, the technical solutions recorded in the foregoing embodiments can be modified, or some of the technical features can be equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the idea and scope of the technical solutions of the embodiments of the present invention.

Claims

1. An electronic conference file management method, characterized in that, It includes the following steps: S1. Enter the meeting information, participant information, and seat information on the host computer and bind them; S2. Compile the meeting agenda on the host computer according to the time axis, including speaking time, speaking order, topic name, sound reinforcement parameters, and projection materials; S3. Start the meeting according to the meeting agenda and sequentially turn on each meeting unit corresponding to the speaker; each meeting unit collects the audio and video of the corresponding speaker through the pickup microphone and camera, and transmits the audio and video to the meeting host in real time. The meeting host then transmits the audio to the sound reinforcement system for on-site sound reinforcement, and transmits the video to the screen for display and playback; while collecting the audio and video, each meeting unit converts the audio into text in real time, and combines the Beidou time service and the network time service protocol to synchronously add time stamps to the audio and video. Then, the audio, video, text, and time stamps are stored in real time to form all-media meeting materials, and the all-media meeting materials are sent to the host computer through the meeting host; S4. The host computer summarizes the all-media meeting materials of each meeting unit, including speaker information, speaking time, the speaker's audio, video, text, and time stamps, and projection materials, and classifies and stores all the all-media meeting materials according to the meeting agenda, meeting time, participants, and speakers to form an electronic meeting file.

2. The electronic conference file management method according to claim 1, wherein, The step of sending the all-media meeting materials to the host computer through the meeting host includes the following steps: Each meeting unit judges the size and time of the stored file according to the storage space. When the file storage reaches the set value, it queries the bus data situation and judges whether there is data exceeding the set value being transmitted on the bus; If so, the meeting unit waits for a certain time and then queries the bus data situation again; if not, the meeting unit sends the all-media meeting materials to the meeting host, and then sends them to the host computer through the meeting host.

3. The electronic conference file management method according to claim 1, wherein, If the administrator requests to view the audio and video of the speaker during the speech, the corresponding meeting unit will push the speaker's audio and video to the host computer for display through the meeting host.

4. The electronic conference file management method according to claim 1, characterized in that When the audio and video stored in the meeting unit fail to be sent to the meeting host and the host computer in time, the meeting unit and the meeting host will synchronize the time stamps and update the speaking time point.

5. An electronic conference file management system, which utilizes an electronic conference file management method as described in any one of claims 1-4, characterized in that, It includes several meeting units, a meeting host, several sound reinforcement systems, a screen, and a host computer; several meeting units are connected in series and then connected to the meeting host; the meeting host is respectively connected to several sound reinforcement systems, the screen, and the host computer; Each meeting unit includes a main control module, and an audio acquisition module, a video acquisition module, an audio-to-text module, a Beidou time service module, and a memory module respectively connected thereto; Among them, the main control module is used to start the meeting according to the meeting agenda and sequentially activate the meeting units corresponding to each speaker; the audio acquisition module is used to collect the audio of the corresponding speaker through a pickup microphone and transmit the audio to the meeting host in real time; the video acquisition module is used to collect the video of the corresponding speaker through a camera and transmit the video to the meeting host in real time; the audio-to-text module is used to convert the audio into text in real time while collecting the audio and video; the Beidou time service module is used to synchronously add timestamps to the audio and video by combining Beidou time service and network time service protocol while collecting the audio and video; the memory module is used to store the audio, video, text, and timestamp in real time to form all-media meeting materials and send them to the meeting host. The meeting host is used to transmit the audio to the sound reinforcement system for on-site sound reinforcement and transmit the video to the screen for display and playback; send the all-media meeting materials to the upper computer. The upper computer includes an input module and an archiving module. Among them, the input module is used to input and bind the meeting information, participant information, and seat information; compile the meeting agenda according to the time axis, including speaking time, speaking order, topic name, sound reinforcement parameters, and projection materials; the archiving module is used to summarize the all-media meeting materials of each meeting unit, including speaker information, speaking time, the speaker's audio, video, text, and timestamp, as well as projection materials, and classify and store all the all-media meeting materials according to the meeting topic, meeting time, participants, and speakers to form an electronic meeting file.

Images