Video conference processing method, device, electronic device and storage medium

Abstract

The embodiment of the present invention provides a video conference processing method, device, electronic device and storage medium. The method is applied to a storage service system in a visual network, including: obtaining a video file for recording the video conference, and a text file corresponding to the audio stream in the video conference during the recording period; the text file includes multiple paragraphs of text information, wherein each paragraph of text information includes the start playback time of the audio stream corresponding to the text information in the video file; upon receiving a user's request to play the video file, playing the video file; in the process of playing the video file, extracting at least one paragraph of text information corresponding to the current playback time from the text file according to the current playback time and each start playback time; and displaying at least one paragraph of text information. When the technical solution of the present invention is adopted, the efficiency of obtaining the conference content of the video conference can be improved.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a video conference processing method, device, electronic equipment and storage medium. Background Art

[0002] With the development of the visual network, many users hold large-scale high-definition video conferences in the visual network. In the process of holding a video conference, it is often necessary to record the content of the video conference. In the related technology, the video conference is generally recorded to achieve the recording of the video conference, and the user can obtain the content of the meeting by watching the recorded video file.

[0003] However, when this method is used, the user cannot accurately understand the content of the video conference when watching the video file due to poor recording effect or unclear audio from the speaker, etc. On the other hand, the user also needs to manually record the speech content while watching the recorded video file, resulting in low efficiency in recording the speech content of the video conference. Summary of the invention

[0004] In view of the above problems, embodiments of the present invention are proposed to provide a video conference processing method, device, electronic device and storage medium that overcome the above problems or at least partially solve the above problems.

[0005] A first aspect of an embodiment of the present invention discloses a video conference processing method, which is applied to a storage service system in a visual network, and includes:

[0006] Obtaining a video file recording the video conference and a text file corresponding to an audio stream in the video conference during a recording period; the text file includes multiple sections of text information, wherein each section of text information includes a start time of playing the audio stream corresponding to the text information in the video file;

[0007] When receiving a request from a user to play the video file, playing the video file;

[0008] In the process of playing the video file, extracting at least one piece of text information corresponding to the current playing time from the text file according to the current playing time and each of the starting playing times;

[0009] The at least one piece of text information is displayed.

[0010] Optionally, the video file carries multiple tags, and playing the video file includes:

[0011] Displaying the multiple marks on a play progress bar for playing the video file, wherein each mark on the play progress bar is used to indicate the play time of the mark in the video file;

[0012] Extracting at least one piece of text information corresponding to the current play time from the text file according to the current play time and each of the start play times, including:

[0013] When a triggering operation on the multiple tags is detected, determining a first play time of the triggered tag in the video file, and switching the current play time to the first play time, so as to play the video file from the first play time;

[0014] At least one first text information whose corresponding start play time is within the first preset time range from the first play time is extracted from the text file.

[0015] Optionally, the video file carries multiple tags, and playing the video file includes:

[0016] Displaying the multiple marks on a play progress bar for playing the video file, wherein each mark on the play progress bar is used to indicate the play time of the mark in the video file;

[0017] Extracting at least one piece of text information corresponding to the current play time from the text file according to the current play time and each of the start play times, including:

[0018] Determine a progress position corresponding to a current playback time, and determine a target mark within a preset distance from the progress position among the multiple marks;

[0019] Determine a second play time in the video file from the target mark;

[0020] At least one second text information whose starting playing time is within a preset time range from the second playing time is extracted from the text file.

[0021] Optionally, extracting at least one piece of text information corresponding to the current playback time from the text file according to the current playback time and each of the start playback times includes:

[0022] Determine at least one starting playback time within a second preset time range from each of the starting playback times;

[0023] At least one third text information corresponding to the at least one start playing time is obtained from the text file.

[0024] Optionally, a conference control terminal and an autonomous server are deployed in the video network, and before obtaining a video file recorded for the video conference, the method further includes:

[0025] receiving a conference recording instruction sent by the autonomous server, wherein the conference recording instruction is generated by the conference control terminal and sent to the autonomous server;

[0026] In response to the conference recording instruction, the audio stream and the video stream currently generated in the video conference are recorded, and the audio stream is cached; wherein the audio stream is the audio stream collected by the terminal currently speaking in the video conference;

[0027] Whenever it is detected that the total playing time of a cached audio stream reaches a preset time, the cached audio stream is identified to obtain text information corresponding to the audio stream, and the starting time of the audio stream in the recording process is used as the starting playing time;

[0028] When the recording of the current video conference is finished, the multiple text information corresponding to the cached multiple audio streams are stored as a text file.

[0029] Optionally, when the recording of the current video conference is finished, after storing the multiple text information corresponding to the cached multiple audio streams as a text file, the method further includes:

[0030] When the video conference ends, obtaining conference data of the video conference;

[0031] Generate meeting minutes based on the meeting data and the text file, and publish the meeting minutes;

[0032] When receiving a download request from a user for the published conference minutes, the conference minutes are sent to the user.

[0033] A second aspect of an embodiment of the present invention provides a video conference processing device, which is applied to a storage service system in a visual network, including:

[0034] A file acquisition module is used to obtain a video file recorded for the video conference, and a text file corresponding to an audio stream in the video conference during a recording period; the text file includes multiple sections of text information, wherein each section of text information includes a start playback time of the audio stream corresponding to the text information in the video file;

[0035] A video playing module, used for playing the video file upon receiving a user's request to play the video file;

[0036] An information extraction module is used to extract at least one piece of text information corresponding to the current playback time from the text file according to the current playback time and each of the start playback times during the playback of the video file;

[0037] The information display module is used to display the at least one piece of text information.

[0038] Optionally, a conference control terminal and an autonomous server are deployed in the visual network, and the device further includes:

[0039] An instruction receiving module, configured to receive a conference recording instruction sent by the autonomous server, wherein the conference recording instruction is generated by the conference control terminal and sent to the autonomous server;

[0040] A video recording module, configured to record the audio stream and video stream currently generated in the video conference in response to the conference recording instruction, and cache the audio stream; wherein the audio stream is the audio stream collected by the terminal currently speaking in the video conference;

[0041] The audio recognition module is used to recognize the cached audio stream every time it is detected that the total playback time of a cached audio stream reaches a preset time, obtain text information corresponding to the audio stream, and use the start time of the audio stream in the recording process as the start playback time;

[0042] The file acquisition module is used to store multiple text information corresponding to the cached multiple audio streams as a text file when the recording of the current video conference is finished.

[0043] Optionally, the video file carries a plurality of marks, and the file playing module is specifically used to display the plurality of marks on a playing progress bar of the video file, wherein each mark on the playing progress bar is used to indicate the playing time of the mark in the video file;

[0044] The information extraction module comprises:

[0045] A first determining unit, configured to determine a first play time of the triggered mark in the video file when a triggering operation on the multiple marks is detected;

[0046] a progress adjustment unit, configured to switch the current play time to the first play time, so as to play the video file from the first play time;

[0047] The first extraction unit is used to extract at least one first text information whose corresponding start playback time is within the first preset time range from the first playback time from the text file.

[0048] Optionally, the video file carries a plurality of marks, and the file playing module is specifically used to display the plurality of marks on a playing progress bar of the video file, wherein each mark on the playing progress bar is used to indicate the playing time of the mark in the video file;

[0049] The information extraction module comprises:

[0050] A second determining unit is used to determine a progress position corresponding to a current playback time, and determine a target mark within a preset distance from the progress position among the multiple marks;

[0051] A third determining unit, configured to determine a second play time from the target mark in the video file;

[0052] The second extraction unit is used to extract at least one second text information whose start playing time is within a preset time range from the second playing time from the text file.

[0053] Optionally, the information extraction module includes:

[0054] A fourth determining unit, configured to determine, from the start playback times, at least one start playback time that is within a second preset time range and is related to the current playback time;

[0055] The third extraction unit is used to obtain at least one third text information corresponding to the at least one start playback time from the text file.

[0056] Optionally, the device further comprises:

[0057] A conference data acquisition module, used for acquiring conference data of the video conference when the video conference ends;

[0058] A meeting minutes generation module, used to generate meeting minutes based on the meeting data and the text file, and publish the meeting minutes;

[0059] The conference minutes sending module is used to send the conference minutes to the user when receiving a download request for the published conference minutes from the user.

[0060] According to a third aspect of the embodiments of the present invention, there is further provided an electronic device, including:

[0061] one or more processors; and

[0062] One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, enable the device to execute the video conference processing method as described in the embodiment of the present invention.

[0063] According to a fourth aspect of the embodiments of the present invention, a computer-readable storage medium is provided, wherein a computer program stored in the medium enables a processor to execute the video conference processing method as described in the embodiments of the present invention.

[0064] The embodiments of the present invention include the following advantages:

[0065] In an embodiment of the present invention, the storage service system can obtain a video file for recording a video conference and a text file corresponding to the audio stream in the video conference. During the playback of the video file, the text information corresponding to the playback time can be displayed according to the current playback time and the start playback time corresponding to each segment of text information in the text file. On the one hand, while watching the recorded video conference, the user can synchronously obtain the content of the video conference corresponding to the current playback period through the displayed text information, thereby improving the accuracy of the user's understanding of the content of the video conference and improving the efficiency of the user in obtaining the content of the conference. On the other hand, since the storage service system can obtain the text file corresponding to the audio in the video conference, there is no need for the user to manually record the content of the video conference, thereby improving the efficiency of recording the video conference. BRIEF DESCRIPTION OF THE DRAWINGS

[0066] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments of the present application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0067] Figure 1 It is a networking schematic diagram of a visual network of the present invention;

[0068] Figure 2 It is a schematic diagram of the hardware structure of a node server of the present invention;

[0069] Figure 3 It is a schematic diagram of the hardware structure of an access switch of the present invention;

[0070] Figure 4 It is a hardware structure diagram of an Ethernet protocol conversion gateway of the present invention;

[0071] Figure 5 FIG. 1 is an implementation environment diagram of a video conference processing method according to an embodiment of the present invention.

[0072] Figure 6 is a flowchart of the steps of a video conference processing method according to an embodiment of the present invention;

[0073] Figure 7It is a flow chart of steps for recording a video conference in a video conference processing method according to an embodiment of the present invention;

[0074] Figure 8 is a schematic diagram of an interface for displaying text information in a playing video file in an example of the present invention;

[0075] Fig. 9 It is a structural schematic diagram of a video conference processing device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0076] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0077] The visual Internet is an important milestone in the development of the Internet. It is a real-time network that can realize real-time transmission of high-definition video and push many Internet applications towards high-definition video and high-definition face-to-face communication.

[0078] The visual network adopts real-time high-definition video exchange technology. It can integrate the required services such as high-definition video conferencing, video monitoring, intelligent monitoring analysis, emergency command, digital radio and television, delayed TV, online teaching, live broadcast, VOD on demand, TV mail, personalized recording (PVR), intranet (self-operated) channels, intelligent video broadcast control, information release and dozens of other video, voice, picture, text, communication, data and other services on a single system platform, and realize high-definition quality video playback through TV or computer.

[0079] In order to enable those skilled in the art to better understand the embodiments of the present invention, the visual network is introduced as follows:

[0080] Some of the technologies used in the visual Internet of Things are as follows:

[0081] Network Technology

[0082] The network technology innovation of Visual Networking improves the traditional Ethernet to cope with the huge potential first video traffic on the network. Different from simple network packet switching (Packet Switching) or network circuit switching (Circuit Switching), Visual Networking technology uses Packet Switching to meet the streaming needs. Visual Networking technology has the flexibility, simplicity and low price of packet switching, and the quality and security guarantee of circuit switching, realizing the seamless connection of the whole network switching virtual circuit and data format.

[0083] Switching Technology

[0084] Visual networking uses the two advantages of Ethernet: asynchronism and packet switching. It eliminates Ethernet defects under the premise of full compatibility, and has seamless end-to-end connection across the entire network, directly connects to user terminals, and directly carries IP data packets. User data does not require any format conversion within the entire network. Visual networking is a more advanced form of Ethernet and a real-time switching platform that can achieve large-scale real-time transmission of high-definition video across the entire network, which is currently unattainable on the Internet, and pushes many network video applications towards high definition and unification.

[0085] Server Technology

[0086] The server technology on the visual network and unified video platform is different from the traditional server. Its streaming media transmission is based on connection-oriented. Its data processing capability is independent of traffic and communication time. A single network layer can include signaling and data transmission. For voice and video services, the complexity of streaming media processing on the visual network and unified video platform is much simpler than data processing, and its efficiency is more than 100 times higher than that of traditional servers.

[0087] Storage Technology

[0088] The ultra-high-speed storage technology of the unified video platform adopts the most advanced real-time operating system to adapt to the media content with ultra-large capacity and ultra-large flow, mapping the program information in the server command to the specific hard disk space. The media content no longer passes through the server, but is directly delivered to the user terminal in an instant. The user generally waits for less than 0.2 seconds. The optimized sector distribution greatly reduces the mechanical movement of the hard disk head seeking, and the resource consumption accounts for only 20% of the same level of IP Internet, but it generates 3 times more concurrent traffic than the traditional hard disk array, and the overall efficiency is improved by more than 10 times.

[0089] Network Security Technology

[0090] The structural design of the visual network completely eradicates the network security issues that plague the Internet through separate licensing for each service and complete isolation of equipment and user data. Generally, anti-virus programs and firewalls are not required, and attacks by hackers and viruses are eliminated, providing users with a structurally worry-free and secure network.

[0091] Service Innovation Technology

[0092] The unified video platform integrates services and transmission. Whether it is a single user, a private network user or a network, it is just an automatic connection. User terminals, set-top boxes or PCs are directly connected to the unified video platform to obtain rich and colorful multimedia video services in various forms. The unified video platform uses a "recipe-style" table configuration mode to replace traditional complex application programming. Complex applications can be implemented with very little code, realizing "unlimited" new business innovation.

[0093] The networking of the visual network is as follows:

[0094] Visual networking is a centrally controlled network structure. The network can be a tree network, star network, ring network, etc., but on this basis, there needs to be a centralized control node in the network to control the entire network.

[0095] like Figure 1 As shown in the figure, the visual network is divided into two parts: access network and metropolitan area network.

[0096] The equipment in the access network can be divided into three categories: node server, access switch, and terminal (including various set-top boxes, encoding boards, storage, etc.). The node server is connected to the access switch, and the access switch can be connected to multiple terminals and can be connected to Ethernet.

[0097] The node server is a node in the access network that performs centralized control functions and can control access switches and terminals. The node server can be directly connected to the access switch or directly connected to the terminal.

[0098] Similarly, the devices in the metropolitan area network can also be divided into three categories: metropolitan area servers, node switches, and node servers. The metropolitan area servers are connected to the node switches, and the node switches can be connected to multiple node servers.

[0099] The node server is a node server of the access network part, that is, the node server belongs to both the access network part and the metropolitan area network part.

[0100] The metropolitan area server is a node with centralized control function in the metropolitan area network, which can control the node switch and node server. The metropolitan area server can be directly connected to the node switch or the node server.

[0101] It can be seen from this that the entire visual network is a hierarchical and centrally controlled network structure, and the network controlled by the node server and the metropolitan area server can be various structures such as tree, star, and ring.

[0102] Figuratively speaking, the access network part can form a unified video platform (the part in the dotted circle), and multiple unified video platforms can form a visual network; each unified video platform can be interconnected through the metropolitan area and wide area visual networks.

[0103] Visual networking equipment classification

[0104] 1.1 The devices in the visual network of the embodiment of the present invention can be mainly divided into three categories: servers, switches (including Ethernet protocol conversion gateways), terminals (including various set-top boxes, encoding boards, storage devices, etc.). The visual network as a whole can be divided into a metropolitan area network (or a national network, a global network, etc.) and an access network.

[0105] 1.2 The equipment in the access network can be mainly divided into three categories: node server, access switch (including Ethernet protocol conversion gateway), terminal (including various set-top boxes, encoding boards, storage, etc.).

[0106] The specific hardware structure of each access network device is as follows:

[0107] Node server:

[0108] like Figure 2 As shown, it mainly includes a network interface module 201, a switching engine module 202, a CPU module 203, and a disk array module 204;

[0109] Among them, the packets coming from the network interface module 201, the CPU module 203, and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of checking the address table 205 on the incoming packets, thereby obtaining the packet's guidance information; and according to the packet's guidance information, the packet is stored in the queue of the corresponding packet buffer 206; if the queue of the packet buffer 206 is close to full, it is discarded; the switching engine module 202 polls all packet buffer queues, and forwards if the following conditions are met: 1) the port sending buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 204 mainly implements the control of the hard disk, including the initialization, reading and writing of the hard disk; the CPU module 203 is mainly responsible for the protocol processing between the access switch and the terminal (not shown in the figure), the configuration of the address table 205 (including the downstream protocol packet address table, the upstream protocol packet address table, and the data packet address table), and the configuration of the disk array module 204.

[0110] Access switch:

[0111] like Figure 3 As shown, it mainly includes a network interface module (a downlink network interface module 301, an uplink network interface module 302), a switching engine module 303 and a CPU module 304;

[0112] Among them, the packet (uplink data) coming from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the destination address (DA), source address (SA), data packet type and packet length of the packet meet the requirements. If they meet the requirements, the corresponding stream identifier (stream-id) is allocated and enters the switching engine module 303, otherwise it is discarded; the packet (downlink data) coming from the uplink network interface module 302 enters the switching engine module 303; the data packet coming from the CPU module 304 enters the switching engine module 303; the switching engine module 303 processes the incoming packet The address table 306 is looked up to obtain the packet's guidance information; if the packet entering the switching engine module 303 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 307 in combination with the stream identifier (stream-id); if the queue of the packet buffer 307 is nearly full, it is discarded; if the packet entering the switching engine module 303 is not from the downstream network interface to the upstream network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the packet's guidance information; if the queue of the packet buffer 307 is nearly full, it is discarded.

[0113] The switching engine module 303 polls all packet buffer queues, which may include two situations:

[0114] If the queue is from the downlink network interface to the uplink network interface, it is forwarded if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero; 3) a token generated by the bit rate control module is obtained;

[0115] If the queue is not going from the downstream network interface to the upstream network interface, it is forwarded if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.

[0116] The code rate control module 308 is configured by the CPU module 304 to generate tokens for all packet buffer queues from the downstream network interface to the upstream network interface within a programmable interval to control the code rate of the upstream forwarding.

[0117] The CPU module 304 is mainly responsible for protocol processing with the node server, configuration of the address table 306 , and configuration of the bit rate control module 308 .

[0118] Ethernet protocol conversion gateway :

[0119] like Figure 4As shown, it mainly includes a network interface module (a downlink network interface module 401, an uplink network interface module 402), a switching engine module 403, a CPU module 404, a packet detection module 405, a bit rate control module 408, an address table 406, a packet buffer 407 and a MAC adding module 409, and a MAC deleting module 410.

[0120] The data packet from the downlink network interface module 401 enters the packet detection module 405; the packet detection module 405 detects whether the Ethernet MAC DA, Ethernet MAC SA, Ethernet length or frame type, visual network destination address DA, visual network source address SA, visual network data packet type and packet length of the data packet meet the requirements, and if they meet the requirements, a corresponding stream identifier (stream-id) is assigned; then, the MAC deletion module 410 subtracts the MAC DA, MAC SA, length or frame type (2 bytes) and enters the corresponding receiving buffer, otherwise it is discarded;

[0121] The downlink network interface module 401 detects the sending buffer of the port. If there is a packet, it obtains the Ethernet MAC DA of the corresponding terminal based on the visual network destination address DA of the packet, adds the Ethernet MAC DA of the terminal, the MACSA of the Ethernet protocol conversion gateway, and the Ethernet length or frame type, and sends it.

[0122] The functions of other modules in the Ethernet protocol conversion gateway are similar to those of the access switch.

[0123] terminal:

[0124] It mainly includes network interface module, business processing module and CPU module; for example, the set-top box mainly includes network interface module, audio and video encoding and decoding engine module, CPU module; the encoding board mainly includes network interface module, audio and video encoding engine module, CPU module; the memory mainly includes network interface module, CPU module and disk array module.

[0125] 1.3 The equipment in the metropolitan area network can be divided into two categories: node server, node switch, and metropolitan area server. Among them, the node switch mainly includes network interface module, switching engine module and CPU module; the metropolitan area server mainly includes network interface module, switching engine module and CPU module.

[0126] 2. Definition of Visual Network Data Packet

[0127] 2.1 Access Network Data Packet Definition

[0128] The data packet of the access network mainly includes the following parts: destination address (DA), source address (SA), reserved bytes, payload (PDU), and CRC.

[0129] As shown in the following table, the data packet of the access network mainly includes the following parts:

[0130] DA SA Reserved Payload CRC

[0131] in:

[0132] The destination address (DA) consists of 8 bytes. The first byte indicates the type of data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), with a maximum of 256 possibilities. The second to sixth bytes are the metropolitan area network address, and the seventh and eighth bytes are the access network address.

[0133] The source address (SA) is also composed of 8 bytes and has the same definition as the destination address (DA).

[0134] The reserved bytes consist of 2 bytes;

[0135] The payload part has different lengths depending on the type of datagram. If it is a protocol packet, it is 64 bytes. If it is a single multicast data packet, it is 32+1024=1056 bytes. Of course, it is not limited to the above two types.

[0136] CRC consists of 4 bytes and its calculation method follows the standard Ethernet CRC algorithm.

[0137] 2.2 Definition of Metropolitan Area Network Data Packet

[0138] The topology of the metropolitan area network is a graph. There may be two or more connections between two devices, that is, there may be more than two connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metropolitan area network address of a metropolitan area network device is unique. In order to accurately describe the connection relationship between metropolitan area network devices, a parameter: a label is introduced in the embodiment of the present invention to uniquely describe a metropolitan area network device.

[0139] The definition of labels in this manual is similar to the definition of labels in MPLS (Multi-Protocol Label Switch). Assuming that there are two connections between device A and device B, there are two labels for the data packet from device A to device B, and there are two labels for the data packet from device B to device A. Labels are divided into input labels and output labels. Assuming that the label of the data packet entering device A (input label) is 0x0000, the label of the data packet when leaving device A (output label) may become 0x0001. The access process of the metropolitan area network is a centralized access process, which means that the address allocation and label allocation of the metropolitan area network are dominated by the metropolitan area server, and the node switch and node server are only passively executed. This is different from the label allocation of MPLS, which is the result of mutual negotiation between the switch and the server.

[0140] As shown in the following table, the data packets of the metropolitan area network mainly include the following parts:

[0141] DA SA Reserved Label Payload CRC

[0142] That is, destination address (DA), source address (SA), reserved byte (Reserved), label, payload (PDU), CRC. The label format can refer to the following definition: the label is 32 bits, of which the upper 16 bits are reserved and only the lower 16 bits are used. It is located between the reserved bytes and payload of the data packet.

[0143] Based on the above-mentioned characteristics of the visual network, one of the concepts of the present invention is proposed. The storage server can obtain the video file recorded for the video conference and the text file corresponding to the audio in the video conference. When the user plays the video file, multiple segments of text information near the current playback time can be extracted from the text file and displayed, so that the user can accurately and quickly obtain the content of the meeting.

[0144] refer to Figure 5 , shows an implementation environment diagram of a video conference processing method according to an embodiment of the present invention, such as Figure 5 As shown, it includes a conference control terminal, a conference management server, an autonomous server, a storage service system, and multiple terminals. The autonomous server, the storage service system, and the multiple terminals are deployed in a visual network, the conference management server and the conference control terminal are deployed in the Internet, the autonomous server can communicate with the conference management server using the Internet protocol, and the autonomous server can communicate with the storage service system and multiple terminals using the visual network protocol.

[0145] In this embodiment, the terminal can be but not limited to the following devices: mobile phone, computer, set-top box or visual network terminal. In the video conference conducted in the visual network, multiple terminals are used as participants. The conference control terminal is used to control multiple terminals participating in the video conference, issue conference control instructions, etc. The autonomous server is used to transmit audio and video streams, conference text data, etc. in the visual network, and the storage service system is used to record the received video streams and audio streams to achieve the purpose of storing the conference content of the video conference.

[0146] like Figure 5 As shown, in a specific implementation, the storage service system may include a storage service system web front end and a storage service system back end. The storage service system back end is a storage server, and the storage service system web front end may support Internet protocol communication, making it convenient for users on the Internet to download files related to video conferencing on web pages.

[0147] The following is an example of how a video conference is conducted in a visual network:

[0148] like Figure 5 As shown, in a video conference on a visual network, the scheduling of audio and video streams can be triggered by a conference control terminal, and the autonomous server processes the actual audio and video stream scheduling in the video conference according to the scheduling triggered by the conference control terminal. For example, at a certain time, terminal 1 is set as the speaker by the conference control terminal, and the other terminals 2, 3, and 4 are set as ordinary participants. At this moment, the conference control terminal triggers an audio and video stream scheduling, and the autonomous server sends the audio stream and video stream collected by terminal 1 to terminals 2, 3, and 4 according to the scheduling. For another example, at another time, terminal 2 is set as the speaker by the conference control terminal, and the other terminals 1, 3, and 4 are set as ordinary participants. At this moment, the conference control terminal triggers another audio and video stream scheduling, and the autonomous server sends the audio stream and video stream collected by terminal 2 to terminals 1, 3, and 4 according to the scheduling.

[0149] In practice, the conference control terminal can continuously change the speaker during the meeting according to the meeting needs, that is, continuously change the audio and video stream scheduling. The autonomous server can forward the audio stream collected by the corresponding terminal to other participating terminals according to the audio and video stream scheduling determined by the conference control terminal.

[0150] Next, combine Figure 5 The implementation environment shown uses the storage service system as the execution body to introduce the video conferencing processing method of this application.

[0151] In one embodiment, a method for recording a video conference is provided. In this embodiment, when a video conference is being conducted, the storage service system can record the video conference to obtain a video file and a text file corresponding to the video conference. Figure 6 FIG. 1 shows a flowchart of steps in which a storage service system records a video conference to obtain a video file and a text file in an embodiment, which may specifically include the following steps:

[0152] Step S601: receiving a conference recording instruction sent by the autonomous server.

[0153] The conference recording instruction is generated by the conference control terminal and sent to the autonomous server.

[0154] In this embodiment, the storage service system can record the video conference based on the conference recording instruction issued by the conference control terminal. Specifically, the conference recording instruction can be generated by the conference control terminal and sent by the conference control terminal to the autonomous server, which then sends it to the backend of the storage service system.

[0155] In practice, if Figure 5 As shown, since the conference control terminal is located in the Internet and is communicated with the conference management server in the Internet, the conference control terminal generates a conference recording instruction that complies with the Internet protocol, and sends the conference recording instruction that complies with the Internet protocol to the conference management server via the Internet. After the conference management server converts the conference recording instruction that complies with the Internet protocol into a conference recording instruction that complies with the visual network protocol, it sends the conference recording instruction that complies with the visual network protocol to the autonomous server, and the autonomous server sends it to the back end of the storage service system in the visual network. The conference recording instruction received by the storage server is an instruction that complies with the visual network protocol.

[0156] Step S602: In response to the conference recording instruction, the audio stream and video stream currently generated in the video conference are recorded, and the audio stream is cached; wherein the audio stream is the audio stream collected by the terminal currently speaking in the video conference.

[0157] In this embodiment, the backend of the storage service system can respond to the conference recording instruction and record the audio stream and video stream generated in the video conference, wherein the audio stream and video stream generated in the video conference can be sent to the backend of the storage service system by the autonomous server after responding to the conference recording instruction. That is, when the autonomous server forwards the conference recording instruction to the storage service system, it also establishes an audio and video stream transmission channel with the storage service system, so as to send the video stream and audio stream sent by each terminal in the video conference to the storage service system.

[0158] In the specific implementation, Figure 5 As shown, the storage service system utilizes the speech analysis system to store the audio stream so that the speech analysis system can recognize the stored audio stream.

[0159] Step S603: Whenever it is detected that the total playing time of a cached audio stream reaches a preset time, the cached audio stream is identified, text information corresponding to the audio stream is obtained, and the starting time of the audio stream during the recording process is used as the starting playing time.

[0160] In this embodiment, when the total playback time of the stored audio stream reaches the preset time, the storage service system can use the speech analysis system to identify the audio stream and obtain the text information corresponding to the audio stream. At the same time, the cached audio stream can be deleted and the next audio stream can be cached. When the total playback time of the next cached audio stream reaches the preset time, the text information corresponding to the next audio stream can be obtained. In this way, multiple pieces of text information can be obtained.

[0161] The start time of the audio stream during the recording process may refer to the time from the start of recording to the start of storing the audio stream, and this time is used as the start time of playing the text information corresponding to the audio stream.

[0162] For example, starting from the time when the video conference starts to be recorded, the time when the audio stream sent by terminal 2 starts to be stored is 20 minutes and 15 seconds. When the playback time of the stored audio stream reaches 5 seconds, the text information A of the stored audio stream is generated, and the starting playback time of the text information A is determined to be 20 minutes and 15 seconds; it means that in the recorded video file, terminal 2 starts to speak at 20 minutes and 15 seconds. During this period, terminal 2 continuously sends audio streams, and starts to store audio streams at 20 minutes and 21 seconds. When the playback time of the stored audio stream reaches 5 seconds, the text information B of the stored audio stream is generated, and the starting playback time of the text information A is determined to be 20 minutes and 21 seconds.

[0163] In one implementation, the storage service system may also determine the terminal that collects the currently stored audio stream, and record the name of the terminal or the name of the user using the terminal in the text information, so that each piece of text information may carry the speaker information.

[0164] Step S604: when the recording of the current video conference is finished, the multiple text information corresponding to the multiple buffered audio streams are stored as a text file.

[0165] In this embodiment, the storage service system can end the recording of the video conference according to the end recording instruction sent by the conference terminal. The process of the storage service system receiving the end recording instruction sent by the conference terminal is the same as the process of the storage service system receiving the conference recording instruction sent by the conference terminal, which will not be repeated here.

[0166] In practice, the storage service system may also end the recording of the video conference when the duration after the start of recording the video conference reaches a preset duration threshold. Of course, the recording of the video conference may also be ended when the end of the video conference is detected.

[0167] In a specific implementation, since the audio is recognized during the recording process and multiple text information is obtained, when the recording is finished, the storage service system can combine the multiple text information together to form a text file, in which each text information has a starting playback time.

[0168] At the end of the recording, the storage service system can publish the recorded video files and text files to the web end of the storage service system. Specifically, the storage service system can publish the names of the video files and the text files on the web end so that users can download the video files and text files, thereby obtaining the meeting content of the video conference and realizing the application of the video files and text files.

[0169] In this embodiment, the storage service system can display text information in the text file to the user while the user is playing the recorded video file, so that the user can obtain the conference content of the video conference in a video clip.

[0170] Specifically, refer to Figure 7 FIG. 1 shows a flowchart of steps in which a storage service system displays a text file to a user in a text information video conference processing method in an embodiment, which specifically includes the following steps:

[0171] Step S701: Obtain a video file recording the video conference and a text file corresponding to the audio stream in the video conference during a recording period.

[0172] The text file includes multiple sections of text information, and each section of text information includes the start playing time of the audio stream corresponding to the text information in the video file.

[0173] In this embodiment, the storage service system can obtain the video file and text file recorded for the video conference at the end of the video conference, and can also obtain the currently recorded video file and text file during the video conference, so as to realize the simultaneous recording and playback of the video conference. The video file can restore the scene of the video conference, wherein the video file recorded for the video conference can refer to the recording of the audio and video stream after the video stream and audio stream collected by each terminal in the video conference are mixed.

[0174] The text file is a file obtained by identifying the audio stream generated in the video conference during the process of recording the video file. Figure 5 For example, in the process of recording a video file, terminal 1 and terminal 2 speak successively, and the text file may include text information corresponding to the audio collected by terminal 1 and text information corresponding to the audio collected by terminal 2.

[0175] In practice, each piece of text information may have a start play time, which may refer to the time difference between the start of recording the video file and the time of recognizing the piece of text information, and the time difference may be used as the relative play time of the audio stream corresponding to the text information in the video file. The specific process of recording the video file and obtaining the text file may be as described in steps S601 to S604 above.

[0176] Step S702: upon receiving a user's request to play the video file, play the video file.

[0177] In this embodiment, the storage service system can publish the name of the obtained video file to the web front end so that the user can play the published video file. Specifically, when the web front end of the storage service system detects a user clicking operation on the name of the video file, it can send a play request to the back end of the storage service system, and the back end of the storage service system pushes the video file to the web front end, which can load and play the video file.

[0178] In a specific implementation, when the backend of the storage service system pushes the video file to the web frontend, it may also push the text file to the web frontend.

[0179] Step S703: in the process of playing the video file, extracting at least one piece of text information corresponding to the current playing time from the text file according to the current playing time and each of the starting playing times.

[0180] Step S704: Display the at least one piece of text information.

[0181] In this embodiment, during the playback of a video conference, the web front-end of the storage service system can detect the relationship between the current playback time and the starting playback time carried by each segment of text information in the text file, thereby determining the starting playback time near the current playback time, and can extract at least one segment of text information corresponding to the starting playback time near the current playback time from the text file.

[0182] Since the starting playback time of each piece of text information is the relative playback time of the audio stream corresponding to the text information in the video file, in practice, when the video file plays a video clip in which a speaker is speaking, the text information corresponding to the speaker's speech can be displayed synchronously, making it convenient for users to know the content of the speaker's speech in text form, and can help users accurately know the content of the video conference.

[0183] In a specific implementation, the web front-end of the storage service system can display the extracted at least one text information on the video playback window of the video file. In practice, when displaying at least one text information, the user can save the speaker's speech content in the video by taking a screenshot of the video playback window. Specifically, when the web front-end of the storage service system detects a screenshot operation on the video playback window, it can take a screenshot of the current video playback window to obtain a picture of the display page, and the picture of the display page can include the at least one text information displayed. Afterwards, the saved picture is sent to the user who is currently logged in to the storage service system, so that the user can record important meeting content through pictures without manual recording, thereby improving the efficiency of meeting records.

[0184] In one implementation, since the speaker information can be carried in the text information, the speaker information can be displayed together with the text information, so that the user can know which speaker's speech the currently displayed text information belongs to, thereby optimizing the user experience.

[0185] In the embodiment of the present invention, during the playback of the video file, the storage service system can display the text information corresponding to the playback time according to the current playback time and the starting playback time corresponding to each segment of text information in the text file, so that the user can synchronously obtain the conference content of the current video segment through the displayed text information while watching the recorded video conference, so that the user can accurately obtain the conference content, while improving the efficiency of the user in obtaining the conference content. On the other hand, since the storage service system can obtain the text file corresponding to the audio in the video conference, the user does not need to manually record the video conference content, thereby improving the efficiency of recording the video conference.

[0186] In combination with the above embodiments, an implementation method for displaying text information during the playback of a video file is provided. In this implementation method, the video file may carry multiple tags, and the playback of the video file may be the following playback process:

[0187] Step S702': displaying the multiple marks on a play progress bar of the video file.

[0188] Wherein, each mark on the play progress bar is used to indicate the play time of the mark in the video file.

[0189] In this embodiment, the multiple marks carried in the video file may refer to marks for marking multiple play time points of the video file. When playing the video file, the multiple marks may be displayed at different positions on the play progress bar according to the play time points marked by each mark.

[0190] The time interval between the playback time points marked by each two adjacent marks can be the same. For example, if the total playback time of the video file is 20 minutes, 5 marks can be set at equal time intervals, so that there is a mark every 4 minutes on the playback progress bar.

[0191] Accordingly, displaying at least one piece of text information may specifically include the following steps:

[0192] Step S7031: When a triggering operation on the multiple tags is detected, the first playback time of the triggered tag in the video file is determined, and the current playback time is switched to the first playback time to play the video file from the first playback time.

[0193] In this implementation, the triggering operation on the multiple marks may refer to a click operation or a touch operation performed by the user on the marks. When the triggering operation on the marks by the user is detected, the play time point marked by the marks may be obtained, and the play time point is the first play time. At the same time, the current play time may be adjusted to the first play time, that is, the current position of the play progress bar is adjusted to the position of the mark, so as to play the video file from the first play time.

[0194] Step S7032: extracting at least one first text information whose corresponding start play time is within a first preset time range from the first play time from the text file.

[0195] In this embodiment, when obtaining the first playback time marked by the triggered mark, the starting playback time within the first preset time range from the first playback time can be obtained from multiple starting playback times, and then, the text information of the corresponding starting playback time within the first preset time range from the first playback time can be extracted from the text file, and the text information is the first text information.

[0196] Among them, the first preset time range can be set according to needs.

[0197] For example, refer to Figure 8 As shown, a schematic diagram of an interface for displaying text information in a video file in an example is shown. Take the total playback time of the video file as 20 minutes, and set 4 marks at equal time intervals as an example. The user clicks on mark 1, and the video file is played from mark 1, and the playback time of mark 1 is obtained as 4 minutes and 5 seconds. Then, the text information with a starting playback time between 3 minutes and 55 seconds and 4 minutes and 15 seconds in the text file can be extracted and displayed on the playback interface. Among them, when displaying the text information between 3 minutes and 55 seconds and 4 minutes and 15 seconds, the text information can be displayed on the progress bar, or displayed on the left or right side of the video screen, and the display position can be determined according to needs.

[0198] Through this implementation, the user can trigger the mark on the playback progress bar to obtain the conference content of the video conference in the nearby time period.

[0199] In combination with the above embodiments, another implementation method for displaying text information during the playback of a video file is provided. In this implementation method, the video file may also carry multiple tags, wherein the playback of the video file may be a playback process such as step S702'.

[0200] In this implementation, displaying at least one piece of text information may specifically include the following steps:

[0201] Step S7031': determine the progress position corresponding to the current playback time, and determine a target mark within a preset distance from the progress position among the multiple marks.

[0202] In this embodiment, the progress position corresponding to the current playback time is the position of the current playback time point on the playback progress bar. Since multiple marks are displayed on the playback progress bar, each mark has its own position on the playback progress bar. The distance difference between the position of the current playback time point on the playback progress bar and the position of each mark on the playback progress bar can be determined, and the target mark with the distance difference within the preset distance can be determined.

[0203] In practice, the target marker may be the marker closest to the current playback time point.

[0204] Step S7032': Determine a second play time from the target mark in the video file.

[0205] In this implementation manner, the play time point marked by the target mark can be obtained, and the play time point is the second play time.

[0206] Step S7033': extracting at least one second text information whose start playing time is within a preset time range from the second playing time from the text file.

[0207] The process of step S7033' is similar to the process of step S7032, and the relevant parts can be referred to the description of step S7032, which will not be repeated here. The preset time range can be consistent with the first preset time range.

[0208] In this embodiment, the storage service system can automatically extract and display text information based on the difference between the current playback time and the playback time points marked by each tag, without affecting the normal playback of the video file, thereby optimizing the user experience.

[0209] In combination with the above embodiments, another implementation method of displaying text information during the playback of a video file is provided. In this implementation method, at least one piece of text information near the current playback may be displayed, and the following steps may be specifically included:

[0210] Step S7031": Determine at least one starting playback time from each of the starting playback times that is within a second preset time range and is related to the current playback time.

[0211] In this implementation, the start play time corresponding to each piece of text information in the text file may be traversed, thereby filtering out at least one start play time within the second preset time range that is the same as the current play time.

[0212] The second preset time range may be set according to actual needs. Specifically, the second preset time range may be different from the first preset time range.

[0213] Step S7032": Obtain at least one third text information corresponding to the at least one start playback time from the text file.

[0214] In this implementation manner, the text information corresponding to the at least one screened start playback time may be extracted, and the text information is the third text information, and then the third text information is displayed.

[0215] When this embodiment is adopted, the storage service system can display text information synchronized with the playback progress in real time during the playback of the video file, so that the user can watch the meeting content that is relatively synchronized with the video file in real time while watching the video file, further optimizing the user experience.

[0216] In one implementation, the storage service system may generate complete meeting minutes after the video conference ends. Specifically, the following steps may be performed:

[0217] Step S605: When the video conference ends, obtain conference data of the video conference.

[0218] In this embodiment, when the video conference ends, the storage service system can obtain the conference data from the conference control terminal. Specifically, the storage service system can generate a conference data request instruction and send the conference data request instruction to the autonomous server, so that the autonomous server sends the conference data request instruction to the conference control terminal. Furthermore, the conference control terminal can respond to the conference data request instruction and return the conference data related to the video conference to the storage service system along the above path (conference management server-autonomous server).

[0219] Among them, the conference data may include information such as the name of the video conference, the number of participants, and the conference topic.

[0220] Step S606: Generate meeting minutes based on the meeting data and the text file, and publish the meeting minutes.

[0221] After obtaining the meeting data, the storage service system may store the meeting data in a text file to obtain the meeting minutes. In practice, the storage service system may store the meeting minutes in the backend of the storage service system.

[0222] Step S607: upon receiving a download request from a user for the published meeting minutes, the meeting minutes are sent to the user.

[0223] In this embodiment, the storage service system can publish the name of the meeting minutes on the web end so that users can view and download them. The name of the meeting minutes can be consistent with the name of the video conference. Specifically, when the web end of the storage service system detects the user's download operation on the meeting minutes, it can generate a download request and send the download request to the backend of the storage service system. The backend of the storage service system sends the meeting minutes to the user who is currently logged in to the storage service system based on the download request.

[0224] It should be noted that the above example is a specific embodiment of the present invention. In practice, recording video files and text files may not be limited to the above method. For example, if the video files and text files are recorded by an autonomous server, the corresponding storage service system may obtain the video files and text files from the autonomous server. Alternatively, if the video files and text files are recorded by a conference control terminal, the corresponding storage service system may obtain the video files and text files from the conference control terminal.

[0225] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0226] refer to Fig. 9 , shows a schematic diagram of the structure of a video conference processing device of this embodiment, the device can be applied to a storage service system in a visual network, and specifically may include the following modules:

[0227] The file acquisition module 901 can be used to obtain a video file recorded for the video conference and a text file corresponding to an audio stream in the video conference during a recording period; the text file includes multiple text information, wherein each text information includes a start playback time of the audio stream corresponding to the text information in the video file;

[0228] The video playing module 902 may be used to play the video file upon receiving a user's request to play the video file;

[0229] The information extraction module 903 may be used to extract at least one piece of text information corresponding to the current playback time from the text file according to the current playback time and each of the start playback times during the playback of the video file;

[0230] The information display module 904 may be configured to display the at least one piece of text information.

[0231] Optionally, a conference control terminal and an autonomous server may be deployed in the visual network, and the device may further include the following modules:

[0232] An instruction receiving module may be used to receive a conference recording instruction sent by the autonomous server, wherein the conference recording instruction is generated by the conference control terminal and sent to the autonomous server;

[0233] The video recording module can be used to record the audio stream and video stream currently generated in the video conference in response to the conference recording instruction, and cache the audio stream; wherein the audio stream is the audio stream collected by the terminal currently speaking in the video conference;

[0234] The audio recognition module can be used to identify the cached audio stream every time it is detected that the total playback time of a cached audio stream reaches a preset time, obtain text information corresponding to the audio stream, and use the start time of the audio stream in the recording process as the start playback time;

[0235] The file acquisition module can be used to store multiple text information corresponding to the cached multiple audio streams as a text file when the recording of the current video conference is finished.

[0236] Optionally, the video file may carry multiple tags, and the file playing module 902 may be specifically used to display the multiple tags on a playing progress bar of the video file, wherein each tag on the playing progress bar is used to indicate the playing time of the tag in the video file;

[0237] The information extraction module 903 may specifically include the following units:

[0238] A first determining unit may be configured to determine a first play time of the triggered mark in the video file when a triggering operation on the multiple marks is detected;

[0239] a progress adjustment unit, which can be used to switch the current play time to the first play time, so as to play the video file from the first play time;

[0240] The first extraction unit may be configured to extract, from the text file, at least one first text information whose corresponding start playback time is within the first preset time range from the first playback time.

[0241] Optionally, the video file may carry multiple marks, and the file playing module may be specifically used to display the multiple marks on a playing progress bar of the video file, wherein each mark on the playing progress bar is used to indicate the playing time of the mark in the video file;

[0242] The information extraction module 903 may include the following units:

[0243] The second determining unit may be configured to determine a progress position corresponding to a current playback time, and determine a target mark within a preset distance from the progress position among the multiple marks;

[0244] A third determining unit may be used to determine a second play time from the target mark in the video file;

[0245] The second extraction unit may be configured to extract at least one second text information whose start playing time is within a preset time range from the second playing time from the text file.

[0246] Optionally, the information extraction module 903 may include the following units:

[0247] A fourth determining unit may be used to determine at least one starting playback time within a second preset time range from the starting playback times;

[0248] The third extraction unit may be configured to obtain at least one third text information corresponding to the at least one start playback time from the text file.

[0249] Optionally, the device may further include the following modules:

[0250] A conference data acquisition module, which can be used to obtain conference data of the video conference when the video conference ends;

[0251] A meeting minutes generation module, which can be used to generate meeting minutes based on the meeting data and the text file, and publish the meeting minutes;

[0252] The meeting minutes sending module can be used to send the meeting minutes to the user when receiving a download request for the published meeting minutes from the user. :

[0253] As for the embodiment of the video conference processing device, since it is basically similar to the embodiment of the video conference processing method, the description is relatively simple, and the relevant parts can be referred to the partial description of the embodiment of the video conference processing method.

[0254] An embodiment of the present invention further provides an electronic device, including:

[0255] one or more processors; and

[0256] One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, enable the device to perform one or more video conference processing methods as described in the embodiments of the present invention.

[0257] The embodiment of the present invention further provides a computer-readable storage medium, which stores a computer program that enables a processor to execute the video conference processing method as described in the embodiment of the present invention.

[0258] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0259] It will be appreciated by those skilled in the art that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0260] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0261] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0262] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0263] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0264] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0265] The above is a detailed introduction to a video conference processing method, device, electronic device and storage medium provided by the present invention. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for general technical personnel in this field, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A video conference processing method, characterized in that: The method is applied to a storage service system in a visual network, including: Obtaining a video file recording the video conference and a text file corresponding to an audio stream in the video conference during a recording period; the text file includes multiple sections of text information, wherein each section of text information includes a start time of playing the audio stream corresponding to the text information in the video file; When receiving a request from a user to play the video file, playing the video file; In the process of playing the video file, extracting at least one piece of text information corresponding to the current playing time from the text file according to the current playing time and each of the starting playing times; Displaying the at least one piece of text information; The video file carries multiple marks, which are displayed on a playback progress bar of the video file, wherein each mark on the playback progress bar is used to indicate the playback time of the mark in the video file; so that the storage service system can determine at least one piece of text information corresponding to the current playback time based on the difference between the playback time of the mark in the video file and the current playback time.

2. The method according to claim 1, characterized in that: Playing the video file includes: Extracting at least one piece of text information corresponding to the current play time from the text file according to the current play time and each of the start play times, including: When a triggering operation on the multiple tags is detected, determining a first play time of the triggered tag in the video file, and switching the current play time to the first play time, so as to play the video file from the first play time; At least one first text information whose corresponding starting playback time is within a first preset time range from the first playback time is extracted from the text file.

3. The method according to claim 1, characterized in that Playing the video file includes: Extracting at least one piece of text information corresponding to the current play time from the text file according to the current play time and each of the start play times, including: Determine a progress position corresponding to a current playback time, and determine a target mark within a preset distance from the progress position among the multiple marks; Determine a second play time of the target mark in the video file; At least one second text information whose starting playing time is within a preset time range from the second playing time is extracted from the text file.

4. The method according to claim 1, characterized in that Extracting at least one piece of text information corresponding to the current play time from the text file according to the current play time and each of the start play times, including: Determine at least one starting playback time within a second preset time range from each of the starting playback times; At least one third text information corresponding to the at least one start playing time is obtained from the text file.

5. The method according to claim 1, characterized in that A conference control terminal and an autonomous server are deployed in the visual network. Before obtaining a video file recorded for the video conference, the method further includes: receiving a conference recording instruction sent by the autonomous server, wherein the conference recording instruction is generated by the conference control terminal and sent to the autonomous server; In response to the conference recording instruction, the audio stream and the video stream currently generated in the video conference are recorded, and the audio stream is cached; wherein the audio stream is the audio stream collected by the terminal currently speaking in the video conference; Whenever it is detected that the total playing time of a cached audio stream reaches a preset time, the cached audio stream is identified to obtain text information corresponding to the audio stream, and the starting time of the audio stream in the recording process is used as the starting playing time; When the recording of the current video conference is finished, the multiple text information corresponding to the cached multiple audio streams are stored as a text file.

6. The method according to claim 5, characterized in that When the recording of the current video conference is finished, after storing the multiple text information corresponding to the cached multiple audio streams as a text file, the method further includes: When the video conference ends, obtaining conference data of the video conference; Generate meeting minutes based on the meeting data and the text file, and publish the meeting minutes; When receiving a download request from a user for the published conference minutes, the conference minutes are sent to the user.

7. A video conference processing device, characterized in that: The device is applied to a storage service system in a visual network, including: A file acquisition module is used to obtain a video file recorded for the video conference, and a text file corresponding to an audio stream in the video conference during a recording period; the text file includes multiple sections of text information, wherein each section of text information includes a start playback time of the audio stream corresponding to the text information in the video file; A video playing module, used for playing the video file upon receiving a user's request to play the video file; An information extraction module is used to extract at least one piece of text information corresponding to the current playback time from the text file according to the current playback time and each of the start playback times during the playback of the video file; An information display module, used to display the at least one piece of text information; The video file carries a plurality of tags, and the device further comprises: A marking module is used to display the multiple marks on a playback progress bar of the video file, wherein each mark on the playback progress bar is used to indicate the playback time of the mark in the video file; so that the storage service system can determine at least one piece of text information corresponding to the current playback time based on the difference between the playback time of the mark in the video file and the current playback time.

8. The device according to claim 7, characterized in that The visual network is deployed with a conference control terminal and an autonomous server, and the device also includes: An instruction receiving module, configured to receive a conference recording instruction sent by the autonomous server, wherein the conference recording instruction is generated by the conference control terminal and sent to the autonomous server; A video recording module, configured to record the audio stream and video stream currently generated in the video conference in response to the conference recording instruction, and cache the audio stream; wherein the audio stream is the audio stream collected by the terminal currently speaking in the video conference; The audio recognition module is used to recognize the cached audio stream every time it is detected that the total playback time of a cached audio stream reaches a preset time, obtain text information corresponding to the audio stream, and use the start time of the audio stream in the recording process as the start playback time; The file acquisition module is used to store multiple text information corresponding to the cached multiple audio streams as a text file when the recording of the current video conference is finished.

9. An electronic device, characterized in that: include: one or more processors; and One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, enable the device to perform the video conference processing method as described in any one of claims 1 to 6.

10. A computer-readable storage medium, characterized in that: The computer program stored therein enables the processor to execute the video conference processing method as described in any one of claims 1 to 6.

Images