Recording method and computer program product of multimedia conference based on media forwarding server

By deploying a media forwarding server on the exit side of the intranet, real-time media data streams of multimedia conferences are obtained and stored, the security and storage space problems of video conferencing cloud services are solved during recording, and safe and convenient multimedia conference recording and sharing are achieved. .

CN114339124BActive Publication Date: 2024-11-01SUIRUI TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202111618500.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-12-27
Publication Date
2024-11-01
Estimated Expiration
2041-12-27

AI Technical Summary

Technical Problem

The existing video conferencing cloud services have security problems when recording audio and video conferencing content, especially in confidential conference scenarios, and the local recording method occupies too much storage space, affecting device performance and resource sharing.

Method used

Using the recording method based on the media forwarding server, it is deployed in the security area on the exit side of the intranet, and obtains real-time media data streams through the media forwarding server, records and stores, avoiding data being exposed to the Internet, and is stored and shared on the intranet. Supports secure recording and sharing of multimedia conferences.

Benefits of technology

It improves the security of conference media data and recording files, reduces the storage burden on participating clients, realizes convenient sharing and management of recording files, and improves the resource utilization efficiency of internal multimedia conferences.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114339124B_ABST
    Figure CN114339124B_ABST
Patent Text Reader

Abstract

The present invention relates to a recording method for a multimedia conference based on a media forwarding server and related products thereof. The media forwarding server is deployed in a security zone on the exit side of an intranet, and supports forwarding of media data based on the intranet and / or extranet. The recording method comprises: in response to obtaining a subscription demand for a multimedia conference forwarded via the intranet, obtaining a real-time media data stream about the multimedia conference from the media forwarding server; performing a recording operation on the obtained real-time media data stream according to the subscription demand to generate a recording file; and performing a storage operation on the recording file. Through the technical solution of the present invention, it is possible to take into account both the security requirements and the sharing requirements for multimedia conference recording.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention generally relates to the field of multimedia communication technology. More specifically, the present invention relates to a recording method for a multimedia conference based on a media forwarding server, a device for executing the recording method, and a computer program product. Background Art

[0002] This section is intended to provide background or context for the embodiments of the invention set forth in the claims. The descriptions herein may include concepts that may be explored, but not necessarily concepts that have been previously thought of or explored. Therefore, unless otherwise noted herein, the content described in this section is not prior art with respect to the specification and claims of this application, and is not admitted to be prior art by inclusion in this section.

[0003] With the development of multimedia communication technology, the utilization rate of remote video conferencing has greatly increased. Combined with the development of cloud computing, the business of SaaS video conferencing cloud services is also growing. The widespread popularization and use of video conferencing cloud services have greatly reduced the cost of enterprise IT deployment of video conferencing hardware terminals. In actual applications, by using the audio and video encoding and decoding capabilities of personal hosts or mobile terminal devices, you can join a meeting anytime and anywhere. Currently, there are two main functions for audio and video conference recording based on video conferencing cloud services:

[0004] Method 1: The video media stream is forwarded through the cloud computing server. During the media forwarding process of the cloud computing server, the real-time media stream in the meeting can be pulled to record the audio and video conference content, and the recorded file can be transcoded and saved in the cloud computing storage server.

[0005] Method 2: When joining a meeting, the participating client (such as a personal host or mobile terminal) uses the client-side capabilities to pull the media stream in the real-time meeting and save the audio and video media stream in real time on the local device to achieve the local recording function.

[0006] The above two methods each have their own advantages and disadvantages. For example, method 1 uses a cloud computing server to pull media streams for recording, which can solve the problem of insufficient local recording storage space. However, given that the video conference media streams and recorded file data involved are exposed and stored in Internet shared resources, there are certain security issues and cannot meet the needs of scenarios with high security requirements (such as confidential meetings within the enterprise). Although method 2 ensures the security of recorded files through localized storage, it will occupy too much local storage space of the participating clients, which not only requires the participating clients to have higher configurations but also makes it inconvenient to read and share conference resources. Summary of the invention

[0007] In order to at least solve the technical problems described in the above background technology section, the present invention proposes a multimedia conference recording solution based on a multimedia forwarding server. By using the solution of the present invention, the security requirements and sharing requirements for multimedia conference recording can be taken into account. In view of this, the present invention provides solutions in the following aspects.

[0008] The first aspect of the present invention provides a recording method for a multimedia conference based on a media forwarding server, wherein the media forwarding server is deployed in a security zone on the exit side of an intranet and supports forwarding of media data based on the intranet and / or an extranet, and the recording method comprises: in response to obtaining a subscription demand for a multimedia conference forwarded via the intranet, obtaining a real-time media data stream about the multimedia conference from the media forwarding server; performing a recording operation on the obtained real-time media data stream according to the subscription demand to generate a recording file; and performing a storage operation on the recording file.

[0009] In one embodiment, obtaining the real-time media data stream about the multimedia conference from the media forwarding server includes: determining the real-time media data stream to be recorded according to the screen mode of the multimedia conference; and pulling the real-time media data stream from the media forwarding server.

[0010] In one embodiment, for at least one of the real-time media data streams, performing a recording operation includes: obtaining identification information of each of the real-time media data streams; starting a stream pulling process to pull the real-time media data stream according to the identification information of each of the real-time media data streams; and performing a recording operation on each of the pulled real-time media data streams.

[0011] In one embodiment, recording each of the pulled real-time media data streams includes: during the recording process of each of the real-time media data streams, independently storing the video file, audio file and instant text file related to each of the real-time media data streams.

[0012] In one embodiment, the method further includes: in response to the existence of a plurality of recorded video files, merging the plurality of the video files; and transcoding the merged video files and other recorded files to obtain the recorded files.

[0013] In one embodiment, performing a storage operation on the recording file includes: in response to the address of the predetermined shared network disk of the intranet being not empty, storing the recording file in the predetermined shared network disk; or in response to the address of the predetermined shared network disk of the intranet being empty, storing the recording file in the predetermined shared local disk.

[0014] In one embodiment, wherein the predetermined shared network disk includes a first type of storage space and a second type of storage space, storing the recording file in the predetermined shared network disk includes: calculating a reserved space threshold required for temporary cache data involved in the recording file generation process; in response to the remaining space of the first type of storage space being greater than or equal to the reserved space threshold, storing the temporary cache data in the first type of storage space, and polling during the storage process to check whether the remaining space of the first type of storage space can store the temporary cache data; determining the second type of storage space based on the difference between the total space value of the predetermined shared network disk and the reserved space threshold; and storing the recording file in the second type of storage space.

[0015] In one embodiment, the first type of storage space includes temporary storage space for streaming and temporary storage space for transcoding, wherein the temporary cached data includes real-time media data streams pulled by the streaming operation and files transcoded by the transcoding operation, and calculating the reserved space threshold required for the temporary cached data involved in the recording file generation process includes: determining the reserved space threshold required for the real-time media data stream pulled by the streaming operation according to the number of multimedia conferences expected to be recorded concurrently in the intranet and the real-time media data streams pulled by the streaming operation during a single recording process; and determining the reserved space threshold required for the files transcoded by the transcoding operation according to the number of multimedia conferences expected to be recorded concurrently in the intranet and the files transcoded by the transcoding operation during a single recording process.

[0016] The second aspect of the present invention proposes a device, comprising: a processor; and a memory, which stores computer instructions for recording a multimedia conference based on a media forwarding server. When the computer instructions are executed by the processor, the device executes the method according to the first aspect of the present invention and the multiple embodiments described below.

[0017] The third aspect of the present invention proposes a computer program product, including program instructions for recording a multimedia conference based on a media forwarding server. When the program instructions are executed by a processor, the method according to the first aspect of the present invention and the following multiple embodiments is implemented.

[0018] By using the solution provided by the present invention, the forwarding service resources for media data can be sunk to the security zone of the intranet, and the interaction, recording and storage of media streams can be performed based on the forwarding service resources, so as to avoid the exposure of conference resources (especially intranet conference resources) to the Internet to the greatest extent, thereby improving the security of media data and recorded files involved in the conference. In addition, the implementation of the entire recording process does not depend on the participating client, and the recorded files can be stored, so that the participating client can read the recorded files according to the needs, thereby meeting the sharing needs. In some embodiments of the present invention, for multiple real-time media data streams, a corresponding number of stream pulling processes can be started to perform stream pulling operations on each real-time media data stream, thereby effectively improving the processing efficiency. In other embodiments of the present invention, the recorded files can be stored in a predetermined shared network disk or a predetermined shared local disk so as to access and read according to needs. Specifically, in relation to a predetermined shared network disk, classified storage management can be performed for temporary cache data and recorded files, thereby effectively improving the efficiency of internal multimedia conferences occupying cloud resources and the efficiency of internal sharing of recorded files. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] By reading the following detailed description with reference to the accompanying drawings, the above and other objects, features and advantages of the exemplary embodiments of the present invention will become readily understood. In the accompanying drawings, several embodiments of the present invention are shown in an exemplary and non-limiting manner, and the same or corresponding reference numerals represent the same or corresponding parts, wherein:

[0020] Figure 1 is a schematic diagram showing an exemplary scenario of media data interaction in a multimedia conference according to an embodiment of the present invention;

[0021] Figure 2 is a flow chart showing a method for recording a multimedia conference based on a media forwarding server according to an embodiment of the present invention;

[0022] Figure 3 is a flow chart showing a method for recording a multimedia conference based on a media forwarding server according to another embodiment of the present invention;

[0023] Figure 4 is a flow chart showing a method for recording a multimedia conference based on a media forwarding server according to yet another embodiment of the present invention; and

[0024] Figure 5 is a structural diagram showing a device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0026] It should be understood that the terms "first", "second", "third" and "fourth" etc. in the claims, specifications and drawings of the present invention are used to distinguish different objects rather than to describe a specific order. The terms "include" and "comprise" used in the specification and claims of the present invention indicate the presence of the described features, wholes, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or their collections.

[0027] It should also be understood that the terms used in this specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. As used in the specification of the present invention and the claims, the singular forms of "a", "an" and "the" are intended to include the plural forms unless the context clearly indicates otherwise. It should also be further understood that the term "and / or" used in the specification of the present invention and the claims refers to any combination of one or more of the associated listed items and all possible combinations, and includes these combinations.

[0028] As used in this specification and claims, the term "if" may be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined" or "if [described condition or event] is detected" may be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]," depending on the context.

[0029] The specific embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0030] Figure 1 1 is a schematic diagram showing an exemplary scenario 100 of media data interaction in a multimedia conference according to an embodiment of the present invention. It is understandable that the multimedia conference of the present invention can be implemented by sinking the video conference media forwarding service to the security zone of the enterprise intranet on the basis of the SaaS video conference cloud service networking architecture. In some embodiments, the security zone may include a demilitarized zone (DMZ) deployed by the enterprise or a firewall at the exit of the enterprise intranet. Figure 1As shown, the exemplary scenario 100 may include scenarios of different conference clients 1-N initiating and joining a multimedia conference, scenarios of sending media streams of a multimedia conference, and scenarios of media stream subscription and sharing interaction of recorded files.

[0031] In actual applications, the scenarios of initiating and joining multimedia conferences by different conference clients 1~N mainly involve the interaction between the conference client and the cloud server 103 (the cloud server can be a SaaS Internet cloud server). That is, when users in the intranet (including within the enterprise or within the local area network) need to conduct a remote video conference, they can initiate and join the conference through the interaction between the conference client and the cloud server 103. Once the media forwarding resources are allocated to the media forwarding server 101 located in the intranet security zone, all users within the enterprise or the local area network can actively establish a connection with the media forwarding server 101 through the conference client to interact with the audio and video media streams. Specifically, the media stream can be sent through the conference clients 1~N in the intranet. It should be noted that Figure 1 Only the interaction of media data in the intranet is shown, and the media data involved in the multimedia conference in the solution of the present invention is not limited to the participating clients in the intranet. For example, in a multimedia conference, if there are participating clients in the extranet joining the conference at the same time, the media data of the participating clients in the extranet can be forwarded by the cloud server, and when the corresponding media stream subscription demand is met in the intranet, the media forwarding server can pull the media data of the participating clients in the extranet from the cloud server.

[0032] The recording process involved in the present invention can be executed by device 102. Specifically, device 102 can obtain the subscription requirements sent by the participating client, and can adopt the same media data stream subscription method as the client to send the subscription requirements to the media forwarding server 101, so as to obtain the real-time media data stream (including intranet data and / or extranet data) from the media forwarding server 101, and record and save the real-time media data stream. The participating client in the intranet can obtain the recording file from the device according to the demand. Based on this, the entire recording process can take into account the security requirements and sharing requirements of multimedia conferences. It can be understood that although Figure 1 The media forwarding server 101 and the device 102 are shown as two separate devices, which may also be combined into one device. The embodiment of the present invention is not limited in this regard.

[0033] Figure 2 2 is a flowchart showing a method 200 for recording a multimedia conference based on a media forwarding server according to an embodiment of the present invention. It should be noted that the method 200 can be understood as Figure 1 The recording process described in the foregoing is an exemplary implementation method, and can be specifically performed by the device 102. Figure 1The detailed description in also applies to the following.

[0034] like Figure 2 As shown, at step S201, in response to the acquisition of the subscription demand for multimedia conference forwarded via the intranet, the real-time media data stream about the multimedia conference can be obtained from the media forwarding server. As mentioned above, the intranet here can be understood as the internal network of the enterprise (which may include a local area network, etc.). The media forwarding server can be deployed in the security zone on the intranet exit side, and supports the forwarding of media data based on the intranet and / or the extranet. As mentioned above, the initiation and joining of the multimedia conference here can be supported by the SaaS Internet cloud server. The media forwarding server can be specifically deployed in the enterprise isolation zone or the protective wall of the intranet exit, and undertake the media forwarding resources related to the multimedia conference sunk by the SaaS Internet cloud server. The aforementioned subscription demand can be initiated by the user through the intranet conference client. When the device obtains the subscription demand, it can use the same subscription method to send the subscription demand to the media forwarding server to obtain the real-time media data stream from the aforementioned media forwarding server. The real-time media data stream may include media data in the intranet. As a result, the media data in its intranet can be avoided from being exposed to the cloud to the greatest extent, providing a prerequisite for the subsequent safe recording of the meeting. In addition, if the participating client involved in the subscription demand is located in the external network, the real-time media data stream may also involve media data from the external network.

[0035] Next, at step S202, a recording operation can be performed on the acquired real-time media data stream according to the subscription requirements to generate a recording file. And at step S203, a storage operation can be performed on the aforementioned recording file. Thus, the interaction, recording and storage of media streams can be performed through the forwarding service resources deployed in the security zone to avoid the exposure of conference resources (especially intranet conference resources) to the Internet to the greatest extent, thereby improving the security of media data and recording files involved in the meeting. In addition, the implementation of the entire recording process does not depend on the participating clients, and the recording files can be stored so that the participating clients can read the recording files as needed, thereby meeting the sharing requirements.

[0036] Further, in some embodiments, for the real-time media data stream, it can be determined in combination with the screen mode of the multimedia conference. Specifically, the real-time media data stream to be recorded can be determined according to the screen mode of the multimedia conference, and the real-time media data stream can be pulled from the media forwarding server. Among them, the screen mode of the multimedia conference can include speaker mode and gallery mode. For example, during the stream pulling process, if the main venue of the multimedia conference (such as a video conference) is in speaker mode and there is only one mainstream, the stream pulling recording of one main video stream can be implemented. If the main venue is in gallery mode and there is only one mainstream, the subscribed video stream can be assumed to be still the speaker, and the subscribed mainstream is the speaker's media stream. In addition, the sound files and instant message texts during the meeting can be independently recorded and saved at the same time. It should be noted that the description of the acquisition process of the real-time media data stream here is only an exemplary description, and the scheme of the present invention is not limited to this.

[0037] Figure 3 FIG. 3 is a flowchart showing a method 300 for recording a multimedia conference based on a media forwarding server according to another embodiment of the present invention. It should be noted that the method 300 can be understood as Figure 1 The method 300 is an exemplary implementation of the recording process described in the embodiment of the present invention, and can be specifically performed by the device 102. In addition, the method 300 can also be understood as a further description and expansion of the method 200. Figure 1 and Figure 2 The detailed description in also applies to the following.

[0038] like Figure 3 As shown, at step S301, in response to obtaining a subscription demand for a multimedia conference forwarded via the intranet, a real-time media data stream about the multimedia conference can be obtained from the media forwarding server. For the multimedia conference, intranet, media forwarding server and real-time media data stream here, please refer to Figure 1 and Figure 2 The description of the relevant parts will not be repeated here.

[0039] Next, at step S302, identification information of each real-time media data stream may be obtained. The identification information here may include an ID or other information that can distinguish and identify the media data stream. In some embodiments, the identification information of each real-time media data stream may be set and shared by the speaker or sharer of the media data stream.

[0040] Next, at step S303, a stream pulling process can be started to pull a real-time media data stream according to the identification information of each real-time media data stream. The number of stream pulling processes here is equivalent to the number of real-time media data streams, and can be a one-to-one correspondence, that is, a real-time media data stream can be pulled by a stream pulling process. In this way, the processing efficiency can be effectively improved. It should be noted that the description of the stream pulling process of the real-time media data stream here is only an exemplary description, and the scheme of the present invention is not limited to this. For example, a stream pulling process can also be set to pull multiple real-time media data streams according to the performance of the device.

[0041] Next, at step S304, during the recording process of each real-time media data stream, the video file, audio file and instant text file of each real-time media data stream can be stored independently. Considering that the video file, audio file and instant text file are transmitted by different transmission channels, their corresponding formats are also different. If all files are stored together, not only the computing load is increased, but also the display media requirements are relatively high. Based on this, the use of separate storage of these files can not only save computing resources, but also facilitate the subsequent display through a variety of display media.

[0042] Then, at step S305, in response to the presence of multiple recorded video files, the multiple video files can be merged. And at step S306, the merged video files and other recorded files can be transcoded to obtain recorded files. In some embodiments, the video files can be merged specifically according to the split-screen mode. For example, for a 2-split screen or a 4-split screen mode, a large display screen can be cut into 2 or 4 16:9 screens, and then the video files are filled in. Specifically, for the unfilled parts, blank space can be left by default, and the other parts can be filled and displayed with dual-stream or multi-stream video files in a predetermined format (such as YUV422 format). It should be noted that the description of the merging process of video files here is only an exemplary description, and the scheme of the present invention is not limited thereto. For example, other commonly used video synthesis techniques can also be used.

[0043] Next, at step S307, the recording file may be stored so that the participating client can obtain it. Thus, the recording of the multimedia conference is realized.

[0044] Figure 4 FIG. 4 is a flowchart showing a method 400 for recording a multimedia conference based on a media forwarding server according to another embodiment of the present invention. It should be noted that the method 400 can be understood as Figure 1The method 400 is an exemplary implementation of the recording process described in the embodiment of the present invention, and can be specifically implemented by the device 102. In addition, the method 400 can also be understood as a further description and expansion of the method 200 and the method 300. Figures 1 to 3 The detailed description in also applies to the following.

[0045] In actual applications, the aforementioned devices can support edge streaming services, edge recording and transcoding services, and edge storage services. Figure 4 As shown, at step S401, a communication connection can be actively established with the media forwarding server on the same side of the media forwarding server in the firewall as an edge recording and streaming service. During a remote video conference conducted by users in an enterprise or a local area network through a participating client, only the actions of initiating and joining the conference can be controlled by the SaaS Internet cloud service, and once the media forwarding resources are allocated to the media forwarding server in the intranet, all users in the enterprise or the local area network can actively establish a connection with the media forwarding server in the firewall through the participating client to send audio and video media data streams. When the participating client has a subscription demand for the media data stream, the device side can send a subscription demand to the media forwarding server in the same way as the participating client subscribes to the media stream, so as to pull the real-time media data stream from the media forwarding server.

[0046] Next, at step S402, real-time media stream pulling can be performed according to the video conference screen mode. As previously mentioned, in some embodiments, the screen mode of a multimedia conference may include a speaker mode and a gallery mode. For example, if the main venue of a multimedia conference (such as a video conference) is in speaker mode and there is only one mainstream, a stream pulling and recording of one main video stream can be implemented. If the main venue is in gallery mode and there is only one mainstream, the subscribed video stream can be assumed to still be the speaker, and the subscribed mainstream can be the speaker's media stream. It should be noted that the description of the real-time media data stream acquisition process here is only an exemplary description, and the solution of the present invention is not limited to this.

[0047] Then, at step S403, when the subscribed media stream is multi-stream, a corresponding number of stream pulling processes can be started to pull the stream and record. Among them, the stream pulling process and the real-time media data stream can be a one-to-one relationship or a one-to-many relationship (that is, one stream pulling process can pull multiple real-time media data streams). For example, for a 2-channel real-time media data stream scenario, the speaker can use the broadcast message channel to notify all participants of his own identity (such as the speaker) and mark his video stream ID. When a participant performs local screen sharing, the sharer can also actively send the local shared video stream ID to all participants. After receiving the broadcast message of two video stream IDs, the device can initiate a subscription to the two video stream IDs at the same time, pull the dual streams from the media forwarding server and save the two video streams. In addition, the sound files and instant message texts during the recording process can still be saved as independent files.

[0048] Then, at step S404, the recorded file can be transcoded. And at step S405, after the transcoding is completed, the final generated recording file can be saved in a predetermined shared network disk or a predetermined shared local disk. For example, during the operation of the edge storage service supported by the device, the predetermined shared network disk can be automatically configured by default configuration. If it is detected that the address of the predetermined shared network disk is empty, the local disk of the device is started by default.

[0049] Next, at step S406, in response to the storage on the predetermined shared network disk, the reserved space threshold required for the temporary cache data involved in the recording generation process can be calculated, and the temporary cache data can be stored in the first type of storage space whose remaining space is greater than or equal to the reserved space threshold, and the second type of storage space can be determined based on the difference between the total space value of the predetermined shared network disk and the reserved space threshold, and the recording file can be stored in the second type of storage space.

[0050] In actual applications, during the initialization phase of starting the edge recording and transcoding service supported by the device, the storage space of the reserved shared network disk can be divided into three parts: temporary storage space for streaming, temporary storage space for transcoding, and permanent storage area for recording files. The aforementioned first type of storage space can include temporary storage space for streaming and temporary storage space for transcoding, and the aforementioned second type of storage space can include a permanent storage area for recording files. Specifically, the size of the temporary storage space for streaming = the number of concurrent recording meetings that may exist within the enterprise × the size of the space required to pull the media stream during a single recording × k1; the size of the temporary storage space for transcoding = the number of concurrent recording meetings that may exist within the enterprise × the size of the space required for the transcoding buffer during a single recording × k2; the permanent storage area for recording files = the remaining available intranet shared storage space. It should be noted that k1 and k2 can be adjusted according to design requirements, for example, both k1 and k2 can be 1.5. In addition, the division of the storage space of the reserved shared network disk and the calculation method of each storage space are only exemplary descriptions, and the scheme of the present invention is not limited thereto.

[0051] The management process of the three storage spaces divided above specifically involves that, in the process of real-time media stream pulling, it is possible to determine at predetermined intervals (e.g., 5s) whether the size of the remaining temporary storage space for pulling the stream is sufficient to store the buffered media data stream. If the temporary storage space is insufficient, an error message may be immediately displayed indicating edge recording failure. In addition, a default reserved space threshold may be configured, and it may be possible to determine whether the remaining space size meets the reserved space threshold before recording, and when it is determined that the reserved space threshold is not met, an error message may be directly displayed indicating recording failure.

[0052] Before transcoding the temporarily stored subscription stream to produce video files, audio files, and text files, the disk size of the reserved path during the transcoding process can be read. If the disk size is less than the predetermined space of the transcoded source file (for example, 3 times the space), the recording transcoding fails. In addition, a scheduled task can be enabled, and the disk space can be polled every predetermined time interval (for example, 5 minutes) to check whether it meets the requirements. If it does, the transcoding will be restarted.

[0053] Before storing the transcoded file to the scheduled shared network disk or the scheduled shared local disk, you can count and output the remaining disk space used for conference recording. And you can pass the statistical results to the enterprise management platform of the SaaS cloud service through the RESTFUL interface in a certain format. Relevant personnel can log in to the enterprise management platform to view the remaining disk space size and the type of data on the disk in real time. In addition, you can also create an interface for deleting and managing conference recording files on the management platform so that users can easily read and manage conference recording files.

[0054] Based on this, the solution of the present invention not only ensures the security of recorded video conference files, but also takes into account the advantages of convenient storage and easy sharing and management of recorded files. Specifically, it can be combined with the media forwarding service of the SaaS Internet cloud server to the security zone of the intranet (such as the firewall exit side) to support real-time pulling of audio and video media streams in the intranet. In addition, through operations such as recording, transcoding, storage, and management of shared network disks, the recording, sharing, and deletion functions of video conferences within the enterprise can be connected in series and implemented one by one, effectively improving the efficiency of internal video conferencing in occupying cloud resources and the efficiency of internal sharing of recorded files.

[0055] Figure 5 The schematic block diagram of the device 500 according to the embodiment of the present invention is schematically shown. The device 500 here can be understood as Figure 1 An exemplary application of the device 102 is shown in FIG. Figure 5 As shown, the device 500 may include a processor 501 and a memory 502. The memory 502 stores a computer instruction for recording a multimedia conference based on a media forwarding server. When the computer instruction is executed by the processor 501, the device 500 executes the above-mentioned method in combination with the above-mentioned method. Figure 2 to Figure 4 For example, in some embodiments, the device 500 can perform acquisition of real-time media data streams, recording of real-time media data streams, storage of recorded files, etc. Based on this, the device 500 can take into account both the security requirements and sharing requirements of the recorded files of the multimedia conference at a lower implementation cost.

[0056] In some implementation scenarios, the device 500 may include a server or a terminal that can support edge streaming, edge recording, edge storage, and other functions. It should be noted that although several devices or sub-devices of the device for recording multimedia conferences based on the media forwarding server are mentioned in the above detailed description, this division is not mandatory. In fact, according to an embodiment of the present invention, the features and functions of two or more devices described above can be concretized in one device. Conversely, the features and functions of one device described above can be further divided to be concretized by multiple devices.

[0057] It can be seen from the above description of the modular design of the present invention that the system of the present invention can be flexibly arranged according to the application scenario or demand without being limited to the architecture shown in the accompanying drawings. Further, it should also be understood that any module, unit, component, server, computer or device that performs the operation of the example of the present invention may include or otherwise access a computer-readable medium, such as a storage medium, a computer storage medium or a data storage device (removable) and / or non-removable) such as a disk, an optical disk or a tape. Computer storage media may include volatile and non-volatile, removable and non-removable media implemented by any method or technology for storing information, such as computer-readable instructions, data structures, program modules or other data. Based on this, the present invention also discloses a computer-readable storage medium on which computer-readable instructions for recording a multimedia conference based on a media forwarding server are stored, and when the computer-readable instructions are executed by one or more processors, the method and operation described in conjunction with the accompanying drawings are implemented.

[0058] Although this specification has shown and described a plurality of embodiments of the present invention, it is obvious to those skilled in the art that such embodiments are provided by way of example only. Those skilled in the art will appreciate many changes, modifications and alternatives without departing from the thought and spirit of the present invention. It should be understood that in the process of practicing the present invention, various alternatives to the embodiments of the present invention described herein may be adopted. The attached claims are intended to define the scope of protection of the present invention, and therefore cover the modular compositions, equivalents or alternatives within the scope of these claims.

Claims

1. A method for recording a multimedia conference based on a media forwarding server, It is characterized in that The media forwarding server is deployed in a security zone at the intranet exit side and supports forwarding of media data based on the intranet and the extranet. The recording method includes: In response to obtaining a subscription demand for a multimedia conference forwarded via the intranet, obtaining a real-time media data stream about the multimedia conference from the media forwarding server; According to the subscription requirement, performing a recording operation on the acquired real-time media data stream to generate a recording file; and Performing a storage operation on the recording file, wherein performing a storage operation on the recording file includes: In response to the address of the predetermined shared network disk of the intranet being not empty, storing the recording file in the predetermined shared network disk; or In response to the address of the predetermined shared network disk of the intranet being empty, the recording file is stored in the predetermined shared local disk.

2. The recording method according to claim 1, It is characterized in that Acquiring the real-time media data stream about the multimedia conference from the media forwarding server includes: Determining the real-time media data stream to be recorded according to the screen mode of the multimedia conference; and Pull the real-time media data stream from the media forwarding server.

3. The recording method according to claim 2, It is characterized in that For at least one of the real-time media data streams, performing a recording operation includes: Obtaining identification information of each channel of the real-time media data stream; According to the identification information of each channel of the real-time media data stream, a stream pulling process is started to perform a stream pulling operation on the real-time media data stream; and A recording operation is performed on each of the pulled real-time media data streams.

4. The recording method according to claim 3, It is characterized in that The operation of recording each of the pulled real-time media data streams includes: During the recording process of each channel of the real-time media data stream, the video file, audio file and instant text file related to each channel of the real-time media data stream are stored independently.

5. The recording method according to claim 4, It is characterized in that The method further comprises: In response to the existence of a plurality of recorded video files, merging the plurality of the video files; and The combined video file and other recorded files are transcoded to obtain the recorded file.

6. The recording method according to claim 1, It is characterized in that The predetermined shared network disk includes a first type of storage space and a second type of storage space, and storing the recording file in the predetermined shared network disk includes: Calculating a reserved space threshold required for temporary cache data involved in the recording file generation process; In response to the remaining space of the first type of storage space being greater than or equal to the reserved space threshold, storing the temporary cache data in the first type of storage space, and polling and checking during the storage process whether the remaining space of the first type of storage space can store the temporary cache data; determining the second type of storage space according to a difference between the total space value of the predetermined shared network disk and the reserved space threshold; and The recorded file is stored in the second type of storage space.

7. The recording method according to claim 6, It is characterized in that The first type of storage space includes temporary storage space for streaming and temporary storage space for transcoding, wherein the temporary cached data includes the real-time media data stream pulled by the streaming operation and the file transcoded by the transcoding operation, and the reserved space threshold required for calculating the temporary cached data involved in the process of generating the recording file includes: Determining a reserved space threshold required for the real-time media data stream pulled by the stream pulling operation according to the number of multimedia conferences expected to be recorded concurrently in the intranet and the real-time media data stream pulled by the stream pulling operation during a single recording process; and According to the number of multimedia conferences expected to be recorded concurrently in the intranet and the files transcoded by the transcoding operation during a single recording, a reserved space threshold required for the files transcoded by the transcoding operation is determined.

8. An electronic device, It is characterized in that include: processor; as well as A memory storing computer instructions for recording a multimedia conference based on a media forwarding server, wherein when the computer instructions are executed by the processor, the electronic device executes the method according to any one of claims 1-7.

9. A computer program product, It is characterized in that The invention comprises program instructions for recording a multimedia conference based on a media forwarding server. When the program instructions are executed by a processor, the method according to any one of claims 1 to 7 is implemented.