Conference data processing method and device, electronic equipment and storage medium

Abstract

The invention provides a conference data processing method and device, electronic equipment and a storage medium. The method comprises the following steps: determining a network demand bandwidth corresponding to a participant terminal according to the terminal number of the participant terminal and a video output resolution; determining a target edge computing node used for processing conference stream data in the edge computing nodes according to node load information of the edge computing nodes and the network demand bandwidth; and distributing conference stream data sent by the participant terminal to the target edge computing node. According to the invention, the video conference can be prevented from being blocked, and meanwhile, the high-definition image quality, low delay and fluency of the video conference can be ensured.

Description

Technical Field

[0001] The present application relates to the technical field of conference stream data processing, and in particular to a conference data processing method, device, electronic device and storage medium. Background Art

[0002] Video conferencing refers to a meeting where people in two or more locations have face-to-face conversations through communication equipment and the Internet. This form of conferencing can be divided into point-to-point conferencing and multi-point conferencing according to the number of participating locations.

[0003] In traditional video conferencing, the server provides data exchange, video and audio processing, conference control and management services for all participating terminals. However, when there are many participating terminals in traditional video conferencing, uneven or insufficient bandwidth allocation will directly affect the speed and quality of data transmission, leading to network congestion and high conference flow data delay, which cannot ensure the high-definition quality and smoothness of the video conference. Summary of the invention

[0004] In view of the above problems, embodiments of the present application are proposed to provide a conference data processing method, device, electronic device and storage medium that overcome the above problems or at least partially solve the above problems.

[0005] In a first aspect, an embodiment of the present application provides a conference data processing method, the method comprising:

[0006] Determining the network required bandwidth corresponding to the participant terminal according to the number of the participant terminal and the video output resolution;

[0007] Determining a target edge computing node for processing conference stream data among the edge computing nodes according to the node load information of the edge computing node and the network required bandwidth;

[0008] The conference stream data sent by the participant terminal is distributed to the target edge computing node.

[0009] Optionally, determining a target edge computing node for processing conference stream data among the edge computing nodes according to the node load information of the edge computing node and the required network bandwidth includes:

[0010] Determine, according to the node load information, an initial edge computing node among the edge computing nodes that meets the required network bandwidth;

[0011] According to a preset node screening rule, the target edge computing node for processing conference stream data is screened out from the initial edge computing nodes.

[0012] Optionally, the filtering out the target edge computing node for processing the conference stream data from the initial edge computing node according to a preset node filtering rule includes:

[0013] Filtering N edge computing nodes closest to the participant terminal from the initial edge computing nodes to serve as the target edge computing nodes; or

[0014] Selecting N edge computing nodes with the lowest delay from the initial edge computing nodes as the target edge computing nodes; or

[0015] Selecting N edge computing nodes with the lowest node load from the initial edge computing nodes as the target edge computing nodes;

[0016] Wherein, N is a positive integer greater than or equal to 1.

[0017] Optionally, distributing the conference stream data sent by the participant terminal to the target edge computing node includes:

[0018] During the video conference, the conference stream data to be transmitted and the target node load information of the target edge computing node monitored in real time are obtained;

[0019] Determine, according to the target node load information, a first edge computing node with the lowest node load among the target edge computing nodes;

[0020] The conference stream data is forwarded to the first edge computing node.

[0021] Optionally, distributing the conference stream data sent by the participant terminal to the target edge computing node includes:

[0022] Acquire the conference stream data sent by the participant terminal, as well as the terminal processing capability and terminal network status of the participant terminal;

[0023] Determining data transmission quality information and data transmission rate information corresponding to the participant terminal based on the terminal processing capability and the terminal network status;

[0024] The conference stream data, the data transmission quality information and the data transmission rate information are distributed to the target edge computing node, so that the target edge computing node forwards the processed conference stream data to the participant terminal according to the data transmission quality information and the data transmission rate information.

[0025] Optionally, distributing the conference stream data sent by the participant terminal to the target edge computing node includes:

[0026] Acquire node network status information and edge node load information of the target edge computing node in real time;

[0027] When the node network status information and the edge node load information indicate that the network status of the second edge computing node is abnormal or the node load is greater than the load threshold, a third edge computing node is selected from the edge computing nodes, the second edge computing node is a node within the target edge computing node, and the third edge computing node is a node among the edge computing nodes except the target edge computing node;

[0028] The conference stream data sent by the participant terminal is distributed to the third edge computing node and the fourth edge computing node, where the fourth edge computing node is a node among the target edge computing nodes except the second edge computing node.

[0029] Optionally, after distributing the conference stream data sent by the participant terminal to the target edge computing node, the method further includes:

[0030] Acquire target network status information of the target edge computing node in real time;

[0031] Based on the target network state information, determine a data forwarding path corresponding to the target edge computing node;

[0032] The data forwarding path is sent to the target edge computing node to instruct the target edge computing node to forward the processed conference stream data according to the data forwarding path.

[0033] In a second aspect, an embodiment of the present application provides a conference data processing device, the device comprising:

[0034] The required bandwidth determination module is used to determine the network required bandwidth corresponding to the terminal of the participant according to the terminal quantity and video output resolution of the terminal of the participant;

[0035] A target node determination module, used to determine a target edge computing node for processing conference stream data among the edge computing nodes according to node load information of the edge computing node and the network required bandwidth;

[0036] The stream data distribution module is used to distribute the conference stream data sent by the participant terminal to the target edge computing node.

[0037] Optionally, the target node determination module includes:

[0038] An initial node determination unit, configured to determine, according to the node load information, an initial edge computing node among the edge computing nodes that meets the network required bandwidth;

[0039] The target node screening unit is used to screen the target edge computing node for processing the conference stream data from the initial edge computing nodes according to a preset node screening rule.

[0040] Optionally, the target node screening unit includes:

[0041] A first node acquisition subunit is used to select N edge computing nodes closest to the participant terminal from the initial edge computing nodes to serve as the target edge computing nodes;

[0042] A second node acquisition subunit is used to select N edge computing nodes with the lowest delay from the initial edge computing nodes to serve as the target edge computing nodes;

[0043] A third node acquisition subunit is used to select N edge computing nodes with the lowest node load from the initial edge computing nodes to serve as the target edge computing nodes;

[0044] Wherein, N is a positive integer greater than or equal to 1.

[0045] Optionally, the stream data distribution module includes:

[0046] A load information acquisition unit, used to acquire the conference stream data to be transmitted and the target node load information of the target edge computing node monitored in real time during the video conference;

[0047] A first edge node determining unit, configured to determine a first edge computing node having the lowest node load among the target edge computing nodes according to the target node load information;

[0048] The first stream data forwarding unit is configured to forward the conference stream data to the first edge computing node.

[0049] Optionally, the stream data distribution module includes:

[0050] A network status acquisition unit, used to acquire the conference stream data sent by the participant terminal, and the terminal processing capability and terminal network status of the participant terminal;

[0051] A data transmission information determination unit, configured to determine data transmission quality information and data transmission rate information corresponding to the participant terminal based on the terminal processing capability and the terminal network status;

[0052] The second stream data forwarding unit is used to distribute the conference stream data, the data transmission quality information and the data transmission rate information to the target edge computing node, so that the target edge computing node forwards the processed conference stream data to the participant terminal according to the data transmission quality information and the data transmission rate information.

[0053] Optionally, the stream data distribution module includes:

[0054] A node load acquisition unit, used to acquire node network status information and edge node load information of the target edge computing node in real time;

[0055] an edge node screening unit, configured to screen out a third edge computing node from the edge computing nodes when the node network status information and the edge node load information indicate that the network status of the second edge computing node is abnormal or the node load is greater than a load threshold, wherein the second edge computing node is a node within the target edge computing node, and the third edge computing node is a node among the edge computing nodes except the target edge computing node;

[0056] A stream data distribution unit is used to distribute the conference stream data sent by the participant terminal to the third edge computing node and the fourth edge computing node, where the fourth edge computing node is a node in the target edge computing node except the second edge computing node.

[0057] Optionally, the device further comprises:

[0058] A network status acquisition module, used to acquire target network status information of the target edge computing node in real time;

[0059] A forwarding path determination module, used to determine a data forwarding path corresponding to the target edge computing node based on the target network state information;

[0060] The forwarding path sending module is used to send the data forwarding path to the target edge computing node to instruct the target edge computing node to forward the processed conference stream data according to the data forwarding path.

[0061] In a third aspect, an embodiment of the present application provides an electronic device, including:

[0062] one or more processors; and

[0063] One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, enable the device to execute any of the conference data processing methods described above.

[0064] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program that enables a processor to execute any of the conference data processing methods described above.

[0065] The embodiments of the present application include the following advantages:

[0066] The solution provided in the embodiment of the present application determines the network required bandwidth corresponding to the participant terminal according to the number of terminals and the video output resolution of the participant terminal. When the pre-configured bandwidth does not meet the network required bandwidth, the target edge computing node for processing the conference stream data in the edge computing node is determined according to the node load information and the network required bandwidth of the edge computing node. The conference stream data sent by the participant terminal is distributed to the target edge computing node. In the embodiment of the present application, the server pushes the processing of the conference stream data to the network edge computing node, which can effectively solve the occurrence of network congestion, reduce the transmission delay of the conference stream data, and ensure the high-definition picture quality and smoothness of the video conference. BRIEF DESCRIPTION OF THE DRAWINGS

[0067] Figure 1 A flowchart of a conference data processing method provided in an embodiment of the present application;

[0068] Figure 2 A flowchart of a method for selecting a target edge computing node provided in an embodiment of the present application;

[0069] Figure 3 A flowchart of a method for forwarding conference stream data provided by an embodiment of the present application;

[0070] Figure 4 A flowchart of another method for forwarding conference stream data provided by an embodiment of the present application;

[0071] Figure 5 A flowchart of a conference stream data distribution method provided in an embodiment of the present application;

[0072] Figure 6 A flowchart of a method for sending a data forwarding path provided in an embodiment of the present application;

[0073] Figure 7 A schematic diagram of the structure of a conference data processing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0074] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0075] Reference Figure 1, shows a flowchart of the steps of a conference data processing method provided by an embodiment of the present application. Figure 1 As shown, the conference data processing method may include: step 101, step 102 and step 103.

[0076] Step 101: Determine the network required bandwidth corresponding to the participant terminal according to the number of the participant terminal and the video output resolution.

[0077] The embodiments of the present application can be applied to a server, that is, the execution subject is a server, such as a video conference server, which can be responsible for managing the creation, control and data processing of a conference.

[0078] The participant terminal refers to a terminal participating in a video conference. In this example, the participant terminal may be, but is not limited to, a video network terminal.

[0079] The number of terminals refers to the number of terminals participating in a video conference.

[0080] Video output resolution can be used to indicate the number of pixels used by the participant's terminal when displaying or transmitting video content. The higher the resolution, the more pixels can be displayed on the screen, which may provide clearer and more detailed image quality.

[0081] In the specific implementation, after the video conference is released, the terminal that wants to join the video conference can apply for the conference, and the server can count the number of terminals of the participating parties of the video conference. At the same time, the video output resolution of the participating terminals can be obtained. For example, taking the video network conference as an example, the user starts the Pamir client software, selects the conference application, selects the participating terminal, conference name, conference level, etc. The Pamir client software initiates a request to start the conference, and the request can carry information such as the required video output resolution.

[0082] In actual applications, the video output resolution can be the video output resolution that the participant terminal actively fills in when applying for a meeting. It can also be set by the server based on the model, system version, and other information of the participant terminal.

[0083] After obtaining the number of participating terminals and the video output resolution, the network bandwidth required by the participating terminals can be determined according to the number of participating terminals and the video output resolution. Specifically, the network bandwidth required by a single participating terminal at the video output resolution can be calculated, and then the network bandwidth required by all participating terminals can be summed to obtain the network bandwidth required.

[0084] After determining the required network bandwidth corresponding to the participant terminals according to the number of the participant terminals and the video output resolution, step 102 is executed.

[0085] Step 102: Determine a target edge computing node for processing conference stream data among the edge computing nodes according to the node load information of the edge computing node and the required network bandwidth.

[0086] Edge computing nodes refer to nodes distributed at the edge of the network and responsible for processing, forwarding and optimizing audio and video stream data.

[0087] After obtaining the network bandwidth required by the participant's terminal, the node load information of the edge computing node can be obtained. In the specific implementation, the node load information of the edge computing node can be regularly queried by writing an automated script. The node load information of the edge computing node can also be regularly obtained based on the built-in tools or plug-ins of the edge computing platform.

[0088] Furthermore, the target edge computing node for processing conference stream data (including video stream data and / or audio stream data) can be selected from the edge computing nodes according to the node load information and network required bandwidth of the edge computing node. The target edge computing node can then be used to process the conference stream data of the participant terminal.

[0089] In a specific implementation, nodes that meet the network bandwidth requirements can be screened out from edge computing nodes based on node load information, and then target edge computing nodes can be screened out from these nodes based on preset node screening rules. Figure 2 This is described in detail as follows.

[0090] Reference Figure 2 , shows a flowchart of the steps of a target edge computing node screening method provided by an embodiment of the present application. Figure 2 As shown, the target edge computing node screening method may include: step 201 and step 202.

[0091] Step 201: Determine, according to the node load information, an initial edge computing node among the edge computing nodes that meets the required network bandwidth.

[0092] In this embodiment, after obtaining the node load information of the edge computing node, the initial edge computing node that meets the network demand bandwidth can be determined according to the node load information. Specifically, the maximum network bandwidth that the edge computing node can currently provide can be calculated according to the total network bandwidth of the edge computing node and the current load information of the node. Then, the node whose maximum network bandwidth that the node can provide is greater than the network demand bandwidth is selected from the edge computing nodes to serve as the initial edge computing node.

[0093] After determining the initial edge computing node that meets the network required bandwidth among the edge computing nodes according to the node load information, execute step 202.

[0094] Step 202: According to a preset node screening rule, the target edge computing node for processing conference stream data is screened out from the initial edge computing nodes.

[0095] After determining the initial edge computing node that meets the network bandwidth requirement among the edge computing nodes according to the node load information, the target edge computing node for processing the conference stream data can be screened out from the initial edge computing node according to the pre-set node screening rules. The specific screening method may include at least one of the following:

[0096] 1. Select N edge computing nodes closest to the participant’s terminal from the initial edge computing nodes as the target edge computing nodes.

[0097] In this example, N is a positive integer greater than or equal to 1.

[0098] When the node screening rule is a distance screening rule, the N edge computing nodes closest to the participant terminal can be screened out from the initial edge computing nodes as the target edge computing nodes. For example, for each edge computing node, its distance from all participant terminals can be calculated. For each edge computing node, all distances to the participant terminals are summarized in some form (such as summing, averaging, etc.) to obtain a comprehensive distance index. Sort all edge computing nodes in order from small to large according to the comprehensive distance index, and select the first N nodes from the sorted list as the target edge computing nodes, etc.

[0099] 2. Select N edge computing nodes with the lowest latency from the initial edge computing nodes to serve as the target edge computing nodes.

[0100] When the node screening rule is the minimum delay screening rule, N edge computing nodes with the lowest delay can be screened out from the initial edge computing nodes as target edge computing nodes. For example, the total delay of each edge computing node can be calculated based on the delay from each edge computing node to each participant's terminal (simply adding up the delays of all participants), and all edge computing nodes are sorted according to the total delay, and finally the N edge computing nodes with the lowest delay are selected as target edge computing nodes, etc.

[0101] 3. Select N edge computing nodes with the lowest node load from the initial edge computing nodes to serve as the target edge computing nodes.

[0102] When the node screening rule is the lowest load screening rule, N edge computing nodes with the lowest node loads can be screened out from the initial edge computing nodes to serve as target edge computing nodes.

[0103] Of course, in practical applications, the target edge computing nodes can also be screened by combining at least two of the above three screening rules, such as combining distance and load to screen the target edge computing nodes at the same time. This embodiment does not limit the specific screening method of the target edge computing nodes.

[0104] The embodiment of the present application uses preset node screening rules to screen target edge computing nodes, thereby optimizing the transmission of video conference stream data and improving the quality of video conferences.

[0105] After determining the target edge computing node for processing the conference stream data among the edge computing nodes according to the node load information of the edge computing node and the network required bandwidth, step 103 is performed.

[0106] Step 103: Distribute the conference stream data sent by the participant terminal to the target edge computing node.

[0107] After determining the target edge computing node for processing conference stream data in the edge computing node according to the node load information of the edge computing node and the network demand bandwidth, the server can distribute the conference stream data (audio stream data and / or video stream data) sent by the participant terminal to the target edge computing node. After the target edge computing node receives the conference stream data, video coding (H.264, H.265) and audio coding (AAC) technology can be used to compress the data and reduce the amount of data, thereby reducing the bandwidth requirement. The data can also be transcoded into a suitable format according to the supported format and network conditions of the receiving device, for example, high-definition video can be transcoded into a definition suitable for a low-bandwidth network. Data can also be cached at the edge node to cope with network fluctuations and reduce data loss, ensuring the continuity and stability of the data flow. The video data is compressed, decompressed and transcoded in real time on the edge node. Through these processing operations, the size of the video data can be reduced, the network transmission delay can be reduced, and the display capabilities and network conditions of different terminal devices can be adapted at the same time.

[0108] The embodiment of the present application can effectively solve the problem of network congestion by pushing the processing of conference stream data to the network edge computing node by the server, and can reduce the transmission delay of conference stream data, and ensure the high-definition image quality and fluency of video conference. At the same time, distributing conference stream data to different edge nodes for processing can reduce the burden on the server and optimize data processing and transmission by using nodes distributed at the edge of the network.

[0109] In this embodiment, during the video conference, the server can forward the received conference stream data to the target edge computing node with the lowest load. Figure 3This is described in detail as follows.

[0110] Reference Figure 3 , shows a flowchart of the steps of a conference stream data forwarding method provided by an embodiment of the present application. Figure 3 As shown, the conference stream data forwarding method may include: step 301, step 302 and step 303.

[0111] Step 301: During a video conference, the conference stream data to be transmitted and the target node load information of the target edge computing node monitored in real time are obtained.

[0112] In this embodiment, the target node load information refers to the load information of the target edge computing node.

[0113] During the video conference, the conference stream data to be transmitted and the target node load information of the target edge computing node monitored in real time can be obtained.

[0114] After the conference stream data to be transmitted and the target node load information of the target edge computing node monitored in real time are acquired, step 302 is executed.

[0115] Step 302: Determine a first edge computing node with the lowest node load among the target edge computing nodes according to the target node load information.

[0116] The first edge computing node is the node with the lowest node load among the target edge computing nodes. In this example, the number of the first edge computing nodes may be one or more, specifically, it may be determined according to the actual situation, and this embodiment does not limit this.

[0117] After obtaining the conference stream data to be transmitted and the target node load information of the target edge computing node monitored in real time, the edge computing node with the lowest node load among the target edge computing nodes, that is, the first edge computing node, can be determined according to the target node load information.

[0118] After determining the first edge computing node with the lowest node load among the target edge computing nodes according to the target node load information, step 303 is executed.

[0119] Step 303: Forward the conference stream data to the first edge computing node.

[0120] After determining the first edge computing node with the lowest node load among the target edge computing nodes according to the target node load information, the conference stream data can be forwarded to the first edge computing node. Specifically, when the first edge computing node is one node, the conference stream data can be directly forwarded to the first edge computing node. When the first edge computing node is a plurality of nodes, the conference stream data can be directly forwarded to any one of the plurality of first edge computing nodes. Alternatively, when the first edge computing node is a plurality of nodes, the terminal of the participant from which the conference stream data comes can also be obtained, and according to the distance between the terminal of the participant and the plurality of first edge computing nodes, the conference stream data can be forwarded to the first edge computing node closest to the distance, etc.

[0121] It can be understood that the above examples are merely examples listed for a better understanding of the technical solutions of the embodiments of the present application, and are not intended to be the sole limitation to the embodiments.

[0122] The embodiment of the present application can improve the processing efficiency of conference stream data by forwarding conference stream data according to node load information after determining the target edge computing node. At the same time, it can achieve load balancing of edge computing nodes and intelligently distribute video data to nodes with stronger processing capabilities or lower loads according to the real-time load conditions and network status of each node to maintain the stability and efficiency of the system.

[0123] In this embodiment, the terminal processing capability and terminal network status of the participant terminal can be monitored in real time, and data transmission instructions and data transmission rates can be specified according to the terminal processing capability and terminal network status to send the processed conference stream data. Figure 4 This is described in detail as follows.

[0124] Reference Figure 4 , shows a flowchart of another method for forwarding conference stream data provided by an embodiment of the present application. Figure 4 As shown, the conference stream data forwarding method may include: step 401, step 402 and step 403.

[0125] Step 401: Acquire the conference stream data sent by the participant terminal, as well as the terminal processing capability and terminal network status of the participant terminal.

[0126] In this embodiment, the terminal processing capability refers to the computing power and resource utilization efficiency of the participant terminal when processing and presenting conference stream data (including video, audio, shared documents, etc.). The terminal processing capability depends on the hardware configuration of the terminal (such as CPU, GPU, memory, storage space, etc.) and the optimization degree of the operating system and application running on it.

[0127] Terminal network status refers to the quality and stability of the network connection between the terminal of the participant and the video conference server or other terminals of the participant. It includes key indicators such as network bandwidth, delay, and packet loss rate.

[0128] During the video conference, the conference stream data sent by the participant's terminal, as well as the terminal processing capability and terminal network status of the participant's terminal can be obtained. Specifically, the terminal processing capability of the participant's terminal can be determined by viewing the terminal's hardware configuration information (such as task manager, system properties, etc.). The quality and stability of the network connection can be detected through network testing tools (such as ping, traceroute, speedtest, etc.) to determine the terminal network status of the participant's terminal.

[0129] After obtaining the conference stream data sent by the participant terminal, the terminal processing capability and the terminal network status of the participant terminal, step 402 is executed.

[0130] Step 402: Based on the terminal processing capability and the terminal network status, determine the data transmission quality information and data transmission rate information corresponding to the participant terminal.

[0131] Data transmission quality information may include: video clarity, audio quality, synchronization, freeze conditions and other information.

[0132] Data transmission rate information refers to the number of binary bits transmitted through a channel or data path per unit time, that is, the number of bits transmitted per second (bit per second, bps), which reflects the performance and efficiency of the data transmission system.

[0133] After obtaining the conference stream data sent by the participant's terminal, the terminal processing capability and the terminal network status of the participant's terminal, the data transmission quality information and data transmission rate information corresponding to the participant's terminal can be determined based on the terminal processing capability and the terminal network status. Specifically, the data stream quality of the data transmission can be judged based on the comprehensive evaluation results of the terminal processing capability and the network status. For example, if the terminal processing capability is strong and the network status is good, the transmission quality of high-definition video and clear audio can be obtained. At the same time, the data transmission rate can be estimated based on the network bandwidth test results and the coding efficiency of the terminal. For example, if the terminal uses efficient video coding technology and the network bandwidth is sufficient, a higher data transmission rate can be supported.

[0134] It can be understood that the above examples are merely examples listed for a better understanding of the technical solutions of the embodiments of the present application, and are not intended to be the sole limitation to the embodiments.

[0135] After the data transmission quality information and data transmission rate information corresponding to the participant terminal are determined based on the terminal processing capability and the terminal network status, step 403 is executed.

[0136] Step 403: Distribute the conference stream data, the data transmission quality information and the data transmission rate information to the target edge computing node, so that the target edge computing node forwards the processed conference stream data to the participant terminal according to the data transmission quality information and the data transmission rate information.

[0137] After determining the data transmission quality information and data transmission rate information corresponding to the participant terminal based on the terminal processing capability and the terminal network status, the conference flow data, data transmission quality information and data transmission rate information can be distributed to the target edge computing node, so that the target edge computing node forwards the processed conference flow data to the participant terminal according to the data transmission quality information and data transmission rate information.

[0138] The embodiment of the present application determines data transmission quality information and data transmission rate information according to the terminal processing capability and terminal network status of the participant's terminal to forward the processed conference stream data, thereby optimizing data transmission and ensuring data transmission quality.

[0139] In this embodiment, during the video conference, when the network status of a node in the target edge computing node is abnormal or the load is too high, another node can be selected from the edge computing nodes as the target edge computing node to process the conference stream data. Figure 5 This is described in detail as follows.

[0140] Reference Figure 5 , shows a flow chart of the steps of a conference stream data distribution method provided by an embodiment of the present application. Figure 5 As shown, the conference stream data distribution method may include: step 501, step 502 and step 503.

[0141] Step 501: Acquire the node network status information and edge node load information of the target edge computing node in real time.

[0142] In this embodiment, during the video conference, the node network status information and edge node load information of the target edge computing node can be obtained in real time. Specifically, the network status of the target edge computing node can be tracked and recorded in real time through the monitoring and management system pre-set in the server. The load information of the edge node usually includes system resource indicators such as CPU usage, memory usage, and disk usage. The edge node load of the target edge computing node can be obtained in real time in the server using a system monitoring tool.

[0143] After acquiring the node network status information and edge node load information of the target edge computing node in real time, step 502 is executed.

[0144] Step 502: When the node network status information and the edge node load information indicate that the network status of the second edge computing node is abnormal or the node load is greater than the load threshold, a third edge computing node is screened out from the edge computing nodes, the second edge computing node is a node within the target edge computing node, and the third edge computing node is a node among the edge computing nodes except the target edge computing node.

[0145] The second edge computing node is one or more nodes within the target edge computing node.

[0146] The third edge computing node is a node selected from the edge computing nodes except the target edge computing node.

[0147] The load threshold refers to a pre-set threshold for determining whether the load of the edge computing node is too high. The specific value of the load threshold can be determined according to business requirements, and this embodiment does not limit this.

[0148] After obtaining the node network status information and edge node load information of the target edge computing node in real time, it can be determined whether there are nodes in the target edge computing node with abnormal network status or node load greater than the load threshold based on the node network status information and edge node load information.

[0149] If the node network status information and the edge node load information indicate that the network status of the second edge computing node is abnormal or the node load is greater than the load threshold, a third edge computing node can be screened out from the edge computing nodes. The screening method of the third edge computing node is similar to the screening method of the target edge computing node, that is, the node is screened according to at least one of the distance screening rule, the load screening rule, and the delay screening rule, which will not be described in detail in this embodiment.

[0150] After the third edge computing node is screened out from the edge computing nodes, step 503 is performed.

[0151] Step 503: Distribute the conference stream data sent by the participant terminal to the third edge computing node and the fourth edge computing node, where the fourth edge computing node is a node in the target edge computing node except the second edge computing node.

[0152] After the third edge computing node is screened out from the edge computing nodes, the conference stream data sent by the participant terminal can be distributed to the third edge computing node and the fourth edge computing node. The fourth edge computing node can be a node in the target edge computing node except the second edge computing node.

[0153] During a video conference, when the network of the target edge computing node is abnormal or the load is too high, the embodiment of the present application promptly screens the target edge computing node from other edge computing nodes to process the conference stream data, thereby ensuring the normal progress of the video conference, avoiding interruption of the video conference, and guaranteeing the quality and fluency of the video conference.

[0154] In this embodiment, the data forwarding path can also be determined according to the network status of the target edge computing node to instruct the target edge computing node to forward data according to the data forwarding path. Figure 6 This is described in detail as follows.

[0155] Reference Figure 6 , shows a flow chart of the steps of a data forwarding path sending method provided by an embodiment of the present application. Figure 6 As shown, the data forwarding path sending method may include: step 601, step 602 and step 603.

[0156] Step 601: Acquire target network status information of the target edge computing node in real time.

[0157] In this embodiment, during the video conference, the target network status information of the target edge computing node can be obtained in real time.

[0158] Step 602: Based on the target network status information, determine a data forwarding path corresponding to the target edge computing node.

[0159] Furthermore, the data forwarding path corresponding to the target edge computing node can be determined according to the target network status information of the target edge computing node. Specifically, the performance of each possible data forwarding path can be evaluated according to the collected target network status information. The evaluation indicators may include the total bandwidth of the path, the average delay, the maximum delay, the packet loss rate, etc. When selecting a data forwarding path, the processing capability and network conditions of the participant terminal receiving the data must also be considered. For example, if the processing capability of the participant terminal is weak or the network conditions are poor, a path with lower bandwidth but higher stability can be selected, and the quality and rate of data transmission can be appropriately reduced. Taking into account the network status and terminal receiving capability, the edge computing node will select a data forwarding path with the best overall performance. For example, there are three edge computing nodes A, B, and C, and a participant terminal D. Node A sends data to D, and there are two possible forwarding paths: A→B→D and A→C→D. The network status evaluation is as follows:

[0160] The bandwidth of the path A→B→D is 100Mbps, the average delay is 50ms, and the packet loss rate is 0.1%.

[0161] The bandwidth of path A→C→D is 200 Mbps, but the average delay is 80 ms, and there may be a high packet loss rate in certain periods of time.

[0162] Considerations for receiving capabilities of the participants’ terminals:

[0163] The processing capability of the participant terminal D is relatively strong, but the current network environment is relatively poor and it is relatively sensitive to network delay and packet loss rate.

[0164] Then the best path can be selected: In this case, although the bandwidth of path A→C→D is higher, it is not the best choice for device D due to its long delay and possible packet loss. Therefore, path A→B→D is selected as the best path for data forwarding to ensure the stability and reliability of data transmission.

[0165] It can be understood that the above examples are only examples listed for better understanding of the technical solutions of the embodiments of the present application, and are not intended to be the sole limitation to the embodiments.

[0166] After determining the data forwarding path corresponding to the target edge computing node based on the target network state information, step 603 is executed.

[0167] Step 603: Send the data forwarding path to the target edge computing node to instruct the target edge computing node to forward the processed conference stream data according to the data forwarding path.

[0168] After determining the data forwarding path corresponding to the target edge computing node based on the target network status information, the data forwarding path can be sent to the target edge computing node to instruct the target edge computing node to forward the processed conference stream data according to the data forwarding path.

[0169] The embodiment of the present application selects the best data forwarding path according to the network status of the target edge computing node to instruct the target edge computing node to optimize data transmission, thereby ensuring the stability and reliability of data transmission.

[0170] The conference data processing method provided in the embodiment of the present application determines the network required bandwidth corresponding to the participant terminal according to the terminal number and video output resolution of the participant terminal. When the pre-configured bandwidth does not meet the network required bandwidth, the target edge computing node for processing the conference stream data in the edge computing node is determined according to the node load information and network required bandwidth of the edge computing node. The conference stream data sent by the participant terminal is distributed to the target edge computing node. In the embodiment of the present application, the server pushes the processing of the conference stream data to the network edge computing node, which can effectively solve the occurrence of network congestion, reduce the transmission delay of the conference stream data, and ensure the high-definition picture quality and smoothness of the video conference.

[0171] It should be noted that, for the method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present application are not limited by the described action sequence, because according to the embodiments of the present application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present application.

[0172] Reference Figure 7 , shows a schematic diagram of the structure of a conference data processing device provided by an embodiment of the present application. Figure 7 As shown, the conference data processing device 700 may include the following modules:

[0173] The required bandwidth determination module 710 is used to determine the network required bandwidth corresponding to the participant terminal according to the number of the participant terminal and the video output resolution;

[0174] A target node determination module 720, configured to determine a target edge computing node for processing conference stream data among the edge computing nodes according to node load information of the edge computing node and the network required bandwidth;

[0175] The stream data distribution module 730 is used to distribute the conference stream data sent by the participant terminal to the target edge computing node.

[0176] Optionally, the target node determination module includes:

[0177] An initial node determination unit, configured to determine, according to the node load information, an initial edge computing node among the edge computing nodes that meets the network required bandwidth;

[0178] The target node screening unit is used to screen the target edge computing node for processing the conference stream data from the initial edge computing nodes according to a preset node screening rule.

[0179] Optionally, the target node screening unit includes:

[0180] A first node acquisition subunit is used to select N edge computing nodes closest to the participant terminal from the initial edge computing nodes to serve as the target edge computing nodes;

[0181] A second node acquisition subunit is used to select N edge computing nodes with the lowest delay from the initial edge computing nodes to serve as the target edge computing nodes;

[0182] A third node acquisition subunit is used to select N edge computing nodes with the lowest node load from the initial edge computing nodes to serve as the target edge computing nodes;

[0183] Wherein, N is a positive integer greater than or equal to 1.

[0184] Optionally, the stream data distribution module includes:

[0185] A load information acquisition unit, used to acquire the conference stream data to be transmitted and the target node load information of the target edge computing node monitored in real time during the video conference;

[0186] A first edge node determining unit, configured to determine a first edge computing node having the lowest node load among the target edge computing nodes according to the target node load information;

[0187] The first stream data forwarding unit is configured to forward the conference stream data to the first edge computing node.

[0188] Optionally, the stream data distribution module includes:

[0189] A network status acquisition unit, used to acquire the conference stream data sent by the participant terminal, and the terminal processing capability and terminal network status of the participant terminal;

[0190] A data transmission information determination unit, configured to determine data transmission quality information and data transmission rate information corresponding to the participant terminal based on the terminal processing capability and the terminal network status;

[0191] The second stream data forwarding unit is used to distribute the conference stream data, the data transmission quality information and the data transmission rate information to the target edge computing node, so that the target edge computing node forwards the processed conference stream data to the participant terminal according to the data transmission quality information and the data transmission rate information.

[0192] Optionally, the stream data distribution module includes:

[0193] A node load acquisition unit, used to acquire node network status information and edge node load information of the target edge computing node in real time;

[0194] an edge node screening unit, configured to screen out a third edge computing node from the edge computing nodes when the node network status information and the edge node load information indicate that the network status of the second edge computing node is abnormal or the node load is greater than a load threshold, wherein the second edge computing node is a node within the target edge computing node, and the third edge computing node is a node among the edge computing nodes except the target edge computing node;

[0195] A stream data distribution unit is used to distribute the conference stream data sent by the participant terminal to the third edge computing node and the fourth edge computing node, where the fourth edge computing node is a node in the target edge computing node except the second edge computing node.

[0196] Optionally, the device further comprises:

[0197] A network status acquisition module, used to acquire target network status information of the target edge computing node in real time;

[0198] A forwarding path determination module, used to determine a data forwarding path corresponding to the target edge computing node based on the target network state information;

[0199] The forwarding path sending module is used to send the data forwarding path to the target edge computing node to instruct the target edge computing node to forward the processed conference stream data according to the data forwarding path.

[0200] The conference data processing device provided in the embodiment of the present application determines the network required bandwidth corresponding to the participant terminal according to the terminal number and video output resolution of the participant terminal. When the pre-configured bandwidth does not meet the network required bandwidth, the target edge computing node for processing the conference stream data in the edge computing node is determined according to the node load information and network required bandwidth of the edge computing node. The conference stream data sent by the participant terminal is distributed to the target edge computing node. In the embodiment of the present application, the server pushes the processing of the conference stream data to the network edge computing node, which can effectively solve the occurrence of network congestion, reduce the transmission delay of the conference stream data, and ensure the high-definition picture quality and smoothness of the video conference.

[0201] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0202] In an embodiment of the present application, an electronic device is also provided. The electronic device may include one or more processors, and one or more machine-readable media storing instructions thereon, the instructions being, for example, application programs. When the instructions are executed by the one or more processors, the processors execute any of the above conference data processing methods.

[0203] In an embodiment of the present application, a non-temporary computer-readable storage medium is also provided, on which a computer program is stored, and the program can be executed by a processor of an electronic device to implement any of the above conference data processing methods. For example, the non-temporary computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0204] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0205] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, devices, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0206] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0207] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0208] These computer program instructions can also be loaded into a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable terminal device provide for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0209] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present application.

[0210] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0211] The above is a detailed introduction to a conference data processing method, device, electronic device and storage medium provided by the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for general technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A conference data processing method, characterized in that: The method comprises: Determining the network required bandwidth corresponding to the participant terminal according to the number of the participant terminal and the video output resolution; Determining a target edge computing node for processing conference stream data among the edge computing nodes according to the node load information of the edge computing node and the required network bandwidth; Distribute the conference stream data sent by the participant terminal to the target edge computing node.

2. The method according to claim 1, characterized in that The determining, according to the node load information of the edge computing node and the network required bandwidth, a target edge computing node for processing the conference stream data in the edge computing node includes: Determining, according to the node load information, an initial edge computing node among the edge computing nodes that meets the required network bandwidth; According to a preset node screening rule, the target edge computing node for processing conference stream data is screened out from the initial edge computing nodes.

3. The method according to claim 2, characterized in that The step of selecting the target edge computing node for processing conference stream data from the initial edge computing node according to a preset node screening rule includes: Filtering N edge computing nodes closest to the participant terminal from the initial edge computing nodes to serve as the target edge computing nodes; or Selecting N edge computing nodes with the lowest delay from the initial edge computing nodes as the target edge computing nodes; or Selecting N edge computing nodes with the lowest node load from the initial edge computing nodes as the target edge computing nodes; Wherein, N is a positive integer greater than or equal to 1.

4. The method according to claim 1, characterized in that: The distributing the conference stream data sent by the participant terminal to the target edge computing node includes: During the video conference, the conference stream data to be transmitted and the target node load information of the target edge computing node monitored in real time are obtained; Determine, according to the target node load information, a first edge computing node with the lowest node load among the target edge computing nodes; The conference stream data is forwarded to the first edge computing node.

5. The method according to claim 1, characterized in that The distributing the conference stream data sent by the participant terminal to the target edge computing node includes: Acquire the conference stream data sent by the participant terminal, as well as the terminal processing capability and terminal network status of the participant terminal; Determining data transmission quality information and data transmission rate information corresponding to the participant terminal based on the terminal processing capability and the terminal network status; The conference stream data, the data transmission quality information and the data transmission rate information are distributed to the target edge computing node, so that the target edge computing node forwards the processed conference stream data to the participant terminal according to the data transmission quality information and the data transmission rate information.

6. The method according to claim 1, characterized in that The distributing the conference stream data sent by the participant terminal to the target edge computing node includes: Acquire node network status information and edge node load information of the target edge computing node in real time; When the node network status information and the edge node load information indicate that the network status of the second edge computing node is abnormal or the node load is greater than the load threshold, a third edge computing node is selected from the edge computing nodes, the second edge computing node is a node within the target edge computing node, and the third edge computing node is a node among the edge computing nodes except the target edge computing node; The conference stream data sent by the participant terminal is distributed to the third edge computing node and the fourth edge computing node, where the fourth edge computing node is a node among the target edge computing nodes except the second edge computing node.

7. The method according to claim 1, characterized in that After distributing the conference stream data sent by the participant terminal to the target edge computing node, the method further includes: Acquire target network status information of the target edge computing node in real time; Based on the target network state information, determine a data forwarding path corresponding to the target edge computing node; The data forwarding path is sent to the target edge computing node to instruct the target edge computing node to forward the processed conference stream data according to the data forwarding path.

8. A conference data processing device, characterized in that: The device comprises: The required bandwidth determination module is used to determine the network required bandwidth corresponding to the terminal of the participant according to the terminal quantity and video output resolution of the terminal of the participant; A target node determination module, used to determine a target edge computing node for processing conference stream data among the edge computing nodes according to node load information of the edge computing node and the network required bandwidth; The stream data distribution module is used to distribute the conference stream data sent by the participant terminal to the target edge computing node.

9. An electronic device, characterized in that: include: one or more processors; and One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, enable the device to perform the conference data processing method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer program stored therein enables the processor to execute the conference data processing method as described in any one of claims 1 to 7.

Images