A method, device, electronic device and storage medium for implementing an online conference
By analyzing and adjusting network fluctuations in online meetings in real time and obtaining standard simulation parameters, the problem of video quality and frame number cannot be optimized in online meetings is solved, and the smooth playback of videos is achieved when the network fluctuates greatly.
Patent Information
- Application Number
- CN202411111267.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-14
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2044-08-14
AI Technical Summary
The existing online meeting methods cannot effectively optimize the quality of received video information, resulting in the video quality and video frame number that cannot meet the normal sharing needs when the network fluctuates greatly, resulting in problems such as video stuttering.
When starting an online meeting, record the network fluctuations of people entering the conference room in real time, and put them in the plane rectangular coordinate system to analyze to obtain the balanced fluctuation nodes. Based on this, obtain the preview fluctuation curve for real-time video sharing simulation and obtain standard simulation and adjust the shared video parameters in the conference room to ensure smooth playback of video quality and frames.
Through real-time analysis and adjustment, it is possible to ensure the stability of video quality and frame rate when the demonstration party’s network fluctuates greatly, prevent video lag, and meet normal video sharing needs.
Smart Images

Figure CN118646842B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of Internet technology, and specifically to a method, device, electronic device and storage medium for implementing an online conference. Background Art
[0002] Online meetings, also known as online meetings or web conferences, are a form of Internet-based meetings that allow participants to communicate and share data between multiple users in different locations in a virtual meeting space by accessing the Internet. This form of meeting is implemented through an Internet conferencing platform, and participants can share screens, synchronize presentations, transfer files, and exchange audio and video and dialogue, thereby achieving efficient communication and data information sharing.
[0003] Existing methods for implementing online conferences are usually optimized to improve the quality of conferences, such as setting up multiple conference terminals, distinguishing and transmitting the audio and video generated by the speaking terminal and the non-speaking terminal, and connecting all terminal devices through multiple transmission channels. Although this improved method can ensure that all devices can receive audio and video information through multiple terminals, it cannot optimize the quality of the received video information, resulting in that when the network fluctuation of the terminal sending the video is large, the quality of the sent video and the number of video frames cannot meet the normal video sharing requirements. For example, in the Chinese patent application publication number CN117749983A, an online conference implementation method, system, computer equipment and storage medium are disclosed. This solution is to establish a connection between the transcoding conference terminal and each conference terminal in the online conference after the online conference starts, and ensure that the terminal devices participating in the conference can receive the audio and video information in the online conference through multiple terminals. Other methods usually involve improvements in voice streaming and screen sharing. This improvement method can only ensure smooth audio during online meetings and make screen jumps more flexible. It lacks optimization of video presentation when sharing videos. As a result, even if screen jumps and audio reception can be performed smoothly, the shared video cannot be effectively optimized when the network fluctuations of the presenter are large, resulting in video freezes, etc. In view of this, it is necessary to improve the existing implementation methods for online meetings. Summary of the invention
[0004] The present invention aims to solve one of the technical problems in the prior art to at least a certain extent, by proposing an implementation method, device, electronic device and storage medium for online conferencing, so as to solve the problem that the quality of received video information cannot be optimized in the prior art, resulting in that when the network fluctuation of the terminal sending the video is large, the quality of the sent video and the number of video frames cannot meet the normal video sharing requirements.
[0005] To achieve the above objectives, in a first aspect, the present invention provides a method for implementing an online conference, comprising:
[0006] When starting an online meeting, the network fluctuations of people entering the meeting room are recorded in real time, and the network fluctuations are put into a plane rectangular coordinate system for analysis to obtain the equilibrium fluctuation nodes;
[0007] Acquire a preview fluctuation curve based on the balanced fluctuation node, perform real-time simulation on video sharing based on the preview fluctuation curve, and acquire standard simulation parameters based on the simulation results;
[0008] The parameters of the shared video in the conference room are adjusted based on the standard simulation parameters.
[0009] Furthermore, when starting an online meeting, the network fluctuations of people entering the meeting room are recorded in real time, and the network fluctuations are put into a plane rectangular coordinate system for analysis, and the equilibrium fluctuation nodes obtained include:
[0010] When an online meeting starts, the people who enter the meeting room are recorded as the first to the Lth participants in order based on the order in which they enter the meeting room; a plane rectangular coordinate system is established, recorded as the fluctuation analysis coordinate system, where the unit of the X-axis of the fluctuation analysis coordinate system is time, and the unit of the Y-axis is network delay;
[0011] The timing starts from 0 when the conference room is created. Based on the time counted after each participant enters the conference room and the network fluctuation of each participant, the network fluctuation curves of the participants are drawn in the fluctuation analysis coordinate system and recorded as the first fluctuation curve to the Lth fluctuation curve in sequence.
[0012] Furthermore, when starting an online meeting, the network fluctuations of people entering the meeting room are recorded in real time, and the network fluctuations are put into a plane rectangular coordinate system for analysis. Obtaining the balanced fluctuation node also includes the following sub-steps:
[0013] When the L1th participant in the conference room starts to share the video, the L1th fluctuation curve is recorded as the shared fluctuation curve, and the fluctuation analysis algorithm is used to obtain the network fluctuation value of each point in the shared fluctuation curve. The fluctuation analysis algorithm is: , where F is the network fluctuation value, fmax is the maximum value of the ordinate in the shared fluctuation curve, fmin is the minimum value of the ordinate in the shared fluctuation curve, kmax is the maximum value of the absolute value of the slope in the shared fluctuation curve, fz is the ordinate of the point where the network fluctuation value is obtained, and fk is the absolute value of the slope of the point where the network fluctuation value is obtained in the shared fluctuation curve;
[0014] The point with the largest network fluctuation value in the shared fluctuation curve is recorded as the equilibrium fluctuation point, and the maximum value of the difference in the horizontal coordinates of the points whose absolute value of the slope in the shared fluctuation curve is equal to |fkmax| is recorded as the simulation span. When there is only one point A in the shared simulation curve whose absolute value of the slope is equal to fkmax, the absolute value of the difference between the horizontal coordinate of point A and the horizontal coordinate of the point with the maximum value of the vertical coordinate in the shared fluctuation curve is recorded as the simulation span, where fkmax is the slope of the equilibrium fluctuation point. When there are multiple participants sharing video, the equilibrium fluctuation point corresponding to each participant is obtained.
[0015] Further, obtaining a preview fluctuation curve based on the balanced fluctuation node, performing real-time simulation on video sharing based on the preview fluctuation curve, and obtaining standard simulation parameters based on the simulation result include:
[0016] The vertical coordinate of the equilibrium fluctuation node is marked as β1, and a plane rectangular coordinate system is established, which is recorded as the fluctuation simulation coordinate system, where the unit of the X-axis of the fluctuation simulation coordinate system is time, and the unit of the Y-axis is network delay; the straight line with the vertical coordinate equal to β1 in the fluctuation simulation coordinate system is recorded as the baseline, and a straight line is drawn in the first quadrant at the point (0, β1) with a slope of fkmax, and stops when the horizontal coordinate of the straight line is equal to (Z, 0), where Z is the simulation span; the line segment composed of the point (0, β1) and the point (Z, fkmax×Z+β1) is recorded as the basic line segment 1, the basic line segment 1 is mirrored based on X=Z, and the mirrored line segment is recorded as the basic line segment 2; the basic line segment 1 and the basic line segment 2 are processed with central symmetry based on the point (2Z, β1), and the obtained line segments are recorded as the basic line segment 3 and the basic line segment 4, and the curve fitted from the basic line segment 1 to the basic line segment 4 is recorded as the basic simulation curve.
[0017] Further, obtaining a preview fluctuation curve based on the balanced fluctuation node, performing real-time simulation on video sharing based on the preview fluctuation curve, and obtaining standard simulation parameters based on the simulation result also include:
[0018] Obtain multiple video qualities that can be satisfied when sharing videos in online conferences, and record them as level 1 video quality to level N video quality from small to large; establish a video simulation model, which is used to simulate the number of frames during video sharing based on video quality and network delay using a real-time simulation method;
[0019] The real-time simulation method includes: re-establishing a conference room α, adding a presenter in the conference room α, and having the presenter share the video, and the network fluctuation of the presenter is a preview fluctuation curve, wherein the preview fluctuation curve is composed of multiple basic simulation curves connected end to end; establishing a table of T rows × N+1 columns, recorded as a shared simulation table, wherein the top row of the shared simulation table is filled with the first-level video quality to the N-level video quality from left to right except the first cell, and the leftmost column of the shared simulation table is filled with the frame number except the first cell; on the basis of the preview fluctuation curve as the network fluctuation, the frame number of the shared video corresponding to all video qualities is obtained, and filled in the shared simulation table; when the maximum value of the filled-in frame number is greater than or equal to the standard smooth frame number, the video quality corresponding to the frame number with the smallest difference from the standard smooth frame number among the filled-in frame number is recorded as the preferred video quality; when the maximum value of the filled-in frame number is less than the standard smooth frame number, the first-level video quality is recorded as the preferred video quality; the preferred video quality and the frame number corresponding to the preferred video quality in the shared simulation table are recorded as standard simulation parameters;
[0020] When there are multiple participants performing video sharing, after obtaining the basic simulation curve corresponding to each participant performing video sharing, the standard simulation parameters of each participant performing video sharing are obtained based on the basic simulation curve of each participant performing video sharing.
[0021] Further, adjusting the parameters of the shared video in the conference room based on the standard simulation parameters includes:
[0022] After the online meeting starts and no participant is sharing video, the network fluctuation curve of each participant is obtained in real time;
[0023] The participants who share videos are recorded as shared personnel; when a shared person appears, the standard simulation parameters of the shared person are obtained based on the shared fluctuation curve of the shared person; when the preferred video quality in the standard simulation parameters of the shared person is not the first-level video quality, the frame number and video quality of the shared video are adjusted based on the standard simulation parameters of the shared person, so that the frame number and video quality of the shared video presentation of the shared person are equal to the standard simulation parameters.
[0024] Furthermore, adjusting the parameters of the shared video in the conference room based on the standard simulation parameters also includes:
[0025] When the preferred video quality in the standard simulation parameters of the sharing personnel is the first-level video quality, the video quality of the shared video demonstrated by the sharing personnel is adjusted to the first-level video quality, and the frame number of the shared video is monitored in real time. When the frame number is less than the frame number in the standard simulation parameters of the sharing personnel, the sharing personnel is reminded of the poor network.
[0026] In a second aspect, the present invention further provides an online conference implementation system, including a network fluctuation analysis module, a standard parameter simulation module, and a video parameter adjustment module:
[0027] The network fluctuation analysis module is used to record the network fluctuations of people entering the meeting room in real time when starting an online meeting, and put the network fluctuations into a plane rectangular coordinate system for analysis to obtain the equilibrium fluctuation nodes;
[0028] The standard parameter simulation module is used to obtain a preview fluctuation curve based on the balanced fluctuation node, perform real-time simulation on video sharing based on the preview fluctuation curve, and obtain standard simulation parameters based on the simulation results;
[0029] The video parameter adjustment module is used to adjust the parameters of the shared video in the conference room based on the standard simulation parameters.
[0030] In a third aspect, the present invention provides a storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the steps in the above method are performed.
[0031] In a fourth aspect, the present invention provides an electronic device, comprising a processor and a memory, wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the steps in the above method are performed.
[0032] Beneficial effects of the present invention: The present invention first records the network fluctuations of the persons entering the conference room in real time when starting an online conference, and puts the network fluctuations into a plane rectangular coordinate system for analysis to obtain a balanced fluctuation node. The advantage of this is that by obtaining the network fluctuations of each person in the conference room, it is helpful to obtain the balanced fluctuation node of the video sharing person in time when any participant is sharing a video, thereby providing data support for subsequent real-time simulation, thereby more quickly obtaining standard simulation parameters to meet normal video sharing needs;
[0033] The present invention also obtains a preview fluctuation curve based on the balanced fluctuation node, performs real-time simulation of video sharing based on the preview fluctuation curve, and obtains standard simulation parameters based on the simulation results; finally, the parameters of the shared video in the conference room are adjusted based on the standard simulation parameters. The advantage of this is that after real-time simulation of video sharing based on the preview fluctuation curve, the obtained standard simulation parameters can be more in line with the actual network fluctuation conditions of the video sharing personnel. Therefore, after adjusting the parameters of the shared video, even if the network fluctuation of the presenter is large, the shared video quality and video frame number can still ensure smooth video playback and prevent video freezes. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] Figure 1 It is a functional block diagram of the system of the present invention.
[0035] Figure 2 The figure is a flow chart of the steps of the method of the present invention.
[0036] Figure 3 It is a schematic diagram of the wave analysis coordinate system of the present invention.
[0037] Figure 4 It is a schematic diagram of obtaining the basic simulation curve of the present invention.
[0038] Figure 5 It is a schematic structural diagram of the electronic device of the present invention. DETAILED DESCRIPTION
[0039] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0040] Example 1, please refer to Figure 1 As shown, the present application provides an online conference implementation system, including a network fluctuation analysis module, a standard parameter simulation module and a video parameter adjustment module:
[0041] The network fluctuation analysis module is used to record the network fluctuations of people entering the meeting room in real time when starting an online meeting, and put the network fluctuations into a plane rectangular coordinate system for analysis to obtain the equilibrium fluctuation nodes.
[0042] The network fluctuation analysis module is configured with fluctuation analysis strategies, which include:
[0043] When an online meeting starts, the people who enter the meeting room are recorded as the first to the Lth participants in order based on the order in which they enter the meeting room; a plane rectangular coordinate system is established, recorded as the fluctuation analysis coordinate system, where the unit of the X-axis of the fluctuation analysis coordinate system is time, and the unit of the Y-axis is network delay;
[0044] The timing starts from 0 when the conference room is created. Based on the time counted after each participant enters the conference room and the network fluctuation of each participant, the network fluctuation curves of the participants are drawn in the fluctuation analysis coordinate system and recorded as the first fluctuation curve to the Lth fluctuation curve in sequence.
[0045] In the specific implementation process, please refer to Figure 3As shown, DD1 to DD5 are the obtained first to fifth fluctuation curves, and the times corresponding to DD6 to DD9 are the times when the participants corresponding to the first fluctuation curve, the third fluctuation curve, the fourth fluctuation curve, and the fifth fluctuation curve enter the conference room after the conference room is created;
[0046] When the L1th participant in the conference room starts to share the video, the L1th fluctuation curve is recorded as the shared fluctuation curve, and the fluctuation analysis algorithm is used to obtain the network fluctuation value of each point in the shared fluctuation curve. The fluctuation analysis algorithm is: , where F is the network fluctuation value, fmax is the maximum value of the ordinate in the shared fluctuation curve, fmin is the minimum value of the ordinate in the shared fluctuation curve, kmax is the maximum value of the absolute value of the slope in the shared fluctuation curve, fz is the ordinate of the point where the network fluctuation value is obtained, and fk is the absolute value of the slope of the point where the network fluctuation value is obtained in the shared fluctuation curve;
[0047] In the specific implementation process, the fluctuation situation of each point in the shared fluctuation curve can be obtained through the fluctuation analysis algorithm. When the ordinate of a point is large, it means that the network delay of the point is large. When the absolute value of the slope of a point in the shared fluctuation curve is large, it means that the network delay is changing at a faster speed at this point, that is, the network fluctuation is large. Therefore, when the network fluctuation value of a point is small, it means that the point has a large network fluctuation or network delay, and when the network fluctuation value of a point is large, it means that the network fluctuation and network delay of the point are both small. Therefore, in order to consider the optimal situation when sharing videos, the point with the largest network fluctuation value can be used as the equilibrium fluctuation point for subsequent analysis.
[0048] In the specific implementation process, for example, in a data processing process, it is detected that fmax is 400ms, fmin is 50ms, kmax is 2, the ordinate of a point in the shared fluctuation curve is 100ms, and the absolute value of the slope of the point in the shared fluctuation curve is 1. Then, by calculation, it can be obtained that the network fluctuation value of the point is 7;
[0049] The point with the largest network fluctuation value in the shared fluctuation curve is recorded as the equilibrium fluctuation point, and the maximum value of the difference in the horizontal coordinates of the points whose absolute value of the slope in the shared fluctuation curve is equal to |fkmax| is recorded as the simulation span. When there is only one point A in the shared simulation curve whose absolute value of the slope is equal to fkmax, the absolute value of the difference between the horizontal coordinate of point A and the horizontal coordinate of the point with the maximum value of the vertical coordinate in the shared fluctuation curve is recorded as the simulation span, where fkmax is the slope of the equilibrium fluctuation point. When there are multiple participants sharing video, the equilibrium fluctuation point corresponding to each participant is obtained.
[0050] In the specific implementation process, obtaining the simulation span helps to build the span of network fluctuations in the subsequent real-time simulation, so that the obtained basic simulation curve can better conform to the network fluctuations of the actual video sharing participants under the optimal network fluctuation conditions;
[0051] The standard parameter simulation module is used to obtain a preview fluctuation curve based on a balanced fluctuation node, perform real-time simulation of video sharing based on the preview fluctuation curve, and obtain standard simulation parameters based on the simulation results.
[0052] The standard parameter simulation module is configured with a basic curve acquisition strategy and a simulation parameter acquisition strategy; the basic curve acquisition strategy includes:
[0053] The vertical coordinate of the equilibrium fluctuation node is marked as β1, and a plane rectangular coordinate system is established, which is recorded as the fluctuation simulation coordinate system, where the unit of the X-axis of the fluctuation simulation coordinate system is time, and the unit of the Y-axis is network delay; the straight line with the vertical coordinate equal to β1 in the fluctuation simulation coordinate system is recorded as the baseline, and a straight line is drawn in the first quadrant at the point (0, β1) with a slope of fkmax, and stops when the horizontal coordinate of the straight line is equal to (Z, 0), where Z is the simulation span; the line segment composed of the point (0, β1) and the point (Z, fkmax×Z+β1) is recorded as the basic line segment 1, the basic line segment 1 is mirrored based on X=Z, and the mirrored line segment is recorded as the basic line segment 2; the basic line segment 1 and the basic line segment 2 are processed with central symmetry based on the point (2Z, β1), and the obtained line segments are recorded as the basic line segment 3 and the basic line segment 4, and the curve fitted from the basic line segment 1 to the basic line segment 4 is recorded as the basic simulation curve.
[0054] In the specific implementation process, please refer to Figure 4 As shown, FF1 is β1, the straight line corresponding to FF2 is the reference line, FF3 is Z, line segment FF4 is the basic line segment 1, line segment FF5 is the basic line segment 2, line segment FF6 and line segment FF7 are the basic line segment 3 and basic line segment 4 respectively, and curve FF8 is the basic simulation curve;
[0055] The simulation parameter acquisition strategy includes: obtaining multiple video qualities that can be satisfied when sharing videos in online conferences, and recording them as level 1 video quality to level N video quality from small to large; establishing a video simulation model, which is used to simulate the number of frames during video sharing based on video quality and network delay using a real-time simulation method;
[0056] The real-time simulation method includes: re-establishing a conference room α, adding a presenter in the conference room α, and having the presenter share videos, and the network fluctuation of the presenter is a preview fluctuation curve, wherein the preview fluctuation curve is composed of multiple basic simulation curves connected end to end; establishing a table of T rows × N+1 columns, recorded as a shared simulation table, wherein the top row of the shared simulation table is filled with the first-level video quality to the N-level video quality from left to right except the first cell, and the leftmost column of the shared simulation table is filled with the number of frames except the first cell; based on the preview fluctuation curve as the network fluctuation, the number of frames of the shared video corresponding to all video qualities is obtained, and filled in the shared simulation table; when the maximum value of the filled-in frame number is greater than or equal to the standard smooth frame number , the video quality corresponding to the number of frames filled in that is the smallest difference from the standard smooth frame number is recorded as the preferred video quality; when the maximum number of frames filled in is less than the standard smooth frame number, the first-level video quality is recorded as the preferred video quality; the preferred video quality and the number of frames corresponding to the preferred video quality in the shared simulation table are recorded as standard simulation parameters, wherein the shared simulation table is shown in Table 1. In this embodiment, the value of T is 2, and the standard smooth frame number is set to 25 frames. In specific implementation, the standard smooth frame number can be adjusted according to the actual number of frames that can make the video play smoothly. The division of the first-level video quality to the N-level video quality can be specifically 360P, 720P, 1080P, 2K, 4K, etc.
[0057]
[0058] When there are multiple participants performing video sharing, after obtaining the basic simulation curve corresponding to each participant performing video sharing, the standard simulation parameters of each participant performing video sharing are obtained based on the basic simulation curve of each participant performing video sharing.
[0059] The video parameter adjustment module is used to adjust the parameters of the shared video in the conference room based on the standard simulation parameters.
[0060] The video parameter adjustment module is configured with a shared video adjustment strategy, which includes:
[0061] After the online meeting starts and no participant is sharing video, the network fluctuation curve of each participant is obtained in real time;
[0062] The participants who share videos are recorded as shared personnel; when a shared person appears, the standard simulation parameters of the shared person are obtained based on the shared fluctuation curve of the shared person; when the preferred video quality in the standard simulation parameters of the shared person is not the first-level video quality, the frame number and video quality of the shared video are adjusted based on the standard simulation parameters of the shared person, so that the frame number and video quality of the shared video presentation of the shared person are equal to the standard simulation parameters.
[0063] In the specific implementation process, by adjusting the frame rate and video quality of the shared video presentation of the sharing personnel, it is possible to ensure that the video is played with high quality and smoothly under the conditions that best suit the network fluctuations and network delays of the sharing personnel.
[0064] When the preferred video quality in the standard simulation parameters of the sharing personnel is the first-level video quality, the video quality of the shared video demonstrated by the sharing personnel is adjusted to the first-level video quality, and the frame number of the shared video is monitored in real time. When the frame number is less than the frame number in the standard simulation parameters of the sharing personnel, the sharing personnel is reminded of the poor network.
[0065] During the specific implementation process, when the preferred video quality in the standard simulation parameters of the shared personnel is the first-level video quality, it means that the network fluctuation or network delay of the shared personnel is large and cannot meet the higher video quality. Therefore, the frame number of the shared video should be monitored in real time, so that when the frame number is less than the frame number in the standard simulation parameters of the shared personnel, timely reminders should be given to ensure the normal playback of the shared video.
[0066] Example 2, please refer to Figure 2 As shown, the present invention provides a method for implementing an online conference, comprising:
[0067] Step S1, when starting an online meeting, the network fluctuations of the people entering the meeting room are recorded in real time, and the network fluctuations are put into a plane rectangular coordinate system for analysis to obtain a balanced fluctuation node.
[0068] Step S1 includes the following sub-steps:
[0069] Step S101, when starting an online meeting, based on the order of entering the conference room, the persons entering the conference room are recorded as the first participant to the Lth participant in sequence; a plane rectangular coordinate system is established, recorded as a fluctuation analysis coordinate system, wherein the unit of the X-axis of the fluctuation analysis coordinate system is time, and the unit of the Y-axis is network delay;
[0070] The timing starts from 0 when the conference room is created. Based on the time counted after each participant enters the conference room and the network fluctuation of each participant, the network fluctuation curves of the participants are drawn in the fluctuation analysis coordinate system and recorded as the first fluctuation curve to the Lth fluctuation curve in sequence.
[0071] Step S102: When the L1th participant in the conference room starts to share the video, the L1th fluctuation curve is recorded as the shared fluctuation curve, and the network fluctuation value of each point in the shared fluctuation curve is obtained using the fluctuation analysis algorithm. The fluctuation analysis algorithm is: , where F is the network fluctuation value, fmax is the maximum value of the ordinate in the shared fluctuation curve, fmin is the minimum value of the ordinate in the shared fluctuation curve, kmax is the maximum value of the absolute value of the slope in the shared fluctuation curve, fz is the ordinate of the point where the network fluctuation value is obtained, and fk is the absolute value of the slope of the point where the network fluctuation value is obtained in the shared fluctuation curve;
[0072] Step S103, record the point with the largest network fluctuation value in the shared fluctuation curve as the equilibrium fluctuation point, record the maximum value of the difference between the horizontal coordinates of the points whose absolute value of the slope in the shared fluctuation curve is equal to |fkmax| as the simulation span, and when there is only one point A in the shared simulation curve whose absolute value of the slope is equal to fkmax, record the absolute value of the difference between the horizontal coordinate of point A and the horizontal coordinate of the point where the maximum value of the vertical coordinate in the shared fluctuation curve is located as the simulation span, where fkmax is the slope of the equilibrium fluctuation point; when there are multiple participants sharing video, obtain the equilibrium fluctuation point corresponding to each participant.
[0073] Step S2, obtaining a preview fluctuation curve based on the balanced fluctuation node, performing real-time simulation on video sharing based on the preview fluctuation curve, and obtaining standard simulation parameters based on the simulation result; Step S2 includes the following sub-steps:
[0074] Step S201, mark the ordinate of the balanced wave node as β1, establish a plane rectangular coordinate system, recorded as the wave simulation coordinate system, wherein the unit of the X-axis of the wave simulation coordinate system is time, and the unit of the Y-axis is network delay; record the straight line with the ordinate equal to β1 in the wave simulation coordinate system as the baseline, draw a straight line with fkmax as the slope in the first quadrant at the point (0, β1), and stop when the abscissa of the straight line is equal to (Z, 0), wherein Z is the simulation span; record the line segment composed of the point (0, β1) and the point (Z, fkmax×Z+β1) as the basic line segment 1, mirror the basic line segment 1 based on X=Z, and record the mirrored line segment as the basic line segment 2; perform central symmetry processing on the basic line segment 1 and the basic line segment 2 based on the point (2Z, β1), record the obtained line segments as the basic line segment 3 and the basic line segment 4, and record the curve fitted from the basic line segment 1 to the basic line segment 4 as the basic simulation curve.
[0075] Step S202, obtaining multiple video qualities that can be satisfied when sharing videos in an online conference, and recording them as level 1 video quality to level N video quality from small to large; establishing a video simulation model, the video simulation model is used to simulate the number of frames during video sharing based on video quality and network delay using a real-time simulation method;
[0076] The real-time simulation method includes: re-establishing a conference room α, adding a presenter in the conference room α, and having the presenter share videos, and the network fluctuation of the presenter is a preview fluctuation curve, wherein the preview fluctuation curve is composed of multiple basic simulation curves connected end to end; establishing a table of T rows × N+1 columns, recorded as a shared simulation table, wherein the top row of the shared simulation table is filled with the first-level video quality to the N-level video quality from left to right except the first cell, and the leftmost column of the shared simulation table is filled with the frame number except the first cell; on the basis of the preview fluctuation curve as the network fluctuation, the frame number of the shared video corresponding to all video qualities is obtained, and filled in the shared simulation table; when the maximum value of the filled-in frame number is greater than or equal to the standard smooth frame number, the video quality corresponding to the frame number with the smallest difference from the standard smooth frame number among the filled-in frame number is recorded as the preferred video quality; when the maximum value of the filled-in frame number is less than the standard smooth frame number, the first-level video quality is recorded as the preferred video quality; the preferred video quality and the frame number corresponding to the preferred video quality in the shared simulation table are recorded as standard simulation parameters.
[0077] Step S203, when there are multiple participants sharing the video, after obtaining the basic simulation curve corresponding to each participant sharing the video, obtain the standard simulation parameters of each participant sharing the video based on the basic simulation curve of each participant sharing the video.
[0078] Step S3: adjusting the parameters of the shared video in the conference room based on the standard simulation parameters.
[0079] Step S3 includes the following sub-steps:
[0080] Step S301, after the online meeting starts and no participant is sharing a video, a network fluctuation curve of each participant is obtained in real time;
[0081] In step S302, the participants who share the video are recorded as shared personnel; when a shared personnel appears, the standard simulation parameters of the shared personnel are obtained based on the shared fluctuation curve of the shared personnel; when the preferred video quality in the standard simulation parameters of the shared personnel is not the first-level video quality, the frame number and video quality of the shared video are adjusted based on the standard simulation parameters of the shared personnel, so that the frame number and video quality of the shared video during the shared video presentation of the shared personnel are equal to the standard simulation parameters.
[0082] Step S303, when the preferred video quality in the standard simulation parameters of the sharing personnel is the first-level video quality, the video quality of the shared video demonstrated by the sharing personnel is adjusted to the first-level video quality, and the frame number of the shared video is monitored in real time. When the frame number is less than the frame number in the standard simulation parameters of the sharing personnel, the sharing personnel is reminded of the poor network.
[0083] Embodiment 3, the present application provides an electronic device 40, including a processor 401 and a memory 402, the memory 402 stores computer-readable instructions, and when the computer-readable instructions are executed by the processor 401, the steps in the above method are executed. Through the above technical solution, the processor 401 and the memory 402 are interconnected and communicate with each other through a communication bus and / or other forms of connection mechanisms, and the memory 402 stores a computer program executable by the processor 401. When the electronic device is running, the processor 401 executes the computer program to execute the method in any optional implementation of the above embodiment to achieve the following functions: first, when starting an online meeting, the network fluctuations of the people entering the conference room are recorded in real time, and the network fluctuations are put into a plane rectangular coordinate system for analysis to obtain an equilibrium fluctuation node; then, a preview fluctuation curve is obtained based on the equilibrium fluctuation node, and video sharing is simulated in real time based on the preview fluctuation curve, and standard simulation parameters are obtained based on the simulation results; finally, the parameters of the shared video in the conference room are adjusted based on the standard simulation parameters.
[0084] Embodiment 4, the present application provides a storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps in the above method are executed. Through the above technical solution, when the computer program is executed by the processor, the method in any optional implementation of the above embodiment is executed to achieve the following functions: first, when starting an online meeting, the network fluctuations of the people entering the conference room are recorded in real time, and the network fluctuations are put into a plane rectangular coordinate system for analysis to obtain a balanced fluctuation node; then, based on the balanced fluctuation node, a preview fluctuation curve is obtained, and video sharing is simulated in real time based on the preview fluctuation curve, and standard simulation parameters are obtained based on the simulation results; finally, the parameters of the shared video in the conference room are adjusted based on the standard simulation parameters.
[0085] In the above embodiments of the present application, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant description of other embodiments.
[0086] It should be understood by those skilled in the art that the embodiments of the present invention may be provided as methods, systems or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware aspects. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media containing computer-usable program codes. Among them, the storage medium may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (Static Random Access Memory, referred to as SRAM), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, referred to as EEPROM), erasable programmable read-only memory (Erasable Programmable Read Only Memory, referred to as EPROM), programmable read-only memory (Programmable Read-Only Memory, referred to as PROM), read-only memory (Read-Only Memory, referred to as ROM), magnetic memory, flash memory, magnetic disk or optical disk. These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0087] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.
Claims
1. A method for implementing an online conference, characterized in that: include: When starting an online meeting, the network fluctuations of people entering the meeting room are recorded in real time, and the network fluctuations are put into a plane rectangular coordinate system for analysis to obtain the equilibrium fluctuation nodes; Acquire a preview fluctuation curve based on the balanced fluctuation node, perform real-time simulation on video sharing based on the preview fluctuation curve, and acquire standard simulation parameters based on the simulation results; Adjusting parameters of the shared video in the conference room based on standard simulation parameters; When starting an online meeting, the network fluctuations of people entering the meeting room are recorded in real time, and the network fluctuations are put into a plane rectangular coordinate system for analysis. The equilibrium fluctuation nodes obtained include: When an online meeting starts, the people who enter the meeting room are recorded as the first to the Lth participants in order based on the order in which they enter the meeting room; a plane rectangular coordinate system is established, recorded as the fluctuation analysis coordinate system, where the unit of the X-axis of the fluctuation analysis coordinate system is time, and the unit of the Y-axis is network delay; The timing starts from 0 when the conference room is created. Based on the timing time after each participant enters the conference room and the network fluctuation of each participant, the network fluctuation curves of the participants are drawn in the fluctuation analysis coordinate system and recorded as the first fluctuation curve to the Lth fluctuation curve in sequence; When starting an online meeting, the network fluctuations of people entering the meeting room are recorded in real time, and the network fluctuations are put into a plane rectangular coordinate system for analysis. Obtaining the balanced fluctuation node also includes the following sub-steps: When the L1th participant in the conference room starts to share the video, the L1th fluctuation curve is recorded as the shared fluctuation curve, and the fluctuation analysis algorithm is used to obtain the network fluctuation value of each point in the shared fluctuation curve. The fluctuation analysis algorithm is: , where F is the network fluctuation value, fmax is the maximum value of the ordinate in the shared fluctuation curve, fmin is the minimum value of the ordinate in the shared fluctuation curve, kmax is the maximum value of the absolute value of the slope in the shared fluctuation curve, fz is the ordinate of the point where the network fluctuation value is obtained, and fk is the absolute value of the slope of the point where the network fluctuation value is obtained in the shared fluctuation curve; The point with the largest network fluctuation value in the shared fluctuation curve is recorded as the equilibrium fluctuation point, and the maximum value of the difference between the horizontal coordinates of the points whose absolute value of the slope in the shared fluctuation curve is equal to |fkmax| is recorded as the simulation span. When there is only one point A in the shared simulation curve whose absolute value of the slope is equal to fkmax, the absolute value of the difference between the horizontal coordinate of point A and the horizontal coordinate of the point with the maximum value of the vertical coordinate in the shared fluctuation curve is recorded as the simulation span, where fkmax is the slope of the equilibrium fluctuation point; when there are multiple participants sharing videos, the equilibrium fluctuation point corresponding to each participant is obtained; Based on the balanced fluctuation node, a preview fluctuation curve is obtained, and based on the preview fluctuation curve, real-time simulation of video sharing is performed. Based on the simulation results, standard simulation parameters are obtained, including: The vertical coordinate of the equilibrium fluctuation node is marked as β1, and a plane rectangular coordinate system is established, which is recorded as the fluctuation simulation coordinate system, where the unit of the X-axis of the fluctuation simulation coordinate system is time, and the unit of the Y-axis is network delay; the straight line with the vertical coordinate equal to β1 in the fluctuation simulation coordinate system is recorded as the baseline, and a straight line is drawn in the first quadrant at the point (0, β1) with a slope of fkmax, and stops when the horizontal coordinate of the straight line is equal to (Z, 0), where Z is the simulation span; the line segment composed of the point (0, β1) and the point (Z, fkmax×Z+β1) is recorded as the basic line segment 1, the basic line segment 1 is mirrored based on X=Z, and the mirrored line segment is recorded as the basic line segment 2; the basic line segment 1 and the basic line segment 2 are processed with central symmetry based on the point (2Z, β1), and the obtained line segments are recorded as the basic line segment 3 and the basic line segment 4, and the curve fitted from the basic line segment 1 to the basic line segment 4 is recorded as the basic simulation curve; Acquiring a preview fluctuation curve based on the balanced fluctuation node, performing real-time simulation on video sharing based on the preview fluctuation curve, and acquiring standard simulation parameters based on the simulation results also include: Obtain multiple video qualities that can be satisfied when sharing videos in online conferences, and record them as level 1 video quality to level N video quality from small to large; establish a video simulation model, which is used to simulate the number of frames during video sharing based on video quality and network delay using a real-time simulation method; The real-time simulation method includes: re-establishing a conference room α, adding a presenter in the conference room α, and having the presenter share the video, and the network fluctuation of the presenter is a preview fluctuation curve, wherein the preview fluctuation curve is composed of multiple basic simulation curves connected end to end; establishing a table of T rows × N+1 columns, recorded as a shared simulation table, wherein the top row of the shared simulation table is filled with the first-level video quality to the N-level video quality from left to right except the first cell, and the leftmost column of the shared simulation table is filled with the frame number except the first cell; on the basis of the preview fluctuation curve as the network fluctuation, the frame number of the shared video corresponding to all video qualities is obtained, and filled in the shared simulation table; when the maximum value of the filled-in frame number is greater than or equal to the standard smooth frame number, the video quality corresponding to the frame number with the smallest difference from the standard smooth frame number among the filled-in frame number is recorded as the preferred video quality; when the maximum value of the filled-in frame number is less than the standard smooth frame number, the first-level video quality is recorded as the preferred video quality; the preferred video quality and the frame number corresponding to the preferred video quality in the shared simulation table are recorded as standard simulation parameters; When there are multiple participants performing video sharing, after obtaining the basic simulation curve corresponding to each participant performing video sharing, the standard simulation parameters of each participant performing video sharing are obtained based on the basic simulation curve of each participant performing video sharing.
2. The method for implementing an online conference according to claim 1, characterized in that: Adjusting the parameters of the shared video in the conference room based on standard simulation parameters includes: After the online meeting starts and no participant is sharing video, the network fluctuation curve of each participant is obtained in real time; The participants who share videos are recorded as shared personnel; when a shared person appears, the standard simulation parameters of the shared person are obtained based on the shared fluctuation curve of the shared person; when the preferred video quality in the standard simulation parameters of the shared person is not the first-level video quality, the frame number and video quality of the shared video are adjusted based on the standard simulation parameters of the shared person, so that the frame number and video quality of the shared video presentation of the shared person are equal to the standard simulation parameters.
3. The method for implementing an online conference according to claim 2, characterized in that: Adjusting the parameters of the shared video in the conference room based on the standard simulation parameters also includes: When the preferred video quality in the standard simulation parameters of the sharing personnel is the first-level video quality, the video quality of the shared video demonstrated by the sharing personnel is adjusted to the first-level video quality, and the frame number of the shared video is monitored in real time. When the frame number is less than the frame number in the standard simulation parameters of the sharing personnel, the sharing personnel is reminded of the poor network.
4. An online conference implementation system, used to implement an online conference implementation method according to any one of claims 1 to 3, characterized in that: Including network fluctuation analysis module, standard parameter simulation module and video parameter adjustment module: The network fluctuation analysis module is used to record the network fluctuations of people entering the meeting room in real time when starting an online meeting, and put the network fluctuations into a plane rectangular coordinate system for analysis to obtain the equilibrium fluctuation nodes; The standard parameter simulation module is used to obtain a preview fluctuation curve based on the balanced fluctuation node, perform real-time simulation on video sharing based on the preview fluctuation curve, and obtain standard simulation parameters based on the simulation results; The video parameter adjustment module is used to adjust the parameters of the shared video in the conference room based on the standard simulation parameters.
5. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores computer-readable instructions. When the computer-readable instructions are executed by the processor, the steps in the method according to any one of claims 1 to 3 are executed.
6. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 3 are performed.
