A video conference picture partition display method based on dynamic optimization of multiple video signals

Abstract

This invention discloses a video conferencing screen segmentation and display method based on dynamic optimization of multi-channel video signals. In the field of video display technology, it addresses the problems of wasted video resources and stuttering caused by resource consumption during current video conferencing. The method includes: acquiring users' real-time bandwidth data, analyzing the real-time bandwidth data to obtain an initial video conferencing resolution suitable for the real-time bandwidth; formulating usage rules for the video conferencing room based on users entering the room; acquiring the usage rules and upper limit bandwidth data of the video conferencing room, and adjusting the video resolution for users based on the usage rules; acquiring the real-time bitrate of the video stream corresponding to the presenter, and adjusting the real-time bitrate of the presenter based on the detection results. This invention achieves dynamic optimization of video conferencing resolution based on multiple video signals.

Description

Technical Field

[0001] This invention belongs to the field of video display technology, specifically a video conferencing screen segmentation and display method based on dynamic optimization of multiple video signals. Background Technology

[0002] Split-screen video conferencing refers to a method in video conferencing where participants' images are divided and presented on the same screen according to certain rules. Typically, the system divides the screen into multiple small windows based on the number of participants or specific display needs, with each window displaying the video images of one or more participants. This method allows all participants to see the images of other participants on the same interface, improving interactivity and engagement. Common split-screen patterns include grid layouts (such as 2x2, 3x3, etc.). Depending on the meeting size and screen size, the system automatically adjusts the layout and resolution of the display windows to optimize the meeting experience.

[0003] In existing technologies, video conferencing requires multiple screen switching. Currently, a uniform standard is used for video occupancy between large and small screens in video conferencing, which not only wastes video resources but also easily causes video conferencing to lag. To address this, this invention proposes a video conferencing screen segmentation and display method based on dynamic optimization of multiple video signals. Summary of the Invention

[0004] The purpose of this invention is to propose a video conferencing screen segmentation and display method based on dynamic optimization of multiple video signals, so as to solve the problems mentioned in the background art.

[0005] The technical problem to be solved by this invention is:

[0006] How to dynamically optimize video conferencing resolution based on multiple video signals.

[0007] To achieve the above objectives, the present invention adopts the following technical solution:

[0008] A video conferencing screen segmentation and display method based on dynamic optimization of multiple video signals, the method includes:

[0009] Step S1: Obtain the user's real-time bandwidth data, and then analyze the real-time bandwidth data to obtain the initial video conferencing resolution suitable for the real-time bandwidth data.

[0010] Step S2: Develop usage rules for the video conference room based on the users entering the video conference room;

[0011] Step S3: Obtain the usage rules and upper limit bandwidth data of the video conference room, and adjust the video resolution of the user's video conference according to the usage rules of the video conference room;

[0012] Step S4: Obtain the real-time bitrate of the video stream corresponding to the main speaker, and adjust the real-time bitrate of the main speaker based on the detection results.

[0013] Furthermore, real-time bandwidth data includes the user's device's real-time upload bandwidth, real-time download bandwidth, real-time packet loss rate, and real-time bitrate of the video stream when connected to the Internet.

[0014] Further, step S1 includes the following sub-steps:

[0015] It obtains the real-time upload bandwidth, real-time download bandwidth, real-time packet loss rate, and real-time bitrate of the video stream when the user's device is connected to the Internet;

[0016] Calculate the optimal bandwidth value for the user's devices;

[0017] When comparing the bandwidth excellence value of the user's device with the bandwidth excellence threshold, the initial video conference resolution will be adjusted to the first, second, or third resolution.

[0018] Furthermore, if the first bandwidth excellence threshold is greater than the second bandwidth excellence threshold, the second bandwidth excellence threshold is greater than zero, the first resolution is better than the second resolution, and the second resolution is better than the third resolution.

[0019] Furthermore, the video conference room includes a presenter and listeners. The presenter can be any user in the video conference room, and the listeners are other users besides the presenter.

[0020] Further, step S2 includes the following sub-steps:

[0021] When the video conference starts, count the number of all users who have entered the video conference room, adjust all users’ screens to the same number of small screens as the number of users, and adjust the screen resolution of each user to obtain the small screen resolution.

[0022] Set a fixed time interval, and when the fixed time interval is reached, set the main speaker in a fixed order;

[0023] The rules for using video conferencing rooms include the number of screens, the resolution of smaller screens, the duration interval, and a fixed order.

[0024] Furthermore, the upper limit bandwidth data for the video conferencing room includes the upper limit of real-time upload bandwidth, the lower limit of real-time upload bandwidth, the upper limit of real-time download bandwidth, and the lower limit of real-time download bandwidth.

[0025] Further, step S3 includes the following sub-steps:

[0026] Once a user enters the video conference room, the resolution of each small screen after the user's screen is divided into smaller screens is obtained, and the corresponding real-time bitrate is adjusted according to the resolution of each small screen.

[0027] When any user is set as the main speaker, the real-time download bandwidth of the main speaker is set to the lower limit of the real-time download bandwidth of the video conference room. At the same time, the real-time upload bandwidth of the main speaker is obtained and compared with the upper limit of the real-time upload bandwidth of the video conference room.

[0028] If the real-time upload bandwidth of the presenter is greater than or equal to the real-time upload bandwidth limit of the video conference room, then the real-time upload bandwidth of the presenter will be set to the real-time upload bandwidth limit of the video conference room; if the real-time upload bandwidth of the presenter is less than the real-time upload bandwidth limit of the video conference room, then no action will be taken.

[0029] Set the screen resolution corresponding to the presenter based on the real-time upload bandwidth and real-time download bandwidth;

[0030] When any user is set as the main speaker, the real-time upload bandwidth of all listeners is set to the lower limit of the real-time upload bandwidth of the video conference room. At the same time, the real-time download bandwidth of the listeners is obtained and compared with the upper limit of the real-time download bandwidth of the video conference room.

[0031] If the real-time download bandwidth of the listening user is greater than or equal to the real-time download bandwidth limit of the video conference room, then the real-time download bandwidth of the listening user will be set to the real-time download bandwidth limit of the video conference room; if the real-time download bandwidth of the listening user is less than the real-time download bandwidth limit of the video conference room, then no operation will be performed.

[0032] Set the screen resolution for each user based on their real-time download and upload bandwidth.

[0033] Furthermore, the real-time bitrate adjustment process is as follows:

[0034] When the user's screen is divided into a first number of smaller screens, the real-time bitrate of the video stream is set to the first real-time bitrate.

[0035] When the user's screen is divided into a second number of smaller screens, the real-time bitrate of the video stream is set to the second real-time bitrate.

[0036] When the user's screen is divided into a third number of smaller screens, the real-time bitrate of the video stream is set to the third real-time bitrate.

[0037] Among them, the first quantity is greater than the second quantity, the second quantity is greater than the third quantity, the first real-time bitrate is less than the second real-time bitrate, and the second real-time bitrate is less than the third real-time bitrate.

[0038] Further, step S4 includes the following sub-steps:

[0039] Divide the fixed time interval into consecutive time periods of equal length, and then mark the endpoints of the consecutive time periods as time nodes.

[0040] Obtain the real-time bitrate of the speaker at each time point, and then calculate the average real-time bitrate of the speaker within a fixed time interval.

[0041] At the same time, the standard deviation of the real-time bitrate of the main speaker within a fixed time interval is calculated;

[0042] Set the real-time bitrate fluctuation range for the main speaker;

[0043] No action is taken when the real-time bitrate of the presenting user falls within the real-time bitrate fluctuation range at all time points.

[0044] When the real-time bitrate of the presenting user at any given time point is outside the real-time bitrate fluctuation range, record the number of time points corresponding to the real-time bitrate outside the fluctuation range. If the number of time points corresponding to the real-time bitrate outside the fluctuation range is greater than or equal to a threshold, obtain the number of time points corresponding to the real-time bitrate greater than the maximum endpoint of the real-time bitrate fluctuation range, and record this as the first time point number. Simultaneously, obtain the number of time points corresponding to the real-time bitrate less than the minimum endpoint of the real-time bitrate fluctuation range, and record this as the second time point number. If the first time point number is greater than the second time point number, decrease the user's real-time bitrate. If the first time point number is less than or equal to the second time point number, increase the user's real-time bitrate.

[0045] In summary, due to the adoption of the above technical solution, the beneficial effects of the present invention are:

[0046] This invention first acquires the user's real-time bandwidth data, then analyzes the real-time bandwidth data to obtain an initial video conferencing resolution suitable for the real-time bandwidth data. Simultaneously, it formulates usage rules for the video conferencing room based on the users entering the room. The second step involves acquiring the usage rules and upper limit bandwidth data of the video conferencing room, and adjusting the video resolution for users based on these rules. Finally, it also acquires the real-time bitrate of the video stream corresponding to the presenter, and adjusts the presenter's real-time bitrate based on the detection results. This invention achieves dynamic optimization of video conferencing resolution based on multiple video signals. Attached Figure Description

[0047] To facilitate understanding by those skilled in the art, the present invention will be further described below with reference to the accompanying drawings.

[0048] Figure 1 This is a flowchart of the method of the present invention;

[0049] Figure 2 This is a flowchart of the method for the sub-step corresponding to step S2 in this invention;

[0050] Figure 3 This is a schematic diagram of the computer device in this invention. Detailed Implementation

[0051] The technical solution of the present invention will be clearly and completely described below with reference to the embodiments. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0052] Example 1: Please refer to Figure 1 and Figure 2 As shown, the technical solution provided by this invention is: a video conferencing screen segmentation and display method based on dynamic optimization of multi-channel video signals. This method is used to dynamically adjust the real-time video conferencing resolution of each user in the video conferencing room. The specific method is as follows:

[0053] Step S1: Obtain the user's real-time bandwidth data, and then analyze the real-time bandwidth data to obtain the initial video conferencing resolution suitable for the real-time bandwidth data.

[0054] It should be noted that the real-time bandwidth data includes the real-time upload bandwidth, real-time download bandwidth, real-time packet loss rate, and real-time bitrate of the video stream when the user's device is connected to the Internet. The real-time bitrate of the video stream is the bitrate used by the user when uploading the video stream, and the real-time bitrate is less than the real-time upload bandwidth.

[0055] In this embodiment, step S1 includes the following sub-steps:

[0056] Step S11: Obtain the real-time upload bandwidth SCD, real-time download bandwidth XZD, real-time packet loss rate DBL, and real-time bitrate SSM of the video stream when the user's device is connected to the Internet;

[0057] Step S12: Calculate the bandwidth optimization value YXZ of the user's device using the following formula:

[0058] YXZ=(SCD+XZD+SSM) / (DBL+1);

[0059] Step S13: When the bandwidth excellence value of the user's device is greater than the first bandwidth excellence threshold, the initial video conferencing resolution is adjusted to the first resolution.

[0060] When the bandwidth of the user's device is greater than the second bandwidth threshold and less than or equal to the first bandwidth threshold, the initial video conferencing resolution will be adjusted to the second resolution.

[0061] When the bandwidth of the user's device is less than the second bandwidth threshold, the initial video conference resolution will be adjusted to the third resolution.

[0062] It should be specifically noted that the first excellent bandwidth threshold is greater than the second excellent bandwidth threshold, the second excellent bandwidth threshold is greater than zero, the first resolution is better than the second resolution, and the second resolution is better than the third resolution.

[0063] For example, the first resolution is 2560×1440, the second resolution is 1920×1080, and the third resolution is 1280×720.

[0064] Step S2: Develop usage rules for the video conference room based on the users entering the video conference room;

[0065] It should be noted that the video conference room includes a presenter and listeners. The presenter can be any user in the video conference room, and the listeners are other users besides the presenter.

[0066] In this embodiment, step S2 includes the following sub-steps:

[0067] Step S21: When the video conference starts, count the number of all users who have entered the video conference room, adjust the screens of all users to the same number of small screens as the number of users, and adjust the screen resolution of each user to obtain the small screen resolution.

[0068] If the number of users cannot be divided equally, then the number of users is increased to the minimum number of equally divisible users.

[0069] For example, when the user's screen resolution is 1920×1080, if there are 4 users in the video conference room, the user's screen is divided into 2×2 smaller screens. In this case, there is no need to take a fixed number of divisions upwards, and the resolution of each smaller screen is 960×540. If there are 7 users in the video conference room, the screen cannot be divided equally, so the minimum number of divisions that can be divided is taken upwards, which is 8. The resolution of each smaller screen is 960×270. If there are 9 users in the video conference room, the user's screen is divided into 3×3 smaller screens. In this case, there is no need to take a fixed number of divisions upwards, and the resolution of each smaller screen is 640×360.

[0070] Step S22: Set a fixed time interval. When the fixed time interval is reached, set the main speaker in a fixed order.

[0071] Specifically, the fixed order can be the time sequence of users entering the video conference room or the alphabetical order of the first letters of the pinyin of the users in the video conference room, etc.

[0072] Step S23: The number of screens, small screen resolution, duration interval, and fixed order are used as the rules for using the video conference room.

[0073] Step S3: Obtain the usage rules and upper limit bandwidth data of the video conference room, and adjust the video resolution of the user's video conference according to the usage rules of the video conference room;

[0074] Specifically, the upper limit bandwidth data for video conferencing rooms includes the upper limit of real-time upload bandwidth, the lower limit of real-time upload bandwidth, the upper limit of real-time download bandwidth, and the lower limit of real-time download bandwidth.

[0075] In this embodiment, step S3 includes the following sub-steps:

[0076] Step S31: After the user enters the video conference room, obtain the resolution of each small screen after the user's screen is evenly divided, and adjust the corresponding real-time bitrate according to the resolution of each small screen.

[0077] In this embodiment, step S31 includes the following sub-steps:

[0078] Step S311: When the user's screen is divided into a first number of small screens, the real-time bitrate of the video stream is set to the first real-time bitrate.

[0079] Step S312: When the user's screen is divided into a second number of small screens, the real-time bitrate of the video stream is set to the second real-time bitrate.

[0080] Step S313: When the user's screen is divided into a third number of small screens, the real-time bitrate of the video stream is set to the third real-time bitrate.

[0081] Among them, the first quantity is greater than the second quantity, the second quantity is greater than the third quantity, the first real-time bitrate is less than the second real-time bitrate, and the second real-time bitrate is less than the third real-time bitrate.

[0082] Step S32: When any user is set as the main speaker, the real-time download bandwidth of the main speaker is set to the lower limit of the real-time download bandwidth of the video conference room. At the same time, the real-time upload bandwidth of the main speaker is obtained and compared with the upper limit of the real-time upload bandwidth of the video conference room.

[0083] When any user is set as the main speaker, the main speaker's small screen is adjusted to fill the entire screen for display. After a fixed time interval, the main speaker's small screen is adjusted to fill the entire screen for display. At the same time, the next main speaker is selected in a fixed order, and the main speaker's small screen is adjusted to fill the entire screen.

[0084] Step S33: If the real-time upload bandwidth of the presenter is greater than or equal to the upper limit of the real-time upload bandwidth of the video conference room, then set the real-time upload bandwidth of the presenter to the upper limit of the real-time upload bandwidth of the video conference room.

[0085] If the real-time upload bandwidth of the presenting user is less than the maximum real-time upload bandwidth of the video conference room, no action will be taken.

[0086] Step S34: Set the screen resolution corresponding to the presenter based on the real-time upload bandwidth and real-time download bandwidth;

[0087] Step S35: When any user is set as the main speaker, set the real-time upload bandwidth of all listeners to the lower limit of the real-time upload bandwidth of the video conference room, and at the same time obtain the real-time download bandwidth of the listeners and compare the real-time download bandwidth of the listeners with the upper limit of the real-time download bandwidth of the video conference room.

[0088] Step S36: If the real-time download bandwidth of the listening user is greater than or equal to the real-time download bandwidth limit of the video conference room, then set the real-time download bandwidth of the listening user to the real-time download bandwidth limit of the video conference room.

[0089] If the real-time download bandwidth of the listening user is less than the real-time download bandwidth limit of the video conference room, no action will be taken.

[0090] Step S37: Set the screen resolution corresponding to the listening user based on the real-time download bandwidth and real-time upload bandwidth;

[0091] Step S4: Obtain the real-time bitrate of the video stream corresponding to the main speaker, and adjust the real-time bitrate of the main speaker based on the detection results;

[0092] In this embodiment, step S4 includes the following sub-steps:

[0093] Step S41: Divide the fixed time interval into consecutive time periods of equal length, and then record the endpoints of the consecutive time periods as time nodes i, i = 1, 2, ..., n, where n is the upper limit of the time node.

[0094] Step S42: Obtain the real-time bitrate SSMi of the presenter at each time point, and then calculate the average real-time bitrate PJZ of the presenter within a fixed time interval using a formula. The specific calculation process is as follows:

[0095]

[0096] Step S43: Calculate the standard deviation BZC of the real-time bitrate for the presenter within a fixed time interval using the following formula:

[0097]

[0098] Step S44: Set the real-time bitrate fluctuation range for the main user. The real-time bitrate fluctuation range is specifically: [PJZ-2×BZC, PJZ+2×BZC];

[0099] Step S45: When the real-time bitrate of the main speaker is within the real-time bitrate fluctuation range at all time points, no operation is performed;

[0100] Step S46: When the real-time bitrate of the presenter at any time point is not within the real-time bitrate fluctuation range, record the number of time points corresponding to the real-time bitrate that is not within the real-time bitrate fluctuation range.

[0101] Step S47: If the number of time nodes corresponding to real-time bitrates that do not belong to the real-time bitrate fluctuation range is greater than or equal to the number threshold, obtain the number of time nodes corresponding to real-time bitrates that are greater than the maximum endpoint value of the real-time bitrate fluctuation range, and record them as the first time node number. At the same time, obtain the number of time nodes corresponding to real-time bitrates that are less than the minimum endpoint value of the real-time bitrate fluctuation range, and record them as the second time node number.

[0102] Step S48: If the number of first time nodes is greater than the number of second time nodes, then reduce the user's real-time bitrate.

[0103] If the number of first time nodes is less than or equal to the number of second time nodes, then increase the user's real-time bitrate.

[0104] In this application, if a corresponding calculation formula appears, the above calculation formula is a dimensionless calculation. The weighting coefficient, proportional coefficient and other coefficients in the formula are set to quantify each parameter to obtain a result value. The size of the weighting coefficient and proportional coefficient is only required to not affect the proportional relationship between the parameter and the result value.

[0105] Example 2: Figure 3As shown, this embodiment provides a computer device, which may include a processor, a communication interface, a memory, and a communication bus. The processor, communication interface, and memory communicate with each other via the communication bus. The processor can call logical instructions in the memory to execute a video conferencing screen segmentation and display method based on dynamic optimization of multiple video signals. This method includes: acquiring real-time bandwidth data of users, then analyzing the real-time bandwidth data to obtain an initial video conferencing resolution suitable for the real-time bandwidth data; formulating usage rules for the video conferencing room based on users entering the video conferencing room; acquiring the usage rules and upper limit bandwidth data of the video conferencing room, and adjusting the video resolution of users using the video conferencing room according to the usage rules; acquiring the real-time bitrate of the video stream corresponding to the presenter, and adjusting the real-time bitrate of the presenter based on the detection results.

[0106] Furthermore, the logical instructions in the aforementioned memory can be implemented as software functional units and sold or used as independent products, and can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0107] On the other hand, this application also provides a computer program product, which includes a computer program stored on a computer-readable storage medium. The computer program includes program instructions, and when the program instructions are executed by a computer, the computer can execute the video conferencing screen segmentation and display method based on dynamic optimization of multiple video signals provided by the above methods. The method includes: acquiring real-time bandwidth data of users, and then analyzing the real-time bandwidth data to obtain an initial video conferencing resolution suitable for the real-time bandwidth data; formulating usage rules for the video conferencing room based on users entering the video conferencing room; acquiring the usage rules and upper limit bandwidth data of the video conferencing room, and adjusting the video resolution of users using the video conferencing room according to the usage rules of the video conferencing room; acquiring the real-time bitrate of the video stream corresponding to the presenter, and adjusting the real-time bitrate of the presenter according to the detection results.

[0108] Furthermore, this application also provides a computer-readable storage medium storing a computer program thereon. When executed by a processor, the computer program implements the aforementioned video conferencing screen segmentation and display methods based on dynamic optimization of multiple video signals. The method includes: acquiring real-time bandwidth data of users, then analyzing the real-time bandwidth data to obtain an initial video conferencing resolution suitable for the real-time bandwidth data; formulating usage rules for the video conferencing room based on users entering the video conferencing room; acquiring the usage rules and upper limit bandwidth data of the video conferencing room, and adjusting the video resolution of the user's video conferencing based on the usage rules; acquiring the real-time bitrate of the video stream corresponding to the presenting user, and adjusting the real-time bitrate of the presenting user based on the detection results.

[0109] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0110] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0111] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A video conferencing screen segmentation and display method based on dynamic optimization of multiple video signals, characterized in that, The methods include: Step S1: Obtain the user's real-time bandwidth data, and then analyze the real-time bandwidth data to obtain the initial video conferencing resolution suitable for the real-time bandwidth data. Step S2: Develop usage rules for the video conference room based on the users entering the video conference room; Step S3: Obtain the usage rules and upper limit bandwidth data of the video conference room, and adjust the video resolution of the user's video conference according to the usage rules of the video conference room; Step S4: Obtain the real-time bitrate of the video stream corresponding to the main speaker, and adjust the real-time bitrate of the main speaker based on the detection results; Step S4 includes the following sub-steps: Divide the fixed time interval into consecutive time periods of equal length, and then mark the endpoints of the consecutive time periods as time nodes i, i = 1, 2, ..., n, where n is the upper limit of the time node. Obtain the real-time bitrate SSMi of the presenter at each time point, and then calculate the average real-time bitrate PJZ of the presenter within a fixed time interval. The specific calculation process is as follows: ； At the same time, the standard deviation BZC of the real-time bitrate of the presenter within a fixed time interval is calculated using the following formula: ； Set the real-time bitrate fluctuation range for the main user. The real-time bitrate fluctuation range is: [PJZ-2×BZC, PJZ+2×BZC]; No action is taken when the real-time bitrate of the presenting user falls within the real-time bitrate fluctuation range at all time points. When the real-time bitrate of the presenting user at any given time point is outside the real-time bitrate fluctuation range, record the number of time points corresponding to the real-time bitrate outside the fluctuation range. If the number of time points corresponding to the real-time bitrate outside the fluctuation range is greater than or equal to a threshold, obtain the number of time points corresponding to the real-time bitrate greater than the maximum endpoint of the real-time bitrate fluctuation range, and record this as the first time point number. Simultaneously, obtain the number of time points corresponding to the real-time bitrate less than the minimum endpoint of the real-time bitrate fluctuation range, and record this as the second time point number. If the first time point number is greater than the second time point number, decrease the user's real-time bitrate. If the first time point number is less than or equal to the second time point number, increase the user's real-time bitrate.

2. The video conferencing screen segmentation and display method based on dynamic optimization of multi-channel video signals according to claim 1, characterized in that, Real-time bandwidth data includes the user's device's real-time upload bandwidth, real-time download bandwidth, real-time packet loss rate, and real-time bitrate of the video stream when connected to the Internet.

3. The video conferencing screen segmentation and display method based on dynamic optimization of multi-channel video signals according to claim 2, characterized in that, Step S1 includes the following sub-steps: Obtain the real-time upload bandwidth (SCD), real-time download bandwidth (XZD), real-time packet loss rate (DBL), and real-time bitrate (SSM) of the video stream when the user's device is connected to the Internet; The optimal bandwidth value YXZ of the user's device is calculated using the following formula: YXZ=(SCD+XZD+SSM) / (DBL+1); When the bandwidth of the user's device is greater than the first bandwidth threshold, the initial video conference resolution will be adjusted to the first resolution. When the bandwidth of the user's device is greater than the second bandwidth threshold and less than or equal to the first bandwidth threshold, the initial video conferencing resolution will be adjusted to the second resolution. When the bandwidth excellence value of the user's device is less than the second bandwidth excellence threshold, the initial video conference resolution will be adjusted to the third resolution; wherein, the first bandwidth excellence threshold is greater than the second bandwidth excellence threshold, the second bandwidth excellence threshold is greater than zero, the first resolution is better than the second resolution, and the second resolution is better than the third resolution.

4. The video conferencing screen segmentation and display method based on dynamic optimization of multi-channel video signals according to claim 3, characterized in that, The first bandwidth excellent threshold is greater than the second bandwidth excellent threshold, the second bandwidth excellent threshold is greater than zero, the first resolution is better than the second resolution, and the second resolution is better than the third resolution.

5. The video conferencing screen segmentation and display method based on dynamic optimization of multi-channel video signals according to claim 1, characterized in that, The video conference room includes a presenter and listeners. The presenter can be any user in the video conference room, and the listeners are other users besides the presenter.

6. The video conferencing screen segmentation and display method based on dynamic optimization of multi-channel video signals according to claim 1, characterized in that, Step S2 includes the following sub-steps: When the video conference starts, count the number of all users who have entered the video conference room, adjust all users’ screens to the same number of small screens as the number of users, and adjust the screen resolution of each user to obtain the small screen resolution. Set a fixed time interval, and when the fixed time interval is reached, set the main speaker in a fixed order; The rules for using video conferencing rooms include the number of screens, the resolution of smaller screens, the duration interval, and a fixed order.

7. The video conferencing screen segmentation and display method based on dynamic optimization of multi-channel video signals according to claim 1, characterized in that, The upper limit bandwidth data for video conferencing rooms includes the upper limit of real-time upload bandwidth, the lower limit of real-time upload bandwidth, the upper limit of real-time download bandwidth, and the lower limit of real-time download bandwidth.

8. The video conferencing screen segmentation and display method based on dynamic optimization of multi-channel video signals according to claim 7, characterized in that, Step S3 includes the following sub-steps: Once a user enters the video conference room, the resolution of each small screen after the user's screen is evenly divided is obtained, and the corresponding real-time bitrate is adjusted according to the resolution of each small screen. When any user is set as the main speaker, the real-time download bandwidth of the main speaker is set to the lower limit of the real-time download bandwidth of the video conference room. At the same time, the real-time upload bandwidth of the main speaker is obtained and compared with the upper limit of the real-time upload bandwidth of the video conference room. If the real-time upload bandwidth of the presenter is greater than or equal to the real-time upload bandwidth limit of the video conference room, then the real-time upload bandwidth of the presenter will be set to the real-time upload bandwidth limit of the video conference room; if the real-time upload bandwidth of the presenter is less than the real-time upload bandwidth limit of the video conference room, then no action will be taken. Set the screen resolution corresponding to the presenter based on the real-time upload bandwidth and real-time download bandwidth; When any user is set as the main speaker, the real-time upload bandwidth of all listeners is set to the lower limit of the real-time upload bandwidth of the video conference room. At the same time, the real-time download bandwidth of the listeners is obtained and compared with the upper limit of the real-time download bandwidth of the video conference room. If the real-time download bandwidth of the listening user is greater than or equal to the real-time download bandwidth limit of the video conference room, then the real-time download bandwidth of the listening user will be set to the real-time download bandwidth limit of the video conference room; if the real-time download bandwidth of the listening user is less than the real-time download bandwidth limit of the video conference room, then no operation will be performed. Set the screen resolution for each user based on their real-time download and upload bandwidth.

9. The video conferencing screen segmentation and display method based on dynamic optimization of multi-channel video signals according to claim 8, characterized in that, The process of adjusting the real-time bitrate according to the resolution of each small screen is as follows: When the user's screen is divided into a first number of smaller screens, the real-time bitrate of the video stream is set to the first real-time bitrate. When the user's screen is divided into a second number of smaller screens, the real-time bitrate of the video stream is set to the second real-time bitrate. When the user's screen is divided into a third number of smaller screens, the real-time bitrate of the video stream is set to the third real-time bitrate. Among them, the first quantity is greater than the second quantity, the second quantity is greater than the third quantity, the first real-time bitrate is less than the second real-time bitrate, and the second real-time bitrate is less than the third real-time bitrate.

Images