Video conference picture segmentation display method based on multi-channel video signal dynamic optimization

Abstract

The invention discloses a video conference picture segmentation display method based on multi-channel video signal dynamic optimization, belongs to the technical field of video display, and solves the problems of video resource waste and video conference picture jamming caused by video conference resource occupation in a current video conference. Analyzing the real-time bandwidth data to obtain an initial video conference resolution suitable for the real-time bandwidth data; formulating a use rule of the video conference room according to the user entering the video conference room; acquiring a use rule and upper limit bandwidth data of the video conference room, and adjusting the video resolution of the video conference used by the user according to the use rule of the video conference room; the real-time code rate of the video stream corresponding to the speaker user is obtained, the real-time code rate of the speaker user is adjusted according to the detection result, and dynamic optimization of the video conference resolution is achieved based on the multiple video signals.

Description

Technical Field

[0001] The present invention belongs to the technical field of video display, and specifically relates to a method for segmented display of video conference images based on dynamic optimization of multiple video signals. Background Art

[0002] The segmented display of video conference images refers to a method in video conferences of segmenting and presenting the images of participants on the same screen according to certain rules. Usually, the system divides the screen into multiple small windows according to the number of participants or specific display requirements, and each window displays the video images of one or more participants. This way allows all participants to see the images of other participants in the same interface, improving the interactivity and sense of participation. Common segmentation modes include grid layouts (such as 2x2, 3x3, etc.), and according to the conference scale and screen size, the system will automatically adjust the layout and resolution of the display windows to optimize the conference experience.

[0003] In the prior art, during a video conference, since the video conference images need to be switched multiple times, and currently a unified standard is adopted for video occupancy of large and small screens in video conference images, which not only causes waste of video resources, but also easily occupies video conference resources and leads to stuttering of video conference images. Therefore, the present invention proposes a method for segmented display of video conference images based on dynamic optimization of multiple video signals. Summary of the Invention

[0004] The purpose of the present invention is to propose a method for segmented display of video conference images based on dynamic optimization of multiple video signals to solve the problems raised in the above background art.

[0005] The technical problem to be solved by the present invention is as follows:

[0006] How to achieve dynamic optimization of video conference resolution based on multiple video signals.

[0007] To achieve the above purpose, the present invention adopts the following technical solutions:

[0008] A method for segmented display of video conference images based on dynamic optimization of multiple video signals, the method includes:

[0009] Step S1, obtaining the real-time bandwidth data of the user, and then analyzing the real-time bandwidth data to obtain the initial video conference resolution applicable to the real-time bandwidth data;

[0010] Step S2, formulating usage rules for the video conference room according to the users entering the video conference room;

[0011] Step S3, obtaining the usage rules of the video conference room and the upper limit bandwidth data, and adjusting the video resolution of the user using the video conference according to the usage rules of the video conference room;

[0012] Step S4: Obtain the real-time bit rate of the video stream corresponding to the main speaker user, and adjust the real-time bit rate of the main speaker user according to the detection result.

[0013] Furthermore, the real-time bandwidth data includes the real-time upload bandwidth, real-time download bandwidth, real-time packet loss rate, and real-time bit rate of the video stream when the user's device is connected to the Internet.

[0014] Furthermore, the step S1 includes the following sub-steps:

[0015] Obtain the real-time upload bandwidth, real-time download bandwidth, real-time packet loss rate, and real-time bit rate of the video stream when the user's device is connected to the Internet;

[0016] Calculate the bandwidth excellent value of the user's device;

[0017] When the bandwidth excellent value of the user's device is compared with the bandwidth excellent threshold, adjust the initial video conference resolution to the first resolution, the second resolution, or the third resolution.

[0018] Furthermore, the first bandwidth excellent threshold is greater than the second bandwidth excellent threshold, the second bandwidth excellent threshold is greater than zero, the first resolution is better than the second resolution, and the second resolution is better than the third resolution.

[0019] Furthermore, the video conference room includes a main speaker user and listening users. The main speaker user is any user in the video conference room, and the listening users are other users except the main speaker user.

[0020] Furthermore, the step S2 includes the following sub-steps:

[0021] When the video conference starts, count the number of all users entering the video conference room, adjust the screens of all users to the same number of small screens as the number of users according to the number of users, and at the same time adjust the screen resolution corresponding to the users to obtain the small screen resolution;

[0022] Set a fixed time interval. When the fixed time interval is reached, set the main speaker user in a fixed order;

[0023] Take the number of screens, the small screen resolution, the time interval, and the fixed order as the usage rules of the video conference room.

[0024] Furthermore, the upper limit bandwidth data of the video conference room includes the upper limit value of the real-time upload bandwidth, the lower limit value of the real-time upload bandwidth, the upper limit value of the real-time download bandwidth, and the lower limit value of the real-time download bandwidth of the video conference room.

[0025] Furthermore, the step S3 includes the following sub-steps:

[0026] After the user enters the video conference room, obtain the small screen resolutions of each small screen after the user's screen is evenly divided, and adjust the corresponding real-time bitrate according to the small screen resolutions of each small screen;

[0027] When any user is set as the host user, set the real-time download bandwidth of the host user to the lower limit value of the real-time download bandwidth of the video conference room. At the same time, obtain the real-time upload bandwidth of the host user, and compare the real-time upload bandwidth of the host user with the upper limit value of the real-time upload bandwidth of the video conference room;

[0028] If the real-time upload bandwidth of the host user is greater than or equal to the upper limit value of the real-time upload bandwidth of the video conference room, set the real-time upload bandwidth of the host user to the upper limit value of the real-time upload bandwidth of the video conference room; if the real-time upload bandwidth of the host user is less than the upper limit value of the real-time upload bandwidth of the video conference room, do not perform any operation;

[0029] Set the screen resolution corresponding to the host user according to the real-time upload bandwidth and the real-time download bandwidth;

[0030] When any user is set as the host user, set the real-time upload bandwidth of all listening users to the lower limit value of the real-time upload bandwidth of the video conference room. At the same time, obtain the real-time download bandwidth of the listening users, and compare the real-time download bandwidth of the listening users with the upper limit value of the real-time download bandwidth of the video conference room;

[0031] If the real-time download bandwidth of the listening users is greater than or equal to the upper limit value of the real-time download bandwidth of the video conference room, set the real-time download bandwidth of the listening users to the upper limit value of the real-time download bandwidth of the video conference room. If the real-time download bandwidth of the listening users is less than the upper limit value of the real-time download bandwidth of the video conference room, do not perform any operation;

[0032] Set the screen resolution corresponding to the listening users according to the real-time download bandwidth and the real-time upload bandwidth.

[0033] Furthermore, the adjustment process of the real-time bitrate is as follows:

[0034] When the user's screen is evenly divided into the first number of small screens, set the real-time bitrate of the video stream to the first real-time bitrate;

[0035] When the user's screen is evenly divided into the second number of small screens, set the real-time bitrate of the video stream to the second real-time bitrate;

[0036] When the user's screen is evenly divided into the third number of small screens, set the real-time bitrate of the video stream to the third real-time bitrate;

[0037] Among them, the first number is greater than the second number, the second number is greater than the third number, the first real-time bitrate is less than the second real-time bitrate, and the second real-time bitrate is less than the third real-time bitrate.

[0038] Further, the step S4 includes the following sub-steps:

[0039] Divide the fixed duration interval into consecutive time periods of the same length, and then record the endpoints of the consecutive time periods as time nodes;

[0040] Obtain the real-time bitrate corresponding to the main speaker user at each time node, and then calculate the average value of the real-time bitrates corresponding to the main speaker user within the fixed duration interval;

[0041] At the same time, calculate the standard deviation of the real-time bitrates corresponding to the main speaker user within the fixed duration interval;

[0042] Set the real-time bitrate fluctuation range of the main speaker user;

[0043] When the real-time bitrates corresponding to the main speaker user at all time nodes belong to the real-time bitrate fluctuation range, do not perform any operation;

[0044] When the real-time bitrate corresponding to the main speaker user at any time node does not belong to the real-time bitrate fluctuation range, record the number of time nodes corresponding to the real-time bitrate that does not belong to the real-time bitrate fluctuation range; if the number of time nodes corresponding to the real-time bitrate that does not belong to the real-time bitrate fluctuation range is greater than or equal to the quantity threshold, obtain the number of time nodes corresponding to the real-time bitrate greater than the maximum endpoint value of the real-time bitrate fluctuation range, denoted as the first number of time nodes, and at the same time obtain the number of time nodes corresponding to the real-time bitrate less than the minimum endpoint value of the real-time bitrate fluctuation range, denoted as the second number of time nodes; if the first number of time nodes is greater than the second number of time nodes, reduce the real-time bitrate of the user; if the first number of time nodes is less than or equal to the second number of time nodes, increase the real-time bitrate of the user.

[0045] In summary, due to the adoption of the above technical solutions, the beneficial effects of the present invention are:

[0046] The present invention first obtains the real-time bandwidth data of the user, then analyzes the real-time bandwidth data, analyzes and obtains the initial video conference resolution applicable to the real-time bandwidth data, and at the same time formulates the usage rules of the video conference room according to the users entering the video conference room. In the second step, it obtains the usage rules of the video conference room and the upper limit bandwidth data, adjusts the video resolution of the user using the video conference according to the usage rules of the video conference room, and finally also obtains the real-time bitrate of the video stream corresponding to the main speaker user, and adjusts the real-time bitrate of the main speaker user according to the detection result. The present invention realizes the dynamic optimization of the video conference resolution based on multiple video signals. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] For the convenience of those skilled in the art to understand, the present invention will be further described below with reference to the accompanying drawings.

[0048] Figure 1 is the method flow chart of the present invention;

[0049] Figure 2 is the method flow chart of the sub - steps corresponding to step S2 in the present invention;

[0050] Figure 3 is the structural schematic diagram of the computer device in the present invention. Detailed implementation manners

[0051] Next, the technical solution of the present invention will be clearly and completely described in conjunction with the embodiments. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the scope of protection of the present invention.

[0052] Embodiment 1: Please refer to Figure 1 and Figure 2 As shown, the technical solution provided by the present invention is: a video conference screen segmentation and display method based on dynamic optimization of multi - path video signals. This method is used to dynamically adjust the real - time video conference resolution of each user in the video conference room. The method is as follows:

[0053] Step S1, obtain the real - time bandwidth data of the user, and then analyze the real - time bandwidth data to obtain the initial video conference resolution applicable to the real - time bandwidth data;

[0054] It should be specifically noted that the real - time bandwidth data is the real - time upload bandwidth, real - time download bandwidth, real - time packet loss rate, and real - time code rate of the video stream when the device used by the user is connected to the Internet. Among them, the real - time code rate of the video stream is the code rate used when the user uploads the video stream, and the real - time code rate is less than the real - time upload bandwidth;

[0055] In this embodiment, step S1 includes the following sub - steps:

[0056] Step S11, obtain the real - time upload bandwidth SCD, real - time download bandwidth XZD, real - time packet loss rate DBL, and real - time code rate SSM of the video stream when the device used by the user is connected to the Internet;

[0057] Step S12, calculate the bandwidth excellent value YXZ of the device used by the user through the formula. The specific formula is as follows:

[0058] YXZ = (SCD + XZD + SSM) / (DBL + 1);

[0059] Step S13, when the bandwidth excellent value of the device used by the user is greater than the first bandwidth excellent threshold, adjust the initial video conference resolution to the first resolution;

[0060] When the excellent bandwidth value of the user's device is greater than the second excellent bandwidth threshold and less than or equal to the first excellent bandwidth threshold, adjust the initial video conference resolution to the second resolution;

[0061] When the excellent bandwidth value of the user's device is less than the second excellent bandwidth threshold, adjust the initial video conference resolution to the third resolution;

[0062] It should be specifically noted that the first excellent bandwidth threshold is greater than the second excellent bandwidth threshold, the second excellent bandwidth threshold is greater than zero, the first resolution is better than the second resolution, and the second resolution is better than the third resolution;

[0063] Exemplarily, the first resolution is 2560×1440, the second resolution is 1920×1080, and the third resolution is 1280×720.

[0064] Step S2, formulate the usage rules of the video conference room according to the users entering the video conference room;

[0065] It should be specifically noted that the video conference room includes a main speaker user and listening users. The main speaker user can be any user in the video conference room, and the listening users are other users except the main speaker user;

[0066] In this embodiment, the step S2 includes the following sub-steps:

[0067] Step S21, when the video conference starts, count the number of all users entering the video conference room, adjust the screens of all users to the same number of small screens as the number of users according to the number of users, and at the same time adjust the screen resolution corresponding to the users to obtain the small screen resolution;

[0068] Among them, if the number of users cannot be evenly divided, round up the number of users to the smallest evenly divisible number of quantity division values;

[0069] Exemplarily, when the screen resolution of the user is 1920×1080, if the number of users entering the video conference room is 4 users, divide the screen of the users into 2×2 small screens. At this time, there is no need to round up to a fixed quantity division value, and the resolution of each small screen is 960×540; if the number of users entering the video conference room is 7 users, at this time, the screen cannot be evenly divided, so round up to the smallest evenly divisible number of quantity division values. At this time, the quantity division value is 8, and the resolution of each small screen is 960×270; if the number of users entering the video conference room is 9 users, divide the screen of the users into 3×3 small screens. At this time, there is no need to round up to a fixed quantity division value, and the resolution of each small screen is 640×360;

[0070] Step S22, set a fixed time interval. When the fixed time interval is reached, set the main speaker user in a fixed order.

[0071] Specifically, the fixed order can be the time order corresponding to the users entering the video conference room or the order of the first letters of the pinyin of the users in the video conference room, etc.

[0072] Step S23, use the number of screens, the small screen resolution, the time interval, and the fixed order as the usage rules of the video conference room.

[0073] Step S3, obtain the usage rules and the upper limit bandwidth data of the video conference room, and adjust the video resolution of the users using the video conference according to the usage rules of the video conference room.

[0074] Specifically, the upper limit bandwidth data of the video conference room includes the upper limit value of the real-time upload bandwidth, the lower limit value of the real-time upload bandwidth, the upper limit value of the real-time download bandwidth, and the lower limit value of the real-time download bandwidth of the video conference room.

[0075] In this embodiment, step S3 includes the following sub-steps:

[0076] Step S31, when a user enters the video conference room, obtain the small screen resolution of each small screen after the user's screen is evenly divided, and adjust the corresponding real-time bitrate according to the small screen resolution of each small screen.

[0077] In this embodiment, step S31 includes the following sub-steps:

[0078] Step S311, when the user's screen is evenly divided into the first number of small screens, set the real-time bitrate of the video stream to the first real-time bitrate.

[0079] Step S312, when the user's screen is evenly divided into the second number of small screens, set the real-time bitrate of the video stream to the second real-time bitrate.

[0080] Step S313, when the user's screen is evenly divided into the third number of small screens, set the real-time bitrate of the video stream to the third real-time bitrate.

[0081] Among them, the first number is greater than the second number, the second number is greater than the third number, the first real-time bitrate is less than the second real-time bitrate, and the second real-time bitrate is less than the third real-time bitrate.

[0082] Step S32, when any user is set as the main speaker user, set the real-time download bandwidth of the main speaker user to the lower limit value of the real-time download bandwidth of the video conference room. At the same time, obtain the real-time upload bandwidth of the main speaker user, and compare the real-time upload bandwidth of the main speaker user with the upper limit value of the real-time upload bandwidth of the video conference room.

[0083] Wherein, when any user is set as the host user, the small screen of the host user is adjusted to fill the full screen for display. After the host user is adjusted to fill the full screen for a fixed time interval, the host user is adjusted to the small screen for display, and the next host user is selected in a fixed order, and the small screen of the host user is adjusted to fill the full screen;

[0084] Step S33, if the real-time upload bandwidth of the host user is greater than or equal to the upper limit value of the real-time upload bandwidth of the video conference room, set the real-time upload bandwidth of the host user to the upper limit value of the real-time upload bandwidth of the video conference room;

[0085] If the real-time upload bandwidth of the host user is less than the upper limit value of the real-time upload bandwidth of the video conference room, no operation is performed;

[0086] Step S34, set the screen resolution corresponding to the host user according to the real-time upload bandwidth and the real-time download bandwidth;

[0087] Step S35, when any user is set as the host user, set the real-time upload bandwidth of all listening users to the lower limit value of the real-time upload bandwidth of the video conference room, and at the same time obtain the real-time download bandwidth of the listening users, and compare the real-time download bandwidth of the listening users with the upper limit value of the real-time download bandwidth of the video conference room;

[0088] Step S36, if the real-time download bandwidth of the listening user is greater than or equal to the upper limit value of the real-time download bandwidth of the video conference room, set the real-time download bandwidth of the listening user to the upper limit value of the real-time download bandwidth of the video conference room;

[0089] If the real-time download bandwidth of the listening user is less than the upper limit value of the real-time download bandwidth of the video conference room, no operation is performed;

[0090] Step S37, set the screen resolution corresponding to the listening user according to the real-time download bandwidth and the real-time upload bandwidth;

[0091] Step S4, obtain the real-time bit rate of the video stream corresponding to the host user, and adjust the real-time bit rate of the host user according to the detection result;

[0092] In this embodiment, the step S4 includes the following sub-steps:

[0093] Step S41, divide the fixed time interval into continuous time periods of the same length, and then record the endpoints of the continuous time periods as time nodes i, i = 1, 2,..., n, where n is the upper limit value of the time nodes;

[0094] Step S42: Obtain the real-time bitrate SSMi of the main speaker user at each time node, and then calculate the average value PJZ of the real-time bitrate of the main speaker user within a fixed duration interval through the formula. The specific calculation process is as follows:

[0095]

[0096] Step S43: Calculate the standard deviation BZC of the real-time bitrate of the main speaker user within a fixed duration interval through the formula. The specific formula is as follows:

[0097]

[0098] Step S44: Set the real-time bitrate fluctuation range of the main speaker user. The real-time bitrate fluctuation range is specifically: [PJZ - 2×BZC, PJZ + 2×BZC];

[0099] Step S45: When the real-time bitrates of the main speaker user at all time nodes belong to the real-time bitrate fluctuation range, do not perform any operation;

[0100] Step S46: When the real-time bitrate of the main speaker user at any time node does not belong to the real-time bitrate fluctuation range, record the number of time nodes corresponding to the real-time bitrate that does not belong to the real-time bitrate fluctuation range;

[0101] Step S47: If the number of time nodes corresponding to the real-time bitrate that does not belong to the real-time bitrate fluctuation range is greater than or equal to the quantity threshold, obtain the number of time nodes corresponding to the real-time bitrate greater than the maximum endpoint value of the real-time bitrate fluctuation range, denoted as the first number of time nodes, and at the same time obtain the number of time nodes corresponding to the real-time bitrate less than the minimum endpoint value of the real-time bitrate fluctuation range, denoted as the second number of time nodes;

[0102] Step S48: If the first number of time nodes is greater than the second number of time nodes, reduce the real-time bitrate of the user;

[0103] If the first number of time nodes is less than or equal to the second number of time nodes, increase the real-time bitrate of the user.

[0104] In this application, if there are corresponding calculation formulas, the above calculation formulas are all dimensionless and take their numerical values for calculation. For the weight coefficients, proportionality coefficients, and other coefficients in the formulas, the values set are for quantifying each parameter to obtain a result value. Regarding the magnitudes of the weight coefficients and proportionality coefficients, as long as the proportional relationship between the parameters and the result value is not affected.

[0105] Embodiment 2: As Figure 3As shown in the figure, this embodiment provides a computer device, which may include: a processor, a communications interface, a memory, and a communication bus. Among them, the processor, the communication interface, and the memory complete communication with each other through the communication bus. The processor can call the logical instructions in the memory to execute a video conference screen segmentation display method based on dynamic optimization of multiplex video signals. The method includes: obtaining the real-time bandwidth data of the user, and then analyzing the real-time bandwidth data to obtain an initial video conference resolution applicable to the real-time bandwidth data; formulating the usage rules of the video conference room according to the users entering the video conference room; obtaining the usage rules of the video conference room and the upper limit bandwidth data, and adjusting the video resolution of the users using the video conference according to the usage rules of the video conference room; obtaining the real-time bit rate of the video stream corresponding to the main speaker user, and adjusting the real-time bit rate of the main speaker user according to the detection result.

[0106] In addition, when the logical instructions in the above-mentioned memory are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to enable a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of this application. The foregoing storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROMs), random access memories (RAMs), magnetic disks, or optical discs that can store program codes.

[0107] On the other hand, this application also provides a computer program product. The computer program product includes a computer program stored on a computer-readable storage medium. The computer program includes program instructions. When the program instructions are executed by a computer, the computer can execute the video conference screen segmentation display method based on dynamic optimization of multiplex video signals provided by the above-mentioned methods. The method includes: obtaining the real-time bandwidth data of the user, and then analyzing the real-time bandwidth data to obtain an initial video conference resolution applicable to the real-time bandwidth data; formulating the usage rules of the video conference room according to the users entering the video conference room; obtaining the usage rules of the video conference room and the upper limit bandwidth data, and adjusting the video resolution of the users using the video conference according to the usage rules of the video conference room; obtaining the real-time bit rate of the video stream corresponding to the main speaker user, and adjusting the real-time bit rate of the main speaker user according to the detection result.

[0108] In another aspect, the present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it is configured to execute the above-described video conference screen segmentation display method based on dynamic optimization of multiple video signals. The method includes: obtaining real-time bandwidth data of a user, and then analyzing the real-time bandwidth data to obtain an initial video conference resolution applicable to the real-time bandwidth data; formulating usage rules for a video conference room according to the users entering the video conference room; obtaining the usage rules of the video conference room and upper limit bandwidth data, and adjusting the video resolution used by the users for the video conference according to the usage rules of the video conference room; obtaining the real-time bit rate of the video stream corresponding to the main speaker user, and adjusting the real-time bit rate of the main speaker user according to the detection result.

[0109] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. A person of ordinary skill in the art can understand and implement it without creative effort.

[0110] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence, or the part that contributes to the prior art can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0111] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, and are not intended to limit them. Although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of each embodiment of the present application.

Claims

1. A video conference screen segmentation display method based on dynamic optimization of multi-channel video signals, characterized in that: Methods include: Step S1, obtaining the user's real-time bandwidth data, and then analyzing the real-time bandwidth data to obtain an initial video conference resolution suitable for the real-time bandwidth data; Step S2, formulating usage rules of the video conference room according to the users entering the video conference room; Step S3, obtaining the usage rules and upper bandwidth data of the video conference room, and adjusting the video resolution of the user's video conference according to the usage rules of the video conference room; Step S4, obtaining the real-time bit rate of the video stream corresponding to the main speaker, and adjusting the real-time bit rate of the main speaker according to the detection result.

2. The video conference screen segmentation display method based on dynamic optimization of multi-channel video signals according to claim 1 is characterized in that: Real-time bandwidth data includes the real-time upload bandwidth, real-time download bandwidth, real-time packet loss rate and real-time bit rate of the video stream when the user's device is connected to the Internet.

3. The video conference screen segmentation display method based on dynamic optimization of multi-channel video signals according to claim 2 is characterized in that: The step S1 includes the following sub-steps: Obtain the real-time upload bandwidth, real-time download bandwidth, real-time packet loss rate and real-time bit rate of the video stream when the user's device is connected to the Internet; Calculate the bandwidth optimal value of the device used by the user; When the bandwidth excellence value of the device used by the user is compared with the bandwidth excellence threshold, the initial video conference resolution is adjusted to the first resolution, the second resolution, or the third resolution.

4. The video conference screen segmentation display method based on dynamic optimization of multi-channel video signals according to claim 3 is characterized in that: The first bandwidth excellent threshold is greater than the second bandwidth excellent threshold, the second bandwidth excellent threshold is greater than zero, the first resolution is better than the second resolution, and the second resolution is better than the third resolution.

5. The video conference screen segmentation display method based on dynamic optimization of multi-channel video signals according to claim 1 is characterized in that: The video conference room includes a speaker and listeners. The speaker is any user in the video conference room, and the listeners are other users except the speaker.

6. The video conference screen segmentation display method based on dynamic optimization of multi-channel video signals according to claim 1 is characterized in that: The step S2 includes the following sub-steps: When a video conference starts, the number of users entering the video conference room is counted, and the screens of all users are adjusted to the same number of small screens as the number of users. At the same time, the screen resolutions of the users are adjusted to obtain the small screen resolutions. Set a fixed time interval. When the fixed time interval is reached, set the main speaker in a fixed order. Set the number of screens, small screen resolution, time interval, and fixed order as the usage rules of the video conference room.

7. The video conference screen segmentation display method based on dynamic optimization of multi-channel video signals according to claim 1 is characterized in that: The upper bandwidth limit data of the video conference room includes the real-time upload bandwidth upper limit value, the real-time upload bandwidth lower limit value, the real-time download bandwidth upper limit value, and the real-time download bandwidth lower limit value of the video conference room.

8. The video conference screen segmentation display method based on dynamic optimization of multi-channel video signals according to claim 7 is characterized in that: The step S3 includes the following sub-steps: When a user enters a video conference room, the resolution of each small screen after the user's screen is evenly divided is obtained, and the corresponding real-time bit rate is adjusted according to the resolution of each small screen; When any user is set as the main speaker, the real-time download bandwidth of the main speaker is set as the lower limit of the real-time download bandwidth of the video conference room, and the real-time upload bandwidth of the main speaker is obtained, and the real-time upload bandwidth of the main speaker is compared with the upper limit of the real-time upload bandwidth of the video conference room; If the real-time upload bandwidth of the main speaker is greater than or equal to the upper limit of the real-time upload bandwidth of the video conference room, the real-time upload bandwidth of the main speaker is set to the upper limit of the real-time upload bandwidth of the video conference room; if the real-time upload bandwidth of the main speaker is less than the upper limit of the real-time upload bandwidth of the video conference room, no operation is performed; Set the screen resolution corresponding to the presenter based on the real-time upload bandwidth and real-time download bandwidth; When any user is set as the main speaker, the real-time upload bandwidth of all the listening users is set to the lower limit of the real-time upload bandwidth of the video conference room, and the real-time download bandwidth of the listening users is obtained, and the real-time download bandwidth of the listening users is compared with the upper limit of the real-time download bandwidth of the video conference room; If the real-time download bandwidth of the lecturer is greater than or equal to the upper limit of the real-time download bandwidth of the video conference room, the real-time download bandwidth of the lecturer is set to the upper limit of the real-time download bandwidth of the video conference room; if the real-time download bandwidth of the lecturer is less than the upper limit of the real-time download bandwidth of the video conference room, no operation is performed; Set the screen resolution of the listening user according to the real-time download bandwidth and real-time upload bandwidth.

9. The video conference screen segmentation display method based on dynamic optimization of multi-channel video signals according to claim 8, characterized in that: The real-time bit rate adjustment process is as follows: When the user's screen is evenly divided into a first number of small screens, setting the real-time bit rate of the video stream to a first real-time bit rate; When the screen of the user screen is evenly divided into a second number of small screens, setting the real-time bit rate of the video stream to a second real-time bit rate; When the screen of the user screen is evenly divided into a third number of small screens, setting the real-time bit rate of the video stream to a third real-time bit rate; The first number is greater than the second number, the second number is greater than the third number, the first real-time bit rate is less than the second real-time bit rate, and the second real-time bit rate is less than the third real-time bit rate.

10. The video conference screen segmentation display method based on dynamic optimization of multi-channel video signals according to claim 1, characterized in that: The step S4 includes the following sub-steps: Divide the fixed time interval into continuous time segments of equal length, and then record the endpoints of the continuous time segments as time nodes; Obtain the real-time bit rate corresponding to the main speaker at each time node, and then calculate the average value of the real-time bit rate corresponding to the main speaker within a fixed time interval; At the same time, the standard deviation of the real-time bit rate corresponding to the main speaker within a fixed time interval is calculated; Set the real-time bit rate fluctuation range of the main speaker; When the real-time bitrate corresponding to the presenter at all time nodes is within the real-time bitrate fluctuation range, no operation is performed; When the real-time bit rate corresponding to the main speaker at any time node does not belong to the real-time bit rate fluctuation interval, the number of time nodes corresponding to the real-time bit rate that does not belong to the real-time bit rate fluctuation interval is recorded; if the number of time nodes corresponding to the real-time bit rate that does not belong to the real-time bit rate fluctuation interval is greater than or equal to the number threshold, the number of time nodes corresponding to the real-time bit rate greater than the maximum endpoint value of the real-time bit rate fluctuation interval is obtained, recorded as the first time node number, and at the same time, the number of time nodes corresponding to the real-time bit rate less than the minimum endpoint value of the real-time bit rate fluctuation interval is obtained, recorded as the second time node number; if the first time node number is greater than the second time node number, the user's real-time bit rate is reduced; if the first time node number is less than or equal to the second time node number, the user's real-time bit rate is increased.

Images