Multi-terminal intelligent scheduling method, system and equipment based on single meeting place of video conference and medium

Abstract

The invention discloses a multi-terminal intelligent scheduling method, system, device and medium based on a video conference single meeting place, and the method comprises the steps: configuring a corresponding number of terminal devices according to the number of display screens of a single meeting place, and binding each terminal device with a conference management control platform; pre-configuring the picture layout of the terminal equipment, and uploading pre-configured layout parameters to the cloud server; the display screen in the meeting place is connected to the corresponding terminal equipment; after all the terminal devices join the conference, the cloud server searches for pre-configured layout parameters matched with the terminal devices and issues the pre-configured layout parameters to all the terminal devices, and initialization drawing of an overall picture window is carried out; and the cloud server dispatches an on-screen picture of the display screen according to the real-time condition of the meeting place. According to the invention, the technical scheme of multi-terminal access and cloud server intelligent algorithm overall scheduling is adopted, and the problem that the existing technical scheme of single-terminal access or multi-terminal access on the market cannot realize non-repetitive pictures of participants on screens of a large number of meeting places is solved.

Description

Technical Field

[0001] The present invention belongs to the technical field of video conferencing, and in particular relates to a multi-terminal intelligent scheduling method, system, equipment and medium based on a single video conferencing venue. Background Art

[0002] Screen mirroring: refers to completely copying the screen content of a computer or mobile device to another display device, so that the same screen content is presented on each display device.

[0003] Split screen display: When a single conference device is connected to multiple display screens at the same time, each display screen displays different screen content.

[0004] Nowadays, online video conferencing uses advanced communication technology to break geographical restrictions, providing people with an efficient and convenient way of remote communication. It has become one of the indispensable tools in modern business and social activities.

[0005] When arranging some video conference room, especially large and medium-sized venues, sometimes the large screen in the center of the venue needs to display multiple different screen layouts at the same time, and other auxiliary display screens also need to display certain specific screen layouts respectively. The content of each screen should be as controllable as possible, with no duplication of the upper screen and a stable overall viewing experience.

[0006] For this scenario, the common solutions are as follows: 1. Use a single terminal device to join the meeting, and use screen mirroring or split-screen display. 2. Use multiple terminal devices to join the meeting, and different screen areas of the large screen or auxiliary screens respectively display the overall images of different terminal devices, so as to achieve the effect of combining the images of each device together for display.

[0007] However, these solutions do have their own defects to varying degrees: 1. When using a single terminal device solution: (1) The video conferencing software in many conference devices does not support split-screen display, but only supports single-screen display. In this case, the only way is to use screen mirroring to mirror the overall screen content on each display screen in the conference venue. This method has a single screen content and cannot meet the personalized needs of different displays for different screens; (2) Some device conference software supports split-screen display, but split-screen display requires software to customize the content displayed on each screen in the connected device. If the number of screens is large, it will lead to a huge development workload. On the other hand, it is not easy to flexibly and dynamically adjust the layout content of each screen. In addition, for devices that support split-screen display, when the number of conference member screens on a single screen is large (for example, a single screen needs to display a 5*5 25-grid screen), the more screens are connected, the more rendering resources are consumed. However, the machine performance of a single terminal device is limited, and it is easy to reach the performance bottleneck of a single device, resulting in the inability of a single terminal device to render and display more conference member screens while supporting multiple screens. It can only connect to a limited number of display screens, and the number of conference member screens on its single display screen must be controlled. 2. When using a multi-terminal device solution: When multiple terminal devices are connected to the same conference venue, the problem of different screens displaying different layouts can be solved. However, in many cases, the conference organizers expect the display images of each screen to be controllable to a certain extent, such as the images should not be repeated as much as possible, and the entire venue image should be kept as stable as possible when members join and leave the meeting, without multiple screens flashing and changing at the same time. However, the commonly used multi-terminal access solution cannot achieve the goal of non-repetitive images of participants on each screen when there are multiple display screens in a conference venue, because the display images of each terminal are maintained by each terminal. It is easy to have the image of a participant displayed on both screen A and screen B. Moreover, for the same conference room, if a member who is repeatedly displayed on multiple screens leaves the meeting or rejoins the meeting, it is easy for the images of multiple screens to flicker and switch, which is extremely unfriendly to the conference experience. Summary of the invention

[0008] In view of the deficiencies in the prior art, the present invention provides a multi-terminal intelligent scheduling method, system, device and medium based on a single video conference venue. The multi-screen images in a single venue can be freely customized and controlled at will. The multi-terminals are made to be the same terminal, and real-time scheduling can solve the problems of repeated display of multi-screen images, frequent switching of screens by participants entering and leaving the meeting frequently, and real-time early warning monitoring and processing of abnormal images and abnormal equipment performance can also be performed to ensure the overall stability of the venue images. Moreover, it can break through the upper limit of screens and equipment. There is no limit on the number of access display screens and access terminal devices in a single conference room venue, and they can be configured arbitrarily.

[0009] To achieve the above object, the present invention adopts the following technical solutions: A multi-terminal intelligent scheduling method based on a single video conference venue includes the following steps: According to the number of display screens in a single venue, a corresponding number of terminal devices are equipped, and each terminal device is bound to the conference management and control platform; the screen layout of the terminal device is pre-configured, and the pre-configured layout parameters are uploaded to the cloud server; Connect the display screen in the venue to the corresponding terminal device; After each terminal device joins the conference, the cloud server searches for pre-configured layout parameters that match the terminal device and sends them to each terminal device to initialize the overall window drawing; The cloud server schedules the upper screen of the display screen according to the real-time situation of the venue.

[0010] To optimize the above technical solutions, the specific measures taken also include: Furthermore, the binding of each terminal device to the conference management control platform is specifically as follows: Each terminal device generates its unique identification by adding its physical MAC address and device SN code, and enters the identification into the conference management and control platform to bind each terminal device one by one; The screen layout of the pre-configured terminal device is specifically as follows: On the conference management and control platform, each terminal device is configured with the highest priority layout and alternate layouts that the terminal device is expected to display. The layouts include single screen, two-half screen, four-quarter screen, 1+N screen and 2+N screen. The 1+N screen represents 1 large picture window and N small picture windows, and the 2+N screen represents 2 large picture windows and N small picture windows. The user ID that is expected to be displayed in each picture window in each layout is set separately, and the picture window screen filling rules are set. The filling rules include filling in sequence according to the order in which participants join the meeting.

[0011] Furthermore, the connecting of the display screen in the conference venue to the corresponding terminal device specifically includes: For the central large screen, multiple terminal devices are connected at the same time through the video matrix device, and the layout screen of each terminal device is placed at the set position of the central large screen; for a single auxiliary display screen, it is directly connected to the corresponding single terminal device.

[0012] Furthermore, the cloud server searches for pre-configured layout parameters matching the terminal device specifically as follows: The terminal device reports its unique identifier to the cloud server, and the cloud server uses the identifier to find pre-configured layout parameters that match the terminal device. The pre-configured layout parameters include the drawing coordinate position and window attributes of each window in the layout; the method of sending it to each terminal device is to send it through a signaling channel; the method of initializing the drawing of the entire window is to perform initialization drawing of the entire layout window according to the coordinates of each window in the pre-configured layout parameters.

[0013] Furthermore, the cloud server schedules the upper screen image of the display screen according to the real-time situation of the venue. The specific process is: When a terminal device joins the conference, the corresponding user ID to be subscribed to each window in the layout of the terminal device is calculated based on the pre-configured layout parameters of all the terminal devices currently joining the conference and the information of all the participants that have been displayed on the screen, combined with the layout parameter information expected by the terminal device, and the user ID is pushed to the terminal device that has just joined the conference through the signaling message channel. After receiving the user ID, the terminal device initiates a subscription to the user's video stream screen, and renders and displays it on the screen, so that the screen of the same user is not subscribed and displayed repeatedly on the same screen or on different screens; When a user enters a meeting, the cloud server first combines the pre-configured layout parameters of all terminal devices bound to the current meeting to calculate the terminal device that the user should display on the screen and the window position on the display screen, and then sends this position information to the corresponding terminal device through the signaling message channel. After the terminal device receives this signaling message, it renders the user's screen on the screen; the terminal device reports the screen status to the cloud server, and the screen status is used to mark whether the user's screen rendering is successful; the cloud server responds according to the screen status; if the screen status is successful, the cloud server maintains the current user status, if the screen status is failed, the cloud server selects a replacement user; When a terminal device A has joined the meeting and the window image in the layout is displayed on the screen, if the user of a window that is already on the screen exits the meeting, the terminal device reports the exit information to the cloud server in real time. The cloud server selects a list of users who are not currently displayed on the screen on all terminal devices, and sends the highest priority user ID that is not displayed on the screen to terminal device A according to the user priority configured for the meeting. After receiving this message, terminal device A renders the user's screen on the screen.

[0014] Furthermore, the cloud server selects the replacement user specifically as follows: Calculate the highest priority user ID in the current list of users not on the screen in the entire venue, push this user ID to the terminal device for the second time, and the terminal device will then replace the corresponding abnormally rendered window with this replacement user.

[0015] Furthermore, the multi-terminal intelligent scheduling method also includes user video stream abnormality warning and terminal device performance status monitoring; The specific process of the abnormal warning of the user video stream is as follows: If the user's video stream is detected to be abnormal, the abnormal information is reported to the cloud server, and the cloud server performs user replacement operations, and sends the highest priority replacement user information that is not on the screen to the terminal device, and the terminal device performs the on-screen replacement operation of the picture window image of the video stream abnormality; The specific process of the terminal equipment performance status monitoring is as follows: Each terminal device bound to the venue reports its own performance status in real time, including CPU usage and memory usage; If the cloud server detects that a terminal device has reached its own performance status upper limit, it will prioritize searching for the optimal layout with lower performance consumption from the pre-configured alternate layouts and push it to the terminal device. The terminal device will then replace the entire interface of the alternate layout. If the alternate layout is not configured or the performance of the terminal device has not returned to the normal range after the alternate layout takes effect, the cloud server will push an early warning message to the conference management and control platform to alert the venue support personnel to take appropriate measures.

[0016] The present invention also proposes a multi-terminal intelligent scheduling system based on a single video conference venue, comprising: a terminal device, a display screen, a conference management and control platform, and a cloud server; The terminal devices are all connected to the conference management and control platform, and the conference management and control platform is communicatively connected with the cloud server; Each of the terminal devices is bound to the conference management and control platform on the conference management and control platform, the conference management and control platform is pre-configured with a screen layout of the terminal device, and the conference management and control platform uploads the pre-configured layout parameters to the cloud server; The display screen is located in the conference room and connected to the corresponding terminal device, and is used to display the video conference layout and the video streams of the participating users; After each terminal device joins the conference, the cloud server searches for pre-configured layout parameters that match the terminal device, and sends them to each terminal device to perform initialization drawing of the overall picture window; The cloud server is used to schedule the upper screen image of the display screen according to the real-time situation of the venue.

[0017] The present invention also proposes an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the multi-terminal intelligent scheduling method based on a single video conference venue as described above is implemented.

[0018] The present invention also provides a computer-readable storage medium storing a computer program, wherein the computer program enables a computer to execute the multi-terminal intelligent scheduling method based on a single video conference venue as described above.

[0019] The beneficial effects of the present invention are: (1) In a scenario where a single conference room has multiple display screens that need to display different images respectively, the present invention adopts a technical solution of multi-terminal access and overall scheduling of cloud server intelligent algorithms, which effectively solves the problem that the existing single-terminal access or multi-terminal access technical solutions on the market cannot achieve non-repetitive images of participants on a large number of conference room screens.

[0020] (2) The conference multi-terminal intelligent algorithm system technical solution proposed in the present invention can achieve unlimited upper limit on the number of screens connected in a single conference room, and can be flexibly connected according to actual needs. Compared with the single-terminal multi-screen different display access solution on the market, it can save a lot of multi-screen layout customization development costs, and break through the bottleneck of the existing technology that can only access a limited number of screens and render a limited total number of pictures.

[0021] (3) The conference multi-terminal intelligent algorithm system technical solution proposed by the present invention can achieve any style change setting, real-time update and replacement of the overall screen layout on a single display screen, free configuration, and flexible change. Existing single-terminal or multi-terminal technical solutions cannot achieve this.

[0022] (4) The conference multi-terminal intelligent algorithm system technology proposed in this invention can achieve real-time monitoring of abnormal images in the conference room and early warning of machine performance, thereby performing real-time dynamic replacement of images, providing the conference room with a very good user experience. Existing single-terminal or multi-terminal technology solutions cannot achieve this. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 Pre-configured schematics for terminal device binding and layout; Figure 2 This is a schematic diagram of multiple terminal device screen access in a single venue; Figure 3 Unified scheduling flow chart for cloud server intelligent algorithms. DETAILED DESCRIPTION

[0024] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0025] Embodiment 1

[0026] The present invention proposes a multi-terminal intelligent scheduling method based on a single video conference venue, comprising the following steps: (1) Binding of terminal devices and pre-configuration of screen layout According to the number of display screens in a single conference room, a corresponding number of video conferencing terminal devices are equipped. The terminal device binding and layout pre-configuration diagram is as follows: Figure 1 As shown, each terminal device generates its unique identification using its physical MAC address + device SN code. Enter the identification into the conference management and control platform, and bind each terminal device one by one. Configure the highest priority layout and alternate layout (such as single screen, two-half screen, four-half screen, 1+N screen, 2+N screen, etc.) that we expect each terminal device to display on the conference management and control platform. 1+N screen means 1 large picture window and N small picture windows, 2+N screen means 2 large picture windows and N small picture windows, set the user ID that each picture window in this layout expects to display, or set specific picture window filling rules (such as filling in order according to the order in which participants join the meeting, etc., the rules can be freely customized).

[0027] (2) Terminal device screen access Connect each display screen in the venue to the corresponding terminal device according to the venue requirements. Figure 2 If it is a central large screen, multiple conference terminal devices can be connected at the same time through the video matrix device, and the layout screen of each conference terminal can be placed at the appropriate position of the large screen. If it is a single auxiliary display screen, it can be directly connected to the corresponding single conference terminal.

[0028] (3) Cloud server pre-configuration layout data is sent After each terminal device joins the conference, it reports its unique identifier to the cloud server. The cloud server matches its preset layout parameter information (the parameter information includes the corresponding drawing coordinate position, window attributes, etc. of each window in the layout) through the identifier, and sends the layout parameter information to each terminal through the signaling channel. After receiving the layout parameter information, the terminal initializes the drawing of the overall layout window according to the coordinates of each window in the parameter.

[0029] (4) Cloud server intelligent algorithm uniformly schedules the screen images Cloud server intelligent algorithm unified scheduling flow chart Figure 3 shown.

[0030] The cloud server stores and records the layout parameter information expected by all bound terminal devices.

[0031] 1. When a terminal device joins a meeting, based on the preset layout parameter information of all currently joined terminals and the information of all participants that have been displayed on the screen, combined with the layout parameter information expected by the terminal device, a real-time algorithm is used to deduplicate, calculate the corresponding user ID that each window in the terminal device layout should subscribe to, and push the user ID to the terminal device through the signaling message channel. After receiving the user ID, the terminal device initiates a subscription to the user's video stream and renders it on the screen. It is based on the coordinated scheduling of the cloud server algorithm that can achieve real-time deduplication and intelligent sorting of multiple terminal screens in the same conference room, ensuring that the same user's screen is not subscribed and displayed repeatedly on the same screen or on different screens.

[0032] 2. When a user enters a meeting, the cloud server first combines the preset layout information of all terminal devices bound to the current meeting, intelligently calculates the terminal device that should be on the screen and the window position on the terminal device, and then sends this position information to the corresponding terminal device through the signaling message channel. After the terminal device receives this signaling message, it renders the user's screen on the screen.

[0033] 3. When a terminal device A has joined the meeting and the window image in the layout is displayed on the screen, if the user of a window that is already on the screen exits the meeting, the terminal reports the exit information to the cloud server in real time. The cloud server algorithm screens and calculates a list of users who are not currently on the screen on all terminal devices, and pushes the highest priority user ID that is not on the screen to terminal device A according to the user priority configured for the meeting. After receiving this message, terminal device A renders the user's screen on the screen.

[0034] 4. When the terminal receives the screen signaling message sent by the cloud server and performs screen rendering for the specified user in the message, if the screen rendering is successful, the terminal needs to report the successful screen status to the cloud server; if the screen rendering is abnormal, the terminal also needs to report the abnormal status to the cloud server. The cloud server centrally maintains the information data of the screen status of each terminal device to provide accurate data support for subsequent algorithm operations. When the cloud server receives a message of abnormal screen rendering, it is necessary to perform a secondary algorithm filling operation to calculate the highest priority user ID in the list of users who are not on the screen in the entire venue, and push this user information to the terminal device for the second time. The terminal device then replaces the corresponding rendering abnormal window with this filling user and performs secondary screen rendering.

[0035] 5. When the terminal successfully completes the rendering of a user's screen in the corresponding window according to the signaling sent by the cloud server, if the terminal detects that the user's video stream screen is abnormal (such as black screen, green screen, flashing screen, etc.) during the ongoing meeting, the screen abnormality warning mechanism is triggered. The terminal reports the abnormal information to the cloud server, and the cloud server performs another algorithm filling operation, and sends the highest priority filling user information that is not on the screen to the terminal, and the terminal performs the on-screen replacement of the corresponding window screen.

[0036] 6. During the meeting, each terminal bound to the venue needs to report its own performance status (such as CPU occupancy, memory usage, etc.) to the cloud server in real time. If a terminal device reaches its own performance bottleneck during the meeting (which often causes abnormalities such as frame drops and freezes), the cloud server will monitor the reported information and trigger the intelligent control mechanism, and preferentially search for the optimal layout with lower performance consumption from the pre-configured alternate layouts, push it to the terminal, and the terminal will perform the overall replacement of the alternate layout interface to reduce the performance consumption of the machine and achieve a good venue experience. If the alternate layout is not configured or the machine performance has not returned to the normal range after the alternate layout takes effect, the cloud server will immediately push the warning information to the conference management and control platform to remind the venue support personnel to take corresponding measures (such as manually reconfiguring the new layout for the terminal and issuing a replacement).

[0037] Embodiment 2

[0038] The present invention proposes a multi-terminal intelligent scheduling system based on a single video conference venue corresponding to the method of embodiment 1, including: a terminal device, a display screen, a conference management and control platform, and a cloud server; The terminal devices are all connected to the conference management and control platform, and the conference management and control platform is communicatively connected with the cloud server; Each of the terminal devices is bound to the conference management and control platform on the conference management and control platform, the conference management and control platform is pre-configured with a screen layout of the terminal device, and the conference management and control platform uploads the pre-configured layout parameters to the cloud server; The display screen is located in the conference room and connected to the corresponding terminal device, and is used to display the video conference layout and the video streams of the participating users; After each terminal device joins the conference, the cloud server searches for pre-configured layout parameters that match the terminal device, and sends them to each terminal device to perform initialization drawing of the overall picture window; The cloud server is used to schedule the upper screen image of the display screen according to the real-time situation of the venue.

[0039] The implementation methods of each module and module function in the system are completely consistent with the steps of the method in Example 1, so they will not be repeated here.

[0040] Embodiment 3

[0041] The present invention proposes an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the multi-terminal intelligent scheduling method based on a single video conference venue as described in Example 1 is implemented.

[0042] Embodiment 4

[0043] The present invention provides a computer-readable storage medium storing a computer program, wherein the computer program enables a computer to execute the multi-terminal intelligent scheduling method based on a single video conference venue as described in the first embodiment.

[0044] In the embodiments disclosed in the present application, the computer storage medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or apparatus. The computer storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or equipment, or any suitable combination of the foregoing. More specific examples of computer storage media may include electrical connections based on one or more lines, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0045] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed in this application can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0046] The above are only preferred embodiments of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the present invention should be regarded as the protection scope of the present invention.

Claims

1. A multi-terminal intelligent scheduling method based on a single video conference venue, characterized in that: The following steps are involved: According to the number of display screens in a single venue, a corresponding number of terminal devices are equipped, and each terminal device is bound to the conference management and control platform; the screen layout of the terminal device is pre-configured, and the pre-configured layout parameters are uploaded to the cloud server; Connect the display screen in the venue to the corresponding terminal device; After each terminal device joins the conference, the cloud server searches for pre-configured layout parameters that match the terminal device and sends them to each terminal device to initialize the overall window drawing; The cloud server schedules the upper screen of the display screen according to the real-time situation of the venue.

2. The multi-terminal intelligent scheduling method based on a single video conference venue as claimed in claim 1, characterized in that: The binding of each terminal device to the conference management and control platform is specifically as follows: Each terminal device generates its unique identification by adding its physical MAC address and device SN code, and enters the identification into the conference management and control platform to bind each terminal device one by one; The screen layout of the pre-configured terminal device is specifically as follows: On the conference management and control platform, each terminal device is configured with the highest priority layout and alternate layouts that the terminal device is expected to display. The layouts include single screen, two-half screen, four-quarter screen, 1+N screen and 2+N screen. The 1+N screen represents 1 large picture window and N small picture windows, and the 2+N screen represents 2 large picture windows and N small picture windows. The user ID that is expected to be displayed in each picture window in each layout is set separately, and the picture window screen filling rules are set. The filling rules include filling in sequence according to the order in which participants join the meeting.

3. The multi-terminal intelligent scheduling method based on a single video conference venue as claimed in claim 1, characterized in that: The specific steps of connecting the display screen in the conference venue to the corresponding terminal device are as follows: For the central large screen, multiple terminal devices are connected at the same time through the video matrix device, and the layout screen of each terminal device is placed at the set position of the central large screen; for a single auxiliary display screen, it is directly connected to the corresponding single terminal device.

4. The multi-terminal intelligent scheduling method based on a single video conference venue as claimed in claim 1, characterized in that: The cloud server searches for pre-configured layout parameters that match the terminal device: The terminal device reports its unique identifier to the cloud server, and the cloud server uses the identifier to find pre-configured layout parameters that match the terminal device. The pre-configured layout parameters include the drawing coordinate position and window attributes of each window in the layout; the method of sending it to each terminal device is to send it through a signaling channel; the method of initializing the drawing of the entire window is to perform initialization drawing of the entire layout window according to the coordinates of each window in the pre-configured layout parameters.

5. The multi-terminal intelligent scheduling method based on a single video conference venue as claimed in claim 1, characterized in that: The specific process of the cloud server scheduling the upper screen image of the display screen according to the real-time situation of the venue is as follows: When a terminal device joins the conference, the corresponding user ID to be subscribed to each window in the layout of the terminal device is calculated based on the pre-configured layout parameters of all the terminal devices currently joining the conference and the information of all the participants that have been displayed on the screen, combined with the layout parameter information expected by the terminal device, and the user ID is pushed to the terminal device that has just joined the conference through the signaling message channel. After receiving the user ID, the terminal device initiates a subscription to the user's video stream screen, and renders and displays it on the screen, so that the screen of the same user is not subscribed and displayed repeatedly on the same screen or on different screens; When a user enters a meeting, the cloud server first combines the pre-configured layout parameters of all terminal devices bound to the current meeting to calculate the terminal device that the user should display on the screen and the window position on the display screen, and then sends this position information to the corresponding terminal device through the signaling message channel. After the terminal device receives this signaling message, it renders the user's screen on the screen; the terminal device reports the screen status to the cloud server, and the screen status is used to mark whether the user's screen rendering display is successful; The cloud server responds according to the status of the screen; If the status of the upper screen is that the upper screen rendering is successful, the cloud server maintains the current user status. If the status of the upper screen is that the upper screen rendering fails, the cloud server selects a replacement user. When a terminal device A has joined the meeting and the window image in the layout is displayed on the screen, if the user of a window that is already on the screen exits the meeting, the terminal device reports the exit information to the cloud server in real time. The cloud server selects a list of users who are not currently displayed on the screen on all terminal devices, and sends the highest priority user ID that is not displayed on the screen to terminal device A according to the user priority configured for the meeting. After receiving this message, terminal device A renders the user's screen on the screen.

6. The multi-terminal intelligent scheduling method based on a single video conference venue as claimed in claim 5, characterized in that: The cloud server selects the replacement user specifically as follows: Calculate the highest priority user ID in the current list of users not on the screen in the entire venue, push this user ID to the terminal device for the second time, and the terminal device will then replace the corresponding abnormally rendered window with this replacement user.

7. The multi-terminal intelligent scheduling method based on a single video conference venue as claimed in claim 1, characterized in that: The multi-terminal intelligent scheduling method also includes user video stream abnormality warning and terminal device performance status monitoring; The specific process of the abnormal warning of the user video stream is as follows: If the user's video stream is detected to be abnormal, the abnormal information is reported to the cloud server, and the cloud server performs user replacement operations, and sends the highest priority replacement user information that is not on the screen to the terminal device, and the terminal device performs the on-screen replacement operation of the picture window image of the video stream abnormality; The specific process of the terminal equipment performance status monitoring is as follows: Each terminal device bound to the venue reports its own performance status in real time, including CPU usage and memory usage; If the cloud server detects that a terminal device has reached its own performance status upper limit, it will prioritize searching for the optimal layout with lower performance consumption from the pre-configured alternate layouts and push it to the terminal device. The terminal device will then replace the entire interface of the alternate layout. If the alternate layout is not configured or the performance of the terminal device has not returned to the normal range after the alternate layout takes effect, the cloud server will push an early warning message to the conference management and control platform to alert the venue support personnel to take appropriate measures.

8. A multi-terminal intelligent scheduling system based on a single video conference venue, characterized in that: include: Terminal equipment, display screens, conference management and control platforms, and cloud servers; The terminal devices are all connected to the conference management and control platform, and the conference management and control platform is communicatively connected with the cloud server; Each of the terminal devices is bound to the conference management and control platform on the conference management and control platform, the conference management and control platform is pre-configured with a screen layout of the terminal device, and the conference management and control platform uploads the pre-configured layout parameters to the cloud server; The display screen is located in the conference room and connected to the corresponding terminal device, and is used to display the video conference layout and the video streams of the participating users; After each terminal device joins the conference, the cloud server searches for pre-configured layout parameters that match the terminal device, and sends them to each terminal device to perform initialization drawing of the overall picture window; The cloud server is used to schedule the upper screen image of the display screen according to the real-time situation of the venue.

9. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the multi-terminal intelligent scheduling method based on a single video conference venue as described in any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: The computer program enables the computer to execute the multi-terminal intelligent scheduling method based on a single video conference venue as described in any one of claims 1 to 7.

Images