Method, device and computer program for displaying an online conference interface
The same frame mode in online conferencing systems automatically positions video screens based on a frame background diagram, addressing inefficiencies in manual adjustment and enhancing the display experience.
Patent Information
- Application Number
- JP2024531475
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-03-01
- Filing Date
- 2022-11-28
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2042-11-28
AI Technical Summary
The current online conference interfaces require manual adjustment of video screens for participants, which is inefficient and lacks a systematic approach to position video screens in a way that meets the needs of specific conference scenes.
Implementing a same frame mode that generates a unified frame screen based on a frame background diagram, where video screens of different participants are positioned at specific locations, eliminating the need for manual adjustment.
This approach improves the efficiency of video screen positioning by automatically arranging participant screens in a way that meets the requirements of the conference scene, enhancing the display experience without manual intervention.
Smart Images

Figure 2024542601000001_ABST
Abstract
Description
[Technical field]
[0001] This application claims priority to a Chinese patent application bearing application number 202210194408.1, filed on March 1, 2022, for the invention entitled "Online conference interface display method, apparatus, medium, and computer program product", the entire contents of which are incorporated herein by reference. TECHNICAL FIELD The embodiments of the present application relate to the technical field of online conferences, and in particular to a method, apparatus, medium and computer program product for displaying an online conference interface. [Background technology]
[0002] With the continuous development of network and streaming media technology, online conferences have been born. Compared with traditional conferences, conference participants do not need to arrive at the designated conference location in advance, but can join online conferences at any location by using their terminals. A conference participant can request to join an online conference by inputting a conference number, and after turning on video access, various conference participant objects with video access turned on can all be displayed in grid mode in the online conference interface.
[0003] Apparently, in the current display method of an online conference interface, the video screen corresponding to each conference participating object is displayed independently, and the conference creator or conference moderator needs to manually adjust the display position of the video screen corresponding to each conference participating object as needed, and the efficiency of manual adjustment is low. Summary of the Invention
[0004] The embodiments of the present application provide an online conference interface display method, device, medium and computer program product.
[0005] In one aspect, an embodiment of the present application provides a method for displaying an online conference interface, the method being performed by a server, the method comprising: When the online conference is in a same frame mode, obtaining a frame background image of the online conference; Generate an identical frame screen based on the frame background map and the video screens of each conference participant object, where the video screens of different conference participant objects are displayed at different positions on the frame background map; and pushing the same frame screen to a client of the conference participant object so that the client displays the same frame screen in an online conference interface.
[0006] In another aspect, an embodiment of the present application provides a method for displaying an online conference interface, the method being executed by a terminal, the method including: Receiving a conference join operation used to trigger joining an online conference; When the online conference is turned on a same frame mode, display a same frame screen on the online conference interface, and the video screens of different conference participant objects on the same frame screen are displayed at different positions on the same frame background image. Display the same frame screen on the online conference interface; When video access is turned on, the video screen of the current conference participant object is displayed at a screen position of the frame background image within the same frame screen.
[0007] In another aspect, embodiments of the present application provide a display device for an online conference interface, the device comprising: When the online conference turns on the same frame mode, an acquisition module is used to acquire a frame background image of the online conference; a generating module for generating a same frame screen based on the frame background map and the video screens of each conference participant object, the video screens of different conference participant objects being displayed at different positions on the frame background map; and a push module for pushing the same frame screen to a client of the conference participation object so that the client displays the same frame screen on an online conference interface.
[0008] In another aspect, embodiments of the present application provide a display device for an online conference interface, the device comprising: a receiving module for receiving a conference join operation used to trigger joining an online conference; A display module for displaying a same-frame screen on the online conference interface when the online conference turns on a same-frame mode, and the video screens of different conference participant objects in the same-frame screen are displayed at different positions on the same frame background picture; The display module also displays the video screen of the current conference participant object at the screen position of the frame background diagram within the same frame screen when video access is turned on.
[0009] In another aspect, an embodiment of the present application provides a server including a processor and a memory, the memory storing at least one instruction to be loaded and executed by the processor to realize the method for displaying an online conference interface described in the above aspect.
[0010] In another aspect, an embodiment of the present application provides a terminal including a processor and a memory, the memory storing at least one instruction to be loaded and executed by the processor to realize the method for displaying an online conference interface described in the above aspect.
[0011] In another aspect, an embodiment of the present application provides a computer-readable storage medium, the computer-readable storage medium storing at least one memory that is loaded and executed by a processor to realize the method for displaying an online conference interface described in the above aspect.
[0012] In another aspect, an embodiment of the present application provides a computer program product, the computer program product including computer instructions stored in a computer-readable storage medium, a processor of a computing device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computing device to perform the method for displaying an online conference interface provided by the above aspect.
[0013] The beneficial effects brought about by the technical solutions provided by the embodiments of the present application at least include the following: In an embodiment of the present application, a uniform frame mode is provided in an online conference scene. After a client turns on the uniform frame mode, the video screen corresponding to each conference participating object can be displayed at different positions in the same frame background map, and the frame background map corresponds to the current online conference, which can meet the needs of specific positions in different online conference scenes, and the conference participating objects do not need to actively adjust the display positions in the online conference interface of the video screens corresponding to each conference participating object, thereby improving the efficiency of adjusting the display needs of specific positions of the video screens in online conference scenes. [Brief description of the drawings]
[0014] [Figure 1] 1 illustrates a system architecture of an online conference system provided by an exemplary embodiment of the present application. [Diagram 2] 2 illustrates a flowchart of a method for displaying an online conference interface provided by an exemplary embodiment of the present application. [Diagram 3]1 illustrates an interface diagram of an online conference interface according to an exemplary embodiment of the present application; [Figure 4] 4 illustrates a flowchart of a method for displaying an online conference interface provided by another exemplary embodiment of the present application. [Diagram 5] 1 illustrates a process for setting and using a frame background diagram according to an exemplary embodiment of the present application. [Figure 6] 4 illustrates a target location determination process according to an exemplary embodiment of the present application. [Figure 7] 13 illustrates a target location determination process according to another exemplary embodiment of the present application. [Figure 8] 4 illustrates a flowchart of a method for displaying an online conference interface provided by another exemplary embodiment of the present application. [Figure 9] 1 illustrates a business flow chart of a same-frame mode system according to an exemplary embodiment of the present application; [Figure 10] 1 illustrates a schematic diagram of an online conference interface provided by an exemplary embodiment of the present application; [Figure 11] FIG. 1 illustrates an interaction sequence diagram in same-frame mode as illustrated by an exemplary embodiment of the present application. [Figure 12] 2 illustrates a flowchart of a method for displaying an online conference interface provided by an exemplary embodiment of the present application. [Figure 13] 1 illustrates a schematic diagram of a process for displaying a same frame screen according to an exemplary embodiment of the present application; [Figure 14] 4 illustrates a flowchart of a method for displaying an online conference interface provided by another exemplary embodiment of the present application. [Figure 15] FIG. 1 illustrates a push interaction diagram of layout information provided by an exemplary embodiment of the present application; [Figure 16] FIG. 2 is a structural block diagram of a display device of an online conference interface provided by an exemplary embodiment of the present application; [Figure 17] FIG. 13 is a structural block diagram of a display device of an online conference interface provided by another exemplary embodiment of the present application. [Figure 18] FIG. 2 illustrates a structural diagram of a computer device provided by an exemplary embodiment of the present application; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0015] 1 shows a system architecture of an online conference system provided by an exemplary embodiment of the present application. The online conference system includes a terminal 110 and a server 120. Here, data communication is performed between the terminal 110 and the server 120 through a communication network, which can be a wired network or a wireless network, and can be at least one of a local area network, a metropolitan area network, and a wide area network.
[0016] The terminal 110 is an electronic device on which a conference client operates. Here, the conference client may be a desktop client or a web client, and the electronic device may be a smartphone, a tablet, a personal computer, a wearable device, or an in-vehicle terminal, etc. In FIG. 1, the terminal 110 is described as including a smartphone, a tablet, and a personal computer as an example, but is not limited thereto.
[0017] The server 120 may be an independent physical server, a server cluster or a distributed system consisting of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, Content Delivery Networks (CDNs), and big data and artificial intelligence platforms. In an embodiment of the present application, the server 120 may be a background server of a conferencing application.
[0018] In some embodiments, the server 120 is configured with services implementing different functions, and the different services may be configured on the same server or different servers. In one possible embodiment, to realize a warm-up function, the server 120 is configured with a conference layout service, a same-frame mode service, a conference control service, etc.
[0019] The main function of the conference layout service is to manage the layout, background image, and conference layout template in the conference. After a user joins a conference, inquiries, same frame layout settings, etc. are all managed by the conference layout service, and it also plays the role of conference control service, same frame mode service, and notification to clients.
[0020] The same frame mode service is used to control the participation of same frame mode robots in a conference after turning on the same frame mode, and is responsible for cutting and compositing multiple video user screens into a new screen, and can detect and process user video streaming data.
[0021] The main function of the conference control service is to manage users' participation in and leaving conferences, and notifications of changes to user status and layout-related data. When the layout of the same frame is turned on during a conference, the conference control service notifies the client of the conference participation object of that information via the conference layout service.
[0022] In this embodiment, after the terminal 110 turns on the same frame mode, a request to turn on the same frame mode is sent to the server 120, and the corresponding server 120 pushes ("sends", "push distributes") the generated same frame screen to each terminal 110.
[0023] In the following embodiments, the display of an online conference interface is applied to the online conference system shown in FIG. 1 as an example.
[0024] 2 shows a flowchart of an online conference interface display method provided by an exemplary embodiment of the present application. In this embodiment, the method is described as being applied to a server in the online conference system shown in FIG. 1, and the method includes the following steps:
[0025] In step 201, if the online conference turns on the same frame mode, obtain the frame background image of the online conference. Here, the frame background view is a screen layout for integrating video screens corresponding to different conference participating objects, and different online conference scenes can correspond to different frame background views; that is, the frame background view can be used to integrate the video screens of conference participating objects into the same conference scene, and in order to enable the frame background view to be arranged on the video screens of different conference participating objects, at least a number of seats are arranged on the frame background view, and the video screens of different conference participating objects are rendered on different seats; for example, taking the frame background view as an example when the frame background view is a classroom scene, the frame background view includes several classroom seats, and during the online conference, the video screens corresponding to different conference participating objects can be rendered on the seats of different classrooms, so that different conference participating objects can coexist in the same classroom scene, and the effect of holding a real conference in a classroom scene is realized.
[0026] In an online conference scene, each conference participation object can choose whether to turn on the same frame mode, and after the conference participation object decides to turn on the same frame mode, the corresponding server receives a request to turn on the same frame mode in the online conference and performs a step of turning on the frame mode and generating a subsequent same frame screen, and if the conference participation object does not turn on the same frame mode, the corresponding server does not perform a step of generating a subsequent same frame screen.
[0027] Alternatively, in an online conference, if there is a conference participation object that turns on the same frame mode, a same frame screen corresponding to the online conference interface of the conference participation object is displayed, and conversely, if a conference participation object does not turn on the same frame mode, the same frame screen is not displayed on the online conference screen of the conference participation object.
[0028] Optionally, when different conference participant objects select different frame background views and the server needs to generate a same frame screen with different frame background views, in order to avoid wasting the processing resources of the server, it can be set so that only a specific conference participant role can submit a frame background view selection request. The specific conference participant role may be a client with a moderator. Correspondingly, after the moderator turns on the same frame mode and selects a frame background view, the moderator's client can send a frame background view selection request to the server, and the frame background view selection request can include a conference participation identifier (the conference participation identifier is used to characterize a participating character) of a user corresponding to the moderator's client. If the server determines that the conference participant role is the moderator, it will obtain the frame background view included in the received frame background view selection request as the frame background view of the online conference.
[0029] In one possible embodiment, after a conference participation object joins an online conference, it can select whether to turn on the same frame mode, and after the conference participation object selects to turn on the same frame mode, the corresponding server receives a request to turn on the same frame mode for the online conference, and then further obtains a frame background view corresponding to the online conference.
[0030] For the process of obtaining the frame background picture, after joining an online conference, the conference participation object may select from a plurality of candidate frame background pictures, and the corresponding server may obtain the frame background picture selected by the conference participation object; the conference moderator object (conference creation object) may select from a plurality of candidate frame background pictures when creating a target online conference, and after the corresponding online conference is created, the server may also obtain a frame background picture corresponding to the online conference; optionally, the frame background picture may be a frame background picture customized for the online conference by the conference participation object (conference moderator object or conference creation object), and the corresponding server obtains a frame background picture corresponding to the online conference; optionally, the frame background picture may be a conference scene based on the online conference, and the server automatically selects an appropriate frame background picture for the online conference, the conference scene may be filled in when the conference creation object creates the online conference, and the server has pre-stored corresponding frame background pictures for different conference scenes, and after the online conference is created, a frame background picture appropriate for the online conference can be selected according to the conference scene corresponding to the online conference, but the embodiment of the present application does not limit the process of obtaining the frame background picture.
[0031] Taking the example of obtaining a frame background image of an online conference according to the conference scene of the online conference, if the conference scene set by the conference creation object when creating the conference is a debate scene, after receiving an online conference creation request, the server can obtain a frame background image suitable for the conference scene according to the debate scene in the online conference creation request.
[0032] Optionally, the server may store a plurality of candidate frame background maps in advance, which may be pre-developed and set by developers for different conference scenes. In the process of use, users are also allowed to customize new candidate frame background maps for subsequent use according to the needs of actual online conference scenes.
[0033] The frame background diagram is intended to provide an integrated display of video screens corresponding to different conference participating objects, and therefore includes at least a plurality of display positions so that different video screens can be displayed at different display positions.
[0034] Optionally, the frame background view may be stored on the server in the form of layout parameters, which may be stored in the form of json, and in one illustrative example, the layout parameters corresponding to the frame background view may be as shown in Table 1.
[0035] TIFF2024542601000002.tif69170
[0036] In this embodiment, the overall layout width in Table 1 is the image width corresponding to the frame background image, and the overall layout height is the image height corresponding to the frame background image. As shown in Fig. 3, the overall layout width and the overall layout height are both the height and width for rendering the same frame screen 302.
[0037] Since the frame background view is for integrating multiple conference participating objects, and a corresponding frame background view provides the display positions or seats where the video screens corresponding to different conference participating objects are placed, therefore, the layout parameters corresponding to the frame background view should also include information related to seats, such as seat information corresponding to each seat, seat number, seat order, seat type, seat position, size of the seat rectangle, distance of the seat rectangle, etc. Here, the seat number may be the seat ID corresponding to each seat, for example, the seat ID corresponding to the first seat may be 1, the seat order may be the order in which the current seat is located among all the seats included in the entire frame background picture, for example, if the seat number is 4, it indicates that the seat is the fourth seat in the frame background picture, the seat type indicates the image type that the seat displays, and can be classified into two types, one is a seat for rendering a video screen corresponding to a conference participation object, and the other is a seat for rendering other image screens of an online conference scene, that is, the seat of this type is not for displaying a video screen corresponding to a conference participation object, such as a classroom background screen of a classroom scene, the seat position is a display position for displaying the position of the seat in the entire frame background picture, for example, the seat position may be the position of the upper left corner of the seat in the frame background picture, the size of the rectangle of the seat is the size of the rectangular frame that the seat occupies in the frame background picture, and the distance of the rectangle of the seat is also the position of the seat from the top, bottom, left, right, and right frames of the frame background picture. As shown in FIG. 3, the same frame picture 302 includes different seats 303.
[0038] Optionally, the frame background map also includes image display positions provided for some dynamic display images in an online conference, and the dynamic display images are different from the video screens corresponding to the conference participating objects. Correspondingly, the layout parameters in the frame background map can also include information such as image information, image address, md5 information of the image and the seat number occupied by the screen, where the seat number occupied by the image is for displaying the dynamic display image at a specific seat number in the frame background map, for example, if the seat number occupied by the image is 4, the image is displayed at the fourth seat in the frame background map.
[0039] In step 202, a uniform frame screen is generated based on the frame background map and the video screens of each conference participant object, where the video screens of different conference participants objects are displayed at different positions on the frame background map.
[0040] When displaying video screens in an online conference interface in the related technology, unlike the video screens of different conference participating objects are randomly and independently displayed in the online conference interface, in the embodiments of the present application, a frame background view is provided, and the frame background view includes different display positions, and the video screen corresponding to each conference participating object can be displayed at different positions in the frame background view, so that the video screens of different conference participating objects are displayed in sequence in the same frame background view, and further, the same frame screen corresponding to different conference participating objects is generated to meet the display needs of the conference scene corresponding to a specific online conference.
[0041] With respect to the method of ordering and displaying conference participation objects at different positions in the frame background view, different conference participation objects can also be displayed according to a video access order, different conference participation objects can also be displayed according to a conference participation role, or different conference participation objects can also be displayed according to an object type, but the embodiments of the present application are not limited thereto. When generating the same frame screen, the video screen of each conference participating object is required, so after the video access of each corresponding conference participating object, the client of the conference participating object needs to upload the acquired video screen to the server so that the server can generate the same frame screen according to the video screen uploaded.
[0042] Alternatively, in the same online conference, some conference participant objects may not have the same frame mode turned on, and some conference participant objects may have the same frame mode turned on, but regardless of whether they have the same frame mode or not, they all need to upload their video screens so that the video screens corresponding to all conference participant objects are displayed in the frame background view.
[0043] In step 203, the same frame screen is pushed to the client of the conference participation object so that the client can display the same frame screen in the online conference interface.
[0044] In one possible embodiment, after the server generates a same-frame screen corresponding to each conference participation object, it can push the same-frame screen to a client corresponding to each conference participation object, and after the corresponding client receives the same-frame screen, it can display the same-frame screen in the online conference interface, thereby realizing the manifestation process of the online conference interface in the same-frame mode.
[0045] Optionally, when the server pushes the same frame screen to the client, there is no need to push the same frame screen to a conference participating object that does not have the same frame mode turned on in an online conference, and only the video screen of other conference participating objects other than the conference participating object in question needs to be pushed.
[0046] As shown in Fig. 3, it shows an interface schematic diagram of an online conference interface shown by an exemplary embodiment of the present application. The online conference interface 301 displays a same frame screen 302, and video screens corresponding to different conference participation objects in the same frame screen are displayed at different positions in a frame background picture (a frame background picture called a classroom), optionally, the frame background picture called a classroom includes multiple seat positions 303, and the server can display video screens corresponding to different conference participation objects at different seat positions 303 according to a preset rule, for example, the video screen (object screen) 304 corresponding to the conference participation object is displayed at the fifth position from the left in the first row.
[0047] To sum up, in the embodiment of the present application, a same frame mode is provided in an online conference scene. After a client turns on the same frame mode, the video screen corresponding to each conference participating object can be displayed at different positions in the same frame background map, and the frame background map corresponds to the current online conference, which can meet the needs of specific positions in different online conference scenes, and the conference participating objects do not need to actively adjust the display positions in the online conference interface of the video screens corresponding to each conference participating object, thereby improving the efficiency of adjusting the display needs of specific positions of the video screens in online conference scenes.
[0048] Since the display position in the frame background map is fixed, accurately displaying the video screens corresponding to different conference participating objects at specified positions and meeting the needs of each conference participating object is the key to further avoiding the conference participating objects from adjusting their video screens. Accordingly, in this embodiment, several display position determination methods are provided which can meet the user's conference participation needs to a certain extent.
[0049] 4 shows a flowchart of an online conference interface display method provided by another exemplary embodiment of the present application. In this embodiment, the method is described as being applied to a server in the online conference system shown in FIG. 1, and the method includes the following steps:
[0050] In step 401, if the online conference turns on the same frame mode, obtain the frame background image of the online conference.
[0051] In one possible embodiment, when an online conference turns on the same frame mode, a frame background view corresponding to the online conference can be selected online by the conference moderator object or the conference creation object, and a frame background view selection request can be sent to the server, and the corresponding server can obtain the frame background view corresponding to the online conference according to the received frame background view selection request.
[0052] Optionally, a frame background selection request is submitted by the moderator client to avoid multiple conference participant objects from selecting different frame backgrounds. In a corresponding exemplary example, step 401 may include step 401A and step 401B.
[0053] In step 401A, if the online conference turns on the same frame mode, a frame background picture selection request sent by a moderator client is received, where the frame background picture selection request includes a frame background picture used in the online conference. In order to adapt the frame background view corresponding to an online conference to the needs of the conference participating objects, in one possible embodiment, the frame background view corresponding to an online conference may be selected by a conference moderator object, or may be selected by a conference creation object, or may be selected by any conference participating object; illustratively, taking the frame background view selected by the conference moderator object as an example, when the online conference turns on the same frame mode, a frame background view selection interface may be displayed on the client interface of the conference moderator object, and multiple candidate frame background views are displayed in the frame background view selection interface; when the conference moderator object receives a selection operation for the target frame background view, the moderator client corresponding to the conference moderator object can send a frame background view selection request to the server, and the frame background view selection request includes at least an identifier corresponding to the frame background view selected by the conference moderator object; in response, the server receives the frame background view selection request sent from the moderator client, and can further determine the frame background view (target frame background view) to be used in the online conference according to the identifier in the frame background view selection request. In addition, the timing when the conference moderator object or the conference creation object selects the frame background view may be after creating an online conference, selecting the same frame mode, and providing a frame background view selection interface, or the selection may be made when the conference creation object creates an online conference and fills in the corresponding online conference information, but the embodiments of the present application are not limited to these.
[0054] In step 401B, a frame background picture of an online conference is obtained according to a frame background picture selection request.
[0055] In one possible embodiment, after a frame background view selection request sent from a moderator client is received by the server, i.e., according to the identifier corresponding to the (target) frame background view included in the frame background view selection request, the frame background view that needs to be used in the online conference can be searched and obtained from the frame background view library based on the identifier.
[0056] In order to provide a user with selectable frame background views, the server needs to store multiple selectable frame background views corresponding to the same frame mode in advance, and further, when a user uses the same frame mode function, the candidate frame background views are pushed to the client where the user is located, and the corresponding client can present the received candidate frame background views for the user to select a candidate frame background view.
[0057] Optionally, different candidate frame background views can be set for different meeting scenes, and when presenting the candidate frame background views to the user, the candidate frame background views that match the meeting scene can be presented to the user based on the meeting scene of the current online meeting, in order to reduce the time the user spends searching for an appropriate frame background view.
[0058] Optionally, to enable the server to push candidate frame background views to the client, the frame background view developer can pre-set layout parameters of various frame background views in the server. In a corresponding exemplary example, the process of setting a frame background view in the server can include the following steps.
[0059] 1. receiving a configuration request for a frame background map, the configuration request including layout parameters of the frame background map; Optionally, the server externally provides an interface or function that enables the user to set, add, or change the frame background map, so that the user can call up the interface during actual use to achieve the purpose of setting the frame background map. In one possible embodiment, a user can set a frame background view through a setting interface corresponding to an online conference, for example, adding a new frame background view and changing an existing frame background view. After completing the setting and saving the layout parameters, the client can send a frame background view setting request to the server, where the setting request includes the layout parameters of the set frame background view, and the corresponding server can receive the setting request for the frame background view sent from the client. Alternatively, when a user sets layout parameters corresponding to a frame background map, the user may do so via a specific setting page or via an online meeting APP, but the embodiments of the present application are not limited thereto. Optionally, the server allows an online conference developer to set layout parameters of the frame background view, and optionally further allows a user using the online conference APP to customize the frame background view or make changes to an existing frame background view and submit the layout parameters of the customized frame background view to the server.
[0060] 2. The layout parameters are associated with the same frame mode and saved, and a same frame screen using a frame background map is rendered based on the layout parameters. Optionally, after receiving a frame background view setting request sent by the client, i.e., obtaining layout parameters corresponding to the frame background view from the setting request, the server can further store the layout parameters in a specific memory area of the same frame mode, and when the same frame mode function is subsequently used, can render the corresponding frame background view based on the layout parameters.
[0061] As shown in Figure 5, it shows the process of setting and using a frame background diagram shown in an exemplary embodiment of the present application. The conference layout service 505 provides an HTTP interface to the outside, so that the user can call the web interface 503 via the APP 501 and the web page 502 to inquire the setting layout, and the conference control service 504 can push the layout to the APP 501 through the XMPP protocol after inquiring the layout from the conference layout service 505. During the display of the conference interface, the conference control service 504 and the conference layout service 505 can both interact with the same frame mode service 506 to realize the generation and pushing of the same frame screen.
[0062] In step 402, a screen position in the frame background diagram of the video screen corresponding to each conference participant object is determined. Since multiple (display) positions are provided in the frame background diagram, displaying the video screens of different conference participating objects at corresponding positions is the key to avoiding users from adjusting the video screens.In a corresponding possible embodiment, after the server determines the frame background diagram corresponding to the online conference, and when each conference participating object receives the uploaded video screen, it needs to determine the screen position in the frame background diagram of the video screen corresponding to each conference participating object, and then render the same frame screen.
[0063] In some conference scenes, the video access order of the conference participating objects has a certain regularity, for example, determined according to a specific online conference process or based on the importance of the conference participating objects, and correspondingly, the screen position (or display position) at which the video screen corresponding to each conference participating object is located in the frame background view is determined according to the video access order so that this regularity can also be shown in the same frame screen, and in an illustrative example, step 402 can include step 402A and step 402B.
[0064] In step 402A, a video access order of each conference participant object is obtained, where the video access order is the order in which each conference participant object turns on video access in the online conference.
[0065] In one possible embodiment, after a conference participation object turns on video access, the client of the conference participation object uploads the acquired video screen to the server, and correspondingly, the server can determine a corresponding video access order for each conference participation object to turn on video access in the online conference according to the start time of receiving the upload of the video screen of each conference participation object, and further determine a display position in the frame background view of the video screen corresponding to each conference participation object according to the video access order.
[0066] In step 402B, a target position in the frame background diagram of the video screen corresponding to each conference participant object is determined based on the video access order.
[0067] Optionally, the layout parameters corresponding to the frame background view may include a position order identifier for each position, which indicates a position where the video screen can be displayed. In a corresponding possible embodiment, after obtaining the video access order corresponding to each conference participation object, the server can determine the screen position in the frame background view of the video screen corresponding to each conference participation object according to the correspondence between the video access order and the position order identifier.
[0068] In an illustrative example, when the frame background view includes k display seats, and the video access order corresponding to the conference participation object is nth and corresponds to the nth position, the nth display seat can be determined as the screen position of the video screen corresponding to the conference participation object, where n is a positive integer less than or equal to k.
[0069] As shown in Fig. 6, it illustrates a screen position determination process illustrated by an exemplary embodiment of the present application. An identical frame screen 602 is displayed in an online conference interface 601, and when the video access order corresponding to the conference participation object is second, an object screen (video screen) 603 corresponding to the conference participation object is displayed in the second position from the left, and when the video access order corresponding to the conference participation object is third, an object screen (video screen) 604 corresponding to the conference participation object is displayed in the third position from the left.
[0070] In another possible application scenario, for example, in a two-way online debate, two-way online conference, etc., when it is necessary to display the role relationship of both or multiple parties in the online conference interface, in order to ensure that each conference participant object is displayed in the same frame in the online conference interface and to respectively show the role relationship between each conference participant object, in one possible embodiment, the server can determine the screen position of each conference participant object in the frame background diagram of its corresponding video screen according to the conference role in the target online conference. In another corresponding exemplary example, step 402 can further include step 402C and step 402D.
[0071] At step 402C, a conference participant identifier is obtained for each conference participant object, and the conference participant identifier is used by the conference participant object to characterize the conference role in the online conference. In one possible embodiment, a client corresponding to each conference participation object can upload a video screen to the server, and each conference participation object can further retain a conference participation identifier corresponding to a conference role in the online conference, so that the server can obtain the conference participation identifier corresponding to each conference participation object, and further determine the screen position to be displayed in the frame background view of the video screen according to the conference participation identifier.
[0072] Illustratively, taking an online debate as an example, the conference participant identifier of the conference participant object may be a negative debater, an affirmative debater, a moderator, and the like.
[0073] In step 402D, a screen position in the frame background diagram of the video screen corresponding to each conferencing object is determined based on the conferencing identifier.
[0074] Optionally, the layout parameters of the frame background view can further indicate the conference role corresponding to each display position, and in one possible embodiment, after the server obtains the conference participation identifier corresponding to each conference participation object, i.e., the conference participation object clarifies the conference role in the online conference, the screen positions in the frame background view of the video screen corresponding to each conference participation object can be further arranged according to the conference role, for example, the conference participation objects belonging to the same side are arranged on one side of the frame background view.
[0075] In one illustrative example, taking an online debate as an example, the conference participation objects belonging to the affirmative side debater can be displayed in the left area position of the frame background diagram, and the conference participation objects belonging to the negative side debater can be displayed in the right area position of the frame background diagram, and the conference participation objects belonging to the debaters on the same side can be displayed in the order of the person making the argument, the person making the questions, the person making the first rebuttal, etc. As shown in Figure 7, it shows a screen position determination process shown by another exemplary embodiment of the present application. An online conference interface 701 displays a same frame screen 702, and when the conference participation object is a councilor, after the conference participation object corresponding to the councilor accesses the online conference, a video screen 703 corresponding to the councilor is displayed at the position of the councilor; when the conference participation object is the second refuter of the affirmative side and it is determined that the conference participation object corresponding to the second refuter of the affirmative side has accessed the online conference, a video screen 704 corresponding to the second refuter of the affirmative side is displayed at the position of the second refuter of the affirmative side. Optionally, a function is provided for the user to independently select the determination method of the corresponding screen position. When the online conference creation object creates an online conference, if the online conference creation object is selected to turn on the same frame mode, multiple determination methods may be provided for the user to select, for example, the candidate determination methods include method 1 (determined according to the video access order), method 2 (determined according to the role of conference participation), method 3 (custom setting), etc., the conference creation object can select any determination method, and further, the server can automatically determine the corresponding screen position in the frame background diagram of each video screen according to the submitted determination method during the online conference. Optionally, if the determination method is method 2, after other conference participation objects participate in the online conference, the server can send a request to obtain the conference role to each conference participation object's client, so that each conference participation object obtains the conference role in the online conference. If the conference creation object selects method 1, each other conference participation object does not need to set the conference role when participating in the online conference.
[0076] In step 403, a uniform frame picture is generated based on the picture position and the video picture. In one possible embodiment, after the server determines a screen position in a frame background view of a video image corresponding to a newly accessed conference participant object, it can generate a rendered identical frame screen based on rendering of a displayed video screen at the screen position.
[0077] In step 404, the same frame screen is pushed to the client corresponding to the conference participation object, so that the client displays the same frame screen in the online conference interface.
[0078] The embodiment of step 404 can refer to the above embodiment, and the description thereof will be omitted in this embodiment. Optionally, the conference participant object can be positioned relative to each video screen in the same frame screen.
[0079] If the same frame screen generated by the server according to the above positioning rules does not meet the needs of the conference participating objects, in one possible embodiment, the server also provides a function for the conference participating objects to adjust the display position of each video screen in the same frame screen by themselves.
[0080] Here, the process of adjusting each display position in the same frame screen may include the following steps 3 and 4.
[0081] In step 3, the moderator client receives a position adjustment command for the video screen in the same frame screen. In order to allow each conference participating object to adjust the same frame screen and avoid the same frame screen being relatively crowded, in one possible embodiment, it is set to allow the conference moderator object or the conference creation object to have the authority to adjust the position of each video screen in the same frame screen, and correspondingly, when the conference moderator object has an adjustment need for the display position of a video screen in the same frame screen, it can drag the video screen and move it to the position that needs to be adjusted, and the moderator client receives the position adjustment operation for the video screen and sends a position adjustment command to the server, and the corresponding server receives the position adjustment command for the video screen in the same frame screen from the moderator client, and the position adjustment command includes the object identifier of the conference participating object corresponding to the video screen that needs to be adjusted and the adjusted screen position identifier.
[0082] In step 4, the same frame screen is updated based on the position adjustment command, and the updated same frame screen is pushed to the client of the conference participant object. Optionally, after the server receives the position adjustment command, it can update the screen position in the frame background view of the video screen indicated by the object identifier and the screen position identifier included in the position adjustment command, generate an updated identical frame screen, and push the updated identical frame screen to clients corresponding to other conference participating objects. In this embodiment, the screen position in the frame background diagram of the video screen corresponding to each conference participation object can be determined according to the video access order corresponding to the conference participation object or the conference role corresponding to the conference participation object, and each conference participation object can be displayed in the same frame background diagram, so that the needs of the conference scene corresponding to the online conference can be compatible, and the adjustment operation of the conference participation object to the display position of the video screen can be reduced.
[0083] In one possible application scenario, when the same frame mode is turned on, the server can generate a virtual robot, make the virtual robot participate in an online conference, and further process the video streaming of the conference participating objects received by the virtual robot so as to generate a same frame screen.
[0084] Please refer to Fig. 8, which shows a flowchart of an online conference interface display method provided by another exemplary embodiment of the present application. In this embodiment, the method is described as being applied to a server in the online conference system shown in Fig. 1, and the method includes the following steps:
[0085] In step 801, if the online conference has the same frame mode turned on, a conference virtual object is generated. In the same frame mode, a conference robot (conference virtual object) function is introduced, and the conference virtual object is used to generate a same frame screen corresponding to an online conference. In one possible embodiment, after an online conference turns on same-frame mode, the server creates a conference virtual object corresponding to the online conference.
[0086] In step 802, a conference virtual object is added to an online conference. The conference virtual object provides services for the generation process of a uniform frame screen. In order to enable the conference virtual object to obtain the video screen corresponding to each conference participant object, the conference virtual object needs to be added to the online conference, and in one possible embodiment, after the server creates the conference virtual object, the server initiates a request to add to the conference, and in response to the request to add to the conference, the conference virtual object is added to the online conference. As shown in FIG. 9, it shows a business flow chart of the same frame mode system shown by an exemplary embodiment of the present application. After a user turns on the same frame mode, when the same frame mode business service (server) receives a request to turn on the same frame mode, it puts the task of turning on the same frame mode into a task storage queue, and occupies the task by the conference robot. After the conference robot occupies the same frame mode task, the same frame mode robot service controls the conference robot to enter the conference media room corresponding to the online conference according to the request parameters in the task, and performs the subsequent rendering generation process of the same frame screen. As can be seen from the above, different conference robots correspond to different target online conferences, that is, the same frame mode task corresponding to the same online conference can only obtain one conference robot service. Optionally, the user's camera on / off queue can also be sent to the same frame mode business service to generate the same frame screen later.
[0087] In step 803, the frame background image of the online conference is obtained by the object service of the conference virtual object. In one possible embodiment, after a conference virtual object (conference robot) joins an online conference, a subsequent identical frame screen generation process can be performed by an object service corresponding to the conference virtual object, and a frame background view corresponding to the online conference is obtained by the object service accordingly.
[0088] In step 804, the video screen of each conference participant object is pulled by the object service. Optionally, after the server receives the video streaming uploaded by each conference participating object, the corresponding object service also pulls the video screen of each conference participating object from the server.
[0089] In step 805, a uniform frame screen is generated by the object service based on the frame background picture and the video screen. Optionally, after the object service obtains the video screen of each conference participant object and the frame background picture of the online conference, it can generate the same frame screen according to the frame background picture and the video screen. Here, the process of generating the same frame screen based on the frame background picture and the video screen can be referred to in the above embodiment, and the description thereof will be omitted in the embodiment of the present application. Alternatively, in the above embodiments, the video screen corresponding to each conference participating object is displayed on the frame background diagram as an example. In other possible embodiments, when there are many conference participating objects, it is possible to select to display video screens corresponding to some conference participating objects on the same frame background diagram according to the conference role of each conference participating object, and to display video screens corresponding to other conference participating objects independently on the periphery (surroundings) of the frame background diagram. In an exemplary embodiment, the process of generating a same frame screen based on the frame background and the video screen corresponding to each conference participant object may further include the following steps 5-7. In step 5, a conference participant identifier of each conference participant object is obtained, which is used to characterize the conference role of the conference in the online conference. The conference role characterizes the importance and necessity of the conference participant object, for example, for an online debate, the importance of the council member is obviously lower than the importance of each debater, and the video screen of each debater may be preferentially displayed on the frame background diagram. So, in one possible embodiment, according to the conference role of each conference participant object in the online conference, it can be determined whether to display the corresponding video screen on the frame background diagram, and the corresponding server needs to obtain the conference participant identifier corresponding to each conference participant object.
[0090] In step 6, each conference participant object is divided into a first object set and a second object set based on the conference participant identifier. In one possible embodiment, based on the conference role of each conference participation object indicated by the conference participation identifier, each conference participation object is divided into a first object set and a second object set based on whether the conference role needs to be displayed in the frame background diagram, where the conference participation objects included in the first object set are objects that need to be displayed in the same frame background diagram, and the conference participation objects included in the second object set are objects that do not need to be displayed in the frame background diagram. Taking an online debate as an example, the moderator and council members may belong to a second set of objects, and each debater may belong to a first set of objects.
[0091] In step 7, the video screens of the conference participating objects in the first object set are displayed on the frame background diagram, and the video screens of the conference participating objects in the second object set are displayed around the frame background diagram to generate a uniform frame screen. Since the importance of the conference participating objects included in the first object set is higher than the importance of the conference participating objects included in the second object set, in one possible embodiment, the video screens corresponding to the first object set are preferentially displayed in the same frame background diagram, and the video screens corresponding to the object sets are displayed independently on the periphery (surroundings) of the frame background diagram, thereby generating the same frame screen. Optionally, the division criteria for the first and second object sets may also be customized and divided by the conference creator object or the conference moderator object. As shown in Figure 10, it shows a schematic diagram of an online conference interface shown by an exemplary embodiment of the present application. Taking online debate as an example, the online conference interface 1001 displays video screens corresponding to each conference participant object, where the video screen 1004 of the conference participant object whose role is debater is displayed in the same frame screen 1002, the video screen 1003 of the conference participant object whose role is councilor is displayed around the same frame screen 1002, and the video screens of councilor 1, councilor 2 and the moderator are displayed independently.
[0092] In step 806, the same frame screen is pushed to the client corresponding to the conference participation object so that the client displays the same frame screen in the online conference interface.
[0093] The embodiment of step 806 can refer to the above embodiment, and the description thereof will be omitted in this embodiment. As shown in Figure 11, it shows an interaction sequence diagram in the same frame mode shown by an exemplary embodiment of the present application. After the client 1101 turns on the same frame mode, it sends a request to turn on the same frame mode to the conference layout system 1102, after the conference layout system 1102 receives the request to turn on the same frame mode, it notifies the same frame mode system 1103 to start the conference robot, after the same frame mode system 1103 successfully starts the conference robot, it feeds back the result of the invocation by the conference layout system 1102 to the client 1101, and after the processing is successful, it calls back the layout service, correspondingly, the conference layout system 1102 can push a notification message (the notification message can include the entry and exit of the conference participant object, the state of the conference participant object and the layout change message) to the client through the conference control system 1104, and the conference control system 1104 of the conference can push a message through the xmpp transmission protocol 1105, and the client 1101 can extract the layout parameter information from the conference layout system 1102. In this embodiment, by introducing a conference virtual object into the same-frame screen generation process, it is possible to ensure that different online conferences can cope with the interference of the same-frame screen generation process, thereby ensuring the normal execution of the same-frame task; and by displaying some conference participating objects in the same frame background map, it is possible to avoid the situation where there are too many conference participating objects to be matched to the appropriate frame background map.
[0094] In the above embodiment, the method for generating a uniform frame screen was explained mainly from the viewpoint of the server side, but in this embodiment, the method for displaying an online conference interface will be explained from the viewpoint of a client corresponding to a conference participation object.
[0095] Please refer to Figure 12, which shows a flowchart of an online conference interface display method provided by an exemplary embodiment of the present application. In this embodiment, the method is described as being used in a terminal in the online conference system shown in Figure 1, and the method includes the following steps:
[0096] At step 1201, a conference join operation is received that is used to trigger joining an online conference. In some embodiments, the join conference operation refers to inputting a conference number into a client to join an online conference, where the conference number is used as a unique identifier of the online conference. Optionally, after receiving the conference access operation, the terminal sends a conference participation request to the server to request participation in the online conference, where the conference access request includes at least the conference number of the online conference and a client account (used to determine the identity of the conference participation object). Illustratively, as shown in FIG. 13, which illustrates a schematic diagram of a process of displaying a single frame screen according to an exemplary embodiment of the present application, a user can trigger participation in an online conference by inputting a conference number and entering a name in a conference participation interface 1301 of a client, and then clicking a conference participation control 1302.
[0097] In step 1202, if the online conference turns on the same frame mode, display the same frame screen on the online conference interface, and display the video screens of different conference participating objects in the same frame screen at different positions on the same frame background diagram.
[0098] In one possible embodiment, after a user joins an online conference, he or she can choose whether to turn on the same frame mode, and after choosing to turn on the same frame mode, the online conference interface will display the same frame screen; conversely, if the user chooses not to turn on the same frame mode, the online conference interface will not display the same frame screen, but will display each independently displayed video screen.
[0099] As shown in FIG. 13, after a user triggers the conference participation control 1302, an online conference interface 1303 can be displayed, in which presentation information 1304 is displayed, which is used to suggest whether to turn on the same frame mode, and by clicking the confirmation control 1305, the same frame mode can be triggered to be turned on, in response to which a same frame screen 1306 is displayed in the online conference interface 1303.
[0100] In step 1203, if the video access is turned on, the video screen of the current conference participant object is displayed at the screen position of the frame background diagram in the same frame screen. In one possible embodiment, after joining an online conference, a user can also choose whether to turn on video access, and after the user turns on video access and provides that same frame mode is turned on, a video screen corresponding to the current conference participating object is displayed at the screen position of the frame background view in the same frame screen. Alternatively, the screen position in the frame background view of the video screen corresponding to the current conference participation object may be determined by the video access order of the current conference participation object, or by the conference participation identifier (characterizing the role of the conference) of the current conference participation object, or by a setting operation of the conference creation object or the conference moderator object. As shown in FIG. 13, when a user requires video access, the video access can be triggered by a video access control 1307 in the online conference interface 1303, and if the role of the conference corresponding to "User A" is the second affirmative rebuttal, a video screen 1308 corresponding to "User A" is displayed at the position of the second affirmative rebuttal on the same frame screen 1306. Here, the specific process of generating the same frame screen can be referred to in the above embodiment, and the description thereof will be omitted in this embodiment. To sum up, in the embodiment of the present application, a same frame mode is provided in an online conference scene. After a client turns on the same frame mode, the video screen corresponding to each conference participating object can be displayed at different positions in the same frame background map, and the frame background map corresponds to the current online conference, which can meet the needs of specific positions in different online conference scenes, and the conference participating objects do not need to actively adjust the display positions in the online conference interface of the video screens corresponding to each conference participating object, thereby improving the efficiency of adjusting the display needs of specific positions of the video screens in online conference scenes.
[0101] The screen position in the frame background of the video screen of the current conference participant object is made to match the user's desire, for example, to match the user's conference role. In one possible embodiment, the current conference participant object can preset its conference role in the online conference and submit it to the server, and the corresponding server can display the corresponding video screen at a screen position matching the conference role according to the conference role of the current conference participant object. Please refer to Figure 14, which shows a flowchart of an online conference interface display method provided by another exemplary embodiment of the present application. In this embodiment, the method is described as being used in the terminal in the online conference system shown in Figure 1, and the method includes the following steps:
[0102] At step 1401, a conference join operation is received that is used to trigger joining an online conference. The embodiment of step 1401 can refer to the above embodiment, and the description thereof will be omitted in this embodiment. In step 1402, presentation information for presenting whether or not to turn on the same frame mode is displayed.
[0103] In one possible embodiment, after a user joins an online conference, presentation information can be automatically displayed and used to present the user with whether or not to turn on same frame mode, and the user can decide whether or not to turn on same frame mode by confirming or rejecting the presentation information. Optionally, a same-frame mode control may be provided in the online conference interface, and a user may decide to turn on same-frame mode by turning on the same-frame mode control, or decide to turn off same-frame mode by turning off the same-frame mode control.
[0104] In step 1403, in response to a confirmation operation on the presented information, a layout parameter acquisition request used to request layout parameters of the same frame screen is transmitted to the server. In one possible embodiment, when a user decides to turn on the same frame mode, he or she can click a confirmation control corresponding to the presentation information, and the corresponding terminal receives the confirmation operation for the presentation information, decides to turn on the same frame mode, and sends a layout parameter acquisition request for the same frame screen corresponding to the same frame mode to the server to obtain layout parameters, thereby displaying the same frame screen based on the layout parameters.
[0105] In step 1404, the layout parameters pushed by the server are received, and the same frame screen is displayed on the online conference interface based on the layout parameters. Alternatively, after the server receives a layout parameter acquisition request sent from the client, if the conference participation object does not turn on video access for a certain period of time, the server can only feed back the layout parameters of the frame background image corresponding to the online conference to the terminal; if the conference participation object turns on video access, the server can feed back the layout parameters of the generated identical frame screen to the terminal, so that the identical frame screen can be displayed on the online conference interface according to the layout parameters after the terminal receives the layout parameters.
[0106] As shown in Figure 15, it shows a layout information push interaction diagram shown by an exemplary embodiment of the present application. Here, the conference control system 1502 and the conference layout system 1501 are both servers, when the conference layout system 1501 receives a request to turn on the same frame mode, the conference control system 1502 pushes the conference layout change to the client 1503, so that the corresponding client 1503 receives the conference layout change, and further inquires the conference control system 1502 about the detailed information of the changed conference layout, and at the same time, the conference layout system 1501 feeds back the inquired conference layout to the conference control system 1502, thereby feeding back to the client 1503, and the corresponding client 1503 displays the same frame layout in the online conference interface according to the detailed information of the inquired conference layout. Optionally, the conference layout system 1501 is used to manage the layout function of the entire online conference, and when each online conference is started, the conference layout system 1501 is queried to obtain the layout information of the conference. The same frame mode in this embodiment belongs to a special conference layout of the online conference. Optionally, the conference layout system 1501 also provides modification, query and layout resetting functions to the outside. When a user turns on the same frame mode, first obtain all the layout information by querying the layout interface ClientQueryStoreLayoutV2. When a same frame mode is selected, the change layout ClientSelectStoreLayoutV2 interface of the layout system is called from the client, which is used to apply a certain layout information to the same frame mode. When a certain layout information is cancelled, the ResetLayoutV2 interface is called to cancel a certain layout information. Alternatively, the conference control system 1502 is mainly a conference management system. It mainly includes functions such as conference management, message push, etc. The functions related to this embodiment are two functions: layout information push function of online conference and conference layout robot. Here, the layout information push instructs that after the conference layout module sets the layout, the layout module triggers a conference layout change message, and the conference control system 1502 pushes the message to the client, and then processes the client's inquiry detail layout function. In the conference robot function, after turning on the same frame mode, the robot initiates a conference participation request, and the conference control background receives the robot's conference participation request and updates the robot member cache; if the robot successfully participates in the media room, the robot side initiates a notify request to the conference control background and notifies the conference control background that it has successfully participated in the media room; after receiving the notify request, the conference control side pushes the users already in the conference to the robot side, and also pushes the robot to other users in the conference, thereby completing the overall flow of the robot's conference participation. The robot successfully joins the conference, plays the role of video streaming cut and composite multiple video user screens into a new screen, and can detect and process user data.
[0107] In step 1405, if video access is turned on, upload the video streaming of the current conference participant object, including the video screen of the current conference participant object, to the server. In one possible embodiment, when a user turns on video access, the client collects a video screen of the current conference participant object via a camera, and encapsulates the collected video screen into a video stream so as to upload the video streaming of the current conference participant object to the server.
[0108] In step 1406, the server receives the pushed uniform frame screen, and displays the video screen of the current conference participant object at the screen position of the frame background image, and the uniform frame screen is generated based on the video screen and the frame background image. Optionally, after the server receives the video streaming of the current conference participating object, it analyzes the video streaming, obtains the video screen of the current conference participating object, and further determines the display position (screen position) of the video screen corresponding to the conference participating object in the frame background diagram, displays the video screen at the screen position, generates an updated identical frame screen, and pushes the updated identical frame screen to a client corresponding to each conference participating object, so that the terminal (client) can display the video screen of the current conference participating object at the screen position of the frame background diagram according to the identical frame screen pushed from the server. Optionally, it is determined to correspond to a screen position in a frame background view corresponding to the conference participation object in the above embodiment, and the screen position in the frame background view of the video screen corresponding to the current conference participation object may be a corresponding position in the frame background view of the video access order corresponding to the current conference participation object, the screen position may be a position corresponding to the frame background view of the conference role in the online conference of the current conference participation object, and the screen position may be a position set by the conference moderator object in the online conference. For the case where the screen position is set according to the conference role corresponding to the current conference participation object, in one possible embodiment, when the online conference turns on the same frame mode, the conference participation object needs to set the conference role in the online conference by itself, and the corresponding terminal receives the conference role setting operation, determines the conference role corresponding to the current conference participation object, and further uploads the conference participation identifier corresponding to the conference role to the server, and the server determines the screen position in the frame background view of the video screen corresponding to the current conference participation object according to the conference role.
[0109] In this embodiment, the process of obtaining layout parameters corresponding to the identical frame screen is realized through the interaction between the terminal and the server, and the identical frame screen can be displayed in the online conference interface of the client. In addition, by providing the terminal side with a conference role setting operation, the server can determine the target position in the frame background map of the video screen corresponding to each conference participating object according to the conference role set, which is advantageous for the generated identical frame screen to better meet the needs of the user for the online conference scene.
[0110] FIG. 16 is a structural block diagram of a display device of an online conference interface provided by an exemplary embodiment of the present application, the device including: When the online conference is in the same frame mode, an acquisition module 1601 is used for acquiring the frame background image of the online conference; a generating module 1602 for generating a same frame screen based on the frame background map and the video screens of each conference participant object, where the video screens of different conference participant objects are displayed at different positions on the frame background map; and a push module 1603 for pushing the same frame screen to a client of the conference participant object, so that the client displays the same frame screen in an online conference interface. Optionally, the generating module 1602 further comprises: determining a screen location in the frame background diagram of the video screen corresponding to each of the conference participant objects; generating the same frame picture based on the screen position and the video screen.
[0111] Optionally, the generating module 1602 further comprises: obtaining a video access order for each of the conference participant objects, the video access order being an order in which each of the conference participant objects turned on video access in the online conference; and determining the screen position in the frame background view of the video screen corresponding to each of the conference participant objects based on the video access order.
[0112] Optionally, the generating module 1602 further comprises: obtaining, for each said conference participant object, a conference participant identifier used to characterize said conference participant object's conference role in said online conference; and determining a screen position in the frame background view of the video screen corresponding to each of the conferee objects based on the conferee identifier. Optionally, the acquisition module 1601 further comprises: receiving a frame background picture selection request sent by a moderator client, the frame background picture being used in the online conference, when the online conference has the same frame mode turned on; and acquiring the frame background picture of the online conference according to the frame background picture selection request.
[0113] Optionally, the apparatus further comprises: a receiving module for receiving a position adjustment command for the video screen in the same frame screen by the moderator client; and an update module for updating the same frame screen based on the position adjustment command and pushing the updated same frame screen to a client of the conference participant object. Optionally, the apparatus further comprises: A receiving module for receiving a setting request for the frame background image, the setting request including layout parameters of the frame background image; and a storage module for storing the layout parameters in association with the same frame mode so as to render the same frame screen using the frame background picture based on the layout parameters.
[0114] Optionally, the generating module 1602 further comprises: obtaining, for each said conference participant object, a conference participant identifier used to characterize said conference participant object's conference role in said online conference; dividing each of the conference participant objects into a first object set and a second object set based on the conference participant identifier; The video screens of the conference participating objects in the first object set are displayed in the frame background diagram, and the video screens of the conference participating objects in the second object set are displayed around the frame background diagram, thereby generating the same frame screen.
[0115] Optionally, the acquisition module 1601 further comprises: If the online conference has the same frame mode turned on, generating a conference virtual object; adding said conference virtual object to said online conference; and obtaining the frame background view of the online conference through the object service of the conference virtual object. The generating module 1602 further drawing said video view of each said conference participant object by said object service; The object service is used to generate the same frame screen based on the frame background picture and the video screen.
[0116] To sum up, in the embodiment of the present application, a same frame mode is provided in an online conference scene. After a client turns on the same frame mode, the video screen corresponding to each conference participating object can be displayed at different positions in the same frame background map, and the frame background map corresponds to the current online conference, which can meet the needs of specific positions in different online conference scenes, and the conference participating objects do not need to actively adjust the display positions in the online conference interface of the video screens corresponding to each conference participating object, thereby improving the efficiency of adjusting the display needs of specific positions of the video screens in online conference scenes.
[0117] FIG. 17 is a structural block diagram of a display device of an online conference interface provided by another exemplary embodiment of the present application, the device including: a receiving module 1701 for receiving a conference join operation used to trigger joining an online conference; A display module 1702 for displaying a same-frame screen on the online conference interface when the online conference turns on a same-frame mode, and the video screens of different conference participants in the same-frame screen are displayed at different positions of the same-frame background picture; The display module 1702 is further used for displaying the video screen of the current conference participant object at the screen position of the frame background image on the same frame screen when the video access is turned on. Optionally, the screen position is a position in the frame background diagram indicated by a video access order, which is an order in which the current conference participant object turns on video access in the online conference; Or, The screen position is a position in the frame background diagram indicated by the conference role of the current conference participant object in the online conference; Or, The screen position is the position where the conference moderator object is set in the online conference. Optionally, the apparatus further comprises: The receiving module 1701 is further used for receiving a conference role setting operation and determining the conference role of the current conference participant object when the online conference turns on the same frame mode; The server includes a sending module for sending the conference role to the server, so as to determine the screen position in the frame background view of the video screen corresponding to the current conference participant object according to the conference role.
[0118] Optionally, the apparatus further comprises: The display module 1702 is further used for displaying presentation information used to present whether to turn on the same frame mode; The display module 1702 further includes: sending, to a server, a layout parameter request used for requesting the layout parameters of the same frame screen in response to a confirmation operation on the presented information; receiving the layout parameters pushed by the server, and displaying the same frame screen on the online conference interface according to the layout parameters; Optionally, the display module 1702 may further include: if video access is turned on, uploading to a server a video streaming of the current conference participant object, including the video screen of the current conference participant object; It is used for receiving the same frame screen generated based on the video screen and the frame background map pushed by the server, and displaying the video screen of the current conference participating object at the screen position of the frame background map.
[0119] To sum up, in the embodiment of the present application, a same frame mode is provided in an online conference scene. After a client turns on the same frame mode, the video screen corresponding to each conference participating object can be displayed at different positions in the same frame background map, and the frame background map corresponds to the current online conference, which can meet the needs of specific positions in different online conference scenes, and the conference participating objects do not need to actively adjust the display positions in the online conference interface of the video screens corresponding to each conference participating object, thereby improving the efficiency of adjusting the display needs of specific positions of the video screens in online conference scenes.
[0120] It should be noted that the device provided by the above embodiment is merely described as an example of the division of the above functional modules, but in actual applications, the allocation of the above functions may be achieved by different functional modules as required, that is, the internal structure of the device may be divided into different functional modules to achieve all or part of the functions described above. In addition, the device and method embodiments provided by the above embodiment belong to the same concept, and the implementation process thereof is referred to in detail in the method embodiment, and the description thereof is omitted here.
[0121] 18, which shows a structural diagram of a computer device provided by an exemplary embodiment of the present application, which may be a server or a terminal in the above embodiment. Specifically, the computer device 1800 includes a central processing unit (CPU) 1801, a system memory 1804 including a random access memory 1802 and a read-only memory 1803, and a system bus 1805 connecting the system memory 1804 and the central processing unit 1801. The computer device 1800 further includes a basic input / output system (Input / Output, I / O system) 1806 that facilitates information transfer between each device in the computer, and a mass storage device 1807 for storing an operating system 1813, an application program 1814, and other program modules 1815. The basic input / output system 1806 includes a display 1808 for displaying information and an input device 1809, such as a mouse or keyboard, for a user to input information. Here, the display 1808 and the input device 1809 are both connected to the central processing unit 1801 via an input / output controller 1810 that is connected to the system bus 1805. The basic input / output system 1806 may further include an input / output controller 1810 that is used to receive and process input from a number of other devices, such as a keyboard, a mouse, or an electronic stylus. Similarly, the input / output controller 1810 may also provide output to a display screen, a printer, or other type of output device. The mass storage device 1807 is connected to the central processing unit 1801 via a mass storage controller (not shown) connected to the system bus 1805. The mass storage device 1807 and its associated computer readable medium provide non-volatile memory for the computing device 1800. That is, the mass storage device 1807 may include a computer readable medium (not shown), such as a hard disk or drive. The system memory 1804 and mass storage device 1807 may be collectively referred to as memory. The memory stores one or more programs, the one or more programs are configured to be executed by one or more central processing units 1801, the one or more programs contain instructions for implementing the above methods, and the central processing unit 1801 executes the one or more programs to realize the method of displaying an online conference interface provided by the embodiments of each of the above methods. According to embodiments of the present application, the computer device 1800 may further operate with a remote computer connected to a network such as the Internet via a network, i.e., the computer device 1800 may be connected to a network 1812 via a network interface unit 1811 connected to the system bus 1805, or may use the network interface unit 1811 to connect to another type of network or remote computer system (not shown).
[0122] An embodiment of the present application further provides a computer-readable medium, in which at least one instruction is stored, and the at least one instruction is loaded and executed by a processor, thereby realizing the method for displaying an online conference interface on a server side or the method for displaying an online conference interface on a terminal side described in the above embodiment.
[0123] An embodiment of the present application provides a computer program product including computer instructions stored in a computer-readable medium, the computer program product being configured to cause a processor of the computer device to read the computer instructions from the computer-readable medium, and the processor to execute the computer instructions, thereby causing the computer device to perform the method for displaying an online conference interface described in the above embodiment.
Claims
1. A method for displaying an online conference interface executed by a server, comprising: When the online conference turns on a same frame mode, obtaining a frame background picture of the online conference; generating an identical frame screen based on the frame background map and the video screens of each conference participant object, the video screens of different conference participant objects being displayed at different positions of the frame background map; and pushing the same frame screen to a client of the conference participant object so that the client displays the same frame screen in an online conference interface.
2. Generating a uniform frame screen based on the frame background picture and the video screen of each conference participant object, determining a screen location in the frame background view of the video screen corresponding to each of the conference participant objects; and generating the identical frame screen based on the screen position and the video screen.
3. Determining a screen position in the frame background view of the video screen corresponding to each of the conference participant objects includes: obtaining a video access order for each of the conference participant objects, the video access order being an order in which each of the conference participant objects turned on video access in the online conference; and determining the screen location in the frame background view of the video screen corresponding to each of the conference participant objects based on the video access order.
4. Determining a screen position in the frame background view of the video screen corresponding to each of the conference participant objects includes: obtaining a conference participant identifier for each of the conference participant objects, the conference participant identifier being used to characterize a conference role of the conference participant object in the online conference; and determining the screen location in the frame background view of the video screen corresponding to each of the conference attendee objects based on the conference attendee identifier.
5. When the online conference turns on a same frame mode, obtaining a frame background picture of the online conference is receiving a frame background picture selection request sent by a moderator client when the online conference has the same frame mode turned on, the frame background picture selection request including the frame background picture used in the online conference; The method according to any one of claims 1 to 4, further comprising: obtaining the frame background view of the online conference based on a selection request for the frame background view.
6. The method further comprises: the moderator client receiving a position adjustment command for the video screen in the same frame screen; The method of claim 5 , further comprising: updating the same-frame screen based on the position adjustment command, and pushing the updated same-frame screen to a client of the conference participant object.
7. If the online conference turns on a same frame mode, before obtaining a frame background view of the online conference, the method further comprises: receiving a setting request for the frame background map, the setting request including layout parameters for the frame background map; The method according to any one of claims 1 to 4, further comprising: associating the layout parameters with the same frame mode and saving the same frame screen using the frame background view based on the layout parameters.
8. Generating a uniform frame screen based on the frame background picture and the video screen of each conference participant object, obtaining a conference participant identifier for each of the conference participant objects, the conference participant identifier being used to characterize a conference role of the conference participant object in the online conference; dividing each of the conference attendee objects into a first object set and a second object set based on the conference attendee identifier; A method according to any one of claims 1 to 4, comprising: displaying the video screens of conference participating objects in the first object set on the frame background diagram; and displaying the video screens of conference participating objects in the second object set around the frame background diagram, thereby generating the same frame screen.
9. When the online conference turns on a same frame mode, obtaining a frame background picture of the online conference is generating a conference virtual object when the online conference has the same frame mode turned on; adding the conference virtual object to the online conference; Obtaining the frame background view of the online meeting through an object service of the meeting virtual object; Generating a uniform frame screen based on the frame background picture and the video screen of each conference participant object, drawing the video view of each of the conference participants through the object services; The method according to any one of claims 1 to 4, further comprising: generating, by said object service, said identical frame screen based on said frame background picture and said video screen.
10. A method for displaying an online conference interface executed by a terminal, comprising: Receiving a conference join operation used to trigger joining an online conference; When the online conference is turned on a same frame mode, display a same frame screen on the online conference interface, and the video screens of different conference participant objects in the same frame screen are displayed at different positions of the same frame background image. Display the same frame screen on the online conference interface; if video access is turned on, displaying the video screen of the current conference participant object at a screen position of the frame background view within the same frame screen.
11. the screen position is a position in the frame background view indicated by a video access order, the video access order being an order in which the current conference participant object turned on video access in the online conference; Or, The screen position is a position indicated by a conference role in the frame background diagram, and the conference role is a conference role in the online conference of the current conference participant object; Or, The method of claim 10 , wherein the screen position is a position set by a conference moderator object in the online conference.
12. The method further comprises: If the online conference turns on the same frame mode, receiving a conference role setting operation and determining the conference role of the current conference participant object; and sending the conference role to the server, such that the server determines the screen position in the frame background view of the video screen corresponding to the current conference participant object based on the conference role.
13. After receiving the conference join operation, the method further comprises: displaying presentation information used to present whether to turn on the same frame mode; When the online conference turns on a same frame mode, displaying a same frame screen on the online conference interface; sending, to a server, a layout parameter request used for requesting layout parameters of the same frame screen in response to a confirmation operation on the presented information; The method according to any one of claims 10 to 12, further comprising: receiving the layout parameters pushed by the server; and displaying the same frame screen on the online conference interface based on the layout parameters.
14. When the video access is turned on, displaying the video screen of the current conference participant object at a screen position of the frame background image in the same frame screen; if the video access is turned on, uploading to a server a video stream of the current conference participant object, the video stream including the video screen of the current conference participant object; A method according to any one of claims 10 to 12, comprising receiving the same frame screen generated based on the video screen and the frame background diagram pushed by the server, and displaying the video screen of the current conference participant object at the screen position of the frame background diagram.
15. A display device for an online conference interface, comprising: When the online conference turns on a same frame mode, an acquisition module is used to acquire a frame background image of the online conference; a generating module for generating a same frame screen based on the frame background map and a video screen of each conference participant object, the video screens of different conference participant objects being displayed at different positions on the frame background map; a push module for pushing the same frame screen to a client of the conference participant object so that the client displays the same frame screen in an online conference interface.
16. A display device for an online conference interface, comprising: a receiving module for receiving a conference join operation used to trigger joining an online conference; A display module for displaying a same-frame screen on an online conference interface when the online conference turns on a same-frame mode, and the video screens of different conference participant objects in the same-frame screen are displayed at different positions of the same-frame background picture; The display module also displays the video screen of the current conference participant object at a screen position of the frame background diagram within the same frame screen when video access is turned on.
17. A server including a processor and a memory in which at least one instruction is stored, the at least one instruction being loaded and executed by the processor to implement a method for displaying an online conference interface according to any one of claims 1 to 9.
18. A terminal including a processor and a memory in which at least one instruction is stored, the at least one instruction being loaded and executed by the processor so as to realize a method for displaying an online conference interface according to any one of claims 10 to 14.
19. A computer-readable storage medium having stored thereon at least one instruction, the at least one instruction being loaded and executed by a processor to implement the method for displaying an online conference interface according to any one of claims 1 to 9, or to implement the method for displaying an online conference interface according to any one of claims 10 to 14.
20. A computer program product including computer instructions stored on a computer-readable storage medium, wherein a processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method for displaying an online conference interface according to any one of claims 1 to 9, or the method for displaying an online conference interface according to any one of claims 10 to 14.
Citation Information
Patent Citations
Meeting place creating method and system of video conference
CN104349111A
Interface display method and device in multimedia conference scene, terminal and medium
CN111596985A
Intuitive virtual interaction method
JP2011239397A
Recording and playback of meetings
JP2013533987A
Remote work support system and remote work support method
JP6888854B1
