Video conferencing implementation method, device, system, and storage medium

Abstract

The present application discloses a method, device, system and computer storage medium for implementing a video conference, belonging to the field of network technologies. The method includes: obtaining layout information of a conference screen of a video conference; sending information of corresponding participant areas to at least two terminals; receiving multimedia data of participants provided by at least two terminals based on the information of the corresponding participant areas; obtaining conference video data based on the multimedia data of participants; and sending the conference video data to at least two terminals. By sending the layout information to the terminals participating in the video conference, the terminals participating in the video conference can collect multimedia data of participants that conforms to the layout information according to the layout information, and the conference device can generate conference video data with a matching size, and the display effect of the conference video data is better. The problem that the effect of conference video data in the related art is poor is solved, and the display effect of conference video data in the video conference is improved.

Description

Technical Field

[0001] This application relates to the field of network technologies, and particularly to a method, device, system, and storage medium for implementing a video conference. Background Art

[0002] Video conferencing is a current emerging video conferencing method. Through video conferencing, multiple people can hold meetings online, which is convenient and fast.

[0003] Currently, in one implementation of a video conference, terminals of multiple participants establish connections with a server. After the video conference starts, these multiple terminals transmit the collected video data to the server. The server, according to a predetermined layout method, sequentially arranges the video data transmitted by the multiple terminals in different picture areas to form conference video data including the video data of each terminal.

[0004] However, in the conference video data generated by the above server, the areas allocated to different terminals may not match the sizes of the video data collected by the terminals themselves, which may lead to a problem of poor effect of the conference video data. Summary of the Invention

[0005] Embodiments of this application provide a method, device, system, and storage medium for implementing a video conference. The technical solution is as follows:

[0006] On one hand, this application provides a method for implementing a video conference. The method includes:

[0007] Obtaining layout information of a conference screen of a video conference, where the layout information includes information of at least two participant areas in the conference screen, and correspondence information between the at least two participant areas and at least two terminals participating in the video conference;

[0008] Sending information of the corresponding participant area to the at least two terminals;

[0009] Receiving participant multimedia data provided by the at least two terminals based on the information of the corresponding participant area;

[0010] Obtaining conference video data based on the participant multimedia data;

[0011] Sending the conference video data to the at least two terminals.

[0012] Optionally, the obtaining layout information of a conference screen of a video conference includes:

[0013] Receiving the layout information sent by a master control terminal among the at least two terminals.

[0014] Optionally, after receiving the layout information sent by the master terminal, the method further includes:

[0015] When the master control instruction indicates that the first terminal among the at least two terminals is the master terminal, determining the first terminal as the master terminal.

[0016] Optionally, the master control instruction includes at least one of a speaking instruction triggered by the first terminal, a master control switching instruction triggered by the first terminal, and a master control switching instruction triggered by the master terminal before the current moment.

[0017] Optionally, sending the information of the corresponding participant area to the at least two terminals includes:

[0018] Receiving layout application information sent by a second terminal among the at least two terminals;

[0019] Based on the layout application information, sending the information of the participant area corresponding to the second terminal to the second terminal.

[0020] Optionally, obtaining the conference video data based on the participating multimedia data includes:

[0021] When the participating multimedia data includes shared video data, processing the shared video data according to the layout information to obtain the conference video data; wherein, in the conference video data, the area occupied by the shared video data is larger than the area occupied by other participating multimedia data except the shared video data.

[0022] Optionally, after obtaining the conference video data based on the participating multimedia data, the method further includes:

[0023] Displaying the conference video data on a display screen.

[0024] Optionally, sending the conference video data to the at least two terminals includes:

[0025] Receiving layout adjustment information sent by a second terminal among the at least two terminals;

[0026] Adjusting the conference video data based on the layout adjustment information;

[0027] Sending the adjusted conference video data to the second terminal.

[0028] On the other hand, an embodiment of the present application provides a method for implementing a video conference, and the method includes:

[0029] Obtaining the information of the participant area corresponding to the terminal provided by the conference device;

[0030] Obtain video data;

[0031] Based on the information of the participant area and the multimedia data, obtain the multimedia data for the participants;

[0032] Provide the multimedia data for the participants to the conference device;

[0033] Receive the conference video data provided by the conference device;

[0034] Display the conference video data.

[0035] Optionally, the obtaining the multimedia data for the participants based on the information of the participant area and the multimedia data includes:

[0036] Perform person recognition on the multimedia data to determine the area where the person is located in the multimedia data;

[0037] Based on the information of the participant area and the area where the person is located, process the multimedia data to obtain the multimedia data for the participants; wherein, in the multimedia data for the participants, the proportion of the area where the person is located is greater than a specified value.

[0038] Optionally, the method further includes:

[0039] Send layout information to the conference device, where the layout information includes the information of at least two participant areas in the conference screen, and the correspondence information between the at least two participant areas and at least two terminals participating in the video conference.

[0040] Optionally, the obtaining the information of the participant area corresponding to the terminal provided by the conference device includes:

[0041] Send layout application information to the conference device;

[0042] Receive the information of the participant area corresponding to the terminal feedback by the conference device.

[0043] Optionally, the receiving the conference video data provided by the conference device includes:

[0044] Send layout adjustment information to the conference device;

[0045] Receive the conference video data adjusted by the conference device based on the layout adjustment information.

[0046] Optionally, the displaying the conference video data includes:

[0047] Receive an adjustment instruction;

[0048] Display the conference video data adjusted according to the adjustment instruction.

[0049] On the other hand, an embodiment of the present application provides a video conferencing implementation device, which includes:

[0050] A layout acquisition module, configured to acquire layout information of a conference screen of a video conference, where the layout information includes information of at least two participant areas in the conference screen, and a correspondence between the at least two participant areas and at least two terminals participating in the video conference;

[0051] A sending module, configured to send information of the participant areas corresponding to the at least two terminals to the at least two terminals;

[0052] A receiving module, configured to receive participant multimedia data provided by the at least two terminals based on the information of the corresponding participant areas;

[0053] A conference video acquisition module, configured to acquire conference video data based on the participant multimedia data;

[0054] A conference video sending module, configured to send the conference video data to the at least two terminals.

[0055] On the other hand, an embodiment of the present application provides a video conferencing implementation device, which includes:

[0056] An area acquisition module, configured to acquire information of a participant area corresponding to a terminal provided by a conference device;

[0057] A video acquisition module, configured to acquire video data;

[0058] A participant video acquisition module, configured to obtain participant multimedia data based on the information of the participant area and the multimedia data;

[0059] A participant video providing module, configured to provide the participant multimedia data to the conference device.

[0060] On the other hand, an embodiment of the present application provides a video conferencing implementation system, which includes a conference device and at least two terminals;

[0061] The conference device is configured to acquire layout information of a conference screen of a video conference, where the layout information includes information of at least two participant areas in the conference screen, and correspondence information between the at least two participant areas and at least two terminals participating in the video conference;

[0062] The conference device is configured to send information of the corresponding participant areas to the at least two terminals;

[0063] The terminal is configured to acquire multimedia data;

[0064] The terminal is configured to obtain conference multimedia data based on the information of the participant area and the multimedia data;

[0065] The terminal is configured to provide the conference multimedia data to the conference device;

[0066] The conference device is configured to obtain conference video data based on the conference multimedia data;

[0067] The conference device is configured to send the conference video data to the at least two terminals;

[0068] The terminal is configured to display the conference video data.

[0069] Optionally, the conference device is configured to display the conference video data on a display screen;

[0070] The second terminal among the at least two terminals is configured to send layout adjustment information to the conference device;

[0071] The conference device is configured to send the conference video data to the first terminal among the at least two terminals, and send the conference video data adjusted based on the layout adjustment information to the second terminal;

[0072] The first terminal is configured to display the conference video data, and the second terminal is configured to display the adjusted conference video data.

[0073] On the other hand, an embodiment of the present application provides a conference device, which includes a processor and a memory. At least one instruction, at least one program, a code set or an instruction set is stored in the memory, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to implement the video conference implementation method as described above.

[0074] According to another aspect of the present application, a terminal is provided. The conference device includes a processor and a memory. At least one instruction, at least one program, a code set or an instruction set is stored in the memory, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to implement the video conference implementation method as described above.

[0075] According to another aspect of the present application, a computer non-transitory storage medium is provided. At least one instruction, at least one program, a code set or an instruction set is stored in the computer non-transitory storage medium, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by a processor to implement the video conference implementation method as described above.

[0076] According to another aspect of the present application, a computer program product or a computer program is provided. The computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the methods provided in the above various alternative implementation manners.

[0077] The beneficial effects brought by the technical solutions provided in the embodiments of the present application at least include:

[0078] By obtaining the layout information of the conference screen of a video conference and sending the layout information to the terminals participating in the video conference, so that the terminals participating in the video conference can collect the participating multimedia data conforming to the layout information according to the layout information. After the terminals participating in the video conference send the obtained participating multimedia data to the conference device, the conference device can generate conference video data with a matching size and provide the conference video data to the terminals participating in the video conference, and the display effect of the conference video data is better. This solves the problem that the effect of the conference video data in the related art is poor, and improves the display effect of the conference video data in the video conference. BRIEF DESCRIPTION OF THE DRAWINGS

[0079] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0080] Figure 1 is a schematic diagram of the display of the conference screen of a video conference;

[0081] Figure 2 is a schematic structural diagram of an implementation environment involved in the embodiments of the present application;

[0082] Figure 3 is a flowchart of a method for implementing a video conference provided in the embodiments of the present application;

[0083] Figure 4 is a flowchart of another method for implementing a video conference provided in the embodiments of the present application;

[0084] Figure 5 is a flowchart of another method for implementing a video conference provided in the embodiments of the present application;

[0085] Figure 6 is Figure 5 a flowchart of sending information of the participant area in the shown embodiment;

[0086] Figure 7 is Figure 5 A flowchart of obtaining conference multimedia data in the illustrated embodiment;

[0087] Figure 8 is Figure 5 A schematic diagram of the conference screen of a video conference in the illustrated embodiment;

[0088] Figure 9 is Figure 5 A display schematic diagram of a terminal in the illustrated embodiment;

[0089] Figure 10 is Figure 5 A flowchart of presenting conference video data in the illustrated embodiment;

[0090] Figure 11 A block diagram of a video conference implementation device provided by an embodiment of the present application;

[0091] Figure 12 A block diagram of another video conference implementation device provided by an embodiment of the present application;

[0092] Figure 13 A structural block diagram of a video conference implementation system provided by an embodiment of the present application;

[0093] Figure 14 A structural schematic diagram of a conference device provided by an embodiment of the present application;

[0094] Figure 15 A block diagram of a terminal provided by an embodiment of the present application.

[0095] Through the above-mentioned drawings, specific embodiments of the present application have been shown, and more detailed descriptions will be provided hereinafter. These drawings and textual descriptions are not intended to limit the scope of the concept of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. Detailed Embodiments

[0096] To make the objectives, technical solutions, and advantages of the present application clearer, the following will further describe in detail the embodiments of the present application with reference to the accompanying drawings.

[0097] A video conference system, also known as a conference television system, refers to a system device that enables two or more individuals or groups in different locations to transmit voice, images, and document materials to each other through transmission lines and multimedia devices, achieving instant and interactive communication to realize a remote conference.

[0098] In a current implementation of video conferencing, each terminal collects video data of the participants through its own camera. After each terminal collects the video data, it sends the collected video data to the conference device. The conference device combines the video data sent by multiple terminals it receives into a conference video data. When the display screen shows the conference video data, the video data collected by each terminal participating in the video conference will be displayed in different areas of the display screen. Exemplarily, as Figure 1 shown, it is a schematic diagram of the display of a conference screen of a video conference. Among them, the conference screen includes 4 areas, and the video data 11, 12, 13, and 14 provided by terminal A, terminal B, terminal C, and terminal D are respectively displayed in these four areas. The conference screen can be displayed on the display screens of each terminal participating in the video conference, and the technical effect of the video conference can be achieved through this conference screen.

[0099] It can be seen that in the above implementation of video conferencing, the sizes of the video data collected by different terminals participating in the video conference may be different. For example, a participant collects video data through the camera of a laptop computer, and another participant collects video data through the camera of a mobile phone, which may lead to inconsistencies in various parameters (such as aspect ratio, resolution, and bit rate, etc.) of the collected video data. In this way, there is a problem that the sizes of the video data of each terminal in the conference screen generated by the conference device do not match the size of the conference screen. For example Figure 1 the diagonal shaded area in the conference screen shown. This will lead to a problem of poor display effect of the video conference.

[0100] Figure 2 is a schematic structural diagram of an implementation environment involved in an embodiment of the present application. This implementation environment includes a conference device 21 and multiple terminals 22.

[0101] The conference device 21 may include a server or a server cluster composed of multiple servers. The conference device 21 can establish a connection with the terminal 22 through a wired connection or a wireless connection. In addition, in some implementation manners, the conference device 21 and the terminal 22 may also be the same type of hardware device, and the embodiments of the present application do not limit this. The conference device 21 may include a Multi-point Control Unit (MCU) for implementing multi-terminal call and connection.

[0102] The terminal 22 may include a mobile phone, a tablet computer, a desktop computer, a notebook computer, and various intelligent wearable devices. The terminal 22 may have one or more components such as a display screen, a microphone, a speaker, and a speaker connection component (such as a speaker interface or a wireless connection module, etc.) to implement various functions of the video conference.

[0103] Figure 3 is a flowchart of a method for implementing a video conference provided by an embodiment of the present application. In this embodiment, the method for implementing the video conference is applied to Figure 2 the conference device in the implementation environment shown for illustration. The method for implementing the video conference may include the following steps:

[0104] Step 301: Obtain the layout information of the conference screen of the video conference. The layout information includes information on at least two participant areas in the conference screen, and the correspondence information between the at least two participant areas and at least two terminals participating in the video conference.

[0105] Step 302: Send the information of the corresponding participant area to the at least two terminals.

[0106] Step 303: Receive the participant multimedia data provided by the at least two terminals based on the information of the corresponding participant area.

[0107] Step 304: Obtain the conference video data based on the participant multimedia data.

[0108] Step 305: Send the conference video data to the at least two terminals.

[0109] Among them, the participant multimedia data may include one or more of audio data, video data, image data, and text data.

[0110] In summary, the method for implementing a video conference provided by the embodiment of the present application obtains the layout information of the conference screen of the video conference and sends the layout information to the terminals participating in the video conference, so that the terminals participating in the video conference can collect participant multimedia data that conforms to the layout information according to the layout information. After the terminals participating in the video conference send the obtained participant multimedia data to the conference device, the conference device can generate conference video data with a matching size and provide the conference video data to the terminals participating in the video conference, and the display effect of the conference video data is better. It solves the problem that the effect of the conference video data in the related technology is poor and improves the display effect of the conference video data in the video conference.

[0111] In addition, in a way of implementing a video conference, the conference device will perform processing such as cropping and compressing the video data uploaded by the terminals participating in the video conference so that the video data can meet various requirements of the conference screen of the video conference. However, this will obviously seriously increase the computing burden of the conference device.

[0112] In the video conferencing implementation method provided by the embodiments of the present application, the conferencing device may not perform processing such as compressing and cropping video images. Instead, each of the multiple terminals participating in the video conference processes the collected video data according to the instructions of the information on the participant area sent by the conferencing device, which can greatly reduce the computing load of the conferencing device and thus improve the smoothness of the video conference.

[0113] Figure 4 FIG. 4 is a flowchart of another video conferencing implementation method provided by the embodiments of the present application. In this embodiment, it is exemplified by applying this video conferencing implementation method to Figure 2 the terminal in the shown implementation environment. This video conferencing implementation method may include the following steps:

[0114] Step 401: Obtain the information on the participant area corresponding to the terminal provided by the conferencing device.

[0115] Step 402: Obtain multimedia data.

[0116] Step 403: Based on the information on the participant area and the multimedia data, obtain the participating multimedia data.

[0117] Step 404: Provide the participating multimedia data to the conferencing device.

[0118] In summary, in the video conferencing implementation method provided by the embodiments of the present application, the terminals participating in the video conference can collect the participating multimedia data that conforms to the layout information according to the layout information provided by the conferencing device. After the terminals participating in the video conference provide the obtained participating multimedia data to the conferencing device respectively, the conferencing device can generate conference video data with a matching size and provide the conference video data to the terminals participating in the video conference. The display effect of the conference video data is better. This solves the problem of poor effect of conference video data in the related art and improves the display effect of conference video data in the video conference.

[0119] Figure 5 FIG. 5 is a flowchart of another video conferencing implementation method provided by the embodiments of the present application. In this embodiment, it is exemplified by applying this video conferencing implementation method to Figure 2 the shown implementation environment. This video conferencing implementation method may include the following steps:

[0120] Step 501: The conferencing device receives the layout information sent by the master terminal among at least two terminals participating in the video conference.

[0121] Among them, the layout information includes information on at least two participant regions in the conference screen, and correspondence information between at least two participant regions and at least two terminals participating in the video conference. In the conference screen of this video conference, these at least two participant regions are used to display video data provided by the terminals participating in the video conference. The information of the participant region can include various parameters of the participant region, such as region shape, resolution, bit rate, color, and region edge length, etc.

[0122] Based on the information of the participant region, the terminal can process the collected video data into participant multimedia data that matches the participant region, that is, video data that can be exactly displayed in the participant region.

[0123] The terminals participating in the video conference can be determined before this step. Exemplarily, the conference device can establish a video conference, and the terminals can participate in the video conference by verifying information (such as username and password, etc.). Before the video conference starts, the conference device can determine the terminals participating in the video conference.

[0124] Of course, after the video conference starts, new terminals can also participate in the video conference. For this situation, the layout information can be re-determined by re-executing step 501.

[0125] The master terminal can be one of the multiple terminals participating in the video conference, and this terminal can be used to control the video conference. Step 501 provides a way to obtain the layout information. However, the conference device can also obtain the layout information through other means. For example, the layout information is pre-stored locally in the conference device, etc. The embodiments of the present application do not limit this.

[0126] Step 502: The conference device sends information on the participant regions corresponding to at least two terminals participating in the video conference.

[0127] The conference device can send the information on the participant region corresponding to each terminal participating in the video conference to each terminal. For example, if the terminal A participating in the video conference corresponds to the participant region 51 in the video screen, and the terminal B participating in the video conference corresponds to the participant region 52 in the video screen, then the conference device can send the information of the participant region 51 to the terminal A and send the information of the participant region 52 to the terminal B.

[0128] In an exemplary embodiment, the conference device can also send the layout information to each terminal participating in the video conference, that is, each terminal participating in the video conference can receive the information of all participant regions.

[0129] In step 502, the conference device can directly send the information on the corresponding participant region to the terminals participating in the video conference, or,Figure 6 As shown, it is another way to send the information of the participant area in step 502, and this way may include:

[0130] Sub-step 5021: The conference device receives the layout application information sent by the second terminal among at least two terminals participating in the video conference.

[0131] The second terminal can be one of the terminals participating in the video conference, and this terminal can actively send the layout application information to the conference device.

[0132] Sub-step 5022: The conference device sends the information of the participant area corresponding to the second terminal to the second terminal based on the layout application information.

[0133] After receiving the layout application information of the second terminal, the conference device can send the information of the participant area corresponding to the second terminal to the second terminal.

[0134] Each terminal participating in the video conference can, after being ready for the video conference, send the layout application information to the conference device to obtain the information of the corresponding participant area.

[0135] Step 503: The terminal obtains the multimedia data.

[0136] The multimedia data may include video data collected by the camera component of the terminal participating in the video conference, or shared video data provided by the terminal, or image and audio data provided by the terminal, etc.

[0137] Among them, the video data collected by the camera component can be the video data of the participant himself or the video data of the environment around the participant. Exemplarily, when the terminal is a mobile phone, the video data of the participant can be collected through the front camera (or rear camera) of the mobile phone.

[0138] The shared video data may include some pictures to be presented by the participant, such as slide presentations (such as PPT), documents, tables, pictures, videos, audio, web pages or other multimedia information stored locally on the terminal, and these information can be provided by recording the display screen window or application window.

[0139] Step 504: The terminal obtains the participating multimedia data based on the information of the participant area and the multimedia data.

[0140] After the terminal collects the multimedia data, it can process the multimedia data based on the information of the participant area to obtain the participating multimedia data.

[0141] Exemplarily, the multimedia data can be video data with a resolution of 800×600 collected by the terminal. If the resolution recorded in the information of the participant area is 200×300, the terminal can crop the video data with a resolution of 800×600 into video data with a resolution of 200×300, and this video data with a resolution of 200×300 can be used as the multimedia data for the participants. In addition, the terminal can also adjust other parameters of the video data according to the information of the participant area, such as bit rate and color, etc.

[0142] In an exemplary embodiment, as Figure 7 shown, step 504 may include the following two sub-steps:

[0143] Sub-step 5041: The terminal performs person recognition on the multimedia data to determine the area where the person is located in the multimedia data.

[0144] The terminal can use person recognition technology to identify the area where the face (or face and shoulders) is located in the multimedia data (such as video data).

[0145] Exemplarily, the terminal can divide each frame image of the video data into multiple small-sized images, and use the adaboost algorithm (an iterative algorithm) to sequentially identify whether each area contains the head and shoulder features of a person. If the judgment is yes, record the area coordinates and size. If the judgment is no, do not record the coordinate information, and so on, traverse and search the entire image to determine the area occupied by the head and shoulders in the image.

[0146] Sub-step 5042: The terminal processes the multimedia data based on the information of the participant area and the area where the person is located to obtain the multimedia data for the participants.

[0147] The terminal can perform operations such as cropping and compressing on the collected multimedia data (such as video data) based on the information of the participant area and the area where the person is located, so that in the video data for the participants, the proportion of the area where the person is located is greater than a specified value. Exemplarily, the specified value is 50%-75%.

[0148] In an exemplary embodiment, if the resolution recorded in the information of the participant area is 200×300 and the video data collected by the terminal has a resolution of 800×600, the terminal can process the video data into multimedia data for the participants with a resolution of 200×300 and the proportion of the area where the person is located is 75%.

[0149] Through person recognition, the area where the person is located in the multimedia data for the participants is larger, which can highlight the person in the video image and improve the effect of the video conference.

[0150] Step 505: The terminal provides the participating multimedia data to the conference device.

[0151] The terminal can process the participating multimedia data in real time and transmit the participating multimedia data to the conference device in real time.

[0152] Step 506: The conference device obtains the conference video data based on the participating multimedia data.

[0153] The conference device can obtain the participating multimedia data provided by multiple terminals participating in the video conference and merge the multiple participating multimedia data into conference video data. The conference device can layout the multiple participating multimedia data in the conference screen according to the layout information determined in step 501.

[0154] Optionally, when the participating multimedia data includes shared video data, the conference device processes the shared video data according to the layout information to obtain conference video data. In this conference video data, the area occupied by the shared video data is larger than the area occupied by other participating multimedia data except the shared video data, that is, the display area of the shared video data is made larger than that of other participating multimedia data to highlight the shared video data and thus improve the display effect of the video conference.

[0155] Among them, the layout information may record the information of the participating area corresponding to the shared video data and send it to the terminal providing the shared video data in step 501. In this case, the terminal participating in the video conference can send a sharing message to the master terminal or the conference device in advance to indicate that it will provide shared video data, so that the master terminal or the conference device can determine the corresponding layout information.

[0156] In addition, it is also possible that a certain terminal temporarily provides shared video data. In this case, the terminal can also send a sharing message to the master terminal (or the conference device) and re - execute step 501 to determine the new layout information.

[0157] The shared video data may have an identifier, and the conference device can determine whether the participating multimedia data includes shared video data through this identifier.

[0158] Exemplarily, as Figure 8 shown, it is a schematic diagram of the conference screen of a video conference in an embodiment of the present application. In this conference screen, the shared video data 81 is displayed in the largest area, while the video data 82 of other participants is displayed in other smaller areas. With such a layout, all participants can clearly see the picture presented by the shared video data, improving the display effect of the video conference.

[0159] Step 507: The conference device sends conference video data to at least two terminals participating in the video conference.

[0160] The conference device can send conference video data to each terminal participating in the video conference.

[0161] In an exemplary embodiment, the conference device can also separately adjust the conference video data presented to one or more terminals. Exemplarily, step 507 may include:

[0162] 1) The conference device receives layout adjustment information sent by a second terminal among at least two terminals.

[0163] The second terminal can send the layout adjustment information to the conference device. The layout adjustment information may include a layout method different from the above layout information. For example, compared with the above layout information, in the layout adjustment information, the size of the participating area corresponding to a certain terminal becomes larger, and the size of the participating area corresponding to another terminal becomes smaller.

[0164] 2) The conference device adjusts the conference video data based on the layout adjustment information.

[0165] The conference device can adjust the conference video data based on the layout adjustment information through a local image processing component (such as an MCU). It should be noted that the conference device can only adjust the conference video data to be sent to the second terminal, and does not adjust the conference video data for other terminals (such as the first terminal) that do not send layout adjustment information.

[0166] 3) The conference device sends the adjusted conference video data to the second terminal.

[0167] Correspondingly, the conference device sends the unadjusted conference video data to other terminals participating in the video conference except the second terminal. In this case, the conference video data displayed on the second terminal is different from that displayed on other terminals participating in the video conference, enriching the diversity and user experience of the video conference.

[0168] Step 508: The terminal displays the conference video data.

[0169] The terminal can display the conference video data obtained from the conference device on the display screen. Exemplarily, as Figure 9 shown, it is a display schematic diagram of a terminal. The terminal 90 displays a conference screen 91 composed of conference video data on the display screen. The participants can watch the conference screen 91. The conference screen 91 may also have a speaking button 912 and a host switching button 913. The speaking button 912 is triggered when a participant wants to speak, and the host switching button 913 is triggered when a participant wants to apply to become the host.

[0170] In an exemplary embodiment, as Figure 10 shown, step 508 may include the following two sub-steps:

[0171] Step 5081, the terminal receives an adjustment instruction.

[0172] The adjustment instruction may be triggered by a participant operating the terminal, and the adjustment instruction is used to adjust the layout of the conference screen presented on the display screen of the terminal.

[0173] Exemplarily, when the participant of operating terminal A wants to highlight the video data provided by the terminal of participant B, an adjustment instruction may be triggered on terminal A to adjust the layout mode of the conference screen, so that the display area of the video data provided by participant B becomes larger (correspondingly, the area occupied by the video data provided by the terminals of other participants may shrink).

[0174] Step 5082, the terminal displays the adjusted conference video data according to the adjustment instruction.

[0175] The terminal may adjust the conference video data provided by the conference device according to the adjustment instruction to obtain the adjusted conference video data, and display the adjusted conference video data on the display screen. The terminal may implement dynamic adjustment of the conference video data through a local image processing component (such as a Graphics Processing Unit (GPU)).

[0176] It should be noted that the adjustment instruction is used to adjust the layout of the conference screen presented on the local display screen of the terminal, but will not affect the conference screens presented in other terminals participating in the video conference.

[0177] Exemplarily, if the participant of operating terminal A wants to change the layout of the conference screen, an adjustment instruction may be triggered in terminal A to adjust the layout of the conference screen presented in the display screen of terminal A. However, the layout of the conference screen presented on the display screen of terminal B may still be the layout in the conference video data provided by the conference device.

[0178] Step 509, the conference device displays the conference video data on the display screen.

[0179] In an exemplary embodiment, the conference device also has a display screen. Subsequently, the conference device may display the conference video data on the display screen. On this basis, there may also be one or more participants at the conference device, and these one or more participants may participate in the video conference through the conference device and control the video conference through the conference device, such as controlling the layout information of the conference video data, etc.

[0180] Step 510: When the conference device determines that the first terminal among at least two terminals participating in the video conference is the master terminal according to the master control instruction, the first terminal is determined as the master terminal.

[0181] In the video conference implementation method provided in the embodiments of the present application, the master terminal can also be changed. For example, when the conference device determines that the first terminal among at least two terminals participating in the video conference is the master terminal according to the master control instruction, the conference device can determine the first terminal as the master terminal.

[0182] The master control instruction can include at least one of a speaking instruction triggered by the first terminal, a master control switching instruction triggered by the first terminal, a master control switching instruction triggered by the previous master terminal (i.e., confirmed by the previous master terminal), and a control instruction triggered by the conference device. For example, when the conference device has a display screen, the control instruction can be triggered through the conference device to adjust and control the master terminal. In addition, in the conference video data, an identifier can be added to the participating area corresponding to the master terminal so that each terminal can identify the master terminal, facilitating the progress of the video conference.

[0183] By switching the master terminal, the video conference implementation method can be made more flexible.

[0184] In summary, in the video conference implementation method provided in the embodiments of the present application, by obtaining the layout information of the conference screen of the video conference and sending the layout information to the terminals participating in the video conference, the terminals participating in the video conference can collect the participating multimedia data that conforms to the layout information according to the layout information. After the terminals participating in the video conference send the obtained participating multimedia data to the conference device, the conference device can generate conference video data with a matching size and provide the conference video data to the terminals participating in the video conference, and the display effect of the conference video data is better. This solves the problem of poor effect of conference video data in the related art and improves the display effect of conference video data in the video conference.

[0185] In addition, in the video conference implementation method provided in the embodiments of the present application, the conference device does not need to perform processing such as compression and cropping on the video image. Instead, each of the multiple terminals participating in the video conference processes the collected video data according to the indication of the information of the participant area sent by the conference device, which can greatly reduce the computing load of the conference device and thus improve the smoothness of the video conference.

[0186] Figure 11 It is a block diagram of a video conference implementation device provided in the embodiments of the present application. The video conference implementation device 1100 includes:

[0187] A layout acquisition module 1110, configured to acquire layout information of a conference screen of a video conference, where the layout information includes information of at least two participant areas in the conference screen, and correspondence information between the at least two participant areas and at least two terminals participating in the video conference.

[0188] A sending module 1120, configured to send information of the participant areas corresponding to the at least two terminals to the at least two terminals.

[0189] A receiving module 1130, configured to receive participant multimedia data provided by the at least two terminals based on the information of the corresponding participant areas.

[0190] A conference video acquisition module 1140, configured to acquire conference video data based on the participant multimedia data.

[0191] A conference video sending module 1150, configured to send the conference video data to the at least two terminals.

[0192] In summary, the video conference implementation device provided in the embodiment of the present application acquires the layout information of the conference screen of the video conference, and sends the layout information to the terminals participating in the video conference, so that the terminals participating in the video conference can collect participant multimedia data conforming to the layout information according to the layout information. After the terminals participating in the video conference send the obtained participant multimedia data to the conference device, the conference device can generate conference video data with a matching size and provide the conference video data to the terminals participating in the video conference, and the display effect of the conference video data is better. This solves the problem that the effect of conference video data in the related art is poor, and improves the display effect of conference video data in the video conference.

[0193] Optionally, the layout acquisition module is configured to:

[0194] Receive layout information sent by a master control terminal among the at least two terminals.

[0195] Optionally, the conference device further includes:

[0196] A hosting confirmation module, configured to determine the first terminal as the master control terminal when the master control instruction indicates that the first terminal among the at least two terminals is the master control terminal.

[0197] Optionally, the master control instruction includes at least one of a speaking instruction triggered by the first terminal, a master control switching instruction triggered by the first terminal, and a master control switching instruction triggered by the master control terminal before the current moment.

[0198] Optionally, the sending module is configured to:

[0199] Receive layout application information sent by a second terminal among the at least two terminals;

[0200] Based on the layout application information, send the information of the participant area corresponding to the second terminal to the second terminal.

[0201] Optionally, the conference video acquisition module includes:

[0202] When the conference multimedia data includes shared video data, process the shared video data according to the shared layout information to obtain conference video data. In the conference video data, the area occupied by the shared video data is larger than the area occupied by other conference multimedia data except the shared video data.

[0203] Optionally, the conference device further includes:

[0204] A conference display module, configured to display the conference video data on a display screen.

[0205] Figure 12 It is a block diagram of another video conference implementation device provided by an embodiment of the present application. The video conference implementation device 1200 includes:

[0206] An area acquisition module 1210, configured to acquire the information of the participant area corresponding to the terminal provided by the conference device;

[0207] A video acquisition module 1220, configured to acquire multimedia data;

[0208] A participant video acquisition module 1230, configured to obtain conference multimedia data based on the information of the participant area and the multimedia data;

[0209] A participant video providing module 1240, configured to provide the conference multimedia data to the conference device;

[0210] A conference data receiving module 1250, configured to receive the conference video data provided by the conference device;

[0211] A conference data display module 1260, configured to display the conference video data.

[0212] In summary, for the video conference implementation device provided by the embodiment of the present application, the terminals participating in the video conference can collect conference multimedia data that conforms to the layout information according to the layout information provided by the conference device. After the terminals participating in the video conference give the conference multimedia data obtained by each to the conference device, the conference device can generate conference video data with a matching size and provide the conference video data to the terminals participating in the video conference, and the display effect of the conference video data is better. It solves the problem of poor effect of conference video data in the related art and improves the display effect of conference video data in the video conference.

[0213] Optionally, the participant video acquisition module is used for:

[0214] Perform person recognition on video data to determine the area where the person is located in the video data;

[0215] Based on the information of the participant area and the area where the person is located, process the video data to obtain the participating multimedia data, and in the participating video data, the proportion of the area where the person is located is greater than the specified value.

[0216] Optionally, the terminal further includes:

[0217] A layout information sending module, configured to send layout information to the conference device, where the layout information includes information of at least two participant areas in the conference screen, and correspondence information between at least two participant areas and at least two terminals participating in the video conference.

[0218] Optionally, an area obtaining module, configured to:

[0219] Send layout application information to the conference device;

[0220] Receive the information of the participant area corresponding to the terminal fed back by the conference device.

[0221] Optionally, a conference data display module, configured to:

[0222] Receive an adjustment instruction;

[0223] Display the conference video data adjusted according to the adjustment instruction.

[0224] Figure 13 It is a structural block diagram of a video conference implementation system provided by an embodiment of the present application. The system 1300 includes a conference device 131 and at least two terminals 132.

[0225] The conference device 131 is configured to obtain the layout information of the conference screen of the video conference, where the layout information includes information of at least two participant areas in the conference screen, and correspondence information between at least two participant areas and at least two terminals participating in the video conference.

[0226] The conference device 131 is configured to send the information of the participant area corresponding to at least two terminals to at least two terminals.

[0227] The terminal 132 is configured to obtain multimedia data.

[0228] The terminal 132 is configured to obtain the participating multimedia data based on the information of the participant area and the multimedia data.

[0229] The terminal 132 is configured to provide the participating multimedia data to the conference device.

[0230] The conference device 131 is configured to obtain the conference video data based on the participating multimedia data.

[0231] The conference device 131 is used to send conference video data to at least two terminals;

[0232] The terminal 132 is used to display the conference video data.

[0233] In addition, in the embodiments of the present application, the methods executed by the conference device 131 and the terminal 132 may also refer to Figure 5 the embodiments shown, which will not be elaborated here.

[0234] In summary, the video conferencing implementation system provided by the embodiments of the present application obtains the layout information of the conference screen of the video conference and sends the layout information to the terminals participating in the video conference, so that the terminals participating in the video conference can collect the participating multimedia data that conforms to the layout information according to the layout information. After the terminals participating in the video conference send the obtained participating multimedia data to the conference device, the conference device can generate conference video data with a matching size and provide the conference video data to the terminals participating in the video conference, and the display effect of the conference video data is better. This solves the problem that the effect of the conference video data in the related art is poor and improves the display effect of the conference video data in the video conference.

[0235] Optionally, the conference device 131 is used to display the conference video data on the display screen.

[0236] The second terminal 1321 among the at least two terminals is used to send layout adjustment information to the conference device 131.

[0237] The conference device 131 is used to send conference video data to the first terminal 1322 among the at least two terminals (the first terminal may be a terminal that does not send layout adjustment information to the conference device), and send the conference video data adjusted based on the layout adjustment information to the second terminal 1321.

[0238] The first terminal 1322 is used to display the conference video data, and the second terminal 1321 is used to display the adjusted conference video data. That is, the conference video data displayed by the terminal that does not send layout adjustment information to the conference device is different from the conference video data displayed by the terminal that sends layout adjustment information to the conference device.

[0239] According to another aspect of the present application, a computer program product or a computer program is provided. The computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the methods provided in the above various optional implementation manners.

[0240] Figure 14FIG. 0 is a schematic structural diagram of a conference device 1400 provided by an embodiment of the present application. The conference device 1400 may be a server. Exemplarily, as Figure 14 shown, the conference device 1400 includes a central processing unit (CPU) 1401, a memory 1402, and a system bus 1403 connecting the memory 1402 and the central processing unit 1401. The memory 1402 may include a computer-readable medium (not shown) such as a hard disk or a compact disc read-only memory (CD-ROM).

[0241] Without loss of generality, the computer-readable storage medium may include a computer storage medium (which may be a non-transitory storage medium) and a communication medium. The computer storage medium includes volatile and non-volatile, removable and non-removable media implemented by any method or technology for storing information such as computer-readable instructions, data structures, program modules, or other data. The computer storage medium includes random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, or other solid-state storage technologies, CD-ROM, digital versatile disc (DVD), or other optical storage, magnetic tape cartridges, magnetic tapes, disk storage, or other magnetic storage devices. Of course, those skilled in the art will appreciate that the computer storage medium is not limited to the above several types.

[0242] The above-mentioned memory 1402 further includes one or more programs. The one or more programs are stored in the memory and are configured to be executed by the CPU to implement the video conferencing implementation method provided by the embodiments of the present application.

[0243] Figure 15The following is a block diagram of a terminal 1500 provided by an embodiment of the present application. The terminal 1500 may be: a smart phone, a tablet computer, a Moving Picture Experts Group Audio Layer III (MP3) player, a Moving Picture Experts Group Audio Layer IV (MP4) player, a laptop computer, or a desktop computer. The terminal 1500 may also be referred to by other names such as a user equipment, a portable terminal, a laptop terminal, a desktop terminal, etc.

[0244] Generally, the terminal 1500 includes: a processor 1501 and a memory 1502.

[0245] The processor 1501 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1501 may be implemented in at least one of the following hardware forms: Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 1501 may also include a main processor and a co-processor. The main processor is a processor for processing data in the wake state, also known as the Central Processing Unit (CPU); the co-processor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1501 may be integrated with a Graphics Processing Unit (GPU), and the GPU is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1501 may also include an Artificial Intelligence (AI) processor, and the AI processor is used to process computational operations related to machine learning.

[0246] The memory 1502 may include one or more computer-readable storage media (which may be non-transitory storage media), and the computer-readable storage media may be non-transitory. The memory 1502 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices and flash storage devices. In some embodiments, the non-transitory computer-readable storage media in the memory 1502 is used to store at least one instruction, and the at least one instruction is used to be executed by the processor 1501 to implement the video conferencing implementation method provided by the method embodiment of the present application.

[0247] In some embodiments, the terminal 1500 may further optionally include: a peripheral device interface 1503 and at least one peripheral device. The processor 1501, the memory 1502, and the peripheral device interface 1503 may be connected through a bus or signal lines. Each peripheral device may be connected to the peripheral device interface 1503 through a bus, signal lines, or a circuit board. Specifically, the peripheral device includes at least one of a radio frequency circuit 1504, a touch display screen 1505, a camera 1506, an audio circuit 1507, a positioning component 1508, and a power supply 1509.

[0248] The peripheral device interface 1503 can be used to connect at least one peripheral device related to input / output (I / O) to the processor 1501 and the memory 1502. In some embodiments, the processor 1501, the memory 1502, and the peripheral device interface 1503 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1501, the memory 1502, and the peripheral device interface 1503 can be implemented on a separate chip or circuit board, and this embodiment does not limit this.

[0249] The radio frequency circuit 1504 is used to receive and transmit radio frequency (RF) signals, also known as electromagnetic signals. The radio frequency circuit 1504 communicates with a communication network and other communication devices through electromagnetic signals. The radio frequency circuit 1504 converts an electrical signal into an electromagnetic signal for transmission, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 1504 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and the like. The radio frequency circuit 1504 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes but is not limited to: the World Wide Web, a metropolitan area network, an intranet, each generation of mobile communication networks (2G, 3G, 4G, and 5G), a wireless local area network, and / or a Wireless Fidelity (WiFi) network. In some embodiments, the radio frequency circuit 1504 may further include a circuit related to Near Field Communication (NFC), and this application does not limit this.

[0250] The display screen 1505 is used to display a user interface (UI). The UI may include graphics, text, icons, videos, and any combination thereof. When the display screen 1505 is a touch display screen, the display screen 1505 also has the ability to collect touch signals on or above the surface of the display screen 1505. The touch signals can be input as control signals to the processor 1501 for processing. At this time, the display screen 1505 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one display screen 1505, which is disposed on the front panel of the terminal 1500; in other embodiments, there may be at least two display screens 1505, which are respectively disposed on different surfaces of the terminal 1500 or are in a foldable design; in still other embodiments, the display screen 1505 may be a flexible display screen, which is disposed on a curved surface or a folding surface of the terminal 1500. Even more, the display screen 1505 can also be set to an irregular non-rectangular shape, that is, a special-shaped screen. The display screen 1505 can be prepared from materials such as a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc.

[0251] The camera module 1506 is used to collect images or videos. Optionally, the camera module 1506 includes a front camera and a rear camera. Generally, the front camera is disposed on the front panel of the terminal, and the rear camera is disposed on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth-of-field camera, a wide-angle camera, and a telephoto camera, so as to implement functions such as background blurring by fusing the main camera and the depth-of-field camera, panoramic shooting by fusing the main camera and the wide-angle camera, and virtual reality (VR) shooting functions or other fusion shooting functions. In some embodiments, the camera module 1506 may further include a flash. The flash can be a single-color temperature flash or a two-color temperature flash. A two-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation under different color temperatures.

[0252] The audio circuit 1507 may include a microphone and a speaker. The microphone is used to collect sound waves of the user and the environment, and convert the sound waves into electrical signals for input to the processor 1501 for processing, or input to the radio frequency circuit 1504 to achieve voice communication. For the purpose of stereo collection or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the terminal 1500. The microphone may also be an array microphone or an omnidirectional collection microphone. The speaker is used to convert the electrical signal from the processor 1501 or the radio frequency circuit 1504 into sound waves. The speaker may be a traditional thin film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for uses such as ranging. In some embodiments, the audio circuit 1507 may further include a headphone jack.

[0253] The positioning component 1508 is used to locate the current geographical location of the terminal 1500 to implement navigation or location-based service (LBS). The positioning component 1508 may be a positioning component based on the Global Positioning System (GPS) of the United States, the Beidou system of China, or the Galileo system of Russia.

[0254] The power supply 1509 is used to supply power to each component in the terminal 1500. The power supply 1509 may be alternating current, direct current, a disposable battery, or a rechargeable battery. When the power supply 1509 includes a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery charged through a wired line, and a wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0255] In some embodiments, the terminal 1500 further includes one or more sensors 1510. The one or more sensors 1510 include but are not limited to: an acceleration sensor 1511, a gyroscope sensor 1512, a pressure sensor 1513, a fingerprint sensor 1514, an optical sensor 1515, and a proximity sensor 1516.

[0256] The acceleration sensor 1511 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established with the terminal 1500. For example, the acceleration sensor 1511 can be used to detect the components of the gravitational acceleration on the three coordinate axes. The processor 1501 can control the touch display screen 1505 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 1511. The acceleration sensor 1511 can also be used for games or the collection of the user's motion data.

[0257] The gyroscope sensor 1512 can detect the body direction and rotation angle of the terminal 1500. The gyroscope sensor 1512 can cooperate with the acceleration sensor 1511 to collect the 3D actions of the user on the terminal 1500. Based on the data collected by the gyroscope sensor 1512, the processor 1501 can implement the following functions: motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

[0258] The pressure sensor 1513 can be disposed on the side frame of the terminal 1500 and / or the lower layer of the touch display screen 1505. When the pressure sensor 1513 is disposed on the side frame of the terminal 1500, it can detect the holding signal of the user on the terminal 1500, and the processor 1501 can perform left / right hand recognition or quick operation according to the holding signal collected by the pressure sensor 1513. When the pressure sensor 1513 is disposed on the lower layer of the touch display screen 1505, the processor 1501 can control the operable controls on the UI interface according to the pressure operation of the user on the touch display screen 1505. The operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

[0259] The fingerprint sensor 1514 is used to collect the fingerprint of the user. The processor 1501 can identify the user's identity according to the fingerprint collected by the fingerprint sensor 1514, or the fingerprint sensor 1514 can identify the user's identity according to the collected fingerprint. When the identified user identity is a trusted identity, the processor 1501 authorizes the user to perform relevant sensitive operations, and the sensitive operations include unlocking the display screen, viewing encrypted information, downloading software, making payments, and changing settings, etc. The fingerprint sensor 1514 can be disposed on the front, back, or side of the terminal 1500. When there are physical buttons or manufacturer logos on the terminal 1500, the fingerprint sensor 1514 can be integrated with the physical buttons or manufacturer logos.

[0260] The optical sensor 1515 is used to collect the ambient light intensity. In one embodiment, the processor 1501 can control the display brightness of the touch display screen 1505 according to the ambient light intensity collected by the optical sensor 1515. Specifically, when the ambient light intensity is high, the display brightness of the touch display screen 1505 is increased; when the ambient light intensity is low, the display brightness of the touch display screen 1505 is decreased. In another embodiment, the processor 1501 can also dynamically adjust the shooting parameters of the camera module 1506 according to the ambient light intensity collected by the optical sensor 1515.

[0261] The proximity sensor 1516, also known as a distance sensor, is typically disposed on the front panel of the terminal 1500. The proximity sensor 1516 is used to collect the distance between the user and the front of the terminal 1500. In one embodiment, when the proximity sensor 1516 detects that the distance between the user and the front of the terminal 1500 is gradually decreasing, the touch display screen 1505 is controlled by the processor 1501 to switch from the lit state to the off state; when the proximity sensor 1516 detects that the distance between the user and the front of the terminal 1500 is gradually increasing, the touch display screen 1505 is controlled by the processor 1501 to switch from the off state to the lit state.

[0262] Those skilled in the art can understand that Figure 15 the structure shown in does not constitute a limitation on the terminal 1500, and may include more or fewer components than shown in the figure, or combine certain components, or adopt different component arrangements.

[0263] In this application, the term "at least one of A and B" is merely a description of the association relationship between associated objects, indicating that there can be three relationships. For example, at least one of A and B can represent: A exists alone, A and B exist simultaneously, and B exists alone. Similarly, "at least one of A, B, and C" indicates that there can be seven relationships, which can represent: A exists alone, B exists alone, C exists alone, A and B exist simultaneously, A and C exist simultaneously, C and B exist simultaneously, and A, B, and C exist simultaneously. Similarly, "at least one of A, B, C, and D" indicates that there can be fifteen relationships, which can represent: A exists alone, B exists alone, C exists alone, D exists alone, A and B exist simultaneously, A and C exist simultaneously, A and D exist simultaneously, C and B exist simultaneously, D and B exist simultaneously, C and D exist simultaneously, A, B, and C exist simultaneously, A, B, and D exist simultaneously, A, C, and D exist simultaneously, B, C, and D exist simultaneously, and A, B, C, and D exist simultaneously, these fifteen situations.

[0264] In this application, the terms "first" and "second" are only used for descriptive purposes and cannot be construed as indicating or implying relative importance. The term "plurality" refers to two or more, unless otherwise clearly defined.

[0265] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces. The indirect couplings or communication connections of the devices or units can be in electrical, mechanical or other forms.

[0266] The units described as separate components may or may not be physically separated. The components displayed as units may or may not be physical units, that is, they can be located in one place or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0267] Those of ordinary skill in the art can understand that all or part of the steps to implement the above embodiments can be completed by hardware, or can be completed by a program instructing relevant hardware. The program can be stored in a computer-readable storage medium. The above-mentioned storage medium can be a read-only memory, a disk or an optical disc, etc.

[0268] The above are only alternative embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present application shall be included within the protection scope of the present application.

Claims

1. A method for implementing a video conference, characterized in that, The method includes: Obtaining layout information of a conference screen of a video conference, where the layout information includes information of at least two participant areas in the conference screen and correspondence information between the at least two participant areas and at least two terminals participating in the video conference; Sending information of the corresponding participant area to the at least two terminals; Receiving participant multimedia data provided by the at least two terminals based on the information of the corresponding participant area; Obtaining conference video data based on the participant multimedia data; Sending the conference video data to the at least two terminals, The at least two terminals providing participant multimedia data based on the information of the corresponding participant area includes: Obtaining multimedia data; Based on the information of the participant area and the multimedia data, obtaining participant multimedia data, The obtaining participant multimedia data based on the information of the participant area and the multimedia data includes: Performing person recognition on the multimedia data to determine the area where the person in the multimedia data is located; Based on the information of the participant area and the area where the person is located, processing the multimedia data to obtain the participant multimedia data; where, in the participant multimedia data, the proportion of the area where the person is located is greater than a specified value.

2. The method according to claim 1, characterized in that, The obtaining layout information of the conference screen of the video conference includes: Receiving the layout information sent by a master terminal among the at least two terminals.

3. The method according to claim 2, characterized in that, After receiving the layout information sent by the master terminal, the method further includes: When a master control instruction indicates that a first terminal among the at least two terminals is the master terminal, determining the first terminal as the master terminal.

4. The method according to claim 3, characterized in that, The master control instruction includes at least one of a speech instruction triggered by the first terminal, a master control switching instruction triggered by the first terminal, and a master control switching instruction triggered by the master terminal before the current moment.

5. The method according to any one of claims 1-4, characterized in that, The sending information of the corresponding participant area to the at least two terminals includes: Receiving layout application information sent by a second terminal among the at least two terminals; Based on the layout application information, sending information of the participant area corresponding to the second terminal to the second terminal.

6. The method according to any one of claims 1-4, characterized in that, The obtaining conference video data based on the participant multimedia data includes: When the participant multimedia data includes shared video data, processing the shared video data according to the layout information to obtain the conference video data; where, in the conference video data, the area occupied by the shared video data is greater than the area occupied by other participant multimedia data except the shared video data.

7. The method according to any one of claims 1-4, characterized in that, After obtaining the conference video data based on the participant multimedia data, the method further includes: Displaying the conference video data on a display screen.

8. The method according to any one of claims 1-4, characterized in that, The sending the conference video data to the at least two terminals includes: Receiving layout adjustment information sent by a second terminal among the at least two terminals; Adjusting the conference video data based on the layout adjustment information; Sending the adjusted conference video data to the second terminal.

9. A method for implementing a video conference, characterized in that, The method includes: Obtaining information of the participant area corresponding to the terminal provided by a conference device; Obtain multimedia data; Based on the information of the participant areas and the multimedia data, obtain the participating multimedia data; Provide the participating multimedia data to the conference device; Receive the conference video data provided by the conference device; Display the conference video data, The obtaining the participating multimedia data based on the information of the participant areas and the multimedia data includes: Perform person recognition on the multimedia data to determine the areas where the persons in the multimedia data are located; Based on the information of the participant areas and the areas where the persons are located, process the multimedia data to obtain the participating multimedia data; wherein, in the participating multimedia data, the proportion of the areas where the persons are located is greater than a specified value.

10. The method according to claim 9, characterized in that, The method further includes: Send layout information to the conference device, where the layout information includes information of at least two participant areas in the conference screen, and correspondence information between the at least two participant areas and at least two terminals participating in the video conference.

11. The method according to claim 9 or 10, characterized in that, The obtaining the information of the participant areas corresponding to the terminals provided by the conference device includes: Send layout application information to the conference device; Receive the information of the participant areas corresponding to the terminals fed back by the conference device.

12. The method according to claim 9 or 10, characterized in that, The receiving the conference video data provided by the conference device includes: Send layout adjustment information to the conference device; Receive the conference video data adjusted by the conference device based on the layout adjustment information.

13. The method according to claim 9 or 10, characterized in that, The displaying the conference video data includes: Receive an adjustment instruction; Display the conference video data adjusted according to the adjustment instruction.

14. A video conferencing implementation system, characterized in that, The system includes a conference device and at least two terminals; The conference device is used to obtain layout information of the conference screen of the video conference, where the layout information includes information of at least two participant areas in the conference screen, and correspondence information between the at least two participant areas and at least two terminals participating in the video conference; The conference device is used to send the information of the corresponding participant areas to the at least two terminals; The terminal is used to obtain multimedia data; The terminal is used to obtain the participating multimedia data based on the information of the participant areas and the multimedia data; The terminal is used to provide the participating multimedia data to the conference device; The conference device is used to obtain conference video data based on the participating multimedia data; The conference device is used to send the conference video data to the at least two terminals; The terminal is used to display the conference video data, The terminal is used to obtain the participating multimedia data based on the information of the participant areas and the multimedia data, including: Perform person recognition on the multimedia data to determine the areas where the persons in the multimedia data are located; Based on the information of the participant areas and the areas where the persons are located, process the multimedia data to obtain the participating multimedia data; wherein, in the participating multimedia data, the proportion of the areas where the persons are located is greater than a specified value.

15. The system according to claim 14, characterized in that, The conference device is used to display the conference video data on a display screen; The second terminal among the at least two terminals is configured to send layout adjustment information to the conference device; The conference device is configured to send the conference video data to the first terminal among the at least two terminals, and send the conference video data adjusted based on the layout adjustment information to the second terminal; The first terminal is configured to display the conference video data, and the second terminal is configured to display the adjusted conference video data.

16. A conference device, characterized in that, The conference device includes a processor and a memory. At least one instruction, at least one program, a code set or an instruction set is stored in the memory. The at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to implement the video conferencing implementation method according to any one of claims 1 to 8.

17. A terminal, characterized in that, The conference device includes a processor and a memory. At least one instruction, at least one program, a code set or an instruction set is stored in the memory. The at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to implement the video conferencing implementation method according to any one of claims 9 to 13.

18. A computer non-transitory storage medium, characterized in that, At least one instruction, at least one program, a code set or an instruction set is stored in the computer non-transitory storage medium. The at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by a processor to implement the video conferencing implementation method according to any one of claims 1 to 8.

19. A computer non-transitory storage medium, characterized in that, At least one instruction, at least one program, a code set or an instruction set is stored in the computer non-transitory storage medium. The at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by a processor to implement the video conferencing implementation method according to any one of claims 9 to 13.

Images