A conference data processing method and device, a storage medium and an apparatus
By assigning media proxy servers and media interface servers to participants in a multi-person real-time online conferencing system, and adaptively allocating resources according to the participants' needs, the problem of user number limitation is solved, achieving more efficient resource utilization and a wider range of applicable conferencing scenarios.
Patent Information
- Application Number
- CN202210258324.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-16
- Publication Date
- 2026-02-10
- Estimated Expiration
- 2042-03-16
AI Technical Summary
In existing technologies, the limited server capacity of multi-person real-time online conferencing systems restricts the number of users that can join, thus limiting the use cases for these meetings.
By assigning media proxy servers and media interface servers to meeting participants, resources are adaptively allocated based on the meeting information of each participant, meeting the needs of different participants and achieving on-demand allocation of media server resources.
It improves the resource utilization of the conferencing system, supports more participants in the meeting, expands the applicable scenarios of the meeting, and reduces the data processing pressure on the media interface server.
Smart Images

Figure CN116800723B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of communication technology, and more particularly to a conference data processing method, apparatus, storage medium, and device. Background Technology
[0002] With the development of real-time online conferencing technology, multi-person real-time online conferencing has become the most common way for people to communicate efficiently in their lives and work. The rapid and widespread application of multi-person real-time online conferencing in international conferences, distance education, business negotiations, academic conferences, and other fields has greatly facilitated information exchange.
[0003] Currently, all users participating in the meeting are directly connected to the same server. However, due to the limited server capacity, the number of users that can be connected to the server is limited, which restricts the number of people that the meeting can support and thus limits the use cases of the meeting. Summary of the Invention
[0004] The technical problem to be solved by the embodiments of this application is to provide a meeting data processing method, apparatus, storage medium and device that can support more participants in the target meeting and improve the applicability of the target meeting.
[0005] One embodiment of this application provides a meeting data processing method, including:
[0006] Obtain at least two meeting participants who are participating in the target meeting, and the meeting information of the meeting participants among the at least two meeting participants;
[0007] Based on the meeting information, determine the first meeting participant who meets the conditions for meeting proxy service and the second meeting participant who does not meet the conditions for meeting proxy service from at least two meeting participants;
[0008] Assign a media proxy server to the participants in the first meeting, and assign a media interface server to the participants in the second meeting;
[0009] The media proxy server processes the first meeting media content between the first meeting participants and the second meeting participants, and the media interface server processes the second meeting media content between the second meeting participants.
[0010] One embodiment of this application provides a conference data processing apparatus, including:
[0011] The first acquisition module is used to acquire at least two meeting participants who are participating in the target meeting, as well as the meeting information of the meeting participants among the at least two meeting participants;
[0012] The determination module is used to determine, based on the meeting information of the participants, a first meeting participant that meets the conditions for meeting proxy service and a second meeting participant that does not meet the conditions for meeting proxy service from at least two meeting participants.
[0013] The allocation module is used to allocate media proxy servers to the first meeting participants and media interface servers to the second meeting participants.
[0014] The processing module is used to process the first conference media content between the first conference participants and the second conference participants according to the media proxy server, and to process the second conference media content between the second conference participants according to the media interface server.
[0015] The allocation module includes:
[0016] The first allocation unit is used to obtain the object statistics information of the participants in the first meeting, and allocate media proxy servers to the participants in the first meeting based on the object statistics information of the participants in the first meeting;
[0017] The second allocation unit is used to obtain the object statistics information of the participants in the second meeting, and allocate media interface servers to the participants in the second meeting based on the object statistics information.
[0018] The participants in the second meeting include participant i, participant j, and participant k, where i, j, and k are distinct positive integers.
[0019] The processing module includes:
[0020] The first acquisition unit is used to trigger the media interface server to acquire the raw audio data about the target conference output by the second conference participant i from the first terminal corresponding to the second conference participant i.
[0021] The second acquisition unit is used to trigger the media interface server to acquire the translated speech data about the target conference output by the second conference participant j from the second terminal corresponding to the second conference participant j; the translated speech data is obtained by the second conference participant j translating the original speech data according to the translation language type; the translation language type is the language type associated with the second conference participant k;
[0022] The first determining unit is used to trigger the media interface server to determine the second meeting media content between the participants in the second meeting based on the original voice data and the translated voice data.
[0023] The first sending unit is used to trigger the media interface server to send the media content of the second conference to the third terminal corresponding to the second conference participant k.
[0024] Specifically, the first determining unit is used for:
[0025] The media interface server is triggered to mix the original audio data and the translated audio data to obtain the first mixed audio data. This first mixed audio data is then used as the media content for the second meeting between the participants; or...
[0026] The media interface server is triggered to identify the translated audio data as the second meeting media content between the participants in the second meeting.
[0027] The processing module includes:
[0028] The third acquisition unit is used to trigger the media proxy server to obtain the translated speech data and the original speech data from the media interface server if the participants in the first meeting are associated with the translation language type.
[0029] The second determining unit is used to trigger the media proxy server to determine the first meeting media content between the first meeting participant and the second meeting participant based on the original voice data and the translated voice data;
[0030] The second sending unit is used to trigger the media proxy server to send the media content of the first conference to the fourth terminal corresponding to the participants of the first conference.
[0031] Specifically, the second determining unit is used for:
[0032] The media proxy server is triggered to perform audio mixing on the original audio data and the translated audio data to obtain the second mixed audio data.
[0033] The second mixed audio data is used to determine the first meeting media content between the first meeting participants and the second meeting participants.
[0034] The determining module includes:
[0035] The third determining unit is used to determine the meeting interaction permissions of each of at least two meeting participants based on the meeting information.
[0036] The fourth determining unit is used to determine the meeting participant whose meeting interaction permission is the download permission of meeting media content among at least two meeting participants as the first meeting participant that meets the conditions for meeting proxy service;
[0037] The fifth determining unit is used to identify, among at least two meeting participants, those whose meeting interaction permissions are limited to downloading and uploading meeting media content as the first meeting participant who does not meet the conditions for meeting proxy service.
[0038] The conference data processing device also includes:
[0039] The second acquisition module is used to acquire the changed meeting information of the first meeting participant if a change in the meeting information of the first meeting participant is detected.
[0040] The first switching module is used to switch the media content of the third meeting between the first meeting participants and the second meeting participants to the media interface server if it is determined that the meeting information of the changed participants of the first meeting does not meet the conditions of the meeting proxy service; the media interface server is used to process the media content of the third meeting.
[0041] The conference data processing device also includes:
[0042] The third acquisition module is used to acquire the changed object meeting information of the target meeting participant if a change in the object meeting information of the target meeting participant in the second meeting participant is detected.
[0043] The second switching module is used to switch the fourth meeting media content between the target meeting participant and the remaining meeting participants to the proxy server if the change of the target meeting participant's meeting information meets the meeting proxy service conditions. The proxy server is used to process the fourth meeting media content, and the remaining meeting participants are the meeting participants in the second meeting participants other than the target meeting participant.
[0044] One embodiment of this application provides a computer device, including: a processor and a memory;
[0045] The processor is connected to a memory, which stores a computer program. When the computer program is executed by the processor, it causes the computer device to perform the method provided in the embodiments of this application.
[0046] One aspect of this application provides a computer-readable storage medium storing a computer program adapted to be loaded and executed by a processor, so that a computer device having the processor performs the method provided in this application.
[0047] One embodiment of this application provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the method provided in this application embodiment.
[0048] In this embodiment, at least two meeting participants in the target meeting and their respective meeting information are obtained. Based on this meeting information, a first meeting participant meeting the conditions for meeting proxy service and a second meeting participant meeting the conditions for not meeting the conditions are determined from the at least two participants. Furthermore, a media proxy server is assigned to the first meeting participant, and a media interface server is assigned to the second meeting participant. Here, the meeting proxy service conditions can refer to the conditions for accessing the media proxy server. That is, the first meeting participant is a meeting participant meeting the conditions for accessing the media proxy server. For example, the first meeting participant can be an audience member in the target meeting (i.e., a meeting participant who does not need to speak in the target meeting), or the first meeting participant can be a meeting participant selected from the target meeting participants when the number of participants in the target meeting exceeds a threshold. In other words, media proxy servers can be adaptively assigned to the meeting participants in the target meeting based on the meeting information, enabling on-demand allocation of media server resources and improving resource utilization. Then, the media content of the first meeting between the first and second meeting participants is processed by the media proxy server, and the media content of the second meeting between the second meeting participants is processed by the media interface server. This approach, where the media proxy server handles the first meeting media content between the first and second meeting participants, and the media interface server handles the second meeting media content between the second meeting participants, reduces the data processing load on the media interface machine in the target meeting, supports more participants in the target meeting, and improves the applicability of the target meeting. Attached Figure Description
[0049] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0050] Figure 1 This is a schematic diagram of the architecture of a conference data processing system provided in an embodiment of this application;
[0051] Figure 2 This is a schematic diagram illustrating an application scenario for conference data processing provided in an embodiment of this application;
[0052] Figure 3 This is a flowchart illustrating a meeting data processing method provided in an embodiment of this application;
[0053] Figure 4 This is a structural diagram of a conference data processing system provided in an embodiment of this application;
[0054] Figure 5 This is a schematic diagram of a target meeting interface provided in an embodiment of this application;
[0055] Figure 6 This is a schematic diagram of a target meeting interface provided in an embodiment of this application;
[0056] Figure 7 This is a flowchart of a meeting data processing method provided in an embodiment of this application;
[0057] Figure 8 This is a flowchart illustrating a meeting data processing method provided in an embodiment of this application;
[0058] Figure 9 This is a schematic diagram of the structure of a conference data processing device provided in an embodiment of this application;
[0059] Figure 10 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation
[0060] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0061] This application relates to the field of cloud technology. Specifically, it relates to cloud conferencing technology, which refers to an efficient, convenient, and low-cost conferencing format based on cloud computing technology. Users only need to use an internet interface for simple and easy-to-use operations to quickly and efficiently share voice, data files, and video with teams and clients around the world. The complex technologies involved in data transmission and processing during the meeting are handled by the cloud conferencing service provider. Currently, domestic cloud conferencing mainly focuses on services based on the SaaS (Software as a Service) model, including telephone, internet, and video services. Video conferencing based on cloud computing is called cloud conferencing. In the era of cloud conferencing, data transmission, processing, and storage are all handled by the computer resources of the video conferencing provider. Users no longer need to purchase expensive hardware or install cumbersome software; they only need to open a browser and log in to the corresponding interface to conduct efficient remote meetings.
[0062] Cloud conferencing systems support dynamic multi-server cluster deployment and provide multiple high-performance servers, significantly improving meeting stability, security, and availability. In recent years, video conferencing has gained popularity due to its ability to greatly improve communication efficiency, continuously reduce communication costs, and upgrade internal management, and is widely used in various fields such as transportation, logistics, finance, telecommunications, education, and enterprises. Undoubtedly, with the application of cloud computing, video conferencing will be even more attractive in terms of convenience, speed, and ease of use, inevitably triggering a new surge in video conferencing applications.
[0063] See Figure 1 , Figure 1 This is a schematic diagram of the structure of a conference data processing system provided in an embodiment of this application. Figure 1 As shown, the conference data processing system may include a server 10 and a user terminal cluster. The user terminal cluster may include one or more user terminals; the number of user terminals is not limited here. Figure 1 As shown, it can specifically include user terminal 100a, user terminal 100b, user terminal 100c, ..., user terminal 100n. Figure 1 As shown, user terminals 100a, 100b, 100c, ..., 100n can each connect to the server 10 via a network, so that each user terminal can interact with the server 10 through the network connection.
[0064] Each user terminal in this user terminal cluster can include: smartphones, tablets, laptops, desktop computers, wearable devices, smart home devices, head-mounted devices, in-vehicle terminals, and other smart terminals with conference data processing capabilities. It should be understood that, for example... Figure 1 Each user terminal in the user terminal cluster shown can have a target application (i.e., an application client) installed. Here, the application client can refer to a social application client, office application client, web application client, or other application client that supports conferencing. When this application client runs on each user terminal, it can interact with the aforementioned applications. Figure 1 Data interaction occurs between the servers 10 shown.
[0065] Among them, such as Figure 1 As shown, the server 10 can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.
[0066] For ease of understanding, the embodiments of this application may be described in detail below. Figure 1 Among the multiple user terminals shown, one user terminal is selected as the target user terminal. For example, for ease of understanding, the embodiments of this application can... Figure 1 The user terminal 100a shown serves as the target user terminal. This target user terminal can obtain at least two meeting participants in the target meeting, and the meeting information for each of these participants. This meeting information may include object identification information, object identity information, and object permission information. Further, based on the meeting information of each participant, the target user terminal can determine, from the at least two participants, a first meeting participant that meets the meeting proxy service conditions, and a second meeting participant that does not meet the conditions. The meeting proxy service conditions refer to the conditions for accessing a media proxy server. If a meeting participant meets the meeting proxy service conditions, it can be connected to the media proxy server; if it does not meet the conditions, it will be connected to the media interface server. For example, if a media proxy server has the function of sending conference media content, and if conference participant 1 has the permission to download conference media content among at least two conference participants, then conference participant 1 can be determined to meet the conditions for conference proxy service, and conference participant 1 with the permission to download conference media content can be determined as the first conference participant; if conference participant 2 has both the permission to download and the permission to upload conference media content among at least two conference participants, then conference participant 2 can be determined to not meet the conditions for conference proxy service, and conference participant 2 will be connected to the media interface server.
[0067] Furthermore, the target user terminal can obtain object statistics information of the first meeting participants, such as the number of participants and their location. Based on this information, the target user terminal can allocate media proxy servers to the first meeting participants. The media proxy servers then process the first meeting media content between the first and second meeting participants. Similarly, the target user terminal can obtain object statistics information of the second meeting participants, including the number of participants and their location. Based on this information, the target user terminal can allocate media proxy servers to the second meeting participants. The media proxy servers then process the second meeting media content between the second meeting participants. This allows for the allocation of media proxy servers to first meeting participants who meet the conditions for meeting proxy services, enabling on-demand resource allocation, improving resource utilization, increasing the number of participants the target meeting can support, and thus expanding the applicable scenarios for the target meeting.
[0068] For better understanding, please refer to [link / reference]. Figure 2 , Figure 2 This is a schematic diagram illustrating an application scenario for conference data processing provided in an embodiment of this application. Wherein, as... Figure 2 The server 20d shown can be the server 10 mentioned above, such as... Figure 2 The user terminals 20a, 20e, and 20h shown can be the above-mentioned Figure 1 This refers to any user terminal in the user terminal cluster shown. User terminal 20a can be the user terminal corresponding to object 20b, user terminal 20e can be the user terminal corresponding to object 20f, and user terminal 20h can be the user terminal corresponding to object 20i. For example... Figure 2 As shown, object 20b can join the target meeting through the display interface 20c provided by user terminal 20a. This target meeting can be any type of meeting initiated by the meeting initiator. Object 20b can be a guest speaker in the target meeting, delivering remarks related to the meeting. After object 20b joins the target meeting, user terminal 20a can identify it as a participant. Furthermore, user terminal 20a can obtain the target meeting information of participant 20b and determine whether participant 20b meets the conditions for meeting proxy services. The conditions for meeting proxy services can refer to the conditions for accessing a media proxy server. If the condition for accessing the media proxy server is that the participant only has download permissions for meeting media content, then since participant 20b is a guest speaker in the target meeting, it has both download and upload permissions for meeting media content. Therefore, since participant 20b does not meet the conditions for the conference proxy service, participant 20b becomes the second participant. Further, after user terminal 20a determines participant 20b as the second participant, it can assign a media interface server 20d to participant 20b. Participants connected to this media interface server 20d have download and upload permissions for conference media content. Media interface server 20d can, based on the conference configuration information corresponding to participant 20b (i.e., the upload language type of the raw audio data that participant 20b needs to upload, and the second download language type of the conference media content to be received in the target conference), distribute the conference media content of the target conference to participant 20b and receive the raw audio data uploaded by participant 20b.
[0069] like Figure 2As shown, object 20f can join the target conference through the display interface 20g provided by user terminal 20e. Object 20f can refer to an interpreter in the target conference, i.e., an translator who can translate the raw audio data uploaded by conference guests into translated audio data in the target language. After object 20f joins the target conference, user terminal 20e can identify it as a conference participant. Furthermore, user terminal 20e can obtain the conference information of participant 20f and determine whether participant 20f meets the conditions for conference proxy service based on this information. The condition for accessing the media proxy server is that the conference participant only has the permission to download conference media content. Since participant 20f is an interpreter in the target conference, it has both download and upload permissions for conference media content. Therefore, participant 20f does not meet the conditions for conference proxy service, and thus becomes a second conference participant. Furthermore, after user terminal 20e identifies meeting participant 20f as the second meeting participant, it can assign a media interface server 20d to meeting participant 20f. Meeting participants connected to this media interface server 20d have download and upload permissions for meeting media content. Media interface server 20d can send raw audio data to meeting participant 20f and receive the translated audio data uploaded by meeting participant 20f based on the meeting configuration information corresponding to meeting participant 20f (i.e., the translation language type of the translated audio data that meeting participant 20f needs to upload, and the second download language type of the raw audio data received from the target meeting).
[0070] like Figure 2As shown, object 20i can join the target meeting through the display interface 20j provided by user terminal 20h. Object 20i can refer to a meeting audience member in the target meeting, i.e., an audience member listening to the speeches delivered by the meeting speakers. After object 20i joins the target meeting, user terminal 20h can identify it as a meeting participant. Furthermore, user terminal 20h can obtain the meeting information of meeting participant 20i and, based on this information, determine whether meeting participant 20i meets the meeting proxy service conditions. These conditions require the meeting participant to only have download permissions for meeting media content. Since meeting participant 20i is a meeting audience member in the target meeting, it has download permissions for meeting media content. Therefore, meeting participant 20i meets the meeting proxy service conditions and is thus designated as the first meeting participant. Furthermore, after user terminal 20h identifies meeting participant 20i as the first meeting participant, it can allocate a media proxy server 20k to meeting participant 20i. Meeting participants connected to this media proxy server 20k have the right to download meeting media content. Media proxy server 20k can distribute the target meeting media content to meeting participant 20i based on the meeting configuration information corresponding to meeting participant 20i (i.e., the first download language type that meeting participant 20i needs to receive from the target meeting's media content). In this way, by determining the object requirements of meeting participants based on their meeting information, and allocating media proxy servers and media interface servers accordingly, the pressure on the media interface server can be reduced. This avoids connecting all meeting participants to the media interface server, which has a limited capacity, thus limiting the number of objects the target meeting can support and consequently restricting its applicable scenarios. Simultaneously, allocating media proxy server resources or media proxy server resources to meeting participants based on their specific needs enables on-demand resource allocation and improves resource utilization.
[0071] Please see Figure 3 , Figure 3 This is a flowchart illustrating a meeting data processing method provided in an embodiment of this application. The meeting data processing method can be... Figure 1 It can be executed by any user terminal in the system, or by... Figure 1 The server in the middle can be used to execute it, or it can be executed by... Figure 1 The method can be executed jointly by any user terminal and server in this application, and the device used to execute the method in this application can be collectively referred to as a computer device. For example... Figure 3As shown, the meeting data processing method may include, but is not limited to, the following steps:
[0072] S101, obtain at least two meeting participants who are participating in the target meeting, and the meeting information of the meeting participants among the at least two meeting participants.
[0073] Specifically, the computer device can acquire information about at least two participants in the target meeting. The target meeting can refer to a simultaneous interpretation conference, i.e., a conference that simultaneously transmits audio or video data in multiple languages. The computer device can also acquire object meeting information for each of the at least two participants. This object meeting information can include the participant's identifier, identity, permissions, request information, and the time they joined the target meeting. This object meeting information can be configured on each participant's corresponding terminal, or it can be configured on the target meeting administrator's corresponding terminal; for example, the target meeting administrator could be the entity that created the target meeting.
[0074] It should be noted that when the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use, and processing of the meeting information of the meeting participants must comply with the relevant laws, regulations, and standards of the relevant countries and regions. In other words, the computer device can only obtain the meeting information of the meeting participants after obtaining authorization from the user; that is, the meeting information of the meeting participants is only obtained after user authorization.
[0075] S102, based on the meeting information, determine the first meeting participant that meets the meeting proxy service conditions and the second meeting participant that does not meet the meeting proxy service conditions from at least two meeting participants.
[0076] Specifically, the computer equipment can determine, based on the meeting information of each of at least two meeting participants, a first meeting participant that meets the meeting proxy service conditions and a second meeting participant that does not meet the meeting proxy service conditions. The meeting proxy service conditions refer to the conditions for accessing a media proxy server. That is, if a meeting participant meets the meeting proxy service conditions, the first meeting participant who meets the conditions can be connected to the media proxy server; if a meeting participant does not meet the meeting proxy service conditions, the second meeting participant who does not meet the conditions will be connected to another media server.
[0077] Optionally, when the target meeting information includes target identity information, target permission information, and target requirement information, the first meeting participant can refer to an audience member who joins the target meeting but does not need to speak in the target meeting; they only need to download the meeting media data related to the target meeting, i.e., they have download permissions for the meeting media content in the target meeting. The second meeting participant can refer to a participant who needs to speak in the target meeting; that is, the second meeting participant needs to upload raw audio data to the target meeting and also needs to download the meeting media content in the target meeting, possessing both download and upload permissions for the meeting media content. For example, the second meeting participant can include meeting guests and interpreters or translators.
[0078] Optionally, when the target meeting information includes the time of joining the target meeting, the first meeting participant can refer to the meeting participants selected from the target meeting participants based on the time of joining the target meeting when the number of meeting participants in the target meeting exceeds a threshold. For example, the first meeting participant can refer to the meeting participants who joined the target meeting after the number of meeting participants in the target meeting exceeded the threshold, and the second meeting participant can refer to the meeting participants who joined the target meeting before the number of meeting participants in the target meeting exceeded the threshold. Of course, the computer device can randomly select the first meeting participants from the target meeting participants when the number of meeting participants in the target meeting exceeds the threshold, and use the meeting participants in the target meeting other than the first meeting participants as the second meeting participants.
[0079] Optionally, the specific method by which the computer device determines the first meeting participant who meets the meeting proxy service conditions and the second meeting participant who does not meet the meeting proxy service conditions from at least two meeting participants based on the meeting information may include: determining the meeting interaction permissions of each of the at least two meeting participants based on the meeting information; identifying the meeting participants whose meeting interaction permissions are limited to downloading meeting media content as the first meeting participant who meets the meeting proxy service conditions; and identifying the meeting participants whose meeting interaction permissions are limited to both downloading and uploading meeting media content as the first meeting participant who does not meet the meeting proxy service conditions.
[0080] Specifically, the computer device can determine the meeting interaction permissions of each participant in at least two meeting participants based on the meeting information. Specifically, the computer device can determine the meeting interaction permissions of each participant based on the participant's object identifier information, object identity information, object permission information, and object requirement information. Meeting interaction permissions can include download permissions and / or upload permissions for meeting media content, which can refer to meeting audio data, meeting video data, meeting image data, and meeting text data, etc. Further, the computer device can identify the participant with the meeting interaction permission of downloading meeting media content as the first meeting participant meeting the conditions for meeting proxy service. The computer device can identify the participant with both meeting interaction permissions of downloading and uploading meeting media content as the first meeting participant not meeting the conditions for meeting proxy service. It can be understood that the conditions for meeting proxy service refer to the conditions for joining a media proxy server, which allows access to the media proxy server's processing capabilities for meeting media content.
[0081] Optionally, the meeting initiator of the target meeting can pre-set the meeting interaction permissions for the participants, resulting in a meeting interaction permission table. For example, when object 1 joins the target meeting, it has meeting interaction permission 1; when object 2 joins the target meeting, it has meeting interaction permission 2, and so on. Specifically, when an object is detected participating in the target meeting, it is identified as a meeting participant, and its object identifier is obtained. The meeting interaction permissions corresponding to the object identifier are then retrieved from the meeting interaction permission table.
[0082] Optionally, the computer device can obtain the identity information of the meeting participants and the meeting type of the target meeting. Based on the identity information of the meeting participants and the meeting type of the target meeting, the device can determine the meeting interaction permissions of the meeting participants. For example, when the target meeting is an annual work summary meeting, the device can obtain the identity information of the meeting participants, determine the object type of the meeting participants based on the identity information, and determine the meeting interaction permissions of the meeting participants based on the object type. Meeting interaction permissions may include upload permissions and / or download permissions for meeting media content. If the computer device can determine that the object type of the meeting participant is a leader, then the meeting interaction permissions for the meeting participant can be determined to be download permissions and upload permissions for meeting media content. If the computer device determines that the object type of the meeting participant is an employee, then the meeting interaction permissions for the meeting participant can be determined to be download permissions for meeting media content.
[0083] Optionally, the computer device can determine the meeting interaction permissions of meeting participants based on their object-specific needs information. Specifically, the computer device can obtain information about a meeting participant's usage of media receiving devices (such as microphones, cameras, etc.) and determine their object-specific needs information accordingly. For example, when the computer device detects that a meeting participant has both their microphone and speaker turned on for the target meeting, it can determine that the participant has the need to upload and download meeting media content; when the participant has only turned on their speaker, it can determine that they have the need to download meeting media content. Further, the computer device can determine the meeting interaction permissions of meeting participants based on their object-specific needs information. For example, if a meeting participant has the need to download meeting media content, their meeting interaction permission can be determined to be the permission to download meeting media content; if a meeting participant has the need to both download and upload meeting media content, their meeting interaction permission can be determined to be both the permission to download and upload meeting media content.
[0084] S103, assign a media proxy server to the first meeting participant and a media interface server to the second meeting participant.
[0085] Specifically, since the conditions for meeting proxy service can be the conditions for accessing a media proxy server, and the first meeting participant meets the conditions, a media proxy server can be assigned to the first meeting participant. Since the second meeting participant does not meet the conditions, a media interface server is assigned to the second meeting participant. In this way, media proxy servers can be adaptively assigned to meeting participants in the target meeting based on the meeting information, enabling on-demand allocation of media server resources and improving resource utilization.
[0086] Specifically, the computer equipment can obtain object statistics information of the participants in the first meeting, such as the number of participants and their location. Based on this information, the computer equipment can assign a media proxy server to each participant in the first meeting. Similarly, the computer equipment can obtain object statistics information of the participants in the second meeting, such as the number of participants and their location. Based on this information, the computer equipment can assign a media interface server to each participant in the second meeting.
[0087] Optionally, the media proxy server and the interface server can provide different media services. For example, the media proxy server can provide download services for conference media content, while the interface servers can provide both upload and download services for conference media content. In this case, the first conference participant can refer to a participant with download permissions for the conference media content in the target conference, and the second conference participant can refer to a participant with both download and upload permissions for the conference media content in the target conference. That is, the media proxy server can obtain the conference media content for the target conference from the media interface server, process the conference media content to obtain the first media conference content, and send the first conference media content to the first terminal corresponding to the first conference participant. This allows the first conference participant, who only has download permissions for conference media content, to be connected to the media proxy server, and the media proxy server to send the conference media content for the target conference to the first conference participant. This reduces the load on the media interface server, thereby expanding the number of participants supported by the target conference and broadening the application scenarios of the target conference. In this way, by allocating media proxy machines to the first meeting participants who meet the conditions for meeting proxy servers, and allocating media interface machines or other media proxy machines to the second meeting participants who do not meet the conditions for meeting proxy services, resources can be allocated on demand, thereby improving resource utilization.
[0088] Optionally, the media proxy server and the interface server can provide the same media services. For example, both the media proxy server and the interface server can provide upload and download services for conference media content. In this case, the first conference participant can refer to the participant who joins the target conference after the number of participants in the target conference exceeds a certain threshold, and the second conference participant can refer to the participant who joins the target conference before the number of participants in the target conference exceeds the threshold. That is, the media proxy server handles the media conference content related to the first conference participant, and the media interface server handles the media conference content related to the second conference participant. This can reduce the pressure on the media interface server, thereby expanding the number of participants supported by the target conference and broadening the use cases of the target conference. In this way, by allocating media proxy machines to the first conference participants who meet the conditions for conference proxy service, and allocating media interface machines or other media proxy machines to the second conference participants who do not meet the conditions for conference proxy service, on-demand resource allocation can be achieved, improving resource utilization.
[0089] Optionally, the specific details of the computer device's allocation of media proxy servers for the first batch of conference participants may include: the computer device can allocate media proxy servers based on the number of participants in the first batch of conference participants. Specifically, the computer device can obtain the number of participants in the first batch of conference participants and the capacity of each media proxy server, and allocate media proxy servers to the participants based on the number of participants and the capacity of each media proxy server. For example, if the number of participants in the first batch of conference participants is 1000, and the capacity of each media proxy server is 600, then the participants in the first batch of conference participants can be allocated to two media proxy servers. In this way, allocating media proxy servers to the participants in the first batch of conference participants based on the number of participants can avoid the situation where too many participants are allocated to a single media proxy server, exceeding the capacity of the media proxy server and causing it to malfunction, thus improving the accuracy of media proxy server allocation.
[0090] Optionally, the specific details of the computer device assigning media proxy servers to the first meeting participants may include: the computer device can assign media proxy servers based on the location information of the first meeting participants. Specifically, the computer device can obtain the location information of the first meeting participants and the location information of the media servers, and assign media proxy servers to the first meeting participants based on these two information. Specifically, the computer device can obtain the matching degree between the location information of the first meeting participant 1 and the location information of each media proxy server in the media proxy server set, and assign the media proxy server with the highest matching degree to the first meeting participant 1. For example, if the location information of the first meeting participant 1 is China, then a media proxy server with a server location in China can be assigned to the first meeting participant; if the location information of the first meeting participant 2 is the United States, then a media proxy server with a server location in the United States can be assigned to the first meeting participant 2. This can reduce the latency of sending and receiving conference media data and improve the efficiency of data transmission.
[0091] Similarly, the method by which the computer device allocates a media interface server for the second meeting participants can refer to the method by which it allocates a media proxy server for the first meeting participants, and will not be described again in this embodiment.
[0092] S104, based on the media proxy server, process the first conference media content between the first conference participants and the second conference participants, and based on the media interface server, process the second conference media content between the second conference participants.
[0093] Specifically, after the computer equipment assigns a media proxy server to the first meeting participants, it can process the first meeting media content between the first meeting participants and the second meeting participants according to the media proxy server, and process the second meeting media content between the second meeting participants according to the media interface server.
[0094] Specifically, the computer equipment can allocate media interface servers to the second meeting participants based on the number of participants and / or their location information. The media interface servers then process the media content between the second meeting participants. In this way, the computer equipment can determine the first meeting participants who meet the conditions for meeting proxy services and the second meeting participants who do not. Further, a media proxy server is allocated to the first meeting participants, and a media interface server is allocated to the second meeting participants. Allocating media proxy servers or media interface servers according to the specific needs of the meeting participants allows for on-demand configuration, assigning appropriate media servers to each participant. This also avoids assigning all meeting participants to a media interface server, reducing the data processing load on the media interface server and thus increasing the number of participants the target meeting can support, expanding the target meeting's application scenarios.
[0095] It is understood that this application implements the following: based on the object meeting information of each of at least two meeting participants, it determines the meeting participants who meet the conditions for meeting proxy services as the first meeting participants, and determines the meeting participants who do not meet the conditions for meeting proxy services as the second meeting participants. Further, a media proxy server is assigned to the first meeting participants, and a media interface server is assigned to the second meeting participants. Both the media proxy server and the media interface server are media servers for the target meeting, used to process the meeting media content of the target meeting, such as receiving raw audio data uploaded by meeting participants in the target meeting, receiving translated audio data based on the raw audio data, or sending raw audio data and / or translated audio data. The first meeting participant connected to the media proxy server can obtain the meeting media content of the target meeting, i.e., it has the permission to download the meeting media content of the target meeting. The second meeting participant connected to the media interface server can obtain the meeting media content of the target meeting and upload meeting media content related to the target meeting, i.e., it has the permission to download the meeting media content of the target meeting and the permission to upload meeting media content related to the target meeting. This allows for the allocation of media interface server resources and media proxy server resources associated with the target meeting based on the meeting information of the meeting participants (such as the specific needs of the participants), thereby achieving on-demand allocation of media server resources and improving the utilization rate of media server resources.
[0096] Specifically, after the computer equipment assigns a media proxy server to the first meeting participant, it can determine the first meeting configuration information of the first meeting participant based on the first meeting participant's meeting information. This first meeting configuration information may include a first download language type, which refers to the language type from which the first meeting participant needs to obtain audio data from the target meeting. For example, the first meeting participant could be a meeting audience attending the target meeting. If the first meeting participant needs to obtain audio data in Chinese from the target meeting, then the first download language type is Chinese. After assigning the media proxy server, the computer equipment can send the first meeting configuration information of the first meeting participant to the media proxy server. The media proxy server can then allocate meeting media content from the target meeting to the first meeting participant based on this first meeting configuration information. For example, if the first download language type of the first meeting participant A is Chinese, the media proxy server can obtain Chinese audio data from the target meeting and send this audio data to the first terminal corresponding to the first meeting participant A. The first terminal corresponding to the first meeting participant A can then output the Chinese audio data.
[0097] Specifically, after the computer equipment assigns a media interface server to the participants in the second meeting, it can determine the second meeting configuration information of the participants based on their meeting information. This second meeting configuration information can include a second download language type and an upload language type. The second download language type refers to the language type from which the participants need to obtain audio data from the target meeting, and the upload language type refers to the language type from which the participants upload the original audio data related to the target meeting. For example, a participant could be a guest at the target meeting who needs to obtain audio data in Chinese; in this case, the second download language type would be Chinese. Similarly, a participant could be an interpreter at the target meeting who needs to translate the original audio data uploaded by the guest to obtain translated audio data. The upload language type could then refer to the language type of the translated audio data uploaded by the interpreter. Of course, the upload language type could also refer to the language type of the original audio data uploaded by the guests at the target meeting.
[0098] Specifically, after the computer equipment assigns a media interface server to the second meeting participant, it can send the second meeting configuration information of the second meeting participant to the media interface server. The media interface server can then allocate meeting media content from the target meeting to the second meeting participant and receive the meeting media content uploaded by the second meeting participant regarding the target meeting, based on the second meeting participant's second meeting configuration information. For example, if second meeting participant B can be a meeting guest in the target meeting, and if second meeting participant B needs to upload raw audio data in Chinese language and receive audio data in Chinese language from the target meeting, then the upload language type and the download language type in the second meeting participant's second meeting configuration information will both be Chinese language. The media interface server can then, based on second meeting participant B's second meeting configuration information, send audio data in Chinese language to the first terminal corresponding to second meeting participant B (this audio data in Chinese language can refer to raw audio data in Chinese language uploaded by other meeting guests in the target meeting, or translated audio data in Chinese language uploaded by interpreters), and receive raw audio data in Chinese language input by the second meeting participant. For example, if participant C in the second meeting is an interpreter in the target meeting, and the second download language type in the second meeting configuration information corresponding to participant C is Chinese and the upload language type is English, then the media interface server can obtain the raw Chinese language audio data from the target meeting and send it to the second terminal corresponding to participant C. The second terminal corresponding to participant C can output the raw Chinese language audio data. Participant C can translate the raw Chinese language audio data to obtain translated English language audio data and input the translated English language audio data into the second terminal. The media interface server can then obtain the translated English language audio data from the second terminal corresponding to participant C.
[0099] Optionally, the second meeting participants include second meeting participant i, second meeting participant j, and second meeting participant k, where i, j, and k are distinct positive integers. The specific method by which the computer device processes the second meeting media content between the second meeting participants according to the media interface server may include: triggering the media interface server to obtain the original audio data about the target meeting output by second meeting participant i from the first terminal corresponding to second meeting participant i; triggering the media interface server to obtain the translated audio data about the target meeting output by second meeting participant j from the second terminal corresponding to second meeting participant j; the translated audio data is obtained by second meeting participant j translating the original audio data according to the translation language type; the translation language type is the language type associated with second meeting participant k; triggering the media interface server to determine the second meeting media content between the second meeting participants based on the original audio data and the translated audio data; and triggering the media interface server to send the second meeting media content to the third terminal corresponding to second meeting participant k.
[0100] Specifically, the second participant i can be a guest in the target conference. Participant i can upload audio data about the target conference by opening a media content receiving device (such as a microphone) on their first terminal. The first terminal corresponding to participant i can receive the audio data input by participant i as the raw audio data. The computer device can trigger the media interface server to obtain the raw audio data about the target conference output by participant i from the first terminal corresponding to participant i. Simultaneously, the computer device can output its own raw audio data about the target conference to participant i through the first terminal corresponding to participant i. It is understandable that participant i can listen to the raw audio data about the target conference they uploaded while uploading it.
[0101] Furthermore, after the computer device obtains the original audio data of the target meeting from the second meeting participant i, it can determine the language type of the original audio data and identify the second meeting participant j who will translate the original audio data. This second meeting participant j can refer to a conference interpreter, i.e., the translation target. The computer device can trigger a media interface server to send the original audio data to the second terminal corresponding to the second meeting participant j in real time, and output the original audio data to the second meeting participant j through the second terminal. Furthermore, the second meeting participant j can translate the original audio data according to the translation language type, translating the original audio data of the first language type into translated audio data of the second language type. Here, the translation language type can refer to the language type associated with the second meeting participant k. It can be understood that the translation language type can refer to the language type of the audio data that the second meeting participant k needs to receive. For example, if the second meeting participant needs to receive Chinese audio data, then the translation language type is Chinese. The second meeting participant j can input the translated audio data through a media content receiving device (such as a microphone) in the second terminal.
[0102] Furthermore, the computer device can obtain the translated audio data about the target meeting output by the second meeting participant j from the second terminal corresponding to the second meeting participant j. Furthermore, the computer device can trigger the media interface server to determine the second meeting media content between the second meeting participants based on the original audio data and the translated audio data. Furthermore, the computer device can trigger the media interface server to send the second meeting media content to the third terminal corresponding to the second meeting participant k, so that the second meeting participant k receives the translated audio data.
[0103] For example, participant 1 (a meeting guest) uploads raw audio data about the target meeting, which can be in English. The computer can trigger a media interface device to retrieve the raw audio data from participant 1 from the first terminal. Further, the computer can obtain the translation language of the audio data to be received by participant 3, and determine participant 2 (an interpreter or translator) to translate the raw audio data. For instance, if the translation language is Chinese, participant 2 will translate the English audio into Chinese. Further, the computer can trigger a media interface server to send the raw audio data from participant 1 to the second terminal corresponding to participant 2, who then inputs the raw audio data. Participant 2 can then translate the raw audio data, converting the English audio data into Chinese audio data. Furthermore, the second meeting participant 2 can input translated voice data through a second terminal. The computer device can then obtain the translated voice data about the target meeting input by the second meeting participant 2 from the second terminal corresponding to the second meeting participant 2 via a media interface server; that is, the translated voice data that translates the original voice data. Further, the computer device can trigger the media interface server to determine the second meeting media content between the second meeting participants based on the original voice data and the translated voice data, and send the second meeting media content to the third terminal corresponding to the second meeting participant 3.
[0104] Optionally, the specific method by which the computer device determines the second meeting media content between the second meeting participants may include: triggering the media interface server to perform audio mixing processing on the original voice data and the translated voice data to obtain first mixed voice data, and determining the first mixed voice data as the second meeting media content between the second meeting participants; or, triggering the media interface server to determine the translated voice data as the second meeting media content between the second meeting participants.
[0105] Specifically, computer equipment can trigger a media interface server, which, through its mixing service, mixes the original and translated audio data to obtain first mixed audio data. This first mixed audio data is then used to determine the second meeting media content for the second group of participants. The mixing process involves integrating sounds from multiple sources into a single stereo or mono track. During mixing, the frequency, dynamics, timbre, localization, reverberation, and sound field of each original signal are individually adjusted to optimize each track. These tracks are then superimposed onto the final product, creating a perfectly layered sound that is inaudible to a typical audience during live recording. The computer equipment's mixing of the original and translated audio data allows the first group of participants to hear both simultaneously. Alternatively, the computer equipment can trigger the media interface server to directly use the translated audio data to determine the second meeting media content for the second group of participants. Understandably, after the computer device obtains the translated speech data, it can trigger the media interface server to directly send the translated speech data to the second meeting participant k through the media interface server, or it can perform audio mixing processing on the translated speech data and the original speech data to obtain the first mixed speech data, and send the first mixed speech data to the second meeting participant k.
[0106] Optionally, the specific method by which the computer device processes the first meeting media content between the first and second meeting participants according to the media proxy server may include: if the first meeting participant is associated with a translation language type, then the media proxy server is triggered to obtain translated speech data and original speech data from the media interface server. The media proxy server is then triggered to determine the first meeting media content between the first and second meeting participants based on the original speech data and translated speech data. Finally, the media proxy server is triggered to send the first meeting media content to the fourth terminal corresponding to the first meeting participant.
[0107] Specifically, the computer device can obtain the meeting configuration information of the first meeting participant. This configuration information may refer to the download language type of the meeting media content downloaded by the first meeting participant. Based on the meeting configuration information of the first meeting participant, the computer device detects whether the first meeting participant is associated with the translation language type. If the download language type of the meeting media content downloaded by the first meeting participant is the same as the translation language type, it can be determined that the first meeting participant is associated with the translation language type; if the download language type of the meeting media content downloaded by the first meeting participant is different from the translation language type, it can be determined that the first meeting participant is not associated with the translation language type. Further, if the computer device determines that the first meeting participant is associated with the translation language type, it can trigger the media proxy server, and obtain the translated voice data and the original voice data from the media proxy server. Based on the original voice data and the translated voice data, the computer device determines the first meeting media content between the first meeting participant and the second meeting participant. Further, the computer device can send the first meeting media content to the fourth terminal corresponding to the first meeting participant through the media proxy server.
[0108] For example, if participant A needs to receive Chinese language audio data from the target meeting, the computer can determine the language type of the original audio data uploaded by participant B (the meeting guest who uploaded the original audio data). If the language type of the original audio data is the same as the Chinese language type of the audio data that participant A needs to receive, i.e., the language type of the original audio data is Chinese, then the original audio data uploaded by participant B can be sent to participant A. If the language type of the original audio data is different from the language type of the audio data that participant A needs to receive, i.e., the language type of the original audio data is not Chinese, but English, German, or other languages besides Chinese, then it can be detected whether participant A is associated with the translated audio type. If the download language type of the meeting media content downloaded by participant A is the same as the translated language type, then it can be determined that participant A is associated with the translated language type. This translated audio type refers to the translation language type used by participant C (the interpreter or translator) to translate the original audio data, that is, the original audio data is translated into translated language data. Understandably, if the first meeting participant A receives audio data in Chinese, and the translation language is Chinese (i.e., the original audio data in other languages is translated into Chinese), then the first meeting participant can be associated with the translation language. Furthermore, the computer device can trigger a media proxy server to retrieve the translated audio data and the original audio data from the media interface server. The computer device can then trigger the media proxy server to determine the first meeting media content between the first meeting participant A and the second meeting participant B based on the original and translated audio data, and send the first meeting media content to the fourth terminal corresponding to the first meeting participant.
[0109] Optionally, the specific method by which the computer device determines the first meeting media content between the first meeting participant and the second meeting participant may include: triggering a media proxy server to mix the original audio data and the translated audio data to obtain second mixed audio data. The second mixed audio data is then used to determine the first meeting media content between the first meeting participant and the second meeting participant.
[0110] Specifically, the computer device can trigger the media proxy server to mix the original voice data and the translated voice data to obtain second mixed voice data, and then identify the second mixed voice data as the first meeting media content between the first meeting participants and the second meeting participants.
[0111] Optionally, the specific method by which the computer device determines the first meeting media content between the first meeting participant and the second meeting participant may include: if the first meeting participant is associated with a translation language type, the computer device may trigger a media proxy server, which, through the media proxy server, obtains the first mixed audio data between the original audio data and the translated audio data from the media interface server. This first mixed audio data is then determined as the first meeting media content between the first meeting participant and the second meeting participant.
[0112] Optionally, the specific method by which the computer device determines the first meeting media content between the first meeting participant and the second meeting participant may include: if the first meeting participant is associated with a translation language type, the computer device may trigger a media proxy server to obtain translated audio data from a media interface server. The translated audio data is then determined as the first meeting media content between the first and second meeting participants.
[0113] Optionally, if the first meeting participant is not associated with the translation language type, the language type of the audio data that the first meeting participant needs to receive is obtained, and this language type is determined as the target translation language type. The computer device can obtain the target translation audio data and original audio data corresponding to the target translation language type from the media interface server via a media proxy server. The computer device can then mix the target translation audio data and original audio data using the media proxy server to obtain third mixed audio data, which is then determined as the first meeting media content between the first and second meeting participants. For example, if the first meeting participant needs to receive audio data in English, the media proxy server can be triggered to obtain the original audio data and the target translation audio data of English translation type from the media interface server, and then mix these two audio data to obtain third mixed audio data, which is then determined as the first meeting media content between the first and second meeting participants.
[0114] Specifically, the media proxy server can directly obtain the first meeting media content between the first meeting participant and the second meeting participant from the media interface machine based on the first meeting configuration information of the first meeting participant (such as the first download language type of the meeting media content downloaded by the first meeting participant in the target meeting), and send the first meeting media content to the fourth terminal where the first meeting participant is located. In this way, the media proxy server does not need to obtain the voice data (such as raw voice data and translated voice data) of the target meeting from the terminal corresponding to the second meeting participant, reducing the data processing burden, supporting a larger number of participants, and also realizing simultaneous interpretation of the target meeting, greatly improving the scale of simultaneous interpretation that the target meeting can support.
[0115] Optionally, the conference data processing method provided in this application embodiment can be executed by a conference control system, a conference simultaneous interpretation configuration management system, an interface machine system (i.e., a media interface server), and a proxy machine system (i.e., a media proxy server). The main functions of the conference control system are to manage the conference status of the target conference (such as conference start, conference pause, and conference termination) and manage object permissions (e.g., determining the conference permissions of conference participants based on their conference information, which may refer to upload and download permissions for conference media content). Simultaneously, the conference control system can obtain user operations of conference participants on their corresponding terminals. It is understood that when the target conference starts, the operations and status information of conference guests, audience members, and interpreters in the target conference will be synchronized to the conference control system. For example, operations such as administrators activating simultaneous interpretation, interpreters switching translation languages, and audience members switching the language of the audio being listened to will all be synchronized to the conference control system.
[0116] In addition, the conference control system synchronizes changes to conference participants with the conference simultaneous interpretation configuration management system. Specifically, all terminal operations performed by conference participants in the target conference are synchronized to the conference control system. For example, when a participant initiates simultaneous interpretation for the target conference or uses the target conference on a corresponding terminal, the target conference's built-in state synchronization protocol synchronizes the current real-time state of the target conference to the conference control system in the conference backend. While maintaining a series of state dimensions between the conference control system and the participants' terminals, the system synchronizes the current real-time state of the target conference to the state synchronization system in the conference backend, storing the data for business queries. The conference simultaneous interpretation configuration management system interfaces with the conference control system, the proxy machine system, and the interface machine system. It retrieves the conference configuration information corresponding to each participant from the conference control system and synchronizes this information to the proxy machine system and the interface machine system. Essentially, the conference simultaneous interpretation configuration management system primarily interfaces with the services of the conference control system and the media side (i.e., the interface machine system and the proxy machine system), synchronizing the simultaneous interpretation configuration information (i.e., the conference configuration information of the participants) to the corresponding media side services based on the participants' conference information.
[0117] The main function of the interface system is to manage the uplink and downlink of media streams for at least two participants in the target conference. This uplink and downlink refers to uploading conference media content to and from the target conference. In simultaneous interpretation conferences, the interface system can also manage the conference configuration information of the interpreters participating in the target conference, namely, the upload language type of the translated audio data uploaded by the interpreters and the selected download language type. Simultaneous interpretation conferences refer to a translation method in which interpreters provide uninterrupted oral translation to the audience without interrupting the speaker. Simultaneous interpreters provide real-time translation through dedicated equipment, and this method is suitable for large seminars and international conferences. The mixing service in the interface system can distribute the raw audio data uploaded by conference guests and the translated audio data uploaded by interpreters to the terminals of other participants in the target conference and the media proxy server. The proxy system can simulate a robot in the media streaming room, acquiring raw and translated audio data from the interface system and distributing the raw and translated audio data to the terminals of the participants according to the conference configuration information sent by the conference control system. This enables the media proxy server to support simultaneous interpretation for the target conference, greatly expanding the scale of the target conference that can be supported in simultaneous interpretation scenarios. It also enables simultaneous interpretation support for large room conferences (i.e., large-scale real-time online conferences, such as those with 2,000 or more participants), significantly expanding the application scenarios of simultaneous interpretation conferences in large-scale multinational conferences.
[0118] like Figure 4As shown, Figure 4 This is a structural diagram of a conference data processing system provided in an embodiment of this application, such as... Figure 4 As shown, Client 1 and Client 2 can refer to the user terminals corresponding to the second meeting participants, and Client 3 can refer to the user terminals corresponding to the first meeting participants. Figure 4 As shown, when the meeting participants corresponding to clients 1, 2, and 3 join the target meeting, the meeting backend of the target meeting can obtain the meeting information of the participants through the meeting access layer and the core meeting control service, and obtain the operation information of the participants in each client for the target meeting in real time. Specifically, the meeting backend, through the scheduling management service in the core meeting control service, checks whether the participants meet the meeting proxy service conditions based on their meeting information. The scheduling management service identifies the participants that meet the meeting proxy service conditions as the first meeting participants and assigns them a media proxy server (i.e., a proxy machine). The scheduling management service also identifies the participants that do not meet the meeting proxy service conditions as the second meeting participants and assigns them a media interface server (i.e., an interface machine). Furthermore, the meeting backend can send the meeting configuration information of each participant in the target meeting to the corresponding interface machine or proxy machine according to the simultaneous interpretation configuration management service in the core meeting control service. For example, if the meeting backend assigns a proxy machine to the first meeting participant, it sends the first meeting participant's meeting configuration information to the proxy machine.
[0119] like Figure 4 As shown, the media backend includes an interface machine of type 1 server and a proxy machine of type 2 server. Second conference participants accessing the interface machine have download and upload permissions for conference media content, such as... Figure 4 As shown, the interface machine service in the interface machine can obtain uplink audio (i.e., the original audio data uploaded by the conference guests in the target conference, and the translated audio data uploaded by the interpreters) from the terminal corresponding to the second conference participant through the channel provided by the media proxy. Further, the interface machine can use the mixing service to mix the original audio data and translated audio data received from the second conference participant to obtain the first mixed audio data (i.e., simultaneous interpretation mixed audio). The interface machine can use the configuration management service, according to the conference configuration information of the second conference participant sent by the conference backend, to distribute the first mixed audio data to the terminal corresponding to the second conference participant, i.e., client 1 and client 2, through the media proxy. The first conference participant connected to the proxy machine has download permissions for conference media content, such as... Figure 4As shown, the proxy service in the proxy machine can obtain raw and translated voice data from the interface machine through a real proxy. The mixing service in the proxy machine then mixes the raw and translated voice data to obtain second mixed voice data. Furthermore, the proxy machine can use the configuration management service, based on the meeting configuration information of the first meeting participant sent from the meeting backend, to distribute the second mixed voice data to the terminal corresponding to the first meeting participant, i.e., client 3, through a media proxy.
[0120] like Figure 5 As shown, Figure 5 This is a schematic diagram of a target meeting interface provided in an embodiment of this application, such as... Figure 5 As shown, in related technologies, participants who join the target meeting first are assigned to the media interface server. When the number of participants reaches a threshold, i.e., when the media interface server's load capacity is at its maximum, a notification indicating that the maximum number of participants has been reached is output. After this point, participants joining the target meeting from this point onward are assigned to the media proxy server. For example... Figure 5 As shown, when the number of participants in the meeting reaches 300, a flag indicating that the maximum number of participants has been reached will be output to indicate that no more participants can be assigned to the media interface server. After this point, all participants joining the target meeting will be assigned to the media proxy server.
[0121] like Figure 6 As shown, Figure 6 This is a schematic diagram of a target meeting interface provided in an embodiment of this application, such as... Figure 6 As shown, this embodiment of the application obtains the object meeting information corresponding to the meeting participants. Based on this object meeting information, it selects a first meeting participant who meets the meeting proxy service conditions and a second meeting participant who does not meet the proxy service conditions from at least two meeting participants participating in the target meeting. Further, a media proxy server is assigned to the first meeting participant, and a media interface server is assigned to the second meeting participant, thereby reducing the pressure on the media interface server, increasing the number of participants that the target meeting can support, and expanding the applicable scenarios of the target meeting. Figure 6 As shown, after assigning the first group of participants to the media proxy server, the target meeting can support over 3000 participants, and more participants can be added, increasing the total number of people the target meeting can support. Simultaneously, it also enables on-demand resource allocation, improving server resource utilization.
[0122] like Figure 7 As shown, Figure 7 This is a flowchart of a meeting data processing method provided in an embodiment of this application, such as... Figure 7 As shown, during the interpretation configuration process for the second meeting participants (i.e., meeting guests and interpreters), the interpretation client (i.e., the terminal corresponding to the second meeting participant, such as the terminal corresponding to the interpreter and the terminal corresponding to the meeting guest) can obtain the interpretation configuration of the second meeting participant (i.e., the meeting configuration information of the second meeting participant) and send the interpretation configuration of the second meeting participant to the access layer of the meeting backend. The access layer synchronizes the interpretation configuration of the second meeting participant to the meeting control backend. Through the simultaneous interpretation configuration management in the meeting control backend, the interpretation configuration of the second meeting participant is sent to the media interface machine, completing the interpretation configuration of the second meeting participant. Finally, through the simultaneous interpretation configuration management, the meeting control backend, and the access layer, a configuration success message is returned to the interpretation client.
[0123] like Figure 7 As shown, during the listening configuration process for the first meeting participant (i.e., the meeting audience), the audience client (i.e., the terminal corresponding to the first meeting participant) can obtain the first meeting participant's listening configuration (i.e., the first meeting participant's meeting configuration information). Similarly, the audience client can send the first meeting participant's listening configuration to the access layer of the meeting backend. The access layer synchronizes the first meeting participant's listening configuration to the meeting control backend, and through the simultaneous interpretation configuration management in the meeting control backend, sends the first meeting participant's listening configuration to the media proxy machine. The media proxy machine can send the first meeting participant's listening configuration to the media interface machine, so that the media interface machine can return the meeting media content according to the first meeting participant's listening configuration, thereby completing the interpretation configuration for the second meeting participant, and returning a configuration success message to the audience client through simultaneous interpretation configuration management, the meeting control backend, and the access layer.
[0124] like Figure 7As shown, during the data processing of the target meeting, the media interface machine can obtain the interpreted audio (i.e., the original audio data uploaded by the meeting guests and the translated audio data uploaded by the interpreters) from the interpretation client, query the interpretation configuration corresponding to the second meeting participant, mix the original audio data and translated audio data in the interpreted audio to obtain the first mixed audio data, and return the first mixed audio data to the interpretation client. Meanwhile, the media proxy machine can obtain the interpreted audio from the media interface machine according to the listening configuration of the first meeting participant, mix the original audio data and translated audio data in the interpreted audio to obtain the second mixed audio data, and return the second mixed audio data to the listener client. This allows for the allocation of media interface server resources and media proxy server resources associated with the target meeting based on the meeting information of the meeting participants (such as specific needs information), thereby achieving on-demand allocation of media server resources and improving the utilization rate of media server resources. It also increases the number of participants that the target meeting can support, expanding the applicable scenarios for the target meeting.
[0125] When the above embodiments of this application are applied to specific products or technologies, obtaining information such as the target meeting information and meeting configuration information of the meeting participants requires the permission or consent of the target participants. Furthermore, the collection, use, and processing of this information must comply with the relevant laws, regulations, and standards of the relevant countries and regions. In other words, a computer device can only obtain the target meeting information and meeting configuration information of the meeting participants after obtaining authorization from the user regarding the aforementioned information.
[0126] In this embodiment, at least two meeting participants in the target meeting and their respective meeting information are obtained. Based on this meeting information, a first meeting participant meeting the conditions for meeting proxy service and a second meeting participant meeting the conditions for not meeting the conditions are determined from the at least two participants. Further, a media proxy server is assigned to the first meeting participant, and a media interface server is assigned to the second meeting participant. Here, the meeting proxy service conditions can refer to the conditions for accessing the media proxy server. That is, the first meeting participant is a meeting participant meeting the conditions for accessing the media proxy server. For example, the first meeting participant can be an audience member in the target meeting (i.e., a meeting participant who does not need to speak in the target meeting), or the first meeting participant can be a meeting participant selected from the target meeting participants when the number of participants in the target meeting exceeds a threshold. In other words, media proxy servers can be adaptively assigned to the meeting participants in the target meeting based on the meeting information, enabling on-demand allocation of media server resources and improving resource utilization. Then, the media content of the first meeting between the first and second meeting participants is processed by the media proxy server, and the media content of the second meeting between the second meeting participants is processed by the media interface server. In this way, having the media proxy server handle the media content between the first and second meeting participants reduces the data processing pressure on the media interface machine in the target meeting, supports more participants, and improves the applicability of the target meeting. Through the embodiments of this application, media interface server resources and media proxy server resources associated with the target meeting are allocated according to the meeting information of the participants (such as specific needs information), thereby achieving on-demand allocation of media server resources and improving their utilization. Simultaneously, it can increase the number of participants that the target meeting can support and expand its applicable scenarios.
[0127] Please see Figure 8 , Figure 8 This is a flowchart illustrating a meeting data processing method provided in an embodiment of this application. The meeting data processing method can be... Figure 1 It can be executed by any user terminal in the system, or by... Figure 1 The server in the middle can be used to execute it, or it can be executed by... Figure 1 The method can be executed jointly by any user terminal and server in this application, and the device used to execute the method in this application can be collectively referred to as a computer device. For example... Figure 8 As shown, the meeting data processing method may include, but is not limited to, the following steps:
[0128] S201, Obtain at least two meeting participants who are participating in the target meeting, and the meeting information of the meeting participants among the at least two meeting participants.
[0129] S202, based on the meeting information, determine the first meeting participant that meets the conditions for meeting proxy service and the second meeting participant that does not meet the conditions for meeting proxy service from at least two meeting participants.
[0130] S203, obtain the object statistics information of the first meeting participants, and allocate a media proxy server to the first meeting participants based on the object statistics information of the first meeting participants.
[0131] S204, Process the first meeting media content between the first meeting participants and the second meeting participants according to the media proxy server.
[0132] Specifically, the details of steps S201-S204 in this embodiment can be found above. Figure 3 The contents of steps S101-S104 are not described again in this embodiment of the application.
[0133] S205, if a change is detected in the object meeting information of the first meeting participant, then obtain the changed object meeting information of the first meeting participant.
[0134] Specifically, if the computer device detects a change in the meeting information of a participant in the first meeting, such as a change in the participant's identity, needs, or permissions, the computer device can obtain this changed meeting information. For example, if the computer device detects that a participant in the first meeting has turned on their microphone and inputs voice data through their fourth terminal, it can determine that the participant has changed from an audience member to a guest, and the computer device can obtain this changed meeting information, i.e., the guest identity information.
[0135] S206 If it is determined that the change object meeting information of the first meeting participant does not meet the meeting proxy service conditions, then the third meeting media content between the first meeting participant and the second meeting participant will be switched to the media interface server.
[0136] Specifically, after obtaining the changed meeting information of the first meeting participant, the computer device can check whether the changed meeting information meets the conditions for meeting proxy service. If the computer device determines that the changed meeting information of the first meeting participant does not meet the conditions for meeting proxy service, it can switch the third meeting media content between the first and second meeting participants to the media interface server, which is used to process the third meeting media content. In other words, if the computer device determines that the changed meeting information of the first meeting participant does not meet the conditions for meeting proxy service, it switches the media proxy server accessed by the first meeting participant to the media interface server, meaning the first meeting participant is connected to the media interface server, and the media interface server processes the third meeting media content between the changed first and second meeting participants. In other words, if the computer device determines that the changed meeting information of the first meeting participant does not meet the conditions for meeting proxy service, it means that the first meeting participant has changed to the second meeting participant, and the media proxy server accessed by the changed first meeting participant is switched to the media interface server. In this way, when a change in the meeting information of the first meeting participant is detected, resulting in the failure to meet the meeting proxy service conditions (such as a meeting guest being removed, i.e., the meeting guest is changed to a meeting audience), the first meeting participant with updated information is connected to the media interface server. This can satisfy the object requirements of the first meeting participant after the information change, and can also achieve on-demand allocation of media servers, improving resource utilization. At the same time, it can also increase the number of participants that the target meeting can support, thereby improving the applicability of the target meeting.
[0137] Optionally, if the computer device detects a change in the object meeting information of the target meeting participant among the second meeting participants, it obtains the changed object meeting information of the target meeting participant. If the changed object meeting information of the target meeting participant meets the conditions for the meeting proxy service, the fourth meeting media content between the target meeting participant and the remaining meeting participants is switched to the media proxy server. The media proxy server is used to process the fourth meeting media content, and the remaining meeting participants are the meeting participants in the second meeting participants other than the target meeting participant.
[0138] Specifically, after the computer equipment assigns a media interface server to the second group of participants, it can detect whether the target participant's meeting information has changed. If the computer equipment detects a change in the target participant's meeting information, it can obtain the changed meeting information, such as changes in the participant's identity, permissions, and requirements. For example, if a target participant who was a guest fails to upload original audio data within the target time, their identity can be changed from guest to audience member—a listener upgrade. The computer equipment can obtain this changed meeting information, i.e., the audience member's identity information.
[0139] Furthermore, the computer equipment can detect whether the changed meeting information of the target meeting participant meets the meeting proxy service conditions. If the changed meeting information of the target meeting participant meets the meeting proxy service conditions, the second meeting media content between the target meeting participant and the remaining meeting participants can be switched to the media proxy server. This media proxy server is used to handle the fourth meeting media content. The remaining meeting participants refer to the meeting participants in the second meeting who are not the target meeting participant. It can be understood that when the changed meeting information of the target meeting participant meets the proxy service conditions, the target meeting participant changes from the second meeting participant to the first meeting participant. A proxy server is then assigned to the target meeting participant after the information change, and the media proxy server handles the second meeting media content exclusively shared between the target meeting participant after the information change and the remaining meeting participants. Thus, when a change in the target meeting participant's meeting information is detected, thereby meeting the meeting proxy service conditions, the updated target meeting participant is connected to the media interface server. This allows for on-demand allocation of media servers, improving resource utilization. It also reduces the load on the media interface server, thereby increasing the number of participants the target meeting can support and improving its applicability.
[0140] In this embodiment, at least two meeting participants in the target meeting and their respective meeting information are obtained. Based on this meeting information, a first meeting participant meeting the conditions for meeting proxy service and a second meeting participant meeting the conditions for not meeting the conditions are determined from the at least two participants. Further, a media proxy server is assigned to the first meeting participant, and a media interface server is assigned to the second meeting participant. Here, the meeting proxy service conditions can refer to the conditions for accessing the media proxy server. That is, the first meeting participant is a meeting participant meeting the conditions for accessing the media proxy server. For example, the first meeting participant can be an audience member in the target meeting (i.e., a meeting participant who does not need to speak in the target meeting), or the first meeting participant can be a meeting participant selected from the target meeting participants when the number of participants in the target meeting exceeds a threshold. In other words, media proxy servers can be adaptively assigned to the meeting participants in the target meeting based on the meeting information, enabling on-demand allocation of media server resources and improving resource utilization. Then, the media content of the first meeting between the first and second meeting participants is processed by the media proxy server, and the media content of the second meeting between the second meeting participants is processed by the media interface server. In this way, having the media proxy server handle the media content between the first and second meeting participants reduces the data processing pressure on the media interface server in the target meeting, supports more participants, and improves the applicability of the target meeting. Through this embodiment, media interface server resources and media proxy server resources associated with the target meeting are allocated according to the meeting information of the participants (such as specific needs information), thereby achieving on-demand allocation of media server resources and improving their utilization. This also increases the number of participants the target meeting can support, expanding its applicable scenarios. Furthermore, it allows for the acquisition of changed meeting information for participants, and the re-allocation of media interface servers or media proxy servers to these participants based on this information, ensuring that the target meeting's functionality remains unaffected during media server switching.
[0141] Please see Figure 9 , Figure 9 This is a schematic diagram of the structure of a conference data processing device provided in an embodiment of this application. The aforementioned conference data processing device can be a computer program (including program code) running on a computer device; for example, the conference data processing device is an application software. The conference data processing device can be used to execute corresponding steps in the conference data processing method provided in the embodiments of this application. Figure 9As shown, the conference data processing device may include: a first acquisition module 11, a determination module 12, an allocation module 13, a processing module 14, a second acquisition module 15, a first switching module 16, a third acquisition module 17, and a second switching module 18.
[0142] The first acquisition module 11 is used to acquire at least two meeting participants who are participating in the target meeting, and the meeting information of the meeting participants among the at least two meeting participants;
[0143] The determination module 12 is used to determine, based on the object meeting information, a first meeting participant that meets the meeting proxy service conditions and a second meeting participant that does not meet the meeting proxy service conditions from at least two meeting participants;
[0144] Allocation module 13 is used to allocate media proxy servers to the first meeting participants and media interface servers to the second meeting participants;
[0145] Processing module 14 is used to process the first conference media content between the first conference participants and the second conference participants according to the media proxy server, and to process the second conference media content between the second conference participants according to the media interface server.
[0146] The conference data processing device also includes:
[0147] The first allocation unit is used to obtain the object statistics information of the participants in the first meeting, and allocate media proxy servers to the participants in the first meeting based on the object statistics information of the participants in the first meeting;
[0148] The second allocation unit is used to obtain the object statistics information of the participants in the second meeting, and allocate media interface servers to the participants in the second meeting based on the object statistics information.
[0149] The participants in the second meeting include participant i, participant j, and participant k, where i, j, and k are distinct positive integers.
[0150] Processing module 14 includes:
[0151] The first acquisition unit is used to trigger the media interface server to acquire the raw audio data about the target conference output by the second conference participant i from the first terminal corresponding to the second conference participant i.
[0152] The second acquisition unit is used to trigger the media interface server to acquire the translated speech data about the target conference output by the second conference participant j from the second terminal corresponding to the second conference participant j; the translated speech data is obtained by the second conference participant j translating the original speech data according to the translation language type; the translation language type is the language type associated with the second conference participant k;
[0153] The first determining unit is used to trigger the media interface server to determine the second meeting media content between the participants in the second meeting based on the original voice data and the translated voice data.
[0154] The first sending unit is used to trigger the media interface server to send the media content of the second conference to the third terminal corresponding to the second conference participant k.
[0155] Specifically, the first determining unit is used for:
[0156] The media interface server is triggered to mix the original audio data and the translated audio data to obtain the first mixed audio data. This first mixed audio data is then used as the media content for the second meeting between the participants; or...
[0157] The media interface server is triggered to identify the translated audio data as the second meeting media content between the participants in the second meeting.
[0158] The processing module 14 includes:
[0159] The third acquisition unit is used to trigger the media proxy server to obtain the translated speech data and the original speech data from the media interface server if the participants in the first meeting are associated with the translation language type.
[0160] The second determining unit is used to trigger the media proxy server to determine the first meeting media content between the first meeting participant and the second meeting participant based on the original voice data and the translated voice data;
[0161] The second sending unit is used to trigger the media proxy server to send the media content of the first conference to the fourth terminal corresponding to the participants of the first conference.
[0162] Specifically, the second determining unit is used for:
[0163] The media proxy server is triggered to perform audio mixing on the original audio data and the translated audio data to obtain the second mixed audio data.
[0164] The second mixed audio data is used to determine the first meeting media content between the first meeting participants and the second meeting participants.
[0165] The determining module 12 includes:
[0166] The third determining unit is used to determine the meeting interaction permissions of each of at least two meeting participants based on the meeting information.
[0167] The fourth determining unit is used to determine the meeting participant whose meeting interaction permission is the download permission of meeting media content among at least two meeting participants as the first meeting participant that meets the conditions for meeting proxy service;
[0168] The fifth determining unit is used to identify, among at least two meeting participants, those whose meeting interaction permissions are limited to downloading and uploading meeting media content as the first meeting participant who does not meet the conditions for meeting proxy service.
[0169] The conference data processing device also includes:
[0170] The second acquisition module 15 is used to acquire the changed object meeting information of the first meeting participant if a change in the object meeting information of the first meeting participant is detected.
[0171] The first switching module 16 is used to switch the media content of the third meeting between the first meeting participant and the second meeting participant to the media interface server if it is determined that the meeting information of the changed object of the first meeting participant does not meet the meeting proxy service conditions; the media interface server is used to process the media content of the third meeting.
[0172] The conference data processing device also includes:
[0173] The third acquisition module 17 is used to acquire the changed object meeting information of the target meeting participant if it is detected that the object meeting information of the target meeting participant in the second meeting participant has changed.
[0174] The second switching module 18 is used to switch the fourth meeting media content between the target meeting participant and the remaining meeting participants to the proxy server if the change of the target meeting participant's meeting information meets the meeting proxy service conditions. The proxy server is used to process the fourth meeting media content, and the remaining meeting participants are the meeting participants in the second meeting participants other than the target meeting participant.
[0175] According to one embodiment of this application, Figure 3 The steps involved in the conference data processing method shown can be derived from... Figure 9 The various modules in the conference data processing device shown are used to perform this operation. For example, Figure 3 Step S101 shown can be performed by Figure 9 The first acquisition module 11 in the process is executed. Figure 3 Step S102 shown can be performed by Figure 9 The determination module 12 in the middle is used to execute, Figure 3 Step S103 shown can be performed by Figure 9 The allocation module 13 in the middle is used to execute, Figure 3 Step S104 shown can be performed by Figure 9 The processing module 14 in the middle is used to execute, etc.
[0176] According to one embodiment of this application, Figure 9 The modules in the conference data processing device shown can be individually or entirely combined into one or more units, or some of these units can be further divided into multiple functionally smaller sub-units to achieve the same operation without affecting the technical effects of the embodiments of this application. The above modules are based on logical functional division; in practical applications, the function of one module can be implemented by multiple units, or the function of multiple modules can be implemented by one unit. In other embodiments of this application, the testing device may also include other units; in practical applications, these functions can also be implemented with the assistance of other units, and can be implemented collaboratively by multiple units.
[0177] In this embodiment, at least two meeting participants in the target meeting and their respective meeting information are obtained. Based on this meeting information, a first meeting participant meeting the conditions for meeting proxy service and a second meeting participant meeting the conditions for not meeting the conditions are determined from the at least two participants. Further, a media proxy server is assigned to the first meeting participant, and a media interface server is assigned to the second meeting participant. Here, the meeting proxy service conditions can refer to the conditions for accessing the media proxy server. That is, the first meeting participant is a meeting participant meeting the conditions for accessing the media proxy server. For example, the first meeting participant can be an audience member in the target meeting (i.e., a meeting participant who does not need to speak in the target meeting), or the first meeting participant can be a meeting participant selected from the target meeting participants when the number of participants in the target meeting exceeds a threshold. In other words, media proxy servers can be adaptively assigned to the meeting participants in the target meeting based on the meeting information, enabling on-demand allocation of media server resources and improving resource utilization. Then, the media content of the first meeting between the first and second meeting participants is processed by the media proxy server, and the media content of the second meeting between the second meeting participants is processed by the media interface server. In this way, having the media proxy server handle the media content between the first and second meeting participants reduces the data processing pressure on the media interface server in the target meeting, supports more participants, and improves the applicability of the target meeting. Through this embodiment, media interface server resources and media proxy server resources associated with the target meeting are allocated according to the meeting information of the participants (such as specific needs information), thereby achieving on-demand allocation of media server resources and improving their utilization. This also increases the number of participants the target meeting can support, expanding its applicable scenarios. Furthermore, it allows for the acquisition of changed meeting information for participants, and the re-allocation of media interface servers or media proxy servers to these participants based on this information, ensuring that the target meeting's functionality remains unaffected during media server switching.
[0178] Please see Figure 10 , Figure 10 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Figure 10As shown, the computer device 1000 may include a processor 1001, a network interface 1004, and a memory 1005. Furthermore, the computer device 1000 may also include a user interface 1003 and at least one communication bus 1002. The communication bus 1002 is used to enable communication between these components. The user interface 1003 may include a display screen and a keyboard; optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The memory 1005 may be high-speed RAM or non-volatile memory, such as at least one disk storage device. Optionally, the memory 1005 may also be at least one storage device located remotely from the processor 1001. Figure 10 As shown, the memory 1005, which is a computer-readable storage medium, may include an operating system, a network communication module, a user interface module, and a device control application.
[0179] exist Figure 10 In the computer device 1000 shown, the network interface 1004 provides network communication functionality; the user interface 1003 is mainly used to provide an input interface for the user; and the processor 1001 can be used to call the device control application stored in the memory 1005 to achieve:
[0180] Obtain at least two meeting participants who are participating in the target meeting, and the meeting information of the meeting participants among the at least two meeting participants;
[0181] Based on the meeting information, determine the first meeting participant who meets the conditions for meeting proxy service and the second meeting participant who does not meet the conditions for meeting proxy service from at least two meeting participants;
[0182] Assign a media proxy server to the participants in the first meeting, and assign a media interface server to the participants in the second meeting;
[0183] The media proxy server processes the first meeting media content between the first meeting participants and the second meeting participants, and the media interface server processes the second meeting media content between the second meeting participants.
[0184] It should be understood that the computer device 1000 described in the embodiments of this application can execute the foregoing text. Figure 3 or Figure 8 The description of the conference data processing method in the corresponding embodiments can also be performed as described above. Figure 8The description of the conference data processing device in the corresponding embodiments will not be repeated here. Furthermore, the beneficial effects of using the same method will also not be repeated here.
[0185] Furthermore, it should be noted that this application embodiment also provides a computer-readable storage medium, which stores a computer program executed by the aforementioned conference data processing device. The computer program includes program instructions, and when the processor executes the program instructions, it can execute the aforementioned... Figure 3 and Figure 8 The description of the conference data processing method in the corresponding embodiments is already provided, so it will not be repeated here.
[0186] Furthermore, the beneficial effects of using the same method will not be repeated here. For technical details not disclosed in the computer-readable storage medium embodiments involved in this application, please refer to the description of the method embodiments of this application. As an example, program instructions can be deployed and executed on a computing device, or on multiple computing devices located in one location, or on multiple computing devices distributed in multiple locations and interconnected through a communication network. Multiple computing devices distributed in multiple locations and interconnected through a communication network can constitute a blockchain system.
[0187] Furthermore, it should be noted that this application also provides a computer program product or computer program, which may include computer instructions, which may be stored in a computer-readable storage medium. The processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor may execute the computer instructions, causing the computer device to perform the aforementioned actions. Figure 3 and Figure 8 The description of the conference data processing method in the corresponding embodiments is already provided and will not be repeated here. Furthermore, the beneficial effects of using the same method will also not be repeated. For technical details not disclosed in the computer program products or computer program embodiments related to this application, please refer to the description of the method embodiments of this application.
[0188] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application.
[0189] The steps in the method of this application embodiment can be adjusted, combined, or deleted according to actual needs.
[0190] The modules in the device of this application embodiment can be merged, divided, and deleted according to actual needs.
[0191] Those skilled in the art will understand that implementing all or part of the processes in the above embodiments is possible.
[0192] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the methods described above. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.
[0193] The above description discloses only preferred embodiments of the present invention and should not be construed as limiting the scope of the present invention. Therefore, equivalent variations made in accordance with the claims of the present invention are still within the scope of the present invention.
Claims
1. A method for processing conference data, characterized in that, include: Obtain at least two meeting participants who are participating in the target meeting, and the meeting information of the meeting participants among the at least two meeting participants; Based on the object meeting information, determine the object requirement information of the at least two meeting participants, and based on the object requirement information, determine the meeting interaction permissions of each of the at least two meeting participants; The meeting participant whose meeting interaction permission is the download permission of meeting media content among the at least two meeting participants is identified as the first meeting participant that meets the conditions for meeting proxy service; Among the at least two meeting participants, those whose meeting interaction permissions are download and upload permissions for meeting media content are identified as the second meeting participant who does not meet the conditions for meeting proxy service; Assign a media proxy server to the first meeting participant and a media interface server to the second meeting participant; The media proxy server processes the first conference media content between the first conference participant and the second conference participant, and the media interface server processes the second conference media content between the second conference participants.
2. The method according to claim 1, characterized in that, The step of allocating a media proxy server to the first meeting participant and a media interface server to the second meeting participant includes: Obtain object statistics information of the first meeting participants, and allocate media proxy servers to the first meeting participants based on the object statistics information of the first meeting participants; Obtain the object statistics information of the second meeting participants, and allocate a media interface server to the second meeting participants based on the object statistics information.
3. The method according to claim 1, characterized in that, The participants in the second meeting include participant i, participant j, and participant k, where i, j, and k are distinct positive integers. The step of processing the second conference media content between the second conference participants according to the media interface server includes: The media interface server is triggered to obtain the original audio data about the target conference output by the second conference participant i from the first terminal corresponding to the second conference participant i; The media interface server is triggered to obtain the translated audio data about the target meeting output by the second meeting participant j from the second terminal corresponding to the second meeting participant j; the translated audio data is obtained by the second meeting participant j translating the original audio data according to the translation language type; the translation language type is the language type associated with the second meeting participant k; The media interface server is triggered to determine the second meeting media content between the second meeting participants based on the original voice data and the translated voice data; The media interface server is triggered to send the second conference media content to the third terminal corresponding to the second conference participant k.
4. The method according to claim 3, characterized in that, The triggering of the media interface server to determine the second meeting media content between the second meeting participants based on the original voice data and the translated voice data includes: The media interface server is triggered to mix the original audio data and the translated audio data to obtain first mixed audio data, which is then identified as the second meeting media content between the second meeting participants; or... The media interface server is triggered to identify the translated audio data as the second conference media content between the second conference participants.
5. The method according to claim 3, characterized in that, The step of processing the first conference media content between the first conference participant and the second conference participant according to the media proxy server includes: If the first meeting participant is associated with the translation language type, the media proxy server is triggered to obtain the translated audio data and the original audio data from the media interface server. The media proxy server is triggered to determine the first meeting media content between the first meeting participant and the second meeting participant based on the original voice data and the translated voice data; The media proxy server is triggered to send the media content of the first meeting to the fourth terminal corresponding to the first meeting participant.
6. The method according to claim 5, characterized in that, The triggering of the media proxy server to determine the first meeting media content between the first meeting participant and the second meeting participant based on the original voice data and the translated voice data includes: The media proxy server is triggered to perform audio mixing on the original audio data and the translated audio data to obtain second mixed audio data. The second mixed audio data is used to determine the first meeting media content between the first meeting participant and the second meeting participant.
7. The method according to claim 1, characterized in that, The method further includes: If a change is detected in the meeting information of the first meeting participant, then the changed meeting information of the first meeting participant is obtained. If it is determined that the change object meeting information of the first meeting participant does not meet the meeting proxy service conditions, then the third meeting media content between the first meeting participant and the second meeting participant will be switched to the media interface server; the media interface server is used to process the third meeting media content.
8. The method according to claim 1, characterized in that, The method further includes: If a change is detected in the object meeting information of the target meeting participant among the second meeting participants, then the changed object meeting information of the target meeting participant is obtained; If the change information of the target meeting participant meets the conditions for meeting proxy service, then the fourth meeting media content between the target meeting participant and the remaining meeting participants will be switched to the media proxy server; the media proxy server is used to process the fourth meeting media content, and the remaining meeting participants are the meeting participants in the second meeting participants other than the target meeting participant.
9. A conference data processing device, characterized in that, include: The first acquisition module is used to acquire at least two meeting participants who are participating in the target meeting, and the meeting information of the meeting participants among the at least two meeting participants; The determination module includes a third determination unit, a fourth determination unit, and a fifth determination unit; The third determining unit is used to determine the object requirement information of the at least two meeting participants based on the object meeting information, and to determine the meeting interaction permissions of each of the at least two meeting participants based on the object requirement information. The fourth determining unit is used to determine the meeting participant whose meeting interaction permission is the download permission of meeting media content among the at least two meeting participants as the first meeting participant that meets the conditions for meeting proxy service; The fifth determining unit is used to determine the meeting participants whose meeting interaction permissions are download and upload permissions for meeting media content among the at least two meeting participants as the second meeting participants who do not meet the conditions for meeting proxy service; The allocation module is used to allocate a media proxy server to the first meeting participant and a media interface server to the second meeting participant. The processing module is configured to process the first conference media content between the first conference participant and the second conference participant according to the media proxy server, and to process the second conference media content between the second conference participants according to the media interface server.
10. A computer device, characterized in that, include: Processor and memory; The processor is connected to a memory, wherein the memory is used to store a computer program, and the processor is used to invoke the computer program to cause the computer device to perform the method according to any one of claims 1-8.
11. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program adapted to be loaded and executed by a processor to cause a computer device having the processor to perform the method of any one of claims 1-8.
12. A computer program product, characterized in that, The computer program product includes computer instructions stored in a computer-readable storage medium, the computer instructions being adapted to be read and executed by a processor to cause a computer device having the processor to perform the method of any one of claims 1-8.
Citation Information
Patent Citations
Video conference processing method, system and device, computer device and storage medium
CN110213523A
Conference data processing method and device, storage medium and equipment
CN111639503A