Conference participation method and apparatus, device, and storage medium
By generating digital people to participate in online meetings and simulating user voice expression content, the problem of users being unable to attend multiple meetings in real time is solved, improving the timeliness and authenticity of attendance, and improving the user experience.
Patent Information
- Application Number
- PCT/CN2024/119479
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-03-08
- Filing Date
- 2024-09-18
- Publication Date
- 2025-07-17
AI Technical Summary
In the prior art, users have poor real-time access to meeting content through AI assistants and are unable to attend multiple meetings in real time, which affects the effectiveness of attending meetings.
The client receives user operation events, generates digital people to participate in online meetings, and displays the user's digital people in the conference interface. The server provides relevant content and data flow to simulate user's tone expressions, realizing the participation of digital people in the conference.
It improves the timeliness and authenticity of users' participation in the conference, solves the problem that users cannot attend multiple meetings at the same time, and improves the meeting experience and Q&A efficiency.
Smart Images

Figure CN2024119479_17072025_PF_FP_ABST
Abstract
Description
A method, device, equipment and storage medium for participating in a meeting
[0001] This application claims priority to the Chinese patent applications filed with the State Intellectual Property Office on January 11, 2024, with application number 202410043995.3 and application name “A method and device for replacing a digital human to attend a meeting” and filed with the State Intellectual Property Office on March 8, 2024, with application number 202410268583.X and application name “A method, device, equipment and storage medium for attending a meeting”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of cloud computing technology, and in particular to a conference participation method, apparatus, device, and storage medium. Background Art
[0003] Currently, users often encounter the problem of meeting conflicts. When a user is attending a meeting and cannot attend another meeting at the same time, the user can chat with the artificial intelligence (AI) assistant in the other meeting to obtain the content of the other meeting.
[0004] However, in the above method, the real-time nature of the meeting content obtained by users from the AI assistant is poor, which affects the effectiveness of users' participation in the meeting.
[0005] Summary of the Invention
[0006] The present application provides a method, apparatus, device and storage medium for attending a meeting, which solves the technical problem in related technologies that the meeting content obtained by users from AI assistants is not real-time, affecting the effectiveness of users' participation in the meeting.
[0007] In a first aspect, a conference participation method is provided, which is applied to a conference participation system, wherein the conference participation system includes a client and a server. The method includes: first, the client receives a first operation event of a first user for indicating that the digital person of the first user joins a first conference; thereafter, in response to the first operation event, the client sends a conference participation request to the server, wherein the conference participation request is used to indicate that the digital person of the user requests to join the first conference; then the server sends a conference participation response to the client, i.e., notifying that the digital person of the first user has successfully joined the first conference; finally, the client displays a conference interface of the first conference, wherein the conference interface displays users participating in the first conference, and the users participating in the first conference include the digital person of the first user.
[0008] It is understood that the method described in the first aspect can be executed by a computing device, which can be a terminal, an apparatus including a terminal, or a chip within a terminal. Alternatively, the computing device can be a network device, an apparatus including a network device, or a chip within a network device. For ease of understanding, the following description uses execution by a computing device as an example.
[0009] In this application, after receiving the user's first operation event, the client can participate in the online meeting based on the user's digital person, and display the users participating in the online meeting (including the user's digital person) in the meeting interface of the online meeting. Participating in the online meeting based on the digital person can meet the timeliness of the user's participation in the meeting and improve the user's participation experience.
[0010] In one possible design, the first user is participating in a second conference.
[0011] Based on this possible design, the first user is attending the second meeting, so the first user's digital human can attend the first meeting on behalf of the first user, which can effectively solve the situation where the same user cannot attend more than two meetings and avoid the user's poor experience in the meeting conflict scenario.
[0012] In one possible design, the users participating in the first meeting also include a second user, and the method also includes: the server obtains first content, which is content stored in the server that matches the target question, and the target question is a question related to the first user in the meeting content of the first meeting; the server sends a first data stream to the second user, and the first data stream is a data stream corresponding to the first content.
[0013] Based on this possible design, since the first data stream sent by the server to the second user is generated based on the digital human image and the first content, the second user displays (or plays) the first data stream after receiving it, and can simulate the first user's voice and express the first content in the form of a digital human, thereby improving the authenticity of the digital human's participation in the meeting.
[0014] In one possible design, when the server does not store content that matches the target question, the server sends a first prompt message to the client, and the first prompt message is used to prompt that there is no content that matches the target question in the server, and the target question is a question related to the first user in the meeting content of the first meeting; the above-mentioned client displays the meeting interface of the first meeting specifically including: the client displays the first prompt message in the meeting interface of the first meeting.
[0015] Based on this possible design, when the server does not store content matching the target question, the server can send a first prompt to the client, indicating that the server does not have content matching the target question. The client can then display this first prompt in the meeting interface of the first meeting, thereby reminding the user to answer the target question and improving the effectiveness of the answer.
[0016] In one possible design, the method also includes: the server sends a target question to the client, where the target question is a question related to the user in the meeting content of the first meeting; the above-mentioned client displays the meeting interface of the first meeting specifically including: the client displays the target question in the meeting interface of the first meeting.
[0017] Based on this possible design, after the server sends the target question to the client, the user can quickly answer the target question based on the target question displayed on the meeting interface, which improves the efficiency of question and answering while ensuring the effective progress of the online meeting.
[0018] In one possible design, the method further includes: the server sends a second prompt message to the second user, where the second prompt message is used to prompt that the digital person of the first user is a user participating in the first meeting.
[0019] Based on this possible design, the second user can display the second prompt information after receiving the second prompt information sent by the digital human conference gateway. This can help other users participating in the meeting to easily and quickly identify that it is the first user's digital human rather than the first user himself who is participating in the first meeting, which can promote the effective progress of the first meeting.
[0020] In one possible design, the method also includes: when the server identifies the user information of the first user from the conference content of the first conference, the server sends a second data stream to the above-mentioned second user, and the second data stream is a data stream corresponding to the second content, and the second content is content related to the user information.
[0021] Based on this possible design, when the server recognizes the user information of the first user from the meeting content of the first meeting, it indicates that the meeting content of the first meeting (including the current meeting content) may be highly relevant to the user. At this time, the server can send a data stream corresponding to the second content (i.e., a second data stream) to the second user. After receiving the second data stream, the second user can display / play the second data stream, which can simulate the user's voice and color representation of the content related to the user information in the form of a digital human, and can meet the diverse needs of users for participating in meetings.
[0022] In a second aspect, a conference participation device is provided. The device includes: a receiving module, a first sending module, a second sending module, and a display module; the receiving module is configured to receive a first operation event from a first user, the first operation event being used to instruct the first user's digital human to join a first conference; the first sending module is configured to, in response to the first operation event, send a conference participation request to a server, the conference participation request being used to instruct the user's digital human to request to join the first conference; the second sending module is configured to send a conference participation response to a client, the conference participation response being used to notify the first user's digital human of successful joining the first conference; and the display module is configured to display a conference interface of the first conference, the conference interface displaying users participating in the first conference, the users participating in the first conference including the first user's digital human.
[0023] In one possible design, the first user is participating in a second conference.
[0024] In one possible design, the users participating in the first meeting also include a second user, and the device also includes an acquisition module; the acquisition module is used to obtain first content, where the first content is content stored in the server that matches the target question, and the target question is a question related to the first user in the meeting content of the first meeting; the second sending module is used to send a first data stream to the second user, where the first data stream is a data stream corresponding to the first content.
[0025] In one possible design, the second sending module is also used to send a first prompt message to the client when the server does not store content matching the target question. The first prompt message is used to prompt that there is no content matching the target question in the server, and the target question is a question related to the first user in the meeting content of the first meeting; the display module is specifically used to display the first prompt message in the meeting interface of the first meeting.
[0026] In one possible design, the second sending module is also used to send a target question to the client, where the target question is a question related to the first user in the meeting content of the first meeting; the display module is specifically used to display the target question on the meeting interface of the first meeting.
[0027] In a possible design, the second sending module is further used to send a second prompt message to the above-mentioned second user, and the second prompt message is used to prompt that the digital person of the first user is a user participating in the first meeting.
[0028] In one possible design, the second sending module is also used to send a second data stream to the above-mentioned second user when the server identifies the user information of the first user from the conference content of the first conference. The second data stream is a data stream corresponding to the second content, and the second content is content related to the user information.
[0029] In addition, the technical effects of the conference participating device described in the second aspect can refer to the technical effects of the method described in the first aspect, and will not be repeated here.
[0030] In a third aspect, a computing device cluster is provided, comprising at least one computing device, each computing device comprising a processor and a memory; the processor of the at least one computing device is used to execute instructions stored in the memory of the at least one computing device, so that the computing device cluster executes the method described in the first aspect.
[0031] In a fourth aspect, a computer program product comprising instructions is provided. When the instructions are executed by a computing device cluster, the computing device cluster executes the method described in the first aspect.
[0032] In a fifth aspect, a computer-readable storage medium is provided, comprising computer program instructions. When the computer program instructions are executed by a computing device cluster, the computing device cluster executes the method described in the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0033] FIG1 shows a schematic diagram of a conference interface of a client provided in an embodiment of the present application;
[0034] FIG2 shows a schematic diagram of an online conference scenario provided by an embodiment of the present application;
[0035] FIG3 shows a schematic diagram of a network architecture of a conference participation system provided in an embodiment of the present application;
[0036] FIG4 shows a schematic diagram of a network architecture of a cloud computing platform provided in an embodiment of the present application;
[0037] FIG5 shows a flow chart of a conference participation method provided in an embodiment of the present application;
[0038] FIG6 shows a schematic diagram of a conference interface of another client provided in an embodiment of the present application;
[0039] FIG7 shows a schematic diagram of a conference interface of another client provided in an embodiment of the present application;
[0040] FIG8 shows a schematic diagram of a conference interface of another client provided in an embodiment of the present application;
[0041] FIG9 shows a flow chart of another method for participating in a conference provided in an embodiment of the present application;
[0042] FIG10 shows a flow chart of another method for participating in a conference provided in an embodiment of the present application;
[0043] FIG11 is a schematic diagram showing a flow chart of another method for participating in a conference provided in an embodiment of the present application;
[0044] FIG12 shows a schematic diagram of a conference interface of another client provided in an embodiment of the present application;
[0045] FIG13 shows a schematic diagram of a conference interface of another client provided in an embodiment of the present application;
[0046] FIG14 shows a flow chart of another method for participating in a conference provided in an embodiment of the present application;
[0047] FIG15 shows a schematic diagram of a conference interface of another client provided in an embodiment of the present application;
[0048] FIG16 shows a flow chart of another method for participating in a conference provided in an embodiment of the present application;
[0049] FIG17 shows a schematic structural diagram of a conference participating device provided in an embodiment of the present application;
[0050] FIG18 shows a schematic structural diagram of a computing device provided in an embodiment of the present application;
[0051] FIG19 shows a schematic diagram of the structure of a computing device cluster provided in an embodiment of the present application;
[0052] FIG20 shows a schematic diagram of a network architecture of a computing device cluster provided in an embodiment of the present application. DETAILED DESCRIPTION
[0053] To facilitate understanding of the solutions provided in the embodiments of the present application, some concepts involved in the present application are explained before introducing the solutions provided in the embodiments of the present application.
[0054] A digital human is a virtual character created in digital form in a digital space, with an anthropomorphic or real-life appearance and form. It is also called an avatar, digital virtual human, or virtual digital human. In the embodiments of this application, a user's digital human can participate in online meetings on their behalf.
[0055] A digital human image refers to the appearance, image, and temperament of a digital human in a virtual space. A digital human image can be customized based on various needs and scenarios, including facial features, hairstyle, posture, and facial expressions. In this embodiment of the present application, the digital human generation device can generate a digital human image of a user's digital human based on the user's audio and video information.
[0056] Meetings are an important part of communication and collaboration within a company, and more and more meetings are being held online (also known as online meetings). Companies can use online meetings for technical exchanges, education and training, job interviews, business management, project discussions, and regular department meetings.
[0057] Currently, users (or employees within an enterprise) often encounter meeting conflicts in their daily lives and work. When a user is currently attending one meeting (hereinafter referred to as the first meeting) and is unable to attend another meeting (hereinafter referred to as the second meeting), the user is considered absent from the second meeting. Unable to access the content of the second meeting in real time, the user must wait until the second meeting ends, resulting in a slow information acquisition process. Furthermore, users are unable to express their opinions in the second meeting, which could influence the meeting's conclusion.
[0058] In an optional implementation, the user can have a conversation with the AI assistant in the other conference (i.e., the second conference) through chatting to obtain the conference content of the second conference.
[0059] For example, as shown in Figure 1, users 101, 102, 103, and 104 are participating in the first meeting. Since user 101 cannot attend the second meeting, user 101 asks the AI assistant via chat: "What was discussed in the second meeting in the last half hour?" The AI assistant then responds to user 101 with "Content 1," which is the content of the second meeting in the last half hour. In this way, user 101 can obtain the content of the second meeting through the AI assistant.
[0060] In an embodiment of the present application, a meeting (eg, a first meeting) may be referred to as a meeting of a certain user (eg, a user supporting the meeting) among all users participating in the meeting. For example, the first meeting shown in FIG. 1 may also be referred to as a meeting of user 101.
[0061] However, the above implementation has at least the following two defects:
[0062] 1. The meeting content obtained by users from AI assistants is all content within a historical time period, which has poor real-time performance and cannot meet the needs of meeting conflict scenarios. It cannot obtain content from another meeting in real time, affecting the effectiveness of users' participation in meetings.
[0063] Second, AI assistants can only access meeting content but cannot take the initiative. For example, AI assistants cannot attend another meeting on behalf of the user and speak in another meeting.
[0064] Based on this, an embodiment of the present application provides a method for participating in a meeting. After receiving a first operation event of a first user, the client can participate in an online meeting based on the digital person of the first user. Participating in an online meeting based on a digital person can meet the timeliness of the user's participation in the meeting and improve the user's participation experience.
[0065] The embodiments of the present application provide a conference participation method, apparatus, device, and storage medium, which are applied to interactive scenarios such as calls and chats, as well as online conference scenarios (including but not limited to scenarios such as hosting a meeting, participating in a meeting, and conference conflicts). Specifically, in an online conference scenario, after the client receives the first operation event of the first user, it can send a conference participation request to the server, that is, instruct the first user's digital human to request to join the first conference. Finally, after the first user's digital human successfully joins the first conference, the client can display the conference interface of the first conference, which displays the users participating in the first conference (including the first user's digital human).
[0066] For example, as shown in FIG2 , in an online conference scenario, the conference system provided in an embodiment of the present application may include a conference system 201 and at least one electronic device (five electronic devices are shown in FIG2 , including electronic device 204 , electronic device 205 , electronic device 206 , electronic device 207 , and electronic device 208 ).
[0067] Conference system 201 can provide digital human image creation capabilities, speech-to-text conversion capabilities, text-to-speech conversion capabilities, meeting minutes acquisition capabilities, and knowledge base connection capabilities. Specifically, the digital human image creation capability is to generate a digital human image of user 202 (i.e., digital human 203 shown in Figure 2) within conference system 201.
[0068] User 202 can connect to conference system 201 through electronic device 204 (specifically, a client (also referred to as a conference terminal) installed in electronic device 204), so that user 202 can participate in an online meeting and communicate with other users in the online meeting. In addition, user 202 can generate a digital human 203 through the connected conference system 201, and the digital human 203 can participate in the online meeting on behalf of user 202.
[0069] In order to enable ordinary people in the art to better understand the technical solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.
[0070] It is understood that the terms "first," "second," and the like in the specification and claims of this application and the accompanying drawings are used to distinguish similar objects and are not necessarily used to describe a particular order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate so that the embodiments of the application described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Instead, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
[0071] It will also be understood that the term “comprising” indicates the presence of described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements and / or components.
[0072] The conference participation method, apparatus, device, and storage medium provided in the embodiments of the present application can be applied to a conference participation system. As shown in Figure 3, the conference participation system includes an electronic device 301, a server 302, and an electronic device 303. Typically, in actual applications, the connections between the various devices shown in Figure 3 can be wireless connections. To facilitate and intuitively represent the connection relationship between the various devices, solid lines are used in Figure 3.
[0073] The conference joining method provided in the embodiment of the present application can be executed by a client, which can be an application installed and running on the electronic device 301 (or the electronic device 303). Specifically, the client is used to receive a first operation event of a first user, and then display a conference interface of the first conference. The first operation event is used to instruct the digital human of the first user to join the first conference. The conference interface displays users participating in the first conference, and the users participating in the first conference include the digital human of the first user.
[0074] Furthermore, the conference joining method provided in the embodiment of the present application may also be executed by a server, which may be an application installed and running on the server 302. Specifically, the server is configured to receive a conference joining request sent by the client and send a conference joining response to the client. The conference joining request is used to indicate that the digital human of the first user has requested to join the first conference, and the conference joining request is used to notify the digital human of the first user that the digital human has successfully joined the first conference.
[0075] In addition, the electronic device 303 can be an electronic device used by (or corresponding to) another user (for example, a second user). The electronic device 303 (specifically, the client in the electronic device 303) can receive a first data stream sent by the server to the second user. The first data stream is a data stream corresponding to the first content. The first content is content stored in the server that matches the target question. The target question is a question related to the first user in the meeting content of the above-mentioned first meeting.
[0076] In one example, the above-mentioned electronic device (including electronic device 301 and electronic device 303) can be a terminal, which can also be called user equipment (UE), access terminal, subscriber unit (subscriber unit), user station, mobile station (MS), mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication device, user agent or user device. The terminal in the embodiments of the present application can be a mobile phone, a cellular phone, a smart phone, a tablet computer, a wireless data card, a personal digital assistant (PDA), a wireless modem, a handheld device (handset), a laptop computer, a machine type communication (MTC) terminal, a computer with wireless transceiver function, a virtual reality (VR) terminal, an augmented reality (AR) terminal, a smart home device (for example, a refrigerator, a television, an air conditioner, an electric meter, etc.), an intelligent robot, a robotic arm, a workshop equipment, a wireless terminal in industrial control, a wireless terminal in self-driving, a wireless terminal in remote medical care, a wireless terminal in a smart grid, a wireless terminal in transportation safety, a wireless terminal in a smart city, a wireless terminal in a smart home, a vehicle-mounted terminal, a roadside unit with terminal function, or a wireless terminal in a smart city. The terminal of the present application may also be an onboard module, onboard module, onboard component, onboard chip or onboard unit built into a vehicle as one or more components or units. The terminal may also be other devices with terminal functions, for example, the terminal may also be a device that functions as a terminal in device-to-device (D2D) communication.
[0077] The embodiments of this application do not limit the device form factor of the terminal. The device used to implement the terminal's function can be a terminal; it can also be a device that supports the terminal in implementing the function, such as a chip system. The device can be installed in the terminal or used in conjunction with the terminal. In the embodiments of this application, the chip system can be composed of a chip or include a chip and other discrete components.
[0078] In another example, the above-mentioned server 302 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, network acceleration services (content delivery network, CDN), as well as big data and artificial intelligence platforms.
[0079] In one implementation of an embodiment of the present application, the multiple functions included in the above-mentioned server 302 can be deployed in different devices respectively. Based on this, as shown in Figure 4, the method for attending a conference provided in an embodiment of the present application can act on a cloud computing platform, which may include a conference system 401 and an electronic device 402. Specifically, the conference system 401 may include a conference management server 4011, a digital human conference gateway 4012, a digital human generation device 4013, and a media server 4014. Generally, in actual applications, the connection between the above-mentioned devices can be a wireless connection. In order to conveniently and intuitively represent the connection relationship between the various devices, solid lines are used in Figure 4.
[0080] In the embodiment of the present application, the functions of the conference system 401 shown in Figure 4 are the same as or similar to the functions of the server 302 shown in Figure 3, and both can implement the various functions of the server provided in the embodiment of the present application.
[0081] Specifically, a client is installed and running in the electronic device 402, and the client is used to receive the first operation event of the first user, and then display the conference interface of the first conference. The first operation event is used to indicate that the digital person of the first user joins the first conference, and the conference interface displays the users participating in the first conference, and the users participating in the first conference include the digital person of the first user.
[0082] The conference management server 4011 is used to receive a conference joining request sent by the client, and send the conference joining request to the digital human conference joining gateway 4012. The conference joining request is used to indicate that the digital human of the first user requests to join the first conference.
[0083] The digital human conference gateway 4012 is used to obtain the digital human image of the digital human and generate a first data stream based on the digital human image and the first content.
[0084] The digital human generating device 4013 is used to generate a digital human image of a digital human based on the audio and video information of the first user.
[0085] The media server 4014 is used to send the conference content of the first conference to the digital conference gateway 4012.
[0086] Based on the cloud computing platform shown in Figure 4 above, the conference joining method provided in the embodiments of this application can be run on this cloud computing platform to implement the process of a user's digital human joining the first conference. Specifically, the cloud computing platform is deployed with a conference system and a client, and the conference system is deployed with a conference management server and a digital human conference joining gateway. As shown in Figure 5, the conference joining method may include S501-S506.
[0087] S501: A client receives a first operation event from a first user.
[0088] The first operation event is used to instruct the first user's digital human to join the first meeting.
[0089] In conjunction with the description of the above embodiments, the client is an application installed and running on an electronic device. The functions of the conference system (including the functions of the conference management server, the functions of the digital human conference gateway, the functions of the digital human generation device, and the functions of the media server) are used to implement the various functions of the server provided in the embodiments of this application.
[0090] In the embodiment of the present application, the first user may trigger the first operation event by clicking a control, a physical key, or keyboard input, etc. For example, for clicking a control, a control may be displayed on the display interface of the client, and the first user may trigger the first operation event by clicking the control.
[0091] Exemplarily, as shown in FIG6 , the display interface of the client includes a conference management page, which includes a conference list, initiating a conference, joining a conference, reserving a conference, and hosting a conference.
[0092] Specifically, the conference list includes a floating box 601 and a floating box 602 , wherein the floating box 601 is used to represent conference 1 and the floating box 602 is used to represent conference 2. The meeting time of the two meetings is both 10:00-11:00.
[0093] The floating frame 601 includes a join control 6011 , and the first user can join the meeting 1 by clicking the join control 6011 .
[0094] The floating frame 602 includes a digital human joining control 6021 . The first user can instruct the first user's digital human to join the meeting 2 by clicking the digital human joining control 6021 .
[0095] In addition, the first user may also click a join control in the floating box 602 to join the conference 2, or click a share conference control in the floating box 602 to share the conference 2 with other users.
[0096] In addition, the first user can create an online meeting in a short time by clicking Start Meeting. The first user can join a scheduled (or ongoing) online meeting by clicking Join Meeting. The first user can schedule an online meeting for a future time period by clicking Schedule Meeting. The first user can host / conduct an online meeting as the meeting host (or meeting manager) by clicking Host Meeting.
[0097] S502: In response to a first operation event, the client sends a conference joining request to the conference management server. Correspondingly, the conference management server receives the conference joining request sent by the client.
[0098] The conference joining request is used to indicate that the digital person of the first user requests to join the first conference.
[0099] S503: The conference management server sends a conference participation request to the digital human conference participation gateway. Correspondingly, the digital human conference participation gateway receives the conference participation request sent by the conference management server.
[0100] S504: The digital conference gateway sends a conference participation response to the conference management server. Correspondingly, the conference management server receives the conference participation response sent by the digital gateway.
[0101] The conference joining response is used to notify the first user's digital human that he or she has successfully joined the first conference.
[0102] In one implementation of the embodiment of the present application, after receiving the conference joining request, the digital person conference gateway can determine whether the digital person of the first user is successfully matched with the first user. When the digital person of the first user is successfully matched with the first user, it means that the identity verification of the first user is successful (or passed), that is, the digital person conference gateway can allow the digital person of the first user to join the first conference. At this time, the digital person conference gateway can send a conference joining response to the conference management server, that is, notifying the first user's digital person of successfully joining the first conference, which can ensure the security of the digital person's participation in the conference.
[0103] Optionally, the above-mentioned conference joining request may include the identifier of the first user and the identifier of the first user's digital person. After receiving the conference joining request, the digital person conference joining gateway may determine whether the user identifier corresponding to the identifier of the digital person stored in the digital person conference joining gateway is the same as the identifier of the first user. If they are the same, the digital person conference joining gateway may determine that the digital person and the first user are successfully matched. If they are different, the digital person conference joining gateway may determine that the digital person and the first user are not matched.
[0104] In an optional implementation, when the first user's digital human fails to match the user, it indicates that the first user's identity verification has failed, and the digital human conference gateway does not allow the first user's digital human to join the first conference. In this case, the digital human conference gateway can send a first failure response to the client via the conference management server, which is used to notify the first user's digital human that the first user cannot join the first conference.
[0105] S505: The conference management server sends a conference joining response to the client. Correspondingly, the client receives the conference joining response sent by the conference management server.
[0106] In combination with the description of the above embodiments, it should be understood that the functions of the conference management server and the functions of the digital conference gateway can be integrated into the server provided in the embodiments of the present application.
[0107] S506: The client displays the conference interface of the first conference.
[0108] The conference interface displays users participating in the first conference, and the users participating in the first conference include the digital person of the first user.
[0109] In an optional implementation, the first user is attending the second meeting, so the first user's digital human can attend the first meeting on behalf of the first user, which can effectively solve the situation where the same user cannot attend more than two meetings and avoid the user's poor experience in the meeting conflict scenario.
[0110] For example, as shown in Figure 7, the conference interface of the first conference includes digital human 701, user 702, user 703, and user 704, where digital human 701 is the digital human of the first user. Specifically, the users participating in the first conference include digital human 701, user 702, user 703, and user 704.
[0111] Based on the method provided in the above embodiment, first, the client can receive the first operation event of the first user for instructing the first user's digital person to join the first meeting; thereafter, in response to the first operation event, the client can send a meeting request to the server, that is, instructing the first user's digital person to request to join the first meeting; after receiving the meeting request, the server can send a meeting response to the client to notify the first user's digital person that the first user has successfully joined the first meeting; finally, the client can display the meeting interface of the first meeting, and the meeting interface shows the users participating in the first meeting, and the users participating in the first meeting include the digital person of the first user. In the embodiment of the present application, after receiving the first operation event of the first user, the client can participate in the online meeting based on the digital person of the first user, and display the users participating in the online meeting (including the digital person of the first user) in the meeting interface of the online meeting. Participation in the online meeting based on the digital person can meet the timeliness of the user's participation in the meeting, thereby improving the user's meeting experience.
[0112] In one case, the first meeting may be any meeting that the user wants to attend. In this way, based on the meeting attendance method provided in the embodiment of the present application, the digital human of the first user may attend the first meeting on behalf of the first user.
[0113] In another case, the first meeting can be any meeting that the first user is currently attending. In this way, based on the meeting attendance method provided in the embodiment of the present application, the first user's digital human can attend the first meeting on behalf of the first user. The first user can perform other operations, such as attending other meetings.
[0114] In another case, the first meeting can be any meeting that the first user currently needs to attend, but the first meeting conflicts with any meeting that the first user is currently attending (e.g., the second meeting). In this case, based on the meeting attendance method provided in the embodiment of the present application, the first user's digital human can attend the first meeting on behalf of the first user, while the first user continues to attend the second meeting.
[0115] 8 , the users participating in the first conference include user 801, user 802, user 803, and user 804. The "I" in user 801 is the first user corresponding to the client in the embodiment of the present application (or the first user using the client).
[0116] In addition, the conference interface of the first conference may include a floating box 805 , which is used to invite the user 801 to participate in the second conference.
[0117] The floating box 805 includes a control 8051 , a control 8052 and a control 8053 .
[0118] Specifically, the first user can hang up (or reject) the conference invitation related to the second conference by clicking the control 8051.
[0119] The first user can make the digital person of user 801 participate in the second meeting by clicking control 8052.
[0120] The first user can enable user 801 to participate in the second meeting by clicking control 8053, and the digital person of user 801 can participate in the first meeting.
[0121] In one implementation of the embodiment of the present application, the users participating in the first user also include the second user. In conjunction with Figure 5 , as shown in Figure 9 , the conference participation method provided in the embodiment of the present application may further include S507 - S508 .
[0122] S507: The digital conference gateway obtains the first content.
[0123] The first content is the content matching the target question stored in the digital conference gateway, and the target question is a question related to the first user in the conference content of the first conference.
[0124] In an optional implementation, the digital human conference gateway may pre-store a knowledge base of the first user, the knowledge base including at least one reply content, and the first content is the reply content included in the at least one reply content.
[0125] S508: The digital conference gateway sends the first data stream to the second user. Correspondingly, the second user receives the first data stream sent by the digital conference gateway.
[0126] The first data stream is the data stream corresponding to the first content.
[0127] It should be understood that the second user receiving the first data stream specifically means that the client corresponding to the second user (or an electronic device installed with the client) receives the first data stream sent by the digital conference gateway.
[0128] In the embodiment of the present application, the first content may be an image, audio, video (or audio and video), text (or text), emoticon or symbol, etc. For example, when the first content is audio and video, the data stream may be an audio and video stream.
[0129] It can be understood that since the first data stream sent by the server to the second user is generated based on the digital human image and the first content, the second user displays (or plays) the first data stream after receiving it, and can simulate the first user's voice and express the first content in the form of a digital human, thereby improving the authenticity of the digital human's participation in the meeting.
[0130] In one implementation of the embodiment of the present application, the digital human conference gateway may first obtain the digital human image of the digital human, and generate the first data stream based on the digital human image and the first content.
[0131] It should be understood that for any content, the server can accurately and effectively generate the data stream corresponding to the content based on the content and the digital human image, thereby improving the effectiveness of data stream generation and thus improving the authenticity of the online meeting.
[0132] Optionally, the conference system in the embodiment of the present application further comprises a digital human generation device. After acquiring the audio and video information of the first user, the client can send the audio and video information to the digital human generation device, so that the digital human generation device can generate a digital human image of the digital human based on the audio and video information and send the digital human image to the digital human conference gateway.
[0133] Specifically, the digital human generation device can generate a digital human image exclusive to the first user (i.e., the digital human image of the above-mentioned digital human) by means of cutouts and audio timbre inference and training.
[0134] In the embodiment of the present application, the digital human conference gateway can save the digital human image after receiving the digital human image sent by the digital human generation device, and save the corresponding relationship between the digital human image and the user.
[0135] It should be understood that since the correspondence between the digital human image and the user is saved in the server, after the server obtains the meeting participation request sent by the client, it can obtain (or determine) the digital human image corresponding to the first user (specifically the digital human image of the first user's digital human) from the correspondence, and thus obtain the corresponding data stream based on the digital human image, that is, it can simulate the user's voice and form in the form of a digital human, thereby improving the authenticity of the digital human's participation in the meeting.
[0136] Optionally, the digital human generation device can also be called a digital human generation module. The functions of the digital human generation device can also be integrated into the server in the embodiment of the present application.
[0137] In an optional implementation, the server (specifically, the digital conference gateway) may also send the first data stream to the client corresponding to the first user. In this way, the client may display the conference interface of the first conference based on the first data stream, specifically, the client plays the first data stream in the conference interface of the first conference.
[0138] It should be understood that since the first data stream is generated by the digital human conference gateway based on the digital human image and the first content, the conference interface of the first meeting can be displayed based on the first data stream, and the first content can be expressed in the form of a digital human by simulating the user's voice, thereby improving the authenticity of the digital human conference.
[0139] It should be understood that the server can obtain the first content, which means that the server stores content that matches the target question. At this time, the server sends the data stream corresponding to the first content (i.e., the first data stream) to the client, which means that feedback can be provided based on the target question conveniently and quickly, thereby improving the efficiency of content question and answering.
[0140] In addition, after receiving the first data stream sent by the server, the client can display the conference interface of the first meeting based on the first data stream. Specifically, the first data stream is played in the conference interface of the first meeting, which can simulate the user's voice expression in the form of a digital person and match the content of the target question, thereby improving the authenticity of the digital person's participation in the meeting.
[0141] In combination with FIG5 , as shown in FIG10 , the conference participation method provided in the embodiment of the present application may further include S509 .
[0142] S509: When the digital conference gateway does not store content matching the target question, the digital conference gateway sends a first prompt message to the client. Correspondingly, the client receives the first prompt message sent by the digital conference gateway.
[0143] The first prompt information is used to prompt that there is no content matching the target question in the digital conference gateway.
[0144] In combination with the description of the above embodiment, it should be understood that the target question is a question related to the first user in the conference content of the first conference.
[0145] Continuing with FIG10 , the client displays the conference interface of the first conference, specifically including S5061 .
[0146] S5061. The client displays a first prompt message in the conference interface of the first conference.
[0147] In an optional implementation, the digital conference gateway may send the target question to the client, so that the client may display the target question on the conference interface of the first conference.
[0148] It should be understood that the first user can quickly answer the target questions displayed on the meeting interface, which improves the efficiency of question and answering while ensuring the effective progress of the online meeting.
[0149] Optionally, the conference system is further deployed with a media server, which can send the conference content of the first conference to the digital conference gateway. The target question is identified by the digital conference gateway from the conference content of the first conference.
[0150] In this embodiment of the present application, when the server does not store content matching the target question, the server may send a first prompt to the client, indicating that the server does not have content matching the target question. The client may then display this first prompt in the conference interface of the first meeting, thereby reminding the first user to answer the target question and improving the effectiveness of the answer.
[0151] In an optional implementation, the user participating in the first conference also includes a second user. In conjunction with Figure 5 , as shown in Figure 11 , the conference participation method provided in the embodiment of the present application may further include S510 - S511 .
[0152] S510: The digital human conference gateway sends a second prompt message to the conference management server. Correspondingly, the conference management server receives the second prompt message sent by the digital human conference gateway.
[0153] The second prompt information is used to prompt that the digital person of the first user is a user who participates in the first conference.
[0154] In the embodiment of the present application, the second prompt information can also be understood as prompting the digital person of the first user to participate in the first meeting on behalf of the first user.
[0155] S511: The conference management server sends a second prompt message to the second user. Correspondingly, the second user receives the second prompt message sent by the conference management server.
[0156] It should be understood that after receiving the second prompt information sent by the digital human conference gateway, the second user can display the second prompt information. This can help other users participating in the meeting to easily and quickly identify that it is the first user's digital human rather than the first user himself who is participating in the first meeting, which can promote the effective progress of the first meeting.
[0157] In an optional implementation, the second prompt information is specifically used to prompt the digital human of the first user to express the target content in the first meeting on behalf of the first user. In this way, the conference participation method provided in the embodiment of the present application can also include steps A to D.
[0158] Step A: The client receives a second operation event from the user.
[0159] The second operation event is used to instruct the digital human of the first user to express the target content in the first meeting instead of the first user.
[0160] It should be understood that the manner in which the first user triggers the second operation event is the same as or similar to the manner in which the first user triggers the first operation event in the above embodiment, and will not be described in detail here.
[0161] Optionally, the target content may be the same as or different from the above-mentioned first content, and the embodiment of the present application does not limit the specific content included in the target content.
[0162] 12 , user 1201 is participating in a second conference, and users participating in the second conference also include user 1202, user 1203, and user 1204. User 1201 triggers a second operation event by keyboard input (specifically, inputting text information).
[0163] Specifically, user 1201 enters the following text message: "My opinion is Content 2. Please convey it to me." Content 2 is the target content in the above embodiment. User 1201's digital human can reply to user 1201 with the text message "OK." Afterwards, user 1201's digital human can express Content 2 on behalf of user 1201.
[0164] Afterwards, in response to the second operation event, the client may send a replacement request to the conference management server. Accordingly, the conference management server receives the replacement request sent by the client. The replacement request is used to instruct the second user's digital human to express the target content on behalf of the user.
[0165] Step B: The conference management server sends a replacement request to the digital conference gateway. Correspondingly, the digital conference gateway receives the replacement request sent by the conference management server.
[0166] Step C: The digital human conference gateway sends a second prompt message to the conference management server. Correspondingly, the conference management server receives the second prompt message sent by the digital human conference gateway.
[0167] Step D: The conference management server sends a replacement response to the second user. Correspondingly, the second user receives the replacement response sent by the conference management server.
[0168] In an optional implementation, the conference management server may also send a second prompt message to the client (specifically, the client corresponding to the first user) via the digital conference gateway, so that the client may display the second prompt message in the conference interface of the first conference.
[0169] Exemplarily, the second prompt information may be a preset shape, such as a palm, a light bulb, or a bright spot.
[0170] For example, as shown in Figure 13, the users participating in the first meeting include the digital human of user 1301, user 1302, user 1303, and user 1304. By displaying a palm in the lower right corner of user 1301's digital human, indicating that user 1301's digital human is raising its hand (or ready to speak), users 1302, 1303, and 1304 can determine that user 1301's digital human will participate in the first meeting on behalf of user 1301. In addition, user 1301's digital human can express target content on behalf of user 1301.
[0171] In one implementation of the embodiment of the present application, the digital human conference gateway can generate a target data stream (the target data stream is the data stream corresponding to the target content) based on the target content and the digital human's digital human image, and send the target data stream to the second user. After receiving the target data stream, the second user can display / play the target data stream based on the target content.
[0172] It should be understood that the second user displays / plays the target data stream, which can simulate the user's voice in the form of a digital human to express relevant content instead of the user, and can meet various conference scenarios.
[0173] Optionally, the conference management server may also send the second prompt information and / or target data stream to the media server so that the media server may send the second prompt information and / or target data stream to other users (or other clients / other electronic devices) in the network.
[0174] In combination with Figure 5, as shown in Figure 14, the conference participation method provided in the embodiment of the present application may also include S512-S518.
[0175] S512: The client receives a third operation event sent by the first user.
[0176] The third operation event is used to instruct the first user's digital human to obtain the minutes of the first meeting.
[0177] S513: In response to the third operation event, the client sends an acquisition request to the conference management server. Correspondingly, the conference management server receives the acquisition request sent by the client.
[0178] The acquisition request is used to instruct the first user's digital human to request to obtain the minutes of the first meeting.
[0179] S514: The conference management server sends an acquisition request to the digital conference attendee gateway. Correspondingly, the digital conference attendee gateway receives the acquisition request sent by the conference management server.
[0180] S515. The digital conference gateway obtains the content of the first conference.
[0181] Optionally, the digital conference gateway may receive the audio and video stream of the first conference sent by the above-mentioned media server, and perform identification processing on the audio and video stream of the first conference to obtain the conference content of the first conference.
[0182] S516. The digital human conference gateway identifies and processes the content of the first meeting to obtain the minutes of the first meeting.
[0183] S517: The Digital Human Conference Gateway sends an acquisition response to the Conference Management Server. Correspondingly, the Conference Management Server receives the acquisition response sent by the Digital Human Gateway.
[0184] The acquisition response includes the minutes of the first meeting.
[0185] S518: The conference management server sends an acquisition response to the client. Correspondingly, the client receives the acquisition response sent by the conference management server.
[0186] Continuing with FIG14 , the client displays the conference interface of the first conference, specifically including S5062 .
[0187] S5062. The client displays the minutes of the first meeting in the meeting interface of the first meeting.
[0188] 15 , the users participating in the first conference include user 1501, user 1502, user 1503, and user 1504. User 1501 triggers a third operation event by keyboard input (specifically, inputting text information).
[0189] Specifically, the text message input by user 1501 is: Please synchronize the content of meeting 1505 to me in real time. The digital human of user 1501 can reply to user 1501 with a response text, specifically the minutes of meeting 1505.
[0190] Optionally, the conference 1505 shown in FIG. 15 may be a conference attended by the digital person of the first user (ie, the first conference), or may be another conference (eg, a conference currently being attended by the user).
[0191] In an embodiment of the present application, first, the client can receive a third operation event from the first user for instructing the first user's digital person to obtain the minutes of the first meeting; thereafter, in response to the third operation event, the client can send an acquisition request to the server, that is, instructing the first user's digital person to request to obtain the minutes of the first meeting; after receiving the acquisition request, the server can send an acquisition response to the client, and the acquisition response includes the minutes of the first meeting, so that the client can obtain the minutes of the first meeting. Finally, the client can display the minutes of the first meeting in the meeting interface of the first meeting. In an embodiment of the present application, after receiving the third operation event from the first user, the client can not only participate in the online meeting based on the first user's digital person, but also obtain the minutes of the online meeting based on the digital person, and can realize a variety of participation functions in the online meeting based on the digital person, thereby improving the effectiveness of user participation.
[0192] In one implementation of the embodiment of the present application, the user participating in the first conference also includes a second user. In conjunction with Figure 5 , as shown in Figure 16 , the conference participation method provided by the embodiment of the present application further includes S519 .
[0193] S519: When the digital human conference gateway identifies the user information of the first user from the conference content of the first conference, the digital human conference gateway sends a second data stream to the second user.
[0194] The second data stream is a data stream corresponding to second content, and the second content is content related to the user information of the first user.
[0195] Optionally, the user information of the first user includes a user identifier of the first user.
[0196] It should be understood that when the server recognizes the user information of the first user from the meeting content of the first meeting, it indicates that the meeting content of the first meeting (including the current meeting content) may be highly relevant to the user. At this time, the server can send a data stream corresponding to the second content (i.e., a second data stream) to the second user. After receiving the second data stream, the second user can display / play the second data stream, which can simulate the user's voice and color in the form of a digital human to represent the content related to the user information, thereby meeting the user's diverse meeting needs.
[0197] In an optional implementation, the second data stream may be a data stream simulating the first user's voice, indicating that the first user's digital human has participated in the first meeting. For example, the second data stream may be a response (e.g., "Answer") sent by the digital human conference gateway upon recognizing that the host of the first meeting is calling the roll (specifically, calling the first user's name).
[0198] In an optional implementation, the server may also send the second data stream to the client (specifically the client corresponding to the first user), so that the client can display the conference interface of the first conference based on the second data stream, specifically display the second data stream on the conference interface of the first conference.
[0199] It is understandable that in order to implement the functions in the above embodiments, the client and server include hardware structures and / or software modules corresponding to the execution of each function. It should be readily apparent to those skilled in the art that, in combination with the units and method steps of each example described in the embodiments disclosed in this application, this application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application scenario and design constraints of the technical solution.
[0200] The above text describes in detail the conference participation method provided according to this embodiment in conjunction with Figures 1 to 16. The following text describes the conference participation device provided according to this embodiment in conjunction with Figure 17.
[0201] The present application also provides a conference participating device, which is applied to a client. As shown in FIG17 , the conference participating device 170 includes: a receiving module 1701 , a first sending module 1702 , a second sending module 1703 and a display module 1704 .
[0202] The receiving module 1701 is configured to receive a first operation event of a first user, where the first operation event is used to instruct the digital human of the first user to join a first conference.
[0203] The first sending module 1702 is configured to send a conference joining request to the server in response to the first operation event, where the conference joining request is used to indicate that the user's digital human requests to join the first conference.
[0204] The second sending module 1703 is configured to send a conference joining response to the client, where the conference joining response is used to notify the first user's digital human that the first user has successfully joined the first conference.
[0205] The display module 1704 is configured to display a conference interface of the first conference, where the conference interface displays users participating in the first conference, including the digital human of the first user.
[0206] In one possible design, the first user is participating in a second conference.
[0207] In a possible design, the users participating in the first conference also include a second user, and the conference participating device 170 also includes an acquisition module 1705.
[0208] The acquisition module 1705 is configured to acquire first content, where the first content is content stored in the server and matches a target question, and the target question is a question related to the first user in the conference content of the first conference.
[0209] The second sending module 1703 is configured to send a first data stream to the second user, where the first data stream is a data stream corresponding to the first content.
[0210] In one possible design, the second sending module 1703 is also used to send a first prompt message to the client when the server does not store content matching the target question. The first prompt message is used to prompt that there is no content matching the target question in the server, and the target question is a question related to the first user in the meeting content of the first meeting.
[0211] The display module 1704 is specifically configured to display the first prompt information in the conference interface of the first conference.
[0212] In a possible design, the second sending module 1703 is further used to send a target question to the client, where the target question is a question related to the first user in the conference content of the first conference.
[0213] The display module 1704 is specifically configured to display the target question on the conference interface of the first conference.
[0214] In one possible design, the second sending module 1703 is further used to send a second prompt message to the above-mentioned second user, and the second prompt message is used to prompt that the digital person of the first user is a user participating in the first meeting.
[0215] In one possible design, the second sending module 1703 is also used to send a second data stream to the above-mentioned second user when the server identifies the user information of the first user from the conference content of the first conference. The second data stream is a data stream corresponding to the second content, and the second content is content related to the user information.
[0216] The sending module (including the first sending module and the second sending module), the receiving module, the display module, and the acquisition module can all be implemented by software or by hardware. For example, the implementation of the display module will be described below using the display module as an example. Similarly, the implementation of the sending module, the receiving module, and the acquisition module can refer to the implementation of the display module.
[0217] As an example of a software functional unit, a module may include code running on a computing instance. The computing instance may include at least one of a physical host (computing device), a virtual machine, and a container. Furthermore, the computing instance may be one or more. For example, the display module may include code running on multiple hosts / virtual machines / containers. It should be noted that the multiple hosts / virtual machines / containers used to run the code may be distributed in the same region or in different regions. Furthermore, the multiple hosts / virtual machines / containers used to run the code may be distributed in the same availability zone (AZ) or in different AZs, each AZ including one data center or multiple geographically close data centers. Typically, a region may include multiple AZs.
[0218] Similarly, multiple hosts / virtual machines / containers running the code can be distributed within the same virtual private cloud (VPC) or across multiple VPCs. Typically, a VPC is set up within a region. Cross-region communication between two VPCs within the same region, or between VPCs in different regions, requires a communication gateway within each VPC to interconnect the VPCs.
[0219] As an example of a hardware functional unit, a display module may include at least one computing device, such as a server. Alternatively, the display module may be implemented using an application-specific integrated circuit (ASIC) or a programmable logic device (PLD). The PLD may be a complex programmable logical device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof.
[0220] The multiple computing devices included in the display module can be distributed in the same region or in different regions. The multiple computing devices included in the display module can be distributed in the same AZ or in different AZs. Similarly, the multiple computing devices included in the display module can be distributed in the same VPC or in multiple VPCs. The multiple computing devices can be any combination of servers, ASICs, PLDs, CPLDs, FPGAs, GALs, and other computing devices.
[0221] It should be noted that in other embodiments, the display module can be used to execute any step in the conference participation method, the sending module can be used to execute any step in the conference participation method, the receiving module can be used to execute any step in the conference participation method, and the acquisition module can also be used to execute any step in the conference participation method. The steps that the sending module, receiving module, acquisition module, and display module are responsible for implementing can be specified as needed. The full functionality of the conference participation device is achieved by having the sending module, receiving module, acquisition module, and display module respectively implement different steps in the conference participation method.
[0222] This application also provides a computing device 1800. As shown in Figure 18, computing device 1800 includes a bus 1802, a processor 1804, a memory 1806, and a communication interface 1808. Processor 1804, memory 1806, and communication interface 1808 communicate with each other via bus 1802. Computing device 1800 can be a server or a terminal device. It should be understood that this application does not limit the number of processors and memories in computing device 1800.
[0223] Bus 1802 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, among others. Buses may be classified as address buses, data buses, control buses, and the like. For ease of illustration, FIG18 illustrates a single bus line, but this does not imply a single bus or type of bus. Bus 1802 may include a path for transmitting information between various components of computing device 1800 (e.g., memory 1806, processor 1804, and communication interface 1808).
[0224] The processor 1804 may include any one or more processors such as a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP), or a digital signal processor (DSP).
[0225] The memory 1806 may include volatile memory, such as random access memory (RAM). The processor 1804 may also include non-volatile memory, such as read-only memory (ROM), flash memory, hard disk drive (HDD), or solid state drive (SSD).
[0226] The memory 1806 stores executable program codes, and the processor 1804 executes the executable program codes to respectively implement the functions of the aforementioned receiving module, sending module, acquiring module, and display module, thereby implementing the conference joining method. That is, the memory 1806 stores instructions for executing the conference joining method.
[0227] The communication interface 1808 uses a transceiver module such as, but not limited to, a network interface card or a transceiver to implement communication between the computing device 1800 and other devices or a communication network.
[0228] Embodiments of the present application also provide a computing device cluster. The computing device cluster includes at least one computing device. The computing device can be a server, such as a central server, an edge server, or a local server in a local data center. In some embodiments, the computing device can also be a terminal device such as a desktop computer, a laptop computer, or a smartphone.
[0229] As shown in Figure 19, the computing device cluster includes at least one computing device 1800. The memory 1806 in one or more computing devices 1800 in the computing device cluster may store the same instructions for executing the conference participation method.
[0230] In some possible implementations, the memory 1806 of one or more computing devices 1800 in the computing device cluster may also store partial instructions for executing the conference joining method. In other words, the combination of one or more computing devices 1800 can jointly execute the instructions for executing the conference joining method.
[0231] It should be noted that the memory 1806 in different computing devices 1800 in the computing device cluster can store different instructions, each for executing a portion of the functions of the participating device. In other words, the instructions stored in the memory 1806 in different computing devices 1800 can implement the functions of one or more modules among the receiving module, the sending module, the acquiring module, and the display module.
[0232] In some possible implementations, one or more computing devices in a computing device cluster may be connected via a network. The network may be a wide area network (WAN) or a local area network (LAN), etc. FIG. 20 illustrates a possible implementation. As shown in FIG. 20 , two computing devices 1800A and 1800B are connected via a network. Specifically, the network is connected via a communication interface in each computing device. In this type of possible implementation, the memory 1806 in the computing device 1800A stores instructions for executing the functions of a sending module, a receiving module, and an acquiring module. Simultaneously, the memory 1806 in the computing device 1800B stores instructions for executing the functions of a display module.
[0233] The connection mode between the computing device clusters shown in FIG20 may be considered to be that the conference participation method provided by the present application requires a large number of display processes, so it is considered to delegate the functions implemented by the display module to the computing device 1800B.
[0234] It should be understood that the functionality of the computing device 1800A shown in FIG20 may also be implemented by multiple computing devices 1800. Similarly, the functionality of the computing device 1800B may also be implemented by multiple computing devices 1800.
[0235] The present application also provides another computing device cluster. The connection relationship between the computing devices in the computing device cluster can be similar to the connection method of the computing device cluster described in Figures 19 and 20. The difference is that the memory 1806 of one or more computing devices 1800 in the computing device cluster can store the same instructions for executing the conference participation method.
[0236] In some possible implementations, the memory 1806 of one or more computing devices 1800 in the computing device cluster may also store partial instructions for executing the conference joining method. In other words, the combination of one or more computing devices 1800 can jointly execute the instructions for executing the conference joining method.
[0237] The present application also provides a computer program product including instructions. The computer program product may be software or a program product including instructions that can be run on a computing device or stored in any available medium. When the computer program product is run on at least one computing device, the at least one computing device executes a conference participation method.
[0238] The embodiment of the present application also provides a computer-readable storage medium. The computer-readable storage medium can be any available medium that can be stored by a computing device or a data storage device such as a data center containing one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive). The computer-readable storage medium includes instructions that instruct the computing device to execute the conference participation method.
[0239] An embodiment of the present application also provides a conference participation system, which includes the client and server involved in the above embodiment.
[0240] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the protection scope of the technical solutions of the various embodiments of the present invention.
Claims
1. A method for participating in a meeting, characterized in that Applied to a conferencing system, the conferencing system includes a client and a server, and the method includes: The client receives a first operation event of a first user, and the first operation event is used to indicate that the digital human of the first user joins a first meeting; In response to the first operation event, the client sends a participation request to the server, and the participation request is used to indicate that the digital human of the user requests to join the first meeting; The server sends a participation response to the client, and the participation response is used to notify that the digital human of the first user has successfully joined the first meeting; The client displays the meeting interface of the first meeting, and the meeting interface displays the users participating in the first meeting, and the users participating in the first meeting include the digital human of the first user.
2. The method according to claim 1, wherein The first user is participating in a second meeting.
3. The method according to claim 1 or 2, characterized in that, The users participating in the first meeting further include a second user, and the method further includes: The server obtains first content, where the first content is the content stored in the server that matches a target problem, and the target problem is a problem related to the first user in the meeting content of the first meeting; The server sends a first data stream to the second user, and the first data stream is the data stream corresponding to the first content.
4. The method according to any one of claims 1 to 3, characterized in that, The method further includes: When the server does not store content that matches the target problem, the server sends a first prompt message to the client, and the first prompt message is used to prompt that there is no content in the server that matches the target problem, and the target problem is a problem related to the first user in the meeting content of the first meeting; The client displays the meeting interface of the first meeting, including: The client displays the first prompt message in the meeting interface of the first meeting.
5. The method according to any one of claims 1-4, characterized in that, The method further includes: The server sends a target problem to the client, and the target problem is a problem related to the first user in the meeting content of the first meeting; The client displays the meeting interface of the first meeting, including: The client displays the target problem in the meeting interface of the first meeting.
6. The method according to any one of claims 1-5, characterized in that, The users participating in the first meeting further include a second user, and the method further includes: The server sends a second prompt message to the second user, and the second prompt message is used to prompt that the digital human of the first user is a user participating in the first meeting.
7. The method according to any one of claims 1-6, characterized in that, The users participating in the first meeting further include a second user, and the method further includes: When the server identifies the user information of the first user from the meeting content of the first meeting, the server sends a second data stream to the second user, and the second data stream is the data stream corresponding to the second content, and the second content is the content related to the user information.
8. A participating device, characterized in that, Including: A receiving module, a first sending module, a second sending module, and a display module; The receiving module is used to receive a first operation event of a first user, and the first operation event is used to indicate that the digital human of the first user joins a first meeting; The first sending module is configured to send a participation request to a server in response to the first operation event, where the participation request is used to indicate that the digital human of the user requests to join the first meeting; The second sending module is configured to send a participation response to a client, where the participation response is used to notify that the digital human of the first user has successfully joined the first meeting; The display module is configured to display a meeting interface of the first meeting, where the meeting interface displays users participating in the first meeting, and the users participating in the first meeting include the digital human of the first user.
9. The device according to claim 8, characterized in that, The first user is participating in a second meeting.
10. The device according to claim 8 or 9, characterized in that The users participating in the first meeting further include a second user, and the device further includes an acquisition module; The acquisition module is configured to acquire first content, where the first content is content stored in the server and matching a target question, and the target question is a question related to the first user in the meeting content of the first meeting; The second sending module is configured to send a first data stream to the second user, where the first data stream is a data stream corresponding to the first content.
11. The device according to any one of claims 8-10, wherein The second sending module is further configured to send a first prompt message to the client when the server does not store content matching the target question, where the first prompt message is used to prompt that there is no content matching the target question in the server, and the target question is a question related to the first user in the meeting content of the first meeting; The display module is specifically configured to display the first prompt message in the meeting interface of the first meeting.
12. The device according to any one of claims 8-11, wherein The second sending module is further configured to send the target question to the client, where the target question is a question related to the first user in the meeting content of the first meeting; The display module is specifically configured to display the target question in the meeting interface of the first meeting.
13. The device according to any one of claims 8 to 12, characterized in that, The users participating in the first meeting further include a second user; The second sending module is further configured to send a second prompt message to the second user, where the second prompt message is used to prompt that the digital human of the first user is a user participating in the first meeting.
14. The device according to any one of claims 8-13, characterized in that, The users participating in the first meeting further include a second user; The second sending module is further configured to send a second data stream to the second user when the server identifies the user information of the first user from the meeting content of the first meeting, where the second data stream is a data stream corresponding to second content, and the second content is content related to the user information.
15. A cluster of computing devices, characterized in that, including at least one computing device, each computing device including a processor and a memory; The processor of the at least one computing device is configured to execute instructions stored in the memory of the at least one computing device, so that the computing device cluster executes the participation method according to any one of claims 1-7.
16. A computer program product comprising instructions, characterized in that, When the instructions are run by a cluster of computing devices, the cluster of computing devices is caused to execute the participation method according to any one of claims 1-7.
17. A computer-readable storage medium, characterized in that, It includes computer program instructions. When the computer program instructions are executed by a cluster of computing devices, the cluster of computing devices executes the participation method according to any one of claims 1-7.
Citation Information
Patent Citations
Virtual conference management method and device, equipment and medium
CN117040952A
Online conference processing method, device and equipment and computer readable storage medium
CN117938561A
Method of simultaneously participating in multiple evnets in virtual space and apparatus thereof
KR102593239B1
Managing, monitoring and transcribing concurrent meetings and / or conference calls
US20180191907A1
Automated Testing System for A Video Conferencing System
US20230370295A1