Method for displaying conference data, conference system, and computing device

Abstract

Embodiments of the present application belong to the technical field of cloud computing, and disclose a method for displaying conference data, a conference system, and a computing device. The method is applied to a conference system, the conference system comprising a participating terminal, and a cloud platform for operating a conference management service. The method comprises: a participating terminal acquires the participation state of a first participant in an online conference; in response to the participation state of the first participant being a temporarily offline state, the participating terminal sends a first temporarily offline state notification to a conference management service; upon receiving the first temporarily offline state notification, the conference management service executes a management operation on conference data in the online conference; in response to the participation state of the first participant changing from the temporarily offline state to a listening state, the participating terminal, by means of a conference data playback window, displays the conference data corresponding to the management operation. By employing the present application, participants missing conference content in an online conference can be avoided.

Description

Method for displaying conference data, conference system and computing device

[0001] This application claims priority to Chinese patent application No. 202311563628.8 filed on November 21, 2023, entitled “A method and device for setting an away status and interaction in a conference system”, and No. 202410153104.X filed on February 2, 2024, entitled “Method, conference system and computing device for displaying conference data”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of cloud computing technology, and in particular to a method for displaying conference data, a conference system, and a computing device. Background Art

[0003] With the development of Internet technology and cloud computing technology, the application of online meetings is becoming more and more widespread.

[0004] Participants may leave an online meeting for various reasons. For example, they may need to make a phone call during the meeting. However, leaving the meeting midway may result in missing out on important content.

[0005] Summary of the Invention

[0006] The present application provides a method, conference system, and computing device for displaying conference data, which can prevent participants from missing the content of online conferences. The corresponding technical solutions are as follows:

[0007] In a first aspect, a method for displaying conference data is provided, which is applied to a conference system. The conference system includes a cloud platform and conference terminals, and the cloud platform includes a conference management service. The method includes:

[0008] A participant terminal obtains the participant status of the first participant corresponding to the participant terminal in the online conference, where the participant status includes listening status or detached status. In response to the first participant's participant status being detached, the participant terminal sends a first detached status notification to the conference management service. Upon receiving the first detached status notification, the conference management service performs a management operation on conference data in the online conference. In response to the first participant's participant status changing from detached to listening status, the participant terminal displays the conference data corresponding to the management operation in the conference data playback window.

[0009] In the solution shown in this application, the participating terminal is able to identify the participating status of the first participant who uses the participating terminal to participate in the online meeting. When the participating terminal determines that the first participant is in the temporarily away state, it can notify the conference management service to perform management operations on the conference data when the first participant is in the temporarily away state. Then, when the participating terminal determines that the online state is restored, the participating terminal can display the conference data corresponding to the management operation through the conference data playback window. In this way, the first participant can watch the content of the meeting when he is temporarily away and will not miss the important content of the online meeting.

[0010] In one feasible manner, the above method also includes: when the first participant's attendance status is in a temporarily away state, the conference management service sends a prompt message to the participating terminals corresponding to the other participants in response to detecting the identity information of the first participant in the audio data of other participants in the online conference, and the prompt message is used to indicate that the first participant is in a temporarily away state.

[0011] In the solution shown in the present application, the conference management service can identify whether the audio data of other participants in the online meeting include the identity information of the first participant when the first participant is in a temporarily away state. The identity information of the first participant can be the name of the first participant, the title of the position, the name used by the first participant to participate in the online meeting, etc. If the conference management service identifies the identity information of the first participant in the audio data of other participants, it can send a prompt message to the corresponding participating terminals of the other participants to remind the other participants that the first participant is in a temporarily away state. In this way, it can avoid that other participants communicate with the first participant when the first participant is in a temporarily away state, thereby avoiding ineffective communication in the online meeting, and thereby improving the communication efficiency of the participants in the online meeting.

[0012] In one feasible manner, the above method further includes: when the first participant's attendance status is in a temporarily away state, the conference management service sends a prompt message to the participant terminals corresponding to the other participants in response to receiving interactive operations between other participants and the first participant, and the prompt message is used to indicate that the first participant is in a temporarily away state.

[0013] In the solution shown in the present application, the conference management service can detect whether other participants have performed interactive operations with the first participant, such as "@"ing the first participant, when the first participant is in the temporarily away state. If the conference management service detects that other participants have performed interactive operations with the first participant, it can send a prompt message to the corresponding participating terminals of the other participants to remind the other participants that the first participant is in the temporarily away state. In this way, it is possible to avoid other participants communicating with the first participant when the first participant is in the temporarily away state, thereby avoiding ineffective communication in the online meeting and improving the communication efficiency of the participants in the online meeting.

[0014] In one practicable embodiment, a participant terminal obtains the attendance status of a first participant corresponding to the participant terminal in an online conference, including: obtaining an image of the first participant captured by the participant terminal according to a detection period. After each acquisition of the image of the first participant, the first participant's facial image is detected in the image of the first participant. In response to the number of consecutive times that the first participant's facial image is not detected exceeding a threshold, the first participant's attendance status is determined to be temporarily away.

[0015] In one feasible method, in response to the fact that the number of consecutive times that the facial image of the first participant is not detected exceeds a number threshold, the first participant's attendance status is determined to be a temporarily away state, including: in response to the fact that the number of consecutive times that the facial image of the first participant is not detected exceeds a number threshold, and no operation information of the participating terminal is detected within a specified time period, the first participant's attendance status is determined to be a temporarily away state.

[0016] In the solution shown in this application, the participating terminal can accurately determine whether the first participant's participating status is temporarily away based on the number of times the first participant's facial image is not detected and the length of time the first participant has not operated the participating terminal.

[0017] In one achievable embodiment, performing management operations on conference data in an online conference includes: a conference management service sending a conference data storage notification to a participating terminal. In response to receiving the conference data storage notification, the participating terminal stores the currently received video data and audio data of the online conference.

[0018] In the solution described in this application, the management operation for conference data can be that the participating terminal stores the conference data when the first participant is temporarily away. In this way, after the first participant returns to the listening state, the participating terminal can play the stored conference data, thereby preventing the first participant from missing important conference content.

[0019] In one conceivable implementation, the aforementioned management operation on conference data in an online conference includes: a conference management service obtaining audio data of other participants in the online conference, converting the obtained audio data of each participant into text data. The conference management service then sends the obtained text data corresponding to each participant to a participating terminal. The participating terminal then receives and stores the text data corresponding to each participant.

[0020] In the solution described in this application, the management operation for conference data can also be that the conference management service converts the audio data of other participants into text data when the first participant is temporarily away, and sends it to the participating terminal for storage. In this way, after the first participant returns to the listening state, the participating terminal can display the stored text data, thereby preventing the first participant from missing important meeting content.

[0021] In one practicable embodiment, the method further includes: upon receiving the first away status notification, the conference management service sends a second away status notification to the participating terminals corresponding to other participants in the online conference. The second away status notification instructs the participating terminals corresponding to the other participants to add an away indicator in the display window corresponding to the first participant. This can remind the other participants that the first participant is away, avoid ineffective communication between the other participants and the first participant in the online conference, and thereby improve the communication efficiency of the participants in the online conference.

[0022] In one practicable embodiment, the method further includes: in response to the first participant's attendance status being in an Away state, displaying a control for releasing the Away state in the online conference interface of the participant terminal. In response to a click operation on the control for releasing the Away state, determining that the first participant's attendance status is updated from the Away state to the Listening state.

[0023] In a second aspect, a conference system is provided, which includes a cloud platform and conference terminals. The cloud platform includes a conference management service, wherein:

[0024] The participant terminal is used to obtain the participant status of the first participant corresponding to the participant terminal in the online conference, where the participant status includes a listening state or an away state.

[0025] The conference participant terminal is configured to send a first away status notification to the conference management service in response to the first participant's attendance status being away.

[0026] The conference management service is used to perform management operations on conference data in the online conference after receiving the first temporary absence status notification.

[0027] The conference terminal is configured to display conference data corresponding to the management operation through a conference data playback window in response to the first participant's conference status being changed from an absent status to a listening status.

[0028] In one feasible manner, when the first participant's attendance status is in the temporarily away state, the conference management service is used to send a prompt message to the participating terminals corresponding to the other participants in response to detecting the identity information of the first participant in the audio data of other participants in the online conference, where the prompt message is used to indicate that the first participant is in the temporarily away state.

[0029] In one feasible manner, while the first participant's attendance status is in the temporarily away state, the conference management service is used to send prompt information to the participant terminals corresponding to other participants in response to receiving interactive operations between other participants and the first participant, where the prompt information is used to indicate that the first participant is in the temporarily away state.

[0030] In one feasible method, the participating terminal is used to obtain the picture of the first participant taken by the participating terminal according to the detection period; after each time the picture of the first participant is obtained, it is detected whether there is a facial image of the first participant in the picture of the first participant; in response to the continuous number of times that the facial image of the first participant is not detected exceeds a number threshold, it is determined that the participating status of the first participant is a temporarily away state.

[0031] In one achievable manner, the participant terminal is configured to determine that the first participant's attendance status is temporarily away in response to the fact that the number of consecutive times the first participant's facial image is not detected exceeds a threshold and no operation information of the participant terminal is detected within a specified time period.

[0032] In one achievable manner, the conference management service is configured to send a conference data storage notification to a participating terminal. The participating terminal is configured to store the currently received video data and audio data of the online conference in response to receiving the conference data storage notification.

[0033] In one possible implementation, a conference management service is configured to obtain audio data from other participants in an online conference and convert the obtained audio data for each participant into text data. The conference management service is configured to send the obtained text data corresponding to each participant to a participating terminal. The participating terminal is configured to receive and store the text data corresponding to each participant.

[0034] In one feasible manner, the conference management service is used to send a second temporary absence status notification to the participating terminals corresponding to other participants in the online conference after receiving the first temporary absence status notification. The second temporary absence status notification is used to instruct the participating terminals corresponding to the other participants to add a temporary absence mark in the display window corresponding to the first participant.

[0035] In one feasible manner, the participating terminal is used to display a control for releasing the away status in the online conference interface of the participating terminal in response to the first participant's participating status being in the away status; in response to a click operation on the control for releasing the away status, it is determined that the first participant's participating status is updated from the away status to the listening status.

[0036] In a third aspect, a computing device cluster is provided, comprising at least one computing device, each computing device comprising a processor and a memory. The processor of the at least one computing device is configured to execute instructions stored in the memory of the at least one computing device, so that the computing device cluster performs the method described in the first aspect.

[0037] In a fourth aspect, a computer program product comprising instructions is provided. When the instructions are executed by a computing device cluster, the computing device cluster executes the method as described in the first aspect above.

[0038] In a fifth aspect, a computer-readable storage medium is provided, comprising computer program instructions. When the computer program instructions are executed by a computing device cluster, the computing device cluster executes the method described in the first aspect above. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] FIG1 is a flow chart of a method for displaying conference data provided by an embodiment of the present application;

[0040] FIG2 is a schematic diagram of an interface of an online conference provided in an embodiment of the present application;

[0041] FIG3 is a schematic diagram of an interface of an online conference provided in an embodiment of the present application;

[0042] FIG4 is a flow chart of a method for displaying conference data provided by an embodiment of the present application;

[0043] FIG5 is a schematic diagram of a conference system provided in an embodiment of the present application;

[0044] FIG6 is a schematic diagram of the structure of a computing device provided in an embodiment of the present application;

[0045] FIG7 is a schematic diagram of the structure of a computing device cluster provided in an embodiment of the present application;

[0046] FIG8 is a schematic diagram of the structure of a computing device cluster provided in an embodiment of the present application. DETAILED DESCRIPTION

[0047] In order to make the objectives, technical solutions and advantages of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0048] An online conference is a form of voice communication between multiple people using an online conferencing app. Because conference calls are not restricted by time or location, they are becoming increasingly popular in both personal and professional life.

[0049] In one example, a user can log in to his or her account in an online conference application running on a terminal, and then operate the online conference application to create or join an online conference in the online conference application. When a user creates a meeting in an online conference application, the online conference application can send a conference creation request to the cloud platform through the terminal. After receiving the conference creation request sent by the terminal, the conference management service of the cloud platform can create an online conference in the cloud platform and generate a conference identifier (Identity document, ID) for the conference, and then send the conference ID to the terminal. The user can forward the conference ID to other users who need to join the conference call. Other users can operate the online conference application, enter the received conference ID in the online conference application, and then join the corresponding online conference. In one example, each user who joins the online conference can be called a participant, and the person who creates the online conference can also be called a conference host.

[0050] After a participant joins a conference call using an online conferencing app running on their terminal, they can use the app to enable microphone access on their terminal, record the participant's audio through the microphone, and then send the captured audio to the conference management service. During the conference call, the participant can receive and play the audio of other participants sent by the conference management service on their terminal, allowing multiple participants to participate in an online conference call.

[0051] Unlike offline meetings, online participants may need to leave the meeting for various reasons, losing their ability to watch and listen to the entire meeting. This can lead to missing important content. For example, a participant might receive a call while participating in an online meeting on their mobile phone and need to answer it, causing them to miss part of the meeting. Furthermore, other participants cannot determine whether a participant is watching and listening to the meeting. While the participant is offline, they may try to communicate with the participant about the meeting. However, since the participant is not listening to the meeting, they cannot respond to other participants, reducing communication efficiency in the online meeting.

[0052] The present application provides a method for displaying conference data that can identify when a participant is temporarily away from an online conference, that is, when the participant is not viewing or listening to the online conference content. The method automatically records the content of the online conference while the participant is temporarily away, and can also notify other participants of the participant's temporary absence. This prevents participants from missing online conference content and improves communication efficiency among participants in online conferences.

[0053] Figure 1 is a flow chart of a method for displaying conference data provided by an embodiment of the present application. This method can be applied to a conference system including a cloud platform and a conference terminal, where a conference management service runs on the cloud platform. The method for displaying conference data is applied to the process of participants participating in an online conference. Referring to Figure 1, the method includes:

[0054] Step 101: A participant terminal obtains a participant status of a first participant corresponding to the participant terminal in an online conference, where the participant status includes a listening status or an away status.

[0055] The first participant can be any participant in the online meeting. The participant terminal can run an online meeting application, and the first participant can use the online meeting application on the participant terminal to participate in the online meeting. The participant is in a listening state, that is, the participant is in a state of watching and listening to the online meeting content. The participant is in a temporarily absent state, that is, the participant is not watching or listening to the online meeting content. The first participant's meeting status obtained by the participant terminal can be actively set by the first participant, or it can be obtained by the participant terminal detecting the first participant's meeting status according to a detection period.

[0056] If the first participant actively sets their status, all participants in the online meeting will be in the listening state by default. The online meeting app can include a toggle control for the Away state. To temporarily suspend the meeting, the first participant can click the Away state toggle control to change from the listening state to the Away state.

[0057] When the participant terminal detects the first participant's attendance status according to a detection period, the participant terminal may periodically obtain an image of the first participant captured by the participant terminal and detect whether the first participant's facial image is present in the image of the first participant. In response to the number of consecutive times that the first participant's facial image is not detected exceeding a threshold, the participant's attendance status is determined to be temporarily away.

[0058] During implementation, while the first participant is participating in an online meeting, the participant terminal can capture the first participant's image according to a detection cycle. For example, the first participant's image can be captured using a mobile phone's front camera, or using a camera connected to a computer host. Each time the participant captures the first participant's image, the participant terminal can detect whether the first participant's facial image exists in the image. If the first participant's facial image is detected in the captured image, it can be determined that the first participant is currently viewing and listening to the online meeting content. If the number of consecutive times that the first participant's facial image is not detected in the captured image exceeds a set threshold, it can be determined that the first participant is not currently viewing and listening to the online meeting content, i.e., the first participant is determined to be in a temporarily away state. The first participant's facial image can be pre-stored in the participant terminal. For example, after the first participant joins the online meeting through the participant terminal, the conference management service can send the first participant's facial image to the participant terminal. The duration of the detection cycle and the number threshold can be pre-set by a technician, for example, a detection cycle of 10 seconds and a number threshold of 2.

[0059] In another example, in addition to determining the first participant's attendance status by detecting the first participant's facial image, the participating terminal may also determine the first participant's attendance status based on the participant's terminal operation information. Specifically, if it is determined that the number of consecutive times the first participant's facial image has not been detected exceeds a threshold and no operation information from the participating terminal has been detected within a specified time period, the participant's attendance status is determined to be temporarily away.

[0060] The operation information may be operation time such as a cursor movement event, a click event, or a keyboard input event of the first participant operating the participating terminal. In implementation, after the number of consecutive times that the facial image of the first participant is not detected in the captured image exceeds a threshold, it can be determined whether the duration for which the operation information of the participating terminal is not detected currently exceeds a specified duration. For example, it is determined whether the difference between the time when the first participant last triggered an operation, etc., and the current time exceeds a specified duration. If it is determined whether the duration for which the operation information of the participating terminal is not detected currently exceeds a specified duration, it can be determined that the participant's participating status is temporarily away.

[0061] Step 102: In response to the first participant's attendance status being temporarily away, the participant terminal sends a first temporary away status notification to the conference management service.

[0062] The first away status notification may carry information such as the account identifier corresponding to the first participant or the terminal identifier of the participating terminal.

[0063] Step 103: After receiving the first temporary absence status notification, the conference management service performs management operations on the conference data in the online conference.

[0064] In one example, the management operation performed by the conference management service may be that the conference management service performs screen recording processing on conference data in the online conference data.

[0065] During implementation, if the conference host configures the participants to record the online meeting, that is, the first participant can store the video data and audio data in the online meeting, and the first participant has cloud recording permissions, the online meeting can be recorded through the conference management service, that is, the video data and audio data of the online meeting sent to the first participant's participating terminal can be received and stored.

[0066] In another example, the conference management service may perform the management operation by sending a conference data storage notification to the participating terminal. In response to receiving the conference data storage notification, the participating terminal stores the currently received video data and audio data of the online conference.

[0067] In practice, if the conference host allows attendees to record the online meeting, but the first attendee does not have cloud recording permissions, the conference management service can send a conference data storage notification to the attendee's terminal. Upon receiving the conference data storage notification, the attendee terminal corresponding to the first attendee can perform screen recording, that is, store the video and audio data received from the online meeting.

[0068] In another example, the conference management service may also perform management operations by obtaining audio data of other participants in the online conference, converting the obtained audio data of each participant into text data, and sending the obtained text data corresponding to each participant to the participating terminal, which receives and stores the text data corresponding to each participant.

[0069] In implementation, if the conference host configures the participants not to record the online conference, the conference management service can obtain the audio data in the online conference after receiving the first temporary absence status notification sent by the participating terminal, and then perform text recognition processing on the obtained audio data, and then convert the audio data in the online conference into text data. Among them, the audio data of the online conference obtained may include audio data corresponding to each participant except the first participant. In this way, when performing text recognition processing on the audio data, the text data corresponding to the audio data of each participant can be identified separately. For the text data of each participant identified, the conference management service can send the text data of each participant to the participating terminal of the first participant for storage.

[0070] In addition, the conference data stored in this step may also include conference control information in the online conference, such as the conference host's setting information on online conference permissions, conference interaction information, such as hand-raising requests triggered by participants in the online conference, and participant entry and exit information.

[0071] Step 104: In response to the change of the first participant's attendance status from the away state to the listening state, the participant terminal displays the conference data corresponding to the management operation in the conference data playback window.

[0072] During implementation, after the participating terminal determines that the first participant's participation status has changed from the away status to the listening status, the conference data playback window can be displayed in the display interface of the participating terminal, and the conference data stored through the storage processing is displayed in the conference data playback window.

[0073] Among them, when the conference data is stored by the participating terminal, the participating terminal can display the stored conference data in the conference data playback window. For example, play the video data and audio data of the online conference recorded by the participating terminal when the first participant is in the temporary away state, or display the text data corresponding to the voice of other participants identified by the conference management service when the first participant is in the temporary away state. The video data and audio data of the recorded online conference, as well as the text data corresponding to the participant's voice, can be played at the same time. In this way, the first participant can choose to watch the recorded video data in silence, and determine the communication content of other participants in the temporary away state through the displayed text data. This will not affect the normal playback of the audio data and video data of the current online conference.

[0074] When conference data is stored on the cloud platform by the conference management service, the participating terminal can send a corresponding acquisition request for the conference data to the conference management service. After receiving the acquisition request sent by the participating terminal, the conference management service can send the stored conference data to the participating terminal, which will display it through the conference data playback window.

[0075] In an embodiment of the present application, while a first participant is participating in an online meeting, a participating terminal can detect the first participant's attendance status. If the participating terminal determines that the first participant is in an AWAY state and is not viewing or listening to the online meeting content, the conference data of the online meeting can be stored through the conference management service or the participating terminal. When the first participant views and listens to the online meeting content again, the conference data stored while the first participant was AWAY can be replayed, thereby preventing the first participant from missing the content of the online meeting.

[0076] In one achievable embodiment, the change of the first participant's attendance status from the Away state to the Listening state may be triggered by the first participant, and corresponding processing includes: in response to the first participant's attendance status being the Away state, displaying a control for releasing the Away state in the online conference interface of the participant terminal; and in response to a click operation on the control for releasing the Away state, determining that the first participant's attendance status has been changed from the Away state to the Listening state.

[0077] As shown in Figure 2, when the participating terminal determines that the participating state of the first participant is temporarily away, a control for releasing the temporarily away state can be displayed on the online conference interface of the participating terminal. The control for releasing the temporarily away state can be overlaid on the online conference interface. While displaying the control for releasing the temporarily away state, the conference screen displayed in the online conference interface can be grayscaled, or the audio playback of the online conference can be turned off. When the first participant needs to listen to and watch the content of the online conference again, he or she can click on the control for releasing the temporarily away state. After detecting the click operation of the control for releasing the temporarily away state, the participating terminal determines that the participating state of the first participant has changed from the temporarily away state to the listening state.

[0078] The first participant's attendance status may be changed to the listening state by the participant terminal detecting the first participant's facial image or operation information on the participant terminal. For example, if the participant terminal detects the first participant's facial image or operation information on the participant terminal while the first participant is in the Away state, the participant may determine that the first participant has changed from the Away state to the listening state.

[0079] After determining that the first participant has changed from the Away state to the Listening state, the participating terminal can retrieve the conference data stored when the first participant left the Away state and display it in a conference data playback window. The conference data playback window can be a separate window created by the participating terminal and is different from the window used by the participating terminal to play the current conference content.

[0080] In one feasible method, after receiving the first temporary absence status notification, the conference management service sends a second temporary absence status notification to the participating terminals corresponding to other participants in the online conference. The second temporary absence status notification is used to instruct the participating terminals that receive the second temporary absence status to add a temporary absence mark in the window corresponding to the first participant.

[0081] As shown in Figure 3, after receiving the second away status notification corresponding to the first participant, the other participant's corresponding terminal can add an away indicator in the window displaying the first participant's conference screen and near the first participant's account. The away indicator can be a clock icon to indicate that the first participant is currently away.

[0082] Accordingly, after determining that the first participant has changed from the Away state to the Listening state, the participant terminal may also send a first Listening state notification to the conference management service. Upon receiving the first Listening state notification, the conference management service may stop storing and processing conference data from the online conference. Furthermore, the participant terminal may send a second Listening state notification corresponding to the first participant to the terminals of other participants. Upon receiving the second Listening state notification corresponding to the first participant, the terminals of other participants may remove the Away indicator added to the window displaying the first participant's conference screen and near the first participant's account.

[0083] It can be seen that in an embodiment of the present application, after a participant in an online meeting is in a temporarily away state, the conference management service can notify other participants of the information that the participant is in a temporarily away state. This can avoid other participants from interacting with the participant in the temporarily away state in the online meeting, thereby improving the communication efficiency of the participants in the online meeting.

[0084] In one feasible manner, while the first participant is in the away state, when other participants interact with the first participant in the online conference, the other participants may be further reminded that the first participant is in the away state.

[0085] In one example, in response to detecting identity information of other participants in the online conference from audio data of the other participants, the conference management service sends a prompt message to the participating terminals corresponding to the other participants, where the prompt message is used to indicate that the first participant is in an away state.

[0086] During implementation, the conference management service can perform text recognition processing on the audio data sent by each participating terminal in the online conference (that is, the audio data of the participant recorded by the participating terminal). The conference management service can store the identity information corresponding to the participant who is currently in the temporary away state. Among them, the identity information corresponding to the participant may include the participant's name, account name, etc. In the result of the text recognition processing of the audio data corresponding to the second participant by the conference management service, if the identity information of the first participant who is in the temporary away state is detected, it is determined that the second participant may currently be communicating with the first participant in the online conference. Therefore, the conference management service can send a prompt message to the participating terminal corresponding to the second participant again. After the second participant receives the prompt message corresponding to the first participant, a text reminder can be made in the online conference interface, such as displaying "XX (the identity information of the first participant) is currently in the temporary away state" in the online conference interface, or playing "XX is currently in the temporary away state" in voice.

[0087] In another example, when the first participant's attendance status is in the away state, the conference management service sends a prompt message to the participant terminals corresponding to the other participants in response to receiving interactive operations between the other participants and the first participant, where the prompt message is used to indicate that the first participant is in the away state.

[0088] During implementation, if the conference management service detects interactions between other participants and the first participant, such as a third participant "@"ing the first participant in the chat interface, the conference management service can send a prompt message to the third participant's corresponding terminal. After receiving the prompt message from the first participant, the third participant can issue a text reminder in the chat interface, such as displaying "XX is currently away" or playing a voice message saying "XX is currently away."

[0089] It can be seen that in an embodiment of the present application, when the first participant is in a temporarily away state, if there are other participants in the online meeting who communicate and interact with the first participant, the conference management service can further remind other participants that the first participant is in a temporarily away state, thereby avoiding invalid communication in the online meeting and improving the communication efficiency of the participants in the online meeting.

[0090] FIG4 is a flow chart of a method for displaying conference data provided by an embodiment of the present application, which can be applied to a conference system including a cloud platform and conference terminals. A conference management service is running in the cloud platform, and the conference management service can further include conference control services, recording services, translation services, media services, and message services. Participant A in FIG4 can be the first participant mentioned above, and participant B can be the other participants mentioned above. In FIG4, participant A and participant B can also represent the conference terminals operated by participant A and participant B respectively. Referring to FIG4, the method includes:

[0091] Step S1: The participant terminal corresponding to participant A sets the temporary absence status of participant A to the conference control service.

[0092] When the participant A's corresponding terminal detects that the participant A is in the away state, it may send an away state notification to the conference control service so as to set the participant A's conference state to the away state in the conference control service.

[0093] Among them, in the conference control service, the attendance status of each participant in the online conference can be recorded, and the attendance status of each participant is set to the listening state by default.

[0094] Step S2: The conference control service returns a notification of successful setting status to participant A.

[0095] In one example, the setting status success notification may be the conference data storage notification in the above embodiment.

[0096] Step S3: The conference control service notifies other participants (participant B) that participant A is in a temporary absence state.

[0097] In this way, other participants can be reminded that participant A is in a temporary absence state, thereby avoiding ineffective communication between other participants and participant A.

[0098] Step S4: The participating terminal corresponding to participant A starts local screen recording.

[0099] In one example, after receiving the setting status success notification sent by the conference control service, the participating terminal corresponding to participant A can start local screen recording processing, that is, store the video data and audio data of the online conference.

[0100] Step S5: The participant terminal corresponding to participant A sends a cloud recording request to the recording service.

[0101] In one example, after the participating terminal corresponding to participant A receives the setting status success notification sent by the conference control service, if it is determined that the meeting host has configured the participant to record the online meeting, and participant A has cloud recording permissions, a cloud recording request can be sent to the recording service to enable the recording service to start cloud recording of the online meeting.

[0102] Step S6: The participant terminal corresponding to participant A sends a speech-to-text request to the translation service.

[0103] Step S7: The translation service sends the text-to-speech results of the other participants' speeches to the participant terminal corresponding to participant A.

[0104] Step S8: The participating terminal corresponding to participant A stores the speech-to-text conversion result.

[0105] In implementation, the participant terminal corresponding to the participant A may only execute any one of the above steps S4 and S5, and the execution of steps S4 and S5 does not affect the execution of step S6.

[0106] Step S9: Participant B calls participant A via the media service.

[0107] In one example, a calling function between participants may be provided in an online conference. After participant B successfully calls participant A, the participant terminal corresponding to participant A may display a prompt message indicating that participant B is calling participant A.

[0108] Step S10: The media service queries the conference control service to determine whether participant A is in a temporarily away state.

[0109] Step S11: The media service notifies the message service that participant A is in a temporary absence state.

[0110] Step S12: The message service notifies participant B that participant A is temporarily away.

[0111] In this way, when other participants (such as participant B) call participant A who is temporarily away, the messaging service can send a notification to participant B that participant A is temporarily away. This can avoid ineffective communication between participant B and participant A, thereby improving the communication efficiency of the online meeting.

[0112] Step S13: Participant B sends @ participant A to the messaging service in the chat.

[0113] In one example, a text chat function between participants can be set up in an online meeting. Participant B can @ participant A in the chat dialog box to remind participant A that participant B is currently looking for participant A to chat.

[0114] Step S14: The message service queries the conference control service to determine whether participant A is in a temporary absence state.

[0115] Step S15: The message service notifies participant B that participant A is temporarily away.

[0116] In this way, when other participants (such as participant B) @ participant A who is temporarily away during the chat, the messaging service can send a notification to participant B that participant A is temporarily away. This can avoid ineffective communication between participant B and participant A, thereby improving the communication efficiency of the online meeting.

[0117] Step S16: The participant terminal corresponding to participant A sends a setting to the conference control service to cancel the temporary absence status of participant A.

[0118] Step S17: The conference control service notifies other participants (including participant B) that participant A is in a listening state.

[0119] Step S18: The participating terminal corresponding to participant A plays the conference data stored by participant A in the away state.

[0120] In this way, participant A can obtain the meeting content when participant A is away through the conference data played by the participating terminal, thereby avoiding missing the meeting content in the online meeting and improving the efficiency of communication among participants in the online meeting.

[0121] The present application also provides a conference system, as shown in FIG5 , including: the conference system includes a cloud platform and conference terminals, the cloud platform includes a conference management service, wherein:

[0122] The participant terminal 510 is used to obtain the participant status of the first participant corresponding to the participant terminal in the online conference, where the participant status includes a listening state or an away state.

[0123] The conference participant terminal 510 is configured to send a first away status notification to the conference management service in response to the first participant's conference status being away.

[0124] The conference management service 520 is configured to perform management operations on conference data in the online conference after receiving the first temporary absence status notification.

[0125] The conference terminal 510 is configured to display conference data corresponding to the management operation through a conference data playback window in response to the first participant's conference status being changed from the absent status to the listening status.

[0126] In one feasible manner, when the first participant's attendance status is in the temporarily away state, the conference management service 520 is used to send a prompt message to the conference terminals corresponding to other participants in response to detecting the identity information of the first participant in the audio data of other participants in the online conference, where the prompt message is used to indicate that the first participant is in the temporarily away state.

[0127] In one feasible manner, while the first participant's attendance status is in the temporarily away state, the conference management service is used 520 to send a prompt message to the participant terminals corresponding to the other participants in response to receiving the interactive operations between the other participants and the first participant, where the prompt message is used to indicate that the first participant is in the temporarily away state.

[0128] In one feasible manner, the participant terminal 510 is used to obtain the picture of the first participant taken by the participant terminal according to a detection cycle; after each time the picture of the first participant is obtained, it is detected whether there is a facial image of the first participant in the picture of the first participant; in response to the continuous number of times that the facial image of the first participant is not detected exceeds a number threshold, it is determined that the participant status of the first participant is a temporarily away state.

[0129] In one achievable manner, the participant terminal 510 is configured to determine that the participant status of the first participant is temporarily away in response to the fact that the number of consecutive times the first participant's facial image is not detected exceeds a threshold and no operation information of the participant terminal is detected within a specified time period.

[0130] In one achievable manner, the conference management service 520 is configured to send a conference data storage notification to the participating terminals. The participating terminals are configured to store the currently received video data and audio data of the online conference in response to receiving the conference data storage notification.

[0131] In one implementation, conference management service 520 is configured to obtain audio data from other participants in the online conference and convert the obtained audio data of each participant into text data. The conference management service is configured to send the obtained text data corresponding to each participant to the participant terminal. The participant terminal is configured to receive and store the text data corresponding to each participant.

[0132] In one feasible manner, the conference management service 520 is used to send a second temporary absence status notification to the participating terminals corresponding to other participants in the online conference after receiving the first temporary absence status notification. The second temporary absence status notification is used to instruct the participating terminals corresponding to the other participants to add a temporary absence mark in the display window corresponding to the first participant.

[0133] In one feasible manner, the participant terminal 510 is used to display a control for releasing the away status in the online conference interface of the participant terminal in response to the first participant's participant status being in the away status; and in response to a click operation on the control for releasing the away status, it is determined that the first participant's participant status is updated from the away status to the listening status.

[0134] The conference terminal 510 and the conference management service 520 can be implemented by software or hardware. For example, the implementation of the conference management service 520 is described below. Similarly, the implementation of the conference terminal 510 can refer to the implementation of the conference management service 520.

[0135] As an example of a software functional unit, the conference management service 520 may include code running on a computing instance. The computing instance may be at least one of a physical host (computing device), a virtual machine, a container, and other computing devices. Furthermore, the above-mentioned computing device may be one or more. For example, the conference management service 520 may include code running on multiple hosts / virtual machines / containers. It should be noted that the multiple hosts / virtual machines / containers used to run the application may be distributed in the same region or in different regions. The multiple hosts / virtual machines / containers used to run the code may be distributed in the same AZ or in different AZs, and each AZ includes one data center or multiple geographically close data centers. Generally, a region may include multiple AZs.

[0136] Similarly, the multiple hosts / virtual machines / containers running the code can be distributed within the same VPC or across multiple VPCs. Typically, a VPC is located within a region. Cross-region communication between two VPCs within the same region, or between VPCs in different regions, requires a communication gateway within each VPC to interconnect the VPCs.

[0137] As an example of a hardware functional unit, a module can include at least one computing device, such as a server. Alternatively, conference management service 520 can be implemented using an ASIC or a PLD. The PLD can be implemented using a CPLD, FPGA, GAL, or any combination thereof.

[0138] The multiple computing devices included in the conference management service 520 can be distributed in the same region or in different regions. The multiple computing devices included in the YY device can be distributed in the same AZ or in different AZs. Similarly, the multiple computing devices included in the YY device can be distributed in the same VPC or in multiple VPCs. The multiple computing devices can be any combination of servers, ASICs, PLDs, CPLDs, FPGAs, GALs, and other computing devices.

[0139] This application also provides a computing device 100. As shown in FIG6 , computing device 100 includes a bus 102, a processor 104, a memory 106, and a communication interface 108. Processor 104, memory 106, and communication interface 108 communicate with each other via bus 102. Computing device 100 can be a server or a terminal device. It should be understood that this application does not limit the number of processors and memories in computing device 100.

[0140] Bus 102 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, among others. Buses may be classified as address buses, data buses, control buses, and the like. For ease of illustration, FIG6 shows only one bus line, but this does not imply a single bus or type of bus. Bus 102 may include a path for transmitting information between various components of computing device 100 (e.g., memory 106, processor 104, and communication interface 108).

[0141] The processor 104 may include any one or more processors such as a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP), or a digital signal processor (DSP).

[0142] The memory 106 may include volatile memory, such as random access memory (RAM). The memory 106 may also include non-volatile memory, such as read-only memory (ROM), flash memory, hard disk drive (HDD), or solid state drive (SSD).

[0143] The memory 106 stores executable program code, and the processor 104 executes the executable program code to implement the functions of the aforementioned conference terminal 510 or conference management service 520, thereby implementing the method for displaying conference data. In other words, the memory 106 stores instructions for executing the method for displaying conference data.

[0144] The communication interface 108 uses a transceiver module such as, but not limited to, a network interface card or a transceiver to implement communication between the computing device 100 and other devices or a communication network.

[0145] Embodiments of the present application also provide a computing device cluster. The computing device cluster includes at least one computing device. The computing device can be a server, such as a central server, an edge server, or a local server in a local data center. In some embodiments, the computing device can also be a terminal device such as a desktop computer, a laptop computer, or a smartphone.

[0146] As shown in Figure 7, the computing device cluster includes at least one computing device 100. The memory 106 in one or more computing devices 100 in the computing device cluster may store the same instructions for executing the method for presenting conference data.

[0147] In some possible implementations, the memory 106 of one or more computing devices 100 in the computing device cluster may also store partial instructions for executing the method for presenting conference data. In other words, the combination of one or more computing devices 100 may jointly execute the instructions for executing the method for presenting conference data.

[0148] It should be noted that the memories 106 in different computing devices 100 in the computing device cluster may store different instructions, each for executing a portion of the functions of the conference management service 520 .

[0149] In some possible implementations, one or more computing devices in a computing device cluster may be connected via a network. The network may be a wide area network (WAN) or a local area network (LAN), among others. FIG. 8 illustrates a possible implementation. As shown in FIG. 8 , two computing devices 100A and 100B are connected via a network. Specifically, the connection to the network is achieved via a communication interface in each computing device. In this type of possible implementation, the memory 106 in the computing device 100A stores instructions for the functions of the participant terminal 510. Simultaneously, the memory 106 in the computing device 100B stores instructions for executing the functions of the conference management service 520.

[0150] The connection method between the computing device clusters shown in Figure 8 can be considered to be that the method for displaying conference data provided by this application needs to be implemented through a cloud platform, so it is considered to hand over the functions implemented by the conference management service 520 to the computing device 100B for execution.

[0151] It should be noted that the memory 106 in different computing devices 100 in the computing device cluster can store different instructions for executing partial functions of the conference system. In other words, the instructions stored in the memory 106 in different computing devices 100 can implement different functions in the participant terminal 510 and the conference management service 520.

[0152] Embodiments of the present application also provide a computer program product including instructions. The computer program product may be software or a program product including instructions that can be executed on a computing device or stored on any available medium. When executed on at least one computing device, the computer program product causes the at least one computing device to execute a method for displaying conference data.

[0153] The present application also provides a computer-readable storage medium. The computer-readable storage medium can be any available medium that can be stored by a computing device, or a data storage device such as a data center that contains one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive). The computer-readable storage medium includes instructions that instruct the computing device to execute the method for displaying conference data.

[0154] In this application, the terms "first", "second", etc. are used to distinguish between identical or similar items with substantially the same effects and functions. It should be understood that there is no logical or temporal dependency between "first" and "second", nor is there a limit on quantity and execution order. It should also be understood that although the following description uses the terms "first", "second", etc. to describe various elements, these elements should not be limited by the terms. These terms are only used to distinguish one element from another. In this application, the term "at least one" means one or more, and the term "plurality" means two or more.

[0155] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the protection scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for displaying conference data, characterized in that: The method is applied to a conference system, the conference system includes a cloud platform and conference terminals, the cloud platform includes a conference management service, and the method includes: The conference participant terminal acquires the conference participant status of the first participant corresponding to the conference participant terminal in the online conference, where the conference participant status includes a listening status or an away status; In response to the first participant's attendance status being an away state, the participant terminal sends a first away state notification to the conference management service; After receiving the first temporary absence status notification, the conference management service performs a management operation on the conference data of the online conference; In response to the first participant's attendance status being changed from the away status to the listening status, the conference terminal displays conference data corresponding to the management operation through a conference data playback window.

2. The method according to claim 1, characterized in that The method further comprises: While the first participant's attendance status is in the away state, the conference management service sends a prompt message to the participant terminals corresponding to the other participants in response to detecting the identity information of the first participant in the audio data of other participants in the online conference, and the prompt message is used to indicate that the first participant is in the away state.

3. The method according to claim 1, characterized in that The method further comprises: While the first participant's attendance status is in the away state, the conference management service sends a prompt message to the participant terminals corresponding to the other participants in response to receiving the interactive operations between the other participants and the first participant, and the prompt message is used to indicate that the first participant is in the away state.

4. The method according to any one of claims 1 to 3, characterized in that: The participant terminal obtains the participant status of the first participant corresponding to the participant terminal in the online conference, including: Acquire the image of the first participant captured by the participating terminal according to the detection period; After acquiring the screen of the first participant each time, detecting whether there is a facial image of the first participant in the screen of the first participant; In response to the fact that the number of consecutive times that the facial image of the first participant is not detected exceeds a number threshold, it is determined that the attendance status of the first participant is an away state.

5. The method according to claim 4, characterized in that In response to the fact that the number of consecutive times that the facial image of the first participant is not detected exceeds a number threshold, determining that the first participant's attendance status is temporarily away includes: In response to the fact that the number of consecutive times that the facial image of the first participant is not detected exceeds a number threshold and the operation information of the participant terminal is not detected within a specified time period, it is determined that the participant status of the first participant is an away status.

6. The method according to any one of claims 1 to 5, characterized in that: The performing management operations on the conference data in the online conference includes: The conference management service sends a conference data storage notification to the participating terminal; In response to receiving the conference data storage notification, the participant terminal stores the currently received video data and audio data of the online conference.

7. The method according to any one of claims 1 to 5, characterized in that: The performing management operations on the conference data of the online conference includes: The conference management service obtains audio data of other participants in the online conference, and converts the obtained audio data of each participant into text data; The conference management service sends the obtained text data corresponding to each participant to the participant terminal; The conference participant terminal receives and stores text data corresponding to each participant.

8. The method according to any one of claims 1 to 7, characterized in that: The method further comprises: After receiving the first away status notification, the conference management service sends a second away status notification to the participating terminals corresponding to other participants in the online conference, where the second away status notification is used to instruct the participating terminals corresponding to the other participants to add an away status mark in the display window corresponding to the first participant.

9. The method according to any one of claims 1 to 8, characterized in that: The method further comprises: In response to the first participant's attendance status being an AWAY status, displaying a control for releasing the AWAY status in the online conference interface of the participant terminal; In response to a click operation on the control for releasing the away status, it is determined that the meeting status of the first participant is updated from the away status to the listening status.

10. A conference system, characterized in that: The conference system includes a cloud platform and conference terminals. The cloud platform includes conference management services, wherein: The conference participant terminal is used to obtain the conference participant status of the first participant corresponding to the conference participant terminal in the online conference, where the conference participant status includes a listening status or an away status; The conference participant terminal is configured to send a first away status notification to the conference management service in response to the conference status of the first participant being away. The conference management service is used to perform management operations on the conference data of the online conference after receiving the first temporary absence status notification; The conference participant terminal is configured to display conference data corresponding to the management operation through a conference data playback window in response to the conference status of the first participant being changed from the away status to the listening status.

11. The conference system according to claim 10, characterized in that: While the first participant's attendance status is in the away state, the conference management service is used to send prompt information to the participant terminals corresponding to the other participants in response to detecting the identity information of the first participant in the audio data of other participants in the online conference, and the prompt information is used to indicate that the first participant is in the away state.

12. The conference system according to claim 10, characterized in that: While the first participant's attendance status is in the away state, the conference management service is used to send prompt information to the participant terminals corresponding to the other participants in response to receiving interactive operations between the other participants and the first participant, and the prompt information is used to indicate that the first participant is in the away state.

13. The conference system according to any one of claims 10 to 12, characterized in that: The participant terminal is used to obtain the picture of the first participant taken by the participant terminal according to the detection cycle; after each acquisition of the picture of the first participant, detect whether there is a facial image of the first participant in the picture of the first participant; in response to the continuous number of times that the facial image of the first participant is not detected exceeds a number threshold, determine that the participant status of the first participant is a temporarily away state.

14. The conference system according to claim 13, characterized in that: The participant terminal is used to determine that the participant status of the first participant is temporarily away in response to the continuous number of times that the facial image of the first participant is not detected exceeds a number threshold and no operation information of the participant terminal is detected within a specified time period.

15. The conference system according to any one of claims 10 to 14, characterized in that: The conference management service is used to send a conference data storage notification to the participating terminal; The participant terminal is used for storing the currently received video data and audio data of the online conference in response to receiving the conference data storage notification.

16. The conference system according to any one of claims 10 to 14, characterized in that: The conference management service is used to obtain audio data of other participants in the online conference, and convert the obtained audio data of each participant into text data; The conference management service is used to send the obtained text data corresponding to each participant to the participant terminal; The conference participant terminal is used for receiving and storing text data corresponding to each participant.

17. The conference system according to any one of claims 10 to 16, characterized in that: The conference management service is also used to send a second away status notification to the participating terminals corresponding to other participants in the online conference after receiving the first away status notification, and the second away status notification is used to instruct the participating terminals corresponding to the other participants to add an away status mark in the display window corresponding to the first participant.

18. The conference system according to any one of claims 10 to 17, characterized in that: The participating terminal is also used to display a control for releasing the away status in the online conference interface of the participating terminal in response to the participating status of the first participant being an away status; and in response to a click operation on the control for releasing the away status, determine that the participating status of the first participant is updated from the away status to the listening status.

19. A computing device cluster, characterized in that: comprising at least one computing device, each computing device comprising a processor and a memory; The processor of the at least one computing device is configured to execute instructions stored in the memory of the at least one computing device, so that the computing device cluster executes the method according to any one of claims 1 to 9.

20. A computer program product comprising instructions, characterized in that When the instructions are executed by a computing device cluster, the computing device cluster executes the method according to any one of claims 1 to 9.

21. A computer-readable storage medium, characterized in that: The method comprises computer program instructions. When the computer program instructions are executed by a computing device cluster, the computing device cluster performs the method according to any one of claims 1 to 9.

Images