Method for displaying conference data, conference system and computing equipment

Abstract

The embodiment of the invention discloses a method for displaying conference data, a conference system and computing equipment, and belongs to the technical field of cloud computing. The method is applied to a conference system, the conference system comprises a conference participating terminal and a cloud platform for operating a conference management service, and the method comprises the following steps: the conference participating terminal obtains a conference participating state of a first conference participant in an online conference; and the conference participating terminal responds to the situation that the conference participating state of the first conference participant is a temporary leaving state, and sends a first temporary leaving state notice to the conference management service. And after receiving the first temporary leaving state notification, the conference management service performs management operation on conference data in the online conference. The conference participating terminal responds to the situation that the conference participating state of the first conference participant is changed from the temporary leaving state to the listening state, and conference data corresponding to the management operation is displayed through a conference data playback window. By adopting the method and the device, participants can be prevented from missing the conference content of the online conference.

Description

[0001] This application claims priority to Chinese patent application No. 202311563628.8 filed on November 21, 2023, with invention name “A method and device for setting an away status and interaction in a conference system”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of cloud computing technology, and in particular to a method for displaying conference data, a conference system, and a computing device. Background Art

[0003] With the development of Internet technology and cloud computing technology, online meetings are becoming more and more widely used.

[0004] Participants may leave the online meeting for various reasons. For example, participants may need to make phone calls during the meeting. However, if participants leave the online meeting, they may miss some important content in the online meeting. Summary of the invention

[0005] The embodiments of the present application provide a method for displaying conference data, a conference system, and a computing device, which can prevent participants from missing the content of online conferences. The corresponding technical solutions are as follows:

[0006] In a first aspect, a method for displaying conference data is provided, and the method is applied to a conference system. The conference system includes a cloud platform and a conference terminal, and the cloud platform includes a conference management service. The method includes:

[0007] The participating terminal obtains the participating status of the first participant corresponding to the participating terminal in the online conference, and the participating status includes a listening status or an away status. In response to the first participant's participating status being an away status, the participating terminal sends a first away status notification to the conference management service. After receiving the first away status notification, the conference management service performs a management operation on the conference data in the online conference. In response to the first participant's participating status changing from an away status to a listening status, the participating terminal displays the conference data corresponding to the management operation through the conference data playback window.

[0008] In the solution shown in the present application, the participating terminal is able to identify the participating status of the first participant who uses the participating terminal to participate in the online meeting. When the participating terminal determines that the first participant is in the temporarily away state, it can notify the conference management service to perform management operations on the conference data of the first participant when the participant is in the temporarily away state. Then, when the participating terminal determines to resume the online state, the participating terminal can display the conference data corresponding to the management operation through the conference data playback window. In this way, the first participant can watch the content of the meeting when he is in the temporarily away state and will not miss the important content of the online meeting.

[0009] In one achievable manner, the above method also includes: when the first participant's attendance status is in an away state, the conference management service, in response to detecting the identity information of the first participant in the audio data of other participants in the online conference, sends a prompt message to the attending terminals corresponding to the other participants, and the prompt message is used to indicate that the first participant is in an away state.

[0010] In the scheme shown in the present application, the conference management service can identify whether the audio data of other participants in the online meeting includes the identity information of the first participant when the first participant is in the temporarily away state. The identity information of the first participant can be the name of the first participant, the title of the position, the name used by the first participant to participate in the online meeting, etc. If the conference management service identifies the identity information of the first participant in the audio data of other participants, it can send a prompt message to the corresponding participating terminals of the other participants to prompt other participants that the first participant is in the temporarily away state. In this way, it can be avoided that other participants communicate with the first participant when the first participant is in the temporarily away state, thereby avoiding invalid communication in the online meeting, and further improving the communication efficiency of the participants in the online meeting.

[0011] In one achievable manner, the above method also includes: when the first participant's attendance status is in the temporarily away state, the conference management service sends a prompt message to the participant terminals corresponding to other participants in response to receiving interactive operations between other participants and the first participant, and the prompt message is used to indicate that the first participant is in the temporarily away state.

[0012] In the scheme shown in the present application, the conference management service can detect whether other participants have performed interactive operations with the first participant, such as "@" the first participant, when the first participant is in the temporarily away state. If the conference management service detects that other participants have performed interactive operations with the first participant, it can send a prompt message to the corresponding participating terminals of the other participants to prompt the other participants that the first participant is in the temporarily away state. In this way, it is possible to avoid other participants communicating with the first participant when the first participant is in the temporarily away state, thereby avoiding ineffective communication in online meetings, and thereby improving the communication efficiency of participants in online meetings.

[0013] In an achievable manner, a participant terminal obtains the participant status of a first participant corresponding to the participant terminal in an online conference, including: obtaining a picture of the first participant taken by the participant terminal according to a detection period. After obtaining the picture of the first participant each time, detecting whether there is a face image of the first participant in the picture of the first participant. In response to the continuous number of times that the face image of the first participant is not detected exceeding a number threshold, determining that the participant status of the first participant is temporarily away.

[0014] In one achievable method, in response to the fact that the number of consecutive times that the facial image of the first participant is not detected exceeds a number threshold, the first participant's attendance status is determined to be temporarily away, including: in response to the fact that the number of consecutive times that the facial image of the first participant is not detected exceeds a number threshold and no operation information of the participant terminal is detected within a specified time period, the first participant's attendance status is determined to be temporarily away.

[0015] In the solution shown in the present application, the participant terminal can accurately determine whether the first participant's attendance status is temporarily away based on the number of times the first participant's facial image is not detected and the length of time the first participant has not operated the participant terminal.

[0016] In one achievable manner, performing management operations on conference data in an online conference includes: a conference management service sends a conference data storage notification to a participating terminal. In response to receiving the conference data storage notification, the participating terminal stores the currently received video data and audio data of the online conference.

[0017] In the solution shown in the present application, the management operation of conference data can be that the conference terminal stores the conference data when the first participant is in a temporary absence state. In this way, after the first participant returns to a listening state, the conference terminal can play the stored conference data, thereby preventing the first participant from missing important conference content.

[0018] In one achievable manner, the above-mentioned management operation on the conference data in the online conference includes: the conference management service obtains the audio data of other participants in the online conference, and converts the obtained audio data of each participant into text data. The conference management service sends the obtained text data corresponding to each participant to the participating terminal. The participating terminal receives and stores the text data corresponding to each participant.

[0019] In the solution shown in the present application, the management operation of conference data can also be that when the first participant is in the temporary absence state, the conference management service converts the audio data of other participants into text data and sends it to the participant terminal for storage. In this way, after the first participant returns to the listening state, the participant terminal can display the stored text data, thereby preventing the first participant from missing important conference content.

[0020] In an achievable manner, the method further includes: after receiving the first away status notification, the conference management service sends a second away status notification to the participating terminals corresponding to other participants in the online conference, and the second away status notification is used to instruct the participating terminals corresponding to other participants to add an away status mark in the display window corresponding to the first participant. In this way, other participants can be reminded that the first participant is in the away status, which can avoid ineffective communication between other participants and the first participant in the online conference, thereby improving the communication efficiency of participants in the online conference.

[0021] In one achievable manner, the method further includes: in response to the first participant's attendance status being an away state, displaying a control for releasing the away state in the online conference interface of the participant terminal. In response to a click operation on the control for releasing the away state, determining that the first participant's attendance status is updated from the away state to the listening state.

[0022] In a second aspect, a conference system is provided, the conference system comprising a cloud platform and a conference terminal, the cloud platform comprising a conference management service, wherein:

[0023] The conference participant terminal is used to obtain the conference participant status of the first participant corresponding to the conference participant terminal in the online conference, where the conference participant status includes a listening status or an away status.

[0024] The conference participant terminal is used for sending a first away status notification to the conference management service in response to the conference status of the first participant being away.

[0025] The conference management service is used to perform management operations on conference data in the online conference after receiving the first temporary absence status notification.

[0026] The conference terminal is used for displaying conference data corresponding to the management operation through a conference data playback window in response to the change of the conference status of the first participant from the temporary absence status to the listening status.

[0027] In one feasible manner, when the first participant's attendance status is in the away state, the conference management service is used to send a prompt message to the participant terminals corresponding to the other participants in response to detecting the identity information of the first participant in the audio data of other participants in the online conference, and the prompt message is used to indicate that the first participant is in the away state.

[0028] In one feasible manner, when the first participant's attendance status is in the away state, the conference management service is used to send prompt information to the participant terminals corresponding to other participants in response to receiving interactive operations between other participants and the first participant, and the prompt information is used to indicate that the first participant is in the away state.

[0029] In one feasible method, the participant terminal is used to obtain a picture of the first participant taken by the participant terminal according to a detection period; after each acquisition of the picture of the first participant, it is detected whether there is a facial image of the first participant in the picture of the first participant; in response to the continuous number of times that the facial image of the first participant is not detected exceeding a number threshold, it is determined that the participant status of the first participant is a temporarily away state.

[0030] In one achievable manner, the participant terminal is used to determine that the participant status of the first participant is temporarily away in response to the fact that the number of consecutive times that the facial image of the first participant is not detected exceeds a threshold and no operation information of the participant terminal is detected within a specified time period.

[0031] In an achievable manner, the conference management service is used to send a conference data storage notification to the participating terminal. The participating terminal is used to store the currently received video data and audio data of the online conference in response to receiving the conference data storage notification.

[0032] In one achievable manner, the conference management service is used to obtain audio data of other participants in the online conference, and convert the obtained audio data of each participant into text data. The conference management service is used to send the obtained text data corresponding to each participant to the participant terminal. The participant terminal is used to receive and store the text data corresponding to each participant.

[0033] In one achievable method, the conference management service is used to send a second away status notification to the participating terminals corresponding to other participants in the online conference after receiving the first away status notification. The second away status notification is used to instruct the participating terminals corresponding to the other participants to add an away status mark in the display window corresponding to the first participant.

[0034] In one feasible manner, the participating terminal is used to display a control for releasing the away status in the online conference interface of the participating terminal in response to the first participant's participating status being in the away status; in response to a click operation on the control for releasing the away status, it is determined that the first participant's participating status is updated from the away status to the listening status.

[0035] In a third aspect, a computing device cluster is provided, the computing device cluster comprising at least one computing device, each computing device comprising a processor and a memory. The processor of at least one computing device is used to execute instructions stored in the memory of at least one computing device, so that the computing device cluster executes the method described in the first aspect above.

[0036] In a fourth aspect, a computer program product comprising instructions is provided, wherein when the instructions are executed by a computing device cluster, the computing device cluster executes the method described in the first aspect above.

[0037] In a fifth aspect, a computer-readable storage medium is provided, characterized in that it includes computer program instructions. When the computer program instructions are executed by a computing device cluster, the computing device cluster executes the method described in the first aspect above. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 This is a flow chart of a method for displaying conference data provided by an embodiment of the present application;

[0039] Figure 2 This is a schematic diagram of an online conference interface provided by an embodiment of the present application;

[0040] Figure 3 This is a schematic diagram of an online conference interface provided by an embodiment of the present application;

[0041] Figure 4 This is a flow chart of a method for displaying conference data provided by an embodiment of the present application;

[0042] Figure 5 is a schematic diagram of a conference system provided in an embodiment of the present application;

[0043] Figure 6 is a schematic diagram of the structure of a computing device provided in an embodiment of the present application;

[0044] Figure 7 is a schematic diagram of the structure of a computing device cluster provided in an embodiment of the present application;

[0045] Figure 8 It is a structural diagram of a computing device cluster provided in an embodiment of the present application. DETAILED DESCRIPTION

[0046] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0047] Online conferencing is a form of voice communication between multiple people through online conferencing applications. Since conference calls are not restricted by time, location and other factors, they are increasingly used in life and work.

[0048] In one example, a user can log in to his account in the online conference application running on the terminal, and then operate the online conference application to create or join an online conference in the online conference application. When a user creates a meeting in the online conference application, the online conference application can send a conference creation request to the cloud platform through the terminal. After receiving the conference creation request sent by the terminal, the conference management service of the cloud platform can create an online conference in the cloud platform and generate a conference identification (Identity document, ID) for the conference, and then send the conference ID to the terminal. The user can forward the conference ID to other users who need to join the conference call. Other users can operate the online conference application, enter the received conference ID in the online conference application, and then join the corresponding online conference. In one example, each user who joins the online conference can be called a participant, and the person who creates the online conference can also be called a conference host.

[0049] After a participant joins a conference call through an online conference application running on a terminal, the participant can operate the online conference application to enable the terminal's microphone permission, record the participant's audio through the microphone, and then send the collected audio to the conference management service through the terminal. During the conference call, the participant who joins the conference call can receive and play the audio of other participants sent by the conference management service through the terminal, so that multiple participants can hold a conference call online.

[0050] Unlike offline meetings, when participating in online meetings, participants may need to leave the online meeting for various reasons and cannot watch and listen to the online meeting content all the time, so they may miss some important content in the online meeting. For example, when a participant is participating in an online meeting through a mobile phone, a call suddenly comes in and the participant needs to answer the call, which causes the participant to miss part of the online meeting content. In addition, other participants cannot know whether the participant has been watching and listening to the content of the online meeting. Other participants may communicate with the participant about the content of the meeting while the participant is temporarily offline. However, since the participant is not listening to the content of the online meeting, he cannot respond to other participants, resulting in poor communication efficiency in online meetings.

[0051] The embodiment of the present application provides a method for displaying conference data, which can identify the temporary absence state of a participant during an online conference, that is, identify the state in which the participant is not watching or listening to the content of the online conference, and automatically record the content of the online conference in which the participant is temporarily absent, and can also notify other participants of the participant in the temporary absence state. In this way, the participant can be prevented from missing the content of the online conference, and the communication efficiency between participants in the online conference can also be improved.

[0052] Figure 1 This is a flow chart of a method for displaying conference data provided by an embodiment of the present application. The method can be applied to a conference system including a cloud platform and a conference terminal, and a conference management service is running in the cloud platform. The method for displaying conference data is applied to the process of participants attending an online conference, see Figure 1 , the method comprising:

[0053] Step 101: A participant terminal obtains a participant status of a first participant corresponding to the participant terminal in an online conference, where the participant status includes a listening status or an away status.

[0054] The first participant may be any participant in the online conference. The participant terminal may run an online conference application, and the first participant may operate the online conference application in the participant terminal to participate in the online conference. The participant is in a listening state, that is, the participant is in a state of watching and listening to the content of the online conference, and the participant is in a temporarily away state, that is, the participant is in a state of not watching and listening to the content of the online conference. The participating state of the first participant obtained by the participating terminal may be actively set by the first participant, or may be obtained by the participating terminal detecting the participating state of the first participant according to the detection period.

[0055] When the first participant actively sets the meeting status, each participant is in the listening state by default in the online meeting. A temporary away state switch control can be set in the online meeting application. When the first participant needs to temporarily stop the online meeting, he can click the temporary away state switch control to change the first participant from the listening state to the temporary away state.

[0056] When the participating terminal detects the participating status of the first participant according to the detection cycle, the participating terminal can obtain the picture of the first participant photographed by the participating terminal according to the cycle, and detect whether there is a facial image of the first participant in the picture of the first participant. In response to the continuous number of times that the facial image of the first participant is not detected exceeding the number threshold, it is determined that the participating status of the participant is temporarily away.

[0057] In implementation, when the first participant is participating in the online meeting, the participant terminal can capture the screen of the first participant according to the detection cycle, for example, the screen of the first participant can be captured by the front camera of the mobile phone, or the screen of the first participant can be captured by the camera connected to the computer host. After capturing the screen of the first participant each time, the participant terminal can detect whether there is a facial image of the first participant in the screen. If it is detected that the facial image of the first participant is detected in the captured screen, it can be said that the first participant is watching and listening to the content of the online meeting. If it is detected that the number of times that the facial image of the first participant is not detected in the captured screen exceeds the set number threshold, it can be considered that the first participant is not currently watching and listening to the content of the online meeting, that is, it can be determined that the first participant is in a temporary absence state. Among them, the first participant can be pre-stored in the participant terminal, for example, after the first participant joins the online meeting through the participant terminal, the conference management service can send the facial image of the first participant to the participant terminal. The duration and number threshold of the above detection cycle can be pre-set by the technician, for example, the detection cycle is 10 seconds and the number threshold is 2.

[0058] In another example, in addition to determining the first participant's attendance status by detecting the first participant's face image, the participant terminal may also determine the first participant's attendance status in combination with the participant terminal's operation information. That is, after determining that the number of consecutive times that the first participant's face image has not been detected exceeds a threshold number, and the participant terminal's operation information has not been detected within a specified time period, the participant's attendance status is determined to be temporarily away.

[0059] The operation information may be the operation time of the first participant operating the cursor movement event, click event or keyboard input event of the participating terminal. In implementation, after the consecutive number of times that the facial image of the first participant is not detected in the captured image exceeds the number threshold, it can be determined whether the duration for which the operation information of the participating terminal is not detected currently exceeds the specified duration. For example, determine whether the difference between the time when the first participant last triggered an operation and the current time exceeds the specified duration. If it is determined whether the duration for which the operation information of the participating terminal is not detected currently exceeds the specified duration, it can be determined that the participant's participating status is temporarily away.

[0060] Step 102: In response to the first participant's attendance status being temporarily away, the participant terminal sends a first temporarily away status notification to the conference management service.

[0061] The first away-from-session status notification may carry information such as an account identifier corresponding to the first participant or a terminal identifier of a participant terminal.

[0062] Step 103: After receiving the first temporary absence status notification, the conference management service performs management operations on the conference data in the online conference.

[0063] In one example, the management operation performed by the conference management service may be that the conference management service performs screen recording processing on conference data in the online conference data.

[0064] During implementation, if the meeting host configures the participants to record the online meeting, that is, the first participant can store the video data and audio data in the online meeting, and the first participant has cloud recording permissions, the online meeting can be recorded through the conference management service, that is, the video data and audio data of the online meeting sent to the participating terminal of the first participant are received and stored.

[0065] In another example, the conference management service may perform the management operation by sending a conference data storage notification to the participating terminal. In response to receiving the conference data storage notification, the participating terminal stores the currently received video data and audio data of the online conference.

[0066] In implementation, if the conference host configures the participants to record the online conference, but the first participant does not have cloud recording permissions, the conference management service can send a conference data storage notification to the participating terminals. After receiving the conference data storage notification, the participant terminal corresponding to the first participant can record the screen, that is, store the video data and audio data received from the online conference.

[0067] In another example, the conference management service may perform management operations by obtaining audio data of other participants in the online conference, converting the obtained audio data of each participant into text data, and sending the obtained text data corresponding to each participant to the participating terminal, which receives and stores the text data corresponding to each participant.

[0068] In implementation, if the conference host configures the participants not to record the online conference, the conference management service can obtain the audio data in the online conference after receiving the first temporary absence status notification sent by the participating terminal, and then perform text recognition processing on the obtained audio data, and then convert the audio data in the online conference into text data. Among them, the audio data of the online conference obtained may include audio data corresponding to each participant except the first participant. In this way, when performing text recognition processing on the audio data, the text data corresponding to the audio data of each participant can be identified separately. For the text data of each participant identified, the conference management service can send the text data of each participant to the participating terminal of the first participant for storage.

[0069] In addition, the conference data stored in this step may also include conference control information in the online conference, such as the conference host's setting information on online conference permissions, conference interaction information, such as hand-raising requests triggered by participants in the online conference, and participant entry and exit information.

[0070] Step 104: In response to the first participant's attendance status being changed from the away status to the listening status, the participant terminal displays conference data corresponding to the management operation through a conference data playback window.

[0071] In implementation, after determining that the first participant's attendance status has changed from the away status to the listening status, the participating terminal can display a conference data playback window in the display interface of the participating terminal, and the conference data stored by the storage processing is displayed in the conference data playback window.

[0072] Among them, when the conference data is stored by the participating terminal, the participating terminal can display the stored conference data in the conference data playback window. For example, play the video data and audio data of the online conference recorded by the participating terminal when the first participant is in the away state, or display the text data corresponding to the voice of other participants recognized by the conference management service when the first participant is in the away state. The video data and audio data of the recorded online conference, as well as the text data corresponding to the participant's voice, can be played at the same time. In this way, the first participant can choose to watch the recorded video data in silence, and determine the communication content of other participants in the away state of the first participant through the displayed text data. This will not affect the normal playback of the audio data and video data of the current online conference.

[0073] When conference data is stored on the cloud platform by the conference management service, the participating terminal can send a corresponding acquisition request for the conference data to the conference management service. After receiving the acquisition request sent by the participating terminal, the conference management service can send the stored conference data to the participating terminal, and the participating terminal will display it through the conference data playback window.

[0074] In the embodiment of the present application, the participating terminal can detect the participating status of the first participant during the process of the first participant participating in the online meeting. When the participating terminal determines that the first participant is in a temporarily away state without watching and listening to the online meeting content, the conference data of the online meeting can be stored through the conference management service or the participating terminal. When the first participant watches and listens to the online meeting content again, the conference data stored by the first participant during the temporarily away state can be played back, thereby preventing the first participant from missing the content of the online meeting.

[0075] In one achievable manner, the change of the first participant's meeting status from the away state to the listening state may be triggered by the first participant, and the corresponding processing includes: in response to the first participant's meeting status being the away state, displaying a control for releasing the away state in the online conference interface of the participant terminal. In response to a click operation on the control for releasing the away state, determining that the first participant's meeting status is changed from the away state to the listening state.

[0076] like Figure 2 As shown, when the participating terminal determines that the participating status of the first participant is in the away state, a control for releasing the away state can be displayed on the online conference interface of the participating terminal. The control for releasing the away state can be overlaid on the online conference interface. While displaying the control for releasing the away state, the conference screen displayed in the online conference interface can be grayed out, or the audio playback of the online conference can be turned off. When the first participant needs to listen to and watch the content of the online conference again, he can click on the control for releasing the away state. After detecting the click operation of the control for releasing the away state, the participating terminal determines that the participating status of the first participant has changed from the away state to the listening state.

[0077] The first participant's state of attending the conference may be changed to the listening state by the participant's terminal detecting the first participant's face image or operation information of the participant's terminal. For example, when the first participant is in the temporarily away state, if the participant's terminal detects the first participant's face image or operation information of the participant's terminal, it can be determined that the first participant has changed from the temporarily away state to the listening state.

[0078] After determining that the first participant changes from the away state to the listening state, the participating terminal can obtain the conference data stored when the first participant changes from the away state, and display it through the conference data playback window. The conference data playback window can be a window created by the participating terminal, which is different from the window in which the participating terminal plays the current conference content.

[0079] In one feasible manner, after receiving the first away status notification, the conference management service sends a second away status notification to the participating terminals corresponding to other participants in the online conference. The second away status notification is used to instruct the participating terminals that receive the second away status to add an away status mark in the window corresponding to the first participant.

[0080] like Figure 3 As shown, after receiving the second away status notification corresponding to the first participant, the other participant's corresponding participating terminal can add an away status mark near the window displaying the first participant's conference screen and the first participant's account. The away status mark can be a clock icon, which can be used to indicate that the first participant is currently in the away status.

[0081] Correspondingly, after determining that the first participant has changed from the away state to the listening state, the participating terminal can also send a first listening state notification to the conference management service. After receiving the first listening state notification, the conference management service can stop storing and processing the conference data in the online conference. And it can also send a second listening state notification corresponding to the first participant to the terminals of other participants. After receiving the second listening state notification corresponding to the first participant, the terminals of other participants can cancel the away mark added to the window displaying the first participant's conference screen and near the first participant's account.

[0082] It can be seen that in an embodiment of the present application, after a participant participating in an online meeting is in a temporarily away state, the conference management service can notify other participants of the information that the participant is in a temporarily away state, thereby avoiding other participants from interacting with the participant in the temporarily away state in the online meeting, thereby improving the communication efficiency of the participants in the online meeting.

[0083] In one practicable manner, when the first participant is in the away state, when other participants interact with the first participant in the online conference, other participants may be further reminded that the first participant is in the away state.

[0084] In one example, in response to detecting identity information of other participants in the online conference from audio data of other participants, the conference management service sends prompt information to conference terminals corresponding to other participants, where the prompt information is used to indicate that the first participant is in an away state.

[0085] In implementation, the conference management service may perform text recognition processing on the audio data sent by each participating terminal in the online conference (that is, the audio data of the participant recorded by the participating terminal). The conference management service may store the identity information corresponding to the participant who is currently in the temporary away state. Among them, the identity information corresponding to the participant may include the name, account name, etc. of the participant. In the result of the text recognition processing of the audio data corresponding to the second participant by the conference management service, if the identity information of the first participant who is in the temporary away state is detected. It is determined that the second participant may currently be communicating with the first participant in the online conference. Therefore, the conference management service can send a prompt message to the participating terminal corresponding to the second participant again. After the second participant receives the prompt message corresponding to the first participant, a text reminder can be made in the online conference interface, for example, "XX (the identity information of the first participant) is currently in the temporary away state" is displayed in the online conference interface, or the voice playback "XX is currently in the temporary away state" is played.

[0086] In another example, when the first participant's attendance status is in the away state, the conference management service sends a prompt message to the participant terminals corresponding to other participants in response to receiving interactive operations between other participants and the first participant, and the prompt message is used to indicate that the first participant is in the away state.

[0087] In implementation, if the conference management service obtains the interactive operation between other participants and the first participant, for example, the third participant "@"s the first participant in the chat interface. Then the conference management service can send a prompt message to the participating terminal corresponding to the third participant. After the third participant receives the prompt message corresponding to the first participant, a text reminder can be made in the chat interface, such as displaying "XX is currently in a temporary absence" or playing a voice message "XX is currently in a temporary absence".

[0088] It can be seen that in an embodiment of the present application, when the first participant is in an away state, if there are other participants in the online meeting who communicate and interact with the first participant, the conference management service can further remind other participants that the first participant is in an away state, thereby avoiding invalid communication in the online meeting and improving the communication efficiency of the participants in the online meeting.

[0089] Figure 4 This is a flow chart of a method for displaying conference data provided by an embodiment of the present application. The method can be applied to a conference system including a cloud platform and conference terminals. A conference management service runs in the cloud platform, and the conference management service can further include conference control service, recording service, translation service, media service and message service. Figure 4 Participant A in the above-mentioned first participant can be the above-mentioned participant B, and participant A can be the above-mentioned other participants. Figure 4 In the example, participant A and participant B can also refer to the conference terminals operated by participant A and participant B respectively. Figure 4 , the method comprising:

[0090] Step S1: The conference terminal corresponding to participant A sets the temporary absence status of participant A to the conference control service.

[0091] When the participant A's corresponding conference terminal detects that the participant A is in the away state, it may send an away state notification to the conference control service, so as to set the participant A's conference state to the away state in the conference control service.

[0092] Among them, in the conference control service, the attendance status corresponding to each participant in the online conference can be recorded, and the attendance status corresponding to each participant is set to the listening state by default.

[0093] Step S2: The conference control service returns a notification of successful setting status to participant A.

[0094] In one example, the setting status success notification may be the conference data storage notification in the above embodiment.

[0095] Step S3: The conference control service notifies other participants (participant B) that participant A is in a temporary absence state.

[0096] In this way, other participants can be reminded that participant A is temporarily away, thereby avoiding invalid communication between other participants and participant A.

[0097] Step S4: The participating terminal corresponding to participant A starts local screen recording processing.

[0098] In one example, after receiving the setting status success notification sent by the conference control service, the participating terminal corresponding to participant A can start local screen recording processing, that is, store the video data and audio data of the online conference.

[0099] Step S5: The participant terminal corresponding to participant A sends a cloud recording request to the recording service.

[0100] In one example, after the participating terminal corresponding to participant A receives the successful setup status notification sent by the conference control service, if it is determined that the meeting host has configured the participant to record the online meeting, and participant A has cloud recording permissions, a cloud recording request can be sent to the recording service to enable the recording service to start cloud recording of the online meeting.

[0101] Step S6: The participant terminal corresponding to participant A sends a speech-to-text request to the translation service.

[0102] Step S7: The translation service sends the text conversion results of the speeches of other participants to the participant terminal corresponding to participant A.

[0103] Step S8: The participant terminal corresponding to participant A stores the speech-to-text conversion result.

[0104] In implementation, the participant terminal corresponding to the participant A may only execute any one of the steps S4 and S5, and the execution of the steps S4 and S5 does not affect the execution of the step S6.

[0105] Step S9: Participant B calls participant A through the media service.

[0106] In one example, a calling function between participants may be provided in an online conference. After participant B successfully calls participant A, the participant terminal corresponding to participant A may display a prompt message indicating that participant B is calling participant A.

[0107] Step S10: The media service queries the conference control service to find out that participant A is in a temporarily away state.

[0108] Step S11: The media service notifies the message service that participant A is in a temporary absence state.

[0109] Step S12: The message service will notify participant B that participant A is in a temporary absence state.

[0110] In this way, when other participants (such as participant B) call participant A who is temporarily away, the message service can send a notification to participant B that participant A is temporarily away. This can avoid invalid communication between participant B and participant A, thereby improving the communication efficiency of the online meeting.

[0111] Step S13, participant B sends @participant A to the messaging service in the chat.

[0112] In one example, a text chat function between participants may be provided in an online meeting, and participant B may @ participant A in the chat dialog box to remind participant A that participant B is currently looking for participant A to chat.

[0113] Step S14: The message service queries the conference control service to find out that participant A is in a temporary absence state.

[0114] Step S15: The message service will notify participant B that participant A is in a temporary absence state.

[0115] In this way, when other participants (such as participant B) @ participant A who is temporarily away during the chat, the messaging service can send a notification to participant B that participant A is temporarily away. This can avoid ineffective communication between participant B and participant A, thereby improving the communication efficiency of the online meeting.

[0116] Step S16: The conference terminal corresponding to participant A sets the conference control service to cancel the temporary absence status of participant A.

[0117] Step S17: The conference control service notifies other participants (including participant B) that participant A is in a listening state.

[0118] Step S18: The conference terminal corresponding to participant A plays the conference data stored by participant A in the away state.

[0119] In this way, participant A can obtain the meeting content when participant A is away through the conference data played by the participating terminal, thereby avoiding missing the meeting content in the online meeting and improving the efficiency of communication among participants in the online meeting.

[0120] The present application also provides a conference system, such as Figure 5 As shown, the conference system includes a cloud platform and conference terminals, and the cloud platform includes conference management services, including:

[0121] The conference participant terminal 510 is used to obtain the conference participant status of the first participant corresponding to the conference participant terminal in the online conference, where the conference participant status includes a listening status or an away status.

[0122] The conference participant terminal 510 is configured to send a first away status notification to the conference management service in response to the conference status of the first participant being away.

[0123] The conference management service 520 is used to perform management operations on conference data in the online conference after receiving the first temporary absence status notification.

[0124] The conference terminal 510 is used for displaying conference data corresponding to the management operation through the conference data playback window in response to the conference status of the first participant being changed from the away state to the listening state.

[0125] In one achievable manner, when the first participant's attendance status is in the away state, the conference management service 520 is used to send a prompt message to the participant terminals corresponding to the other participants in response to detecting the identity information of the first participant in the audio data of other participants in the online conference, and the prompt message is used to indicate that the first participant is in the away state.

[0126] In one achievable manner, while the first participant's attendance status is in the away state, the conference management service is used 520 to respond to receiving interactive operations between other participants and the first participant, and to send prompt information to the participant terminals corresponding to other participants, wherein the prompt information is used to indicate that the first participant is in the away state.

[0127] In one achievable method, the participant terminal 510 is used to obtain a picture of the first participant taken by the participant terminal according to a detection cycle; after each acquisition of the picture of the first participant, a detection is performed on the picture of the first participant to determine whether there is a facial image of the first participant; in response to the number of consecutive times when the facial image of the first participant is not detected exceeding a number threshold, the participant status of the first participant is determined to be a temporarily away state.

[0128] In one achievable manner, the participant terminal 510 is configured to determine that the participant status of the first participant is temporarily away in response to the fact that the number of consecutive times that the facial image of the first participant is not detected exceeds a threshold and no operation information of the participant terminal is detected within a specified time period.

[0129] In an achievable manner, the conference management service 520 is used to send a conference data storage notification to the participating terminal. The participating terminal is used to store the currently received video data and audio data of the online conference in response to receiving the conference data storage notification.

[0130] In one achievable manner, the conference management service 520 is used to obtain audio data of other participants in the online conference, and convert the obtained audio data of each participant into text data. The conference management service is used to send the obtained text data corresponding to each participant to the participant terminal. The participant terminal is used to receive and store the text data corresponding to each participant.

[0131] In one achievable manner, the conference management service 520 is used to send a second away status notification to the participating terminals corresponding to other participants in the online conference after receiving the first away status notification, and the second away status notification is used to instruct the participating terminals corresponding to the other participants to add an away status mark in the display window corresponding to the first participant.

[0132] In one feasible manner, the participant terminal 510 is used to display a control for releasing the away status in the online conference interface of the participant terminal in response to the first participant's participant status being in the away status; in response to a click operation on the control for releasing the away status, it is determined that the first participant's participant status is updated from the away status to the listening status.

[0133] The conference terminal 510 and the conference management service 520 can be implemented by software or hardware. As an example, the implementation of the conference management service 520 is introduced below. Similarly, the implementation of the conference terminal 510 can refer to the implementation of the conference management service 520.

[0134] As an example of a software functional unit, the conference management service 520 may include code running on a computing instance. The computing instance may be at least one of a physical host (computing device), a virtual machine, a container, and other computing devices. Furthermore, the computing device may be one or more. For example, the conference management service 520 may include code running on multiple hosts / virtual machines / containers. It should be noted that the multiple hosts / virtual machines / containers used to run the application may be distributed in the same region or in different regions. The multiple hosts / virtual machines / containers used to run the code may be distributed in the same AZ or in different AZs, each AZ including a data center or multiple data centers with similar geographical locations. Typically, a region may include multiple AZs.

[0135] Similarly, multiple hosts / virtual machines / containers used to run the code can be distributed in the same VPC or in multiple VPCs. Usually, a VPC is set up in a region. For cross-region communication between two VPCs in the same region and between VPCs in different regions, a communication gateway must be set up in each VPC to achieve interconnection between VPCs through the communication gateway.

[0136] As an example of a hardware functional unit, the conference management service 520 may include at least one computing device, such as a server, etc. Alternatively, the conference management service 520 may also be a device implemented using ASIC or PLD, etc. The PLD may be implemented using CPLD, FPGA, GAL or any combination thereof.

[0137] The multiple computing devices included in the conference management service 520 can be distributed in the same region or in different regions. The multiple computing devices included in the YY device can be distributed in the same AZ or in different AZs. Similarly, the multiple computing devices included in the YY device can be distributed in the same VPC or in multiple VPCs. The multiple computing devices can be any combination of computing devices such as servers, ASICs, PLDs, CPLDs, FPGAs, and GALs.

[0138] The present application also provides a computing device 100. Figure 6 As shown, the computing device 100 includes: a bus 102, a processor 104, a memory 106, and a communication interface 108. The processor 104, the memory 106, and the communication interface 108 communicate with each other through the bus 102. The computing device 100 can be a server or a terminal device. It should be understood that the present application does not limit the number of processors and memories in the computing device 100.

[0139] The bus 102 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 6 The bus 102 is represented by only one line, but it does not mean that there is only one bus or one type of bus. The bus 102 may include a path for transmitting information between various components of the computing device 100 (eg, the memory 106, the processor 104, and the communication interface 108).

[0140] The processor 104 may include any one or more of a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP), or a digital signal processor (DSP).

[0141] The memory 106 may include a volatile memory, such as a random access memory (RAM). The memory 106 may also include a non-volatile memory, such as a read-only memory (ROM), a flash memory, a hard disk drive (HDD), or a solid state drive (SSD).

[0142] The memory 106 stores executable program codes, and the processor 104 executes the executable program codes to respectively implement the functions of the aforementioned conference terminal 510 or conference management service 520, thereby implementing the method for displaying conference data. That is, the memory 106 stores instructions for executing the method for displaying conference data.

[0143] The communication interface 108 uses a transceiver module such as, but not limited to, a network interface card or a transceiver to implement communication between the computing device 100 and other devices or a communication network.

[0144] The embodiment of the present application also provides a computing device cluster. The computing device cluster includes at least one computing device. The computing device can be a server, such as a central server, an edge server, or a local server in a local data center. In some embodiments, the computing device can also be a terminal device such as a desktop computer, a laptop computer, or a smart phone.

[0145] like Figure 7 As shown, the computing device cluster includes at least one computing device 100. The memory 106 in one or more computing devices 100 in the computing device cluster may store the same instructions for executing the method for presenting conference data.

[0146] In some possible implementations, the memory 106 of one or more computing devices 100 in the computing device cluster may also store partial instructions for executing the method for displaying conference data. In other words, the combination of one or more computing devices 100 may jointly execute instructions for executing the method for displaying conference data.

[0147] It should be noted that the memory 106 in different computing devices 100 in the computing device cluster may store different instructions, which are respectively used to execute part of the functions of the conference management service 520 .

[0148] In some possible implementations, one or more computing devices in the computing device cluster may be connected via a network, which may be a wide area network or a local area network. Figure 8A possible implementation is shown. Figure 8 As shown, two computing devices 100A and 100B are connected via a network. Specifically, the network is connected via a communication interface in each computing device. In this type of possible implementation, the memory 106 in the computing device 100A stores instructions for the functions of the conference terminal 510. At the same time, the memory 106 in the computing device 100B stores instructions for executing the functions of the conference management service 520.

[0149] Figure 8 The connection method between the computing device clusters shown may be that considering that the method for displaying conference data provided by the present application needs to be implemented through a cloud platform, it is considered that the functions implemented by the conference management service 520 are handed over to the computing device 100B for execution.

[0150] It should be noted that the memory 106 in different computing devices 100 in the computing device cluster can store different instructions for executing part of the functions of the conference system. That is, the instructions stored in the memory 106 in different computing devices 100 can implement different functions in the conference terminal 510 and the conference management service 520.

[0151] The embodiment of the present application also provides a computer program product including instructions. The computer program product may be software or a program product including instructions that can be run on a computing device or stored in any available medium. When the computer program product is run on at least one computing device, the at least one computing device executes a method for displaying conference data.

[0152] The embodiment of the present application also provides a computer-readable storage medium. The computer-readable storage medium can be any available medium that can be stored by the computing device or a data storage device such as a data center containing one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk). The computer-readable storage medium includes instructions that instruct the computing device to execute a method for displaying conference data.

[0153] In this application, the terms "first", "second", etc. are used to distinguish between identical or similar items with substantially the same effects and functions. It should be understood that there is no logical or temporal dependency between "first" and "second", nor is the quantity and execution order limited. It should also be understood that although the following description uses the terms first, second, etc. to describe various elements, these elements should not be limited by the terms. These terms are only used to distinguish one element from another element. In this application, the term "at least one" means one or more, and the term "multiple" means two or more.

[0154] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the protection scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for displaying conference data, characterized in that: The method is applied to a conference system, the conference system includes a cloud platform and conference terminals, the cloud platform includes a conference management service, and the method includes: The conference participant terminal acquires the conference participant status of the first participant corresponding to the conference participant terminal in the online conference, where the conference participant status includes a listening status or an away status; In response to the first participant's attendance status being an away state, the participant terminal sends a first away state notification to the conference management service; After receiving the first temporary absence status notification, the conference management service performs a management operation on the conference data of the online conference; In response to the first participant's attendance status being changed from the away status to the listening status, the conference terminal displays conference data corresponding to the management operation through a conference data playback window.

2. The method according to claim 1, characterized in that The method further comprises: While the first participant's attendance status is in the away state, the conference management service sends a prompt message to the participant terminals corresponding to the other participants in response to detecting the identity information of the first participant in the audio data of other participants in the online conference, and the prompt message is used to indicate that the first participant is in the away state.

3. The method according to claim 1, characterized in that The method further comprises: While the first participant's attendance status is in the away state, the conference management service sends a prompt message to the participant terminals corresponding to the other participants in response to receiving the interactive operations between the other participants and the first participant, and the prompt message is used to indicate that the first participant is in the away state.

4. The method according to any one of claims 1 to 3, characterized in that: The participant terminal obtains the participant status of the first participant corresponding to the participant terminal in the online conference, including: Acquire the image of the first participant captured by the participating terminal according to the detection period; After acquiring the screen of the first participant each time, detecting whether there is a facial image of the first participant in the screen of the first participant; In response to the fact that the number of consecutive times that the facial image of the first participant is not detected exceeds a number threshold, it is determined that the attendance status of the first participant is an away state.

5. The method according to claim 4, characterized in that In response to the fact that the number of consecutive times that the facial image of the first participant is not detected exceeds a number threshold, determining that the first participant's attendance status is temporarily away includes: In response to the fact that the number of consecutive times that the facial image of the first participant is not detected exceeds a number threshold and the operation information of the participant terminal is not detected within a specified time period, it is determined that the participant status of the first participant is an away status.

6. The method according to any one of claims 1 to 5, characterized in that: The performing management operations on the conference data in the online conference includes: The conference management service sends a conference data storage notification to the participating terminal; In response to receiving the conference data storage notification, the participant terminal stores the currently received video data and audio data of the online conference.

7. The method according to any one of claims 1 to 5, characterized in that: The performing management operations on the conference data of the online conference includes: The conference management service obtains audio data of other participants in the online conference, and converts the obtained audio data of each participant into text data; The conference management service sends the obtained text data corresponding to each participant to the participant terminal; The conference participant terminal receives and stores text data corresponding to each participant.

8. The method according to any one of claims 1 to 7, characterized in that: The method further comprises: After receiving the first away status notification, the conference management service sends a second away status notification to the participating terminals corresponding to other participants in the online conference, where the second away status notification is used to instruct the participating terminals corresponding to the other participants to add an away status mark in the display window corresponding to the first participant.

9. The method according to any one of claims 1 to 8, characterized in that: The method further comprises: In response to the first participant's attendance status being an AWAY status, displaying a control for releasing the AWAY status in the online conference interface of the participant terminal; In response to a click operation on the control for releasing the away status, it is determined that the meeting status of the first participant is updated from the away status to the listening status.

10. A conference system, characterized in that: The conference system includes a cloud platform and conference terminals. The cloud platform includes conference management services, wherein: The conference participant terminal is used to obtain the conference participant status of the first participant corresponding to the conference participant terminal in the online conference, where the conference participant status includes a listening status or an away status; The conference participant terminal is configured to send a first away status notification to the conference management service in response to the conference status of the first participant being away. The conference management service is used to perform management operations on the conference data of the online conference after receiving the first temporary absence status notification; The conference participant terminal is configured to display conference data corresponding to the management operation through a conference data playback window in response to the conference status of the first participant being changed from the away status to the listening status.

11. The conference system according to claim 10, characterized in that: While the first participant's attendance status is in the away state, the conference management service is used to send prompt information to the participant terminals corresponding to the other participants in response to detecting the identity information of the first participant in the audio data of other participants in the online conference, and the prompt information is used to indicate that the first participant is in the away state.

12. The conference system according to claim 10, characterized in that: While the first participant's attendance status is in the away state, the conference management service is used to send prompt information to the participant terminals corresponding to the other participants in response to receiving interactive operations between the other participants and the first participant, and the prompt information is used to indicate that the first participant is in the away state.

13. The conference system according to any one of claims 10 to 12, characterized in that: The participant terminal is used to obtain the picture of the first participant taken by the participant terminal according to the detection cycle; after each acquisition of the picture of the first participant, detect whether there is a facial image of the first participant in the picture of the first participant; in response to the continuous number of times that the facial image of the first participant is not detected exceeds a number threshold, determine that the participant status of the first participant is a temporarily away state.

14. The conference system according to claim 13, characterized in that: The participant terminal is used to determine that the participant status of the first participant is temporarily away in response to the continuous number of times that the facial image of the first participant is not detected exceeds a number threshold and no operation information of the participant terminal is detected within a specified time period.

15. The conference system according to any one of claims 10 to 14, characterized in that: The conference management service is used to send a conference data storage notification to the participating terminal; The participant terminal is used for storing the currently received video data and audio data of the online conference in response to receiving the conference data storage notification.

16. The conference system according to any one of claims 10 to 14, characterized in that: The conference management service is used to obtain audio data of other participants in the online conference, and convert the obtained audio data of each participant into text data; The conference management service is used to send the obtained text data corresponding to each participant to the participant terminal; The conference participant terminal is used for receiving and storing text data corresponding to each participant.

17. The conference system according to any one of claims 10 to 16, characterized in that: The conference management service is also used to send a second away status notification to the participating terminals corresponding to other participants in the online conference after receiving the first away status notification, and the second away status notification is used to instruct the participating terminals corresponding to the other participants to add an away status mark in the display window corresponding to the first participant.

18. The conference system according to any one of claims 10 to 17, characterized in that: The participating terminal is also used to display a control for releasing the away status in the online conference interface of the participating terminal in response to the participating status of the first participant being an away status; and in response to a click operation on the control for releasing the away status, determine that the participating status of the first participant is updated from the away status to the listening status.

19. A computing device cluster, characterized in that: comprising at least one computing device, each computing device comprising a processor and a memory; The processor of the at least one computing device is configured to execute instructions stored in the memory of the at least one computing device, so that the computing device cluster executes the method according to any one of claims 1 to 9.

20. A computer program product comprising instructions, characterized in that When the instructions are executed by a computing device cluster, the computing device cluster executes the method according to any one of claims 1 to 9.

21. A computer-readable storage medium, characterized in that: The method comprises computer program instructions. When the computer program instructions are executed by a computing device cluster, the computing device cluster performs the method according to any one of claims 1 to 9.

Images