Online meeting processing method and apparatus, and electronic device, computer-readable storage medium and computer program product

Abstract

Provided in the present application are an online meeting processing method and apparatus, and an electronic device, a computer-readable storage medium and a computer program product. The method comprises: displaying a meeting interface of an online meeting logged in by means of a target account, wherein the target account is used for allowing a plurality of meeting objects of one meeting place to participate in the online meeting; and when any target meeting object among the plurality of meeting objects speaks, displaying, in the meeting interface, speaking instruction information used for instructing the target meeting object to speak.

Description

Online conference processing method, device, electronic device, computer-readable storage medium, and computer program product

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application is based on the Chinese patent application with application number 2023106677556 and application date of June 6, 2023, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby introduced into this application as a reference. Technical Field

[0003] The present application relates to the field of Internet technology, and in particular to a method, device, electronic device, computer-readable storage medium, and computer program product for processing an online conference. Background Art

[0004] With the development of the internet, online conferencing is becoming increasingly popular. Also known as web conferencing or remote collaborative office work, online conferencing allows users to leverage the internet to share data across multiple locations, effectively improving the efficiency of online collaboration with clients, partners, and colleagues across regions.

[0005] For a conference scenario where multiple people are participating in an online meeting in the same conference room, the related art implements this approach: a single conference account is logged into the conference device, and all participants in the conference room speak through the microphone of that single conference account. However, because only one conference account (the one logged into the conference device) can be identified, the speeches of all participants in the conference room are marked as those of that conference account. This makes it impossible for other participants in the online meeting (for example, those not in the same conference room) to determine who is currently speaking, greatly affecting the efficiency of the online meeting.

[0006] Summary of the Invention

[0007] The embodiments of the present application provide a method, device, electronic device, computer-readable storage medium, and computer program product for processing an online conference, which can improve the efficiency and experience of online conferences.

[0008] The technical solution of the embodiment of the present application is implemented as follows:

[0009] The present application provides an online conference processing method, which is applied to an electronic device and includes:

[0010] Displaying a conference interface of an online conference logged in through a target account, wherein the target account is used for multiple conference participants in a conference venue to participate in the online conference;

[0011] When any target conference object among the multiple conference objects speaks, speech instruction information for instructing the target conference object to speak is displayed in the conference interface.

[0012] The embodiment of the present application further provides an online conference processing device, including:

[0013] A first display module is configured to display a conference interface of an online conference logged in through a target account, wherein the target account is used for multiple conference participants in a conference venue to participate in the online conference;

[0014] The second display module is configured to display speech instruction information for instructing any target conference object to speak in the conference interface when any target conference object among the multiple conference objects speaks.

[0015] An embodiment of the present application further provides an electronic device, including:

[0016] a memory configured to store computer-executable instructions;

[0017] The processor is configured to implement the online conference processing method provided in the embodiment of the present application when executing the computer executable instructions stored in the memory.

[0018] An embodiment of the present application further provides a computer-readable storage medium storing computer-executable instructions or a computer program. When the computer-executable instructions or the computer program are executed by a processor, the online conference processing method provided in the embodiment of the present application is implemented.

[0019] An embodiment of the present application also provides a computer program product, including computer-executable instructions or a computer program. When the computer-executable instructions or the computer program are executed by a processor, the online conference processing method provided in the embodiment of the present application is implemented.

[0020] The embodiments of the present application have the following beneficial effects:

[0021] By applying the above-mentioned embodiment of the present application, when logging into an online conference through a target account, and the target account is used for multiple conference participants in a conference venue to participate in the online conference, when any of the multiple conference participants speaks, speech instruction information for instructing the target conference participant to speak can be displayed in the conference interface. In this way, for a conference scenario where multiple participants participate in an online conference through a single conference account in the same conference venue, different speech instruction information can be displayed when different conference participants speak, so that the speech instruction information clearly identifies which conference participant is speaking among the multiple conference participants, thereby improving the efficiency and conference experience of the online conference. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] FIG1 is a schematic diagram of the architecture of an online conference processing system 100 provided in an embodiment of the present application;

[0023] FIG2 is a schematic structural diagram of an electronic device 500 for implementing an online conference processing method provided in an embodiment of the present application;

[0024] FIG3 is a flow chart of a method for processing an online conference provided in an embodiment of the present application;

[0025] FIG4 is a schematic diagram showing a conference reservation interface provided in an embodiment of the present application;

[0026] FIG5 is a schematic diagram showing a voiceprint registration interface provided in an embodiment of the present application;

[0027] FIG6 is a schematic diagram showing conference joining information provided in an embodiment of the present application;

[0028] FIG7 is a schematic diagram of a virtual login process according to an embodiment of the present application;

[0029] FIG8 is a flowchart of removing a virtual login account provided in an embodiment of the present application;

[0030] FIG9 is a schematic diagram showing the display of speech instruction information provided in an embodiment of the present application;

[0031] FIG10 is a schematic diagram showing display of speech instruction information provided in an embodiment of the present application;

[0032] FIG11 is a schematic diagram showing a display of a meeting minutes provided in an embodiment of the present application;

[0033] FIG12 is a schematic diagram of registration of an online conference client provided in an embodiment of the present application;

[0034] FIG13 is a flow chart of a method for processing an online conference according to an embodiment of the present application;

[0035] FIG14 is a schematic diagram of a processing flow of a virtual participant management module provided in an embodiment of the present application;

[0036] FIG15 is a schematic diagram of the binding relationship between the conference management object and the virtual participants provided in an embodiment of the present application;

[0037] FIG16 is a schematic diagram of a processing flow of a speech recognition module provided in an embodiment of the present application;

[0038] FIG17 is a schematic diagram of storing voiceprint features provided in an embodiment of the present application. DETAILED DESCRIPTION

[0039] In order to make the purpose, technical solutions and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limiting this application. All other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0040] In the following description, reference is made to “some embodiments”, which describes a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0041] In the following description, the terms "first\second\third" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0042] Unless otherwise defined, all technical and scientific terms used in the embodiments of the present application have the same meanings as those commonly understood by those skilled in the art. The terms used in the embodiments of the present application are only for the purpose of describing the embodiments of the present application and are not intended to limit the present application.

[0043] Before further describing the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are explained. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations.

[0044] 1) Client: An application running in a terminal to provide various services, such as a client that supports online meetings.

[0045] 2) In response, it is used to indicate the conditions or states on which the executed operations depend. When the dependent conditions or states are met, one or more operations executed can be real-time or have a set delay. Unless otherwise specified, there is no restriction on the order in which the multiple operations executed are executed.

[0046] 3) Online meetings, also known as web conferences or remote collaborative office work, allow users to use the Internet to share data among multiple users in different locations (meeting venues), effectively improving the efficiency of online collaboration with customers, partners, and colleagues in various regions.

[0047] 4) Voiceprint is the sound wave spectrum that carries speech information displayed by electroacoustic instruments.

[0048] 5) Speaker recognition, also known as voiceprint recognition, is a biometric technology that uses voice to distinguish speakers for identity verification and authentication.

[0049] The embodiments of the present application provide a method, apparatus, electronic device, computer-readable storage medium, and computer program product for processing an online conference, which can improve the efficiency and experience of online conferences. These are described below.

[0050] It should be noted that the collection and processing of relevant data in this application should be strictly in accordance with the requirements of relevant laws and regulations when applied in practice, and the informed consent or separate consent of the personal information subject should be obtained. Subsequent data use and processing should be carried out within the scope of authorization of laws and regulations and the personal information subject.

[0051] The following describes the processing system of the online conference provided by the embodiment of the present application. Referring to Figure 1, Figure 1 is a schematic diagram of the architecture of the processing system 100 of the online conference provided by the embodiment of the present application. In order to support an exemplary application, the terminal 400-1 and the terminal 400-2 are connected to the server 200 through the network 300. The network 300 can be a wide area network or a local area network, or a combination of the two, and a wireless or wired link is used to realize data transmission. Among them, the terminal 400-1 corresponds to the first conference place and logs in to the online conference through the first target account, the terminal 400-2 corresponds to the second conference place and logs in to the online conference through the second target account, and the first conference place and the second conference place both include multiple conference objects; the terminal 400-1 and the terminal 400-2 synchronize the conference information of the online conference (such as the speech content in the online conference) through the server 200.

[0052] Taking terminal 400-1 as an example, terminal 400-1 is configured to respond to a conference join instruction for logging into an online conference through a target account (i.e., a first target account) by sending a conference join request to server 200 for logging into the online conference through the target account; server 200 is configured to receive the conference join request sent by the terminal; in response to the conference join request, control the terminal to log into the online conference through the target account; terminal 400-1 is further configured to display a conference interface of the online conference logged in through the target account when server 200 controls the terminal to log in to the online conference through the target account, where the target account is used for multiple conference participants in a conference venue to participate in the online conference; when any of the multiple conference participants speaks, speech instruction information for instructing the target conference participant to speak is displayed in the conference interface. At the same time, the speech instruction information can also be synchronized to another terminal participating in the online conference (i.e., terminal 400-2), so that terminal 400-2 also displays speech instruction information for instructing the target conference participant to speak in the conference interface. In this way, for a conference scenario where multiple parties participate in an online conference through one conference account at the same conference venue, different speech indication information can be displayed when different conference parties speak, so as to clearly identify which conference party is speaking through the speech indication information, thereby improving the meeting efficiency and meeting experience of the online conference.

[0053] In some embodiments, the online conference processing method provided in the embodiments of the present application can be implemented by various electronic devices, for example, it can be implemented by a terminal alone, it can also be implemented by a server alone, or it can be implemented by a terminal and a server in collaboration. The online conference processing method provided in the embodiments of the present application can be applied to various scenarios, including but not limited to cloud technology, artificial intelligence, smart transportation, assisted driving, games, audio and video, online conferences, instant messaging, etc.

[0054] In some embodiments, the electronic device for implementing the processing method of the online conference provided in the embodiments of the present application may be various types of terminals or servers. Among them, the server (such as server 200) may be an independent physical server, or it may be a server cluster or distributed system composed of multiple physical servers. The terminal (such as terminal 400-1) may be a laptop, a tablet computer, a desktop computer, a smart phone, an intelligent voice interaction device (such as a smart speaker), a smart home appliance (such as a smart TV), a smart watch, a car terminal, a wearable device, a virtual reality (VR) device, etc., but is not limited to this. The terminal and the server may be directly or indirectly connected via wired or wireless communication, and the embodiments of the present application do not limit this.

[0055] In some embodiments, the processing method of the online conference provided in the embodiments of the present application can be implemented with the help of cloud technology. Cloud technology refers to a hosting technology that unifies a series of resources such as hardware, software, and network in a wide area network or a local area network to realize the calculation, storage, processing and sharing of data. Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, and application technology based on the cloud computing business model application. It can form a resource pool that is used on demand and is flexible and convenient. Cloud computing technology will become an important support. The background services of the technical network system require a large amount of computing resources and storage resources. As an example, the server (such as server 200) can also be a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), and basic cloud computing services such as big data and artificial intelligence platforms.

[0056] In some embodiments, multiple servers may form a blockchain, with the servers being nodes on the blockchain. Information connections may exist between each node in the blockchain, and information may be transmitted between nodes via these connections. Data related to the online conference processing method provided in the embodiments of the present application (e.g., meeting minutes, voice data of meeting participants, etc.) may be stored on the blockchain.

[0057] In some embodiments, the terminal or server can implement the processing method of the online conference provided in the embodiment of the present application by running various computer executable instructions or computer programs. For example, the computer executable instructions can be commands, machine instructions or software instructions at the microprogram level. The computer program can be a native program or software module in the operating system; it can be a local (Native) application (Application, APP), that is, a program that needs to be installed in the operating system to run, such as a conference APP; it can also be a small program that can be embedded in any APP, that is, a program that can be run only by downloading it to a browser environment. In short, the above-mentioned computer executable instructions can be instructions in any form, and the above-mentioned computer program can be an application, module or plug-in in any form.

[0058] The following describes an electronic device for implementing a processing method for an online conference provided in an embodiment of the present application. Referring to Figure 2, Figure 2 is a schematic diagram of the structure of an electronic device 500 for implementing a processing method for an online conference provided in an embodiment of the present application. The electronic device 500 provided in an embodiment of the present application can be a terminal or a server. The electronic device 500 provided in an embodiment of the present application includes: at least one processor 510, a memory 550, at least one network interface 520 and a user interface 530. The various components in the electronic device 500 are coupled together via a bus system 540. It can be understood that the bus system 540 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 540 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the various buses are labeled as bus system 540 in Figure 2.

[0059] In some embodiments, the online conference processing device provided in the embodiments of the present application can be implemented in software. Figure 2 shows the online conference processing device 555 stored in the memory 550, which can be software in the form of programs and plug-ins, including the following software modules: a first display module 5551 and a second display module 5552. These modules are logical, so they can be arbitrarily combined or further split according to the functions implemented. The functions of each module will be explained below.

[0060] The following describes the method for processing an online conference provided by an embodiment of the present application. In some embodiments, the method for processing an online conference provided by an embodiment of the present application can be implemented by various electronic devices. For example, it can be implemented by a terminal alone, or by a server alone, or by a terminal and a server in collaboration. Taking terminal implementation as an example, see Figure 3, which is a flow chart of the method for processing an online conference provided by an embodiment of the present application. The method for processing an online conference provided by an embodiment of the present application includes:

[0061] Step 101: The terminal displays a conference interface of an online conference logged in through a target account.

[0062] The target account is used for multiple meeting parties in a meeting place to participate in an online meeting.

[0063] Here, the terminal can be provided with a client that supports online meetings, and the user can participate in the online meeting by running the client through the terminal. In actual application, the terminal can log in to the online meeting through the target account, so that the terminal displays the meeting interface of the online meeting logged in through the target account. The target account can be the login account of the client, and the terminal can log in to the online meeting through the target account when the client is logged in to the target account. It should be noted that the conference objects of each conference venue in multiple conference venues join the online conference through the target account corresponding to each conference venue, thereby realizing a meeting between the conference objects of multiple conference venues.

[0064] It should be noted that the target account can belong to the conference management object of the online conference, which can schedule online conferences, manage conference objects in online conferences, manage relevant information of online conferences (such as the start and end of online conferences, the duration of online conferences, and the meeting location), etc. The above-mentioned multiple conference objects include the conference management object, and the conference objects other than the conference management object in the multiple conference management objects can be called conference participant objects. In actual implementation, each conference venue participating in the online conference can have a conference management object, and of course an online conference can also have a conference management object. In an embodiment of the present application, the target account is used for multiple conference objects in a conference venue to participate in the online conference, thus forming a conference scenario in which multiple conference objects participate in the online conference through one conference account (i.e., the target account) in the same conference venue.

[0065] It should be noted that, for conference scenarios where multiple objects participate in an online conference through a single conference account at the same conference venue, in the embodiments of the present application, it is hoped that different speech indication information can be displayed when different conference objects speak, so as to clearly identify which conference object among the multiple conference objects is speaking through the speech indication information. Therefore, on each terminal participating in the online conference, when any target conference object among the multiple conference objects speaks, the speech indication information for instructing the target conference object to speak can be displayed in the conference interface. The following explanation will be continued using the terminal as the terminal on the conference management object side as an example.

[0066] In some embodiments, before displaying a conference interface for an online conference logged in through a target account, the terminal can schedule an online conference in the following manner: displaying a conference scheduling interface; receiving conference setting information for the online conference based on the conference scheduling interface; and scheduling the online conference in response to a confirmation operation on the conference setting information.

[0067] Here, a user (such as a conference management object) can make a reservation for an online conference. Specifically, the terminal displays a conference reservation interface in response to an online conference reservation instruction triggered by the user (such as one that can be triggered by an online conference reservation control). As an example, refer to Figure 4, which is a display schematic diagram of a conference reservation interface provided by an embodiment of the present application. Here, the conference reservation interface can be used by the user to set the conference setting information of the online conference, such as the meeting location of the online conference, the name of the conference management object (i.e., the conference host) participating in the online conference, the password for joining the online conference, whether to turn on the virtual login mode, and so on. After the terminal receives the conference setting message set by the user based on the conference reservation interface, in response to the confirmation operation for the conference setting information, the online conference is reserved according to the conference setting information. In this way, the reservation of the online conference is realized, and the conference object can participate in the online conference by joining the scheduled online conference.

[0068] In some embodiments, the target account belongs to a conference management object among multiple conference objects. Before displaying the conference interface of an online conference logged in through a target account, the terminal can register the object voiceprint of the conference management object to the object voiceprint library of the online conference in the following manner: in response to the first entry instruction of the conference management object for the online conference, display the voiceprint registration interface of the online conference; based on the voiceprint registration interface, receive the object voice of the conference management object; in response to the confirmation operation for the object voice, add the voiceprint of the object voice as the object voiceprint of the conference management object to the object voiceprint library.

[0069] It should be noted that for conference scenarios where multiple participants participate in an online conference at the same conference venue using a single conference account, embodiments of the present application aim to display different speaking instructions when different participants speak. This allows the user to clearly identify which participant is speaking through the speaking instructions. Therefore, when a user first enters (or logs in to) an online conference, they must register their voiceprint with the object voiceprint library of the online conference. To this end, upon receiving the first entry instruction from the conference management object for the online conference, the terminal displays the online conference voiceprint registration interface. The user can enter their voice through this voiceprint registration interface to register their voiceprint with the object voiceprint library of the online conference. When the terminal receives the subject voice of the conference management object via the voiceprint registration interface, in response to a confirmation operation for the subject voice, it performs voiceprint recognition on the subject voice to obtain the subject voiceprint. This voiceprint is then added to the object voiceprint library as the subject voiceprint of the conference management object, thereby registering the subject voiceprint of the conference management object with the object voiceprint library of the online conference. In this way, after booking an online meeting, when the conference management object enters the online meeting for the first time, it will be guided to register its own object voiceprint in the object voiceprint library, which facilitates the conference management object's operation and improves the efficiency of the conference management object's voiceprint registration.

[0070] In some embodiments, the terminal may display a voice collection control and a voice collection reference text in the voiceprint registration interface; correspondingly, the terminal may receive the object voice of the conference management object based on the voiceprint registration interface in the following manner: based on the voice collection control, the terminal may receive the object voice of the conference management object reading the voice collection reference text.

[0071] Here, the voiceprint registration interface provides a voice capture control and a voice capture reference text. The voice capture control is used to capture voice in response to a trigger operation on the voice capture control; the voice capture reference text is used by the user to refer to the voice capture reference text when performing voice input. Based on this, the terminal can receive the subject's voice, which is read aloud from the conference management subject, by using the voice capture control. This enables voice capture based on the voice capture reference text, simplifying the voiceprint registration process for the user and improving the accuracy of the acquired voiceprint for the device, thereby improving the accuracy of subsequent voiceprint recognition to determine the speaker.

[0072] In some embodiments, the terminal may display a voice file upload control in the voiceprint registration interface; accordingly, the terminal may receive the object voice of the conference management object based on the voiceprint registration interface in the following manner: based on the voice file upload control, receive the uploaded voice file of the conference management object; in response to the confirmation operation for the voice file, use the voice included in the voice file as the object voice.

[0073] Here, a voice file upload control can also be provided in the voiceprint registration interface. The voice file upload control is used for users to upload voice files including their own voices through the voice file upload control. Based on this, the terminal can receive the uploaded voice file of the conference management object through the voice file upload control. The voice included in the voice file is the object voice of the conference management object. In actual applications, the voice file upload control includes a file drag and drop upload function area and a file selection upload control. Users can upload voice files by dragging and dropping voice files to the file drag and drop upload function area. Users can also upload files by selecting files and selecting voice files in the file directory to upload. Here, voiceprint registration is also implemented by uploading voice files, which increases the implementation method of voiceprint registration, making voiceprint registration adaptable to more scenarios and increasing the convenience of user voiceprint registration.

[0074] As an example, see Figure 5, which is a schematic diagram of the voiceprint registration interface provided by an embodiment of the present application. Here, the terminal displays the voiceprint registration interface, and within the voiceprint registration interface, it displays a voice collection control 61, a voice collection reference text 62, and a voice file upload control 63. Here, the voice file upload control 63 includes a file drag and drop upload function area 631 and a file selection upload area 632.

[0075] In some embodiments, the target account belongs to a conference management object among multiple conference objects, and the terminal can display a conference object addition control for the online conference; in response to the triggering operation of the conference management object on the conference object addition control, the conference joining information is displayed; wherein, the conference joining information is used to respond to the joining instruction for the online conference triggered by the conference participant object based on the conference joining information, and join the online conference through a virtual login mode, and the conference participant object is a conference object other than the conference management object among the multiple conference objects; wherein, the virtual login mode is used to indicate that when a virtual login account of the conference participant object is received, the virtual login account is bound to the target account, and the object voiceprint of the conference participant object is registered in the object voiceprint library, so that the conference participant object can join the online conference based on the virtual login account.

[0076] Here, after entering an online conference, the conference management object can also add conference participants to the online conference. In an embodiment of the present application, the added conference participants join the online conference through a virtual login mode. Specifically, the terminal of the conference management object can display a conference object addition control for the online conference. For example, the terminal can display a conference object addition control in the object management interface of the online conference; when a trigger operation for the conference object addition control is received, the conference joining information is displayed.

[0077] In actual applications, the conference joining information can be a conference joining graphic code (such as a QR code), a conference joining link, a conference joining password, etc. In this way, after displaying the conference joining information, the terminal can send the conference joining information to the target terminals of the conference participants respectively, so that the conference participants can join the online conference based on the conference joining information displayed by the target terminals; of course, after displaying the conference joining information, the terminal may not send the conference joining information to the target terminals of the conference participants, but instead the conference participants can operate on the terminal to join the online conference based on the conference joining information displayed by the terminal. At this time, if there are multiple conference participants, the corresponding conference joining information can be provided to each conference participant by triggering the conference object adding control; or a conference joining information can be provided to multiple conference participants by only triggering the conference object adding control once. When each conference participant operates based on the conference joining information, he or she can identify his or her own identity, such as entering his or her own name. For example, when the conference joining information is a conference joining graphic code, if the terminal does not send the conference joining graphic code to the target terminal of the conference participant, regardless of whether there is one or multiple conference participants, the terminal can only trigger the trigger operation of adding controls for the conference object once, and display a conference joining graphic code. Multiple conference participants can be added to the online conference through the conference joining graphic code. Each conference participant can join the online conference by scanning the graphic code. In order to identify the individual identity of the conference participant, the conference participant can enter the personal name and other identification after scanning the graphic code and then join the online meeting.

[0078] In an embodiment of the present application, when a conference participant joins an online conference based on conference joining information, the conference participant joins the online conference through a virtual login mode. The virtual login mode is used to indicate that when a virtual login account of the conference participant is received, the virtual login account is bound to the target account, and the object voiceprint of the conference participant is registered in the object voiceprint library, so that the conference participant joins the online conference based on the virtual login account. Specifically, the target terminal of the conference participant responds to the joining instruction for the online conference triggered by the conference participant based on the above conference joining information, displays the virtual login interface of the online conference; based on the virtual login interface, receives the virtual login account for the online conference; in response to the confirmation operation for the virtual login account, binds the virtual login account to the target account for logging into the online conference, and displays the voiceprint registration interface of the online conference; based on the voiceprint registration interface, receives the object voice of the conference participant; in response to the confirmation operation for the object voice, adds the voiceprint of the object voice as the object voiceprint of the conference participant to the object voiceprint library of the online conference, so that the conference participant joins the online conference based on the virtual login account. In this way, the virtual login of the conference participant is completed.

[0079] In actual application, the above-mentioned joining instruction can be received in the following ways: when the meeting joining information is a meeting joining graphic code, the joining instruction is received in response to a scanning operation on the meeting joining graphic code; when the meeting joining information is a meeting joining link, the joining instruction is received in response to an access operation on the meeting joining link; and when the meeting joining information is a meeting joining password, the joining instruction is received in response to an identification operation on the meeting joining password. For example, the graphic code can be a QR code, barcode, etc., and the conference participant can trigger a join instruction by scanning the graphic code using a personal terminal; the conference join link can be sent by the terminal of the conference management object to the personal terminal of the conference participant, and when the personal terminal of the conference participant receives an access operation (such as a click operation) for the conference join link, it receives a join instruction; the conference join password can be sent by the terminal of the conference management object to the personal terminal of the conference participant, and when the personal terminal of the conference participant receives a copy operation for the conference join password and, when the conference join password has been copied, starts a client that supports online conferences, the client can automatically perform an identification operation for the conference join password, and thus receive a join instruction in response to the identification operation for the conference join password. In this way, joining an online conference can be achieved in a variety of ways, and users can choose the appropriate method to use according to their needs, enriching the applicable scenarios of joining online conferences.

[0080] In actual applications, the above-mentioned virtual login interface can allow users to enter a virtual login account. For example, the virtual login account can be the mobile phone number of the registered client (i.e., the client that supports online meetings), and the virtual login is achieved through mobile phone number verification (i.e., mobile phone verification code). If the mobile phone number is not registered with the client, it can be registered first, and then a virtual login can be performed. For example, the virtual login account can also be the client account generated by registering the client, and the virtual login is achieved by entering the client account and the corresponding account password. The voiceprint registration interface is used for meeting participants to upload their own object voice, thereby registering the object voiceprint of the meeting participant in the object voiceprint library of the online meeting. The voiceprint registration interface can be seen in Figure 5. For example, the personal terminal of the conference participant can display a voice collection control and a voice collection reference text in the voiceprint registration interface, so that based on the voice collection control, the object voice of the conference participant reading the voice collection reference text is received; for example, the personal terminal of the conference participant can display a voice file upload control in the voiceprint registration interface, so that based on the voice file upload control, the voice file of the conference participant uploaded is received, and in response to the confirmation operation on the voice file, the voice included in the voice file is used as the object voice of the conference participant.

[0081] After receiving the participant's voice, the voiceprint of the participant's voice is added to the online conference's voiceprint database in response to a confirmation operation. This allows the participant to join the online conference using a virtual login account. When a participant speaks in the online conference, the participant's voiceprint can be used to identify the participant speaking.

[0082] In actual applications, the virtual login account for joining the online meeting can be understood as a virtual participant, and the virtual participant corresponds to the meeting participant object corresponding to the virtual login account.

[0083] As an example, see FIG6 , which is a schematic diagram of the display of conference joining information provided by an embodiment of the present application. Here, the terminal (conference management object side) displays a conference object adding control "Add Virtual Participant" for the online conference in the conference member management interface, as shown in FIG6 (1); in response to the triggering operation of the conference object adding control "Add Virtual Participant", the conference joining information is displayed, and the conference joining information is a conference joining graphic code (QR code), as shown in FIG6 (2).

[0084] Continuing, refer to FIG7 , which is a flow chart of virtual login provided by an embodiment of the present application. Here, the meeting participant can scan the displayed meeting joining graphic code through the target terminal held by the meeting participant. In response to the scanning operation for the meeting joining graphic code, the target terminal receives the joining instruction for the online meeting. At this time, the virtual login interface is displayed, as shown in FIG7 (1) - FIG7 (2). The virtual login interface allows the meeting participant to enter the virtual login account (i.e., mobile phone number) and the corresponding mobile phone verification code. In response to the confirmation operation for the virtual login account triggered by the “OK” control in the virtual login interface, the virtual login account is bound to the target account for logging into the online meeting, and the voiceprint registration interface of the online meeting is displayed, as shown in FIG7 (3). Based on the voiceprint registration interface, the target voice of the meeting participant can be received. In response to the confirmation operation for the target voice triggered by the “OK” control in the voiceprint registration interface, the voiceprint of the target voice is added as the target voiceprint of the meeting participant to the target voiceprint library of the online meeting, so that the meeting participant can join the online meeting based on the virtual login account. In this way, the virtual login of the meeting participant is completed.

[0085] In some embodiments, a terminal can enable virtual login mode by: displaying a virtual login switch for an online meeting; and, in response to an instruction to enable the virtual login switch, controlling the online meeting to be in virtual login mode. Accordingly, when the online meeting is in virtual login mode, the terminal can display a control for adding meeting objects for the online meeting. As an example, referring to FIG4 , the virtual login switch "Virtual Login" can be displayed on the meeting reservation interface. When making an online meeting reservation, the virtual login switch can be turned on, thereby placing the online meeting in virtual login mode. Of course, the virtual login switch can also be displayed on the meeting interface or meeting management interface of the online meeting after entering the online meeting, without limitation. Thus, when the terminal controls the online meeting to be in virtual login mode, the terminal can display a control for adding meeting objects for the online meeting, allowing meeting participants to add meeting objects through virtual login mode, allowing meeting participants to join the online meeting through virtual login mode.

[0086] In some embodiments, a participant joins an online meeting through a virtual login mode, and the terminal can remove the participant's virtual login account in the following manner: displaying an account removal control for the virtual login account; and controlling the virtual login account to exit the online meeting in response to a triggering operation on the account removal control.

[0087] Here, the conference participant objects of the online conference (referring to the conference objects other than the conference management object in the multiple conference objects) can join the online conference through the virtual login mode. In this way, the target account is bound to the virtual login account of each participating conference object. In actual application, the conference management object can remove the virtual login account bound to the target account. For example, see Figure 8, which is a flowchart of removing the virtual login account provided by the embodiment of the present application. Here, the terminal displays the account information of the target account, and displays the account information of the virtual login accounts 1-2 bound to the target account in the associated area of ​​the account information of the target account. At the same time, the account removal control "Remove" of each virtual login account is displayed, as shown in Figure 8 (1); in response to the trigger operation of the account removal control "Remove" for the virtual login account 1, the virtual login account 1 is controlled to exit the online conference. At this time, the remaining virtual login account 2 is in the online conference, as shown in Figure 8 (2). In this way, the conference management object can manage the virtual login accounts that join the online conference as needed, increasing the management flexibility of the online conference.

[0088] In some embodiments, a participant joins an online meeting through a virtual login mode, and the terminal can exit the online meeting in the following manner: in response to a meeting exit operation for a target account, control the target account to exit the online meeting, and control the virtual login account bound to the target account to exit the online meeting.

[0089] Here, the participating meeting objects of the online meeting (referring to the meeting objects other than the meeting management object in the multiple meeting objects) can join the online meeting through the virtual login mode. In this way, the target account is bound to the virtual login account of each participating meeting object. Since the virtual login account joins the online meeting by binding the target account, when the target account exits the online meeting, the virtual login account bound to the target account also automatically exits the online meeting. That is, when the terminal receives the meeting exit operation for the target account, it controls the target account to exit the online meeting and controls the virtual login account bound to the target account to exit the online meeting.

[0090] In some embodiments, the online conference has an object voiceprint library, which includes the object voiceprint of each conference object among multiple conference objects; the terminal can determine the target conference object who is speaking in the following manner: perform voice detection on the online conference, and when the target voice is detected, obtain the voice voiceprint of the target voice; match the voice voiceprint with each object voiceprint respectively to obtain a matching result; when the matching result indicates that there is a target object voiceprint that matches the voice voiceprint, it is determined that the conference object with the target object voiceprint is speaking, wherein the conference object with the target object voiceprint is the target conference object.

[0091] Here, based on the above embodiment, when a conference object joins an online conference, it will register its own object voiceprint to the object voiceprint library of the online conference. In this way, the object voiceprint library includes the object voiceprint of each conference object among the multiple conference objects joining the online conference. Based on this, during the online conference, the terminal can perform voice detection on the online conference, that is, detect whether someone is speaking. When the terminal detects the target voice, it identifies the voice voiceprint of the target voice; then the voice voiceprint is matched with each object voiceprint for similarity to obtain a matching result. The matching result is used to indicate whether there is a target object voiceprint that matches the voice voiceprint (that is, an object voiceprint whose similarity reaches a similarity threshold); when the matching result indicates that there is a target object voiceprint that matches the voice voiceprint, it is determined that the conference object with the target object voiceprint is speaking. Here, the conference object of the target object voiceprint is the target conference object. At this time, speech indication information for instructing the target conference object to speak is displayed. In this way, the target conference object who is currently speaking is determined through voiceprint matching. Based on this, different speaking indication information can be displayed when different conference objects speak, so that the speaking indication information can clearly identify which conference object among multiple conference objects is speaking, thereby improving the meeting efficiency and meeting experience of the online meeting.

[0092] In some embodiments, each of the multiple conference objects corresponds to a speech control button; the terminal can determine the target conference object who is speaking in the following manner: detect whether the speech control button corresponding to each conference object is in a pressed state to obtain a detection result; when the detection result indicates that the target speech control button is in a pressed state, it is determined that the conference object corresponding to the target speech control button is speaking, wherein the conference object corresponding to the target speech control button is the target conference object.

[0093] Here, each conference participant can also be assigned a corresponding speech control button, which can be a physical device. When a conference participant speaks, they can press their corresponding speech control button, which is then in a pressed state. Based on this, the terminal can detect whether the speech control button corresponding to each conference participant is in a pressed state and obtain a detection result. When the detection result indicates that the target speech control button is in a pressed state, it is determined that the conference participant corresponding to the target speech control button is currently speaking. Here, the conference participant corresponding to the target speech control button is the target conference participant, and speech indication information indicating that the target conference participant is speaking is displayed. In this way, by configuring the speech control button and detecting whether the speech control button is in a pressed state, the target conference participant currently speaking is accurately determined. Based on this, different speech indication information can be displayed when different conference participants speak. This clearly identifies which conference participant is speaking among multiple conference participants through the speech indication information, thereby improving the efficiency and meeting experience of online meetings.

[0094] In some embodiments, the terminal can determine the target conference object who is speaking in the following manner: perform voice detection on the online conference, and when the target voice is detected, identify the target sound direction of the target voice; obtain the object sound direction of each conference object among multiple conference objects, and match the target sound direction with the sound direction of each object respectively to obtain a matching result; when the matching result indicates that there is a target object sound direction that matches the target sound direction, determine that the conference object corresponding to the target object sound direction is speaking, wherein the conference object corresponding to the target object sound direction is the target conference object.

[0095] Here, the target conference object who is speaking can also be determined by identifying the direction of sound. During the online conference, the terminal can perform voice detection on the online conference, that is, detect whether someone is speaking. When the terminal detects the target voice, it identifies the target sound direction of the target voice; then obtains the object sound direction of each conference object among the multiple conference objects, and thus performs similarity matching on the target sound direction with the sound direction of each object to obtain a matching result. The matching result is used to characterize whether there is a target object sound direction that matches the target sound direction (that is, the object sound direction whose similarity reaches the similarity threshold); when the matching result characterizes the existence of a target object sound direction that matches the target sound direction, it is determined that the conference object corresponding to the target object sound direction is speaking. Here, the conference object corresponding to the target object sound direction is the target conference object. At this time, the speech indication information for instructing the target conference object to speak is displayed. In this way, by detecting the direction of the target voice, the target conference object who is currently speaking is determined. Based on this, different speech indication information can be displayed when different conference objects speak, so that the speech indication information can clearly identify which conference object among multiple conference objects is speaking, thereby improving the meeting efficiency and meeting experience of the online meeting.

[0096] In some embodiments, before displaying the conference interface of an online conference logged in through a target account, the terminal may also add the object voiceprint to the object voiceprint library in the following manner: displaying a voiceprint adding control; in response to a triggering operation on the voiceprint adding control, displaying a voiceprint registration interface for the online conference; based on the voiceprint registration interface, receiving the object voice of the conference object and the object identification of the conference object; in response to a confirmation operation on the object voice, using the voiceprint of the object voice as the object voiceprint of the conference object, and associating the object voiceprint and the object identification and adding them to the object voiceprint library.

[0097] Here, a voiceprint addition control can be provided for adding a subject voiceprint. Through this voiceprint addition control, participants in the online meeting can individually add their subject voiceprints. In response to a triggering operation on the voiceprint addition control, the online meeting voiceprint registration interface is displayed. This voiceprint registration interface can be seen in Figure 5. However, this voiceprint registration interface also includes an object ID addition control, through which the subject ID of the subject whose subject voice is currently being input can be added. Based on this, the subject voice and subject ID of the subject can be received through the voiceprint registration interface. When a confirmation operation is received for the subject voice, the voiceprint of the subject voice is used as the subject voiceprint of the subject, and the subject voiceprint and subject ID are associated and added to the subject voiceprint library.

[0098] Step 102: When any target conference object among the multiple conference objects speaks, speech instruction information for instructing the target conference object to speak is displayed in the conference interface.

[0099] Here, for a conference scenario in which multiple objects participate in an online conference through one conference account at the same conference venue, when any target conference object among multiple conference objects speaks, speech indication information for indicating that the target conference object is speaking is displayed in the conference interface. In this way, different speech indication information can be displayed when different conference objects speak, so as to clearly identify which conference object among the multiple conference objects is speaking through the speech indication information. For example, refer to Figure 9, which is a display diagram of the speech indication information provided by an embodiment of the present application. Here, in the conference interface, the speech indication information "Speaking: Conference Object 1 (virtual participant)" is displayed to indicate that "Conference Object 1" is speaking. In actual applications, the speech indication information can be text information (such as conference object 1 is speaking), image information (either static or dynamic, such as displaying a dynamic image of "microphone" in the associated area of ​​the identification information of conference object 1 to indicate that conference object 1 is speaking), and so on.

[0100] In some embodiments, the terminal can also send a notification message of the target conference object's speech to the target terminal logged in to the first account; wherein the first account is used for conference objects at target conference venues different from the conference venue to participate in the online conference; the notification message is used to notify the target terminal to display speech instruction information. Here, the notification message of the target conference object's speech can be sent to the target terminal of the first account, that is, the terminal at other conference venues participating in the online conference. At this time, the target terminal displays the speech instruction information for instructing the target conference object to speak. In this way, the synchronization of the speech instruction information at the terminals of each conference venue of the online conference is achieved, so that each user participating in the online conference can understand who the conference object is currently speaking, thereby improving the meeting efficiency and meeting experience.

[0101] In some embodiments, the terminal may display speech indication information for instructing the target conference object to speak in the conference interface in the following manner: in the conference interface, the target object identifier of the target conference object is displayed, and in the associated area of ​​the target object identifier, speech indication information for instructing the target conference object to speak is displayed.

[0102] Here, the terminal can display the target object identifier of the target conference object in the conference interface, thereby displaying the speech indication information for instructing the target conference object to speak in the associated area of ​​the target object identifier. For example, refer to Figure 10, which is a display schematic diagram of the speech indication information provided by an embodiment of the present application. Here, in the conference interface, the object identifiers of each conference object (conference object 1-2) are displayed, wherein the target conference object is conference object 2. At this time, in the associated area of ​​the target object identifier of conference object 2, the speech indication information for instructing conference object 2 to speak is displayed, and the speech indication information is dynamic image information, that is, a dynamic image of "microphone".

[0103] In some embodiments, each conference object has a corresponding object meeting minutes. The terminal can display the meeting minutes of the online meeting in the following manner: in response to the meeting minutes viewing operation for the online meeting, the following processing is performed for each conference object: the object meeting minutes of the conference object is displayed, and the minutes indication information for indicating that the object meeting minutes belong to the conference object is displayed.

[0104] Here, since any target conference object among multiple conference objects speaks, speech indication information for indicating that the target conference object is speaking can be displayed, that is, in an embodiment of the present application, when any conference object speaks, it can be clear which conference object the speech is from, so when taking meeting minutes, the meeting minutes and the corresponding speaking object can be associated. In this way, when viewing the minutes of an online meeting, the object meeting minutes of the conference object can be displayed for each conference object, and the minutes indication information for indicating that the object meeting minutes belongs to the conference object can be displayed. For example, see Figure 11, which is a display diagram of the meeting minutes provided by an embodiment of the present application. Here, object meeting minutes 1-2 of conference objects 1-2 are displayed, and for each object meeting minutes, minutes indication information for indicating that the object meeting minutes belongs to the conference object is displayed. For example, for object meeting minutes 1, corresponding minutes indication information "conference object 1" is displayed, and for object meeting minutes 2, corresponding minutes indication information "conference object 2" is displayed. Here, the minutes indication information is the identifier of the conference object. In this way, when viewing the meeting minutes, you can also understand which meeting object the meeting minutes specifically belong to, which improves the efficiency of organizing and viewing the meeting minutes, thereby improving the experience of organizing the meeting minutes after the online meeting.

[0105] In some embodiments, the terminal can join the target online conference in the following manner: in response to a conference joining instruction for the target online conference triggered by the target object based on the conference joining information of the target online conference, displaying a virtual login interface of the target online conference; based on the virtual login interface, receiving a virtual login account for the target online conference; in response to a confirmation operation on the virtual login account, binding the virtual login account to the real login account of the target online conference, and displaying a voiceprint registration interface of the target online conference; based on the voiceprint registration interface, receiving the target object's object voice; in response to a confirmation operation on the object voice, adding the voiceprint of the object voice as the target object's object voiceprint to the object voiceprint library of the target online conference, so that the target object joins the target online conference based on the virtual login account.

[0106] Here, for a target online conference that is different from the above-mentioned online conference, the target object (i.e., the conference management object of the above-mentioned online conference) can join the target online conference as a conference participant object, i.e., the target object joins the target online conference through a virtual login mode. In some embodiments, the terminal can receive a conference joining instruction for the target online conference in one of the following ways: when the conference joining information of the target online conference is a conference joining graphic code, the conference joining instruction is received in response to a scanning operation on the conference joining graphic code; when the conference joining information of the target online conference is a conference joining link, the conference joining instruction is received in response to an access operation on the conference joining link; and when the conference joining information of the target online conference is a conference joining password, the conference joining instruction is received in response to an identification operation on the conference joining password. For example, the graphic code can be a QR code, barcode, etc., and the target object can trigger a join instruction by scanning the graphic code using a personal terminal; the conference join link can be sent from the terminal of the conference management object of the target online conference to the personal terminal of the target object, and when the personal terminal of the target object receives an access operation (such as a click operation) for the conference join link, it receives a join instruction; the conference join password can be sent from the terminal of the conference management object of the target online conference to the personal terminal of the target object, and when the personal terminal of the target object receives a copy operation for the conference join password and starts a client that supports online conferences when the conference join password has been copied, the client can automatically perform an identification operation for the conference join password, and thus receive a join instruction in response to the identification operation for the conference join password. In this way, joining an online conference can be achieved in a variety of ways, and users can choose the appropriate method to use according to their needs, enriching the applicable scenarios of joining online conferences.

[0107] Continuing, the target subject's personal terminal responds to the conference join instruction by displaying a virtual login interface for the target online conference. This virtual login interface allows the target subject to enter a virtual login account. For example, the virtual login account can be the mobile phone number of a registered client (i.e., a client that supports online conferences). Virtual login is achieved through mobile phone number verification (i.e., a mobile phone verification code). If the mobile phone number is not registered with the client, the target subject can first register and then perform a virtual login. For example, the virtual login account can also be a client account generated by registering the client. Virtual login is achieved by entering the client account and the corresponding account password. After logging into the virtual login account, in response to a confirmation operation on the virtual login account, the virtual login account is bound to the real login account of the target online conference, and a voiceprint registration interface for the target online conference is displayed. This voiceprint registration interface is used for the target subject to upload their own object voice, thereby registering the target subject's object voiceprint in the object voiceprint library of the target online conference. This voiceprint registration interface can be seen in Figure 5. After receiving the target subject's object voice, in response to a confirmation operation on the object voice, the voiceprint of the target voice is added as the target subject's object voiceprint to the object voiceprint library of the target online conference.

[0108] It should be noted that the trigger operation mentioned in the embodiments of the present application can be any operation that can trigger the corresponding function, such as single-click, double-click, drag, etc. The controls mentioned in the embodiments of the present application can be equivalent to function items and can have various presentation forms, such as graphic buttons, progress bars, menus, lists, etc. The embodiments of the present application do not impose any restrictions on this.

[0109] By applying the above-mentioned embodiment of the present application, when logging into an online conference through a target account, and the target account is used for multiple conference participants in a conference venue to participate in the online conference, when any of the multiple conference participants speaks, speech instruction information for instructing the target conference participant to speak can be displayed in the conference interface. In this way, for a conference scenario where multiple participants participate in an online conference through a single conference account in the same conference venue, different speech instruction information can be displayed when different conference participants speak, so that the speech instruction information clearly identifies which conference participant is speaking among the multiple conference participants, thereby improving the efficiency and conference experience of the online conference.

[0110] The following will illustrate an exemplary application of the embodiment of the present application in an actual application scenario. In the related art, for conference scenarios where multiple people participate in online conferences in the same conference room, the following solution is often used: only one conference account / device is logged in, and all participants in the conference room speak through the microphone of the conference account / device. However, there are the following problems in online conferences: since the online conference system can only identify one conference account (the conference account of the current login person or the conference account of the conference hardware device), the speeches of all participants in the conference room are identified as the speeches of the conference account, and the identified meeting minutes are also considered to be the minutes of the conference account, and it is impossible to associate the speeches and meeting minutes with the real participants; at the same time, other participants in the online conference who are not in the same conference room cannot determine who the current speaker is, which greatly affects the efficiency and atmosphere of the online conference.

[0111] Based on this, an embodiment of the present application provides a method for processing an online conference to at least solve the above-mentioned problems. In an embodiment of the present application, for a conference scenario in which multiple people participate in an online conference in the same conference room and only log in to one conference account / device, 1) through the virtual login of all participants to the online conference and speaker recognition technology, the online conference system (i.e., the online conference background) can automatically identify the current speaker. 2) The direction of the sound is identified through the microphone of the online conference system, so that the online conference system can identify the current speaker based on the direction of the sound. 3) A physical button is assigned to each participant, and the participant can press the physical button when speaking, so that the online conference system can identify the current speaker through the physical button. In this way, different speakers in the online conference can be identified, solving the problem of identifying each current speaker and associating the meeting minutes with the real speaker.

[0112] Next, a solution for 1) enabling the online conference system to automatically identify the current speaker through virtual login of all participants to the online conference and speaker recognition technology is described in detail.

[0113] First, the online conference processing method provided in the embodiment of the present application is described from the product level.

[0114] (1) The conference management object (e.g., conference host or co-host) can choose whether to enable virtual login in the conference reservation interface, as shown in Figure 4.

[0115] (2) When the conference management object chooses to enable virtual login, the conference management object can register its voiceprint by reading a few short sentences or uploading a piece of its own voice to the online conference system when logging into the online conference, as shown in Figure 5.

[0116] (3) As shown in Figure 6, the conference management object can add virtual participants (corresponding to the conference participant object) in the member management interface. After the conference management object clicks to add a virtual participant, the online conference system automatically generates a QR code and displays it under the name of the conference management object. Since the virtual participant needs to be under the name of the conference management object, each conference room should have at least one conference management object.

[0117] (4) When a virtual participant virtually logs into a scheduled online conference, the virtual participant can use a personal terminal (such as a mobile phone) to scan the QR code displayed under the name of the conference management object. At this time, the virtual participant's personal terminal displays the content shown in (2) of Figure 7. The virtual participant can enter his or her mobile phone number to obtain a verification code, and then complete the virtual login of the virtual participant after entering the verification code, without having to enter the client login password of the online conference client.

[0118] (5) If the entered mobile phone number has not been registered with the online conference client, the online conference system will remind the user to register the online conference client, otherwise the virtual login cannot be completed, as shown in Figure 12, which is a registration diagram of the online conference client provided in an embodiment of the present application.

[0119] (6) When a virtual participant logs in virtually, he or she also needs to read a few short sentences on his or her personal mobile phone or upload a piece of his or her own voice to the online conference system to register the voiceprint of the corresponding virtual participant, as shown in (3) in Figure 7.

[0120] (7) As shown in (1) of Figure 8, after the virtual login is completed, the online conference system automatically identifies the name, company, position, and other information of the virtual participant through the mobile phone number and displays the obtained information in the member management interface. The virtual participant can perform the operation of exiting the meeting, but cannot perform other operations such as turning on the microphone / camera and starting screen sharing. Operations such as turning on the microphone / camera and starting screen sharing can be performed by the conference management object.

[0121] (8) During the online meeting, the online meeting system uses the registered voiceprint to identify the current speaker of the online meeting and marks the current speaker on the meeting interface so that other participants can know which participant is speaking, as shown in Figures 9 and 10; at the same time, the meeting minutes are recorded and associated with the real speaker of the meeting minutes, as shown in Figure 11.

[0122] (9) Since online conferences are held for participants from multiple different conference venues, the online conference can include conference management objects corresponding to each conference venue. Participants from different conference venues virtually log in to the online conference through the conference management objects of the corresponding conference venues. Therefore, the conference management object can remove the virtual participants under its own name from the online conference, but cannot remove the virtual participants under other conference management objects from the online conference, as shown in Figure 8.

[0123] (10) When the conference management object exits the online conference, the virtual participants under its name will also automatically exit the online conference.

[0124] Then, the online conference processing method provided in the embodiment of the present application is described from a technical perspective.

[0125] See Figure 13, which is a flow chart of the online conference processing method provided by an embodiment of the present application, including: a voice recognition module is mainly responsible for storing (registering) the voiceprint information of participants (i.e., conference objects) and identifying the current speaker through the stored voiceprint information; a conference management module is mainly responsible for the conference minutes after identifying the current speaker and the user interface display of the online conference system; a virtual participant management module is mainly responsible for the login of virtual participants and the management of virtual participants by the conference management object (i.e., the conference host), etc. This will be explained in detail below.

[0126] (1) Virtual Participant Management Module. The virtual participant management module mainly implements the login of virtual participants and the binding of virtual participants to conference management objects. See Figure 14, which is a schematic diagram of the processing flow of the virtual participant management module provided in an embodiment of the present application, including:

[0127] 1. The conference management object clicks "Add Virtual Participant". 2. The online conference system automatically generates a QR code for virtual login. 3. The virtual participant scans the QR code. 4. The virtual participant fills in the mobile phone number. 5. The online conference system determines whether the virtual participant's mobile phone number is registered with the online conference client. If so, execute 7, if not, execute 6. 6. Remind the virtual participant to register. 7. Automatically obtain the name, position and other information of the virtual participant (for the display of the conference system interface, meeting minutes and other scenarios), and bind the virtual participant to the conference management object. In this way, after the virtual login, the virtual participant forms a binding relationship (many to one) with the generator of the QR code (i.e., the conference management object). The binding relationship can be shown in Figure 15 (Figure 15 is a schematic diagram of the binding relationship between the conference management object and the virtual participant provided in the embodiment of the present application), and the conference management object can only operate on the virtual participant to which it is bound. 8. The conference management object clicks to remove a virtual participant. 9. The online conference system determines whether the virtual participant is bound to the conference management object. If so, proceed to step 11. If not, proceed to step 10. 10. If not bound, removal fails. 11. If bound, remove the virtual participant.

[0128] It should be noted that the reason they are called virtual participants is because they do not actually log in to the online conference system independently using their online conference account and password. Instead, they log in virtually by scanning a QR code and binding to a conference management object. No password is required during virtual login, and participants can only exit the online conference; they cannot perform operations such as turning on or off the microphone, sharing the screen, or turning on or off the camera. For the online conference system, only one person (the conference management object) is actually logged in.

[0129] (2) Voice recognition module. The voice recognition module mainly includes two functions: voiceprint registration and speaker identification. See Figure 16, which is a schematic diagram of the processing flow of the voice recognition module provided in the embodiment of the present application, including: when registering the voiceprint, a1) obtaining the voice of the participant AN; a2) extracting voiceprint features from the voice of the participant AN respectively; a3) adding the extracted voiceprint features to the voiceprint feature library. When identifying the speaker, b1) obtaining the voice of the current speaker; b2) extracting voiceprint features from the voice of the current speaker; b3) matching the voiceprint features of the speaker's voice with the voiceprint features in the voiceprint feature library to obtain a matching result; b4) confirming the speaker ID based on the matching result.

[0130] Voiceprint features are a type of biometric feature that is extracted when a speaker speaks. They can be used as a representation and identification of the speaker, and are a general term for voice features that can distinguish the speaker from other people, as well as voice models established based on these features or parameters. Voiceprint recognition feature parameters may include Linear Predictive Coding (LPC) features and Mel Frequency Cepstrum Coefficient (MFCC) features. Referring to Figure 17, Figure 17 is a schematic diagram of the storage of voiceprint features provided in an embodiment of the present application. After the online conference system extracts the voiceprint features of the participants, it will be stored in the format shown in Figure 17. When a participant in the same conference room speaks, the online conference system will extract the voiceprint features of the speaker and cross-search them in the above-mentioned voiceprint feature library to see if they match the voiceprint features in the voiceprint feature library. If the match is successful, it means that the current speaker has been identified. After the speaker is identified, the speaker's relevant information (such as name, position information, etc.) can be used in the conference management module to identify the speaker.

[0131] (3) Conference management module. The conference management module mainly identifies the virtual participant who is currently speaking, and then marks the virtual participant who is currently speaking on the conference system interface, conference minutes interface and other interfaces with participant identification. For example: a) Participant interface, including the participant main interface and the participant list interface, displays the name, position information, etc. of the virtual participant. b) Current speaker interface, including the participant main interface and the participant list interface, displays the identification of the virtual participant who is speaking (microphone of the target color (such as green)). c) Meeting minutes interface, displays the name of the virtual participant and the content of the meeting minutes. In actual applications, subsequent interfaces that need to identify the current speaker can use similar methods to identify the virtual participant who is currently speaking.

[0132] By applying the above-mentioned embodiments of the present application, in a conference scenario where multiple people participate in an online conference in the same conference room and only log in to one conference account / device, when any target participant in the online conference speaks, an identifier indicating that the target participant is speaking is displayed to identify the different current speakers in the online conference; at the same time, through speaker recognition technology, the online conference system can automatically identify the current speaker, solving the problem of associating meeting minutes with the real speaker.

[0133] The following continues to describe an exemplary structure of the online conference processing device 555 provided in an embodiment of the present application implemented as a software module. In some embodiments, as shown in Figure 2, the software module stored in the online conference processing device 555 of the memory 550 may include: a first display module 5551, configured to display a conference interface of an online conference logged in through a target account, and the target account is used for multiple conference objects in a conference venue to participate in the online conference; a second display module 5552, configured to display speech indication information for instructing the target conference object to speak in the conference interface when any target conference object among the multiple conference objects speaks.

[0134] In some embodiments, the first display module 5551 is further configured to display a meeting reservation interface before displaying the meeting interface of the online meeting logged in through a target account; based on the meeting reservation interface, receive meeting setting information for the online meeting; and reserve the online meeting in response to a confirmation operation on the meeting setting information.

[0135] In some embodiments, the online conference has an object voiceprint library, which includes the object voiceprint of each of the multiple conference objects; the second display module 5552 is also configured to perform voice detection on the online conference before displaying the speech indication information for instructing the target conference object to speak in the conference interface when any target conference object among the multiple conference objects speaks, and when the target voice is detected, obtain the voice voiceprint of the target voice; match the voice voiceprint with each of the object voiceprints respectively to obtain a matching result; when the matching result indicates that there is a target object voiceprint that matches the voice voiceprint, determine that the conference object with the target object voiceprint is speaking, wherein the conference object with the target object voiceprint is the target conference object.

[0136] In some embodiments, the target account belongs to a conference management object among the multiple conference objects. The first display module 5551 is further configured to, before displaying the conference interface of the online conference logged in through a target account, respond to the first entry instruction of the conference management object for the online conference, display the voiceprint registration interface of the online conference; based on the voiceprint registration interface, receive the object voice of the conference management object; and in response to the confirmation operation for the object voice, add the voiceprint of the object voice as the object voiceprint of the conference management object to the object voiceprint library.

[0137] In some embodiments, the first display module 5551 is further configured to display a voice collection control and a voice collection reference text in the voiceprint registration interface; the first display module 5551 is further configured to receive the object voice of the conference management object reading the voice collection reference text based on the voice collection control.

[0138] In some embodiments, the first display module 5551 is further configured to display a voice file upload control in the voiceprint registration interface; the first display module 5551 is further configured to receive the uploaded voice file of the conference management object based on the voice file upload control; and in response to a confirmation operation on the voice file, use the voice included in the voice file as the object voice.

[0139] In some embodiments, the target account belongs to a conference management object among the multiple conference objects, and the first display module 5551 is further configured to display a conference object adding control for the online conference; and display conference joining information in response to a triggering operation of the conference management object on the conference object adding control; wherein the conference joining information is used to respond to a joining instruction for the online conference triggered by a conference participant object based on the conference joining information, and join the online conference through a virtual login mode, and the conference participant object is a conference object other than the conference management object among the multiple conference objects; wherein the virtual login mode is used to indicate that when a virtual login account of the conference participant object is received, the virtual login account is bound to the target account, and the object voiceprint of the conference participant object is registered to the object voiceprint library, so that the conference participant object can join the online conference based on the virtual login account.

[0140] In some embodiments, the first display module 5551 is further configured to display a virtual login switch of the online meeting; in response to an on instruction for the virtual login switch, the online meeting is controlled to be in the virtual login mode; the first display module 5551 is further configured to display a conference object addition control of the online meeting when the online meeting is in the virtual login mode.

[0141] In some embodiments, the conference participant joins the online conference through the virtual login mode, and the first display module 5551 is further configured to display an account removal control of the virtual login account; in response to a triggering operation on the account removal control, the virtual login account is controlled to exit the online conference.

[0142] In some embodiments, the conference participant joins the online conference through the virtual login mode, and the first display module 5551 is further configured to control the target account to exit the online conference in response to a conference exit operation for the target account, and control the virtual login account bound to the target account to exit the online conference.

[0143] In some embodiments, the first display module 5551 is further configured to display a voiceprint adding control before displaying the conference interface of the online conference logged in through a target account; in response to a triggering operation on the voiceprint adding control, display the voiceprint registration interface of the online conference; based on the voiceprint registration interface, receive the object voice of the conference object and the object identification of the conference object; in response to a confirmation operation on the object voice, use the voiceprint of the object voice as the object voiceprint of the conference object, and associate the object voiceprint and the object identification to add them to the object voiceprint library.

[0144] In some embodiments, each of the multiple conference objects corresponds to a speech control button; the second display module 5552 is also configured to detect whether the speech control button corresponding to each of the conference objects is in a pressed state before displaying the speech indication information for instructing the target conference object to speak in the conference interface when any target conference object among the multiple conference objects is speaking, and obtain a detection result; when the detection result indicates that the target speech control button is in a pressed state, it is determined that the conference object corresponding to the target speech control button is speaking, wherein the conference object corresponding to the target speech control button is the target conference object.

[0145] In some embodiments, the second display module 5552 is further configured to perform voice detection on the online conference before displaying the speech indication information for instructing the target conference object to speak in the conference interface when any target conference object among the multiple conference objects speaks, and identify the target sound direction of the target voice when the target voice is detected; obtain the object sound direction of each of the multiple conference objects, and match the target sound direction with each of the object sound directions to obtain a matching result; when the matching result indicates that there is a target object sound direction that matches the target sound direction, determine that the conference object corresponding to the target object sound direction is speaking, wherein the conference object corresponding to the target object sound direction is the target conference object.

[0146] In some embodiments, the second display module 5552 is further configured to display the target object identifier of the target conference object in the conference interface, and to display speech instruction information for instructing the target conference object to speak in the associated area of ​​the target object identifier.

[0147] In some embodiments, each of the conference objects has a corresponding object meeting minutes. The second display module 5552 is also configured to respond to a meeting minutes viewing operation for the online conference and perform the following processing for each of the conference objects: display the object meeting minutes of the conference object, and display minute indication information indicating that the object meeting minutes belong to the conference object.

[0148] In some embodiments, the second display module 5552 is further configured to send a notification message of the target conference object's speech to the target terminal logged in to the first account; wherein, the first account is used for conference objects at a target conference venue different from the conference venue to participate in the online conference; the notification message is used to notify the target terminal to display the speech instruction information.

[0149] In some embodiments, the first display module 5551 is further configured to, in response to a meeting joining instruction for the target online meeting triggered by the target object based on the meeting joining information of the target online meeting, display a virtual login interface of the target online meeting; based on the virtual login interface, receive a virtual login account for the target online meeting; in response to a confirmation operation on the virtual login account, bind the virtual login account to the real login account of the target online meeting, and display a voiceprint registration interface of the target online meeting; based on the voiceprint registration interface, receive the target object's object voice; in response to a confirmation operation on the object voice, add the voiceprint of the object voice as the target object's object voiceprint to the object voiceprint library of the target online meeting, so that the target object joins the target online meeting based on the virtual login account.

[0150] In some embodiments, the first display module 5551 is further configured to receive the meeting join instruction in one of the following ways: when the meeting join information is a meeting join graphic code, the meeting join instruction is received in response to a scanning operation on the meeting join graphic code; when the meeting join information is a meeting join link, the meeting join instruction is received in response to an access operation on the meeting join link; and when the meeting join information is a meeting join password, the meeting join instruction is received in response to an identification operation on the meeting join password.

[0151] By applying the above-mentioned embodiment of the present application, when logging into an online conference through a target account, and the target account is used for multiple conference participants in a conference venue to participate in the online conference, when any of the multiple conference participants speaks, speech instruction information for instructing the target conference participant to speak can be displayed in the conference interface. In this way, for a conference scenario where multiple participants participate in an online conference through a single conference account in the same conference venue, different speech instruction information can be displayed when different conference participants speak, so that the speech instruction information clearly identifies which conference participant is speaking among the multiple conference participants, thereby improving the efficiency and conference experience of the online conference.

[0152] The present application also provides a computer program product, which includes computer-executable instructions or a computer program stored in a computer-readable storage medium. A processor of an electronic device reads the computer-executable instructions or the computer program from the computer-readable storage medium and executes the computer-executable instructions or the computer program, causing the electronic device to perform the online conference processing method provided in the present application.

[0153] An embodiment of the present application also provides a computer-readable storage medium, which stores computer-executable instructions or a computer program. When the computer-executable instructions or the computer program are executed by a processor, the processor will execute the online conference processing method provided in the embodiment of the present application.

[0154] In some embodiments, the computer-readable storage medium may be a memory such as RAM, ROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or may be various devices including one or any combination of the above memories.

[0155] In some embodiments, computer-executable instructions may be in the form of a program, software, software module, script, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0156] As an example, computer-executable instructions may, but need not, correspond to a file in a file system, may be stored as part of a file that stores other programs or data, e.g., in one or more scripts in a HyperText Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple coordinating files (e.g., files storing one or more modules, subroutines, or code portions).

[0157] By way of example, computer-executable instructions may be deployed to be executed on one electronic device, or on multiple electronic devices located at one site, or on multiple electronic devices distributed across multiple sites and interconnected by a communication network.

[0158] The above description is merely an embodiment of the present application and is not intended to limit the scope of protection of the present application. Any modifications, equivalent replacements, and improvements made within the spirit and scope of the present application are included in the scope of protection of the present application.

Claims

1. A method for processing an online conference, applied to an electronic device, the method comprising: Displaying a conference interface of an online conference logged in by a target account, wherein the target account is used for multiple conference objects in a conference venue to participate in the online conference; When any target conference object among the multiple conference objects speaks, speech instruction information for instructing the target conference object to speak is displayed in the conference interface.

2. The method of claim 1, wherein: Before displaying the conference interface of the online conference logged in by a target account, the method further includes: Display the conference reservation interface; Based on the conference reservation interface, receiving conference setting information for the online conference; In response to a confirmation operation on the conference setting information, the online conference is scheduled.

3. The method according to any one of claims 1 to 2, wherein: The online conference has an object voiceprint library, and the object voiceprint library includes the object voiceprint of each of the multiple conference objects; When any target conference object among the multiple conference objects speaks, before displaying speech instruction information for instructing the target conference object to speak in the conference interface, the method further includes: Performing voice detection on the online conference, and when a target voice is detected, obtaining a voice print of the target voice; Matching the voice print with the voice prints of the objects to obtain matching results; When the matching result indicates that there is a target object voiceprint matching the speech voiceprint, it is determined that the conference object having the target object voiceprint is speaking, wherein the conference object having the target object voiceprint is the target conference object.

4. The method of claim 3, wherein: The target account belongs to a conference management object among the multiple conference objects. Before displaying a conference interface of an online conference logged in by a target account, the method further includes: In response to the first entry instruction of the conference management object for the online conference, displaying a voiceprint registration interface for the online conference; Based on the voiceprint registration interface, receiving the object voice of the conference management object; In response to a confirmation operation on the object voice, the voiceprint of the object voice is added to the object voiceprint library as the object voiceprint of the conference management object.

5. The method of claim 4, wherein: The method further comprises: In the voiceprint registration interface, a voice collection control and a voice collection reference text are displayed; The receiving the object voice of the conference management object based on the voiceprint registration interface includes: Based on the voice collection control, the object voice of the conference management object reading the voice collection reference text is received.

6. The method of claim 4, wherein: The method further comprises: In the voiceprint registration interface, a voice file upload control is displayed; The receiving the object voice of the conference management object based on the voiceprint registration interface includes: Based on the voice file upload control, receiving the uploaded voice file of the conference management object; In response to a confirmation operation on the voice file, the voice included in the voice file is used as the target voice.

7. The method of claim 3, wherein: The target account belongs to a conference management object among the multiple conference objects, and the method further includes: Display a conference object adding control for the online conference; In response to a triggering operation of the conference management object to add a control to the conference object, displaying conference joining information; The conference joining information is used to respond to a joining instruction for the online conference triggered by a conference participant based on the conference joining information, and join the online conference through a virtual login mode, wherein the conference participant object is a conference object other than the conference management object among the multiple conference objects; Among them, the virtual login mode is used to indicate that when the virtual login account of the conference participant is received, the virtual login account is bound to the target account, and the object voiceprint of the conference participant is registered to the object voiceprint library, so that the conference participant can join the online meeting based on the virtual login account.

8. The method of claim 7, wherein: The method further comprises: Display a virtual login switch for the online conference; In response to an on instruction for the virtual login switch, controlling the online conference to be in the virtual login mode; The adding control of the conference object for displaying the online conference includes: When the online conference is in the virtual login mode, a conference object adding control of the online conference is displayed.

9. The method of claim 7, wherein: The conference participant joins the online conference through the virtual login mode, and the method further includes: Display an account removal control for the virtual login account; In response to a triggering operation on the account removal control, the virtual login account is controlled to exit the online conference.

10. The method of claim 7, wherein: The conference participant joins the online conference through the virtual login mode, and the method further includes: In response to the conference exit operation for the target account, the target account is controlled to exit the online conference, and the virtual login account bound to the target account is controlled to exit the online conference.

11. The method of claim 3, wherein: Before displaying the conference interface of the online conference logged in by a target account, the method further includes: Display voiceprint adding controls; In response to a triggering operation on the voiceprint adding control, displaying a voiceprint registration interface for the online conference; Based on the voiceprint registration interface, receiving the object voice of the conference object and the object identifier of the conference object; In response to a confirmation operation on the object voice, the voiceprint of the object voice is used as the object voiceprint of the conference object, and the object voiceprint is associated with the object identifier and added into the object voiceprint library.

12. The method according to any one of claims 1 to 11, wherein: Each of the multiple conference objects corresponds to a speech control button; When any target conference object among the multiple conference objects speaks, before displaying speech instruction information for instructing the target conference object to speak in the conference interface, the method further includes: Detecting whether the speech control button corresponding to each of the conference objects is in a pressed state, and obtaining a detection result; When the detection result indicates that the target speech control button is in a pressed state, it is determined that the conference object corresponding to the target speech control button is speaking, wherein the conference object corresponding to the target speech control button is the target conference object.

13. The method according to any one of claims 1 to 12, wherein: When any target conference object among the multiple conference objects speaks, before displaying speech instruction information for instructing the target conference object to speak in the conference interface, the method further includes: Performing voice detection on the online conference, and when a target voice is detected, identifying a target utterance direction of the target voice; Acquire the object sound direction of each of the multiple conference objects, and match the target sound direction with the sound direction of each object respectively to obtain a matching result; When the matching result indicates that there is a target object sound direction that matches the target sound direction, it is determined that the conference object corresponding to the target object sound direction is speaking, wherein the conference object corresponding to the target object sound direction is the target conference object.

14. The method according to any one of claims 1 to 13, wherein: The displaying, in the conference interface, speech instruction information for instructing the target conference object to speak includes: In the conference interface, the target object identifier of the target conference object is displayed, and In the associated area of ​​the target object identifier, speech instruction information for instructing the target conference object to speak is displayed.

15. The method according to any one of claims 1 to 14, wherein: Each of the conference objects has a corresponding object meeting minutes, and the method further includes: In response to the conference minutes viewing operation for the online conference, the following processing is performed for each of the conference objects: The object meeting minutes of the conference object are displayed, and the minutes indication information for indicating that the object meeting minutes belong to the conference object is displayed.

16. The method according to any one of claims 1 to 15, wherein: The method further comprises: Sending a notification message of the target conference object speaking to a target terminal logged in to the first account; The first account is used for allowing conference objects at a target conference venue different from the conference venue to participate in the online conference; and the notification message is used for notifying the target terminal to display the speech instruction information.

17. The method according to any one of claims 1 to 16, wherein: The method further comprises: In response to a conference joining instruction for the target online conference triggered by the target object based on the conference joining information of the target online conference, displaying a virtual login interface of the target online conference; Based on the virtual login interface, receiving a virtual login account for the target online conference; In response to a confirmation operation on the virtual login account, binding the virtual login account to a real login account of the target online conference, and displaying a voiceprint registration interface of the target online conference; Based on the voiceprint registration interface, receiving the target object's voice; In response to a confirmation operation on the target voice, the voiceprint of the target voice is added as the target voiceprint of the target object to the object voiceprint library of the target online conference, so that the target object joins the target online conference based on the virtual login account.

18. The method of claim 17, wherein: The method further comprises: The conference joining instruction is received in one of the following ways: When the conference joining information is a conference joining graphic code, in response to a scanning operation on the conference joining graphic code, the conference joining instruction is received; When the conference joining information is a conference joining link, in response to an access operation to the conference joining link, receiving the conference joining instruction; And, when the conference joining information is a conference joining password, the conference joining instruction is received in response to an identification operation for the conference joining password.

19. A device for processing an online conference, the device comprising: A first display module is configured to display a conference interface of an online conference logged in by a target account, wherein the target account is used for multiple conference objects in a conference place to participate in the online conference; The second display module is configured to display speech instruction information for instructing any target conference object among the multiple conference objects to speak in the conference interface.

20. An electronic device, comprising: a memory configured to store computer executable instructions; The processor is configured to implement the online conference processing method described in any one of claims 1 to 18 when executing the computer executable instructions stored in the memory.

21. A computer-readable storage medium storing computer-executable instructions or a computer program, wherein when the computer-executable instructions or the computer program are executed by a processor, the online conference processing method according to any one of claims 1 to 18 is implemented.

22. A computer program product, comprising computer executable instructions or a computer program, wherein when the computer executable instructions or the computer program is executed by a processor, the online conference processing method according to any one of claims 1 to 18 is implemented.

Images