Online conference processing method and device, equipment, storage medium and program product

Abstract

The invention provides an online conference processing method and device, equipment, a storage medium and a program product. The method comprises the steps that a conference interface of an online conference logged in through a target account is displayed, and the target account is used for a plurality of conference objects in a conference place to participate in the online conference; when any target conference object in the plurality of conference objects speaks, displaying indication information used for indicating the target conference object to speak in the conference interface; according to the invention, the conference efficiency and the conference experience of the online conference can be improved.

Description

Technical Field

[0001] The present application relates to the field of Internet technology, and in particular to a method, device, equipment, storage medium and program product for processing an online conference. Background Art

[0002] With the development of the Internet, online meetings are becoming more and more widely used. Online meetings are also called network meetings or remote collaborative office. Users use the Internet to share data among multiple users in different locations, effectively improving the efficiency of online collaboration with customers, partners and colleagues in various regions.

[0003] In the case of multiple people participating in an online conference in the same conference room, the related technology implements it as follows: a conference account is logged in on the conference device, and all participants in the conference room speak through the microphone of the conference account. However, since only one conference account (the conference account logged in by the conference device) can be identified, the speeches of all participants in the conference room are marked as the speeches of the conference account. As a result, other participants in the online conference (such as participants who are not in the same conference room) cannot determine who the current speaker is, which greatly affects the efficiency of the online meeting. Summary of the invention

[0004] The embodiments of the present application provide a method, device, electronic device, computer-readable storage medium, and computer program product for processing an online conference, which can improve the conference efficiency and conference experience of the online conference.

[0005] The technical solution of the embodiment of the present application is implemented as follows:

[0006] The present application provides a method for processing an online conference, including:

[0007] Displaying a conference interface of an online conference logged in by a target account, wherein the target account is used for multiple conference objects in a conference venue to participate in the online conference;

[0008] When any target conference object among the multiple conference objects speaks, instruction information for instructing the target conference object to speak is displayed in the conference interface.

[0009] The embodiment of the present application also provides a device for processing an online conference, including:

[0010] A first display module, used to display a conference interface of an online conference logged in by a target account, wherein the target account is used for multiple conference objects in a conference place to participate in the online conference;

[0011] The second display module is used to display instruction information for instructing any target conference object among the multiple conference objects to speak in the conference interface when the target conference object speaks.

[0012] In the above scheme, the first display module is also used to display a conference reservation interface before displaying the conference interface of the online conference logged in through a target account; based on the conference reservation interface, receive conference setting information for the online conference; and in response to a confirmation operation on the conference setting information, reserve the online conference.

[0013] In the above scheme, the online conference has an object voiceprint library, and the object voiceprint library includes the object voiceprint of each of the multiple conference objects; the second display module is also used to perform voice detection on the online conference before displaying the indication information for indicating the target conference object to speak in the conference interface when any target conference object among the multiple conference objects speaks, and when the target voice is detected, obtain the voice voiceprint of the target voice; match the voice voiceprint with each of the object voiceprints respectively to obtain a matching result; when the matching result indicates that there is a target object voiceprint matching the voice voiceprint, it is determined that the conference object with the target object voiceprint is speaking, wherein the conference object with the target object voiceprint is the target conference object.

[0014] In the above scheme, the target account belongs to a conference management object among the multiple conference objects, and the first display module is further used to, before displaying the conference interface of the online conference logged in through a target account, respond to the first entry instruction of the conference management object for the online conference, display the voiceprint registration interface of the online conference; based on the voiceprint registration interface, receive the object voice of the conference management object; in response to the confirmation operation of the object voice, add the voiceprint of the object voice as the object voiceprint of the conference management object to the object voiceprint library.

[0015] In the above scheme, the first display module is also used to display the voice collection control and the voice collection reference text in the voiceprint registration interface; the first display module is also used to receive the object voice of the conference management object reading the voice collection reference text based on the voice collection control.

[0016] In the above scheme, the first display module is also used to display a voice file upload control in the voiceprint registration interface; the first display module is also used to receive the uploaded voice file of the conference management object based on the voice file upload control; in response to the confirmation operation on the voice file, the voice included in the voice file is used as the object voice.

[0017] In the above scheme, the target account belongs to the conference management object among the multiple conference objects, and the first display module is also used to display the conference object adding control of the online conference; in response to the triggering operation of the conference management object on the conference object adding control, the conference joining information is displayed; wherein the conference joining information is used to respond to the joining instruction for the online conference triggered by the conference participant object based on the conference joining information, and join the online conference through the virtual login mode, and the conference participant object is the conference object other than the conference management object among the multiple conference objects; wherein the virtual login mode is used to indicate that when the virtual login account of the conference participant object is received, the virtual login account is bound to the target account, and the object voiceprint of the conference participant object is registered to the object voiceprint library, so that the conference participant object joins the online conference based on the virtual login account.

[0018] In the above scheme, the first display module is also used to display the virtual login switch of the online meeting; in response to the turn-on instruction for the virtual login switch, the online meeting is controlled to be in the virtual login mode; the first display module is also used to display the conference object addition control of the online meeting when the online meeting is in the virtual login mode.

[0019] In the above scheme, the conference participant joins the online conference through the virtual login mode, and the first display module is also used to display the account removal control of the virtual login account; in response to the triggering operation of the account removal control, the virtual login account is controlled to exit the online conference.

[0020] In the above scheme, the conference participant joins the online conference through the virtual login mode, and the first display module is also used to control the target account to exit the online conference in response to the conference exit operation for the target account, and control the virtual login account bound to the target account to exit the online conference.

[0021] In the above scheme, each of the multiple conference objects corresponds to a speech control button respectively; the second display module is also used to detect whether the speech control button corresponding to each of the conference objects is in a pressed state before displaying the indication information for instructing the target conference object to speak in the conference interface when any target conference object among the multiple conference objects is speaking, and obtain a detection result; when the detection result indicates that the target speech control button is in a pressed state, it is determined that the conference object corresponding to the target speech control button is speaking, wherein the conference object corresponding to the target speech control button is the target conference object.

[0022] In the above scheme, the second display module is also used to perform voice detection on the online conference before displaying the indication information for instructing the target conference object to speak in the conference interface when any target conference object among the multiple conference objects speaks, and when the target voice is detected, identify the target sound direction of the target voice; obtain the object sound direction of each of the multiple conference objects, and match the target sound direction with the sound direction of each object respectively to obtain a matching result; when the matching result indicates that there is a target object sound direction that matches the target sound direction, determine that the conference object corresponding to the target object sound direction is speaking, wherein the conference object corresponding to the target object sound direction is the target conference object.

[0023] In the above scheme, the second display module is also used to display the target object identifier of the target conference object in the conference interface, and display instruction information for instructing the target conference object to speak in the associated area of ​​the target object identifier.

[0024] In the above scheme, each of the conference objects has a corresponding object meeting minutes. The second display module is also used to respond to the meeting minutes viewing operation for the online meeting and perform the following processing for each of the conference objects: display the object meeting minutes of the conference object, and display the minutes indication information used to indicate that the object meeting minutes belong to the conference object.

[0025] In the above scheme, the first display module is also used to display a virtual login interface of the target online conference in response to a conference joining instruction for the target online conference triggered by the target object based on the conference joining information of the target online conference; based on the virtual login interface, a virtual login account for the target online conference is received; in response to a confirmation operation on the virtual login account, the virtual login account is bound to a real login account of the target online conference, and a voiceprint registration interface of the target online conference is displayed; based on the voiceprint registration interface, the object voice of the target object is received; in response to a confirmation operation on the object voice, the voiceprint of the object voice is added as the object voiceprint of the target object to the object voiceprint library of the target online conference, so that the target object joins the target online conference based on the virtual login account.

[0026] In the above scheme, the first display module is also used to receive the conference join instruction in one of the following ways: when the conference join information is a conference join graphic code, the conference join instruction is received in response to a scanning operation on the conference join graphic code; when the conference join information is a conference join link, the conference join instruction is received in response to an access operation on the conference join link; and when the conference join information is a conference join password, the conference join instruction is received in response to an identification operation on the conference join password.

[0027] The present application also provides an electronic device, including:

[0028] A memory for storing computer executable instructions;

[0029] The processor is used to implement the online conference processing method provided in the embodiment of the present application when executing the computer executable instructions stored in the memory.

[0030] The embodiment of the present application also provides a computer-readable storage medium storing computer-executable instructions or a computer program. When the computer-executable instructions or the computer program are executed by a processor, the online conference processing method provided by the embodiment of the present application is implemented.

[0031] The embodiment of the present application also provides a computer program product, including computer executable instructions or a computer program. When the computer executable instructions or the computer program are executed by a processor, the online conference processing method provided by the embodiment of the present application is implemented.

[0032] The embodiments of the present application have the following beneficial effects:

[0033] By applying the above-mentioned embodiment of the present application, when an online conference is logged in through a target account, and the target account is used for multiple conference objects in a conference venue to participate in the online conference, when any of the multiple conference objects speaks, the instruction information for instructing the target conference object to speak can be displayed in the conference interface. In this way, for a conference scenario where multiple objects participate in an online conference through a conference account in the same conference venue, different speech instruction information can be displayed when different conference objects speak, so as to clearly identify which conference object among the multiple conference objects is speaking through the speech instruction information, thereby improving the meeting efficiency and meeting experience of the online conference. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 1 is a schematic diagram of the architecture of an online conference processing system 100 provided in an embodiment of the present application;

[0035] Figure 2It is a structural diagram of an electronic device 500 for implementing an online conference processing method provided in an embodiment of the present application;

[0036] Figure 3 It is a flowchart of a method for processing an online conference provided in an embodiment of the present application;

[0037] Figure 4 It is a display schematic diagram of a conference reservation interface provided in an embodiment of the present application;

[0038] Figure 5 is a display schematic diagram of a voiceprint registration interface provided in an embodiment of the present application;

[0039] Figure 6 This is a schematic diagram of displaying conference joining information provided by an embodiment of the present application;

[0040] Figure 7 It is a schematic diagram of the virtual login process provided by the embodiment of the present application;

[0041] Figure 8 is a flowchart of removing a virtual login account provided in an embodiment of the present application;

[0042] Fig. 9 is a schematic diagram of displaying indication information provided by an embodiment of the present application;

[0043] Fig.10 is a schematic diagram of displaying indication information provided by an embodiment of the present application;

[0044] Fig.11 It is a schematic diagram of displaying the meeting minutes provided in the embodiment of the present application;

[0045] Fig.12 This is a registration diagram of an online conference client provided in an embodiment of the present application;

[0046] Fig.13 It is a flowchart of a method for processing an online conference provided in an embodiment of the present application;

[0047] Fig.14 It is a schematic diagram of the processing flow of the virtual participant management module provided in the embodiment of the present application;

[0048] Fig.15 It is a schematic diagram of the binding relationship between the conference management object and the virtual participants provided in the embodiment of the present application;

[0049] Fig.16 is a schematic diagram of the processing flow of the speech recognition module provided in an embodiment of the present application;

[0050] Fig.17 It is a schematic diagram of storing voiceprint features provided in an embodiment of the present application. DETAILED DESCRIPTION

[0051] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings. The described embodiments should not be regarded as limiting the present application. All other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of this application.

[0052] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0053] In the following description, the terms "first\second\third" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here.

[0054] Unless otherwise defined, all technical and scientific terms used in the embodiments of the present application have the same meanings as those commonly understood by those skilled in the art. The terms used in the embodiments of the present application are only for the purpose of describing the embodiments of the present application and are not intended to limit the present application.

[0055] Before further describing the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are explained. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations.

[0056] 1) Client: An application program running in a terminal to provide various services, such as a client that supports online meetings.

[0057] 2) In response, it is used to indicate the conditions or states on which the executed operations depend. When the dependent conditions or states are met, one or more operations executed may be in real time or have a set delay. Unless otherwise specified, there is no restriction on the order of execution of the multiple operations executed.

[0058] 3) Online meetings, also known as web conferences or remote collaborative office work, enable users to share data among multiple users in different locations (meeting venues) using the Internet, effectively improving the efficiency of online collaboration with customers, partners and colleagues in various regions.

[0059] 4) Voiceprint: It is the sound wave spectrum carrying speech information displayed by electroacoustic instruments.

[0060] 5) Speaker recognition: Also known as voiceprint recognition, it is a biometric technology that uses voice to distinguish speakers for identity verification and authentication.

[0061] The embodiments of the present application provide a method, device, electronic device, computer-readable storage medium, and computer program product for processing an online conference, which can improve the efficiency and experience of the online conference.

[0062] It should be noted that the collection and processing of relevant data in this application should be strictly in accordance with the requirements of relevant laws and regulations when applied in examples, and the informed consent or separate consent of the personal information subject should be obtained, and subsequent data use and processing should be carried out within the scope of authorization of laws and regulations and the personal information subject.

[0063] The following describes the online conference processing system provided by the embodiment of the present application. Figure 1 , Figure 1 It is a schematic diagram of the architecture of the processing system 100 of the online conference provided in the embodiment of the present application. To realize supporting an exemplary application, the terminal 400-1 and the terminal 400-2 are connected to the server 200 through the network 300. The network 300 can be a wide area network or a local area network, or a combination of the two, and a wireless or wired link is used to realize data transmission. Among them, the terminal 400-1 corresponds to the first conference place and logs in to the online conference through the first target account, and the terminal 400-2 corresponds to the second conference place and logs in to the online conference through the second target account. The first conference place and the second conference place both include multiple conference objects; the terminal 400-1 and the terminal 400-2 synchronize the conference information of the online conference (such as the speech content in the online conference) through the server 200.

[0064] Taking the terminal 400 - 1 as an example, the terminal 400 - 1 is used to respond to the conference joining instruction of logging in to the online conference through the target account (ie, the first target account), and send a conference joining request of logging in to the online conference through the target account to the server 200;

[0065] The server 200 is used to receive a conference joining request sent by a terminal; in response to the conference joining request, the control terminal logs into the online conference through a target account;

[0066] Terminal 400-1 is also used to display the conference interface of the online conference logged in by the target account when the server 200 controls the terminal to log in to the online conference through the target account. The target account is used for multiple conference objects in a conference place to participate in the online conference; when any of the multiple conference objects speaks, the conference interface displays the instruction information for instructing the target conference object to speak. At the same time, the instruction information can also be synchronized to another terminal (i.e., terminal 400-2) participating in the online conference, so that terminal 400-2 also displays the instruction information for instructing the target conference object to speak in the conference interface.

[0067] In some embodiments, the online conference processing method provided in the embodiments of the present application can be implemented by various electronic devices, for example, it can be implemented by a terminal alone, it can also be implemented by a server alone, or it can be implemented by a terminal and a server in collaboration. The online conference processing method provided in the embodiments of the present application can be applied to various scenarios, including but not limited to cloud technology, artificial intelligence, smart transportation, assisted driving, games, audio and video, online conferences, etc.

[0068] In some embodiments, the electronic device for implementing the processing method of the online conference provided in the embodiments of the present application may be various types of terminals or servers. Among them, the server (e.g., server 200) may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. The terminal (e.g., terminal 400-1) may be a laptop, a tablet computer, a desktop computer, a smart phone, an intelligent voice interaction device (e.g., an intelligent speaker), a smart home appliance (e.g., a smart TV), a smart watch, a vehicle-mounted terminal, a wearable device, a virtual reality (VR) device, etc., but is not limited thereto. The terminal and the server may be directly or indirectly connected via wired or wireless communication, and the embodiments of the present application do not limit this.

[0069] In some embodiments, the processing method of the online conference provided in the embodiment of the present application can be implemented with the aid of cloud technology (Cloud Technology). Cloud technology refers to a hosting technology that unifies a series of resources such as hardware, software, and network in a wide area network or a local area network to realize the calculation, storage, processing, and sharing of data. Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, and application technology based on the application of cloud computing business model, which can form a resource pool, which is used on demand and is flexible and convenient. Cloud computing technology will become an important support. The background services of the technical network system require a large amount of computing resources and storage resources. As an example, the server (such as server 200) can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks (Content Delivery Network, CDN), and big data and artificial intelligence platforms.

[0070] In some embodiments, multiple servers may form a blockchain, and the servers are nodes on the blockchain. Information connections may exist between each node in the blockchain, and information may be transmitted between nodes through information connections. Among them, data related to the online conference processing method provided in the embodiment of the present application (such as meeting minutes, voice data of conference objects, etc.) can be stored on the blockchain.

[0071] In some embodiments, the terminal or server can implement the processing method of the online conference provided in the embodiment of the present application by running various computer executable instructions or computer programs. For example, the computer executable instructions can be commands, machine instructions or software instructions at the microprogram level. The computer program can be a native program or software module in the operating system; it can be a local (Native) application (Application, APP), that is, a program that needs to be installed in the operating system to run, such as a conference APP; it can also be a small program that can be embedded in any APP, that is, a program that can be run only by downloading it to a browser environment. In short, the above-mentioned computer executable instructions can be instructions in any form, and the above-mentioned computer program can be an application, module or plug-in in any form.

[0072] The following describes an electronic device for implementing an online conference processing method provided by an embodiment of the present application. Figure 2 , Figure 2It is a structural diagram of an electronic device 500 for implementing a processing method for online conferences provided in an embodiment of the present application. The electronic device 500 provided in an embodiment of the present application may be a terminal or a server. The electronic device 500 provided in an embodiment of the present application includes: at least one processor 510, a memory 550, at least one network interface 520 and a user interface 530. The various components in the electronic device 500 are coupled together through a bus system 540. It can be understood that the bus system 540 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 540 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, in Figure 2 Various buses are labeled as bus system 540 .

[0073] The processor 510 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., where the general-purpose processor can be a microprocessor or any conventional processor, etc.

[0074] The user interface 530 includes one or more output devices 531 that enable presentation of media content, including one or more speakers and / or one or more visual display screens. The user interface 530 also includes one or more input devices 532, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.

[0075] The memory 550 may be removable, non-removable, or a combination thereof. The memory 550 may include one or more storage devices physically located away from the processor 510. The memory 550 includes a volatile memory or a non-volatile memory, and may also include both a volatile memory and a non-volatile memory. The non-volatile memory may be a read-only memory (ROM), and the volatile memory may be a random access memory (RAM). The memory 550 described in the embodiments of the present application is intended to include any suitable type of memory.

[0076] In some embodiments, the memory 550 can store data to support various operations, examples of which include programs, modules, and data structures, or a subset or superset thereof, as exemplarily described below.

[0077] Operating system 551, including system programs for processing various basic system services and performing hardware-related tasks, such as framework layer, core library layer, driver layer, etc., for implementing various basic services and processing hardware-based tasks;

[0078] A network communication module 552, used to reach other electronic devices via one or more (wired or wireless) network interfaces 520, exemplary network interfaces 520 include: Bluetooth, Wireless Compatibility Certification (WiFi), and Universal Serial Bus (USB), etc.;

[0079] a presentation module 553 for enabling presentation of information via one or more output devices 531 (e.g., display screen, speaker, etc.) associated with the user interface 530 (e.g., a user interface for operating peripherals and displaying content and information);

[0080] The input processing module 554 is used to detect one or more user inputs or interactions from one of the one or more input devices 532 and translate the detected inputs or interactions.

[0081] In some embodiments, the online conference processing device provided in the embodiments of the present application can be implemented in software. Figure 2 A processing device 555 for an online conference stored in a memory 550 is shown, which may be software in the form of a program or plug-in, including the following software modules: a first display module 5551 and a second display module 5552. These modules are logical and therefore may be arbitrarily combined or further split according to the functions implemented. The functions of each module will be described below.

[0082] The following describes the processing method of the online conference provided by the embodiment of the present application. In some embodiments, the processing method of the online conference provided by the embodiment of the present application can be implemented by various electronic devices, for example, it can be implemented by a terminal alone, it can also be implemented by a server alone, or it can be implemented by a terminal and a server in collaboration. Figure 3 , Figure 3 : is a flow chart of a method for processing an online conference provided in an embodiment of the present application. The method for processing an online conference provided in an embodiment of the present application includes:

[0083] Step 101: The terminal displays a conference interface of an online conference logged in through a target account.

[0084] The target account is used for multiple meeting objects in a meeting place to participate in the online meeting.

[0085] Here, the terminal may be provided with a client supporting online conferences, and the user may participate in the online conference by running the client through the terminal. In actual applications, the terminal may log in to the online conference through the target account, so that the terminal displays the conference interface of the online conference logged in through the target account. The target account may be the login account of the client, and the terminal may log in to the online conference through the target account when the client is in the login state of the target account.

[0086] It should be noted that the target account can belong to the conference management object of the online meeting, which can book online meetings, manage conference objects in online meetings, manage related information of online meetings, etc. The above-mentioned multiple conference objects include the conference management object, and the conference objects other than the conference management object in the multiple conference management objects can be called conference participant objects. In actual implementation, each conference venue participating in the online meeting can have a conference management object. In an embodiment of the present application, the target account is used for multiple conference objects in a conference venue to participate in the online meeting, thus forming a conference scenario in which multiple conference objects participate in the online meeting through one conference account (i.e., the target account) in the same conference venue.

[0087] It should be noted that, for a conference scenario where multiple objects participate in an online conference through a conference account at the same conference venue, in the embodiment of the present application, it is hoped that different speech indication information can be displayed when different conference objects speak, so as to clearly identify which conference object among the multiple conference objects is speaking through the speech indication information. Therefore, on each terminal participating in the online conference, when any target conference object among the multiple conference objects speaks, the indication information for indicating the target conference object to speak can be displayed in the conference interface. Next, the explanation will be continued by taking the terminal as the terminal on the conference management object side as an example.

[0088] In some embodiments, before displaying a conference interface of an online conference logged in through a target account, the terminal can schedule an online conference in the following manner: displaying a conference booking interface; receiving conference setting information for the online conference based on the conference booking interface; and scheduling the online conference in response to a confirmation operation on the conference setting information.

[0089] Here, a user (such as a conference management object) can make a reservation for an online conference. Specifically, the terminal displays a conference reservation interface in response to an online conference reservation instruction triggered by the user (such as a trigger through an online conference reservation control). As an example, see Figure 4 , Figure 4It is a display schematic diagram of the conference reservation interface provided by the embodiment of the present application. Here, the conference reservation interface can be used by the user to set the conference setting information of the online conference, such as the meeting location of the online conference, the name of the conference management object (i.e., the conference host) participating in the online conference, the password for joining the online conference, whether to turn on the virtual login mode, etc. After the terminal receives the conference setting message set by the user based on the conference reservation interface, in response to the confirmation operation for the conference setting information, the online conference is scheduled according to the conference setting information. In this way, the reservation of the online conference is realized, and the conference object can participate in the online conference by joining the scheduled online conference.

[0090] In some embodiments, the target account belongs to a conference management object among multiple conference objects. Before displaying the conference interface of an online conference logged in through a target account, the terminal can register the object voiceprint of the conference management object to the object voiceprint library of the online conference in the following manner: in response to the first entry instruction of the conference management object for the online conference, display the voiceprint registration interface of the online conference; based on the voiceprint registration interface, receive the object voice of the conference management object; in response to the confirmation operation for the object voice, add the voiceprint of the object voice as the object voiceprint of the conference management object to the object voiceprint library.

[0091] It should be noted that for the conference scenario where multiple objects participate in an online conference through a conference account at the same conference venue, in the embodiment of the present application, it is hoped that different speech indication information can be displayed when different conference objects speak, so as to clearly identify which conference object among multiple conference objects is speaking through the speech indication information. Therefore, when the user enters (or logs in) the online conference for the first time, he needs to register his voiceprint to the object voiceprint library of the online conference. Based on this, here, when the terminal receives the first entry instruction of the conference management object for the online conference, it displays the voiceprint registration interface of the online conference. The user can input his own voice through the voiceprint registration interface to register his own voiceprint to the object voiceprint library of the online conference. When the terminal receives the object voice of the conference management object based on the voiceprint registration interface, in response to the confirmation operation for the object voice, the object voice is recognized to obtain the voiceprint of the object voice, so as to add the voiceprint of the object voice as the object voiceprint of the conference management object to the object voiceprint library, thereby realizing the registration of the object voiceprint of the conference management object to the object voiceprint library of the online conference.

[0092] In some embodiments, the terminal may display a voice collection control and a voice collection reference text in the voiceprint registration interface; correspondingly, the terminal may receive the object voice of the conference management object based on the voiceprint registration interface in the following manner: based on the voice collection control, the object voice of the conference management object reading the voice collection reference text is received.

[0093] Here, a voice collection control and a voice collection reference text may be provided in the voiceprint registration interface. The voice collection control is used to collect voice in response to a trigger operation on the voice collection control; the voice collection reference text is used for the user to refer to the voice collection reference text for voice input when performing voice input. Based on this, the terminal can receive the object voice of the conference management object reading the voice collection reference text based on the voice collection control.

[0094] In some embodiments, the terminal may display a voice file upload control in the voiceprint registration interface; accordingly, the terminal may receive the object voice of the conference management object based on the voiceprint registration interface in the following manner: based on the voice file upload control, receiving the uploaded voice file of the conference management object; in response to the confirmation operation for the voice file, taking the voice included in the voice file as the object voice.

[0095] Here, a voice file upload control can also be provided in the voiceprint registration interface, and the voice file upload control is used for users to upload voice files including their own voices through the voice file upload control. Based on this, the terminal can receive the voice file of the uploaded conference management object through the voice file upload control, and the voice included in the voice file is the object voice of the conference management object. In actual applications, the voice file upload control includes a file drag and drop upload function area and a file selection upload control. Users can upload voice files by dragging and dropping voice files to the file drag and drop upload function area. Users can also upload files through file selection and select voice files in the file directory to upload.

[0096] As an example, see Figure 5 , Figure 5 : is a display schematic diagram of the voiceprint registration interface provided by the embodiment of the present application. Here, the terminal displays the voiceprint registration interface, and in the voiceprint registration interface, a voice collection control 61, a voice collection reference text 62, and a voice file upload control 63 are displayed. Here, the voice file upload control 63 includes a file drag upload function area 631 and a file selection upload file 632.

[0097] In some embodiments, the target account belongs to a conference management object among multiple conference objects, and the terminal can display a conference object adding control for the online conference; in response to the triggering operation of the conference management object on the conference object adding control, the conference joining information is displayed; wherein, the conference joining information is used to respond to the joining instruction for the online conference triggered by the conference participant object based on the conference joining information, and join the online conference through a virtual login mode, and the conference participant object is a conference object other than the conference management object among the multiple conference objects; wherein, the virtual login mode is used to indicate that when a virtual login account of the conference participant object is received, the virtual login account is bound to the target account, and the object voiceprint of the conference participant object is registered in the object voiceprint library, so that the conference participant object can join the online conference based on the virtual login account.

[0098] Here, after entering the online conference, the conference management object can also add the conference participant object of the online conference. In the embodiment of the present application, the added conference object joins the online conference through the virtual login mode. Specifically, the terminal of the conference management object can display the conference object addition control of the online conference, for example, the terminal can display the conference object addition control in the object management interface of the online conference; when receiving the trigger operation for the conference object addition control, the conference joining information is displayed.

[0099] In actual application, the conference joining information may be a conference joining graphic code (such as a QR code), a conference joining link, a conference joining password, etc. In this way, after displaying the conference joining information, the terminal may send the conference joining information to the target terminals of the conference participants respectively, so that the conference participants can join the online conference based on the conference joining information displayed by the target terminals; of course, after displaying the conference joining information, the terminal may not send the conference joining information to the target terminals of the conference participants, but the conference participants may operate on the terminal to join the online conference based on the conference joining information displayed by the terminal. At this time, if there are multiple conference participants, the corresponding conference joining information may be provided for each conference participant by triggering the conference object to add controls. When the conference joining information is a conference joining graphic code, if the terminal does not send the conference joining graphic code to the target terminal of the conference participant, regardless of whether there are one or more conference participants, the terminal may only trigger the trigger operation for adding controls to the conference object once, display one conference joining graphic code, and multiple conference participants may be added to the online conference through the conference joining graphic code.

[0100] In an embodiment of the present application, when a conference participant joins an online conference based on conference joining information, the conference participant joins the online conference through a virtual login mode. The virtual login mode is used to indicate that when a virtual login account of a conference participant is received, the virtual login account is bound to the target account, and the object voiceprint of the conference participant is registered in the object voiceprint library, so that the conference participant joins the online conference based on the virtual login account. Specifically, the target terminal of the conference participant responds to the joining instruction for the online conference triggered by the conference participant based on the above conference joining information, and displays the virtual login interface of the online conference; based on the virtual login interface, the virtual login account for the online conference is received; in response to the confirmation operation for the virtual login account, the virtual login account is bound to the target account for logging into the online conference, and the voiceprint registration interface of the online conference is displayed; based on the voiceprint registration interface, the object voice of the conference participant is received; in response to the confirmation operation for the object voice, the voiceprint of the object voice is added as the object voiceprint of the conference participant to the object voiceprint library of the online conference, so that the conference participant joins the online conference based on the virtual login account. In this way, the virtual login of the conference participant is completed.

[0101] In actual application, the above-mentioned joining instruction can be received in the following ways: when the conference joining information is a conference joining graphic code, the joining instruction is received in response to a scanning operation on the conference joining graphic code; when the conference joining information is a conference joining link, the joining instruction is received in response to an access operation on the conference joining link; and when the conference joining information is a conference joining password, the joining instruction is received in response to an identification operation on the conference joining password.

[0102] In actual applications, the above virtual login interface allows users to enter a virtual login account. The virtual login account can be the mobile phone number of the registered client (i.e., the client that supports online meetings). Virtual login is achieved through mobile phone number verification (i.e., mobile phone verification code). When the mobile phone number is not registered with the client, it can be registered first, and then virtual login can be performed. The voiceprint registration interface is used for the meeting participants to upload their own object voices, thereby registering the object voiceprints of the meeting participants to the object voiceprint library of the online meeting. The voiceprint registration interface can be found in Figure 5 .

[0103] In actual applications, the virtual login account that joins the online meeting can be understood as a virtual participant, corresponding to the meeting participant object corresponding to the virtual login account.

[0104] As an example, see Figure 6 , Figure 6Here, the terminal (conference management object side) displays the conference object adding control "Add virtual participant" of the online conference in the conference member management interface, such as Figure 6 In response to the trigger operation of adding a control "add virtual participant" to the conference object, the conference joining information is displayed, and the conference joining information is a conference joining graphic code (QR code), such as Figure 6 (2) as shown.

[0105] Continuing, see Figure 7 , Figure 7 Here, the meeting participants can scan the displayed meeting joining graphic code through the target terminal they hold. In response to the scanning operation of the meeting joining graphic code, the target terminal receives the joining instruction for the online meeting. At this time, the virtual login interface is displayed, such as Figure 7 Middle (1)- Figure 7 As shown in (2) in the virtual login interface. The virtual login account (i.e., mobile phone number) and the corresponding mobile phone verification code can be entered by the meeting participants in the virtual login interface. In response to the confirmation operation for the virtual login account triggered by the "OK" control in the virtual login interface, the virtual login account is bound to the target account for logging into the online meeting, and the voiceprint registration interface for the online meeting is displayed, such as Figure 7 As shown in (3). Based on the voiceprint registration interface, the object voice of the conference participant can be received. In response to the confirmation operation for the object voice triggered by the "OK" control in the voiceprint registration interface, the voiceprint of the object voice is added to the object voiceprint library of the online conference as the object voiceprint of the conference participant, so that the conference participant can join the online conference based on the virtual login account. In this way, the virtual login of the conference participant is completed.

[0106] In some embodiments, the terminal can enable the virtual login mode in the following ways: display the virtual login switch of the online meeting; in response to the opening instruction of the virtual login switch, control the online meeting to be in the virtual login mode; accordingly, the terminal can display the conference object adding control of the online meeting when the online meeting is in the virtual login mode. As an example, see Figure 4, the virtual login switch can be displayed on the conference reservation interface. When making an online conference reservation, the virtual login switch can be turned on, so that the online conference is in virtual login mode. Of course, the virtual login switch can also be displayed on the conference interface or conference management interface of the online conference after entering the online conference, which is not limited here. In this way, when the terminal controls the online conference to be in virtual login mode, the terminal can display the conference object addition control of the online conference to add conference participants through the virtual login mode, so that the conference participants can join the online conference through the virtual login mode.

[0107] In some embodiments, a conference participant joins an online conference through a virtual login mode, and the terminal may remove the virtual login account of the conference participant in the following manner: display an account removal control of the virtual login account; and in response to a trigger operation on the account removal control, control the virtual login account to exit the online conference.

[0108] Here, the participants of the online conference (referring to the conference objects other than the conference management object among the multiple conference objects) can join the online conference through the virtual login mode. In this way, the target account is bound to the virtual login account of each participant of the conference. In actual application, the conference management object can remove the virtual login account bound to the target account. For example, see Figure 8 , Figure 8 Here, the terminal displays the account information of the target account, and in the associated area of ​​the target account information, displays the account information of the virtual login accounts 1-2 bound to the target account, and at the same time, displays the account removal control "Remove" of each virtual login account, such as Figure 8 In response to the trigger operation of the account removal control "Remove" for the virtual login account 1, the virtual login account 1 is controlled to exit the online meeting. At this time, the remaining virtual login account 2 is in the online meeting, such as Figure 8 As shown in (2).

[0109] In some embodiments, the participants join the online meeting through the virtual login mode, and the terminal can exit the online meeting in the following manner: in response to the meeting exit operation for the target account, control the target account to exit the online meeting, and control the virtual login account bound to the target account to exit the online meeting.

[0110] Here, the participating meeting objects of the online meeting (referring to the meeting objects other than the meeting management object in the multiple meeting objects) can join the online meeting through the virtual login mode. In this way, the target account is bound to the virtual login account of each participating meeting object. Since the virtual login account joins the online meeting by binding the target account, when the target account exits the online meeting, the virtual login account bound to the target account also automatically exits the online meeting. That is, when the terminal receives the meeting exit operation for the target account, it controls the target account to exit the online meeting, and controls the virtual login account bound to the target account to exit the online meeting.

[0111] In some embodiments, the online conference has an object voiceprint library, which includes the object voiceprint of each conference object among multiple conference objects; the terminal can determine the target conference object who is speaking in the following manner: perform voice detection on the online conference, and when the target voice is detected, obtain the voice voiceprint of the target voice; match the voice voiceprint with each object voiceprint respectively to obtain a matching result; when the matching result indicates that there is a target object voiceprint that matches the voice voiceprint, it is determined that the conference object with the target object voiceprint is speaking, wherein the conference object with the target object voiceprint is the target conference object.

[0112] Here, based on the above embodiment, when a conference object joins an online conference, it will register its own object voiceprint to the object voiceprint library of the online conference. In this way, the object voiceprint library includes the object voiceprint of each conference object among the multiple conference objects joining the online conference. Based on this, during the online conference, the terminal can perform voice detection on the online conference, that is, detect whether someone is speaking. When the terminal detects the target voice, it identifies the voice voiceprint of the target voice; then the voice voiceprint is matched with each object voiceprint for similarity to obtain a matching result, which is used to characterize whether there is a target object voiceprint that matches the voice voiceprint (that is, an object voiceprint whose similarity reaches a similarity threshold); when the matching result characterizes the existence of a target object voiceprint that matches the voice voiceprint, it is determined that the conference object with the target object voiceprint is speaking. Here, the conference object of the target object voiceprint is the target conference object. At this time, the indication information for indicating that the target conference object is speaking is displayed.

[0113] In some embodiments, each of the multiple conference objects corresponds to a speech control button; the terminal can determine the target conference object who is speaking in the following manner: detect whether the speech control button corresponding to each conference object is in a pressed state to obtain a detection result; when the detection result indicates that the target speech control button is in a pressed state, it is determined that the conference object corresponding to the target speech control button is speaking, wherein the conference object corresponding to the target speech control button is the target conference object.

[0114] Here, a corresponding speech control button can also be assigned to each conference object. When the conference object speaks, it can press its corresponding speech control button. At this time, the speech control button is in a pressed state. Based on this, the terminal can detect whether the speech control button corresponding to each conference object is in a pressed state to obtain a detection result; when the detection result indicates that the target speech control button is in a pressed state, it is determined that the conference object corresponding to the target speech control button is speaking. Here, the conference object corresponding to the target speech control button is the target conference object. At this time, the indication information for indicating the target conference object to speak is displayed.

[0115] In some embodiments, the terminal can determine the target conference object who is speaking in the following manner: perform voice detection on the online conference, and when the target voice is detected, identify the target sound direction of the target voice; obtain the object sound direction of each conference object among multiple conference objects, and match the target sound direction with the sound direction of each object respectively to obtain a matching result; when the matching result indicates that there is a target object sound direction that matches the target sound direction, determine that the conference object corresponding to the target object sound direction is speaking, wherein the conference object corresponding to the target object sound direction is the target conference object.

[0116] Here, the target conference object who is speaking can also be determined by identifying the direction of speech. During the online conference, the terminal can perform voice detection on the online conference, that is, detect whether someone is speaking. When the terminal detects the target voice, it identifies the target direction of speech of the target voice; then obtain the object speech direction of each conference object among multiple conference objects, so as to perform similarity matching between the target speech direction and the speech direction of each object, and obtain a matching result, which is used to characterize whether there is a target object speech direction that matches the target speech direction (that is, the object speech direction whose similarity reaches the similarity threshold); when the matching result characterizes the existence of a target object speech direction that matches the target speech direction, it is determined that the conference object corresponding to the target object speech direction is speaking. Here, the conference object corresponding to the target object speech direction is the target conference object, and at this time, the indication information for indicating the target conference object to speak is displayed.

[0117] Step 102: When any target conference object among the multiple conference objects speaks, indication information for instructing the target conference object to speak is displayed in the conference interface.

[0118] Here, for a conference scenario where multiple parties participate in an online conference at the same conference venue through a conference account, when any target party among multiple conference parties speaks, the conference interface displays instruction information for indicating that the target party is speaking. In this way, different speech instruction information can be displayed when different conference parties speak, so that it can be clearly identified which conference party among multiple conference parties is speaking through the speech instruction information. For example, see Fig. 9 , Fig. 9 It is a display diagram of the indication information provided by the embodiment of the present application. Here, in the conference interface, the indication information "Speaking: Conference Object 1 (virtual participant)" is displayed to indicate that "Conference Object 1" is speaking. In actual applications, the indication information can be text information (such as conference object 1 is speaking), image information (either static or dynamic, such as displaying a dynamic image of "microphone" in the associated area of ​​the identification information of conference object 1 to indicate that conference object 1 is speaking), and so on.

[0119] In some embodiments, the terminal may display instruction information for instructing the target conference object to speak in the conference interface in the following manner: in the conference interface, display the target object identifier of the target conference object, and display instruction information for instructing the target conference object to speak in the associated area of ​​the target object identifier.

[0120] Here, the terminal may display the target object identifier of the target conference object in the conference interface, and then display the instruction information for instructing the target conference object to speak in the associated area of ​​the target object identifier. Fig.10 , Fig.10 : This is a schematic diagram of the display of the indication information provided by the embodiment of the present application. Here, in the conference interface, the object identification of each conference object (conference object 1-2) is displayed, wherein the target conference object is conference object 2. At this time, in the associated area of ​​the target object identification of conference object 2, indication information for indicating conference object 2 to speak is displayed, and the indication information is dynamic image information, that is, a dynamic image of a "microphone".

[0121] In some embodiments, each conference object has a corresponding object meeting minutes. The terminal can display the minutes of the online meeting in the following manner: in response to a meeting minutes viewing operation for the online meeting, the following processing is performed for each conference object: the object meeting minutes of the conference object are displayed, and the minutes indication information used to indicate that the object meeting minutes belong to the conference object is displayed.

[0122] Here, when any target conference object among multiple conference objects speaks, the indication information for indicating that the target conference object is speaking can be displayed, that is, in the embodiment of the present application, when any conference object speaks, it can be clear which conference object the speech is from. Therefore, when taking meeting minutes, the meeting minutes and the corresponding speaking object can be associated. In this way, when viewing the minutes of an online meeting, for each conference object, the object meeting minutes of the conference object can be displayed, and the minutes indication information for indicating that the object meeting minutes belong to the conference object can be displayed. For example, see Fig.11 , Fig.11 It is a display diagram of the meeting minutes provided in the embodiment of the present application. Here, the object meeting minutes 1-2 of the meeting objects 1-2 are displayed, and for each object meeting minute, the minute indication information for indicating that the object meeting minute belongs to the meeting object is displayed. For example, for the object meeting minute 1, the corresponding minute indication information "meeting object 1" is displayed, and for the object meeting minute 2, the corresponding minute indication information "meeting object 2" is displayed. Here, the minute indication information is the identifier of the meeting object.

[0123] In some embodiments, the terminal can join the target online conference in the following manner: in response to a conference joining instruction for the target online conference triggered by the target object based on the conference joining information of the target online conference, displaying a virtual login interface of the target online conference; based on the virtual login interface, receiving a virtual login account for the target online conference; in response to a confirmation operation on the virtual login account, binding the virtual login account to a real login account of the target online conference, and displaying a voiceprint registration interface of the target online conference; based on the voiceprint registration interface, receiving the object voice of the target object; in response to a confirmation operation on the object voice, adding the voiceprint of the object voice as the object voiceprint of the target object to the object voiceprint library of the target online conference, so that the target object joins the target online conference based on the virtual login account.

[0124] Here, the target object (i.e., the conference management object of the online conference) can join the target online conference as a conference participant. In actual application, when joining the target online conference, the target online conference is also joined through a virtual login mode.

[0125] In some embodiments, the terminal may receive a conference join instruction for a target online conference in one of the following ways: when the conference join information is a conference join graphic code, the conference join instruction is received in response to a scanning operation on the conference join graphic code; when the conference join information is a conference join link, the conference join instruction is received in response to an access operation on the conference join link; and when the conference join information is a conference join password, the conference join instruction is received in response to an identification operation on the conference join password.

[0126] By applying the above-mentioned embodiment of the present application, when an online conference is logged in through a target account, and the target account is used for multiple conference objects in a conference venue to participate in the online conference, when any of the multiple conference objects speaks, the instruction information for instructing the target conference object to speak can be displayed in the conference interface. In this way, for a conference scenario where multiple objects participate in an online conference through a conference account in the same conference venue, different speech instruction information can be displayed when different conference objects speak, so as to clearly identify which conference object among the multiple conference objects is speaking through the speech instruction information, thereby improving the meeting efficiency and meeting experience of the online conference.

[0127] The following will illustrate an exemplary application of the embodiment of the present application in an actual application scenario. In the related art, for the conference scenario where multiple people participate in an online conference in the same conference room, the following solution is often used: only one conference account / device is logged in, and all participants in the conference room speak through the microphone of the conference account / device. However, there are the following problems in online conferences: since the online conference system can only identify one conference account (the conference account of the current login person or the conference account of the conference hardware device), the speeches of all participants in the conference room are identified as the speeches of the conference account, and the identified meeting minutes are also considered to be the minutes of the conference account, and it is impossible to associate the speeches and meeting minutes with the real participants; at the same time, other participants in the online conference who are not in the same conference room cannot determine who the current speaker is, which greatly affects the efficiency and atmosphere of the online conference.

[0128] Based on this, an embodiment of the present application provides a method for processing an online conference to at least solve the above-mentioned problems. In an embodiment of the present application, for a conference scenario in which multiple people participate in an online conference in the same conference room and only log in to one conference account / device, 1) through the virtual login of all participants to the online conference and speaker recognition technology, the online conference system (i.e., the online conference background) can automatically identify the current speaker. 2) The direction of the sound is identified through the microphone of the online conference system, so that the online conference system can identify the current speaker based on the direction of the sound. 3) A physical button is assigned to each participant, and the participant can press the physical button when speaking, so that the online conference system can identify the current speaker through the physical button. In this way, different speakers in the online conference can be identified, solving the problem of identifying each current speaker and associating the minutes of the meeting with the real speaker.

[0129] Next, a solution for 1) enabling the online conference system to automatically identify the current speaker through virtual login of all participants to the online conference and speaker recognition technology is described in detail.

[0130] First, the online conference processing method provided in the embodiment of the present application is described from the product level.

[0131] (1) Meeting management objects (such as meeting hosts or co-hosts) can choose whether to enable virtual login in the meeting reservation interface, such as Figure 4 shown.

[0132] (2) When the conference management object chooses to enable virtual login, the conference management object can register its voiceprint by reading a few short sentences or uploading a piece of its own voice to the online conference system when logging into the online conference. Figure 5 shown.

[0133] (3) Figure 6 As shown, the conference management object can add virtual participants (corresponding to the conference participant object) in the member management interface. After the conference management object clicks to add a virtual participant, the online conference system automatically generates a QR code and displays it under the name of the conference management object. Since the virtual participant needs to be under the name of the conference management object, each conference room should have at least one conference management object.

[0134] (4) When a virtual participant virtually logs into a scheduled online meeting, the virtual participant can use a personal terminal (such as a mobile phone) to scan the QR code displayed under the name of the meeting management object. At this time, the virtual participant's personal terminal displays the following Figure 7 As shown in (2), the virtual participant can enter his or her mobile phone number to obtain a verification code, and then complete the virtual login of the virtual participant after entering the verification code, without having to enter the client login password of the online conference client.

[0135] (5) If the entered mobile phone number has not been registered with the online conference client, the online conference system will remind the user to register the online conference client, otherwise the virtual login cannot be completed. Fig.12 As shown, Fig.12 This is a registration diagram of an online conference client provided in an embodiment of the present application.

[0136] (6) When a virtual participant logs in virtually, he / she also needs to read a few short sentences or upload a voice clip of his / her own voice to the online conference system on his / her personal mobile phone to register the voiceprint of the corresponding virtual participant, such as Figure 7 As shown in (3).

[0137] (7) Figure 8As shown in (1), after the virtual login is completed, the online conference system automatically identifies the name, company, position and other information of the virtual participant through the mobile phone number, and displays the obtained information in the member management interface. The virtual participant can perform the operation of exiting the meeting, but cannot perform other operations such as turning on the microphone / camera and starting the shared screen. Operations such as turning on the microphone / camera and starting the shared screen can be performed by the conference management object.

[0138] (8) During an online conference, the online conference system uses the registered voiceprint to identify the current speaker of the online conference and marks the current speaker on the conference interface so that other participants can know which participant is speaking. Fig. 9 and Fig.10 As shown; at the same time, record the minutes of the meeting and associate the real speakers of the minutes with them, such as Fig.11 shown.

[0139] (9) Since online conferences are held for participants from multiple different conference venues, the online conference can include conference management objects corresponding to each conference venue. Participants from different conference venues virtually log in to the online conference through the conference management objects of the corresponding conference venues. Therefore, the conference management object can remove the virtual participants under its own name from the online conference, but cannot remove the virtual participants under other conference management objects from the online conference. Figure 8 shown.

[0140] (10) When the conference management object exits the online conference, the virtual participants under its name will also automatically exit the online conference.

[0141] Then, the online conference processing method provided in the embodiment of the present application is explained from a technical level.

[0142] See also Fig.13 , Fig.13 It is a flow chart of the processing method of online conference provided by the embodiment of the present application, including: the voice recognition module is mainly responsible for storing (registering) the voiceprint information of the participants (i.e., the meeting objects), and identifying the current speaker through the stored voiceprint information; the conference management module is mainly responsible for the meeting minutes after identifying the current speaker and the user interface display of the online conference system; the virtual participant management module is mainly responsible for the login of virtual participants, the management of virtual participants by the conference management object (i.e., the conference host), etc. It will be elaborated in detail below.

[0143] (1) Virtual participant management module. The virtual participant management module mainly implements the login of virtual participants and the binding of virtual participants with conference management objects. Fig.14 , Fig.14 : is a processing flow diagram of a virtual participant management module provided in an embodiment of the present application, including:

[0144] 1. The conference management object clicks "Add virtual participant". 2. The online conference system automatically generates a QR code for virtual login. 3. The virtual participant scans the QR code. 4. The virtual participant fills in the mobile phone number. 5. The online conference system determines whether the virtual participant's mobile phone number is registered with the online conference client. If so, execute 7, if not, execute 6. 6. Remind the virtual participant to register. 7. Automatically obtain the name, position and other information of the virtual participant (for use in the display of the conference system interface, meeting minutes and other scenarios), and bind the virtual participant to the conference management object. In this way, after the virtual participant logs in virtually, a binding relationship (many to one) is formed with the generator of the QR code (i.e., the conference management object). The binding relationship can be as follows Fig.15 As shown ( Fig.15 8. The conference management object clicks to remove a virtual participant. 9. The online conference system determines whether the virtual participant is bound to the conference management object. If so, execute 11. If not, execute 10. 10. Not bound, removal failed. 11. Already bound, remove the virtual participant.

[0145] It should be noted that the reason why it is called a virtual participant is that the participant does not log in to the online conference system independently through the online conference account and password in the true sense, but logs in virtually by scanning the QR code and binding the conference management object. No login password is entered during the virtual login, and the participant can only exit the online conference, but cannot turn on or off the microphone, share the screen, turn on or off the camera, etc. For the online conference system, there is always only one person (the conference management object) who is actually logged in.

[0146] (2) Speech recognition module. The speech recognition module mainly includes two functions: voiceprint registration and speaker identification. Fig.16 , Fig.16 This is a processing flow diagram of the speech recognition module provided in the embodiment of the present application, including: when registering voiceprints, a1) obtaining the voice of the participant AN; a2) extracting voiceprint features from the voice of the participant AN; a3) adding the extracted voiceprint features to the voiceprint feature library. When identifying a speaker, b1) obtaining the voice of the current speaker; b2) extracting voiceprint features from the voice of the current speaker; b3) matching the voiceprint features of the speaker's voice with the voiceprint features in the voiceprint feature library to obtain a matching result; b4) confirming the speaker ID based on the matching result.

[0147] Voiceprint feature is a kind of biometric feature, which is extracted when the speaker speaks. It can be used as a representation and identification of the speaker, and can be distinguished from other people's voice features, as well as the general term for the voice model established based on these features or parameters. Voiceprint recognition feature parameters can include Linear Predictive Coding (LPC) features and Mel Frequency Cepstrum Coefficient (MFCC) features. See Fig.17 , Fig.17 is a schematic diagram of storing voiceprint features provided in an embodiment of the present application. After the online conference system extracts the voiceprint features of the participants, it will be stored in Fig.17 When a participant in the same conference room speaks, the online conference system extracts the speaker's voiceprint features and cross-searches them in the above voiceprint feature library to see if they match the voiceprint features in the voiceprint feature library. If the match is successful, it means that the current speaker has been identified. After the speaker is identified, the speaker's relevant information (such as name, position information, etc.) can be used in the conference management module to identify the speaker.

[0148] (3) Conference management module. The conference management module mainly identifies the virtual participant who is currently speaking in the conference system interface, meeting minutes interface and other interfaces with participant identification after identifying the virtual participant who is currently speaking. For example: a) The participant interface, including the participant main interface and the participant list interface, displays the name, position information, etc. of the virtual participant. b) The current speaker interface, including the participant main interface and the participant list interface, displays the identification of the virtual participant who is currently speaking (microphone of the target color (such as green)). c) The meeting minutes interface displays the name of the virtual participant and the content of the meeting minutes. In actual applications, subsequent interfaces that need to identify the current speaker can use similar methods to identify the virtual participant who is currently speaking.

[0149] By applying the above-mentioned embodiments of the present application, in a conference scenario where multiple people participate in an online conference in the same conference room and only log in to one conference account / device, when any target participant in the online conference speaks, an identifier indicating that the target participant is speaking is displayed to identify the different current speakers in the online conference; at the same time, through speaker recognition technology, the online conference system can automatically identify the current speaker, thereby solving the problem of associating meeting minutes with the real speaker.

[0150] The following is a description of an exemplary structure of the online conference processing device 555 provided in the embodiment of the present application implemented as a software module. In some embodiments, Figure 2As shown, the software modules in the online conference processing device 555 stored in the memory 550 may include: a first display module 5551, used to display the conference interface of the online conference logged in through a target account, and the target account is used for multiple conference objects in a conference venue to participate in the online conference; a second display module 5552, used to display instruction information for instructing the target conference object to speak in the conference interface when any target conference object among the multiple conference objects speaks.

[0151] In some embodiments, the first display module 5551 is further used to display a conference reservation interface before displaying a conference interface of an online conference logged in through a target account; based on the conference reservation interface, receive conference setting information for the online conference; and in response to a confirmation operation on the conference setting information, reserve the online conference.

[0152] In some embodiments, the online conference has an object voiceprint library, which includes the object voiceprint of each of the multiple conference objects; the second display module 5552 is also used to perform voice detection on the online conference before displaying the indication information for indicating the target conference object to speak in the conference interface when any target conference object among the multiple conference objects speaks, and when the target voice is detected, obtain the voice voiceprint of the target voice; match the voice voiceprint with each of the object voiceprints respectively to obtain a matching result; when the matching result indicates that there is a target object voiceprint that matches the voice voiceprint, determine that the conference object with the target object voiceprint is speaking, wherein the conference object with the target object voiceprint is the target conference object.

[0153] In some embodiments, the target account belongs to a conference management object among the multiple conference objects, and the first display module 5551 is further used to, before displaying the conference interface of the online conference logged in through a target account, respond to the first entry instruction of the conference management object for the online conference, display the voiceprint registration interface of the online conference; based on the voiceprint registration interface, receive the object voice of the conference management object; in response to the confirmation operation of the object voice, add the voiceprint of the object voice as the object voiceprint of the conference management object to the object voiceprint library.

[0154] In some embodiments, the first display module 5551 is also used to display a voice collection control and a voice collection reference text in the voiceprint registration interface; the first display module 5551 is also used to receive the object voice of the conference management object reading the voice collection reference text based on the voice collection control.

[0155] In some embodiments, the first display module 5551 is also used to display a voice file upload control in the voiceprint registration interface; the first display module 5551 is also used to receive the uploaded voice file of the conference management object based on the voice file upload control; in response to a confirmation operation on the voice file, the voice included in the voice file is used as the object voice.

[0156] In some embodiments, the target account belongs to a conference management object among the multiple conference objects, and the first display module 5551 is further used to display a conference object adding control of the online conference; in response to a triggering operation of the conference management object on the conference object adding control, the conference joining information is displayed; wherein the conference joining information is used to respond to a joining instruction for the online conference triggered by a conference participant object based on the conference joining information, and join the online conference through a virtual login mode, and the conference participant object is a conference object other than the conference management object among the multiple conference objects; wherein the virtual login mode is used to indicate that when a virtual login account of the conference participant object is received, the virtual login account is bound to the target account, and the object voiceprint of the conference participant object is registered to the object voiceprint library, so that the conference participant object joins the online conference based on the virtual login account.

[0157] In some embodiments, the first display module 5551 is also used to display a virtual login switch of the online meeting; in response to an on instruction for the virtual login switch, the online meeting is controlled to be in the virtual login mode; the first display module 5551 is also used to display a conference object adding control of the online meeting when the online meeting is in the virtual login mode.

[0158] In some embodiments, the conference participant joins the online conference through the virtual login mode, and the first display module 5551 is also used to display an account removal control of the virtual login account; in response to a trigger operation on the account removal control, the virtual login account is controlled to exit the online conference.

[0159] In some embodiments, the conference participant joins the online conference through the virtual login mode, and the first display module 5551 is further used to control the target account to exit the online conference in response to a conference exit operation for the target account, and to control the virtual login account bound to the target account to exit the online conference.

[0160] In some embodiments, each of the multiple conference objects corresponds to a speech control button respectively; the second display module 5552 is also used to detect whether the speech control button corresponding to each of the conference objects is in a pressed state before displaying the indication information for indicating the target conference object to speak in the conference interface when any target conference object among the multiple conference objects is speaking, and obtain a detection result; when the detection result indicates that the target speech control button is in a pressed state, it is determined that the conference object corresponding to the target speech control button is speaking, wherein the conference object corresponding to the target speech control button is the target conference object.

[0161] In some embodiments, the second display module 5552 is also used to perform voice detection on the online conference before displaying the indication information for instructing the target conference object to speak in the conference interface when any target conference object among the multiple conference objects speaks, and when the target voice is detected, identify the target sound direction of the target voice; obtain the object sound direction of each of the multiple conference objects, and match the target sound direction with the sound direction of each object respectively to obtain a matching result; when the matching result indicates that there is a target object sound direction that matches the target sound direction, determine that the conference object corresponding to the target object sound direction is speaking, wherein the conference object corresponding to the target object sound direction is the target conference object.

[0162] In some embodiments, the second display module 5552 is further used to display the target object identifier of the target conference object in the conference interface, and to display instruction information for instructing the target conference object to speak in an associated area of ​​the target object identifier.

[0163] In some embodiments, each of the conference objects has a corresponding object meeting minutes, and the second display module 5552 is also used to respond to a meeting minutes viewing operation for the online meeting, and perform the following processing for each of the conference objects: display the object meeting minutes of the conference object, and display minutes indication information indicating that the object meeting minutes belong to the conference object.

[0164] In some embodiments, the first display module 5551 is further used to display a virtual login interface of the target online conference in response to a conference joining instruction for the target online conference triggered by the target object based on the conference joining information of the target online conference; based on the virtual login interface, receive a virtual login account for the target online conference; in response to a confirmation operation on the virtual login account, bind the virtual login account to a real login account of the target online conference, and display a voiceprint registration interface of the target online conference; based on the voiceprint registration interface, receive the object voice of the target object; in response to a confirmation operation on the object voice, add the voiceprint of the object voice as the object voiceprint of the target object to the object voiceprint library of the target online conference, so that the target object joins the target online conference based on the virtual login account.

[0165] In some embodiments, the first display module 5551 is further used to receive the meeting join instruction in one of the following ways: when the meeting join information is a meeting join graphic code, the meeting join instruction is received in response to a scanning operation on the meeting join graphic code; when the meeting join information is a meeting join link, the meeting join instruction is received in response to an access operation on the meeting join link; and when the meeting join information is a meeting join password, the meeting join instruction is received in response to an identification operation on the meeting join password.

[0166] By applying the above-mentioned embodiment of the present application, when an online conference is logged in through a target account, and the target account is used for multiple conference objects in a conference venue to participate in the online conference, when any of the multiple conference objects speaks, the instruction information for instructing the target conference object to speak can be displayed in the conference interface. In this way, for a conference scenario where multiple objects participate in an online conference through a conference account in the same conference venue, different speech instruction information can be displayed when different conference objects speak, so as to clearly identify which conference object among the multiple conference objects is speaking through the speech instruction information, thereby improving the meeting efficiency and meeting experience of the online conference.

[0167] The embodiment of the present application also provides a computer program product, which includes computer executable instructions or computer programs, and the computer executable instructions or computer programs are stored in a computer-readable storage medium. The processor of the electronic device reads the computer executable instructions or computer programs from the computer-readable storage medium, and the processor executes the computer executable instructions or computer programs, so that the electronic device executes the online conference processing method provided in the embodiment of the present application.

[0168] An embodiment of the present application also provides a computer-readable storage medium, which stores computer-executable instructions or a computer program. When the computer-executable instructions or the computer program are executed by a processor, the processor will execute the online conference processing method provided in the embodiment of the present application.

[0169] In some embodiments, the computer-readable storage medium may be a memory such as RAM, ROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or may be various devices including one or any combination of the above memories.

[0170] In some embodiments, computer executable instructions may be in the form of a program, software, software module, script or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a stand-alone program or as a module, component, subroutine or other unit suitable for use in a computing environment.

[0171] As an example, computer-executable instructions may, but need not, correspond to a file in a file system, may be stored as part of a file that stores other programs or data, such as in one or more scripts in a HyperText Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files storing one or more modules, subroutines, or code portions).

[0172] As an example, computer executable instructions may be deployed to be executed on one electronic device, or on multiple electronic devices located at one site, or on multiple electronic devices distributed at multiple sites and interconnected by a communication network.

[0173] The above is only an embodiment of the present application and is not intended to limit the protection scope of the present application. Any modifications, equivalent substitutions and improvements made within the spirit and scope of the present application are included in the protection scope of the present application.

Claims

1. A method for processing an online conference, characterized in that: The method comprises: Displaying a conference interface of an online conference logged in by a target account, wherein the target account is used for multiple conference objects in a conference venue to participate in the online conference; When any target conference object among the multiple conference objects speaks, instruction information for instructing the target conference object to speak is displayed in the conference interface.

2. The method according to claim 1, characterized in that Before displaying the conference interface of the online conference logged in by a target account, the method further includes: Display the conference reservation interface; Based on the conference reservation interface, receiving conference setting information for the online conference; In response to a confirmation operation on the conference setting information, the online conference is scheduled.

3. The method according to claim 1, characterized in that The online conference has an object voiceprint library, and the object voiceprint library includes the object voiceprint of each of the multiple conference objects; When any target conference object among the multiple conference objects speaks, before displaying instruction information for instructing the target conference object to speak in the conference interface, the method further includes: Performing voice detection on the online conference, and when a target voice is detected, obtaining a voice print of the target voice; Matching the voice print with the voice prints of the objects to obtain matching results; When the matching result indicates that there is a target object voiceprint matching the speech voiceprint, it is determined that the conference object having the target object voiceprint is speaking, wherein the conference object having the target object voiceprint is the target conference object.

4. The method according to claim 3, characterized in that The target account belongs to a conference management object among the multiple conference objects. Before displaying a conference interface of an online conference logged in by a target account, the method further includes: In response to the first entry instruction of the conference management object for the online conference, displaying a voiceprint registration interface for the online conference; Based on the voiceprint registration interface, receiving the object voice of the conference management object; In response to a confirmation operation on the object voice, the voiceprint of the object voice is added to the object voiceprint library as the object voiceprint of the conference management object.

5. The method according to claim 4, characterized in that The method further comprises: In the voiceprint registration interface, a voice collection control and a voice collection reference text are displayed; The receiving the object voice of the conference management object based on the voiceprint registration interface includes: Based on the voice collection control, the object voice of the conference management object reading the voice collection reference text is received.

6. The method according to claim 4, characterized in that The method further comprises: In the voiceprint registration interface, a voice file upload control is displayed; The receiving the object voice of the conference management object based on the voiceprint registration interface includes: Based on the voice file upload control, receiving the uploaded voice file of the conference management object; In response to a confirmation operation on the voice file, the voice included in the voice file is used as the target voice.

7. The method according to claim 3, characterized in that The target account belongs to a conference management object among the multiple conference objects, and the method further includes: Display a conference object adding control for the online conference; In response to a triggering operation of the conference management object to add a control to the conference object, displaying conference joining information; The conference joining information is used to respond to a joining instruction for the online conference triggered by a conference participant based on the conference joining information, and join the online conference through a virtual login mode, wherein the conference participant object is a conference object other than the conference management object among the multiple conference objects; Among them, the virtual login mode is used to indicate that when the virtual login account of the conference participant is received, the virtual login account is bound to the target account, and the object voiceprint of the conference participant is registered to the object voiceprint library, so that the conference participant can join the online meeting based on the virtual login account.

8. The method according to claim 7, characterized in that The method further comprises: Display a virtual login switch for the online conference; In response to an on instruction for the virtual login switch, controlling the online conference to be in the virtual login mode; The adding control of the conference object for displaying the online conference includes: When the online conference is in the virtual login mode, a conference object adding control of the online conference is displayed.

9. The method according to claim 7, characterized in that The conference participant joins the online conference through the virtual login mode, and the method further includes: Display an account removal control for the virtual login account; In response to a triggering operation on the account removal control, the virtual login account is controlled to exit the online conference.

10. The method according to claim 7, characterized in that The conference participant joins the online conference through the virtual login mode, and the method further includes: In response to the conference exit operation for the target account, the target account is controlled to exit the online conference, and the virtual login account bound to the target account is controlled to exit the online conference.

11. The method according to claim 1, characterized in that Each of the multiple conference objects corresponds to a speech control button; When any target conference object among the multiple conference objects speaks, before displaying instruction information for instructing the target conference object to speak in the conference interface, the method further includes: Detecting whether the speech control button corresponding to each of the conference objects is in a pressed state, and obtaining a detection result; When the detection result indicates that the target speech control button is in a pressed state, it is determined that the conference object corresponding to the target speech control button is speaking, wherein the conference object corresponding to the target speech control button is the target conference object.

12. The method according to claim 1, characterized in that When any target conference object among the multiple conference objects speaks, before displaying instruction information for instructing the target conference object to speak in the conference interface, the method further includes: Performing voice detection on the online conference, and when a target voice is detected, identifying a target utterance direction of the target voice; Acquire the object sound direction of each of the multiple conference objects, and match the target sound direction with the sound direction of each object respectively to obtain a matching result; When the matching result indicates that there is a target object sound direction that matches the target sound direction, it is determined that the conference object corresponding to the target object sound direction is speaking, wherein the conference object corresponding to the target object sound direction is the target conference object.

13. The method according to claim 1, characterized in that The displaying, in the conference interface, instruction information for instructing the target conference object to speak includes: In the conference interface, the target object identifier of the target conference object is displayed, and Instruction information for instructing the target conference object to speak is displayed in the associated area of ​​the target object identifier.

14. The method according to claim 1, wherein: Each of the conference objects has a corresponding object meeting minutes, and the method further includes: In response to the conference minutes viewing operation for the online conference, the following processing is performed for each of the conference objects: The object meeting minutes of the conference object are displayed, and the minutes indication information for indicating that the object meeting minutes belong to the conference object is displayed.

15. The method according to claim 1, wherein: The method further comprises: In response to a conference joining instruction for the target online conference triggered by the target object based on the conference joining information of the target online conference, displaying a virtual login interface of the target online conference; Based on the virtual login interface, receiving a virtual login account for the target online conference; In response to a confirmation operation on the virtual login account, binding the virtual login account to a real login account of the target online conference, and displaying a voiceprint registration interface of the target online conference; Based on the voiceprint registration interface, receiving the target object's voice; In response to a confirmation operation on the target voice, the voiceprint of the target voice is added as the target voiceprint of the target object to the object voiceprint library of the target online conference, so that the target object joins the target online conference based on the virtual login account.

16. The method according to claim 15, characterized in that The method further comprises: The conference joining instruction is received in one of the following ways: When the conference joining information is a conference joining graphic code, in response to a scanning operation on the conference joining graphic code, the conference joining instruction is received; When the conference joining information is a conference joining link, in response to an access operation to the conference joining link, receiving the conference joining instruction; And, when the conference joining information is a conference joining password, the conference joining instruction is received in response to an identification operation for the conference joining password.

17. A device for processing an online conference, characterized in that: The device comprises: A first display module, used to display a conference interface of an online conference logged in by a target account, wherein the target account is used for multiple conference objects in a conference place to participate in the online conference; The second display module is used to display instruction information for instructing any target conference object among the multiple conference objects to speak in the conference interface when the target conference object speaks.

18. An electronic device, characterized in that: The electronic device comprises: A memory for storing computer executable instructions; The processor is used to implement the online conference processing method described in any one of claims 1 to 16 when executing the computer executable instructions stored in the memory.

19. A computer-readable storage medium storing computer-executable instructions or a computer program, characterized in that: When the computer executable instructions or computer program are executed by a processor, the online conference processing method described in any one of claims 1 to 16 is implemented.

20. A computer program product comprising computer executable instructions or a computer program, characterized in that When the computer executable instructions or computer program are executed by a processor, the online conference processing method described in any one of claims 1 to 16 is implemented.

Images