Microphone connection methods, devices, equipment, storage media, and computer programs

Abstract

Embodiments of this disclosure provide a virtual microphone connection method, apparatus, device, and storage medium. Based on a first microphone connection operation triggered in a live streaming room by a target object, a virtual microphone connection interface is displayed; based on a second microphone connection operation triggered on the virtual microphone connection interface by the target object, a virtual microphone connection request is generated; the virtual microphone connection request is sent to a live streaming server to cause the live streaming server to create at least one virtual object; information of the at least one virtual object is received from the live streaming server; and the information of the at least one virtual object is displayed in the corresponding microphone area.

Description

Technical Field

[0001] (Cross - reference to related applications) This application claims the priority of a Chinese patent application filed with the China National Intellectual Property Administration on March 24, 2023, with the application number 202310316110.8 and the invention title "Microphone Connection Method, Device, Equipment and Storage Medium", and all of its content is incorporated into this application by reference.

[0002] The embodiments of the present disclosure relate to the field of live streaming technology, and particularly to a microphone connection method, device, equipment and storage medium.

Background Art

[0003] Many current live streaming rooms support the connection of multiple microphones (collaborative live streaming). Therefore, in the development and testing of live streaming rooms, it is always necessary to test the microphone connection status. The conventional microphone connection test solutions are relatively inefficient and prone to errors.

Summary of the Invention

Problems to be Solved by the Invention

[0004] The embodiments of the present disclosure provide a microphone connection method, device, equipment and storage medium that reduce the development and testing cost of microphone connection and improve the development and testing efficiency of microphone connection. [[ID=三十]]

Means for Solving the Problems

[0005] According to a first aspect, the embodiments of the present disclosure provide a microphone connection method, which is executed by a client, displaying a virtual microphone connection interface based on a first microphone connection operation triggered in a live streaming room by a target object; generating a virtual microphone connection request based on a second microphone connection operation triggered by the target object on the virtual microphone connection interface; The virtual microphone connection request is sent to the live streaming server, causing the live streaming server to create at least one virtual object. The system includes receiving information about at least one virtual object returned from the live streaming server and displaying the information about the at least one virtual object in the corresponding microphone area.

[0006] According to a second aspect, embodiments of the present disclosure further provide a microphone connection method, the method being performed by a live streaming server, The live streaming room receives a virtual microphone connection request sent by the client, and creates a virtual object based on the said virtual microphone connection request. A microphone connection request is sent to the microphone connection server based on the virtual object, and the microphone connection server establishes a microphone connection between the virtual object and the target object based on the microphone connection request. The system includes receiving microphone connection success information returned from the microphone connection server, transmitting information about the virtual object to the client based on the microphone connection success information, and causing the client to display the information about the virtual object in the corresponding microphone area.

[0007] According to a third aspect, an embodiment of the present disclosure further provides a virtual microphone connection device, the device being installed on a client, A virtual microphone connection interface display module for displaying the virtual microphone connection interface based on the first microphone connection operation triggered in the live streaming room by the target object, A virtual microphone connection request generation module for generating a virtual microphone connection request based on a second microphone connection operation triggered on the virtual microphone connection interface by a target object, A virtual microphone connection request transmission module that sends the aforementioned virtual microphone connection request to the live streaming server, causing the live streaming server to create at least one virtual object, The system includes an information display module for receiving information about at least one virtual object returned from the live streaming server and displaying the information about the at least one virtual object in the corresponding microphone area.

[0008] According to a fourth aspect, an embodiment of the present disclosure further provides a virtual microphone connection device, the device being installed on a live streaming server, A virtual microphone connection request receiving module for receiving virtual microphone connection requests sent by a client in a live streaming room and creating a virtual object based on the said virtual microphone connection request, A microphone connection request transmission module that sends a microphone connection request to a microphone connection server based on the virtual object, and causes the microphone connection server to establish a microphone connection between the virtual object and the target object based on the microphone connection request, The system includes an information transmission module that receives microphone connection success information returned from the microphone connection server, transmits information about the virtual object to the client based on the microphone connection success information, and causes the client to display the information about the virtual object in the corresponding microphone area.

[0009] According to a fifth aspect, embodiments of the present disclosure further provide an electronic device, the electronic device being: One or more processors, A storage device for storing one or more programs, The one or more programs are executed by the one or more processors to enable the one or more processors to implement the virtual microphone connection method described in the embodiment of this disclosure.

[0010] According to a sixth aspect, embodiments of the present disclosure further provide a storage medium containing computer executable instructions, which is used to perform the virtual microphone connection method described in embodiments of the present disclosure when the computer executable instructions are executed by a computer processor. [Effects of the Invention]

[0011] Embodiments of this disclosure disclose a virtual microphone connection method, apparatus, device, and storage medium that display a virtual microphone connection interface based on a first microphone connection operation triggered in a live streaming room by a target object, generate a virtual microphone connection request based on a second microphone connection operation triggered on the virtual microphone connection interface by the target object, send the virtual microphone connection request to a live streaming server to cause the live streaming server to create at least one virtual object, receive information about at least one virtual object returned from the live streaming server, and display the information about at least one virtual object in the corresponding microphone area. [Brief explanation of the drawing]

[0012] Referring to the embodiments for carrying out the invention described below, while linking the drawings, will make the above and other features, advantages and aspects of each embodiment of the present disclosure more apparent. Throughout the drawings, the same or similar symbols represent the same or similar elements. It should be understood that the drawings are schematic and parts and elements are not necessarily depicted in proportion. [Figure 1] This is a flowchart of the microphone connection method according to the embodiment of this disclosure. [Figure 2] This is a schematic diagram showing a virtual microphone connection interface according to an embodiment of the present disclosure. [Figure 3] This is a flowchart of the microphone connection method according to the embodiment of this disclosure. [Figure 4] This is a signaling diagram of a microphone connection method according to an embodiment of the present disclosure. [Figure 5] This is a schematic diagram of the structure of a microphone connection device according to an embodiment of the present disclosure. [Figure 6] This is a schematic diagram of the structure of a microphone connection device according to an embodiment of the present disclosure. [Figure 7] This is a schematic diagram of the structure of an electronic device according to an embodiment of the present disclosure. [Modes for carrying out the invention]

[0013] The following describes embodiments of the present disclosure in more detail with reference to the drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be implemented in various forms and should not be construed as limited to the embodiments described herein. On the contrary, these embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are used only for exemplary purposes and are not intended to limit the protection scope of the present disclosure.

[0014] It should be understood that each step described in the method embodiments of the present disclosure may be executed in a different order and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the execution of the steps shown. The scope of the present disclosure is not limited in this regard.

[0015] As used herein, the term "comprising" and its variations are open-ended, i.e., "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" represents "at least one embodiment", the term "another embodiment" represents "at least one another embodiment", and the term "some embodiments" represents "at least some embodiments". Related definitions of other terms are given in the following description.

[0016] It should be noted that concepts such as "first", "second", etc. mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not intended to limit the order or interdependence of the functions executed by these devices, modules or units.

[0017] It should be noted that the modifiers "one" and "plural" mentioned in the present disclosure are not restrictive but general. As those skilled in the art should understand, unless specifically stated in the context, it should be understood as "one or more".

[0018] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and do not limit the scope of such messages or information.

[0019] To ensure understanding, before using any of the technical proposals disclosed in each embodiment of this disclosure, the target object should be notified in an appropriate manner in accordance with applicable laws and regulations regarding the type of personal information relating to this disclosure, the scope of use, the usage scenario, etc., and permission from the target object should be obtained.

[0020] For example, when responding to a voluntary request from a target object, an operation that sends prompt information to the target object to explicitly prompt and request the target object to perform the operation requires obtaining and using the target object's personal information. This allows the target object to autonomously choose whether or not to provide personal information to software or hardware such as electronic devices, application programs, servers, or storage media that perform the operation of the proposed technique of this disclosure, in accordance with the prompt information.

[0021] As a selective but not restrictive implementation method, the method of sending prompt information to the target object in response to receiving a voluntary request from the target object may be, for example, a pop-up window, or the prompt information may be presented in text format within the pop-up window. The pop-up window may also include selection controls for the target object to choose whether to "agree" or "disagree" to providing personal information to the electronic device.

[0022] To ensure that this is understood, the above notice and target object authorization process are general in nature and do not constitute a limitation on the methods of implementing this disclosure. Other methods that comply with applicable laws and regulations may also be used to implement this disclosure.

[0023] To ensure clarity, all data relating to this proposed technology (including, but not limited to, the data itself, its acquisition, or its use) must comply with the requirements of applicable laws, regulations, and related provisions.

[0024] Figure 1 is a flowchart of a microphone connection method according to an embodiment of the present disclosure, which applies when a microphone connection is made between a target object and a virtual object, and this method may be performed by a microphone connection device, which may be implemented in software and / or hardware form, and optionally, the device may be installed on an electronic device where the client is located, which may be a mobile terminal, a PC terminal or a server, etc.

[0025] As shown in Figure 1, the method includes the following:

[0026] S110 displays the virtual microphone connection interface based on the first microphone connection operation triggered in the live streaming room by the target object.

[0027] Here, the virtual microphone connection interface displays at least one microphone connection control. The virtual microphone connection interface may be provided by a virtual microphone connection tool, which may be configured in the live streaming room when testing the microphone connection. The target object may be a real object, which can create a live streaming room in the live streaming app, thereby enabling live streaming in the live streaming room or microphone connection interaction with other objects.

[0028] In this embodiment, after a user creates and enters a live streaming room, the virtual microphone connection interface can be displayed by opening the virtual microphone connection tool via a pre-configured debug entry point in the live streaming room. Here, the debug entry point may be embodied in the form of a button. The virtual microphone connection interface displays triggerable microphone connection controls, and the user sends a virtual microphone connection request to the live streaming server by triggering the microphone connection controls.

[0029] The process of selectively displaying a virtual microphone connection interface based on a first microphone connection operation triggered in a live streaming room by a target object may include, when detecting that the target object has triggered a first virtual microphone connection operation in the live streaming room, determining the number of available microphones in the live streaming room, displaying the virtual microphone connection interface based on the first virtual microphone connection operation, and generating microphone connection controls for the number of available microphones in the virtual microphone connection interface.

[0030] Here, the number of available microphones can be understood as the number of microphones that are not currently connected, and the number of microphone connection controls in the virtual microphone connection interface is determined by the number of available microphones. In this embodiment, the total number of microphones that can be connected is predetermined in the live streaming room, and when it is detected that the target object has triggered the first virtual microphone connection operation in the live streaming room, the number of microphones that are currently already connected is determined first, and then the number of microphones that are already connected is subtracted from the total number of microphones to obtain the number of available microphones. For example, if the total number of microphones that can be connected in the live streaming room is 9, and the number of microphones that are currently already connected is 4, then the number of available microphones is 5, and that is, the number of microphone connection controls in the virtual microphone connection interface is also 5. For illustrative purposes, Figure 2 is a schematic diagram showing the virtual microphone connection interface in this embodiment. As shown in Figure 2, in the left diagram, when the target object clicks the "Virtual Microphone Connection" button in the live streaming room, if the terminal has already connected 4 microphones, it determines the number of available microphones to be 5. In the right diagram, the virtual microphone connection interface pops up on the live streaming room page, and 5 microphone connection controls are generated in the virtual microphone connection interface.

[0031] S120 generates a virtual microphone connection request based on a second microphone connection operation triggered by the target object on the virtual microphone connection interface.

[0032] In this embodiment, the process of generating a virtual microphone connection request based on a second microphone connection operation triggered by the target object on the virtual microphone connection interface may also be the process of generating a virtual microphone connection request based on a second microphone connection operation triggered by the target object on at least one microphone connection control.

[0033] Specifically, virtual microphone connection requests are generated based on a second microphone connection operation triggered by the target object on the virtual microphone connection interface. That is, after the virtual microphone connection interface pops up, the user can generate virtual microphone connection requests by clicking on all or some of the microphone connection controls on the virtual microphone connection interface. Here, the number of virtual microphone connection requests depends on the number of microphone connection controls clicked on the target object. For example, in Figure 2, five microphone connection controls are displayed on the virtual microphone connection interface, and the user can generate three virtual microphone connection requests by clicking on three of these controls.

[0034] S130 sends a virtual microphone connection request to the live streaming server, causing the live streaming server to create at least one virtual object.

[0035] In this embodiment, the client generates a virtual microphone connection request and then sends the virtual microphone connection request to the live streaming server. The live streaming server first creates a virtual object based on the virtual microphone connection request, and then sends a microphone connection request to the microphone connection server based on the virtual object. The microphone connection server then establishes a microphone connection between the virtual object and the target object based on the microphone connection request. Upon receiving microphone connection success information returned from the microphone connection server, the live streaming server sends the virtual object information to the client.

[0036] S140 receives information about at least one virtual object returned from the live streaming server and displays the information about at least one virtual object in the corresponding microphone area.

[0037] Here, the virtual object information includes at least the virtual object identifier information and the audio and video associated with the virtual object, and the identifier information may be the name of the virtual object, an avatar, or other information. In this embodiment, when the client where the target object is located receives information on at least one virtual object returned from the live streaming server, it indicates that a microphone connection has been successfully established between the target object and at least one virtual object, and that the virtual object information is displayed in the corresponding microphone area. That is, the virtual object information is displayed in the corresponding microphone area, or the audio and video are played in the corresponding microphone area.

[0038] The technical solution of the embodiment of this disclosure displays a virtual microphone connection interface based on a first microphone connection operation triggered in a live streaming room by a target object, generates a virtual microphone connection request based on a second microphone connection operation triggered on the virtual microphone connection interface by the target object, sends the virtual microphone connection request to a live streaming server to cause the live streaming server to create at least one virtual object, receives information of at least one virtual object returned from the live streaming server, and displays the information of at least one virtual object in the corresponding microphone area. The microphone connection method according to the embodiment of this disclosure realizes a microphone connection between a target object and a virtual object by sending a client microphone connection request to a live streaming server to cause the live streaming server to create a virtual object, and can complete microphone connection development and testing using the virtual object, without requiring actual equipment, and can reduce the development and testing costs of microphone connections as well as improve the efficiency of microphone connection development and testing.

[0039] Figure 3 is a flowchart of a microphone connection method according to an embodiment of the present disclosure, which applies when a target object and a virtual object make a microphone connection, and this method may be performed by a microphone connection device, which may be implemented in software and / or hardware form, and optionally, the device may be installed on an electronic device on which a live streaming server is located.

[0040] As shown in Figure 3, the method includes the following:

[0041] S310 receives a virtual microphone connection request sent by the client in the live streaming room and creates a virtual object based on the virtual microphone connection request.

[0042] Here, the virtual microphone connection request may be triggered and generated by the target object in the client's live streaming room, and the triggering method can be found in the above embodiment and will not be described further here. The virtual object may also be called a robot instance, and may be a single structured data, the structure of which is pre-configured by the developer.

[0043] In this embodiment, after the live streaming server receives a microphone connection request sent by the client, it first determines whether or not this microphone connection request is a virtual microphone connection request. If it is a virtual microphone connection request, it creates a virtual object based on this virtual microphone connection request.

[0044] A method for selectively creating virtual objects based on virtual microphone connection requests involves obtaining information about pre-stored virtual objects and generating configuration structured data based on that information to obtain the virtual objects.

[0045] Here, the information of a virtual object may include identifier information of the virtual object, such as its name and avatar. In this embodiment, a list of virtual object information is constructed in advance and stored in a database. After the live streaming server receives a virtual microphone connection request, it randomly retrieves information of one virtual object from this list. After obtaining the virtual object information, the virtual object is obtained by assembling the virtual object information according to the configuration structure and generating configuration structured data.

[0046] S320 sends a microphone connection request to the microphone connection server based on the virtual object, causing the microphone connection server to establish a microphone connection between the virtual object and the target object based on the microphone connection request.

[0047] Here, the microphone connection server may be understood as a server responsible for microphone connections, and may, for example, be a Web Real-Time Communication (WebRTC) server. In this embodiment, the microphone connection server establishing a microphone connection between the virtual and the target object based on a microphone connection request can refer to, but is not limited to, the microphone connection function of a conventional WebRTC server.

[0048] Here, sending a microphone connection request to the live streaming server microphone connection server may be done by the microphone connection engine. Specifically, the method of sending a microphone connection request to the microphone connection server based on a virtual object may involve activating the microphone connection engine and having the microphone connection engine send the microphone connection request to the microphone connection server.

[0049] Here, the microphone connection request carries information about a virtual object. The microphone connection engine has the function of calling the microphone connection server, and may be, for example, the WebRTC Software Development Kit (WebRTC SDK). The microphone connection engine may be deployed on the live streaming server or on the browser. If the microphone connection engine is deployed on the live streaming server, the live streaming server may operate the microphone connection engine directly, thereby sending a microphone connection request to the microphone connection server. If the microphone connection engine is deployed on the browser, the browser must be started first, and then the microphone connection engine must be operated within the browser.

[0050] A method for selectively activating the microphone connection engine may be to launch a headless browser and activate the microphone connection engine within the headless browser.

[0051] Here, the headless browser can be any conventional browser, such as the Chrome browser. Specifically, a virtual object is created, the headless browser is launched, the microphone connection engine is activated in the headless browser, and finally the microphone connection engine sends a microphone connection request to the microphone connection server.

[0052] When the S330 successfully connects to the microphone, it sends information about the virtual object to the client, causing the client to display the virtual object information in the corresponding microphone area.

[0053] Here, the virtual object information includes at least the identifier information of the virtual object and the audio and video associated with the virtual object. In this embodiment, after the microphone connection server establishes a microphone connection between the virtual object and the target object, it returns microphone connection success information to the live streaming server, and the live streaming server sends the virtual object information to the client based on the microphone connection success information, causing the client to display the virtual object information in the corresponding microphone area.

[0054] The technical proposal of this embodiment receives a virtual microphone connection request sent by a client in a live streaming room, creates a virtual object based on the virtual microphone connection request, sends a microphone connection request to a microphone connection server based on the virtual object, has the microphone connection server establish a microphone connection between the virtual object and the target object based on the microphone connection request, receives microphone connection success information returned from the microphone connection server, sends information about the virtual object to the client based on the microphone connection success information, and has the client display the information about the virtual object in the corresponding microphone area. By generating a virtual object based on a virtual microphone connection request sent by a client and establishing a microphone connection between the virtual object and the target object via the microphone connection server, a microphone connection between the target object and the virtual object is realized, microphone connection development and testing can be completed using the virtual object, and no physical equipment is required, not only reducing the development and testing costs of the microphone connection but also improving the efficiency of the development and testing of the microphone connection.

[0055] Based on the above embodiment, Figure 4 is a signaling diagram of the microphone connection method in this embodiment, and as shown in Figure 4, this method includes the following steps.

[0056] 1. The target object opens the virtual microphone connection interface in the live streaming room, clicks the microphone connection control, and generates a virtual microphone connection request. 2. The client sends a virtual microphone connection request to the live streaming server. 3. The live streaming server creates a virtual object based on the virtual microphone connection request, launches a headless browser, and activates the microphone connection engine in the headless browser. 4. The live streaming server sends a microphone connection request to the microphone connection server via the microphone connection engine. 5. The microphone connection server establishes a microphone connection between the virtual object and the target object. 6. The microphone connection server returns information to the live streaming server indicating that the microphone connection was successful. 7. The live streaming server sends information about the virtual object to the client. 8. The client displays information about the virtual object to the corresponding microphone.

[0057] Figure 5 is a schematic diagram of the structure of a microphone connection device according to an embodiment of the present disclosure. As shown in Figure 5, the device is A virtual microphone connection interface display module 510 is used to display the virtual microphone connection interface based on a first microphone connection operation triggered in the live streaming room by a target object, A virtual microphone connection request generation module 520 for generating a virtual microphone connection request based on a second microphone connection operation triggered on the virtual microphone connection interface by a target object, A virtual microphone connection request transmission module 530 that sends the virtual microphone connection request to the live streaming server and causes the live streaming server to create at least one virtual object, The system includes an information display module 540 for receiving information about at least one virtual object returned from the live streaming server and displaying the information about the at least one virtual object in the corresponding microphone area.

[0058] Selectively, the virtual microphone connection interface display module 510 further, If the target object is detected to have triggered the first virtual microphone connection operation in the live streaming room, the number of available microphones in the live streaming room is determined. It is used to display the virtual microphone connection interface based on the first virtual microphone connection operation and to generate microphone connection controls for the number of available microphones in the virtual microphone connection interface.

[0059] Selectively, the virtual microphone connection request generation module 520 further, It is used to generate a virtual microphone connection request based on a second microphone connection operation triggered by the target object for at least one microphone connection control.

[0060] Figure 6 is a schematic diagram of the structure of a microphone connection device according to an embodiment of the present disclosure. As shown in Figure 6, the device is A virtual microphone connection request receiving module 610 receives virtual microphone connection requests sent by clients in a live streaming room and creates virtual objects based on the virtual microphone connection requests. A microphone connection request transmission module 620 sends a microphone connection request to a microphone connection server based on a virtual object, and establishes a microphone connection between the virtual object and the target object based on the microphone connection request to the microphone connection server. The system includes an information transmission module 630 that, upon successful microphone connection, sends information about a virtual object to the client, causing the client to display the virtual object information in the corresponding microphone area.

[0061] Selectively, the virtual microphone connection request receiving module 610 further, Retrieve information about a pre-stored virtual object, This method is used to obtain a virtual object by generating configuration structured data based on the information of the virtual object.

[0062] Selectively, the microphone connection request transmission module 620 further, Activate the microphone connection engine. The microphone connection engine is used to send microphone connection requests to the microphone connection server, where the microphone connection request carries information about a virtual object.

[0063] Selectively, the microphone connection request transmission module 620 further, Launch a headless browser, It is used to activate the microphone connection engine in headless browsers.

[0064] Selectively, the information of a virtual object includes at least the identifier information of the virtual object and the audio and video associated with the virtual object.

[0065] A microphone connection device according to an embodiment of the present disclosure can perform a microphone connection method according to any embodiment of the present disclosure and has a functional module and beneficial effects corresponding to the method of performance.

[0066] It should be noted that while the units and modules included in the above-mentioned device are divided according to functional logic, they are not limited to the above classifications. They only need to be able to realize the corresponding function. Furthermore, the specific names of each functional unit are merely for the purpose of easily distinguishing them from one another and are not intended to limit the scope of protection of the embodiments of this disclosure.

[0067] Figure 7 is a schematic diagram of the structure of an electronic device according to an embodiment of the present disclosure. Referring to Figure 7, the following diagram shows a schematic diagram of the structure of an electronic device (e.g., a terminal device or server in Figure 7) 500 suitable for implementing an embodiment of the present disclosure. The terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile devices such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. The electronic device shown in Figure 7 is merely an example, and no arbitrary limitations should be placed on the functions and scope of use of the embodiments of the present disclosure.

[0068] As shown in Figure 7, the electronic device 500 may include a processing unit (e.g., a central processor, graphics processor, etc.) 501, which can perform various appropriate operations and processes based on a program stored in read-only memory (ROM) 502 or a program loaded from storage device 508 into random access memory (RAM) 503. RAM 503 further stores various programs and data necessary for the operation of the electronic device 500. The processing unit 501, ROM 502, and RAM 503 are connected to each other via a bus 504. An edit / output (I / O) interface 505 is also connected to the bus 504.

[0069] Generally, input devices 506, including, for example, touchscreens, touchboards, keyboards, mice, cameras, microphones, accelerometers, and gyroscopes; output devices 507, including, for example, liquid crystal displays (LCDs), speakers, and vibrators; storage devices 508, including, for example, magnetic tapes and hard disks; and communication devices 509 can be connected to the I / O interface 505. The communication devices 509 can allow the electronic device 500 and other devices to exchange data via wireless or wired communication. Figure 7 shows an electronic device 500 with various devices, but it should be understood that it is not required to implement or include all the devices shown. Alternatively, more or fewer devices can be implemented or included.

[0070] In particular, according to embodiments of the present disclosure, the process described with reference to the flowchart above can be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product which includes a computer program placed on a non-temporary computer-readable medium, and which includes program code for performing the method shown in the flowchart. In such embodiments, the computer program may be downloaded and installed from a network via a communication device 509, or installed from a storage device 508, or installed from a ROM 502. When the computer program is executed by the processing unit 501, the above-described functions, limited to the method of embodiments of the present disclosure, are performed.

[0071] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and do not limit the scope of such messages or information.

[0072] The electronic devices according to the embodiments of this disclosure belong to the same inventive concept as the microphone connection method according to the above embodiments, and technical details not described in detail in these embodiments can be referenced to the above embodiments, and these embodiments have the same beneficial effects as the above embodiments.

[0073] The embodiments of this disclosure provide a computer storage medium on which a computer program is stored, and when this program is executed by a processor, the microphone connection method according to the embodiments is realized.

[0074] It should be noted that the computer-readable media described above in this disclosure may be computer-readable signal media, computer-readable storage media, or any combination thereof. Computer-readable storage media may be, but are not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this disclosure, computer-readable storage media may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, apparatus, or device. On the other hand, in this disclosure, a computer-readable signaling medium may include data signals propagated in the baseband or as part of a carrier, on which computer-readable program code is carried. Such propagated data signals may be in various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The computer-readable signaling medium may be any computer-readable medium other than a computer-readable storage medium, and this computer-readable signaling medium may transmit, propagate, or transmit programs for use by or in combination with instruction execution systems, apparatus, or devices. The program code contained on the computer-readable medium may be transmitted by any suitable medium, including but not limited to electric wires, optical cables, RF (radio frequency), or any suitable combination thereof.

[0075] In some embodiments, clients and servers can communicate using any currently known or future-to-be-developed network protocol, such as HTTP (HyperText Transfer Protocol), and can interconnect with digital data communications (e.g., communication networks) in any form or medium. Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), the World Wide Web (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), and any currently known or future-to-be-developed networks.

[0076] The computer-readable medium described above may be included in the electronic device described above, or it may be a standalone entity not assembled in the electronic device.

[0077] The above computer-readable medium contains one or more programs, and when the above one or more programs are executed by this electronic device, this electronic device... The computer-readable medium contains one or more programs, and when the one or more programs are executed by this electronic device, the electronic device is instructed to: display a virtual microphone connection interface based on a first microphone connection operation triggered in the live streaming room by a target object; generate a virtual microphone connection request based on a second microphone connection operation triggered on the virtual microphone connection interface by the target object; send the virtual microphone connection request to the live streaming server to cause the live streaming server to create at least one virtual object; and receive information about the at least one virtual object returned from the live streaming server and display the information about the at least one virtual object in the corresponding microphone area.

[0078] Alternatively, the computer-readable medium may contain one or more programs, and when these programs are executed by the electronic device, the electronic device may perform the following actions: receive a virtual microphone connection request sent by a client in a live streaming room, create a virtual object based on the virtual microphone connection request, send a microphone connection request to a microphone connection server based on the virtual object to cause the microphone connection server to establish a microphone connection between the virtual object and a target object based on the microphone connection request, and, if the microphone connection is successful, send information about the virtual object to the client to cause the client to display the information about the virtual object in the corresponding microphone area.

[0079] Computer program code for performing the operations of the Disclosure can be written in one or more programming languages ​​or a combination thereof, and such programming languages ​​include, but are not limited to, object-oriented programming languages—e.g., Java, Smalltalk, C++, and more specifically, general procedural programming languages—e.g., the "C" language or similar programming languages. The program code may run entirely on the target object computer, partially on the target object computer, run as a single, independent software package, run partially on the target object computer, partially on a remote computer, or run entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the target object computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or it may be connected to an external computer (e.g., connected via the Internet using an Internet service provider).

[0080] The flowcharts and block diagrams in the drawings illustrate the implementable systematic architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, program segment, or portion of code, which includes one or more executable instructions for implementing a defined logic function. It should also be noted that in some implementations as alternatives, the functions attached to the blocks may occur in a different order than those attached in the drawings. For example, two consecutive blocks may actually be executed essentially in parallel, or in reverse order depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system that performs the defined function or operation, or by a combination of dedicated hardware and computer instructions.

[0081] The units described in relation to the embodiments of this disclosure may be implemented in software or in hardware. Herein, the names of the units are not limited in any case to the unit itself; for example, the first acquisition unit may be described as "a unit for acquiring at least two Internet Protocol addresses."

[0082] In this specification, the functions described above may be performed by at least partially one or more hardware logic components. For example, without limitation, typical types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), dedicated integrated circuits (ASICs), dedicated standard products (ASSPs), systems on a chip (SOCs), and complex programmable logic devices (CPLDs).

[0083] In the context of this disclosure, a machine-readable medium may be a tangible medium that contains or stores a program for use by or in combination with an instruction execution system, device, or apparatus. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any appropriate combination of the above. More specific examples of machine-readable storage media include one or more line-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any appropriate combination of the above.

[0084] According to one or more embodiments of this disclosure, a virtual microphone connection method is provided, which is performed by a client. Based on the first microphone connection operation triggered in the live streaming room by the target object, the virtual microphone connection interface is displayed, A virtual microphone connection request is generated based on a second microphone connection operation triggered on the virtual microphone connection interface by the target object, The virtual microphone connection request is sent to the live streaming server, causing the live streaming server to create at least one virtual object. The system includes receiving information about at least one virtual object returned from the live streaming server and displaying the information about the at least one virtual object in the corresponding microphone area.

[0085] Furthermore, displaying the virtual microphone connection interface based on the first virtual microphone connection operation triggered in the live streaming room by the target object is possible. When it is detected that the target object has triggered the first virtual microphone connection operation in the live streaming room, the number of available microphones in the live streaming room is determined, This includes displaying a virtual microphone connection interface based on the first virtual microphone connection operation, and generating microphone connection controls for the number of available microphones in the virtual microphone connection interface, Generating a virtual microphone connection request based on a second microphone connection operation triggered by the target object on the virtual microphone connection interface is: This includes generating a virtual microphone connection request based on a second microphone connection operation triggered by a target object for at least one of the microphone connection controls.

[0086] Embodiments of this disclosure further provide a microphone connection method, the method being performed by a live streaming server, The live streaming room receives a virtual microphone connection request sent by the client, and creates a virtual object based on the said virtual microphone connection request. A microphone connection request is sent to the microphone connection server based on the virtual object, and the microphone connection server establishes a microphone connection between the virtual object and the target object based on the microphone connection request. The system includes, upon successful microphone connection, transmitting information about the virtual object to the client, causing the client to display the information about the virtual object in the corresponding microphone area.

[0087] Furthermore, creating a virtual object based on the virtual microphone connection request is Retrieving information about pre-stored virtual objects, This includes obtaining a virtual object by generating configuration structured data based on the information of the virtual object.

[0088] Furthermore, sending a microphone connection request to the microphone connection server based on the virtual object is: To activate the microphone connection engine, The process includes the microphone connection engine sending the microphone connection request to the microphone connection server, where the microphone connection request carries information about the virtual object.

[0089] Furthermore, activating the microphone connection engine means, Launching a headless browser, This includes activating the microphone connection engine in the headless browser.

[0090] Furthermore, the information of the virtual object includes at least the identifier information of the virtual object and the audio and video associated with the virtual object.

[0091] The above description is merely an explanation of better embodiments of the disclosure and the technical principles in which they are applied. Those skilled in the art should understand that the scope of the disclosure is not limited to any specific combination of the above technical features, but should also cover other technical features formed by any combination of the above technical features or their equivalents, without departing from the concept of the disclosure. For example, technical features formed by substituting the above features with similar functional technical features disclosed (but not limited to) in this disclosure.

[0092] Although each operation is described using specific procedures, this should not be understood as requiring that these operations be performed by the specific or sequential procedures shown. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although the above discussion includes some specific implementation details, these should not be construed as limiting the scope of this disclosure. Some features described in the context of a single embodiment may be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may be implemented in multiple embodiments individually or in any suitable subcombination.

[0093] Although this topic has already been described using language specific to structural features and / or methodological logic, it should be understood that the topic limited to the claims in the attached file is not necessarily limited to the specific features or behaviors described above. Conversely, the specific features and behaviors described above are merely illustrative forms of realizing the claims.

Claims

1. A microphone connection method performed by the client, Based on the first microphone connection operation triggered in the live streaming room by the target object, the virtual microphone connection interface is displayed, A virtual microphone connection request is generated based on a second microphone connection operation triggered on the virtual microphone connection interface by the target object, The virtual microphone connection request is sent to the live streaming server, causing the live streaming server to create at least one virtual object. The system receives information about at least one virtual object returned from the live streaming server and displays the information about the at least one virtual object in the corresponding microphone area. Microphone connection method, including

2. Displaying a virtual microphone connection interface based on a first virtual microphone connection operation triggered in a live streaming room by a target object includes, when detecting that the target object has triggered a first virtual microphone connection operation in the live streaming room, determining the number of available microphones in the live streaming room, and displaying the virtual microphone connection interface based on the first virtual microphone connection operation, and generating microphone connection controls for the number of available microphones in the virtual microphone connection interface. Generating a virtual microphone connection request based on a second microphone connection operation triggered by the target object on the virtual microphone connection interface is: This includes generating a virtual microphone connection request based on a second microphone connection operation triggered by a target object for at least one of the microphone connection controls, The method according to claim 1.

3. A microphone connection method performed by a live streaming server, The live streaming room receives a virtual microphone connection request sent by the client, and creates a virtual object based on the said virtual microphone connection request. A microphone connection request is sent to the microphone connection server based on the virtual object, and the microphone connection server establishes a microphone connection between the virtual object and the target object based on the microphone connection request. If the microphone connection is successful, the information of the virtual object is sent to the client, causing the client to display the information of the virtual object in the corresponding microphone area. Microphone connection method, including

4. Creating a virtual object based on the aforementioned virtual microphone connection request is, Retrieving information about pre-stored virtual objects, By generating configuration structured data based on the information of the aforementioned virtual object, a virtual object is obtained, The method according to claim 3, including the method described in claim 3.

5. Sending a microphone connection request to the microphone connection server based on the aforementioned virtual object is: To activate the microphone connection engine, The microphone connection engine transmits the microphone connection request to the microphone connection server, The microphone connection request carries information about the virtual object. The method according to claim 3.

6. Activating the microphone connection engine is Launching a headless browser, Activating the microphone connection engine in the headless browser, The method according to claim 5, including the method described in claim 5.

7. The method according to claim 3, wherein the information of the virtual object includes at least identifier information of the virtual object and audio and video associated with the virtual object.

8. A microphone connection device installed on the client, A virtual microphone connection interface display module for displaying the virtual microphone connection interface based on the first microphone connection operation triggered in the live streaming room by the target object, A virtual microphone connection request generation module for generating a virtual microphone connection request based on a second microphone connection operation triggered on the virtual microphone connection interface by a target object, A virtual microphone connection request transmission module that sends the aforementioned virtual microphone connection request to the live streaming server, causing the live streaming server to create at least one virtual object, An information display module for receiving information of at least one virtual object returned from the live streaming server and displaying the information of the at least one virtual object in the corresponding microphone area, A microphone connection device, including a microphone connection device.

9. A microphone connection device installed on a live streaming server, A virtual microphone connection request receiving module for receiving virtual microphone connection requests sent by a client in a live streaming room and creating a virtual object based on the said virtual microphone connection request, A microphone connection request transmission module that sends a microphone connection request to a microphone connection server based on the virtual object, and causes the microphone connection server to establish a microphone connection between the virtual object and the target object based on the microphone connection request, An information transmission module that receives microphone connection success information returned from the microphone connection server, transmits information about the virtual object to the client based on the microphone connection success information, and causes the client to display the information about the virtual object in the corresponding microphone area. A microphone connection device, including a microphone connection device.

10. One or more processors, A storage device for storing one or more programs, An electronic device in which one or more of the aforementioned programs are executed by one or more processors to enable one or more processors to implement the microphone connection method described in any one of claims 1 to 7.

11. A storage medium containing a computer executable instruction, which is used to perform the microphone connection method described in any one of claims 1 to 7 when the computer executable instruction is executed by a computer processor.

Images