Methods, devices, equipment, storage media, and computer programs for processing live streaming interfaces

Abstract

Embodiments of the present disclosure provide a method, apparatus, device, and storage medium for processing a live streaming interface. The live streaming interface includes a multilayer view, the live streaming interface includes at least one microphone area, and the method includes, for each microphone area, determining the microphone type of the microphone area, wherein the microphone type includes one of a video microphone, a voice microphone, and an empty microphone, and processing at least a portion of the views of the multilayer view according to the microphone type.

Description

Technical Field

[0001] [Cross - Reference to Related Applications] This application claims the priority of a Chinese patent application filed with the China National Intellectual Property Administration on March 16, 2023, with the application number 202310271937.1 and the invention title "Method, Apparatus, Device, and Storage Medium for Processing Live Streaming Interface", and all of its content is incorporated into this application by reference.

[0002] [Technical Field] Embodiments of the present disclosure relate to the field of interface processing technology, and particularly to a method, apparatus, device, and storage medium for processing a live streaming interface.

Background Art

[0003] In recent years, video live streaming has brought a more real - time experience to people. Video live streaming further includes the presentation form of microphone - connected live streaming. During the related microphone - connected live streaming, the live streaming interface may not be able to achieve diversified display, or the implementation solution for diversified display is relatively complex and the efficiency is relatively low.

Summary of the Invention

Problems to be Solved by the Invention

[0004] Embodiments of the present disclosure provide a method, apparatus, device, and storage medium for processing a live streaming interface, which can enrich the display method of the microphone and improve the display efficiency.

Means for Solving the Problems

[0005] According to a first aspect, embodiments of the present disclosure provide a method for processing a live streaming interface. The live streaming interface includes a multi - layer view, and the live streaming interface includes at least one microphone area. The method includes: For each microphone area, the microphone type of the microphone area is determined, wherein the microphone type includes one of the following: a video microphone, a voice microphone, and an empty microphone. This includes processing at least some of the views of the multilayer view according to the microphone type.

[0006] According to a second aspect, an embodiment of the present disclosure further provides a processing device for a live streaming interface, wherein the live streaming interface includes a multilayer view, the live streaming interface includes at least one microphone area, and the device is A microphone type determination module for determining the microphone type of each microphone area, wherein the microphone type includes one of the following: a video microphone, a voice microphone, and an empty microphone. The system includes a view processing module for processing at least some of the views of the multilayer view according to the microphone type.

[0007] According to a third aspect, embodiments of the present disclosure further provide electronic devices, said electronic devices, One or more processors, A storage device for storing one or more programs, The one or more programs are executed by the one or more processors to enable the one or more processors to implement the live streaming interface processing method described in the embodiments of this disclosure.

[0008] According to a fourth aspect, embodiments of the present disclosure further provide a storage medium containing computer executable instructions, which is used to execute a processing method for a live streaming interface described in embodiments of the present disclosure when the computer executable instructions are executed by a computer processor. [Effects of the Invention]

[0009] Embodiments of the present disclosure disclose a method, apparatus, device and storage medium for processing a live streaming interface, the live streaming interface includes a multilayer view, the live streaming interface includes at least one microphone area, the method includes, for each microphone area, determining the microphone type of the microphone area, wherein the microphone type includes one of a video microphone, a voice microphone and an empty microphone, and processing at least a portion of the views of the multilayer view according to the microphone type.

[0010] Referring to the embodiments for carrying out the invention described below, while linking the drawings, will make the above and other features, advantages and aspects of each embodiment of the present disclosure more apparent. Throughout the drawings, the same or similar symbols represent the same or similar elements. It should be understood that the drawings are schematic and parts and elements are not necessarily drawn to scale. [Brief explanation of the drawing]

[0011] [Figure 1] This is a flowchart of the processing method for a live streaming interface according to an embodiment of the present disclosure. [Figure 2] This is an example diagram of a live streaming interface according to an embodiment of the present disclosure. [Figure 3] This is a schematic diagram illustrating the principle of a live streaming interface processing method according to an embodiment of the present disclosure. [Figure 4] This is a schematic diagram of the structure of the processing unit for the live streaming interface according to an embodiment of the present disclosure. [Figure 5] This is a schematic diagram of the structure of an electronic device according to an embodiment of the present disclosure. [Modes for carrying out the invention]

[0012] The following describes embodiments of the present disclosure in more detail with reference to the drawings. While the drawings show several embodiments of the present disclosure, it should be understood that the present disclosure may be implemented in various forms and should not be construed as being limited to the embodiments described herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should also be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0013] It should be understood that the steps described in the method embodiments of this disclosure may be performed in a different order and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the execution of the indicated steps. The scope of this disclosure is not limited in this respect.

[0014] As used herein, the terms “including” and its variations mean “including, but not limited to.” The term “based on” means “based at least partially.” The term “one embodiment” means “at least one embodiment,” the term “another embodiment” means “at least one other embodiment,” and the term “several embodiments” means “at least several embodiments.” Relevant definitions of other terms are given below.

[0015] It should be noted that the concepts of “first,” “second,” etc., as used in this disclosure are used solely to distinguish between different devices, modules, or units, and are not intended to limit the order or interdependence of the functions performed by these devices, modules, or units.

[0016] It should be noted that the modifications “one” and “plural” as used in this disclosure are general rather than restrictive, and should be understood as “one or plural” unless otherwise explicitly stated in the context, as should be understood by those skilled in the art.

[0017] The names of messages or information that are interacted between multiple devices in the embodiments of the present disclosure are for illustrative purposes only and do not limit the scope of these messages or information.

[0018] As can be understood, before using the technical solutions disclosed in each embodiment of the present disclosure, users should be informed in an appropriate manner about the types, usage scopes, usage scenarios, etc. of personal information related to the present disclosure in accordance with relevant laws and regulations, and the permission of the users should be obtained.

[0019] For example, when responding to a user's voluntary request, the operation of sending prompt information to the user to clearly prompt the user and request its execution requires obtaining and using the user's personal information. As a result, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, an application program, a server, or a storage medium that executes the operation of the technical solution of the present disclosure according to the prompt information.

[0020] As a selectable but non-limiting implementation manner, the method of sending prompt information to the user in response to receiving the user's voluntary request may be, for example, in the form of a pop-up window, and the prompt information may be presented in text form in the pop-up window. In addition, the pop-up window may include a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0021] As can be understood, the above notification and user permission acquisition process is only schematic and does not constitute a limitation to the implementation manner of the present disclosure, and other methods that meet the relevant laws and regulations may be used for the implementation manner of the present disclosure.

[0022] As can be understood, the data related to the present technical solution (including but not limited to the data itself, the acquisition or use of the data) should comply with the requirements of the corresponding laws, regulations and related provisions.

[0023] In related technologies, the rendering hierarchy of a video live streaming room may be, from top to bottom, a microphone layer, a theme layer, and an in-stream player layer, with the theme layer view not being displayed across the entire microphone area (i.e., the user can only see the theme outside the microphone area). For microphones with video microphone loading, the microphone layer view is not displayed, allowing the video below the microphone layer to be seen, while for microphones without video microphone loading, the set color is added to the microphone layer view. This method has a drawback: empty microphone themes do not display themes, and empty microphones cannot properly adapt to themes.

[0024] Figure 1 is a flowchart of a method for processing a live streaming interface according to an embodiment of the present disclosure, which applies when processing a view of a live streaming interface, and this method may be performed by a processing device for the live streaming interface, which may be implemented in the form of software and / or hardware, and optionally by electronic equipment, which may be a mobile terminal, a PC terminal or a server, etc.

[0025] As shown in Figure 1, the method includes the following:

[0026] S110, For each microphone area, the microphone type of the microphone area is determined.

[0027] Here, the microphone type includes one of a video microphone, a voice microphone, and an empty microphone. In this embodiment, the caster can connect to the microphone and interact with viewers in the live streaming room during the live stream, and viewers with microphone loading may be called "guests." Guests can choose between video microphone loading or voice microphone loading. If video microphone loading is selected, the video image can be displayed in the corresponding microphone area and the audio can be played in the live streaming room. If voice microphone loading is selected, the guest's video image is not displayed in the microphone area, and the guest's audio can be played in the live streaming room. An empty microphone may be understood as a microphone area where there are no viewers with microphone loading.

[0028] In this embodiment, the live streaming interface includes a three-layer view and includes at least one microphone area. The three-layer view consists of a microphone layer view, a theme layer view, and an in-stream player layer view. Exemplarily, Figure 2 is an example diagram of the live streaming interface in this embodiment, and as shown in Figure 2, this live streaming interface includes a three-layer view, from top to bottom being a microphone layer view, a theme layer view, and an in-stream player layer view, and includes nine microphone areas, meaning the caster can connect to and interact with nine viewers simultaneously. Here, the number of microphone areas may be predetermined when developing the live streaming room, or it may be selected by the caster at the start of the live stream, and is not limited thereto.

[0029] Specifically, the method for determining the microphone type of the microphone area may involve obtaining a field identifier related to the type of the microphone area and determining the microphone type of the microphone area based on the field identifier.

[0030] Here, the field identifier may be obtained from the server terminal. In this embodiment, the client can obtain relevant information for each microphone area from the server, and the relevant information includes a field identifier related to the type, and the specific field in this field identifier can indicate the current microphone type for each microphone area. If the microphone type is a video microphone, it indicates that a guest on this microphone will make a video microphone connection with the caster; if the microphone type is a voice microphone, it indicates that a guest on this microphone will make a voice microphone connection with the caster; and if the microphone type is an empty microphone, it indicates that there is no guest with a microphone connection to this microphone. In this embodiment, the microphone type for each microphone area can be correctly determined by determining the microphone type using the field identifier related to the microphone type.

[0031] S120 processes at least some of the multilayer views depending on the microphone type.

[0032] In this embodiment, different content is displayed depending on the microphone type. For video microphones, the guest's video stream can be displayed in the microphone area; for voice microphones, content related to the guest can be displayed in the microphone area; and for empty microphones, theme content for the live streaming interface can be displayed in the microphone area. Therefore, the processing method for the three-layer view on the microphone area differs depending on the microphone type.

[0033] A method for selectively processing at least some of the views in a multilayer view according to the microphone type may involve obtaining the hierarchical relationships of the multilayer view and processing at least some of the views in the multilayer view according to the hierarchical relationships and the microphone type.

[0034] Here, the hierarchical relationship can be understood as which layer each multilayer view is located in, and in this embodiment, the hierarchical relationship of the three-layer view can be determined by a sorting and combination method, and there are six types of hierarchical relationships. For example, two of these hierarchical relationships may be that the microphone layer view is in the top layer, the theme layer view is in the middle layer, and the in-stream player layer view is in the bottom layer, or that the microphone layer view is in the top layer, the in-stream player layer view is in the middle layer, and the theme layer view is in the bottom layer, and we will not explain each one individually here.

[0035] In this embodiment, the method for processing at least some of the views in the multilayer view according to the hierarchical relationship and microphone type may be as follows: when the microphone type is a video microphone, at least some of the views in the multilayer view are processed to display the content in the in-stream player layer view; when the microphone type is a voice microphone, at least some of the views in the multilayer view are processed to display the content in the microphone layer view; and when the microphone type is an empty microphone, at least some of the views in the multilayer view are processed to display the content in the theme layer view.

[0036] Here, displaying content in the in-stream player layer view may be understood as displaying a video stream in the microphone area. If the microphone type is a video microphone, and the in-stream player layer view is obscured by the microphone layer view or theme layer view, then the microphone layer view or theme layer view must be processed.

[0037] Here, the content in the microphone layer view may be, for example, a target image or live streaming-related information corresponding to the microphone-connected user. If the microphone type is a voice microphone, and the microphone layer view is obscured by the in-stream player layer view or the theme layer view, then the in-stream player layer view or the theme layer view must be processed.

[0038] Here, displaying content in the theme layer view may be understood as displaying theme content for the live streaming interface. If the microphone type is empty microphone, and the theme layer view is obscured by the microphone layer view or in-stream player layer view, then the microphone layer view or in-stream player layer view must be processed.

[0039] In this embodiment, the hierarchical relationship of the three-layer view is such that the microphone layer view is at the top layer, the theme layer view is at the middle layer, and the in-stream player layer view is at the bottom layer.

[0040] Specifically, a method for processing at least some of the three layers of a view depending on the microphone type may involve setting the display attribute of the microphone layer view to hidden and cutting off (or removing) the theme layer view corresponding to the microphone area when the microphone type is a video microphone.

[0041] In this embodiment, when the microphone type is a video microphone, the guest's video stream on this microphone area needs to be displayed on the in-stream player layer view. Since the in-stream player layer view is below the microphone layer view and the theme layer view, the microphone layer view and theme layer view need to be processed to display the guest's video stream on this microphone area, thereby avoiding the in-stream player layer view being obscured by the microphone layer view and theme layer view. Specifically, when the microphone type is a video microphone, the display attribute of the microphone layer view corresponding to this microphone area is set to hidden, and the theme layer view corresponding to the microphone area is trimmed to display the in-stream player layer view.

[0042] Specifically, the method for cutting the theme layer view corresponding to the microphone area may involve determining the location information in the live streaming interface of the microphone area and cutting the theme layer view at that location.

[0043] Here, the position information may be characterized by the coordinates of the center point and size information of the microphone area, or by the coordinates of multiple vertices. When the position information is characterized by the coordinates of the center point and size information of the microphone area, the position of the microphone area in the live streaming interface can be determined based on the coordinates of the center point and size information. If the microphone area is rectangular, the position information may be characterized by the coordinates of four vertices, or by the coordinates of two vertices on the diagonal, that is, the position of the microphone area in the live streaming interface can be obtained based on characterization by the coordinates of four vertices or the coordinates of two vertices on the diagonal. In this embodiment, after determining the position information of the microphone area in the live streaming interface, the theme layer view in the video type microphone area can be correctly cut by cutting the theme layer view in this position information.

[0044] Specifically, a method for processing at least some of the three layers of a view according to the microphone type may involve setting the display attribute of the microphone layer view to "show," adjusting the transparency of the microphone layer view, or setting the display attribute of the microphone layer view to "hide" when the microphone type is an empty microphone.

[0045] In this embodiment, when the microphone type is an empty microphone, there are no guests microphone-loading in this microphone area, and in order to match the content displayed in this microphone area to the theme of the live streaming interface, it is necessary to display the theme layer view of this microphone area, and therefore the microphone layer view needs to be processed. Specifically, the processing method for the microphone layer view may be to set the display attribute of the microphone layer view to display, adjust the transparency of the microphone layer view, or directly set the display attribute of the microphone layer view to hide.

[0046] Here, the transparency of the microphone layer view may be adjusted to any value greater than or equal to 0 or less than 1. "0" represents complete transparency, and "1" represents complete opacity. In this embodiment, it is necessary to adjust the microphone layer view from completely opaque to partially transparent or completely transparent in order to display the content of the theme layer view located below the microphone layer view. In this embodiment, by adjusting the transparency of the microphone layer view, theme content can be displayed in the microphone area of ​​an empty microphone, matching the theme of the microphone area with the theme live streaming interface and improving the visual effect.

[0047] Specifically, a method for processing at least some of the three layers of a view depending on the microphone type may involve setting the display attribute of the microphone layer view to "display" and rendering the target image to the microphone layer view when the microphone type is a voice microphone.

[0048] Here, the target image is either a virtual image or a user avatar corresponding to the microphone area. The virtual image may be understood as a pre-constructed avatar image, and the user avatar may be understood as an image uploaded by the user as an avatar.

[0049] In this embodiment, when the microphone type is a voice microphone, the guest in this microphone area establishes a voice microphone connection with the caster, and since an image related to this guest can be displayed in the microphone layer view in the microphone area, it is necessary to process the microphone layer view of this microphone area. Specifically, when the microphone type is a voice microphone, the processing method for the microphone layer view may be to set the display attribute of the microphone layer view to display, obtain a target image corresponding to the user in this microphone area, and render the target image in the microphone layer view. In this embodiment, by displaying a target image corresponding to the user in the microphone area of ​​the voice microphone, the versatility of the live streaming interface display is improved and the visual effect is enhanced.

[0050] A method for selectively rendering the target image to the microphone layer view may involve blurring the target image and then rendering the blurred target image to the microphone layer view.

[0051] Here, the blurring method may be Gaussian blur or average blur, and is not limited thereto. This embodiment enriches the variety of live streaming interface displays by rendering the blurred target image in the microphone layer view.

[0052] The process further includes selectively rendering the target image to the microphone layer view, then retrieving live streaming-related information corresponding to the microphone region, and displaying the live streaming-related information in the microphone layer view.

[0053] Here, the live streaming-related information may include information such as the microphone connection countdown and gift address. In this embodiment, the live streaming-related information corresponding to the microphone area may be retrieved from the server and finally displayed in the microphone layer view. This allows the caster to intuitively view the guest's live streaming-related information, assisting them in interacting with the guest and improving the microphone connection interactive effect.

[0054] Based on the above embodiment, Figure 3 is a schematic diagram of the processing method for the live streaming interface in this embodiment, and as shown in Figure 3, the process of this method is as follows.

[0055] 1. The presenter, viewers, and guests enter the live streaming room. 2. Determine the microphone type for each microphone area. 3. If the current microphone area is a video microphone, set the microphone layer view to hidden and cut off the theme layer view. 4. If the current microphone area is an empty microphone, adjust the transparency of the microphone layer view. 5. If the current microphone area is a voice microphone, the target image is blurred, and the blurred target image is rendered in the microphone layer view.

[0056] The technical method of the embodiments of this disclosure determines the microphone type of each microphone area, where the microphone type includes one of a video microphone, a voice microphone, and an empty microphone, and processes at least a portion of the views of the multilayer view according to the microphone type. The live streaming interface processing method according to the embodiments of this disclosure can improve the diversity of the live streaming interface display by processing at least a portion of the views of the multilayer view according to the microphone type and displaying different types of microphone areas in different formats, as well as correctly displaying content corresponding to different microphone types and preventing the occurrence of display errors.

[0057] Figure 4 is a schematic diagram of the structure of a processing unit for a live streaming interface according to an embodiment of the present disclosure, wherein the live streaming interface includes a multilayer view, and the live streaming interface includes at least one microphone area, and as shown in Figure 4, the device is A microphone type determination module 410 for determining the microphone type of each microphone area, wherein the microphone type includes one of the following: a video microphone, a voice microphone, and an empty microphone. The system includes a view processing module 420 for processing at least some of the views of a multilayer view according to the microphone type.

[0058] Selectively, the multi-layer view is a three-layer view, consisting of a microphone layer view, a theme layer view, and an in-stream player layer view.

[0059] Selectively, the view processing module 420 further, The hierarchical relationship of the aforementioned multilayer view is obtained, It is used to process at least some of the views of the multilayer view according to the hierarchical relationship and the microphone type.

[0060] Selectively, the view processing module 420 further, If the microphone type is a video microphone, the system processes at least some of the views in the multilayer view to display the content in the in-stream player layer view. If the microphone type is a voice microphone, process at least some of the views of the multilayer view to display the content in the microphone layer view. If the microphone type is an empty microphone, it is used to process at least some of the views in the multilayer view and to display the content in the theme layer view.

[0061] Selectively, the hierarchical relationship is such that the microphone layer view is at the top layer, the theme layer view is at the middle layer, and the in-stream player layer view is at the bottom layer.

[0062] Selectively, the view processing module 420 further, If the microphone type is a video microphone, this is used to hide the display attribute of the microphone layer view and to trim the theme layer view corresponding to the microphone area.

[0063] Selectively, the view processing module 420 further, Determine the location information in the live streaming interface of the microphone area. It is used to segment the theme layer view in location data.

[0064] Selectively, the view processing module 420 further, When the microphone type is an empty microphone, this is used to set the display attribute of the microphone layer view to "show," adjust the transparency of the microphone layer view, or set the display attribute of the microphone layer view to "hide."

[0065] Selectively, the view processing module 420 further, If the microphone type is a voice microphone, the display attribute of the microphone layer view is set to "show" and used to render the target image in the microphone layer view.

[0066] Selectively, the view processing module 420 further, The target image is blurred, This is used to render the blurred target image in the microphone layer view.

[0067] Selectively, further including a live streaming-related information display module, Retrieve live streaming-related information corresponding to the microphone area. It is used to display live streaming-related information in the microphone layer view.

[0068] The live streaming interface processing device according to the embodiments of this disclosure can perform the live streaming interface processing method according to any embodiment of this disclosure and includes a functional module and beneficial effects corresponding to the execution method.

[0069] It should be noted that the units and modules included in the above-mentioned device are merely categorized according to functional logic and are not limited to the above classifications; they only need to be able to realize the corresponding function. Furthermore, the specific names of each functional unit are merely for the purpose of facilitating their distinction from one another and are not intended to limit the scope of protection of the embodiments of this disclosure.

[0070] Figure 5 is a schematic diagram of the structure of an electronic device according to an embodiment of the present disclosure. Referring hereto to Figure 5, it shows a schematic diagram of the structure of an electronic device (e.g., a terminal device or server in Figure 5) 500 suitable for realizing an embodiment of the present disclosure. The terminal devices in the embodiment of the present disclosure may include, but are not limited to, mobile devices such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. The electronic device shown in Figure 5 is merely an example, and no arbitrary limitations should be placed on the functions and scope of use of the embodiment of the present disclosure.

[0071] As shown in Figure 5, the electronic device 500 may include a processing unit (e.g., a central processor, graphics processor, etc.) 501, which can perform various appropriate operations and processes based on a program stored in read-only memory (ROM) 502 or a program loaded from storage device 508 into random access memory (RAM) 503. RAM 503 further stores various programs and data necessary for the operation of the electronic device 500. The processing unit 501, ROM 502, and RAM 503 are connected to each other via a bus 504. An edit / output (I / O) interface 505 is also connected to the bus 504.

[0072] Generally, input devices 506, including, for example, touchscreens, touchboards, keyboards, mice, cameras, microphones, accelerometers, and gyroscopes; output devices 507, including, for example, liquid crystal displays (LCDs), speakers, and vibrators; storage devices 508, including, for example, magnetic tapes and hard disks; and communication devices 509 can be connected to the I / O interface 505. The communication devices 509 can enable the electronic device 500 and other devices to exchange data via wireless or wired communication. Figure 5 shows an electronic device 500 with various devices, but it should be understood that it is not required to implement or include all the devices shown. Alternatively, more or fewer devices can be implemented or included.

[0073] In particular, according to embodiments of the present disclosure, the process described with reference to the flowchart above can be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product which includes a computer program carried on a non-temporary computer-readable medium which includes program code for performing the method shown in the flowchart. In such embodiments, the computer program may be downloaded and installed from a network via a communication device 509, or installed from a storage device 508, or installed from a ROM 502. When the computer program is executed by the processing unit 501, the above-described functions, limited in the manner of embodiments of the present disclosure, are performed.

[0074] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and do not limit the scope of such messages or information.

[0075] The electronic devices according to the embodiments of this disclosure belong to the same inventive concept as the live streaming interface processing method according to the above embodiments, and technical details not described in detail in these embodiments can be referenced to the above embodiments, and these embodiments have the same beneficial effects as the above embodiments.

[0076] Embodiments of this disclosure provide a computer storage medium on which a computer program is stored, and when this program is executed by a processor, the method for processing a live streaming interface according to the above embodiment is realized.

[0077] It should be noted that the computer-readable media described above in this disclosure may be computer-readable signal media, computer-readable storage media, or any combination thereof. Computer-readable storage media may be, but are not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this disclosure, computer-readable storage media may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, apparatus, or device. On the other hand, in this disclosure, a computer-readable signaling medium may include data signals propagated in the baseband or as part of a carrier, on which computer-readable program code is carried. Such propagated data signals may be in various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The computer-readable signaling medium may be any computer-readable medium other than a computer-readable storage medium, and this computer-readable signaling medium may transmit, propagate, or transmit programs for use by or in combination with instruction execution systems, apparatus, or devices. The program code contained on the computer-readable medium may be transmitted by any suitable medium, including but not limited to electric wires, optical cables, RF (radio frequency), or any suitable combination thereof.

[0078] In some embodiments, clients and servers can communicate using any currently known or future-to-be-developed network protocol, such as HTTP (HyperText Transfer Protocol), and can interconnect with digital data communications (e.g., communication networks) in any form or medium. Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), the World Wide Web (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), and any currently known or future-to-be-developed networks.

[0079] The computer-readable medium described above may be included in the electronic device described above, or it may be a standalone entity not incorporated into the electronic device.

[0080] The above computer-readable medium contains one or more programs, and when the above one or more programs are executed by this electronic device, this electronic device For each microphone area, the system determines the microphone type of the microphone area, that the microphone type includes one of a video microphone, a voice microphone, or an empty microphone, and processes at least some of the views of the multilayer view according to the microphone type.

[0081] Computer program code for performing the operations of the Disclosure can be written in one or more programming languages ​​or a combination thereof, and such programming languages ​​include, but are not limited to, object-oriented programming languages—e.g., Java, Smalltalk, C++, and more specifically, general procedural programming languages—e.g., the "C" language or similar programming languages. The program code may run entirely on a user computer, partially on a user computer, run as a single, independent software package, run partially on a user computer, partially on a remote computer, or run entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or it may be connected to an external computer (e.g., connected via the Internet using an Internet service provider).

[0082] The flowcharts and block diagrams in the drawings illustrate the implementable systematic architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, program segment, or portion of code, which includes one or more executable instructions for implementing a defined logic function. It should also be noted that in some implementations as alternatives, the functions attached to a block may occur in a different order than those attached in the drawings. For example, two consecutive blocks may actually be executed essentially in parallel, or in reverse order depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system that performs the defined function or operation, or by a combination of dedicated hardware and computer instructions.

[0083] The units described in relation to the embodiments of this disclosure may be implemented in software or in hardware. Herein, the names of the units are not limited in any case to the unit itself; for example, the first acquisition unit may be described as "a unit for acquiring at least two Internet Protocol addresses."

[0084] Functions beyond those described herein may be performed by at least partially one or more hardware logic components. For example, without limitation, typical types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SOCs), and composite programmable logic devices (CPLDs).

[0085] In the context of this disclosure, a machine-readable medium may be a tangible medium that contains or stores a program for use by or in combination with an instruction execution system, device, or apparatus. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any appropriate combination of the above. More specific examples of machine-readable storage media include one or more line-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any appropriate combination of the above.

[0086] According to one or more embodiments of the present disclosure, a method for processing a live streaming interface is provided, wherein the live streaming interface includes a multilayer view, and the live streaming interface includes at least one microphone area, and the method is: For each microphone area, the microphone type of the microphone area is determined, wherein the microphone type includes one of the following: a video microphone, a voice microphone, and an empty microphone. This includes processing at least some of the views of the multilayer view according to the microphone type.

[0087] Furthermore, the multilayer view is a three-layer view, consisting of a microphone layer view, a theme layer view, and an in-stream player layer view.

[0088] Furthermore, processing at least some of the views among the multilayer views according to the microphone type is: To obtain the hierarchical relationship of the aforementioned multilayer view, This includes processing at least some of the views of the multilayer view according to the hierarchical relationship and the microphone type.

[0089] Furthermore, processing at least some of the views among the multilayer views according to the hierarchical relationship and the microphone type is If the microphone type is a video microphone, the process includes processing at least some of the views in the multilayer view to display the content in the in-stream player layer view, If the microphone type is a voice microphone, the process includes processing at least some of the views in the multilayer view to display the content in the microphone layer view, If the microphone type is an empty microphone, the process includes processing at least some of the views in the multilayer view to display the content in the theme layer view.

[0090] Furthermore, the aforementioned hierarchical relationship is such that the microphone layer view is at the top layer, the theme layer view is at the middle layer, and the in-stream player layer view is at the bottom layer.

[0091] Furthermore, processing at least some of the views among the multilayer views according to the microphone type is: If the microphone type is a video microphone, the display attribute of the microphone layer view is set to hidden, and the theme layer view corresponding to the microphone area is trimmed.

[0092] Furthermore, cutting the theme layer view corresponding to the microphone area is Determining the location information in the live streaming interface of the microphone area, This includes cutting the theme layer view in the aforementioned location information.

[0093] Furthermore, processing at least some of the views among the multilayer views according to the microphone type is: If the microphone type is an empty microphone, the display attribute of the microphone layer view is set to display, the transparency of the microphone layer view is adjusted, or the display attribute of the microphone layer view is set to hide.

[0094] Furthermore, processing at least some of the views among the multilayer views according to the microphone type is: If the microphone type is a voice microphone, the method is characterized by setting the display attribute of the microphone layer view to "display" and rendering the target image to the microphone layer view.

[0095] Furthermore, rendering the target image to the microphone layer view is The aforementioned target image is subjected to blurring, This includes rendering the blurred target image to the microphone layer view.

[0096] Furthermore, after rendering the target image to the microphone layer view, To acquire live streaming-related information corresponding to the aforementioned microphone area, The further includes displaying the aforementioned live streaming-related information in the microphone layer view.

[0097] The above description is merely an explanation of better embodiments of the disclosure and the technical principles in which they are applied. Those skilled in the art should understand that the scope of the disclosure is not limited to any specific combination of the above technical features, but should also cover other technical features formed by any combination of the above technical features or their equivalents, without departing from the concept of the disclosure. For example, technical features formed by substituting the above features with similar functional technical features disclosed (but not limited to) in this disclosure.

[0098] Although each operation is described using specific procedures, this should not be understood as requiring that these operations be performed by the specific or sequential procedures shown. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, the above description includes some specific implementation details, but these should not be interpreted as limiting the scope of this disclosure. Some features described in the context of a single embodiment may be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may be implemented in multiple embodiments, either individually or in any suitable subcombination.

[0099] While this topic has been described using language specific to structural features and / or methodological logic, it should be understood that the topics covered by the attached claims are not necessarily limited to the specific features or operations described above. Conversely, the specific features and operations described above are merely illustrative forms of realizing the claims.

Claims

1. A method for processing a live streaming interface, The live streaming interface includes a multilayer view, the live streaming interface includes at least one microphone area, and the method is For each microphone area, the microphone type of the microphone area is determined, wherein the microphone type includes one of the following: a video microphone, a voice microphone, and an empty microphone. Processing at least some of the views of the multilayer view according to the microphone type, A method for processing live streaming interfaces, including the processing of live streaming interfaces.

2. The method according to claim 1, wherein the multilayer view is a three-layer view, each consisting of a microphone layer view, a theme layer view, and an in-stream player layer view.

3. Processing at least some of the views among the multilayer views according to the microphone type is: To obtain the hierarchical relationship of the aforementioned multilayer view, Processing at least some of the views of the multilayer view according to the hierarchical relationship and the microphone type, The method according to claim 2, including the method described in claim 2.

4. Processing at least some of the views among the multilayer views according to the hierarchical relationship and the microphone type is: If the microphone type is a video microphone, the process includes processing at least some of the views in the multilayer view to display the content in the in-stream player layer view, If the microphone type is a voice microphone, the process includes processing at least some of the views in the multilayer view to display the content in the microphone layer view, If the microphone type is an empty microphone, the system processes at least some of the views in the multilayer view to display the content in the theme layer view. The method according to claim 3, including the method described in claim 3.

5. The method according to claim 3, wherein the hierarchical relationship is such that the microphone layer view is at the top layer, the theme layer view is at the middle layer, and the in-stream player layer view is at the bottom layer.

6. Processing at least some of the views among the multilayer views according to the hierarchical relationship and the microphone type is: If the microphone type is a video microphone, the display attribute of the microphone layer view is set to hidden, and the theme layer view corresponding to the microphone area is cut off. The method according to claim 5.

7. Cutting the theme layer view corresponding to the aforementioned microphone area is, Determining the location information in the live streaming interface of the microphone area, The theme layer view in the aforementioned location information is cut off, The method according to claim 6, including the method described in claim 6.

8. Processing at least some of the views among the multilayer views according to the hierarchical relationship and the microphone type is: If the aforementioned microphone type is an empty microphone, Set the display attribute of the microphone layer view to "Display", adjust the transparency of the microphone layer view, or This includes setting the display attribute of the microphone layer view to hidden, The method according to claim 5.

9. Processing at least some of the views among the multilayer views according to the hierarchical relationship and the microphone type is: If the microphone type is a voice microphone, the display attribute of the microphone layer view is set to display, and the target image is rendered to the microphone layer view. The method according to claim 5.

10. Rendering the target image to the microphone layer view is The aforementioned target image is subjected to blurring, The process involves rendering the blurred target image into the microphone layer view, The method according to claim 9, including the method described in claim 9.

11. After rendering the target image to the microphone layer view, To acquire live streaming-related information corresponding to the aforementioned microphone area, The aforementioned live streaming-related information is displayed in the microphone layer view, The method according to claim 9, further comprising:

12. A processing device for a live streaming interface, wherein the live streaming interface includes a multilayer view, and the live streaming interface includes at least one microphone area, and the device, A microphone type determination module for determining the microphone type of each microphone area, wherein the microphone type includes one of the following: a video microphone, a voice microphone, and an empty microphone. A view processing module for processing at least some of the views of the multilayer view according to the microphone type, A processing unit for a live streaming interface, including a device for live streaming.

13. One or more processors, A storage device for storing one or more programs, An electronic device in which one or more of the aforementioned programs are executed by one or more processors to enable one or more processors to implement the processing method for a live streaming interface according to any one of claims 1 to 11.

14. A storage medium containing computer executable instructions, which is used to perform the processing method of a live streaming interface according to any one of claims 1 to 11 when the computer executable instructions are executed by a computer processor.

Images