Livestreaming room interface processing method and device, and storage medium

By obtaining the configuration parameters of the mic layout, the interface layout of the live broadcast room is uniformly controlled, and the problem of high interface development costs for different types of live broadcast room is solved, and flexible interface layout and efficient development process is realized.

WO2025139936A1PCT designated stage expired Publication Date: 2025-07-03BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/140190
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-12-29
Filing Date
2024-12-18
Publication Date
2025-07-03

AI Technical Summary

Technical Problem

In the prior art, the interface layout of the live broadcast room varies according to different types of live broadcast rooms, resulting in high development costs, high maintenance costs, slow iteration, and insufficient flexibility.

Method used

Provide a live broadcast room interface processing method, which can uniformly control the layout of multimedia streaming data and interface elements in the live broadcast room interface, and reduce development and maintenance costs.

Benefits of technology

It realizes the flexibility of the layout of the live broadcast room interface and improves the development efficiency, reducing the development and maintenance costs of different types of live broadcast room interfaces.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024140190_03072025_PF_FP_ABST
    Figure CN2024140190_03072025_PF_FP_ABST
Patent Text Reader

Abstract

Embodiments of the present disclosure provide a livestreaming room interface processing method and device, and a storage medium. The method comprises: acquiring, by a first client, first multimedia stream data of a second client participating in co-streaming in any target type of livestreaming room and second multimedia stream data of the first client; acquiring a seat layout configuration parameter of the target type of livestreaming room and data to be displayed; and on the basis of the seat layout configuration parameter, displaying, in a livestreaming room interface, the first multimedia stream data, the second multimedia stream data, and an interface element corresponding to the target type of livestreaming room, and displaying, in the interface element, the data to be displayed. The embodiments of the present disclosure provide a general layout method for any target type of livestreaming room interface, and the layout and display of various pieces of multimedia stream data in the livestreaming room interface and related interface elements of various types of livestreaming rooms are controlled by means of a seat layout configuration parameter, thereby achieving a more flexible livestreaming room interface layout, reducing the development costs of the livestreaming room interface, and improving the development efficiency.
Need to check novelty before this filing date? Find Prior Art

Description

Live broadcast room interface processing method, device and storage medium

[0001] This application claims priority to Chinese patent application No. 202311873344.9 filed on December 29, 2023, and the contents of the above-mentioned Chinese patent application disclosure are hereby incorporated by reference in their entirety as a part of this application. Technical Field

[0002] The embodiments of the present disclosure relate to a method, device and storage medium for processing a live broadcast room interface. Background Art

[0003] Currently, in live video broadcast rooms or voice live broadcast rooms, the host can establish a live broadcast session with the guests to conduct real-time live broadcast and live broadcast interaction, so that the audience in the live broadcast room can watch the live broadcast interaction content.

[0004] As live streaming rooms become increasingly versatile, they can now include a variety of different types, such as video chat, voice chat, themed competitions, and karaoke. However, different types of live streaming rooms require different interface layouts, as do different microphone-related controls. Developers need to develop separate interfaces for each type of room, resulting in high development and maintenance costs, slow iteration, and limited flexibility. Summary of the Invention

[0005] The embodiments of the present disclosure provide a live broadcast room interface processing method, device and storage medium, so as to provide a universal layout method for the live broadcast room interface of any target type.

[0006] In a first aspect, an embodiment of the present disclosure provides a method for processing a live broadcast room interface, which is applied to a client, and the method includes:

[0007] Obtaining first multimedia stream data of a second client participating in a live broadcast room of any target type and second multimedia stream data of the first client;

[0008] Obtaining microphone layout configuration parameters and data to be displayed for the live broadcast room of the target type;

[0009] According to the microphone layout configuration parameters, the first multimedia stream data, the second multimedia stream data and the interface elements corresponding to the live broadcast room of the target type are displayed in the live broadcast room interface, and the data to be displayed is displayed in the interface elements.

[0010] In a second aspect, an embodiment of the present disclosure provides a live broadcast room interface processing device, including:

[0011] A multimedia stream data acquisition unit, configured to acquire first multimedia stream data of a second client participating in a live broadcast room of any target type and second multimedia stream data of the first client;

[0012] A parameter acquisition unit, configured to acquire microphone layout configuration parameters of the target type of live broadcast room and data to be displayed;

[0013] A layout unit is used to display the first multimedia stream data, the second multimedia stream data and the interface elements corresponding to the live broadcast room of the target type in the live broadcast room interface according to the microphone layout configuration parameters, and to display the data to be displayed in the interface elements.

[0014] In a third aspect, an embodiment of the present disclosure provides an electronic device, including: at least one processor and a memory;

[0015] The memory stores computer-executable instructions;

[0016] The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the live broadcast room interface processing method described in the first aspect and various possible designs of the first aspect.

[0017] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the live broadcast room interface processing method described in the first aspect and various possible designs of the first aspect is implemented.

[0018] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, comprising computer-executable instructions. When a processor executes the computer-executable instructions, the live broadcast room interface processing method described in the first aspect and various possible designs of the first aspect is implemented.

[0019] The live broadcast room interface processing method, device and storage medium provided by the embodiments of the present disclosure obtain the first multimedia stream data of the second client participating in the microphone connection and the second multimedia stream data of the first client in the live broadcast room of any target type; obtain the microphone layout configuration parameters of the live broadcast room of the target type, and the data to be displayed; according to the microphone layout configuration parameters, the first multimedia stream data, the second multimedia stream data and the interface elements corresponding to the live broadcast room of the target type are displayed in the live broadcast room interface, and the data to be displayed is displayed in the interface elements. The embodiments of the present disclosure provide a general layout method for the live broadcast room interface of any target type, which controls the layout and display of each multimedia stream data in the live broadcast room interface on the client and the interface elements corresponding to the target type of live broadcast room through the microphone layout configuration parameters, making the live broadcast room interface layout more flexible, and developers do not need to develop live broadcast room interfaces for various types of live broadcast rooms, but only need to configure the microphone layout configuration parameters, thereby reducing the development and maintenance costs of different types of live broadcast room interfaces and improving development efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, a brief introduction will be given below to the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0021] FIG1 is a diagram illustrating an example of a scene of a live broadcast room interface processing according to an embodiment of the present disclosure;

[0022] FIG2 is a flow chart of a method for processing a live broadcast room interface according to an embodiment of the present disclosure;

[0023] FIG3a is a schematic diagram of a live broadcast room interface processing according to an embodiment of the present disclosure;

[0024] FIG3 b is a schematic diagram of a live broadcast room interface processing according to another embodiment of the present disclosure;

[0025] FIG3c is a schematic diagram of a live broadcast room interface processing according to another embodiment of the present disclosure;

[0026] FIG4 is a structural block diagram of a live broadcast room interface processing device provided by an embodiment of the present disclosure; and

[0027] FIG5 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0028] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present disclosure without making any creative efforts shall fall within the scope of protection of the present disclosure.

[0029] As live streaming rooms become increasingly versatile, they can now include a variety of different types, such as video chat, voice chat, themed competitions, and karaoke. However, different types of live streaming rooms require different interface layouts, as do different microphone-related controls. Developers need to develop separate interfaces for each type of room, resulting in high development and maintenance costs, slow iteration, and limited flexibility.

[0030] In order to solve the above technical problems, the embodiment of the present disclosure provides a method for processing a live broadcast room interface, which obtains the first multimedia stream data of the second client participating in the microphone connection and the second multimedia stream data of the first client in a live broadcast room of any target type; obtains the microphone layout configuration parameters of the live broadcast room of the target type, and the data to be displayed; according to the microphone layout configuration parameters, the first multimedia stream data, the second multimedia stream data and the interface elements corresponding to the live broadcast room of the target type are displayed in the live broadcast room interface, and the data to be displayed is displayed in the interface elements. The embodiment of the present disclosure provides a general layout method for the live broadcast room interface of any target type, which controls the layout and display of each multimedia stream data in the live broadcast room interface on the client and the interface elements corresponding to the target type of live broadcast room through the microphone layout configuration parameters, making the live broadcast room interface layout more flexible, and developers do not need to develop live broadcast room interfaces for various types of live broadcast rooms, but only need to configure the microphone layout configuration parameters, thereby reducing the development and maintenance costs of different types of live broadcast room interfaces and improving development efficiency.

[0031] The live broadcast room interface processing method provided in the above embodiment is applied to the scenario shown in Figure 1. The live broadcast room can be a live broadcast room of any target type. The live broadcast room may include clients participating in the live broadcast and audience clients not participating in the live broadcast. The clients participating in the live broadcast include anchor clients and guest clients. The live broadcast room interface processing method provided in the embodiment of the present disclosure can be applied to clients participating in the live broadcast (including anchor clients and guest clients).

[0032] It should be noted that the user information and data involved in this disclosure are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0033] The live broadcast room interface processing method disclosed in the present invention will be introduced in detail below in conjunction with specific embodiments.

[0034] Refer to Figure 2, which is a flow chart of a method for processing a live broadcast interface provided by an embodiment of the present disclosure. The method of this embodiment can be applied to any client participating in a live broadcast interface connection in the live broadcast room, denoted as the first client, and the live broadcast interface processing method includes:

[0035] S201: Obtain first multimedia stream data of a second client participating in a live broadcast room of any target type and second multimedia stream data of a first client.

[0036] In this embodiment, a general live broadcast room layout method is provided, which can be applied to any target business scenario, that is, it can be applied to various types of live broadcast rooms, including but not limited to video chat live broadcast rooms, voice chat live broadcast rooms, theme competition live broadcast rooms, check-in ranking live broadcast rooms, karaoke live broadcast rooms, battle live broadcast rooms, etc.

[0037] Specifically, in a live broadcast room of any target type, there are multiple clients participating in the live broadcast, which may include the anchor client and the guest client. The anchor client and the guest client can interact with each other. In addition, the live broadcast room also includes audience clients that do not participate in the live broadcast, which can watch the interaction between the anchor client and the guest client.

[0038] The first client, which is the main execution body of this embodiment, can be a host client or a guest client. The first client can obtain the first multimedia stream data of the second client participating in the live broadcast room (where "first" and "second" in this embodiment are only for the convenience of description and do not represent the order or importance). Specifically, it can be the first multimedia stream data pulled from the server to the second client participating in the live broadcast room. In addition, the first client can also collect the second multimedia stream data of the first client, where the multimedia stream data in this embodiment can include but is not limited to audio, video, images, etc. There can be one or more second clients.

[0039] S202: Obtain microphone layout configuration parameters and data to be displayed for the live broadcast room of the target type.

[0040] In this embodiment, preset microphone position layout parameters can be pre-configured for different types of live broadcast rooms. The microphone position refers to the area where various multimedia stream data are displayed in the live broadcast room interface. In addition to displaying the multimedia stream data screen, each microphone position can also display some interface elements, such as the avatar and ID identification controls of the corresponding client, and can also display some interface elements related to the target type of live broadcast room. For example, in a battle live broadcast room, the score control, timing control, etc. of the corresponding client can be displayed on the microphone position.

[0041] The microphone layout configuration parameters for any type of live broadcast room can include, but are not limited to, the position, size, arrangement, alignment, corresponding interface elements, etc. of each microphone position, which can be configured for that type of live broadcast room. The microphone layout configuration parameters can determine the specific layout of the live broadcast room interface of that type. Optionally, for the same type of live broadcast room, multiple microphone layout configuration parameters can be configured. The host client can send a selection instruction to the server to determine which microphone layout configuration parameters to use in the target type of live broadcast room, so that all clients in the live broadcast room use the microphone layout configuration parameters selected by the host.

[0042] Furthermore, the first client can obtain the microphone layout configuration parameters of the live broadcast room of the current target type, wherein the specific acquisition method is not limited in this embodiment, and it can be obtained from the server, or obtained from the local storage unit of the first client, etc., or any other acquisition method is acceptable.

[0043] Since the microphone layout configuration parameters only determine how the live broadcast room interface is laid out, and do not determine what text, values, pictures, etc. are displayed in the live broadcast room interface layout, it is also necessary to obtain the data to be displayed in the live broadcast room interface to determine what text, values, pictures, etc. are displayed in the live broadcast room interface layout. Of course, it can include but is not limited to text, values, pictures, etc. For example, the avatar and ID identification of each client participating in the microphone connection can be obtained from the server to be displayed in the avatar control and ID identification control corresponding to each client. For example, in the battle live broadcast room, the score of each client during the battle process can be obtained from the server to be displayed in the score control corresponding to each client, and so on.

[0044] S203. Display the first multimedia stream data, the second multimedia stream data, and the interface elements corresponding to the live broadcast room of the target type in the live broadcast room interface according to the microphone layout configuration parameters, and display the data to be displayed in the interface elements.

[0045] In this embodiment, the first client can arrange and play the first multimedia stream data and the second multimedia stream data in the live broadcast room interface according to the microphone layout configuration parameters, and at the same time, display the interface elements corresponding to the live broadcast room of the target type, such as the avatar control, ID identification control, score control, timing control, etc. in the above embodiment, and display the acquired data to be displayed in the corresponding interface elements, thereby completing the layout and display of the entire live broadcast room interface.

[0046] The live studio interface processing method provided in this embodiment obtains the first multimedia stream data of the second client participating in the microphone connection and the second multimedia stream data of the first client in any target type of live studio; obtains the microphone layout configuration parameters of the target type of live studio and the data to be displayed; and according to the microphone layout configuration parameters, displays the first multimedia stream data, the second multimedia stream data, and the interface elements corresponding to the target type of live studio in the live studio interface, and displays the data to be displayed in the interface elements. This embodiment provides a method for the layout of a live studio interface for any target type. The microphone layout configuration parameters are used to control the layout and display of each multimedia stream data and the interface elements corresponding to the target type of live studio in the live studio interface on the client. This makes the live studio interface layout more flexible, and developers do not need to develop live studio interfaces for various types of live studios. They only need to configure the microphone layout configuration parameters, which reduces the development and maintenance costs of different types of live studio interfaces and improves development efficiency. In addition, new layouts of the live studio interface can support dynamic deployment and are independent of client version updates (releases).

[0047] On the basis of any of the above embodiments, the microphone layout configuration parameters may specifically include the position (e.g., distance from the top of the interface, etc.), size, filling method (e.g., stretch filling, blank space, cropping, etc.), alignment method, etc. of the canvas; in addition, the microphone layout configuration parameters may also include the position (e.g., coordinates in the canvas), size, etc. of the effective content area in the canvas, wherein the effective content area is the area of ​​the screen displaying each multimedia stream data, such as shown in Figures 3a and 3b, wherein Figure 3a is a wide alignment method, that is, the width of the effective content area (white area) in the canvas (the entire light gray area, including the white area) is the same as the maximum display width of the live studio interface (the entire dark gray area, including the light gray and white areas). The display width (if the live broadcast room interface is displayed in full screen, the width of the live broadcast room interface is the screen width) is the same. Figure 3b is a high alignment method, that is, the height of the effective content area (white area) in the canvas (the entire light gray area, including the white area) is the same as the maximum display height (the height of the live broadcast room interface minus the height of the upper and lower bangs areas) of the live broadcast room interface (the entire dark gray area, including the light gray and white areas). This causes the canvas and the effective content area to exceed the live broadcast room interface in width, that is, part of the effective content area can be displayed, and whether the left part or the right part is displayed is related to the alignment parameters; the microphone layout configuration parameters may also include the position, size, etc. of the display area of ​​each multimedia stream data in the effective content area.

[0048] Furthermore, in S203, when displaying the first multimedia stream data, the second multimedia stream data, and the interface elements corresponding to the live broadcast room of the target type in the live broadcast room interface according to the microphone position layout configuration parameters, it may specifically include:

[0049] Determining a position and alignment of a canvas in the live studio interface according to the microphone layout configuration parameters, determining a valid content area in the canvas, and determining display areas for the first multimedia stream data and the second multimedia stream data in the valid content area;

[0050] Screens of the first multimedia stream data and the second multimedia stream data, as well as interface elements corresponding to the first multimedia stream data and the second multimedia stream data, are respectively displayed in the display areas of the first multimedia stream data and the second multimedia stream data.

[0051] In this embodiment, the position and alignment of the canvas in the live studio interface can be determined based on parameters such as the position (e.g., distance from the top of the interface), size, filling method (e.g., stretch filling, blank space, cropping, etc.), and alignment of the canvas included in the microphone layout configuration parameters; further, the valid content area can be determined in the canvas based on parameters such as the position (e.g., coordinates in the canvas), size, etc. of the valid content area in the canvas included in the microphone layout configuration parameters; further, the display areas of the first multimedia stream data and the second multimedia stream data can be determined in the valid content area based on parameters such as the position and size of the display areas of each multimedia stream data in the valid content area included in the microphone layout configuration parameters, and then the images of the first multimedia stream data and the second multimedia stream data can be displayed in the display areas of the first multimedia stream data and the second multimedia stream data, respectively. In addition, interface elements corresponding to the first multimedia stream data and the second multimedia stream data (e.g., avatar controls, ID identification controls, score controls, timing controls, etc.) can also be displayed in the display areas of the first multimedia stream data and the second multimedia stream data.

[0052] It should be noted that if the first client is a horizontal screen display, for example, the first client is a horizontal screen display device such as a tablet computer, then a vertical screen display container can be configured in the screen of the first client, for example, as shown in Figure 3c, the live broadcast room interface is displayed in the vertical screen display container, and then the method in the above embodiment is executed in the vertical screen display container, that is, according to the microphone layout configuration parameters, the first multimedia stream data, the second multimedia stream data and the interface elements corresponding to the target type of live broadcast room are displayed in the live broadcast room interface in the vertical screen display container, thereby achieving the adaptability problem of the above-mentioned live broadcast room interface processing method when displayed in horizontal screen.

[0053] Optionally, when displaying the first multimedia stream data and the second multimedia stream data in the live broadcast room interface, the images of the first multimedia stream data and the second multimedia stream data can be uniformly rendered and displayed in a single view (View) in the live broadcast room interface, so that each frame of the first multimedia stream data and the second multimedia stream data is synthesized into a frame image, so that the first client only needs one view (View) to display the images of multiple multimedia stream data.

[0054] In addition, if the first client is the anchor client, the first client also needs to merge the images of each multimedia stream data and each interface element to obtain a multimedia stream data, and push the stream to the audience client for playback, so that the audience client can watch the multimedia stream data of the anchor client and guest client participating in the live broadcast room.

[0055] On the basis of any of the above embodiments, the live studio background image can also be set or modified in the live studio interface, and its execution subject (first client) can be the anchor client. Specifically, the first client can first obtain the live studio background image to be displayed, for example, it can be obtained by any method such as uploading or shooting; further, according to the display area of ​​the first multimedia stream data and the second multimedia stream data, the corresponding area of ​​the live studio background image can be cropped to form a window, wherein the position of each window is consistent with the display area of ​​the first multimedia stream data or the second multimedia stream data, and the size of each window is smaller than or equal to the display area of ​​the corresponding first multimedia stream data or the second multimedia stream data, and the cropped live studio background graphic is overlaid on the live studio interface so that the images of the first multimedia stream data and the second multimedia stream data are displayed from the window, thereby realizing the setting or modification of the live studio background image.

[0056] Based on any of the above embodiments, specific interactions can also be carried out between any two clients participating in the live broadcast room, such as client A participating in the live broadcast room sending a gift to client B, etc. The interaction instructions between any two clients participating in the live broadcast room can be transmitted by the server to each client participating in the live broadcast room.

[0057] After obtaining the interaction instruction between any two clients participating in the joint microphone connection, the first client can determine the corresponding interaction element according to the interaction instruction, and control the interaction element to perform a preset interaction action between the display areas of the multimedia stream data of the any two clients.

[0058] In this embodiment, in order to display on the first client that an interaction has occurred between any two clients, a corresponding interactive element can be determined according to the interactive instruction, and the interactive element can be controlled to perform a preset interactive action between the display areas of the multimedia stream data of any two clients. For example, for an interactive instruction in which client A sends a gift to client B, the corresponding interactive element is a gift display control. The gift display control can display the gift moving from the display area of ​​the multimedia stream data of client A to the display area of ​​the multimedia stream data of client B, thereby displaying the process of client A sending a gift to client B in the live broadcast room interface.

[0059] Based on any of the above embodiments, the audio of each multimedia stream data can also be visualized to show in the live broadcast room interface which client participating in the microphone connection is currently speaking. Specifically, the audio visualization interface element corresponding to each multimedia stream data can be determined based on the audio of each multimedia stream data in the first multimedia stream data and the second multimedia stream data, where the audio visualization interface element can be a control for displaying the volume change of the multimedia stream data, or a control for displaying the audio spectrum, and then the audio visualization interface element corresponding to each multimedia stream data is displayed in the display area of ​​each multimedia stream data.

[0060] Based on any of the above embodiments, when obtaining the microphone layout configuration parameters of the target type of live broadcast room, the following steps may be specifically included:

[0061] Obtaining a preset microphone layout configuration file for the target type of live broadcast room from the server, and parsing the preset microphone layout configuration file to obtain the microphone layout configuration parameters; or

[0062] If the preset microphone layout configuration file of the live broadcast room of the target type cannot be obtained from the server, the preset microphone layout configuration file of the live broadcast room of the target type is obtained from the local storage unit of the first client, and the preset microphone layout configuration file is parsed to obtain the microphone layout configuration parameters.

[0063] In this embodiment, the server can configure a preset microphone layout configuration file for the target type of live broadcast room, and the preset microphone layout configuration file includes microphone layout configuration parameters, and the preset microphone layout configuration file can be dynamically updated and dynamically issued (without relying on the release of the client). The client can obtain the preset microphone layout configuration file for the target type of live broadcast room from the server, and parse the preset microphone layout configuration file to obtain the microphone layout configuration parameters included therein; considering that there is a time delay in obtaining the preset microphone layout configuration file for the target type of live broadcast room from the server, or the problem of failure in obtaining the preset microphone layout configuration file, the target type can be pre-stored in the local storage unit of the first client. The preset microphone layout configuration file for the live broadcast room is configured. When the first client cannot obtain the preset microphone layout configuration file for the live broadcast room of the target type from the server, it can obtain the preset microphone layout configuration file for the live broadcast room of the target type from the local storage unit, and parse the preset microphone layout configuration file to obtain the microphone layout configuration parameters included therein. It should be noted that the preset microphone layout configuration file for the live broadcast room of the target type pre-stored in the local storage unit depends on the version of the client and cannot be dynamically obtained from the server. That is, the preset microphone layout configuration file for the live broadcast room of the target type will be obtained only when the client performs a version update, and it is pre-stored in the local storage unit.

[0064] Optionally, the server includes at least two servers, and at least two servers are configured with preset microphone layout configuration files for the target type of live broadcast room. As a backup, the first client can obtain the preset microphone layout configuration files for the target type of live broadcast room from any server, ensuring the stability and reliability of obtaining the preset microphone layout configuration files, avoiding the problem of acquisition delay or acquisition failure, and also ensuring the flexibility of configuration and update of the preset microphone layout configuration files. Optionally, at least two servers are configured with a preset server priority order, so the first client can obtain the preset microphone layout configuration files for the target type of live broadcast room from at least two servers according to the preset server priority order, for example, first obtaining from the server with the highest priority, if the acquisition fails, then obtaining from the server with the second highest priority, and so on, until the preset microphone layout configuration files are obtained from a certain server, or if the acquisition fails from all servers, the preset microphone layout configuration files for the target type of live broadcast room can be obtained from the local storage unit.

[0065] Optionally, after the first client parses the preset microphone layout configuration file, the parsed microphone layout configuration parameters can be cached in the memory of the first client. The next time the microphone layout configuration parameters of the target type of live broadcast room need to be obtained, the cached microphone layout configuration parameters in the memory can be directly used without having to obtain the preset microphone layout configuration file of the target type of live broadcast room from the server or local storage unit again and parse it, thereby improving the processing speed.

[0066] Furthermore, in the above embodiment, when obtaining the microphone layout configuration parameters of the target type of live broadcast room, the following may be specifically included:

[0067] Check whether the microphone layout configuration parameters are cached in the memory of the first client;

[0068] If the first client has microphone layout configuration parameters cached in its memory, suspend obtaining the preset microphone layout configuration file for the target type of live broadcast room from the server (i.e., no longer obtain the preset microphone layout configuration file); or

[0069] If the first client does not cache the microphone layout configuration parameters in its memory, it obtains a preset microphone layout configuration file for the target type of live broadcast room from the server, and parses the preset microphone layout configuration file to obtain the microphone layout configuration parameters; it may further cache the microphone layout configuration parameters in its memory; or

[0070] If the preset microphone layout configuration file of the target type of live broadcast room cannot be obtained from the server, the preset microphone layout configuration file of the target type of live broadcast room is obtained from the local storage unit of the first client, and the preset microphone layout configuration file is parsed to obtain the microphone layout configuration parameters; the microphone layout configuration parameters can also be cached in the memory.

[0071] Through the above method, it is ensured that the first client can obtain the microphone layout configuration parameters, thereby ensuring the layout of the live broadcast room interface.

[0072] It should be noted that after the server updates the preset microphone position layout configuration file, the updated preset microphone position layout configuration file can be obtained from the server, and then the updated microphone position layout configuration parameters can be parsed to update the live broadcast room interface layout according to the updated microphone position layout configuration parameters; if the updated preset microphone position layout configuration file fails to be obtained from the server, the live broadcast room interface layout will not be updated. In addition, the user can be prompted to update the version of the first client to update the preset microphone position layout configuration file of the target type of live broadcast room stored in the local storage unit of the first client.

[0073] Based on any of the above embodiments, the above live broadcast room interface processing method also supports the expansion of new business scenarios. When adding a new business scenario, in addition to supporting the above live broadcast room interface processing method, it can also support the new business scenario's own specific business logic, such as specific interface elements and the control logic of interface elements, specific ViewModel, etc., which will not be repeated here.

[0074] Corresponding to the live studio interface processing method described in the preceding embodiment, FIG4 is a block diagram of the live studio interface processing device provided by the present embodiment. For ease of illustration, only the portions relevant to the present embodiment are shown. Referring to FIG4 , the live studio interface processing device 400 includes a multimedia stream data acquisition unit 401, a parameter acquisition unit 402, and a layout unit 403.

[0075] The multimedia stream data acquisition unit 401 is configured to acquire the first multimedia stream data of the second client participating in the live broadcast room of any target type and the second multimedia stream data of the first client;

[0076] A parameter acquisition unit 402 is used to acquire microphone layout configuration parameters of the target type of live broadcast room and data to be displayed;

[0077] The layout unit 403 is used to display the first multimedia stream data, the second multimedia stream data and the interface elements corresponding to the live broadcast room of the target type in the live broadcast room interface according to the microphone layout configuration parameters, and display the data to be displayed in the interface elements.

[0078] In one or more embodiments of the present disclosure, when the layout unit 403 displays the first multimedia stream data, the second multimedia stream data, and the interface elements corresponding to the live broadcast room of the target type in the live broadcast room interface according to the microphone position layout configuration parameters, it is configured to:

[0079] Determining a position and alignment of a canvas in the live studio interface according to the microphone layout configuration parameters, determining a valid content area in the canvas, and determining display areas for the first multimedia stream data and the second multimedia stream data in the valid content area;

[0080] Screens of the first multimedia stream data and the second multimedia stream data, as well as interface elements corresponding to the first multimedia stream data and the second multimedia stream data, are respectively displayed in the display areas of the first multimedia stream data and the second multimedia stream data.

[0081] In one or more embodiments of the present disclosure, if the first client is in landscape mode, the layout unit 403, when displaying the first multimedia stream data, the second multimedia stream data, and the interface elements corresponding to the target type of live broadcast room in the live broadcast room interface according to the microphone layout configuration parameters, is configured to:

[0082] Configuring a vertical display container on the screen of the first client;

[0083] According to the microphone layout configuration parameters, the first multimedia stream data, the second multimedia stream data and the interface elements corresponding to the live broadcast room of the target type are displayed in the live broadcast room interface in the vertical screen display container.

[0084] In one or more embodiments of the present disclosure, the layout unit 403 is further configured to:

[0085] Get the background image of the live broadcast room to be displayed;

[0086] A window is cut out of the corresponding area of ​​the live broadcast room background image according to the display area of ​​the first multimedia stream data and the second multimedia stream data, and the cut live broadcast room background graphic is overlaid on the live broadcast room interface so that the images of the first multimedia stream data and the second multimedia stream data are displayed from the window.

[0087] In one or more embodiments of the present disclosure, the layout unit 403 is further configured to:

[0088] Get the interaction instructions between any two clients participating in the live broadcast;

[0089] A corresponding interactive element is determined according to the interactive instruction, and the interactive element is controlled to perform a preset interactive action between the display areas of the multimedia stream data of the arbitrary two clients.

[0090] In one or more embodiments of the present disclosure, when displaying the first multimedia stream data and the second multimedia stream data in the live broadcast room interface, the layout unit 403 is configured to:

[0091] The first multimedia stream data and the second multimedia stream data are uniformly rendered and displayed in a single view in the live broadcast room interface.

[0092] In one or more embodiments of the present disclosure, the layout unit 403 is further configured to:

[0093] According to the audio of each multimedia stream data in the first multimedia stream data and the second multimedia stream data, an audio visualization interface element corresponding to each multimedia stream data is determined and displayed in a display area of ​​each multimedia stream data.

[0094] In one or more embodiments of the present disclosure, when acquiring the microphone layout configuration parameters of the target type of live broadcast room, the parameter acquisition unit 402 is configured to:

[0095] Obtaining a preset microphone layout configuration file for the target type of live broadcast room from the server, and parsing the preset microphone layout configuration file to obtain the microphone layout configuration parameters; or

[0096] If the preset microphone layout configuration file of the live broadcast room of the target type cannot be obtained from the server, the preset microphone layout configuration file of the live broadcast room of the target type is obtained from the local storage unit of the first client, and the preset microphone layout configuration file is parsed to obtain the microphone layout configuration parameters.

[0097] In one or more embodiments of the present disclosure, the server includes at least two server ends. Accordingly, when the parameter acquisition unit 402 acquires the preset microphone layout configuration file of the target type of live broadcast room from the server end, it is used to:

[0098] According to the preset server priority order, a preset microphone layout configuration file of the live broadcast room of the target type is obtained from the at least two servers.

[0099] In one or more embodiments of the present disclosure, when the parameter acquisition unit 402 acquires the preset microphone layout configuration file of the target type of live broadcast room from the server, it is used to:

[0100] Checking whether the microphone position layout configuration parameters are cached in the memory of the first client;

[0101] If the microphone layout configuration parameters are not cached in the memory of the first client, obtaining a preset microphone layout configuration file for the live broadcast room of the target type from the server; or

[0102] If the microphone layout configuration parameters are cached in the memory of the first client, the acquisition of the preset microphone layout configuration file of the live broadcast room of the target type from the server is suspended.

[0103] The device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail in this embodiment.

[0104] Referring to FIG5 , there is shown a schematic diagram of the structure of an electronic device 500 suitable for implementing an embodiment of the present disclosure. The electronic device 500 may be a terminal device or a server. The terminal device may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), vehicle-mounted terminals (e.g., vehicle-mounted navigation terminals), and fixed terminals such as digital TVs and desktop computers. The electronic device shown in FIG5 is merely an example and should not limit the functionality and scope of use of the embodiments of the present disclosure.

[0105] As shown in FIG5 , the electronic device 500 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. Various programs and data required for the operation of the electronic device 500 are also stored in the RAM 503. The processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0106] Typically, the following devices may be connected to the I / O interface 505: an input device 506 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509. The communication device 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. Although FIG5 shows an electronic device 500 having various devices, it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or have alternatively.

[0107] According to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via the communication device 509, or installed from the storage device 508, or installed from the ROM 502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0108] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0109] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0110] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0111] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet Service Provider).

[0112] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0113] The units involved in the embodiments described in this disclosure may be implemented in software or hardware. In some cases, the name of a unit does not limit the unit itself. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses."

[0114] The functions described above in the present disclosure may be performed at least in part by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0115] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0116] In a first aspect, according to one or more embodiments of the present disclosure, a method for processing a live broadcast room interface is provided, which is applied to a client, and the method includes:

[0117] Obtaining first multimedia stream data of a second client participating in a live broadcast room of any target type and second multimedia stream data of the first client;

[0118] Obtaining microphone layout configuration parameters and data to be displayed for the live broadcast room of the target type;

[0119] According to the microphone layout configuration parameters, the first multimedia stream data, the second multimedia stream data and the interface elements corresponding to the live broadcast room of the target type are displayed in the live broadcast room interface, and the data to be displayed is displayed in the interface elements.

[0120] According to one or more embodiments of the present disclosure, displaying the first multimedia stream data, the second multimedia stream data, and the interface elements corresponding to the target business scenario in the live broadcast room interface according to the microphone layout configuration parameters includes:

[0121] Determining a position and alignment of a canvas in the live studio interface according to the microphone layout configuration parameters, determining a valid content area in the canvas, and determining display areas for the first multimedia stream data and the second multimedia stream data in the valid content area;

[0122] Screens of the first multimedia stream data and the second multimedia stream data, as well as interface elements corresponding to the first multimedia stream data and the second multimedia stream data, are respectively displayed in the display areas of the first multimedia stream data and the second multimedia stream data.

[0123] According to one or more embodiments of the present disclosure, if the first client is in a horizontal screen display, the first multimedia stream data, the second multimedia stream data, and the interface elements corresponding to the live broadcast room of the target type are displayed in the live broadcast room interface according to the microphone layout configuration parameters, including:

[0124] Configuring a vertical display container on the screen of the first client;

[0125] According to the microphone layout configuration parameters, the first multimedia stream data, the second multimedia stream data and the interface elements corresponding to the live broadcast room of the target type are displayed in the live broadcast room interface in the vertical screen display container.

[0126] According to one or more embodiments of the present disclosure, the method further includes:

[0127] Get the background image of the live broadcast room to be displayed;

[0128] A window is cut out of the corresponding area of ​​the live broadcast room background image according to the display area of ​​the first multimedia stream data and the second multimedia stream data, and the cut live broadcast room background graphic is overlaid on the live broadcast room interface so that the images of the first multimedia stream data and the second multimedia stream data are displayed from the window.

[0129] According to one or more embodiments of the present disclosure, the method further includes:

[0130] Get the interaction instructions between any two clients participating in the live broadcast;

[0131] A corresponding interactive element is determined according to the interactive instruction, and the interactive element is controlled to perform a preset interactive action between the display areas of the multimedia stream data of the arbitrary two clients.

[0132] According to one or more embodiments of the present disclosure, displaying the first multimedia stream data and the second multimedia stream data in a live broadcast room interface includes:

[0133] The first multimedia stream data and the second multimedia stream data are uniformly rendered and displayed in a single view in the live broadcast room interface.

[0134] According to one or more embodiments of the present disclosure, the method further includes:

[0135] According to the audio of each multimedia stream data in the first multimedia stream data and the second multimedia stream data, an audio visualization interface element corresponding to each multimedia stream data is determined and displayed in a display area of ​​each multimedia stream data.

[0136] According to one or more embodiments of the present disclosure, obtaining microphone layout configuration parameters of the target type of live broadcast room includes:

[0137] Obtaining a preset microphone layout configuration file for the target type of live broadcast room from the server, and parsing the preset microphone layout configuration file to obtain the microphone layout configuration parameters; or

[0138] If the preset microphone layout configuration file of the live broadcast room of the target type cannot be obtained from the server, the preset microphone layout configuration file of the live broadcast room of the target type is obtained from the local storage unit of the first client, and the preset microphone layout configuration file is parsed to obtain the microphone layout configuration parameters.

[0139] According to one or more embodiments of the present disclosure, the server includes at least two server ends. Accordingly, obtaining the preset microphone layout configuration file of the target type of live broadcast room from the server end includes:

[0140] According to the preset server priority order, a preset microphone layout configuration file of the live broadcast room of the target type is obtained from the at least two servers.

[0141] According to one or more embodiments of the present disclosure, obtaining a preset microphone layout configuration file for a live broadcast room of the target type from a server includes:

[0142] Checking whether the microphone position layout configuration parameters are cached in the memory of the first client;

[0143] If the microphone layout configuration parameters are not cached in the memory of the first client, obtaining a preset microphone layout configuration file for the live broadcast room of the target type from the server; or

[0144] If the microphone layout configuration parameters are cached in the memory of the first client, the acquisition of the preset microphone layout configuration file of the live broadcast room of the target type from the server is suspended.

[0145] In a second aspect, according to one or more embodiments of the present disclosure, a live broadcast room interface processing device is provided, comprising:

[0146] A multimedia stream data acquisition unit, configured to acquire first multimedia stream data of a second client participating in a live broadcast room of any target type and second multimedia stream data of the first client;

[0147] A parameter acquisition unit, configured to acquire microphone layout configuration parameters of the target type of live broadcast room and data to be displayed;

[0148] A layout unit is used to display the first multimedia stream data, the second multimedia stream data and the interface elements corresponding to the live broadcast room of the target type in the live broadcast room interface according to the microphone layout configuration parameters, and to display the corresponding data to be displayed in the interface elements.

[0149] According to one or more embodiments of the present disclosure, when the layout unit displays the first multimedia stream data, the second multimedia stream data, and the interface elements corresponding to the live broadcast room of the target type in the live broadcast room interface according to the microphone position layout configuration parameters, it is configured to:

[0150] Determining a position and alignment of a canvas in the live studio interface according to the microphone layout configuration parameters, determining a valid content area in the canvas, and determining display areas for the first multimedia stream data and the second multimedia stream data in the valid content area;

[0151] Screens of the first multimedia stream data and the second multimedia stream data, as well as interface elements corresponding to the first multimedia stream data and the second multimedia stream data, are respectively displayed in the display areas of the first multimedia stream data and the second multimedia stream data.

[0152] According to one or more embodiments of the present disclosure, if the first client is in a horizontal screen display, the layout unit, when displaying the first multimedia stream data, the second multimedia stream data, and the interface elements corresponding to the live broadcast room of the target type in the live broadcast room interface according to the microphone layout configuration parameters, is configured to:

[0153] Configuring a vertical display container on the screen of the first client;

[0154] According to the microphone layout configuration parameters, the first multimedia stream data, the second multimedia stream data and the interface elements corresponding to the live broadcast room of the target type are displayed in the live broadcast room interface in the vertical screen display container.

[0155] According to one or more embodiments of the present disclosure, the layout unit is further configured to:

[0156] Get the background image of the live broadcast room to be displayed;

[0157] A window is cut out of the corresponding area of ​​the live broadcast room background image according to the display area of ​​the first multimedia stream data and the second multimedia stream data, and the cut live broadcast room background graphic is overlaid on the live broadcast room interface so that the images of the first multimedia stream data and the second multimedia stream data are displayed from the window.

[0158] According to one or more embodiments of the present disclosure, the layout unit is further configured to:

[0159] Get the interaction instructions between any two clients participating in the live broadcast;

[0160] A corresponding interactive element is determined according to the interactive instruction, and the interactive element is controlled to perform a preset interactive action between the display areas of the multimedia stream data of the arbitrary two clients.

[0161] According to one or more embodiments of the present disclosure, when displaying the first multimedia stream data and the second multimedia stream data in a live broadcast room interface, the layout unit is configured to:

[0162] The first multimedia stream data and the second multimedia stream data are uniformly rendered and displayed in a single view in the live broadcast room interface.

[0163] According to one or more embodiments of the present disclosure, the layout unit is further configured to:

[0164] According to the audio of each multimedia stream data in the first multimedia stream data and the second multimedia stream data, an audio visualization interface element corresponding to each multimedia stream data is determined and displayed in a display area of ​​each multimedia stream data.

[0165] According to one or more embodiments of the present disclosure, when acquiring the microphone layout configuration parameters of the target type of live broadcast room, the parameter acquisition unit is configured to:

[0166] Obtaining a preset microphone layout configuration file for the target type of live broadcast room from the server, and parsing the preset microphone layout configuration file to obtain the microphone layout configuration parameters; or

[0167] If the preset microphone layout configuration file of the live broadcast room of the target type cannot be obtained from the server, the preset microphone layout configuration file of the live broadcast room of the target type is obtained from the local storage unit of the first client, and the preset microphone layout configuration file is parsed to obtain the microphone layout configuration parameters.

[0168] According to one or more embodiments of the present disclosure, the server includes at least two server ends. Accordingly, when the parameter acquisition unit acquires the preset microphone layout configuration file of the target type of live broadcast room from the server end, it is used to:

[0169] According to the preset server priority order, a preset microphone layout configuration file of the live broadcast room of the target type is obtained from the at least two servers.

[0170] According to one or more embodiments of the present disclosure, when the parameter acquisition unit acquires the preset microphone layout configuration file of the target type of live broadcast room from the server, it is used to:

[0171] Checking whether the microphone position layout configuration parameters are cached in the memory of the first client;

[0172] If the microphone layout configuration parameters are not cached in the memory of the first client, obtaining a preset microphone layout configuration file for the live broadcast room of the target type from the server; or

[0173] If the microphone layout configuration parameters are cached in the memory of the first client, the acquisition of the preset microphone layout configuration file of the live broadcast room of the target type from the server is suspended.

[0174] In a third aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, comprising: at least one processor and a memory;

[0175] The memory stores computer-executable instructions;

[0176] The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the live broadcast room interface processing method described in the first aspect and various possible designs of the first aspect.

[0177] In a fourth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the live broadcast room interface processing method described in the first aspect and various possible designs of the first aspect is implemented.

[0178] In a fifth aspect, according to one or more embodiments of the present disclosure, a computer program product is provided, comprising computer execution instructions. When a processor executes the computer execution instructions, the live broadcast room interface processing method described in the first aspect and various possible designs of the first aspect is implemented.

[0179] The above description is merely an illustration of the technical principles employed in the embodiments of the present disclosure. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but should also encompass other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0180] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0181] Although the present disclosure has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A live broadcast room interface processing method, which is applied to a first client, and the method includes: Obtaining first multimedia stream data of a second client participating in a co-hosting in a live broadcast room of any target type and second multimedia stream data of the first client; Obtaining the microphone layout configuration parameters of the live broadcast room of the target type and the data to be displayed; According to the microphone layout configuration parameters, displaying the first multimedia stream data, the second multimedia stream data, and the interface elements corresponding to the live broadcast room of the target type in the live broadcast room interface, and displaying the data to be displayed in the interface elements.

2. The method according to claim 1, wherein, The step of displaying the first multimedia stream data, the second multimedia stream data, and the interface elements corresponding to the live broadcast room of the target type in the live broadcast room interface according to the microphone layout configuration parameters includes: According to the microphone layout configuration parameters, determining the position and alignment mode of the canvas in the live broadcast room interface, determining an effective content area in the canvas, and determining the display areas of the first multimedia stream data and the second multimedia stream data in the effective content area; Displaying the pictures of the first multimedia stream data and the second multimedia stream data and the interface elements corresponding to the first multimedia stream data and the second multimedia stream data respectively in the display areas of the first multimedia stream data and the second multimedia stream data.

3. The method according to claim 2, wherein If the first client is in landscape mode, the step of displaying the first multimedia stream data, the second multimedia stream data, and the interface elements corresponding to the live broadcast room of the target type in the live broadcast room interface according to the microphone layout configuration parameters includes: Configuring a portrait display container within the screen of the first client; According to the microphone layout configuration parameters, displaying the first multimedia stream data, the second multimedia stream data, and the interface elements corresponding to the live broadcast room of the target type in the live broadcast room interface within the portrait display container.

4. The method according to claim 2 or 3, further including: Obtaining a live broadcast room background image to be displayed; Cutting out a window from the corresponding area of the live broadcast room background image according to the display areas of the first multimedia stream data and the second multimedia stream data, and covering the cut live broadcast room background graphic on the live broadcast room interface, so that the pictures of the first multimedia stream data and the second multimedia stream data are displayed from the window.

5. The method according to any one of claims 2-4, further including: Obtaining an interaction instruction between any two clients participating in the co-hosting; Determining a corresponding interaction element according to the interaction instruction, and controlling the interaction element to perform a preset interaction action between the display areas of the multimedia stream data of the any two clients.

6. The method according to any one of claims 1-5, wherein, The step of displaying the first multimedia stream data and the second multimedia stream data in the live broadcast room interface includes: Rendering and displaying the pictures of the first multimedia stream data and the second multimedia stream data uniformly in a single view in the live broadcast room interface.

7. The method according to any one of claims 1-6, further including: Based on the audio of each multimedia stream data in the first multimedia stream data and the second multimedia stream data, determine the audio visualization interface elements corresponding to each multimedia stream data, and display them at the display area of each multimedia stream data.

8. The method according to any one of claims 1-7, wherein, The obtaining of the microphone layout configuration parameters of the live broadcast room of the target type includes: Obtain the preset microphone layout configuration file of the live broadcast room of the target type from the server, and parse the preset microphone layout configuration file to obtain the microphone layout configuration parameters; or If the preset microphone layout configuration file of the live broadcast room of the target type cannot be obtained from the server, obtain the preset microphone layout configuration file of the live broadcast room of the target type from the local storage unit of the first client, and parse the preset microphone layout configuration file to obtain the microphone layout configuration parameters.

9. The method according to claim 8, wherein, The server includes at least two servers. Correspondingly, the obtaining of the preset microphone layout configuration file of the live broadcast room of the target type from the server includes: Obtain the preset microphone layout configuration file of the live broadcast room of the target type from the at least two servers according to the preset server priority order.

10. The method according to claim 8, wherein, The obtaining of the preset microphone layout configuration file of the live broadcast room of the target type from the server includes: Check whether the microphone layout configuration parameters are cached in the memory of the first client; If the microphone layout configuration parameters are not cached in the memory of the first client, obtain the preset microphone layout configuration file of the live broadcast room of the target type from the server; or If the microphone layout configuration parameters are cached in the memory of the first client, suspend obtaining the preset microphone layout configuration file of the live broadcast room of the target type from the server.

11. A live broadcast room interface processing device, including: A multimedia stream data acquisition unit, configured to acquire the first multimedia stream data of the second client participating in the co-hosting and the second multimedia stream data of the first client in any live broadcast room of the target type; A parameter acquisition unit, configured to acquire the microphone layout configuration parameters of the live broadcast room of the target type and the data to be displayed; A layout unit, configured to display the first multimedia stream data, the second multimedia stream data, and the interface elements corresponding to the live broadcast room of the target type in the live broadcast room interface according to the microphone layout configuration parameters, and display the data to be displayed in the interface elements.

12. An electronic device, including at least one processor and a memory, wherein The memory is configured to store computer execution instructions; The at least one processor is configured to execute the computer execution instructions stored in the memory, so that the at least one processor executes the live broadcast room interface processing method according to any one of claims 1-10.

13. A computer-readable storage medium stores computer-executable instructions, wherein, When the processor executes the computer execution instructions, the live broadcast room interface processing method according to any one of claims 1-10 is implemented.

14. A computer program product comprising computer-executable instructions, wherein, When the processor executes the computer execution instructions, the live broadcast room interface processing method according to any one of claims 1-10 is implemented.

Citation Information

Patent Citations

  • Picture display method and device under microphone-connected live broadcast and electronic equipment

    CN115134620A

  • Live broadcast microphone connection confluence method and device, and storage medium

    CN116801006A

  • Microphone connection interaction method and device for network live broadcast, and live broadcast system

    CN116962744A

  • Managing the display of multimedia content across multiple screens.

    FR3135857A1