Method for determining microphone position layout and electronic equipment

Abstract

The embodiment of the invention relates to a method for determining microphone position layout and electronic equipment. The method comprises the steps that in response to received triggering operation used for adjusting microphone position layout, a first layout of multiple microphone positions is displayed on a user interface, and the first layout comprises multiple microphone position areas corresponding to the multiple microphone positions; displaying a second layout of the plurality of microphone positions on the user interface in response to receiving an adjustment operation on the plurality of microphone position areas of the first layout, the second layout including a plurality of adjusted microphone position areas corresponding to the plurality of microphone positions; and in response to receiving a confirmation operation on the second layout, determining element information on each of the plurality of adjusted microphone bit regions. In this way, a scheme for flexibly determining the microphone position layout is provided, dynamic adjustment of the microphone position layout is achieved, and user experience is improved.

Description

Technical Field

[0001] The embodiments disclosed herein relate generally to the field of live streaming, and more specifically to methods, apparatus, electronic devices, computer-readable storage media, and computer program products for determining microphone layout. Background Technology

[0002] With technological advancements, the development of Artificial Intelligence (AI) is accelerating. For example, in media technology fields such as live streaming, AI is playing an increasingly important role. AI can not only repair and enhance live stream content, but also create and transform its artistic style. It can also increase the popularity and enhance the overall effect of a live stream. During a live stream, hosts can connect with other hosts or viewers for a better viewing experience. Summary of the Invention

[0003] According to exemplary embodiments of the present disclosure, a method, apparatus, electronic device, computer-readable storage medium, and computer program product for determining microphone layout are provided.

[0004] In a first aspect of this disclosure, a method for determining a microphone layout is provided. The method includes: in response to receiving a trigger operation for adjusting the microphone layout, displaying a first layout of a plurality of microphone positions on a user interface, wherein the first layout includes a plurality of microphone position regions corresponding to the plurality of microphone positions; in response to receiving an adjustment operation on the plurality of microphone position regions of the first layout, displaying a second layout of the plurality of microphone positions on the user interface, wherein the second layout includes a plurality of adjusted microphone position regions corresponding to the plurality of microphone positions; and in response to receiving a confirmation operation on the second layout, determining element information on each region among the plurality of adjusted microphone position regions.

[0005] In a second aspect of this disclosure, an electronic device is provided. The electronic device includes: at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to: display a first layout of a plurality of microphone positions on a user interface in response to receiving a trigger operation for adjusting a microphone position layout, wherein the first layout includes a plurality of microphone position regions corresponding to the plurality of microphone positions; display a second layout of the plurality of microphone positions on the user interface in response to receiving an adjustment operation on the plurality of microphone position regions of the first layout, wherein the second layout includes a plurality of adjusted microphone position regions corresponding to the plurality of microphone positions; and determine element information on each region of the plurality of adjusted microphone position regions in response to receiving a confirmation operation on the second layout.

[0006] In a third aspect of this disclosure, an apparatus for determining a microphone layout is provided. The apparatus includes: a first layout display module configured to display a first layout of multiple microphone positions on a user interface in response to receiving a trigger operation for adjusting the microphone layout, wherein the first layout includes multiple microphone position areas corresponding to the multiple microphone positions; a second layout display module configured to display a second layout of the multiple microphone positions on a user interface in response to receiving an adjustment operation on the multiple microphone position areas of the first layout, wherein the second layout includes multiple adjusted microphone position areas corresponding to the multiple microphone positions; and a microphone position element determination module configured to determine element information on each area of ​​the multiple adjusted microphone position areas in response to receiving a confirmation operation on the second layout.

[0007] In a fourth aspect of this disclosure, a computer-readable storage medium is provided. The computer-readable storage medium has machine-executable instructions stored thereon, which, when executed by a device, cause the device to perform the method described in the first aspect of this disclosure.

[0008] In a fifth aspect of this disclosure, a computer program product is provided, including computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the method described in the first aspect of this disclosure.

[0009] In a sixth aspect of this disclosure, an electronic device is provided, comprising: processing circuitry configured to perform the method described in the first aspect of this disclosure.

[0010] The summary section is provided to introduce a series of concepts in a simplified form, which will be further described in the detailed description below. The summary section is not intended to identify key or essential features of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0011] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0012] Figure 1 Schematic diagrams are shown illustrating example environments in which some embodiments of this disclosure can be applied;

[0013] Figure 2 A schematic diagram of the technical architecture of an orchestration engine for determining microphone layout according to some embodiments of the present disclosure is shown;

[0014] Figure 3A schematic diagram of the technical architecture of an orchestration engine for determining microphone layout according to some embodiments of the present disclosure is shown;

[0015] Figure 4 A schematic diagram of a rendering architecture for a client to determine microphone placement according to some embodiments of the present disclosure is shown;

[0016] Figure 5 A schematic flowchart of a method for determining microphone layout according to an example embodiment of the present disclosure is shown;

[0017] Figure 6 A schematic diagram of an example microphone layout according to some embodiments of the present disclosure is shown;

[0018] Figure 7 A schematic diagram of parameters for microphone placement according to some embodiments of the present disclosure is shown;

[0019] Figure 8 A schematic diagram of an interface for adjusting parameters according to some embodiments of the present disclosure is shown;

[0020] Figure 9A and Figure 9B Schematic diagrams illustrating examples of adjusting the microphone area according to some embodiments of the present disclosure are shown respectively;

[0021] Figure 10 A schematic flowchart illustrating the process of rendering a microphone layout according to some embodiments of the present disclosure is shown;

[0022] Figure 11 A schematic diagram illustrating an example of freely editable microphone layout according to some embodiments of the present disclosure is shown;

[0023] Figure 12 A schematic diagram illustrating an example of generating microphone layout based on an AI model according to some embodiments of the present disclosure is shown;

[0024] Figure 13 A schematic flowchart illustrating the process of generating microphone layout based on an AI model according to some embodiments of the present disclosure is shown.

[0025] Figure 14 A schematic diagram showing a preview of some microphone layouts according to some embodiments of the present disclosure is provided.

[0026] Figure 15 A schematic diagram showing the display position of a microphone element according to some embodiments of the present disclosure is shown;

[0027] Figure 16 A schematic diagram of a layout description protocol according to some embodiments of the present disclosure is shown;

[0028] Figure 17 Block diagrams of example apparatuses according to some embodiments of the present disclosure are shown; and

[0029] Figure 18 A block diagram of an example device that can be used to implement embodiments of the present disclosure is shown. Detailed Implementation

[0030] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0031] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0032] For example, upon receiving a user's proactive request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as the electronic device, application, server, or storage medium performing the operations of this disclosed technical solution, based on the prompt message.

[0033] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0034] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0035] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0036] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0037] With the rapid development of AI, content creation based on artificial intelligence technology is also developing faster and faster, especially in the field of live streaming. Artificial intelligence technology can provide a rich content creation platform for various types of live streaming and also provides a lot of convenience for the creation of live streaming content.

[0038] During live streaming sessions, the microphone layout is displayed on the screens of each participating user based on their avatar information. If the microphone layout is the same on different users' screens, it may fail to meet the streamer's expectations and result in a poor user experience.

[0039] To address at least the aforementioned and other potential problems, embodiments of this disclosure provide a method for determining microphone layout. In this method, in response to receiving a trigger operation for adjusting the microphone layout, a first layout of multiple microphone positions is displayed on a user interface, wherein the first layout includes multiple microphone position areas corresponding to the multiple microphone positions. Subsequently, in response to receiving an adjustment operation on the multiple microphone position areas of the first layout, a second layout of the multiple microphone positions is displayed on the user interface, wherein the second layout includes multiple adjusted microphone position areas corresponding to the multiple microphone positions. Further, in response to receiving a confirmation operation on the second layout, element information on each area of ​​the multiple adjusted microphone position areas is determined. This disclosure provides a flexible scheme for determining microphone layout, enabling dynamic adjustment of the microphone layout and improving the user experience.

[0040] In this way, users, such as broadcasters, can adjust the microphone layout according to their own needs, thus achieving dynamic adjustment of the microphone layout to meet the actual needs of the broadcaster. Different users participating in a live stream can then adjust their own microphone layout individually, achieving personalized display of the microphone layout, increasing flexibility, and thus improving the user experience.

[0041] It is understood that this disclosure is only described in conjunction with relevant embodiments and is not intended to limit the scope of protection of this disclosure. Any technical solutions in other disclosures that fall within the scope of protection of this disclosure should be protected.

[0042] Figure 1A schematic diagram of an example environment 100 to which some embodiments of this disclosure can be applied is shown. A computing device 120 is shown in environment 100. The computing device 120 may be a dedicated processing device with data processing capabilities, such as a Graphics Processing Unit (GPU). The computing device 120 may also have the ability to store data. The computing device 120 may also have the ability to receive and transmit data. The computing device 120 can process local data or online data. The computing device 120 may also include capabilities for image generation and image synthesis; for example, the computing device can run various suitable machine learning models.

[0043] Examples of computing device 120 include, but are not limited to, personal computers, server computers, handheld or laptop devices, mobile devices (such as mobile phones, personal digital assistants (PDAs), media players, etc.), multiprocessor systems, consumer electronics, minicomputers, mainframe computers, and distributed computing environments that include any of the above systems or devices.

[0044] The computing device 120 can be used in live streaming scenarios, such as being operated by a broadcaster (as shown by user 110 in the illustration) as a broadcaster-end device 120. For example, the broadcaster can live stream the desktop or application interface of the broadcaster-end device 120. As another example, the broadcaster can live stream images captured by an image acquisition device (such as a camera) of the broadcaster-end device 120.

[0045] For example, Figure 1 The diagram also shows a server 130, which could be a remote server or a data processing unit deployed in the cloud, used to provide services such as live content distribution, data storage, and interaction. For example, content captured by the broadcaster's device 120 can be presented on other client devices 150 via the server 130.

[0046] It is understood that the client device 150 and the broadcaster device 120 may have the same or different device types, and this disclosure does not limit this.

[0047] During a live broadcast using device 120, host 110 can connect with other users via microphone. When multiple users (or guests) connect with host 110, the microphone positions of multiple users and host 110 can be displayed on the host's terminal device 120 interface. A specific embodiment of the microphone position layout will be described in detail below with reference to the accompanying drawings.

[0048] Figure 2 A schematic diagram of the technical architecture 200 of an orchestration engine for determining microphone layout according to some embodiments of the present disclosure is shown. Figure 2The diagram shows a business layer client 210, a business layer server 220, a software development kit (SDK) layer server 230, and an SDK layer client 240.

[0049] The business layer involves the host side (such as co-host) and the guest side, such as multiple guests (multi-guest). Figure 3 A schematic diagram of the technical architecture 300 of an orchestration engine for determining microphone placement according to some embodiments of the present disclosure is shown. The business layer client 210 includes a business client broadcaster side 212 and a business client guest side 214. The business layer server 220 includes a business server broadcaster side 222 and a business server guest side 224.

[0050] In some implementations, the business layer client 210 may include a request layer and a response layer. The business layer server 220 may include a business form layer and a business logic layer, and optionally, a business data layer. The SDK layer server 230 may include a business access layer and a response layer. The SDK layer client 240 may include a business access layer, a basic capability layer, and a live chat data layer.

[0051] For example, the business layer client 210 mainly handles the capabilities that the business layer needs to use from the layout layer, such as switching layouts, zooming in / out, and starting the game rotation. The business layer client 210 can provide business attribute interfaces and hand them over to the business layer server 220 to perform tasks such as layout switching (or layout mapping) and microphone position management (such as microphone order adjustment), combine the data required by the layout layer SDK and pass it in, listen to the SDK layer callback and complete the layout drawing.

[0052] For example, the business layer server 220 processes business logic, coordinates layout rules and gameplay rules, receives semantic information from business input, such as switching to a certain layout or zooming in on a certain position, performs information conversion between layout information and gameplay business logic, and outputs the correct layout key to the SDK side (such as SDK layer server 230) for the next layout calculation.

[0053] The SDK layer server 230 can be bound to the live chat service. The SDK layer server 230 receives information from the business layer server 220, provides a data channel, and outputs correct information to the SDK layer client 240 based on the current live chat status for layout information calculation. Optionally, the SDK layer server 230 can also simultaneously listen for live chat actions such as going up and down, and notify the business layer client 210 to recalculate and redraw the layout.

[0054] Based on the input from the SDK layer server 230 and the static DSL map data, the SDK layer client 240 calculates the layout information required by the business, notifies the business layer client 210 to draw the layout positions, and provides a certain degree of dynamic modification capability.

[0055] Understandably, the above combination Figure 2 and Figure 3 The content described is only an example. The functions that the business layer client 210, business layer server 220, SDK layer server 230 and SDK layer client 240 can implement for the microphone layout are shown in the boxes in the figure, and will not be described in detail here.

[0056] Figure 4 A schematic diagram of a rendering architecture 400 for a client to determine microphone layout according to some embodiments of the present disclosure is shown. Figure 4 The diagram shows the business layer 401, SDK layer 402, and audio / video layer 403.

[0057] The business layer 401 can interact with the user 410, such as by acquiring user input. For example, user input, such as editing and / or selection operations, can be facilitated by providing layout options for User Generated Content (UGC) editors and / or Professional Generated Content (PGC) layouts 411 and 412. Optionally, user input information can be provided to the SDK layer 402 via the DSL protocol 481.

[0058] SDK layer 402 can perform layout calculations 420 based on user input information. For example, the specific content of the input information can be determined through DSL parsing 421, and the layout information can be determined through live chat interaction 422. This layout information 485 can be rendered by Real-Time Communication (RTC) view 440 to generate single-view 441 or multi-view 442 microphone layout information.

[0059] The business layer 401 can obtain the layout information 482 after the view is rendered from the SDK layer 402, and further output the microphone layout through the microphone view rendering 430.

[0060] As shown in the figure, the audio / video layer 403 can execute Time To Live on Hold (TTLH) and Real-Time Control (RTC) 450. For example, the audio / video layer 403 can merge various information streams 452 for presentation on the client. The merged information may include, for example, live video information, live audio information, Supplemental Enhancement Information (SEI) 451, effects information 453, and other merging parameters 483 based on the microphone layout, etc.

[0061] The following section, in conjunction with the accompanying diagrams, describes an example implementation where the microphone layout is jointly determined by the business layer 401 and the SDK layer 402.

[0062] Figure 5 A schematic flowchart of a method 500 for determining microphone layout according to an example embodiment of the present disclosure is shown. The method 500 can be... Figure 1 The execution method 500 can be performed by the computing device 120, or by a combination of the computing device 120 and the server 130, or by any suitable device or apparatus (such as a cloud server). This disclosure does not limit the scope of the execution method. For ease of description, the "processing system" will be used as an example to describe the execution method 500.

[0063] In box 510, in response to receiving a trigger operation for adjusting the microphone layout, the processing system displays a first layout of multiple microphone positions on the user interface, wherein the first layout includes multiple microphone position areas corresponding to the multiple microphone positions. In box 520, in response to receiving an adjustment operation on the multiple microphone position areas of the first layout, the processing system displays a second layout of multiple microphone positions on the user interface, wherein the second layout includes multiple adjusted microphone position areas corresponding to the multiple microphone positions. In box 530, in response to receiving a confirmation operation on the second layout, the processing system determines the element information on each area of ​​the multiple adjusted microphone position areas.

[0064] In some implementations, the triggering, adjusting, and confirming actions can be user input. For example, the broadcaster in the live stream can input data in various feasible ways, such as voice input, gesture input, and text input. Correspondingly, the received actions can originate from the broadcaster, and the user interface is the broadcaster's live stream interface.

[0065] During a live stream, the host can select multiple other users (such as guests) to initiate a live chat. For example, the host can select multiple other hosts or multiple viewers. For instance, if N guests agree to connect, an initial layout of multiple (e.g., N+1) microphone positions can be displayed on the host's user interface, as in the first layout described above.

[0066] In some implementations, the first layout is a first template layout in a pre-defined layout library, and the triggering operation includes a selection operation on the first template layout. For example, the number of microphone positions in the first template layout is predefined.

[0067] The system can pre-store or pre-load a pre-configured layout library, which includes multiple template layouts. Optionally, when the host decides to connect, or when a guest agrees to connect, or after a connection is established and the user clicks the "layout adjustment" control, the processing system can automatically display / pop up multiple template layouts for the user to choose from. For example, the processing system can determine from the layout library multiple template layouts that correspond to N+1 microphone positions. Subsequently, the user can select a first template layout from the multiple template layouts, and the processing system can display this first template layout as the first layout on the host's interface based on the user's selection.

[0068] In the embodiments of this disclosure, a layout template can be a JSON object. A layout library can include multiple sub-libraries, each corresponding to a different number of microphone positions. Each sub-library can include multiple layout templates for the same number of microphone positions, and the number of templates in different sub-libraries can be equal or unequal. For example, the first layout sub-library corresponds to 2 microphone positions and includes templates A1, A2, A3, etc. Similarly, the second layout sub-library corresponds to 3 microphone positions and includes templates B1, B2, B3, B4, etc. It is understood that the layout library is not fixed but can be dynamically updated, for example, through hot-update deployment configured by Dolphin. Specific examples of layout libraries are not detailed in this disclosure.

[0069] In this way, by providing a layout library, users can be given initial layout references. On the one hand, this provides examples to ensure high-quality content created by users in the live streaming room, and on the other hand, it lowers the barrier to entry for users to create content. Furthermore, the layout library can provide playbooks with more extensible layout atoms, integrating a wider variety of layout gameplay and enhancing the gameplay diversity of playbooks.

[0070] Furthermore, users can adjust the layout based on the first layout through operation to obtain a second layout that satisfies the user. For example, the processing system can provide, as shown below: Figure 4 The layout shown is a UGC editor, allowing users to adjust the microphone layout.

[0071] Figure 6A schematic diagram of an example 600 of a microphone layout according to some embodiments of the present disclosure is shown. The area 690 used to display the microphone layout may be referred to as a container (also called a virtual container), and the virtual container may include multiple grids (also called virtual grids) corresponding one-to-one with multiple microphone positions. The virtual container is a container without outer margins, and the virtual container is filled with multiple closely arranged virtual grids. The multiple grids can be implemented as closely arranged grids, that is, two adjacent virtual grids may have a common edge and no relative spacing. As shown, each grid is a rectangle. Each virtual grid includes a microphone position area corresponding to a microphone position, referred to as the actual grid of the microphone position. As shown, there is a spacing between the edges of the actual grids and the edges of the virtual grids, such as spacing / 2. For ease of description, in embodiments of the present disclosure, the terms microphone position, microphone position area, and actual grid of the microphone position may be used interchangeably.

[0072] For example, the adjustment operation mentioned at 520 may include resizing one or more parameters, wherein the one or more parameters include at least one of the following: container margins, container aspect ratio, container arrangement pattern, microphone size, microphone position, microphone spacing, microphone corner radius, etc. Container margins may include top-inset, left-inset, bottom-inset, and right-inset. Optionally, each margin may be preset with a specific range, including a minimum value (quantized to 0) and a maximum value (quantized to 1), and the user can only adjust within this range. The container aspect ratio can be used to determine the size used to display the microphone layout on the user interface, such as... Figure 7 The aspect ratio shown is the ratio between the width W and height H of the virtual container. Optionally, this aspect ratio can be preset to a specific range, including a minimum value (quantized to 0) and a maximum value (quantized to 1), and the user can only adjust it within this range. The container's arrangement mode can represent the layout of the individual grids, such as fixed grid (central_operat), fixed side (central_operat_right_center), full screen (full_screen), floating side (full_screen_right_center), and / or others.

[0073] The size of the microphone area can represent the proportion of the microphone area or the grid of the microphone area to the container. For example, users can adjust the size of the microphone area by dragging the edges of the microphone area or the grid. Optionally, the width (or proportion of the width of the container) and height (or proportion of the height of the container) of the microphone area / grid can be preset to a specific range, including a minimum value (quantized to 0) and a maximum value (quantized to 1), and users can only adjust it within this range.

[0074] The spacing between microphone positions refers to the interval between two microphone positions, denoted as spacing, such as in... Figure 6 In this setup, the spacing between the microphone area and the grid edges is spacing / 2. The corner radius of the microphone area determines its shape within the grid; for example, without a corner radius, the microphone area is rectangular or square. Similarly, the spacing and corner radius of the microphone areas can be preset to specific ranges, and users can only adjust them within these ranges.

[0075] Figure 8 A schematic diagram of an interface 800 for adjusting parameters according to some embodiments of the present disclosure is shown. As illustrated, area 820 shows the adjustment methods for each parameter, and the user can change the layout by pushing the progress bar corresponding to the parameter. Furthermore, the adjustment range for each parameter is preset; for example, the leftmost side of the progress bar represents the minimum value, and the rightmost side represents the maximum value.

[0076] The layout UGC editor can maintain a transformation relationship between a "virtual coordinate system" and a "real coordinate system". For example, the virtual coordinate system can represent the coordinates of each microphone area or virtual grid relative to a virtual container (such as a reference). Figure 6 For example, a real coordinate system can represent the coordinates of each microphone area on the user interface (e.g., ...). Figure 7 (As shown). In this way, the processing system can calculate the virtual coordinates after dragging the cursor and / or adjusting the parameters based on the adjustment operation used, and then obtain the real coordinates of the container and grid through coordinate transformation.

[0077] As an example, the adjustment operation may include a first microphone region size adjustment operation among multiple microphone regions of the first layout. Accordingly, at 520, in response to receiving the size adjustment operation of the first microphone region of the first layout, a second layout may be obtained by adjusting the size of at least one microphone region that shares a common edge with the first microphone region.

[0078] Optionally, adjusting the first microphone area can be a user dragging operation on the edge of the first microphone area or on the edge of the virtual grid outside the first microphone area. For example, combining... Figure 6Users can drag any side of virtual grid 4 to adjust its size, and the sizes of other grids will be adjusted accordingly. Furthermore, the container size remains unchanged during the adjustment process by dragging the edges.

[0079] For example, suppose a user drags the first edge of the first microphone area, and this first edge is the common edge of the first and second microphone areas. When the size of the first microphone area is adjusted, the size of the second microphone area will also be adjusted simultaneously. For instance, a user can click on the first microphone area they want to adjust, and the edge of the first microphone area or its grid will be highlighted. Then, the user can long-press the first edge and drag it; the first edge will be highlighted and moved to a new position as the user drags it.

[0080] Figure 9A and Figure 9B Schematic diagrams of examples 900A and 900B, respectively, of adjusting the microphone area according to some embodiments of the present disclosure, are shown.

[0081] like Figure 9A As shown, microphone areas 1 and 6 are adjacent and share a single edge. When the user drags edge 901 (as indicated by the arrow) to increase the width of microphone area 1, the width of microphone area 6 is also increased synchronously. Furthermore, the widths of microphone areas 2, 4, and 7 are correspondingly decreased. In other words, when dragging edge 901, microphone areas 1 and 6 are associated microphone areas, and microphone areas 2, 4, and 7 are associated microphone areas. Dragging the common edge can cause the size adjustment of all associated microphone areas; that is, the size of all microphone areas adjacent through the common edge is adjusted synchronously. At the same time, it should be ensured that the size of each microphone area meets a preset specific range after the adjustment operation. Therefore, dragging edge 901 is limited to this minimum value 902. That is, when the width of microphone areas 2, 4, and 7 is the minimum value 902, it is impossible to continue increasing the width of microphone area 1 by dragging edge 901.

[0082] like Figure 9B As shown, edge 903 of microphone area 1 is independent, and there are no associated areas involving edge 903. That is, when the user drags edge 903 to increase the width of microphone area 1, there is no other microphone area whose width needs to be increased simultaneously. Therefore, the user can increase the width of only microphone area 1 by dragging edge 903, and the width of microphone area 2 will be reduced until it reaches the minimum value 902 specified by a preset specific range.

[0083] In this way, users can make adjustments to the initial layout. Furthermore, the processing system can perform layout rendering based on these adjustments, for example, to obtain a second layout. This allows for dynamic adjustment and updating of the layout. For instance, the layout UGC editor can not only provide template layouts to users but also generate new layouts based on their adjustments. For example, the layout UGC editor can re-render the currently applied UGC layout to the editor's canvas and reapply it to the live stream after the user adjusts the parameters, thus achieving dynamic layout updates.

[0084] Figure 10 A schematic flowchart of a process 1000 for rendering a microphone layout according to some embodiments of the present disclosure is shown. Exemplarily, process 1000 can be executed by a layout UGC editor.

[0085] At position 1001, retrieve the current layout. By parsing the layout key of the current layout, determine at position 1002 whether the current layout is a UGC layout.

[0086] If it is determined at 1002 that it is not a UGC layout, it can be determined at 1003 that it is a normal layout. Subsequently, the JSON string (DSL jsonString) of the normal layout can be obtained at 1004, and the DSL jsonString can be converted into the editor's internal layout model at 1005. In the embodiments of this disclosure, a normal layout refers to a pre-loaded layout stored locally, and the DSL jsonString can be obtained locally at 1004 accordingly.

[0087] If a UGC layout is identified at step 1002, the layout key (ugcLayoutKey) of that UGC layout can be checked in the cache at step 1011. For example, the cache may contain multiple layout models. If the layout key is found at step 1011, it is converted to a layout model at step 1012. Otherwise, if the layout key is not found at step 1011, the configuration is read from the API ( / get_ugc_config / ) at step 1013, and the JSONString of the UGC layout is obtained at step 1014. This allows it to be converted to (or generated) a layout model at step 1012.

[0088] Then, common parameters can be pre-laid at point 1021, standardized at point 1022, and rendered using the editor at point 1023. For example, common parameters could include... Figure 8 The parameters shown. For example, a standardized layout can be a layout with uniform spacing and close arrangement that can be processed by the layout UGC editor itself.

[0089] As an example, the layout rendered at position 1023 can be as follows: Figure 8 As shown, optionally, after step 1023, user adjustment operations can be received to dynamically update the layout. The specific implementation of the adjustment operation has been described above and will not be repeated here.

[0090] In some implementations, the first layout is a user-defined layout. For example, the triggering action at 510 may include user-inputted editing information.

[0091] A free-mode editor can be set up, allowing users to flexibly edit the microphone layout. This provides users with a more flexible editing mode, enabling them to create layout styles as they wish without having to tightly arrange the various microphone areas in the layout. This allows for richer and more diverse layouts, improving the user experience.

[0092] For example, the free mode editor can provide the following capabilities to facilitate users' free editing: adding or removing microphone jacks, adjusting the size and position of microphone jacks, adjusting the hierarchy of microphone jacks, and outputting layout description protocols, etc.

[0093] For example, a user can perform multiple rounds of editing operations to determine the final layout to be rendered. As an example, the initial editing operation can be a triggering operation to generate a first layout. As an example, further editing operations based on the first layout can be adjustment operations, and the final determined layout can be a second layout. Optionally, adjustment operations can include custom editing operations on one or more of the following: editing operations on the size and / or position of a first microphone area among multiple microphone areas, operations on increasing or decreasing the number of multiple microphone areas, and operations on adjusting the hierarchy of multiple microphone areas.

[0094] Figure 11 A schematic diagram of Example 1100 for freely editing microphone layout according to some embodiments of the present disclosure is shown. Exemplarily, a user can input the number of microphone slots as 5, and then 5 microphone slot areas 1 to 5 can be displayed on the interface, wherein microphone slot area 1 is at a lower level than microphone slot area 2, and microphone slot area 2 is at a lower level than microphone slot area 3. Optionally, the initial size of each microphone slot area can be random, and the user can adjust the microphone layout by freely adjusting the size and position of each area (e.g., by long-pressing and dragging).

[0095] In some implementations, the triggering action may include a natural language instruction input by the user, and correspondingly, the first layout may be generated using an AI model based on the natural language instruction.

[0096] For example, in the interface for adjusting or creating microphone layouts, a control with the name "Create Layout Using AI" or a similar name can be displayed. Users can click on this control and enter natural language commands in the corresponding interface. In embodiments of this disclosure, the AI ​​model can be a large model, referred to as a Large Language Model (LLM), a generative large language model, a large language model based on a transformer architecture, etc., and this disclosure is not limited thereto.

[0097] Figure 12 A schematic diagram of example 1200 of generating microphone layout based on an AI model according to some embodiments of the present disclosure is shown. As illustrated, at 1210, a user can input a natural language command, such as "debate competition, 6 guests and 1 host, arranged left and right." At 1220, the AI ​​model can generate a microphone layout based on this natural language command, such as a first layout. Furthermore, the user can also generate a second layout based on the first layout by adjusting the operation; or the user can directly use the first layout as the second layout by confirming the operation.

[0098] Figure 13 A schematic flowchart of a process 1300 for generating microphone layout based on an AI model according to some embodiments of the present disclosure is shown.

[0099] At step 1301, input information is obtained, including the layout instructions entered by the user, the loaded prompt information, and the current member data on the microphone. Business data validation can then be performed at step 1302. If the validation is successful, proceed to step 1303; otherwise, exit the process at step 1300.

[0100] At 1303, the input information is fed into the large model to obtain the output at 1304. For example, the output could be a first layout, such as a simple JSON file including layout configuration. At 1305, a structure check is performed on the output. If the structure check finds that the structure requirements are not met, the user can retry, for example, in 1306. The system can obtain a prompt message and return to 1303. Optionally, the prompt message at 1306 can be used to emphasize formatting so that the output is regenerated. If it is decided not to retry, the process can exit at 1300.

[0101] If the structure check passes at step 1305, the JSON is converted into a layout definition structure at step 1307, and the complete layout style configuration is built at step 1308. In this way, a layout corresponding to the input information can be generated based on the AI ​​model.

[0102] As an example, the layout generated by the AI ​​model can be as follows: Figure 12As shown in layout 1220. It is understood that users can further adjust layout 1220 (such as the first layout) to obtain a second layout. Optionally, adjustments may include changing the position of a microphone area, changing the size of a microphone area, or swapping the order of two microphone areas.

[0103] In some implementations disclosed herein, the layout model of the microphone placement can be saved as a template layout in a layout library. In some examples, users can view preview images of the template layout through a layout store or strategy manual. This allows users to easily perceive the display effect of the layout in advance, making it easier to select from template layouts and thus enabling expansion to a wider range of business scenarios.

[0104] Figure 14 A schematic preview 1400 of some microphone layouts according to some embodiments of the present disclosure is shown. (See diagram 1400.) Figure 14 Preview images of template layouts 1410 to 1480 are shown. It is understood that different template layouts may have the same or different numbers of microphone bay areas, and this disclosure is not limited in this regard.

[0105] The preview images disclosed herein do not require the use of ImageX uploads, thus avoiding the cumbersome process caused by long upload times (6-8 seconds). Instead, in the embodiments of this disclosure, the client can render and display the preview images in real time based on JSON, which offers greater flexibility, faster response, excellent performance in actual testing, and eliminates frame drops, thereby improving the user experience.

[0106] Continue to refer to Figure 5 At point 530, the element information in each microphone area can be further determined. In some examples, in response to receiving a confirmation operation for the second layout, the content, display position, and display size of the element information in each area of ​​the multiple adjusted microphone areas are determined. Optionally, the display size of the element information depends on the proportion of the height of each area to the display window. Exemplarily, the content of the element information includes one or more of the following: the username of the corresponding microphone host, the number of online viewers, the order number of entering the chat, an indication of whether to speak, information on whether to participate in the battle, the ranking of participating in the battle, the time of participating in the battle, etc.

[0107] For example, for a specific microphone area, the element information to be displayed in that area can be determined based on its size (e.g., relative to the size of a container, or its proportion of the entire screen). Optionally, the element information includes one or more UI elements. The position of each UI element can also be further determined. For example, the element information may include the username and points corresponding to that microphone area.

[0108] Figure 15 A schematic diagram of the display position 1500 of the microphone element according to some embodiments of the present disclosure is shown. Figure 15 The box shown can be the microphone area. Determining the position of a UI element can include: determining that the UI element is in any of the following: top_external, top_internal, left_external, left_internal, right_external, right_internal, bottom_internal, or bottom_external; then, the alignment of the UI element with the edge of the microphone area can be determined: left alignment, right alignment, center alignment, etc.

[0109] Furthermore, the size of each UI element can be determined, such as the font size or the ratio of its size to the microphone area.

[0110] In some embodiments, the present disclosure can predefine multiple size levels for the display of UI elements (or element information), and can determine the corresponding size level based on the size of the microphone area, thereby knowing the size of the element information to be displayed.

[0111] For example, the size of the microphone area relative to the screen size can be divided into multiple levels, with different levels corresponding to different element information sizes. For instance, three levels could be set.

[0112] Level 1 corresponds to fullscreen, meaning the microphone area window is displayed in full width and height. Level 1 can correspond to the first number of UI elements, and the display size of these UI elements can be the first size. In this case, the remaining microphone areas can be displayed as floating windows.

[0113] Level 2 (e.g., panel_large) corresponds to a predetermined size range. For example, the predetermined size range is: the width of the microphone area window occupies more than or equal to 2 / 3 of the screen width and the height occupies more than or equal to 2 / 3 of the screen height. Level 2 can correspond to a second number of UI elements, and the display size of the UI elements is the second size, where the second number is less than or equal to the first number, and the second size is less than or equal to the first size. In this case, the remaining microphone area can be displayed in a floating window format.

[0114] Level 3 (e.g., grid_normal) corresponds to a size range other than levels 1 and 2. For example, the width or height of the microphone area window is less than 2 / 3 of the screen width or height. Level 3 can correspond to a third number of UI elements, and the display size of the UI elements is the third size, where the third number is less than the second number, and the third size is less than the second size. In this case, the remaining microphone areas can be displayed as floating windows.

[0115] Optionally, the remaining microphone area displayed in a floating window can be understood as grid 4 (e.g., grid_small). Optionally, the microphone area in grid 4 may only display the streaming audio and video, or may further display the user's avatar and / or score, etc. This disclosure is not limited in this respect.

[0116] It should be understood that the above description of element information is merely exemplary. For example, more or fewer levels can be set, such as 2 / 3 can be replaced with other values, such as UI elements can include more or less content, etc. This disclosure will not list them all.

[0117] In this way, the UGC layout in the embodiments of this disclosure is highly customizable, and it is impossible to customize the UI element style and corresponding position of each microphone position for each basic layout issued by Dolphin through the "Layout" business field; the embodiments of this disclosure can achieve microphone position element adaptation by setting multiple levels to correspond to the position and size of each UI element, thus avoiding mismatched styles.

[0118] Figure 16 A schematic diagram of a layout description protocol 1600 according to some embodiments of the present disclosure is shown. At 1610, the business layer client 210 reads the current layout model from the SDK layer client 240. At 1620, after customizing the layout model, the business layer client 210 uploads it to the business layer server 220 via a business interface. At 1630, the business layer server 220 uploads the layout model to the SDK layer server 230, and the SDK layer server 230 issues a layout key to the SDK layer client 240. At 1640, the SDK layer client 240 calls the interface of the SDK layer server 230 to obtain the layout model and executes the rendering pipeline process.

[0119] For a detailed implementation of the layout description protocol 1600, please refer to the foregoing. Figures 2 to 15 The descriptions of some parts will not be repeated here.

[0120] Furthermore, the processing system can also retrieve streaming media corresponding to each microphone position area and play the corresponding streaming media in real time in the corresponding microphone position area.

[0121] By referring to the embodiments of this disclosure described in conjunction with the accompanying drawings, this document provides a flexible scheme for determining the microphone layout. Users, such as broadcasters, can adjust the microphone layout based on their own needs, thereby achieving dynamic adjustment of the microphone layout and ensuring that the display method meets the actual needs of the broadcaster. In this way, different users participating in a live broadcast can adjust their respective microphone layouts, achieving personalized display of the microphone layout, improving flexibility, and thus enhancing the user experience.

[0122] It should be understood that in the embodiments of this disclosure, "first," "second," "third," etc., are only used to indicate that multiple objects may be different, but at the same time, it does not exclude that two objects are the same, and should not be interpreted as any limitation on the embodiments of this disclosure.

[0123] It should also be understood that the manner, situation, category, and division of embodiments in the present disclosure are for the convenience of description only and should not constitute a special limitation. Various manners, categories, situations, and features in the embodiments can be combined with each other where logically consistent.

[0124] It should also be understood that the foregoing is merely to help those skilled in the art better understand the embodiments of this disclosure, and is not intended to limit the scope of the embodiments of this disclosure. Those skilled in the art can make various modifications, variations, or combinations based on the foregoing. Such modifications, variations, or combinations are also within the scope of the embodiments of this disclosure.

[0125] It should also be understood that the above description focuses on highlighting the differences between the various embodiments. Similarities or commonalities can be referenced or learned from each other, and for the sake of brevity, they will not be repeated here.

[0126] Figure 17 A schematic block diagram of an example device 1700 according to some embodiments of the present disclosure is shown. Device 1700 may be implemented by software, hardware, or a combination of both. Figure 1 The device 1700 can be implemented as a computing device 120 or a processor within the computing device 120, etc. Figure 17 As shown, the device 1700 includes a first layout display module 1710, a second layout display module 1710, and a microphone position element determination module 1730.

[0127] The first layout display module 1710 is configured to: in response to receiving a trigger operation for adjusting the microphone layout, display a first layout of multiple microphone positions on the user interface, wherein the first layout includes multiple microphone position areas corresponding to the multiple microphone positions. The second layout display module 1720 is configured to: in response to receiving an adjustment operation on the multiple microphone position areas of the first layout, display a second layout of multiple microphone positions on the user interface, wherein the second layout includes multiple adjusted microphone position areas corresponding to the multiple microphone positions. The microphone position element determination module 1730 is configured to: in response to receiving a confirmation operation on the second layout, determine element information on each area among the multiple adjusted microphone position areas.

[0128] In some implementations, the first layout is a first template layout in a pre-set layout library, and the triggering operation includes a selection operation on the first template layout.

[0129] For example, the number of microphone positions in the first template layout is predefined.

[0130] For example, the second layout display module 1720 is configured to: in response to receiving a size adjustment operation on the first microphone area of ​​the first layout, obtain the second layout by adjusting the size of at least one microphone area that shares a common edge with the first microphone area.

[0131] In some implementations, the first layout is a user-defined layout, and the triggering action includes user-inputted editing information.

[0132] In some implementations, the triggering action includes a natural language instruction input by the user, and the first layout is generated using an AI model based on the natural language instruction.

[0133] For example, the adjustment operation includes a custom editing operation on one or more of the following: editing operation on the size and / or position of a first microphone area in multiple microphone areas, adding or subtracting the number of multiple microphone areas, and adjusting the hierarchy of multiple microphone areas.

[0134] In some implementations, the microphone element determination module 1730 is configured to: in response to receiving a confirmation operation on the second layout, determine the content, display position, and display size of element information in each of the multiple adjusted microphone areas.

[0135] For example, the display size of element information depends on the proportion of the height of each area to the display window.

[0136] For example, the content of the element information includes one or more of the following: the username of the host in the corresponding microphone position, the number of online viewers, the order number of entering the microphone connection, the instruction on whether to speak, the information on whether to participate in the battle, the ranking of participating in the battle, and the time of participating in the battle.

[0137] In some implementations, the device 1700 also includes a preview module configured to display a preview of the microphone layout for the live streamer to apply.

[0138] Figure 17 The device 1700 can be used to achieve the above-mentioned combination. Figures 1 to 16 For the sake of brevity, the process described will not be repeated here.

[0139] The division of modules or units in the embodiments of this disclosure is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods. Furthermore, the functional units in the disclosed embodiments may be integrated into one unit, exist as separate physical entities, or two or more units may be integrated into one unit. The integrated unit described above can be implemented in hardware or as a software functional unit.

[0140] Figure 18 A block diagram of an example device 1800 that can be used to implement embodiments of the present disclosure is shown. It should be understood that... Figure 18 The device 1800 shown is merely exemplary and should not be construed as limiting the functionality and scope of the implementation described herein. For example, device 1800 can be used to perform the functions described above. Figures 1 to 16 The process described.

[0141] like Figure 18 As shown, device 1800 is in the form of a general-purpose computing device. Components of computing device 1800 may include, but are not limited to, one or more processors or processing units 1810, memory 1820, storage device 1830, one or more communication units 1840, one or more input devices 1850, and one or more output devices 1860. Processing unit 1810 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 1820. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capability of computing device 1800.

[0142] Computing device 1800 typically includes multiple computer storage media. Such media can be any available media accessible to computing device 1800, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 1820 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 1830 can be removable or non-removable media and may include machine-readable media, such as flash drives, disks, or any other media capable of storing information and / or data and accessible within computing device 1800.

[0143] The computing device 1800 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 18 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 1820 may include computer program product 1825 having one or more program modules configured to perform various methods or actions of various implementations of this disclosure.

[0144] The communication unit 1840 enables communication with other computing devices via a communication medium. Additionally, the components of the computing device 1800 can function as a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the computing device 1800 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0145] Input device 1850 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 1860 can be one or more output devices, such as a monitor, speaker, printer, etc. Computing device 1800 can also communicate as needed with one or more external devices (not shown) via communication unit 1840. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with computing device 1800, or with any device that enables computing device 1800 to communicate with one or more other computing devices (e.g., network card, modem, etc.). Such communication can be performed via an input / output (I / O) interface (not shown).

[0146] According to an exemplary implementation of this disclosure, a non-transitory computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is provided, on which a computer program is stored, which, when executed by a processor, implements the methods described above.

[0147] According to an exemplary implementation of this disclosure, a chip or chip system is provided, on which computer-executable instructions are carried, which, when executed by a device or apparatus or processor, enable the implementation of the methods described above.

[0148] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0149] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0150] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0151] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0152] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for determining microphone placement, comprising: In response to receiving a trigger operation for adjusting the microphone layout, a first layout of multiple microphone positions is displayed on the user interface, wherein the first layout includes multiple microphone position areas corresponding to the multiple microphone positions; In response to receiving an adjustment operation on the plurality of microphone positions in the first layout, a second layout of the plurality of microphone positions is displayed on the user interface, wherein the second layout includes a plurality of adjusted microphone positions corresponding to the plurality of microphone positions. as well as In response to receiving a confirmation operation for the second layout, element information on each region of the plurality of adjusted microphone areas is determined.

2. The method according to claim 1, wherein the first layout is a first template layout in a pre-set layout library, and wherein the triggering operation includes a selection operation on the first template layout.

3. The method according to claim 2, wherein the number of microphone positions in the first template layout is predefined.

4. The method of claim 2, wherein displaying a second layout of the plurality of microphone positions on the user interface in response to receiving an adjustment operation on the plurality of microphone positions of the first layout comprises: In response to receiving a size adjustment operation for the first microphone area of ​​the first layout, the second layout is obtained by adjusting the size of at least one microphone area that shares a common edge with the first microphone area.

5. The method of claim 1, wherein the first layout is a user-defined layout, and wherein the triggering operation includes the user-inputted editing information.

6. The method of claim 1, wherein the triggering operation includes a natural language instruction input by a user, and the first layout is generated using an artificial intelligence (AI) model based on the natural language instruction.

7. The method according to claim 5 or 6, wherein the adjustment operation includes a custom editing operation on one or more of the following: Editing operations on the size and / or position of the first microphone position region among the multiple microphone position regions. The operation of increasing or decreasing the number of the multiple microphone positions. Adjustment operations on the hierarchy of the multiple microphone positions.

8. The method of claim 1, wherein determining element information on each region of the plurality of adjusted microphone areas in response to receiving a confirmation operation on the second layout comprises: In response to receiving a confirmation operation for the second layout, the content, display position, and display size of the element information in each of the plurality of adjusted microphone areas are determined.

9. The method according to claim 8, wherein the display size of the element information depends on the proportion of the height of each area to the display window.

10. The method according to claim 8, wherein the content of the element information includes one or more of the following: the username of the corresponding microphone host, the number of online viewers, the sequence number of entering the live chat, the instruction on whether to speak, the information on whether to participate in the battle, the ranking of participating in the battle, and the time of participating in the battle.

11. The method according to claim 1, further comprising: This displays a preview of the microphone layout, allowing live streamers to apply it.

12. An electronic device, comprising: At least one processing unit; At least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 11 when executed by the at least one processing unit.

13. An apparatus for determining microphone placement, comprising: The first layout display module is configured to display a first layout of multiple microphone positions on a user interface in response to receiving a trigger operation for adjusting the microphone position layout, wherein the first layout includes multiple microphone position areas corresponding to the multiple microphone positions. A second layout display module is configured to, in response to receiving an adjustment operation on the plurality of microphone positions of the first layout, display a second layout of the plurality of microphone positions on the user interface, wherein the second layout includes a plurality of adjusted microphone positions corresponding to the plurality of microphone positions; and The microphone position element determination module is configured to determine element information in each of the plurality of adjusted microphone position areas in response to receiving a confirmation operation for the second layout.

14. A computer-readable storage medium having a computer program stored thereon, the program being executed by a processor to implement the method according to any one of claims 1 to 11.

Images