Method and apparatus for adjusting display interface, and device, medium and program product

Abstract

The embodiments of the present disclosure relate to a method and apparatus for adjusting a display interface, and a device, a medium and a program product. The method comprises: displaying, on a user interface of a first client, target content and a plurality of pieces of media content corresponding to a plurality of users, wherein the plurality of pieces of media content are displayed in a plurality of display units of the user interface. The method further comprises: in response to receiving an operation for adjusting the plurality of display units, collapsing the plurality of display units to a target display area in the user interface. The method further comprises: displaying, in the target display area of the user interface, media content in a target display unit of the plurality of display units.

Description

Methods, apparatus, devices, media, and procedures for adjusting display interfaces.

[0001] Cross-references to related applications

[0002] This application claims priority to Chinese Patent Application No. 202411648659.8, filed on November 18, 2024, entitled "Method, Apparatus, Device, Medium and Program Product for Adjusting Display Interface", the entire contents of which are incorporated herein by reference. Technical Field

[0003] The embodiments disclosed herein generally relate to the field of live streaming, and specifically to methods, apparatus, devices, media, and program products for adjusting display interfaces. Background Technology

[0004] Currently, in the live streaming context, an increasing amount of content is being discovered and presented to a wide audience, including content promoting knowledge, entertaining the public, and showcasing competitive events. Furthermore, during a live stream, the content being streamed is often displayed alongside footage captured by the streamer's device. For example, the streamer might be playing a game and simultaneously displaying footage of themselves on their device, allowing viewers to see both the game and the streamer at the same time.

[0005] With the rise of the live streaming industry, more and more people are paying attention to this field and joining the industry, resulting in an explosive growth in the number of live streamers. As the number of streamers increases dramatically, interactive features for multiple streamers have emerged. Unlike traditional single-streaming, multiple streamers can now be matched and interact with each other to a certain extent, greatly enhancing the viewing experience and bringing new challenges to multi-person live streaming. Summary of the Invention

[0006] Embodiments of this disclosure provide a method, apparatus, device, medium, and program product for adjusting a display interface.

[0007] According to a first aspect of this disclosure, a method for adjusting a display interface is provided. The method includes displaying target content and multiple media contents corresponding to multiple users on a user interface of a first client, the multiple media contents being displayed in multiple display units of the user interface. The method further includes, in response to receiving an operation for adjusting the multiple display units, collapsing the multiple display units into a target display area in the user interface. The method also includes displaying the media contents in the target display unit of the multiple display units in the target display area of ​​the user interface.

[0008] According to a second aspect of this disclosure, a method for adjusting a display interface is provided. The method includes displaying target content and multiple media contents corresponding to multiple users on a user interface of a second client, the multiple media contents being displayed in multiple display units of the user interface. The method further includes collapsing the multiple display units into a target display area in the user interface in response to receiving an instruction to adjust the layout of the user interface. The method also includes displaying the media content in the target display unit of the multiple display units in the target display area of ​​the user interface.

[0009] In a third aspect of this disclosure, an apparatus for adjusting a display interface is provided. The apparatus includes a first content display module configured to display target content and multiple media contents corresponding to multiple users on a user interface of a first client, the multiple media contents being displayed in multiple display units of the user interface; a first display unit folding module configured to fold the multiple display units into a target display area in the user interface in response to receiving an operation for adjusting the multiple display units; and a first media content display module configured to display the media contents in the target display unit of the multiple display units in the target display area of ​​the user interface.

[0010] In a fourth aspect of this disclosure, an apparatus for adjusting a display interface is provided. The apparatus includes a second content display module configured to display target content and multiple media contents corresponding to multiple users on a user interface of a second client, the multiple media contents being displayed in multiple display units of the user interface; a second display unit folding module configured to fold the multiple display units into a target display area in the user interface in response to receiving an instruction to adjust the layout of the user interface; and a second media content display module configured to display the media contents in the target display unit of the multiple display units in the target display area of ​​the user interface.

[0011] In a fifth aspect of this disclosure, an electronic device is provided, including at least one processor; and a storage device for storing at least one program, which, when executed by the at least one processor, causes the at least one processor to implement the methods according to the first and second aspects of this disclosure.

[0012] In a sixth aspect of this disclosure, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements the methods according to the first and second aspects of this disclosure.

[0013] In a seventh aspect of this disclosure, a computer program product is provided. This computer program product includes a computer program that, when executed by a processor, implements the methods according to the first and second aspects of this disclosure.

[0014] It should be understood that the content described in this section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0015] The above and other objects, features and advantages of this disclosure will become more apparent from the accompanying drawings, in which like reference numerals generally denote like parts.

[0016] Figure 1 illustrates a schematic diagram of an example environment in which some embodiments of the present disclosure may be implemented;

[0017] Figure 2 illustrates a schematic diagram of an example method 200 for adjusting a display interface according to some embodiments of the present disclosure;

[0018] Figure 3 illustrates a schematic diagram of an example method 300 for adjusting a display interface according to some embodiments of the present disclosure;

[0019] Figure 4 illustrates a schematic diagram of an example of a live broadcast view from the anchor's perspective, with the layout in a folded state according to some embodiments of the present disclosure.

[0020] Figure 5 illustrates a schematic diagram of an example of a live broadcast view from the anchor's perspective, with the layout in an unfolded state according to some embodiments of the present disclosure.

[0021] Figure 6 illustrates a schematic diagram of an example of a live broadcast view from the viewer's perspective, with the layout in an unfolded state according to some embodiments of the present disclosure.

[0022] Figure 7 illustrates a schematic diagram of an example of a live broadcast view from the viewer's perspective, with the layout in a folded state according to some embodiments of the present disclosure.

[0023] Figure 8 illustrates a schematic diagram of an example of adjusting the overall design of a display interface according to some embodiments of the present disclosure;

[0024] Figure 9 illustrates a schematic diagram of an example of an interactive flow for adjusting a display interface according to some embodiments of the present disclosure;

[0025] Figure 10 illustrates a schematic diagram of an example of a core design for adjusting a display interface according to some embodiments of the present disclosure;

[0026] Figure 11 illustrates a schematic diagram of an example of multi-terminal synchronization for adjusting the layout state of a display interface according to some embodiments of the present disclosure;

[0027] Figure 12 illustrates a schematic diagram of an example of adjusting the microphone position of a display interface according to some embodiments of the present disclosure;

[0028] Figure 13 illustrates a schematic diagram of an example of adjusting the microphone position of a display interface according to some embodiments of the present disclosure;

[0029] Figure 14 illustrates a schematic diagram of an example of merging for adjusting the microphone position of a display interface according to some embodiments of the present disclosure;

[0030] Figure 15 illustrates a schematic diagram of a live broadcast view from the anchor's perspective in an unfolded state according to some embodiments of the present disclosure.

[0031] Figure 16 illustrates a schematic diagram of a live broadcast view from the guest's perspective in an unfolded state according to some embodiments of the present disclosure.

[0032] Figure 17 illustrates a schematic diagram of a live broadcast view from the viewer's perspective, with the layout in an unfolded state according to some embodiments of the present disclosure.

[0033] Figure 18 illustrates a schematic diagram of an example of a live broadcast view from the anchor's perspective, with the layout in a folded state according to some embodiments of the present disclosure.

[0034] Figure 19 illustrates a schematic diagram of an example of a live broadcast view from the guest's perspective in a folded state according to some embodiments of the present disclosure.

[0035] Figure 20 illustrates a schematic diagram of an example of a live broadcast view from the viewer's perspective, with the layout in a folded state according to some embodiments of the present disclosure.

[0036] Figure 21 illustrates a schematic block diagram of a device 2100 for adjusting a display interface according to some embodiments of the present disclosure.

[0037] Figure 22 illustrates a schematic block diagram of a device 2200 for adjusting a display interface according to some embodiments of the present disclosure;

[0038] Figure 23 illustrates a schematic block diagram of an example device suitable for implementing various embodiments of the present disclosure.

[0039] In the various figures, the same or corresponding reference numerals indicate the same or corresponding parts. Detailed Implementation

[0040] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0041] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0042] For example, upon receiving a user's proactive request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as the electronic device, application, server, or storage medium performing the operations of this disclosed technical solution, based on the prompt message.

[0043] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0044] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0045] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0046] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0047] There are still many issues to be addressed during the adjustment of the display interface. For example, taking the current mainstream multi-person live streaming with bullet screen games as an example, multi-person bullet screen games typically start with a single streamer's solo game, and then other streamers or guests join the same game, forming a multi-player live streaming mode. In multi-person bullet screen games, the game content contains information corresponding to both the original streamer and the guests who join the game. At this time, the camera feeds of the original streamer and the guests are also displayed in the live streaming room. For example, the camera feeds of the seven guests who join the game are displayed in the live streaming room in a certain order.

[0048] In the traditional approach described above, when live streaming multiplayer bullet-screen games, the game screen typically occupies a large portion of the live stream screen, while the viewfinder of the streamer or guests usually has a smaller screen. However, when multiple people participate in the bullet-screen game, the viewfinders of multiple guests' cameras are arranged within the live stream screen. When there are many guests, such as seven, their seven screens will occupy a significant portion of the live stream screen, obscuring the bullet-screen game content. Furthermore, statistics show that most users learn the gameplay through rule stickers, which are often located in the lower right corner of the screen and are easily obscured by guest screens. This affects viewers' understanding of the rules and their consumption of gameplay content, thus hindering the streamer's bullet-screen engagement. In addition, the most frequent feedback from online users is also related to screen size issues or obstruction. Therefore, if the guest screen occupies too much space, it will negatively impact the streamer's live stream performance and reduce the viewer's viewing experience.

[0049] To address at least the aforementioned and other potential problems, embodiments of this disclosure propose a method for adjusting a display interface. In this method, target content and multiple media contents corresponding to multiple users are first displayed on the user interface of a first client. The multiple media contents are displayed in multiple display units of the user interface. Then, upon receiving an operation to adjust the multiple display units, the multiple display units are folded into a target display area in the user interface. Finally, the media content in the target display unit is displayed in the target display area of ​​the user interface. This method allows for adjustment of the display layout of specific media content on the user interface, enabling the folding of multiple display units displaying the media content and utilizing the folded target display unit to display the media content. This reduces the display area occupied by the media content corresponding to multiple users, allowing viewers to see more target content and improving the user experience.

[0050] The embodiments of this disclosure will now be described in further detail with reference to the accompanying drawings. Figure 1 illustrates an example environment in which the devices and / or methods of the embodiments of this disclosure may be implemented. In environment 100, a first client 102 may be a device for live streaming, and therefore the first client 102 may also be referred to as a live streaming client. A second client 122 may be a device for watching the content of the first client 102, and may also be referred to as a viewer client. The user interface 104 of the first client 102 displays target content 106 and multiple media contents 110 corresponding to multiple users 118. The multiple media contents 110 are displayed in multiple display units 108 of the user interface 104, for example, multiple slots. Upon receiving an operation 120 for adjusting the multiple display units 108, the multiple display units 108 are folded into the target display area 116 in the user interface 104, and at the same time, an instruction 124 for adjusting the layout is sent to the content delivery network. Finally, the media contents 114 in the target display unit 112 of the multiple display units 108 are displayed in the target display area 116 of the user interface 104. Similarly, similar changes will be made in the user interface 126 of the second client 122 as in the first user interface 104.

[0051] As shown in Figure 1, the gameplay of a multiplayer bullet screen game in a live streaming scenario is used as an example for illustration. It is understood that this application is only described in conjunction with relevant embodiments and is not intended to limit the scope of protection of this application based on these embodiments. Any technical solution falling within the scope of protection of this application should be protected.

[0052] First, during live streaming, the user interface 104 of the first client 102 displays the target content to be streamed, such as a game initiated by the streamer or any suitable content suitable for live streaming. Furthermore, multiple users 118 can participate in activities corresponding to the target content. Therefore, the user interface 106 can also present multiple media contents corresponding to the multiple users 118. Each user can have a corresponding media content, such as a video stream and / or audio stream captured by the user's camera. Therefore, multiple display units 108 are also set in the user interface 104 to display the multiple media contents 110. Each display unit corresponds to a user and is used to display the media content corresponding to that user. The first client 102 merges the target content 106 and the acquired multiple media contents 110, and then uploads the merged information to the content delivery network. In addition, the first client 102 also sends the current layout state of the interface, such as the expanded state, to the content delivery network through some control information, such as Supplemental Enhancement Information (SEI).

[0053] For the second client 122 watching the live stream, it can retrieve the streaming data uploaded by the first client 102 from the content delivery network. Therefore, the user interface 126 of the second client 122 can display the target content 128 and multiple media content items 132. The target content 128 and the multiple media content items 132 are the same as the target content 106 and multiple media content items 110 displayed in the user interface 104. Therefore, the user of the second client 122 can watch the same content as the first client 102. In addition, the multiple media content items 132 displayed in the user interface 126 are also presented in multiple display units 130.

[0054] The user of the first client 102 can adjust the layout of the user interface 104. For example, the user interface 104 presents controls that allow adjustment of the layout. The user can adjust the layout of the user interface to different states by clicking the controls, thereby adjusting the positions of multiple display states. For example, after receiving an operation 120 to adjust multiple display units 108, the multiple display units 108 are collapsed into the target display area 116 in the user interface 104. For example, the multiple display units 108 are overlapped at the position corresponding to the bottommost display unit. Then, multiple media contents corresponding to multiple users are displayed only in the target display area. When displaying media content, one or more display units among the multiple display units can be controlled as target display units to display media content according to certain priority rules. At this time, the first client 102 will merge the content in the target display unit and upload it to the content delivery network. At the same time, the first client 102 also sends an instruction 124 for layout adjustment to the content delivery network.

[0055] It should be noted that the layout of the user interface in the second client 122 changes accordingly with changes in the page layout of the first client. The second client 122 can obtain a layout adjustment instruction 124 from the content delivery network. This instruction 124 includes an identifier of the layout state to which the user interface 104 has been adjusted. For example, this identifier indicates a collapsed layout. At this time, multiple display units 130 can be collapsed into the target display area 138 in the user interface 126. In addition, the second client 122 can also pull the media stream with the adjusted layout from the content delivery network. Then, the media stream is displayed in the user interface 126, thereby displaying the target content 128 on the user interface 126 and displaying the media content corresponding to the target display unit 134 among the multiple display units 130 in the target display area. In addition, the first client 102 can also adjust the layout from a collapsed state to an expanded state. The content viewed in the second client 122 will also change with changes in the layout of the user interface 104 in the first client 102.

[0056] This method allows for adjustments to the display layout of specific media content on the user interface. It enables the expansion or collapse of multiple display units that display media content, and allows control over the media content displayed in the collapsed display units. This reduces the display area occupied by media content for multiple users and improves the user experience.

[0057] The foregoing description, with reference to FIG1, illustrates an example environment in which some embodiments of the present disclosure's devices and / or methods may be implemented. The following description, with reference to FIG2, illustrates an example method 200 for adjusting a display interface according to some embodiments of the present disclosure. The method described in FIG2 can be executed by the first client 102 in FIG1 or any suitable computing device.

[0058] As shown in Figure 2, in example method 200, at box 202, target content and multiple media contents corresponding to multiple users are displayed on the user interface of the first client. The multiple media contents are displayed in multiple display units of the user interface.

[0059] The user interface 104 of the first client 102 has corresponding layout states, and different layout states can be switched by the user of the first client performing relevant operations. For example, in a live broadcast scenario, multiple media contents for 7 guests are usually arranged in a certain order from top to bottom or from left to right. When the host operates the expand or collapse controls corresponding to the multiple media contents, the multiple display units corresponding to the multiple media contents can be expanded or collapsed. In addition, each of the multiple display units corresponding to the multiple media contents corresponds to one of the guests, and the media content in that display unit corresponds to the guest.

[0060] In some embodiments, the expansion or collapse of multiple display units also corresponds to different configuration information, for example, expansion configuration information in the expanded state and collapse configuration information in the collapsed state. Additionally, the configuration information also includes position information for each display unit, representing the position of the display unit within the user interface. When displaying the target content and multiple media contents corresponding to multiple users as described above, it corresponds to the expanded state of the layout for the user interface. In this expanded state, the multiple display units do not overlap. At this time, the first client 102 can obtain the expansion configuration information corresponding to the expanded state, and further utilize this expansion configuration information to determine the positions of the multiple display units and display the multiple media contents within the multiple display units.

[0061] During the display of media content, the positions of multiple users within the user interface can be obtained from the user list first. Then, based on the obtained positions and configuration information, the correspondence between multiple users and multiple display units can be further determined, thereby establishing the correspondence between multiple media contents and display units. This allows for more precise display of the corresponding user's media content on specific display units.

[0062] In some embodiments, the expanded and collapsed states of the multiple display units also have different state identifiers; for example, the expanded state has a first state identifier, and the collapsed state has a second state identifier. In one example, the state identifier may be field information.

[0063] When multiple display units are in an expanded state, the first client 102 can merge the target content 106 in the user interface 104 with multiple media contents 110, and send the merged first merged media content to the content delivery network for the second client to receive.

[0064] Subsequently, at box 204, in response to receiving an operation to adjust multiple display units, the first client 102 folds the multiple display units 108 into the target display area 116 in the user interface.

[0065] In some embodiments, when the first client 102 receives an operation to adjust multiple display units, such as when a user clicks a control for folding, the first client 102 can determine that the layout of the user interface has changed to a folded state. Then, the first client 102 further obtains folding configuration information corresponding to the folded state. For example, the folding configuration information is stored locally on the first client 102, or the first client 102 obtains the folding configuration information from another device. Then, based on the obtained folding configuration information, the first client 102 folds the multiple display units to a target display area in the user interface. For example, when a user triggers a control for folding multiple display units, the multiple display units overlap and are arranged in a display area corresponding to one display unit.

[0066] In some embodiments, after multiple display units are folded 108 times, during the transmission of live content, the target content can be merged with the media content of the target display unit displayed in the target display area. In one example, multiple display units are folded to the area corresponding to one display unit, at which point only one can be displayed, and all other display units completely overlap with the retained display unit and are set to an invisible state. Therefore, during merging, the target content and the media content corresponding to the displayed display unit can be merged. In another example, after the display units are folded, a predetermined number of display units, such as two display units, can be displayed in the target display area, and the target media content in the units to be displayed can be set to a visible state. During merging, the target content and the media content corresponding to the two displayed display units can be merged. The above examples are only for describing this disclosure and are not intended to specifically limit this disclosure.

[0067] Finally, at box 206, the first client 102 displays the media content from the target display unit among multiple display units in the target display area of ​​the user interface. After the multiple display units are collapsed, the media content to be displayed is determined in the target display area 116 of the first client 102 according to certain rules, and then the media content is displayed through the corresponding display unit.

[0068] In some embodiments, before displaying the media content in the target display unit in the target display area 116 of the user interface 104, the first client 102 needs to select the target media content to be displayed from multiple media content. Then, the first client 102 sets the target display unit corresponding to the target media content to be displayed to be visible. Thus, the target media content associated with the target display unit is displayed through the visible target display unit. For example, the media content is associated with the display unit by the user's identifier.

[0069] In some embodiments, during the selection of target media content to be displayed, since the media content is user-specific, it can be determined that the user is visible to it. This process can be initiated based on the audio output status of multiple media outlets, specifically their muted state. For example, non-mute media content is displayed preferentially over muted media content. Therefore, when non-mute media content exists, it can be identified as the target media content to be displayed. If all media content is muted, the media content that can be displayed can be randomly determined.

[0070] When multiple non-silent media contents exist, the first client 102 needs to further determine which of the multiple non-silent media contents is providing audio, for example, determining that there is media content where a user is speaking. Additionally, the non-silent media content can be filtered to remove non-silent media content caused by non-speech noise. In this process, a machine learning model can be used to filter non-speech media content. If among the multiple non-silent media contents there is one media content providing audio, for example, only one user is speaking, then the media content providing audio can be identified as the target media content.

[0071] If multiple non-silent media content pieces are providing audio, such as when multiple users are speaking, the first client 102 determines the media content with the most recent audio information among these pieces. For example, it determines the media content corresponding to the user who spoke most recently. If one of the multiple audio-providing media pieces has the most recent audio information, that media content is determined as the target media content. In this case, the media content corresponding to the user who spoke most recently is determined as the target media content. If multiple audio-providing media pieces have multiple pieces with the most recent audio information, meaning these users spoke at the same time, the media content with the shortest duration is determined from these pieces. Then, the media content with the shortest duration is determined as the target media content. For example, the media content corresponding to the last user in the live stream is determined as the target media content.

[0072] In some embodiments, the first client 102 further determines a second state identifier of the collapsed state, and can determine which media content can be displayed or not displayed at present based on the above operations. At this time, the first client 102 can set multiple visibility identifiers for multiple media content based on the above determination results. One identifier is set for each media content. For example, the attributes of the user corresponding to the content can be set to be visible or invisible. The visibility identifier of the selected target media content to be displayed is set to be visible. The first client 102 also merges the target content and the target media content to generate a second merged media content. Then, the first client 102 sends the second state identifier, multiple visibility identifiers and the second merged media content to the content delivery network for acquisition by the second client as the viewer.

[0073] Furthermore, when the first client 102 receives an operation related to a layout change, it also sends a request to the server used to connect the guests to indicate that the layout has changed. The server can then send messages to multiple users' clients to indicate the layout change, for example, to multiple guests' devices. This message can be an instant message and may include the layout's status, such as an indicator of its collapsed state. Thus, multiple users' clients can follow the layout changes initiated by the first client 102. Additionally, the client devices on these multiple user sides can also adjust the layout.

[0074] This method allows multiple display units that display media content to be folded, and the media content can be displayed using the folded target display unit. This reduces the display area occupied by media content corresponding to multiple users and improves the user experience.

[0075] The above description, with reference to FIG2, illustrates an example method 200 for adjusting a display interface according to some embodiments of the disclosure. The following description, with reference to FIG3, illustrates an example method 300 for adjusting a display interface according to some embodiments of the present disclosure. The method shown in FIG3 can be executed by the second client 122 in FIG1 or any suitable computing device.

[0076] As shown in Figure 3, in example method 300, at box 302, target content and multiple media contents corresponding to multiple users are displayed on the user interface at the second client. The multiple media contents are displayed in multiple display units of the user interface.

[0077] Since the second client 122 is used to display the content broadcast live by the first client, the target content displayed in the user interface of the second client 122 is basically the same as that in the first client. For example, the second client 122 is used to display the media content of a bullet screen game started by the streamer in the first client 102.

[0078] During the display of live content, the second client 102 retrieves content uploaded to the content delivery network by the first client 102 from the content delivery network. Therefore, the second client 122 can receive media content transmitted from the first client 102 through the content delivery network, but it cannot perform any operations on the layout of the multiple display units to change the layout of the multiple display units.

[0079] In some embodiments, when displaying target content and multiple media content, the second client 122 can retrieve a first state identifier and a first merged media content for the layout of the user interface from the content delivery network. The first state identifier indicates the expanded state of the layout. The second client 122 can display the first merged media content on the user interface according to this expanded state. This first merged media content is generated by the first client 102 merging the target content and multiple media content. Multiple display units are also presented on the user interface 102 to display multiple media content items from the first merged media content in the multiple display units of the user interface. Each display unit can be associated with one of multiple users.

[0080] Then, at box 304, in response to receiving an instruction to adjust the layout for the user interface, the second client 122 collapses multiple display units into a target display area within the user interface. After the first client 102 performs a layout adjustment, it uploads a layout identifier to the content delivery network, for example, via SEI information. Then, when the second client 122 receives data from the first client 102, it also obtains the SEI information to acquire a second state identifier for the layout, such as an identifier of the layout's collapsed state. Then, the second client 122 collapses the multiple display units into the target display area within the user interface according to the collapsed configuration information corresponding to this collapsed state. For example, the configuration information instructs multiple display units to be displayed in one target display area. For example, multiple display units are displayed in an area corresponding to one display unit, and the multiple display units are arranged overlapping.

[0081] Finally, at box 306, the second client 122 displays the media content from the target display unit among multiple display units in the target display area of ​​the user interface. After adjusting the layout, the second client 122 can display the retrieved content.

[0082] In this process, the second client can obtain from the content delivery network multiple visibility identifiers for multiple media content uploaded by the first client 102, as well as second merged media content generated by the first client 102 through merging or consolidation operations. This second merged media content is generated by the first client 102 merging the target content and the target media content to be displayed from among the multiple media content, and the visibility identifier for the target content among the multiple visibility identifiers indicates that the target media content is visible. Therefore, the second client 122 can set the target display unit for displaying the target media content among multiple display units to be visible based on the visibility of the target media content. Thus, when displaying the retrieved content, in addition to displaying the target content, the target display unit is also used to display the target media content from the second merged media content.

[0083] The above description, in conjunction with Figure 3, illustrates an example method 300 for adjusting a display interface according to some embodiments of the present disclosure. Figures 2 and 3 above describe the process of adjusting a layout from an expanded state to a collapsed state, and at the first client, the layout can also be adjusted from a collapsed state to an expanded state, the process of which is the reverse of the process described above; therefore, it will not be described in detail here.

[0084] The following is a schematic diagram illustrating an example of a live broadcast view from the broadcaster's perspective in a folded state, according to some embodiments of the present disclosure, with reference to Figure 4.

[0085] As shown in Figure 4, in Example 400, the display unit described above corresponds to the microphone position in the live broadcast. In the user interface of the first client, there is an operable layout expand microphone position 402 control. When the broadcaster performs an operation on the expand microphone position 402, such as clicking or double-clicking, the display unit corresponding to the broadcaster will be expanded, thus converting the layout to an expanded state.

[0086] Once the live chat game starts and a guest joins the streamer's room, a control to expand microphone slot 402 will appear. The streamer needs to manually expand the microphone slot at this point. Additionally, the microphone slot expands automatically when a guest joins the streamer's room.

[0087] After the microphone position is expanded, multiple display units corresponding to the host and multiple guests will be expanded. The maximum number of display units that can exist at the same time after the microphone position is expanded can be set by the host himself, for example, the maximum number of display units that can exist at the same time can be set to 7.

[0088] The above description, with reference to Figure 4, illustrates an example of a live stream view from the broadcaster's perspective in a collapsed layout according to some embodiments of the present disclosure. The following description, with reference to Figure 5, illustrates an example of a live stream view from the broadcaster's perspective in an unfolded layout according to some embodiments of the present disclosure.

[0089] As shown in Figure 5, in Example 500, combined with the previous Example 400, when the layout state is expanded, there are a total of host, guest A, guest B, guest C and guest D.

[0090] After the microphone position is extended and obscures the game screen, the streamer can operate the microphone position collapse control 502 again to collapse multiple display units.

[0091] After the microphone is folded down, the system can determine which user's media content to display based on the visibility of the media content on the display unit. This determination can be made based on information such as whether the user is muted or speaking.

[0092] The above description, with reference to Figure 5, illustrates an example of a live broadcast view from the broadcaster's perspective in an expanded state according to some embodiments of the present disclosure. The following description, with reference to Figure 6, illustrates an example of a live broadcast view from the viewer's perspective in an expanded state according to some embodiments of the present disclosure.

[0093] As shown in Figure 6, in Example 600, after the broadcaster expands the microphone position, the viewer's end will expand the display units corresponding to the broadcaster, guest A, guest B, guest C, and guest D within box 602, and the corresponding media content will also be displayed in the corresponding display units. However, the viewer's end does not have a control to collapse the microphone position for layout control.

[0094] The above description, with reference to FIG. 6, illustrates an example of a live broadcast view from the viewer's perspective in an unfolded state according to some embodiments of the present disclosure. The following description, with reference to FIG. 7, illustrates an example of a live broadcast view from the viewer's perspective in a folded state according to some embodiments of the present disclosure.

[0095] As shown in Figure 7, in Example 700, combined with the previous Example 600, when the microphone position is folded, the connection status information of the 5-person connection 702 will be displayed above the target display unit to remind the audience how many people are currently connected in the bullet screen game.

[0096] The number of people connected includes the host and multiple guests participating in the connection. Additionally, when no guests are connected with the host, the connection status information will not be displayed.

[0097] The above description, with reference to FIG. 7, illustrates an example of a live broadcast view from the viewer's perspective in a folded state according to some embodiments of the present disclosure. The following description, with reference to FIG. 8, illustrates an example of adjusting the overall design of the display interface according to some embodiments of the present disclosure.

[0098] As shown in Figure 8, in example 800, the host 802 first sends an instant message at 804, and then determines the configuration information of the expanded layout UiLayout 806 and the collapsed (folded) layout UiLayout 808 according to the instant message. Subsequently, at 810, the configuration file is parsed and bound to a slot, which can also be called a display unit. After binding the configuration file and the display unit, the user interface 812 and the display unit are subjected to interactive layout abstraction operations.

[0099] While parsing the configuration file to bind slots, the position information of each slot or display unit is also obtained. During this process, list change information 826 is obtained, which includes the identifiers of the host and guests, i.e., the identifiers of multiple users. And at 814, the slot is bound to the list and kept unchanged, and then the correspondence between the display unit and the user in the list can be obtained.

[0100] After multiple display units are folded, at 816, it can be seen that one slot is visible after folding, while the other 6 slots are invisible. That is, one display unit becomes visible and the other 6 display units become invisible (slot 7 is not shown in the figure). Then at 842, the layout is performed in a folded state. In the user interface 844 with the layout adjusted, multiple display units 846 completely overlap, leaving only one display unit.

[0101] When folded into a single display unit, priority decision 818 can be made based on the mute status 820, the start time of speaking 822, and the duration of connection 824, that is, to determine the target media content among multiple media contents for display. For example, the determination can be made based on the mute status, the time of speaking, the duration of speaking, and the duration of joining the live broadcast room. Additionally, the above information can also be determined based on the Real-Time Communication (RTC) volume callback 828. In some embodiments, when the display unit or microphone position is in a folded state, the currently displayed guest or target media content is dynamically determined based on four conditions: First priority: speaking > not speaking; Second priority: multiple people speaking, the one speaking has higher priority than the one not speaking; Third priority: multiple people speaking, the latest speaking guest has higher priority; Fourth priority: if multiple people are speaking and speaking at the same time, the one who speaks last is displayed first.

[0102] Multiple media content can be combined to write Supplemental Enhancement Information (SEI) grid x N 836, where the grid is used to store information associated with each anchor or guest in the media content, such as the anchor or guest's nickname, the amount of rewards received, and popularity. N is the total number of anchors and guests at present.

[0103] After the merge is complete, the live stream 838 corresponding to the host and guests will be obtained. At this time, the folded display unit is used to display the target media content of the host and multiple guests. For example, when the host and a guest are playing a live chat game, the host's microphone is muted, while the guest's microphone is not muted and contains voice information. In this case, the folded display unit is used to display the guest's screen 840.

[0104] Subsequently, at point 834, viewer 832 pulls the stream from live stream 838 to obtain the visible indicators for the guest's image, merge media content and status indicators, and then update the layout of the viewer's user interface.

[0105] Additionally, the viewer's client will also parse SEI grids and update user visibility attributes 830. For example, the viewer's client will parse parameters such as the nicknames of viewers or guests, the amount of donations, and popularity, and update the visibility status of the media content at predetermined time intervals.

[0106] The above description, with reference to FIG8, illustrates examples of adjusting the overall design of a display interface according to some embodiments of the present disclosure. The following description, with reference to FIG9, illustrates examples of adjusting the interaction flow of a display interface according to some embodiments of the present disclosure.

[0107] As shown in Figure 9, in example 900, at point 902, the streamer first initiates the bullet screen feature. Then at point 906, the streamer switches the layout to the first state flag ui_layout=15, which indicates that the current state has been switched to the expanded state.

[0108] Optionally, after the bullet screen feature is activated, at position 904, the live chat server will send a scene switching message to the streamer, notifying the streamer to switch the layout to the expanded state.

[0109] Subsequently, at position 908, the broadcaster writes SEI layout=15 to the Content Delivery Network (CDN), which means sending the first status identifier to the live CDN.

[0110] At 910, the viewer then pulls the stream for decoding. SEI parses the first state identifier layout=15, and at 912, switches the layout to the first state identifier ui_layout=15.

[0111] Next, after the host folds the microphone position, at position 914, the host requests the / position_stash_poo interface 914. Then, at position 916, it receives a real-time message from the live chat server, parses the microphone position folding state, and then at position 918, it cuts the folded layout to the second state identifier ui_layout = 113. At this time, the guest follows the layout folding, also receiving a real-time message from the live chat server at position 920, parsing the microphone position folding state, and then at position 922, cutting the folded layout to the second state identifier ui_layout = 113.

[0112] The viewer's end also follows the layout collapse. At 924, the broadcaster's end writes the second state identifier layout=113 to the live broadcast end. Then at 926, the viewer's end pulls the stream from the live broadcast end for decoding. SEI parses layout=113. Then at 928, the collapsed layout is switched to the second state identifier ui_layout=113.

[0113] Additionally, the broadcaster can switch visible guests when the broadcaster's feed is folded, for example, by calculating the highest priority guest (930). For instance, at box 932, four conditions are listed: microphone on, speaking time, speaking status, and microphone access time. Furthermore, the highest priority guest can also be determined based on the most recently speaking guest, the guest's entry time into the live stream, and the guest's speaking volume.

[0114] At position 934, the broadcaster calculates the guest grid, with the highest priority guest having visible=true and other guests having invisible=false. In other words, the media content of the highest priority guest is visible, while the media content of other guests is invisible.

[0115] Subsequently, at point 936, the live streaming CDN is based on a guest grid (guest list). The highest priority guests participate in the video merging, while others do not. In other words, only the live media content and the media content of the highest priority visible guests are merged.

[0116] At this point, at position 938, the audience pulls the stream from the CDN on the live streaming platform for decoding. SEI parses the guests whose visible=true. Then, at position 940, the layout layer displays the guests whose visible=true, while the microphone positions of other guests are hidden.

[0117] The above description, with reference to FIG9, illustrates examples of interactive flows for adjusting a display interface according to some embodiments of the present disclosure. The following description, with reference to FIG10, illustrates examples of core designs for adjusting a display interface according to some embodiments of the present disclosure.

[0118] As shown in Figure 10, in Example 1000, the broadcaster can switch the layout state 1002, which includes an expanded state 1004 and a collapsed state 1008. The broadcaster can switch the layout 1006 on its own.

[0119] When the broadcaster switches the layout, the expanded layout configuration 1014 and the collapsed layout configuration 1016 can be obtained by reading configuration 1010 and configuration 1012, respectively.

[0120] In some embodiments, the number of display units in the expanded state can have a maximum preset number, for example, the maximum number of slots or display units in the expanded state is 8, including 1 for the host and 7 for the guests. It is understood that other guests can also change the layout of their own live broadcast rooms, so the layouts in the host's and guests' live broadcast rooms are independent and will not affect each other.

[0121] Additionally, the position of the display unit corresponding to the anchor is fixed, while the position of the display unit corresponding to the guest can be randomly assigned. The target display unit after collapsing can be only one, or it can be two or three. This application does not impose any restrictions here.

[0122] The above description, with reference to FIG10, illustrates an example of a core design for adjusting a display interface according to some embodiments of the present disclosure. The following description, with reference to FIG11, illustrates an example of multi-device synchronization for adjusting the layout state of a display interface according to some embodiments of the present disclosure.

[0123] As shown in Figure 11, in example 1100, after the host folds the microphone position, at 1102, the host's end first requests the / position_stash_poo interface. Then, at 1104, it receives a real-time message from the live chat server, parses the microphone position folding state, and then at 1106, switches the folded layout to the second state identifier ui_layout = 113. At this time, the guest follows the layout folding, and similarly at 1108, receives a real-time message from the live chat server, parses the microphone position folding state, and then at 1110, switches the folded layout to the second state identifier ui_layout = 113.

[0124] The viewer's end also follows the layout collapse. At 1112, the broadcaster uploads the second state identifier `layout=113` to the live content distribution platform (CND). Then, at 1114, the viewer pulls the stream from the CDN, decodes it, and parses the supplementary and enhanced information to obtain the second state identifier `layout=113`. Finally, at 1116, the collapsed layout is switched to the second state identifier `ui_layout=113`. The parameter values ​​of both the first and second state identifiers can be defined by the user.

[0125] The above description, with reference to FIG11, illustrates an example of multi-device synchronization for adjusting the layout state of a display interface according to some embodiments of the present disclosure. The following description, with reference to FIG12, illustrates an example of adjusting the microphone position of a display interface according to some embodiments of the present disclosure.

[0126] As shown in Figure 12, in Example 1200, the areas corresponding to multiple display units 1 to 6 are arranged and displayed in a top-to-bottom order in the expanded state. After obtaining the guest list information from the ListChange message 1210, further calculations are performed based on the information in the priority decision 1212 to determine the guest with the highest priority.

[0127] For example, when guest 3 is identified as having the highest priority, the visibility of guest 3 is set to visible, while the visibility of other guests is set to invisible. Furthermore, the display unit 3 bound to guest 3 is made visible and displayed at the target display unit 1.

[0128] The above illustration, with reference to FIG12, depicts an example of adjusting microphone visibility control of a display interface according to some embodiments of the present disclosure. The following illustration, with reference to FIG13, depicts an example of adjusting microphone visibility synchronization of a display interface according to some embodiments of the present disclosure.

[0129] As shown in Figure 13, in Example 1300, combined with the previous Example 800, after the broadcaster switches the layout state to the collapsed state UiLayout 1302, that is, after switching to the collapsed state, at 1304, the visible state of each guest is written to SEI.

[0130] Then at 1306, on the broadcaster's end, encoding is performed and the SEI message is written. After the SEI information is written, at 1310, the broadcaster's streaming information is pushed, and the visible identifier in the SEI information and the merged media content are sent to the CDN together.

[0131] Subsequently, at point 1312, viewers at point 1314 can pull the stream from the CDN. After the stream is complete, the SEI is further parsed at point 1316 to update the microphone visibility, showing microphones with visible=true and hiding microphones with visible=false.

[0132] The above description, with reference to FIG13, illustrates an example of adjusting the microphone position of a display interface according to some embodiments of the present disclosure. The following description, with reference to FIG14, illustrates an example of merging the microphone position of a display interface according to some embodiments of the present disclosure.

[0133] As shown in Figure 14, in Example 1400, at 1402, the host adjusts the size and encodes the stream, and then pushes the stream 1404 to the live RTC server 1408. Multiple guests 1406 join the live chat at the same time.

[0134] Subsequently, at point 1410, media content from the host and guests is retrieved via RTC streaming (n guests). Then, at point 1412, the streams are merged on the RTC client, and the merged media content is transmitted to the game screen at point 1416, with display unit 1418 set to visible=true. Additionally, at point 1414, multiple media contents can be merged on the server side. Finally, the merged media content is transmitted to the audience via CDN 1420.

[0135] The above description, with reference to FIG14, is a schematic diagram illustrating an example of merging microphone positions for adjusting the display interface according to some embodiments of the present disclosure. The following description, with reference to FIG15, is a schematic diagram of an embodiment of a live broadcast view from the broadcaster's perspective, with the layout in an expanded state according to some embodiments of the present disclosure.

[0136] As shown in Figure 15, in Example 1500, when the host starts the XX live streaming mode, there are a total of five players: the host and guests A, B, C, and D. The media content in each player's display unit is different, and the host or guests can set the layout of their own media content.

[0137] The current layout is in the unfolded state. The host or guest can change the unfolded state to the folded state by operating the microphone position control 1502.

[0138] The above description, with reference to FIG. 15, is a schematic diagram of an embodiment of a live broadcast view from the anchor's perspective in an expanded state according to some embodiments of the present disclosure. The following description, with reference to FIG. 16, is a schematic diagram of an embodiment of a live broadcast view from the guest's perspective in an expanded state according to some embodiments of the present disclosure.

[0139] As shown in Figure 16, in Example 1600, from the perspective of the guests, there are also five players: the host, guest A, guest B, guest C, and guest D. The current layout is in an expanded state, and the guests also have a microphone collapse control 1602. The guests can also change the expanded state to a collapsed state by operating the microphone collapse control 1602.

[0140] The above description, with reference to FIG. 16, is a schematic diagram of an embodiment of a live broadcast view from the guest's perspective in an unfolded state according to some embodiments of the present disclosure. The following description, with reference to FIG. 17, is a schematic diagram of an embodiment of a live broadcast view from the audience's perspective in an unfolded state according to some embodiments of the present disclosure.

[0141] As shown in Figure 17, in Example 1700, viewers can watch the live stream of the host and guests A through D playing a game with comments, as well as media content corresponding to the host and each guest. Viewers can also join the game and become a guest on the microphone by clicking the "Join Connection" control 1702. However, the number of guests is usually limited; if the number of guests reaches a threshold, the "Join Connection" control 1702 may not be displayed. Additionally, the viewer's end does not have a control to collapse the microphone position.

[0142] The above description, with reference to FIG17, is a schematic diagram of an embodiment of a live broadcast view from the viewer's perspective, with the layout in an unfolded state according to some embodiments of the present disclosure. The following description, with reference to FIG18, is a schematic diagram of an embodiment of a live broadcast view from the broadcaster's perspective, with the layout in a folded state according to some embodiments of the present disclosure.

[0143] As shown in Figure 18, in Example 1800, when the microphone position is folded, while the broadcaster is speaking, a display unit corresponding to the broadcaster can be displayed in the target display area, and media content corresponding to the broadcaster can be displayed in the display unit. The broadcaster can change the layout state from folded to unfolded by operating the microphone position 1802.

[0144] The following is a schematic diagram of an embodiment of a live broadcast view from the guest's perspective, with the layout in a folded state according to some embodiments of the present disclosure, described below with reference to FIG19. As shown in FIG19, in Example 1900, similar to Example 1800, after the microphone position is folded, a display unit corresponding to the broadcaster is displayed in the target display area. The guest can change the layout state from folded to unfolded by operating the unfolded microphone position 1902. Therefore, the guest can control the layout of the displayed interface themselves.

[0145] The following is a schematic diagram of an embodiment of a live broadcast screen from the viewer's perspective, with the layout in a collapsed state according to some embodiments of the present disclosure, described below with reference to FIG20. As shown in FIG20, in Example 2000, when the viewer's device is in the collapsed state, the number of currently online users can be obtained through the online status bar 2002. For example, it can be seen that there are currently 6 people online in the current live chat game in Example 2000. In some embodiments, the viewer's device cannot join a connection when the device is in the collapsed state. Additionally, the streamer who initially entered the live chat game can control whether others can join the connection by controlling the join-connection switch.

[0146] As shown in Figure 21, the device 2100 includes a first content display module 2102, configured to display target content and multiple media contents corresponding to multiple users on the user interface of a first client, wherein the multiple media contents are displayed in multiple display units of the user interface; a first display unit folding module 2104, configured to fold the multiple display units into the target display area of ​​the user interface in response to receiving an operation for adjusting the multiple display units; and a first media content display module 2106, configured to display the media contents in the target display unit of the multiple display units in the target display area of ​​the user interface.

[0147] In some embodiments, the first content display module 2102 includes: an expansion state determination module configured to determine the expansion state of the layout for the user interface; an expansion configuration information acquisition module configured to acquire expansion configuration information corresponding to the expansion state; and a plurality of media content display modules configured to display a plurality of media content in a plurality of display units of the user interface based on the expansion configuration information, wherein the plurality of display units do not overlap in the expansion state.

[0148] In some embodiments, the multiple media content display module includes: a location information determination module configured to determine the location information of multiple display units based on expanded configuration information; and a multiple display unit display module configured to arrange multiple display units on a user interface to display multiple media contents based on the location information.

[0149] In some embodiments, the apparatus 2100 further includes: a first state identifier determination module configured to determine a first state identifier of the unfolded state of the layout; a target content and multiple media content merging module configured to generate a first merged media content by merging the target content and multiple media content; and a first state identifier and first merged media content sending module configured to send the first state identifier and the first merged media content to a content distribution network.

[0150] In some embodiments, the first display unit folding module 2104 includes: a folding state determination module configured to determine a folding state for the layout of the user interface in response to receiving an operation for adjusting multiple display units; a folding configuration information acquisition module configured to acquire folding configuration information corresponding to the folding state; and a multiple display unit folding module configured to fold multiple display units to a target display area in the user interface based on the folding configuration information.

[0151] In some embodiments, the apparatus 2100 further includes: a second state identifier determination module configured to determine a second state identifier of a folded state; a visibility representation setting module configured to set a plurality of visibility identifiers for a plurality of media content, wherein a visibility identifier for a target media content is set to visible among the plurality of visibility identifiers; a target media content and plurality of media content merging module configured to generate a second merged media content by merging the target media content and the plurality of media content; and a second state identifier, visibility identifier and second merged media content sending module configured to send the second state identifier, the plurality of visibility identifiers and the second merged media content to a content delivery network.

[0152] In some embodiments, the first media content display module 2106 includes: a target media content selection module, configured to select a target media content to be displayed from a plurality of media contents; and a target display unit visibility setting module, configured to display the target media content in a target display area by setting the target display unit corresponding to the target media content to be visible.

[0153] In some embodiments, the target media content selection module includes: a non-silent media content existence determination module, configured to determine whether non-silent media content exists among a plurality of media contents; and a target media content determination module, configured to determine the non-silent media content as the target media content in response to the existence of a non-silent media content among the plurality of media contents.

[0154] In some embodiments, the target media content selection module further includes: a media content providing voice existence determination module, configured to determine whether there is media content providing voice among the multiple non-silent media contents in response to the existence of multiple non-silent media contents; and a target media content determination module, configured to determine the media content providing voice as the target media content in response to the existence of one media content providing voice among the multiple non-silent media contents.

[0155] In some embodiments, the target media content selection module further includes: a media content determination module with recent voice information, configured to determine the media content with recent voice information among the multiple media content providing voice in response to the existence of multiple media content providing voice among multiple non-silent media content; and a target media content determination module, configured to determine the media content with recent voice information as the target media content in response to the existence of a media content with recent voice information among the multiple media content providing voice.

[0156] In some embodiments, the target media content selection module further includes: a media content determination module with the shortest duration, configured to determine the media content with the shortest duration from among the media content with the most recent voice information in response to the existence of multiple media content with the most recent voice information among multiple media content providing voice; and a target media content determination module, configured to determine the media content with the shortest duration as the target media content.

[0157] In some embodiments, the apparatus 2100 further includes: a list receiving module for multiple users, configured to receive a list of multiple users, the list including the positions of users among the multiple users in the display interface; and a correspondence determination module, configured to determine the correspondence between users in the list and display units among multiple display units based on the positions.

[0158] As shown in Figure 22, the device 2200 includes a second content display module 2202, configured to display target content and multiple media contents corresponding to multiple users on the user interface of a first client, the multiple media contents being displayed in multiple display units of the user interface; a second display unit folding module 2204, configured to fold the multiple display units into a target display area in the user interface in response to receiving an instruction to adjust the layout of the user interface; and a second media content display module 2206, configured to display the media contents in the target display unit of the multiple display units in the target display area of ​​the user interface.

[0159] In some embodiments, the second content display module 2202 includes: a first status identifier and a first merged media content acquisition module, configured to acquire a first status identifier and a first merged media content for a layout of a user interface from a content delivery network, wherein the first status identifier indicates the unfolded state of the layout, and the first merged media content is generated by merging target content and multiple media content; and a first merged media content display module, configured to display the first merged media content on the user interface based on the unfolded state, wherein multiple media content in the first merged media content is displayed in multiple display units of the user interface.

[0160] In some embodiments, the second display unit folding module 2204 includes: a plurality of display unit folding modules configured to fold the plurality of display units into a target display area in the user interface in response to receiving a second status identifier for the layout from a content delivery network.

[0161] In some embodiments, the second media content display module 2206 includes: a visibility identifier and a second merged media content acquisition module, configured to acquire a visibility identifier and a second merged media content for multiple media contents from a content delivery network, wherein the second merged media content is generated by merging target content and target media content, and the visibility identifier indicates that the target media content is visible; and a target media content display module, configured to display the target media content in the second merged media content through a display unit corresponding to the target media content among multiple display units.

[0162] Figure 23 shows a schematic block diagram of an example device 2300 that can be used to implement embodiments of the present disclosure. The first client 102 and the second client 122 in Figure 1 can be implemented using device 2300. As shown, device 2300 includes a central processing unit (CPU) 2301, which can perform various appropriate actions and processes according to computer program instructions stored in read-only memory (ROM) 2302 or loaded from storage unit 2308 into random access memory (RAM) 2303. Various programs and data required for the operation of device 2300 may also be stored in RAM 2303. CPU 2301, ROM 2302, and RAM 2303 are interconnected via bus 2304. Input / output (I / O) interface 2305 is also connected to bus 2304.

[0163] Multiple components in device 2300 are connected to I / O interface 2305, including: input unit 2306, such as keyboard, mouse, etc.; output unit 2307, such as various types of monitors, speakers, etc.; storage page 2308, such as disk, optical disk, etc.; and communication unit 2309, such as network card, modem, wireless communication transceiver, etc. Communication unit 2309 allows device 2300 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks. High-pitched techniques, vocal exercises, articulation, breathing techniques, falsetto and mixed voice, and correct singing methods 2.

[0164] The various processes and procedures described above, such as methods 200 and 300, can be executed by processing unit 2301. For example, in some embodiments, methods 200 and 300 may be implemented as computer software programs tangibly contained in a machine-readable medium, such as storage unit 2308. In some embodiments, part or all of the computer program may be loaded and / or installed on device 2300 via ROM 2302 and / or communication unit 2309. When the computer program is loaded into RAM 2303 and executed by CPU 2301, one or more actions of the example methods 200 and 300 described above can be performed.

[0165] This disclosure can be a method, apparatus, system, and / or computer program product. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for performing various aspects of this disclosure.

[0166] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination of the foregoing. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0167] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0168] Computer program instructions used to perform the operations of this disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), is personalized by utilizing the status information of the computer-readable program instructions to implement various aspects of this disclosure.

[0169] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0170] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0171] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0172] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0173] The various embodiments of this disclosure have been described above. These descriptions are exemplary and not exhaustive, and are not limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical applications, or technical improvements to the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. A method for adjusting a display interface, comprising: The target content and multiple media contents corresponding to multiple users are displayed on the user interface of the first client, and the multiple media contents are displayed in multiple display units of the user interface; In response to receiving an operation to adjust the plurality of display units, the plurality of display units are folded into a target display area in the user interface; as well as The media content of the target display unit among the plurality of display units is displayed in the target display area of ​​the user interface.

2. The method according to claim 1, wherein displaying the target content and multiple media contents corresponding to multiple users on the user interface of the first client includes: Determine the expanded state of the layout for the user interface; Obtain the expansion configuration information corresponding to the expansion state; as well as Based on the expanded configuration information, the multiple media contents are displayed in the multiple display units of the user interface, and the multiple display units do not overlap in the expanded state.

3. The method according to claim 2, wherein displaying the plurality of media contents in the plurality of display units of the user interface comprises: Based on the expanded configuration information, the position information of the plurality of display units is determined; as well as Based on the location information, the plurality of display units are arranged on the user interface to display the plurality of media contents.

4. The method according to claim 2, further comprising: A first state identifier is used to determine the unfolded state of the layout; The first merged media content is generated by merging the target content and the multiple media contents; as well as Send the first status identifier and the first merged media content to the content delivery network.

5. The method of claim 1, wherein folding the plurality of display units into the target display area of ​​the user interface comprises: In response to receiving an operation for adjusting the plurality of display units, a folding state of the layout for the user interface is determined; Obtain the folding configuration information corresponding to the folding state; Based on the folding configuration information, the plurality of display units are folded into the target display area in the user interface.

6. The method according to claim 5, further comprising: A second state identifier is used to determine the folded state; Multiple visibility identifiers are set for the multiple media content, wherein the visibility identifier for the target media content is set to be visible; A second merged media content is generated by merging the target content and the target media content; as well as The second status identifier, the plurality of visibility identifiers, and the second merged media content are sent to the content delivery network.

7. The method according to claim 1, wherein displaying media content in the target display unit of the plurality of display units in the target display area of ​​the user interface comprises: Select the target media content to be displayed from the multiple media content options; as well as The target media content is displayed in the target display area by making the target display unit corresponding to the target media content visible.

8. The method of claim 7, wherein selecting the target media content to be displayed from the plurality of media content includes: Determine whether any of the multiple media contents are non-silent; as well as In response to the existence of a non-silent media content among the plurality of media content, the non-silent media content is identified as the target media content.

9. The method of claim 8, wherein selecting the target media content to be displayed from the plurality of media content further comprises: In response to the presence of multiple non-silent media contents among the multiple media contents, determine whether there is any media content that is providing voice among the multiple non-silent media contents; In response to the existence of a media content that is providing audio among the plurality of non-silent media content, the media content that is providing audio is identified as the target media content.

10. The method of claim 9, wherein selecting the target media content to be displayed from the plurality of media content further comprises: In response to the existence of multiple media contents providing voice among the multiple non-silent media contents, determine the media content with the most recent voice information among the multiple media contents providing voice; In response to the existence of a media content with the most recent voice information among the plurality of media content providing voice, the media content with the most recent voice information is determined as the target media content.

11. The method of claim 10, wherein selecting the target media content to be displayed from the plurality of media content further comprises: In response to the existence of multiple media contents with the most recent voice information among the multiple media contents providing voice, the media content with the shortest duration is determined from the multiple media contents with the most recent voice information; as well as The media content with the shortest duration is identified as the target media content.

12. The method according to claim 1, further comprising: Receive a list of the plurality of users, the list including the position of each user in the display interface, and Based on the location, the correspondence between the users in the list and the display units in the plurality of display units is determined.

13. A method for adjusting a display interface, comprising: The target content and multiple media contents corresponding to multiple users are displayed on the user interface of the second client, and the multiple media contents are displayed in multiple display units of the user interface; In response to receiving an instruction to adjust the layout of the user interface, the plurality of display units are folded into a target display area in the user interface; The media content of the target display unit among the plurality of display units is displayed in the target display area of ​​the user interface.

14. The method of claim 13, wherein displaying the target content and multiple media contents corresponding to multiple users on the user interface at the second client comprises: A first state identifier and a first merged media content for the layout of the user interface are obtained from the content delivery network. The first state identifier indicates the expanded state of the layout, and the first merged media content is generated by merging the target content and the multiple media contents. Based on the expanded state, the first merged media content is displayed on the user interface, and the plurality of media contents in the first merged media content are displayed in the plurality of display units of the user interface.

15. The method of claim 13, wherein folding the plurality of display units into a target display area in the user interface comprises: In response to receiving a second status identifier for the layout from the content delivery network, the plurality of display units are folded into the target display area in the user interface.

16. The method of claim 15, wherein displaying media content in a target display unit of the plurality of display units in the target display area of ​​the user interface comprises: The content delivery network is used to obtain multiple visibility identifiers and a second merged media content for the plurality of media content, the second merged media content being generated by merging the target content and the target media content, wherein the visibility identifier for the target content among the plurality of visibility identifiers indicates that the target media content is visible; as well as Based on the fact that the target media content is visible, it is determined that the target display unit corresponding to the target media content among the plurality of display units is visible; The target display unit is used to display the target media content in the second merged media content.

17. An apparatus for adjusting a display interface, comprising: The first content display module is configured to display target content and multiple media contents corresponding to multiple users on the user interface of the first client, wherein the multiple media contents are displayed in multiple display units of the user interface; The first display unit folding module is configured to fold the plurality of display units into a target display area in the user interface in response to receiving an operation for adjusting the plurality of display units; as well as The first media content display module is configured to display media content from the target display unit among the plurality of display units in the target display area of ​​the user interface.

18. An apparatus for adjusting a display interface, comprising: The second content display module is configured to display target content and multiple media contents corresponding to multiple users on the user interface of the second client, wherein the multiple media contents are displayed in multiple display units of the user interface; The second display unit folding module is configured to fold the plurality of display units into a target display area in the user interface in response to receiving an instruction to adjust the layout of the user interface. as well as The second media content display module is configured to display media content from the target display unit among the plurality of display units in the target display area of ​​the user interface.

19. An electronic device comprising: At least one processor; as well as A storage device for storing at least one program, which, when executed by the at least one processor, causes the at least one processor to implement the method according to any one of claims 1-16.

20. A computer-readable storage medium having a computer program stored thereon, the computer program implementing the method according to any one of claims 1-16 when executed by a processor.

21. A computer program product comprising a computer program that, when executed by a processor, implements the method according to any one of claims 1-16.

Images