Method and apparatus for processing livestreaming interface, device, medium and program product
By delaying the loading of some components of the live streaming interface, the problem of terminal device load and energy consumption caused by frequent switching of live streaming rooms was solved, thus improving user experience and device performance.
Patent Information
- Application Number
- PCT/CN2025/114830
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-08-14
- Filing Date
- 2025-08-14
- Publication Date
- 2026-02-19
AI Technical Summary
Existing technologies significantly increase the load and energy consumption of terminal devices when frequently switching between live streaming rooms, leading to high device performance requirements and impacting user experience.
By delaying the loading of certain components of the live streaming interface, and determining whether to delay loading a subset of the second component based on reference information from the terminal device, the live streaming interface is updated only after the predetermined duration has been reached.
It reduces the load and energy consumption of terminal devices, improves the user experience, and reduces the high requirements for device performance.
Smart Images

Figure CN2025114830_19022026_PF_FP_ABST
Abstract
Description
Method, device, equipment, medium and program product for live interface processing
[0001] The present application claims priority to the Chinese patent application No. 202411119554.3, filed on August 14, 2024, entitled “Method, device, equipment, medium and program product for live interface processing”, the whole content of which is incorporated herein by reference. TECHNICAL FIELD
[0002] The example embodiments of the present disclosure generally relate to the field of computer, and in particular, to a method, device, equipment, computer readable storage medium and computer program product for live interface processing. BACKGROUND
[0003] More and more applications are able to provide live streaming function. The interface used by the application to present the live streaming content is usually referred to as “live interface”. The “live interface” is usually composed of multiple components, and the diversified functions of the “live interface” are realized through diversified components. By optimizing the configuration of the components of the “live interface”, the live streaming experience of the audience can be improved. SUMMARY
[0004] In a first aspect of the present disclosure, a method for live interface processing is provided. The method comprises: in response to a terminal device receiving a presentation request for a first live streaming, presenting a live interface corresponding to the first live streaming based on at least a first component subset of a plurality of components corresponding to the first live streaming, the first component subset including at least one component of the plurality of components; determining whether to delay loading a second component subset of the plurality of components based on reference information associated with live streaming browsing at the terminal device; and in response to determining to delay loading the second component subset, updating the live interface corresponding to the first live streaming based on the second component subset after a delay loading time length of the second component subset reaches a predetermined time length.
[0005] In a second aspect of the present disclosure, a device for live interface processing is provided. The device comprises: a presentation module configured to, in response to a terminal device receiving a presentation request for a first live streaming, present a live interface corresponding to the first live streaming based on at least a first component subset of a plurality of components corresponding to the first live streaming, the first component subset including at least one component of the plurality of components; a determination module configured to determine whether to delay loading a second component subset of the plurality of components based on reference information associated with live streaming browsing at the terminal device; and an update module configured to, in response to determining to delay loading the second component subset, update the live interface corresponding to the first live streaming based on the second component subset after a delay loading time length of the second component subset reaches a predetermined time length.
[0006] In a third aspect of the disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. The instructions, when executed by the at least one processor, cause the device to perform the method of the first aspect.
[0007] In a fourth aspect of the disclosure, a computer-readable storage medium is provided. The medium has stored thereon computer-executable instructions that, when executed by a processor, implement the method of the first aspect.
[0008] In a fifth aspect of the disclosure, a computer program product is provided. The computer program product is tangibly stored in a computer storage medium and includes computer- executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.
[0009] It is to be understood that the details set forth in this section are not intended to limit key or critical features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description. BRIEF DESCRIPTION OF DRAWINGS
[0010] The above and other features, aspects, and advantages of embodiments of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings. In the drawings, like reference numerals refer to like elements, in which:
[0011] FIG. 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;
[0012] FIG. 2 shows a flowchart of a process for live interface processing, according to some embodiments of the present disclosure;
[0013] FIG. 3A shows a schematic diagram of an example of a live interface corresponding to a second live, according to some embodiments of the present disclosure;
[0014] FIG. 3B and FIG. 3C respectively show schematic diagrams of examples of a live interface corresponding to a first live, according to some embodiments of the present disclosure;
[0015] FIG. 3D shows a schematic diagram of an example of a live interface corresponding to a third live, according to some embodiments of the present disclosure;
[0016] FIG. 4 shows a flowchart of a process for lazy loading determination for a second subset of components, according to some embodiments of the present disclosure;
[0017] FIG. 5 shows a flowchart of a process for lazy loading determination for a second subset of components, according to some embodiments of the present disclosure;
[0018] FIG. 6 shows a schematic structural block diagram of an apparatus for live interface processing according to some embodiments of the present disclosure; and
[0019] FIG. 7 shows an electronic device in which one or more embodiments of the present disclosure can be implemented. DETAILED DESCRIPTION
[0020] Embodiments of the present disclosure will be described in more detail with reference to the drawings. While certain embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be embodied in various forms and should not be interpreted as being limited to the embodiments set forth herein; rather, these embodiments are provided so that the present disclosure can be more thoroughly and completely understood. It will be appreciated that the drawings of the present disclosure and the embodiments are only for illustrative purposes and should not be construed as limiting the scope of protection of the present disclosure.
[0021] In the description of embodiments of the present disclosure, the term "comprising" and its conjugations should be understood to encompass the meanings of "consisting of" and "consisting essentially of". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions can also be included below.
[0022] In this document, unless explicitly stated, performing a step "in response to A" does not mean performing the step immediately after A, but can include one or more intermediate steps.
[0023] It can be understood that the data involved in the technical solutions of the present disclosure (including but not limited to the data itself, the obtaining or use of the data) should comply with the requirements of relevant laws and regulations and relevant provisions.
[0024] It can be understood that before using the technical solutions disclosed in the embodiments of the present disclosure, the type of personal information involved in the present disclosure, the scope of use, the use scenario, etc. should be informed to the user and the authorization of the user should be obtained through appropriate means according to relevant laws and regulations.
[0025] For example, in response to receiving the user's active request, a prompt message is sent to the user to explicitly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information, so that the user can voluntarily choose whether to provide personal information to the software or hardware such as electronic devices, application programs, servers or storage media, etc. that perform the operation of the technical solutions of the present disclosure according to the prompt message.
[0026] As an optional but non-limiting implementation, in response to receiving the active request of the user, the prompt information can be sent to the user in the form of a pop-up window, in which the prompt information can be presented in the form of text. In addition, the pop-up window can also carry a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.
[0027] It can be understood that the above notification and user authorization obtaining process is only illustrative and does not limit the implementation of the present disclosure, and other ways that meet the relevant laws and regulations can also be applied to the implementation of the present disclosure.
[0028] FIG. 1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. In the environment 100, one or more users 110-1, 110-2, 110-3, …, 110-N can watch a live broadcast and participate in the interaction of the live broadcast session through the respective associated terminal devices 120-1, 120-2, …, 120-N. The user 110 can also be referred to as a participant. For ease of discussion, the users 110-1, 110-2, …, 110-N can be collectively referred to as or individually referred to as the user 110, and the terminal devices 120-1, 120-2, …, 120-N can be collectively referred to as or individually referred to as the terminal device 120. Among all the users 110, one or more users, for example, the user 110-1 can establish a live broadcast session and initiate a live broadcast through the associated terminal device 120-1.
[0029] In some scenarios, the user 110-1 who initiates the live broadcast can also be referred to as a host, a host participant, a live broadcast party, or a live broadcast management party of the live broadcast session. One or more other users 110 can include a guest participant 110-N to represent a user participating in the live broadcast interaction initiated by the host. In addition to the guest participant participating in the live broadcast interaction, the other users 110 can also include a viewing audience, a listener, or a viewing party of the live broadcast session.
[0030] In some embodiments, the terminal device 120 can be respectively installed with an application capable of providing a live broadcast service, or can access a website capable of providing a live broadcast service. The user 110 can operate the terminal device 120 to access the corresponding application or website. Accordingly, the terminal device 120 can present a corresponding live broadcast interface, which can provide, for example, live broadcast content of a live broadcast room, such as audio live broadcast content or video live broadcast content, etc.
[0031] In some embodiments, the terminal device 120 can also communicate with the server 130 through the network 132 to implement the provisioning of the live service. The server 130 can provide functions such as management, configuration and maintenance of the application or website. In some embodiments, the server 130 can store data generated during the live session, including live interaction data generated during the live interaction.
[0032] The terminal device 120 can be any type of mobile terminal, fixed terminal, or portable terminal including a mobile handset, a tablet computer, a laptop computer, a notebook computer, a netbook computer, a smartbook, a tablet computer, a media tablet, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a television receiver, a radio broadcast receiver, an electronic book device, a game device, or any combination thereof, including accessories and peripherals of these devices, or any combination thereof. In some embodiments, the terminal device 120 can also be capable of supporting any type of interface to a user (such as “wearable” circuitry, etc.). The server 110 can be any type of computing system / server capable of providing computing capabilities, including but not limited to mainframes, edge computing nodes, computing devices in a cloud environment, etc.
[0033] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only, and do not imply any limitation on the scope of the present disclosure.
[0034] As mentioned previously, more and more applications are capable of providing live functions. The interface used by the application to present the live content is generally referred to as a “live interface”. The “live interface” is generally composed of a plurality of components, which can include, for example, components presenting a video stream of a host, components presenting video streams of participants, components showing information of the host, components showing information of the participants, components showing a ranking list, components for chatting, sending a barrage, etc. to interact with the host, the participants or other viewers, components for implementing control functions such as volume adjustment, screen adjustment, recording, playback, etc. The “live interface” implements diversified functions through diversified components. By optimizing the configuration of the components of the “live interface”, the live experience of the viewers can be improved.
[0035] Conventionally, an application providing live streaming function usually supports switching live streaming rooms by sliding the screen, so that online live streaming presents high fluidity and instantaneity. Such an operation manner can provide better operation experience and live streaming experience, but such an operation manner also increases the load of the terminal device to some extent. Especially in the use scenario of frequent and fast screen sliding to switch live streaming rooms, each time the live streaming room is switched, all components of the live streaming interface need to be reloaded, which significantly increases the load of the terminal device and puts forward higher requirements on the device performance of the terminal device.
[0036] According to an embodiment of the present disclosure, an improved scheme for live streaming interface processing is provided. According to the scheme, in response to the terminal device receiving a presentation request for a first live streaming, a live streaming interface corresponding to the first live streaming is presented based on at least a first component subset of a plurality of components corresponding to the first live streaming, the first component subset including at least one component of the plurality of components. Based on reference information associated with live streaming browsing at the terminal device, it is determined whether to delay loading a second component subset of the plurality of components. Then, in response to determining to delay loading the second component subset, after a delay loading time length of the second component subset reaches a predetermined time length, the live streaming interface corresponding to the first live streaming is updated based on the second component subset. Thus, during the user's live streaming watching process, the partial components of the live streaming interface can be selectively delayed loaded, which is beneficial to reduce the load and energy consumption of the terminal device.
[0037] Some example embodiments of the present disclosure will be described below with continued reference to the drawings.
[0038] FIG. 2 shows a flowchart of a process 200 for live streaming interface processing according to some embodiments of the present disclosure. For ease of discussion, these embodiments will be described with reference to the environment 100 of FIG. 1. The process 200 can be implemented at the terminal device 120 of the live streaming viewer of FIG. 1.
[0039] At block 210 of the process 200, the terminal device 120 presents a live streaming interface corresponding to a first live streaming based on at least a first component subset of a plurality of components corresponding to the first live streaming in response to receiving a presentation request for the first live streaming.
[0040] In some embodiments, the terminal device 120 can present the live streaming interface corresponding to the first live streaming based on the first component subset in response to receiving a switching request from a second live streaming to the first live streaming. The first live streaming and the second live streaming here can be any live streaming session (also referred to as "live streaming room") initiated by any host.
[0041] To better understand the switching process from the second live broadcast to the first live broadcast, reference will be made to FIG. 3A and FIG. 3B. FIG. 3A shows a schematic diagram of an example 300A of a live broadcast interface corresponding to the second live broadcast, according to some embodiments of the present disclosure. FIG. 3B shows a schematic diagram of an example 300B of a live broadcast interface corresponding to the first live broadcast, according to some embodiments of the present disclosure. As shown in FIG. 3A, the terminal device 120 can present the live broadcast interface 310 corresponding to the second live broadcast. At this time, the user 110 can slide the touch display screen of the terminal device 120 with a finger 320 towards the top or bottom end of the touch display screen, and the terminal device 120 can determine that a switching request from the second live broadcast to the first live broadcast is received in response to the sliding operation on the touch display screen. The terminal device 120 can switch from presenting the live broadcast interface 310 corresponding to the second live broadcast shown in the example 300A to presenting the live broadcast interface 330 corresponding to the first live broadcast shown in the example 300B.
[0042] It can be understood that switching the live broadcast room by sliding the touch display screen is only one of a plurality of selectable live broadcast room switching manners. The user 110 can also input a switching request to the terminal device 120 by operating a plurality of manners such as a volume adjustment button, a touch panel, a mouse, a joystick, etc. during watching the live broadcast.
[0043] It should also be noted that the terminal device 120 is not limited to presenting the live broadcast interface corresponding to the first live broadcast based on the first component subset in the case of switching from the second live broadcast to the first live broadcast. The terminal device 120 can also present the live broadcast interface corresponding to the first live broadcast based on the first component subset in response to receiving a starting operation of an application providing a live broadcast function. For example, the user 110 can click an application icon, and the terminal device 120 can present the live broadcast interface corresponding to the first live broadcast based on the first component subset in response to receiving the clicking operation of the application icon.
[0044] In some embodiments, the terminal device 120 can obtain a first component subset from a plurality of components corresponding to the first live broadcast from the server 130 in response to receiving a presentation request of the first live broadcast. Then, the terminal device 120 can present the live broadcast interface corresponding to the first live broadcast based on the components in the obtained first component subset.
[0045] Alternatively or additionally, the plurality of components corresponding to the first live broadcast here can include all components for constructing the live broadcast interface corresponding to the first live broadcast, or can include part of the components for constructing the live broadcast interface corresponding to the first live broadcast. The first component subset here includes at least one component from the plurality of components. Alternatively or additionally, the first component subset can include one component, or can include a plurality of components. For example, the plurality of components corresponding to the first live broadcast can include N components, N being a positive integer greater than 1. The first component subset can include K components, 1≤K
[0046] Alternatively or additionally, the first subset of components may include components for constructing the basic functions of the live streaming interface corresponding to the first live stream. For example, as shown in FIG3B, the live streaming interface 330 in example 300B may be the live streaming interface corresponding to the first live stream presented based on the first subset of components. Based on this, the first subset of components may include, for example, components 331, 332, 333, 334, 335, and 336. Component 331 may be a component for presenting broadcaster information (e.g., broadcaster avatar), component 335 may be a component for implementing search functionality, and component 336 may be a component for implementing, for example, control functions of the live streaming interface.
[0047] It is understood that the first component subset is not limited to the components presented in the live streaming interface 310; it may also include components not presented in the live streaming interface 310. For example, the first component subset may also include components for streaming media data processing, components for API calls, components for backend management services, components for push notifications, and so on. Of course, the components in the first component subset mentioned above are merely exemplary, and the components in the first component subset can be selected and configured according to the actual needs of the live streaming interface presentation.
[0048] Regarding the presentation of the live stream interface corresponding to the first live stream, it can be presented based on a subset of the first component among multiple components corresponding to the first live stream, or it can be presented based on the subset of the first component and at least one other component subset. For example, the live stream interface corresponding to the first live stream can be presented based on a subset of underlying functional components and a subset of the first component. The subset of underlying functional components may include components for implementing underlying functions such as streaming media data processing, interface calls, background management services, and push notifications. The subset of the first component may include, for example, components 311, 312, 313, 314, 315, and 316.
[0049] In box 220 of process 200, terminal device 120 determines, based on reference information associated with live browsing at terminal device 120, whether to delay loading a second subset of multiple components.
[0050] The reference information related to live streaming at terminal device 120 may include information from multiple dimensions related to live streaming. Alternatively or additionally, the reference information may include information indicating device characteristics of terminal device 120, information indicating component characteristics, and data analysis results related to live streaming, etc.
[0051] The second component subset here includes at least one additional component among a plurality of components; that is, the second component subset may include one or more components other than those in the first component subset. For example, the second component subset may include M components, 1 ≤ M < N, and K + M ≤ N.
[0052] Alternatively or additionally, the at least one other component included in the second component subset can be used to implement additional functions of the live interface corresponding to the first live broadcast, and the at least one other component does not affect the basic functions of the live interface corresponding to the first live broadcast (for example, processing and presentation of streaming media data, presentation of host information, and basic control functions of the live interface, and the like) even if the at least one other component is not loaded, but loading of the at least one other component is conducive to improving the live service capability of the live interface corresponding to the first live broadcast.
[0053] Exemplarily, the second component subset can include, but is not limited to, a like component for implementing a like function, a small window component for implementing a small window display function, a comment component for implementing a comment function, a bullet screen component for implementing a bullet screen function, a voting component for implementing a voting function, a sharing component for implementing a live room sharing function, and the like.
[0054] It should be noted that the components included in the second component subset are exemplary only, and should not be understood as limiting the second component subset to containing only the above components. In actual applications, the first component subset and the second component subset can be flexibly selected and configured according to actual needs, and are not fixed. For the same component, in some cases, the component can belong to the first component subset. In other cases, the component can also belong to the second component subset.
[0055] Regarding determination of whether to delay loading of the second component subset based on the reference information, the judgment process of the terminal device 120 can be different when the specific information content included in the reference information is different, and the judgment process is not described in detail here. The judgment process of whether to delay loading of the second component subset will be exemplarily explained in combination with FIG. 4 and FIG. 5, and specific reference can be made to the explanation of FIG. 4 and FIG. 5.
[0056] At block 230 of process 200, the terminal device 120 can update the live interface corresponding to the first live broadcast based on the second component subset after a predetermined time length of delay loading of the second component subset is reached, in response to determining that the second component subset is to be delay loaded.
[0057] Here, the determination that the second component subset is to be delay loaded can include delaying obtaining of the second component subset from the server 130 and delaying loading of the second component subset to the live interface corresponding to the first live broadcast. The terminal device 120 can also obtain the second component subset from the server 130 according to a predetermined time point (for example, a loading start time point). However, in the case of determining that the second component subset is to be delay loaded, it is determined whether a delay loading time length reaches a predetermined time length, and if the delay loading time length reaches the predetermined time length, the second component subset is loaded to the live interface corresponding to the first live broadcast.
[0058] There can be various ways to determine the delay loading duration. In some embodiments, the loading start time point and the predetermined duration can be preconfigured. The loading start time point can be the time point when the first live streaming interface is presented based on the first component subset, for example, the time point when the first component subset is loaded can be taken as the loading start time point. The loading start time point can also be after the time point when the first live streaming interface is presented based on the first component subset. The terminal device 120 can determine the delay loading duration of the second component subset relative to the loading start time point in response to determining that the second component subset is to be loaded with delay. That is, the delay time relative to the loading start time point. The terminal device 120 can also compare the loading start time point with the predetermined duration, and after determining that the delay loading duration reaches the predetermined duration, the terminal device can update the first live streaming interface corresponding to the first live streaming based on the second component subset.
[0059] In other embodiments, the terminal device 120 can also calculate the delay loading duration from the time point when the presentation request for the first live streaming is received, that is, the delay duration relative to the time point when the presentation request for the first live streaming is received. The terminal device 120 can also calculate the delay loading duration from the time point when the first component subset is loaded or other time points. The terminal device 120 can update the first live streaming interface corresponding to the first live streaming based on the second component subset in response to the delay loading duration reaching the predetermined duration.
[0060] In order to better understand the process of updating the first live streaming interface corresponding to the first live streaming based on the second component subset, reference will be made to FIG. 3B and FIG. 3C, and FIG. 3C shows a schematic diagram of an example 300C of a live streaming interface corresponding to the first live streaming according to some embodiments of the present disclosure. The live streaming interface 330 in the example 300B can be the live streaming interface corresponding to the first live streaming presented by the terminal device 120 based on the first component subset. The terminal device 120 can update the live streaming interface corresponding to the first live streaming based on the second component subset after determining that the delay loading duration reaches the predetermined duration, and the updated live streaming interface corresponding to the first live streaming can be shown as the live streaming interface 340 in the example 300C. Compared with the live streaming interface 330, the live streaming interface 340 presents components 341, 342, 343, 344, 345, 346 in the second component subset. The component 341 can be a comment component for implementing a comment function, the component 342 can be a product display component for implementing a product display function, the component 345 can be a sharing component for implementing a live streaming room sharing function, and the like.
[0061] It is also noted that the second subset of components is not limited to the components presented in the live interface 340, and can also include one or more components that have been loaded but not presented in the live interface 340. For example, the second subset of components can also include a mini-window component for implementing a mini-window function, which is typically presented after the main interface of the application is exited and the live interface continues to be presented through the mini-window component. Of course, the second subset of components can also include other components that are not presented in the live interface, and is not limited to the mini-window component, which is not listed here.
[0062] In some embodiments, if the delay loading duration of the second subset of components does not reach the predetermined duration, and a switching request from the first live broadcast to the third live broadcast is received, the terminal device 120 switches from the live interface of the first live broadcast presented based on the first subset of components to the live interface corresponding to the third live broadcast.
[0063] Exemplarily, as shown in FIGS. 3B-3D, FIG. 3D shows a schematic diagram of an example 300D of a live interface corresponding to the third live broadcast according to some embodiments of the present disclosure. The terminal device 120 can present the live interface 330 in the example 300B based on the first subset of components in response to a presentation request of the first live broadcast. If the terminal device 120 determines to delay load the second subset of components, the terminal device 120 can accumulate and calculate the delay loading duration from the loading start time point, and continuously determine whether the delay loading duration reaches the predetermined duration. If the delay loading duration has not reached the predetermined duration, the terminal device 120 receives a switching request from the first live broadcast to the third live broadcast. In this case, the terminal device 120 does not load the second subset of components and does not update the live interface corresponding to the first live broadcast based on the second subset of components, and the terminal device 120 does not present the live interface 340 in the example 300C. The terminal device 120 presents the live interface 350 corresponding to the third live broadcast in the example 300D in response to the switching request.
[0064] Here, the terminal device 120 not loading the second subset of components can include that the terminal device 120 does not receive the second subset of components from the server 130, or that the terminal device 120 receives the second subset of components from the server 130 at the predetermined time point, but the terminal device 120 does not load the second subset of components to the live interface corresponding to the first live broadcast, so that the live interface 340 in the example 300C is not presented. In this way, by omitting the loading of one or more components in the second subset of components, the load and energy consumption of the terminal device 120 can be reduced.
[0065] In some embodiments, the terminal device 120 can update the live interface corresponding to the first live based on the second component subset at the loading start time point in response to determining not to delay loading the second component subset. It can be understood that the visual effect of the terminal device 120 presenting the live interface corresponding to the first live can not be the same in the case of selecting different time nodes for the loading start time point.
[0066] Exemplarily, as shown in FIGS. 3A-3C, in one example, the time point at which the live interface of the first live is presented based on the first component subset can be selected as the loading start time point. At this time, the time difference between the terminal device 120 presenting the live interface corresponding to the first live based on the first component subset and updating the live interface corresponding to the first live based on the second component subset can be very short. The terminal device 120 switches from presenting the live interface 310 in the example 300A to presenting the live interface 330 in the example 300B in response to the switching request of switching from the second live to the first live. Then, the terminal device 120 quickly switches to presenting the live interface 340 in the example 300C. In the case that the loading operation of the second component subset is fast enough, the visual experience of the user 110 is closer to directly switching from the live interface 310 in the example 300A to the live interface 340 in the example 300C.
[0067] In another example, a time point after the time point at which the live interface of the first live is presented based on the first component subset can be determined as the loading start time point. If the time difference between the terminal device 120 presenting the live interface corresponding to the first live based on the first component subset and updating the live interface corresponding to the first live based on the second component subset can be relatively large. At this time, the user 110 can visually be able to clearly feel the switching process of the terminal device 120 from presenting the live interface 310 in the example 300A to presenting the live interface 330 in the example 300B, and then to presenting the live interface 340 in the example 300C.
[0068] In some embodiments, the terminal device 120 can present the live interface corresponding to the first live based on the first component subset and the second component subset in response to receiving the presentation request of the first live and determining not to delay loading the second component subset. Exemplarily, as shown in FIGS. 3A and 3C, in the case that the terminal device 120 presents the live interface 310 in the example 300A, the terminal device 120 can acquire the first component subset and the second component subset from the server 130 in response to the switching request of switching from the second live to the first live, and then present the live interface 340 in the example 300C based on the first component subset and the second component subset.
[0069] The determination process of block 220 in the foregoing process 200 that the terminal device 120 determines whether to delay load the second component subset based on the reference information will be exemplarily explained below in combination with FIG. 4 and FIG. 5.
[0070] FIG. 4 shows a flowchart of a process 400 for delay loading determination of the second component subset, according to some embodiments of the present disclosure. For ease of discussion, the process 400 will be described with reference to the environment 100 of FIG. 1.
[0071] At block 410, the terminal device 120 can determine a predicted viewing duration of the first live broadcast, which can be taken as the reference message by the terminal device 120.
[0072] The predicted viewing duration indicates a predicted value of a duration of viewing the live broadcast. The specific method of determining the predicted viewing duration will not be elaborated here, and those skilled in the art can freely select various methods known in the prior art or unknown to determine the predicted viewing duration. However, determining the predicted viewing duration of the first live broadcast by various known or unknown methods and achieving the improved solution of the embodiments of the present disclosure should be considered as falling within the protection scope of the improved solution of the embodiments of the present disclosure.
[0073] At block 420, the terminal device 120 can determine whether the predicted viewing duration exceeds a duration threshold. Alternatively or additionally, the duration threshold can be determined in advance based on data analysis. After determining the predicted viewing duration, the terminal device 120 can compare the determined predicted viewing duration with the duration threshold.
[0074] At block 430, if the terminal device 120 determines that the predicted viewing duration does not exceed the duration threshold, the terminal device 120 can determine to delay load the second component subset.
[0075] At block 440, if the terminal device 120 determines that the predicted value exceeds the duration threshold, the terminal device 120 determines not to delay load the second component subset.
[0076] In this way, when the predicted viewing duration of the first live broadcast by the predicted user is short, the components in the second component subset are selected to be delay loaded to reduce the load and energy consumption of the terminal device 120. When the predicted viewing duration of the first live broadcast by the predicted user is long, the components in the second component subset are selected not to be delay loaded to improve the live broadcast service capability.
[0077] FIG. 5 shows a flowchart of a process 500 for delay loading determination of the second component subset, according to some embodiments of the present disclosure. For ease of discussion, the process 500 will be described with reference to the environment 100 of FIG. 1.
[0078] At block 510, the terminal device 120 determines a performance value in the live browsing process. The terminal device 120 can determine the performance value in the live browsing process as a reference message.
[0079] The performance value herein can be used to indicate the data processing performance, power consumption performance, or somatosensory performance of the terminal device 120 in the live browsing process, and the like. The performance value herein can also be used to indicate the comprehensive performance of the terminal device 120 in the live browsing process, for example, the performance value can be a comprehensive performance value determined based on multiple dimension performances such as processing performance, power consumption performance, somatosensory performance, and the like.
[0080] In some embodiments, the performance value can be determined based on multiple performance indicators of the terminal device 120 in the live browsing process. The terminal device 120 can determine the performance value by determining the indicator value and weight of each of the multiple performance indicators in the live browsing process, and determining the performance value of the terminal device 120 based on the indicator value and weight of each of the multiple performance indicators.
[0081] The multiple performance indicators herein can include performance indicators capable of indicating the data processing performance, power consumption performance, somatosensory performance, and the like of the terminal device in the live browsing process. The indicators indicating the data processing performance herein can include, for example, performance indicators capable of indicating the performance of a processor (such as a central processing unit, a graphics processing unit, a tensor processing unit, a neural network processing unit, and the like), performance indicators indicating the disk read-write capability, performance indicators indicating the network communication capability, and the like. The indicators of the power consumption performance herein can include, but are not limited to, thermal design power (TDP), average power consumption, peak power consumption, dynamic power consumption, and the like. The indicators of the somatosensory performance herein can include, but are not limited to, frame rate (FPS), somatosensory temperature, and the like.
[0082] Alternatively or additionally, the terminal device can determine the indicator value and / or weight of each of the multiple performance indicators based on the degree of association between each of the multiple performance indicators and the target live interaction operation. The target live interaction operation herein can include, but is not limited to, liking, adding a product to a shopping cart, following a host, commenting, sending a barrage, voting, sharing, and the like. The degree of association between each of the performance indicators of the terminal device and the target live interaction operation can be statistically determined in advance.
[0083] For example, the association relationship between the performance indicators indicating the performance of the processor, the performance indicators of the power consumption performance, the frame rate, the somatosensory temperature, and the like, and the browsing time can be statistically determined, and a function for calculating the indicator value of each performance indicator can be constructed based on the association relationship. The following shows an exemplary multi-segment function calculation formula for calculating the indicator value.
[0084] wherein s i(x) represents the index value of the i-th performance indicator; b represents the base value of the index value; x represents the i-th performance indicator; p m represents the value of x corresponding to the m-th sub-function; p m-1 represents the value of x corresponding to the m-th sub-function; f m represents the corresponding rule of the m-th sub-function; p n-1 represents the value of x corresponding to the m-th sub-function; f n and f n-1 respectively represent the corresponding rule of the n-th sub-function and the n-1-th sub-function.
[0085] It can be understood that the above calculation formula is only exemplary, and in actual application, the calculation function of the index value of each performance indicator can be selected and configured according to actual data statistical results and requirements, and the calculation function of the index value of each performance indicator can be different.
[0086] Alternatively or additionally, in the case of determining the index value and weight of each performance indicator, the terminal device 120 can determine the performance value of the terminal device 120 based on the index value and weight of each performance indicator. An exemplary calculation formula for calculating the performance value of the terminal device 120 is shown below.
[0087] wherein S T represents the performance value of the terminal device; ω i represents the weight of the i-th performance indicator; s i (x) represents the index value of the i-th performance indicator.
[0088] It can be understood that the above calculation method of the performance value is only exemplary. In actual application, the calculation method of the performance value can be selected and configured according to actual data analysis results and actual requirements.
[0089] It should be further noted that the terminal device 120 can determine the performance value of the terminal device 120 itself in response to receiving the presentation request for the first live broadcast. The terminal device 120 can also determine the performance value of the terminal device 120 itself periodically or in advance. For example, the terminal device 120 can determine the performance value of the terminal device 120 itself periodically in response to the running of the application providing the live broadcast. Then, the terminal device can acquire the performance value calculated last time in response to receiving the presentation request for the first live broadcast. On this basis, the terminal device 120 determining the performance value can include calculating the performance value in real time, or can include acquiring the performance value calculated last time.
[0090] In block 520, the terminal device 120 can determine whether the performance value exceeds the performance threshold.
[0091] Alternatively or additionally, on the basis of the calculation method of the performance value, a performance threshold corresponding to the calculation method of the performance value can be preset. When the terminal device 120 determines the performance value, the terminal device 120 can compare the performance value with the performance threshold to determine whether the performance value exceeds the performance threshold.
[0092] At block 530, if the terminal device 120 determines that the performance value does not exceed the performance threshold, the terminal device 120 can determine to delay loading the second subset of components.
[0093] At block 540, if the performance value exceeds the performance threshold, it can be determined that the second subset of components is not to be delayed.
[0094] In this way, when the performance of the terminal device 120 is relatively poor during live browsing, the second subset of components can be selected to be delayed, thereby reducing the load of the terminal device 120, maintaining the smooth operation of the terminal device 120, and avoiding phenomena such as freezing or overheating that affect the user's intuitive experience. When the performance of the terminal device 120 is relatively good during live browsing, the second subset of components can be selected not to be delayed, thereby improving the live service capability.
[0095] It should be understood that the determination process of whether to delay loading the second subset of components is only exemplary, and in specific implementation, the determination process of delaying loading of the second subset of components can be selected according to actual needs.
[0096] In summary, according to the embodiments of the present disclosure, during live viewing by a user, the live interface can be selectively loaded in part, which is beneficial to reduce the load and energy consumption of the terminal device.
[0097] FIG. 6 shows a schematic structural block diagram of an apparatus for live interface processing according to some embodiments of the present disclosure. The apparatus 600 can be implemented as or included in the terminal device 120 of a live viewing audience. Various modules / components in the apparatus 600 can be implemented by hardware, software, firmware, or any combination thereof.
[0098] As shown in FIG. 6, the apparatus 600 includes a presentation module 610, a determination module 620, and an update module 630. The presentation module 610 is configured to present a live interface corresponding to a first live in response to the terminal device receiving a presentation request for the first live, based on at least a first subset of components in a plurality of components corresponding to the first live, the first subset of components including at least one component in the plurality of components. The determination module 620 is configured to determine whether to delay loading a second subset of components in the plurality of components based on reference information associated with live browsing at the terminal device. The update module 630 is configured to update the live interface corresponding to the first live based on the second subset of components after a delay loading time length of the second subset of components reaches a predetermined time length in response to determining to delay loading the second subset of components.
[0099] In some embodiments, the reference information comprises a predicted browsing duration of the first live broadcast at the terminal device, the determining module 620 is further configured to: if the predicted browsing duration does not exceed a duration threshold, determine to delay loading the second component subset; and if the predicted value exceeds the duration threshold, determine not to delay loading the second component subset.
[0100] In some embodiments, the reference information comprises a performance value of the terminal device in the live broadcast browsing process, the determining module 620 is further configured to: if the performance value does not exceed a performance threshold, determine to delay loading the second component subset; and if the performance value exceeds the performance threshold, determine not to delay loading the second component subset.
[0101] In some embodiments, the performance value is determined based on a plurality of performance indicators of the terminal device in the live broadcast browsing process, and the apparatus 600 can further comprise a performance value determining module configured to determine the performance value by: determining an indicator value and a weight of each of the plurality of performance indicators in the live broadcast browsing process; and determining the performance value of the terminal device based on the indicator value and the weight of each of the plurality of performance indicators.
[0102] In some embodiments, the performance value determining module is further configured to: determine the indicator value and / or the weight of each of the plurality of performance indicators based on a degree of association between each of the plurality of performance indicators and the target live broadcast interactive operation.
[0103] In some embodiments, the presenting module 610 is further configured to: in response to the terminal device receiving a switching request to switch from the second live broadcast to the first live broadcast, present a live broadcast interface corresponding to the first live broadcast based on the first component subset.
[0104] In some embodiments, the updating module 630 is further configured to: in response to determining to delay loading the second component subset, determine a delay loading duration of the second component subset relative to a loading start time point; and after the delay loading duration reaches a predetermined duration, update the live broadcast interface corresponding to the first live broadcast based on the second component subset, wherein the loading start time point is a time point at which the live broadcast interface of the first live broadcast is presented based on the first component subset, or the loading start time point is after the time point at which the live broadcast interface of the first live broadcast is presented based on the first component subset.
[0105] In some embodiments, the updating module 630 is further configured to: in response to determining not to delay loading the second component subset, update the live broadcast interface corresponding to the first live broadcast based on the second component subset at the loading start time point.
[0106] In some embodiments, the presentation module 610 is further configured to present the live interface corresponding to the first live broadcast based on the first subset of components and the second subset of components in response to the terminal device receiving the presentation request for the first live broadcast and determining not to lazy load the second subset of components.
[0107] In some embodiments, the presentation module 610 is further configured to, if the time delay loading duration of the second subset of components does not reach the predetermined duration, and receiving a switching request from the first live broadcast to the third live broadcast, switch from the live interface presented based on the first subset of components of the first live broadcast to the live interface corresponding to the third live broadcast.
[0108] The units and / or modules included in the apparatus 600 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units and / or modules can be implemented using software and / or firmware, e.g., machine-executable instructions stored on a storage medium. In addition to or alternatively, some or all of the units and / or modules in the apparatus 600 can be implemented at least partially by one or more hardware logic components. As an example and not by way of limitation, example types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SOCs), complex programmable logic devices (CPLDs), etc.
[0109] FIG. 7 shows a block diagram of an electronic device 700 in which one or more embodiments of the present disclosure can be implemented. It should be understood that the electronic device 700 illustrated in FIG. 7 is merely an example and should not be construed as limiting on the functionality and scope of the embodiments described herein. The terminal device 120 of FIG. 1 or the apparatus 600 of FIG. 6 can be implemented as or included in one or more electronic devices 700.
[0110] As shown in FIG. 7, the electronic device 700 is in the form of a general computing device. Components of the electronic device 700 can include, but are not limited to, one or more processors 710, memory 720, storage 730, one or more communication units 740, one or more input devices 750, and one or more output devices 760. The processor 710 can be a real or virtual processor and is capable of performing various processing according to programs stored in the memory 720. In a multi-processor system, multiple processors perform computer-executable instructions in parallel to improve the parallel processing capability of the electronic device 700.
[0111] The electronic device 700 typically includes a plurality of computer storage media. Such media can be volatile and / or nonvolatile, removable and / or non-removable, and can be implemented in any method or technology for storage of information and / or data. For example, memory 720 can be implemented using a volatile and / or nonvolatile memory such as random access memory (RAM), cache memory, and / or flash memory. Storage 730 can be implemented using a non-transitory computer-readable medium, such as a solid state memory or a magnetic hard disk, to name a few. The computer-readable medium can be used to store data and / or instructions for use by and / or in connection with one or more computer programs and / or devices. For example, the computer-readable medium can be used for storing training data for training, and / or instructions for implementing the various embodiments of the present disclosure.
[0112] The electronic device 700 can further include additional removable / non-removable, volatile / nonvolatile computer storage media. Although not shown in FIG. 7, a disk drive can be provided for reading from and writing to a removable, non-removable, volatile, and / or non-volatile memory (e.g., a "floppy disk", a "flexible disk", a "hard disk", a "solid state drive", a "flash drive", a "USB flash drive", a "memory stick", a "read only memory" (ROM), an "electrically erasable programmable read only memory" (EEPROM), and / or a "Compact Disk Read Only Memory" (CD-ROM)). In these instances, each drive can be connected to the bus by one or more data media interfaces. The memory 720 can include a computer program product 725 having one or more program modules configured to carry out the various methods or actions of the various embodiments of the present disclosure.
[0113] The communication unit 740 enables communication with other electronic devices over a communication medium. Additionally, the functionality of the components of the electronic device 700 can be implemented in a single computing cluster or a plurality of computer machines that are capable of communicating with one another over a communication connection. As such, the electronic device 700 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network nodes.
[0114] The input device 750 can be one or more input devices such as a mouse, a keyboard, a trackball, etc. The output device 760 can be one or more output devices such as a display, a speaker, a printer, etc. The electronic device 700 can further communicate with one or more external devices (not shown) such as a storage device, a display device, etc. through the communication unit 740, with one or more devices that enable a user to interact with the electronic device 700, or with any devices (e.g., a network card, a modem, etc.) that enable the electronic device 700 to communicate with one or more other electronic devices. Such communication can be enabled by an input / output (I / O) interface (not shown).
[0115] According to an example implementation of the present disclosure, a computer readable storage medium is provided having computer executable instructions stored thereon, where the computer executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, a computer program product is also provided that is tangibly stored on a non-transitory computer readable medium and includes computer executable instructions, where the computer executable instructions are executed by a processor to implement the method described above.
[0116] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.
[0117] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.
[0118] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.
[0119] The computer program product of the present disclosure can have a signal including said computer program. This signal can be electronic, electromagnetic, optical, or any other suitable type of signal. Such a signal can be provided through a communication connection, such as electrical wiring, optical fiber, wireless interface, etc. Examples of computer program products include computer program implemented on a personal computer, server, or other networked device. A non-transitory computer readable medium, such as a floppy disk, CD-ROM, DVD-ROM, Blu-ray Disc, hard disk, or memory stick, can also be used to implement the present disclosure. The computer program product of the present disclosure can also be provided as a service to download and use the computer program over a network, such as the Internet.
[0120] The implementations of the disclosure have been described above with the intent to be illustrative rather than limiting. Although the implementations of the disclosure have been described with regard to one or more implementations, it will be recognized that a variety of modifications and changes can be made to these implementations without departing from the broader spirit and scope of the implementations as set forth in the preceding disclosure. For example, certain aspects of the implementations can be implemented in hardware, software, or firmware, or any combination thereof. The preceding description is intended to be illustrative, and not limiting, of the disclosure. It is recognized that modifications and variations of the implementations disclosed herein will occur to those skilled in the art. It is therefore intended that the disclosed implementations be considered in all respects as illustrative only and not restrictive.
Claims
1. A method for live interface processing, comprising: in response to a terminal device receiving a presentation request for a first live, presenting a live interface corresponding to the first live based on at least a first subset of components of a plurality of components corresponding to the first live, the first subset of components comprising at least one component of the plurality of components; determining whether to lazy load a second subset of components of the plurality of components based on reference information associated with live browsing at the terminal device; and in response to determining to lazy load the second subset of components, updating the live interface corresponding to the first live based on the second subset of components after a lazy loading duration of the second subset of components reaches a predetermined duration. 2.The method of claim 1, wherein the reference information comprises a predicted browsing duration of the first live at the terminal device, and wherein determining whether to lazy load the second subset of components comprises: if the predicted browsing duration does not exceed a duration threshold, determining to lazy load the second subset of components; and if the predicted value exceeds the duration threshold, determining not to lazy load the second subset of components. 3.The method of claim 1, wherein the reference information comprises a performance value of the terminal device during live browsing, and determining whether to lazy load the second subset of components comprises: if the performance value does not exceed a performance threshold, determining to lazy load the second subset of components; and if the performance value exceeds the performance threshold, determining not to lazy load the second subset of components. Determining the performance value comprises: determining respective indicator values and weights of a plurality of performance indicators during the live browsing; and determining the performance value of the terminal device based on the respective indicator values and the weights of the plurality of performance indicators.
4. The method of claim 3, wherein the performance value is determined based on a plurality of performance indicators of the terminal device during the live browsing process, and the method further comprises: 5.The method of claim 4, wherein determining the indicator values and the weights of the plurality of performance indicators comprises: determining respective indicator values and / or the weights of the plurality of performance indicators based on degrees of association between respective performance indicators of the plurality of performance indicators and target live interaction operations. 6.The method of claim 1, wherein presenting the live interface corresponding to the first live comprises: in response to the terminal device receiving a switching request to switch from a second live to the first live, presenting the live interface corresponding to the first live based on the first subset of components. 7.The method of claim 1, wherein updating the live interface corresponding to the first live based on the second subset of components comprises: in response to determining to lazy load the second subset of components, determining a lazy loading duration of the second subset of components relative to a loading start time point; and after the lazy loading duration reaches the predetermined duration, updating the live interface corresponding to the first live based on the second subset of components. wherein the loading start time point is a time point at which the first live interface corresponding to the first live broadcast is presented based on the first component subset, or the loading start time point is after the time point at which the first live interface corresponding to the first live broadcast is presented based on the first component subset.
8. The method of claim 7, further comprising: updating, in response to determining not to delay loading the second component subset, the first live interface corresponding to the first live broadcast based on the second component subset at the loading start time point.
9. The method of claim 1, further comprising: presenting, in response to the terminal device receiving the presentation request for the first live broadcast and determining not to delay loading the second component subset, a live interface corresponding to the first live broadcast based on the first component subset and the second component subset.
10. The method of claim 1, further comprising: if the predetermined time length has not been reached for the time length of the delayed loading of the second component subset, and a switching request from the first live broadcast to a third live broadcast is received, switching from the live interface corresponding to the first live broadcast presented based on the first component subset to a live interface corresponding to the third live broadcast.
11. An apparatus for live interface processing, comprising: a presentation module configured to present, in response to a terminal device receiving a presentation request for a first live broadcast, a live interface corresponding to the first live broadcast based on at least a first component subset of a plurality of components corresponding to the first live broadcast, the first component subset including at least one component of the plurality of components; a determination module configured to determine, based on reference information associated with live browsing at the terminal device, whether to delay loading a second component subset of the plurality of components; and an update module configured to update, in response to determining to delay loading the second component subset, the live interface corresponding to the first live broadcast based on the second component subset after a predetermined time length has been reached for a time length of the delayed loading of the second component subset.
12. An electronic device, comprising: at least one processor; and at least one memory that is coupled to the at least one processor and stores instructions for execution by the at least one processor, the instructions, when executed by the at least one processor, cause the device to perform the method of any one of claims 1-10.
13. A computer-readable storage medium having computer-executable instructions stored therein, the computer-executable instructions, when executed by a processor, implement the method of any one of claims 1-10.
14. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method of any one of claims 1-10.
Citation Information
Patent Citations
Resource loading method and device, electronic equipment and computer storage medium
CN114661370A
Interface interaction method and device, equipment and storage medium
CN116366907A
Publishing a disparate live media output stream that complies with distribution format regulations
US20200204849A1