Multimedia resource display method, device, equipment and storage medium

Abstract

This disclosure relates to a method, apparatus, device, and storage medium for displaying multimedia resources. The method includes: upon receiving a target multimedia resource message, displaying an auxiliary display interface, the auxiliary display interface being independent of a main interface, the auxiliary display interface displaying items including descriptive information of the target multimedia resource, a first type of interactive operation control indicating playback control, and / or a second type of interactive operation control indicating interactive feedback; upon responding to a trigger operation on the first type of interactive operation control, acquiring playback data of the target multimedia resource, and playing the target multimedia resource on the auxiliary display interface based on the playback data; and / or, upon responding to a trigger operation on the second type of interactive operation control, displaying interactive feedback information associated with the second type of interactive operation control on the auxiliary display interface. This disclosure enables playback of multimedia resources and / or user interactive feedback on the auxiliary display interface, improving operational convenience.

Description

Technical Field

[0001] This disclosure relates to computer technology, and more particularly to a method, apparatus, device, and storage medium for displaying multimedia resources. Background Technology

[0002] With the development of internet technology, various applications (APPs) can provide users with various media resources, such as videos (including short videos), audio, images, and text. With the widespread use of mobile devices, viewing short videos and other media resources on mobile devices has become a part of people's daily lives. Applications can proactively push relevant media resource messages to users. However, in related technologies, the pushed messages often focus on the title and description of the relevant media resource. Users need to click on the corresponding control to enter the display page of the relevant media resource within the application and then view its specific content. The above-mentioned solutions suffer from problems such as limited content displayed in the pushed messages, inability to accurately and effectively reflect the relevant media resource, or complex and inefficient operations related to the relevant media resource. Summary of the Invention

[0003] This disclosure provides a method, apparatus, device, and storage medium for displaying multimedia resources, at least addressing the problems in related technologies where the content displayed in push messages is relatively simple, failing to accurately and effectively reflect the relevant media resources, or where viewing the relevant media resources is complex and inefficient. The technical solution of this disclosure is as follows:

[0004] According to a first aspect of the present disclosure, a method for displaying multimedia resources is provided, the method comprising:

[0005] Upon receiving a target multimedia resource message, an auxiliary display interface is displayed. The auxiliary display interface is independent of the main interface. The items displayed on the auxiliary display interface include description information of the target multimedia resource, a first type of interactive operation control indicating playback control, and / or a second type of interactive operation control indicating interactive feedback.

[0006] When a trigger operation is performed on the first type of interactive control, playback data of the target multimedia resource is acquired, and the target multimedia resource is played on the auxiliary display interface based on the playback data; and / or, when a trigger operation is performed on the second type of interactive control, interactive feedback information associated with the second type of interactive control is displayed on the auxiliary display interface.

[0007] In one exemplary embodiment, before displaying the auxiliary display interface upon receiving the target multimedia resource message, the method further includes:

[0008] A first preset surface view control is determined, wherein the first preset surface view control has a first object embedded in it for caching relevant playback data; and a first type of interactive operation control is created based on the first preset surface view control.

[0009] A second preset surface view control is determined, wherein the second preset surface view control has a second object embedded in it for caching relevant interactive feedback information; and a second type of interactive operation control is created based on the second preset surface view control.

[0010] In one exemplary embodiment, after displaying the auxiliary display interface, the method further includes:

[0011] Check if preset audio and video playback permissions are enabled;

[0012] If the preset audio and video playback permission is detected to be enabled, the playback data of the target multimedia resource is obtained;

[0013] The target multimedia resource is played based on the playback data.

[0014] In one exemplary implementation, the step of obtaining playback data of the target multimedia resource when the preset audio / video playback permission is detected to be enabled includes:

[0015] If the preset audio and video playback permission is detected to be enabled, the system will detect whether there are any connected audio and video playback peripherals.

[0016] If the presence of the audio / video playback peripheral is detected, the playback data of the target multimedia resource is acquired;

[0017] Playing the target multimedia resource based on the playback data includes:

[0018] The playback data is sent to the audio / video playback peripheral device so that the audio / video playback peripheral device plays the target multimedia resource based on the playback data.

[0019] In one exemplary implementation, playing the target multimedia resource on the auxiliary display interface based on the playback data includes:

[0020] Reduce the display area of ​​the auxiliary display interface relative to the main interface;

[0021] Based on the playback data, the target multimedia resource is played on the auxiliary display interface with a reduced display area.

[0022] In one exemplary embodiment, after acquiring the playback data of the target multimedia resource in response to a trigger operation on the first type of interactive control, the method further includes:

[0023] Call the playback data display interface associated with the auxiliary display interface. The playback data display interface is less dependent on the operating environment than the auxiliary display interface.

[0024] Based on the playback data, the target multimedia resource is played on the playback data display interface.

[0025] In an exemplary embodiment, when the number of target multimedia resource messages is at least two, each target multimedia resource message is displayed on the auxiliary display interface in the form of a card component. Each card component includes a description of the corresponding target multimedia resource and a first type of interactive control indicating playback control. After displaying the auxiliary display interface, the method further includes:

[0026] In response to a swipe operation on the card component list, the target multimedia resource message displayed in the auxiliary display interface is switched;

[0027] The card component list is obtained by arranging the card components corresponding to each target multimedia resource message, and the sliding direction of the sliding operation is the same as the arrangement direction of each card component.

[0028] In one exemplary embodiment, the auxiliary display interface further includes a third type of interactive control indicating an appointment reminder. After displaying the auxiliary display interface, the method further includes:

[0029] In response to the triggering operation of the third type of interactive operation control that indicates the reservation reminder, a time selection interface for making a reservation reminder for the live broadcast corresponding to the target multimedia resource is presented;

[0030] In response to a selection operation triggered based on the time selection interface, the selected time is used as the target time;

[0031] Receive a reminder notification for the live stream at the target time.

[0032] In one exemplary embodiment, before displaying the auxiliary display interface, the method further includes:

[0033] Identify unplayed candidate multimedia resources from the local cache;

[0034] Based on the multimedia resource preference information of the target object, the target multimedia resource is determined from the candidate multimedia resources;

[0035] The target multimedia resource message is generated using the information corresponding to the target multimedia resource.

[0036] In one exemplary embodiment, before displaying the auxiliary display interface, the method further includes:

[0037] Receive the target multimedia resource message sent by the server;

[0038] The target multimedia resource message is selected and sent by the server based on the identification information of the target object.

[0039] In one exemplary embodiment, the display auxiliary interface includes:

[0040] The first area of ​​the auxiliary display interface displays a cover image indicating the target multimedia resource, the cover image being either a static image or a dynamic image;

[0041] The second area of ​​the auxiliary display interface displays a first type of interactive operation control that indicates playback control, and allows adjustment of the display transparency of the first type of interactive operation control;

[0042] When the adjusted display transparency meets the preset transparency threshold, the first region and the second region at least partially overlap.

[0043] According to a second aspect of the present disclosure, a multimedia resource display device is provided, the device comprising:

[0044] The display unit is configured to display an auxiliary display interface when a target multimedia resource message is received. The auxiliary display interface is independent of the main interface. The display items of the auxiliary display interface include description information of the target multimedia resource, a first type of interactive operation control indicating playback control, and / or a second type of interactive operation control indicating interactive feedback.

[0045] The triggering unit is configured to, when responding to a triggering operation on the first type of interactive control, acquire playback data of the target multimedia resource and play the target multimedia resource on the auxiliary display interface based on the playback data; and / or, when responding to a triggering operation on the second type of interactive control, display interactive feedback information associated with the second type of interactive control on the auxiliary display interface.

[0046] In one exemplary embodiment, the apparatus further includes:

[0047] The first type of interactive operation control creation unit is configured to determine a first preset surface view control, wherein the first preset surface view control has a first object embedded in it for caching relevant playback data; and to create the first type of interactive operation control based on the first preset surface view control.

[0048] The second type of interactive operation control creation unit is configured to determine a second preset surface view control, wherein the second preset surface view control has a second object embedded in it for caching relevant interactive feedback information; and to create the second type of interactive operation control based on the second preset surface view control.

[0049] In one exemplary embodiment, the apparatus further includes:

[0050] The permission detection unit is configured to detect whether preset audio and video playback permissions are enabled.

[0051] The playback data acquisition unit is configured to acquire the playback data of the target multimedia resource when the preset audio and video playback permission is detected to be enabled.

[0052] The first resource playback unit is configured to play the target multimedia resource based on the playback data.

[0053] In one exemplary embodiment, the playback data acquisition unit includes: a peripheral device detection unit configured to detect whether there is a connected audio / video playback peripheral device when the preset audio / video playback permission is enabled; and a playback data acquisition subunit configured to acquire playback data of the target multimedia resource when the audio / video playback peripheral device is detected to exist.

[0054] The first resource playback unit includes a resource playback subunit configured to send the playback data to the audio / video playback peripheral device, so that the audio / video playback peripheral device plays the target multimedia resource based on the playback data.

[0055] In one exemplary embodiment, the triggering unit includes:

[0056] The shrinking unit is configured to shrink the display area of ​​the auxiliary display interface relative to the main interface;

[0057] The playback subunit is configured to play the target multimedia resource on the auxiliary display interface with a reduced display area, based on the playback data.

[0058] In one exemplary embodiment, the apparatus further includes:

[0059] The calling unit is configured to execute a call to the playback data display interface associated with the auxiliary display interface, wherein the playback data display interface has a lower dependence on the runtime environment than the auxiliary display interface.

[0060] The second resource playback unit is configured to play the target multimedia resource on the playback data display interface based on the playback data.

[0061] In one exemplary embodiment, when the number of target multimedia resource messages is at least two, each target multimedia resource message is displayed on the auxiliary display interface in the form of a card component. Each card component includes a description of the corresponding target multimedia resource and a first type of interactive control indicating playback control. The device further includes:

[0062] The switching unit is configured to switch the target multimedia resource message displayed in the auxiliary display interface in response to a swipe operation on the card component list;

[0063] The card component list is obtained by arranging the card components corresponding to each target multimedia resource message, and the sliding direction of the sliding operation is the same as the arrangement direction of each card component.

[0064] In one exemplary embodiment, the apparatus further includes:

[0065] The presentation unit is configured to perform a trigger operation in response to the third type of interactive operation control that indicates the reservation reminder, and present a time selection interface for making a reservation reminder for the live broadcast corresponding to the target multimedia resource;

[0066] The selection unit is configured to perform a selection operation triggered based on the time selection interface, and to use the selected time as the target time.

[0067] The notification unit is configured to receive a reminder notification for the live stream at the target time.

[0068] In one exemplary embodiment, the apparatus further includes:

[0069] The candidate multimedia resource determination unit is configured to determine unplayed candidate multimedia resources from the local cache;

[0070] The target multimedia resource determination unit is configured to determine the target multimedia resource from the candidate multimedia resources based on the multimedia resource preference information of the target object;

[0071] The message generation unit is configured to generate a target multimedia resource message using information corresponding to the target multimedia resource.

[0072] In one exemplary embodiment, the apparatus further includes:

[0073] The message receiving unit is configured to receive the target multimedia resource message sent by the server;

[0074] The target multimedia resource message is selected and sent by the server based on the identification information of the target object.

[0075] In one exemplary embodiment, the display unit includes:

[0076] The first area display unit is configured to perform a first area display of a cover image indicating the target multimedia resource on the auxiliary display interface, wherein the cover image is one of a static image and a dynamic image.

[0077] The second area display unit is configured to execute a first type of interactive operation control for the second area display instruction playback control on the auxiliary display interface, and to adjust the display transparency of the first type of interactive operation control;

[0078] The overlapping unit is configured to perform an operation whereby the first region and the second region at least partially overlap when the adjusted display transparency meets a preset transparency threshold.

[0079] According to a third aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute the instructions to implement the multimedia resource display method as described in the first aspect.

[0080] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein when instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the multimedia resource display method as described in the first aspect.

[0081] According to a fifth aspect of the present disclosure, a computer program product is provided, including a computer program / instructions, characterized in that, when the computer program / instructions are executed by a processor, they implement the multimedia resource display method described in the first aspect.

[0082] The technical solutions provided by the embodiments of this disclosure have at least the following beneficial effects:

[0083] Upon receiving a target multimedia resource message, an auxiliary display interface is displayed. Then, in response to the triggering of interactive controls on the auxiliary display interface instructing playback control, playback data of the target multimedia resource is acquired. Based on this playback data, the target multimedia resource is played on the auxiliary display interface. And / or, in response to the triggering of interactive controls on the auxiliary display interface instructing interactive feedback, related interactive feedback information is displayed on the auxiliary display interface. The auxiliary display interface is independent of the main interface and also includes descriptive information about the target multimedia resource. This technical solution enables playback of multimedia resources and / or user interactive feedback on the auxiliary display interface, greatly improving the ease of operation for the multimedia resource and helping users quickly understand it. This allows users to promptly view multimedia resources of interest, provide interactive feedback on them, thereby improving the effectiveness of multimedia resource display and increasing user engagement with the relevant multimedia resource applications.

[0084] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0085] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure, and are not intended to unduly limit this disclosure.

[0086] Figure 1 This is an architecture diagram of a system for displaying multimedia resources according to an exemplary embodiment.

[0087] Figure 2 This is a flowchart illustrating a method for displaying multimedia resources according to an exemplary embodiment.

[0088] Figure 3 This is a flowchart illustrating a multimedia resource playback according to an exemplary embodiment.

[0089] Figure 4 This is a flowchart illustrating a reservation reminder for a multimedia resource message according to an exemplary embodiment.

[0090] Figure 5 This is also a flowchart illustrating a multimedia resource playback according to an exemplary embodiment.

[0091] Figure 6-9 This is a schematic diagram of an auxiliary display interface according to an exemplary embodiment.

[0092] Figure 10This is a block diagram illustrating a multimedia resource display device according to an exemplary embodiment.

[0093] Figure 11 This is a block diagram illustrating an electronic device according to an exemplary embodiment. Detailed Implementation

[0094] To enable those skilled in the art to better understand the technical solutions of this disclosure, the technical solutions in the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings.

[0095] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0096] Figure 1 This is an architecture diagram of a system for displaying multimedia resources according to an exemplary embodiment. See also: Figure 1 The architecture diagram may include client 10 and server 20.

[0097] The client 10 can be, but is not limited to, one or more physical devices such as smartphones, tablets, laptops, desktop computers, smart speakers, smart wearable devices, digital assistants, augmented reality devices, and virtual reality devices, or applications running on physical devices. The client 10 can be equipped with an operating system that supports running multimedia resource applications.

[0098] Server 20 can provide client 10 with corresponding background services such as playback data based on the user's current trigger operation, so that client 10 can obtain and display the playback data; and / or, server 20 can provide client 10 with corresponding background services such as interactive feedback information based on the user's current trigger operation, so that client 10 can obtain and display the interactive feedback information. As an example only, server 20 can be, but is not limited to, a standalone server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, and big data and artificial intelligence platforms, etc. The client 10 and server 20 can be directly or indirectly connected via wired or wireless communication, and this embodiment of the disclosure is not limited thereto.

[0099] The multimedia resource display method provided in this disclosure can be executed by a multimedia resource display device. The multimedia resource display device can be integrated into an electronic device such as a terminal in hardware or software form, or it can be executed by the terminal alone, or it can be executed collaboratively by the terminal and the server.

[0100] Figure 2 This is a flowchart illustrating a method for displaying multimedia resources according to an exemplary embodiment, such as... Figure 2 As shown, the method for displaying multimedia resources can be applied to electronic devices. Taking the electronic device as the client in the above implementation environment diagram as an example, the method includes the following steps.

[0101] In step S201, upon receiving a target multimedia resource message, an auxiliary display interface is displayed. The auxiliary display interface is independent of the main interface. The items displayed on the auxiliary display interface include description information of the target multimedia resource, a first type of interactive operation control indicating playback control, and / or a second type of interactive operation control indicating interactive feedback.

[0102] In the embodiments of this specification, the target multimedia resource message can be a notification to push the target multimedia resource. Multimedia resources can include, but are not limited to, short videos, long videos, live videos, animations, and images / text. The auxiliary display interface differs from the main (screen) interface of the physical device or the main interface of the application. The auxiliary display interface is independent of the main interface and can serve as the interface style for presenting the target multimedia resource message, such as a notification bar, pop-up window, or floating window. The interface style adopted by the auxiliary display interface can be set differently according to the current usage of the application. For example, when the application is in the background, the interface style adopted by the auxiliary display interface can be a notification bar (which can be selected from...). Figure 6When the application is in use, the auxiliary display interface can use a pop-up window (see reference). Figure 9 The descriptive information of the target multimedia resource displayed on the auxiliary display interface may include, but is not limited to, at least one of the following: the publisher's nickname, the publisher's avatar, the title of the target multimedia resource, the description of the target multimedia resource, the tags of the target multimedia resource, the cover image of the target multimedia resource, and user feedback statistics of the target multimedia resource (such as the number of likes, comments, and shares). The first type of interactive operation control displayed on the auxiliary display interface, indicating playback control, can realize playback control of the target multimedia resource (such as start playback, pause playback). The second type of interactive operation control displayed on the auxiliary display interface, indicating interactive feedback, can realize user interactive feedback regarding the target multimedia resource. For example, it can output likes, comments, reposts, favorites, and reports for the target multimedia resource, and view likes, comments, reposts, favorites, and reports for the target multimedia resource.

[0103] In practical applications, multimedia resources can be works published on application platforms by professional users, ordinary users, etc. The target multimedia resource is a multimedia resource that needs to be recommended to the target audience (registered users or guest users). The target audience can view the description information of the target multimedia resource, interactive operation controls that indicate playback control, and / or interactive operation controls that indicate interactive feedback on the auxiliary display interface through the client. Then, the playback of the target multimedia resource and / or user interactive feedback can be realized through the interactive operation controls.

[0104] In one exemplary embodiment, before displaying the auxiliary display interface, the method further includes generating or receiving a target multimedia resource message. The processes of generating and receiving the target multimedia resource message will be described below.

[0105] 1) The process of generating a target multimedia resource message includes the following steps: First, unplayed candidate multimedia resources are identified from the local cache; then, the target multimedia resource is identified from the candidate multimedia resources based on the target object's multimedia resource preference information; and finally, the target multimedia resource message is generated using the information corresponding to the target multimedia resource.

[0106] Clients typically pre-load a certain number of multimedia resources into the local cache of the physical device to quickly respond to multimedia resource display requests. A recommendation strategy can be used to determine the target multimedia resource from the local cache, and then a target multimedia resource message can be generated. First, played multimedia resources in the local cache can be excluded, and unplayed multimedia resources can be used as candidate multimedia resources. Then, based on the target audience's multimedia resource preference information, the target multimedia resource is determined from the candidate multimedia resources. Finally, the information corresponding to the target multimedia resource is used to generate the target multimedia resource message. When determining the target multimedia resource based on multimedia resource preference information, a machine learning model targeting the target audience can be used for calculation. The information corresponding to the target multimedia resource can include the previously mentioned description of the target multimedia resource, the target audience's push notification preference information, etc. The information corresponding to the target multimedia resource can come from the local cache or from interaction with the server. The target multimedia resource message generated based on the local cache will be displayed to the client under certain product strategies.

[0107] The target multimedia resource comes from unplayed multimedia resources in the local cache, possessing the attribute that the target user wants to view but hasn't yet. Based on multimedia resource preference information, it is ensured that the target multimedia resource is among the unplayed multimedia resources in the local cache that best meets the target user's preferences. Accordingly, the target multimedia resource message corresponding to the target multimedia resource can help users discover multimedia resources they are more interested in, improving the user experience.

[0108] 2) Receive target multimedia resource message: Receive the target multimedia resource message sent by the server; the target multimedia resource message is selected and sent by the server based on the identification information of the target object.

[0109] The server can send targeted or mass messages based on deviceID (device identifier), userID (registered user identifier), the registration ID of a third-party push SDK (push software development kit), or IMEI (International Mobile Equipment Identity). The target multimedia resource message sent by the server is specific to the target multimedia resource. When sending to a specific target, the server can determine the target multimedia resource based on the recommendation strategy corresponding to that specific target; when sending to a mass target, the server can determine the target multimedia resource based on the recommendation strategy corresponding to similar targets. The target multimedia resource message can include all information about the target multimedia resource, or only key information (which can be used to retrieve necessary information from the server later). Target multimedia resource messages corresponding to the target multimedia resource can help users discover multimedia resources they are more interested in, improving the user experience.

[0110] In an exemplary embodiment, when the description information of the target multimedia resource displayed on the auxiliary display interface includes the cover image of the target multimedia resource, the process of displaying the auxiliary display interface includes the following steps: First, displaying the cover image indicating the target multimedia resource in a first area of ​​the auxiliary display interface, wherein the cover image is one of a static image and a dynamic image; then, displaying a first type of interactive operation control indicating playback control in a second area of ​​the auxiliary display interface, and adjusting the display transparency of the first type of interactive operation control; furthermore, when the adjusted display transparency meets a preset transparency threshold, the first area and the second area at least partially overlap.

[0111] When the adjusted display transparency meets a preset transparency threshold, the first area used to display the cover image and the second area used to display the first type of interactive controls at least partially overlap. This ensures that the first type of interactive controls in the second area do not affect the visibility of the cover image in the overlapping portion of the first area. Furthermore, the visual association between the first type of interactive controls and the cover image facilitates better user control during playback. The animated image used as the cover can be taken from a keyframe of the target multimedia resource. If the target multimedia resource is a film or television work, the animated image used as the cover can be generated from multiple keyframe screenshots of that work. Alternatively, the first type of interactive controls indicating playback control can be placed near the title of the target multimedia resource.

[0112] For example, the first layer containing the first area is located below the second layer containing the second area. In the first state, the display transparency of the first type of interactive operation control indicating playback control is greater than or equal to a first preset transparency threshold (e.g., any value between 75% and 80%). At this time, the target object can view, through the client, a cover image and the first type of interactive operation control that overlap at least partially on the auxiliary display interface. When the cover image is a dynamic image, the first type of interactive operation control does not affect the viewing of the dynamic changes of the cover image in the relevant overlapping portion. In the second state, the display transparency of the first type of interactive operation control indicating playback control is greater than or equal to a second preset transparency threshold (e.g., any value between 95% and 100%). At this time, the target object has completed the triggering operation of the first type of interactive operation control, and the display content of the second area can switch from the cover image to the playback content of multimedia resources. The target object can view, through the client, the playback content and the first type of interactive operation control that overlap at least partially on the auxiliary display interface, or can view only the playback content of the multimedia resources playing on the auxiliary display interface (the first type of interactive operation control is hidden and not displayed).

[0113] The auxiliary display interface will be further described below. The process of generating the auxiliary display interface may include the following steps: First, obtain a preset interface framework (UI framework), which includes at least one interface element; then, determine the state value of the interface element based on the target multimedia resource message; and finally, render the preset interface framework based on the state value of the interface element to obtain the auxiliary display interface.

[0114] The client configures the reception of multimedia resource messages, which are notifications pushed to users, in two aspects: a notification UI framework (i.e., the aforementioned preset interface framework) and a notification view controller. The notification UI framework, as the module for displaying the notification interface, includes the system's default interface style, basic components for user customization, and extended components. Extended components include SurfaceView controls for adding multimedia resource playback and buttons for adding multimedia resource playback. The notification view controller, as the module for performing operation callbacks on the notification UI framework, can handle actions such as: 1) callbacks upon receiving a multimedia resource message; 2) callbacks when the user clicks a custom operation button on the multimedia resource message; 3) controlling the way the multimedia resource message is displayed, such as canceling the display; and 4) application startup. The components for user customization include RemoteViews controls, which can be used to develop interfaces containing title elements, descriptions, images, operation buttons, and video playback controls. It should be noted that the module for video playback, constructed using these components, can handle audio and video encoding / decoding, and play / pause audio and video.

[0115] See Figure 6-9The preset interface framework may include a first interface element indicating the cover image, which can be determined directly or indirectly based on the target multimedia resource message to identify the cover image of the target multimedia resource, and then the state value of the first interface element is determined using the cover image. The first interface element indicating the cover image may be an ImageView control. The preset interface framework may include a second interface element indicating the title, which can be determined directly or indirectly based on the target multimedia resource message to identify the title address of the target multimedia resource (such as the Uniform Resource Locator for the title), and then the state value of the second interface element is determined using the title address. The preset interface framework may include a third interface element indicating the user information posted, which can be determined directly or indirectly based on the target multimedia resource message to identify the avatar address of the user's ID (such as the Uniform Resource Locator for the avatar), and then the state value of the third interface element is determined using the user ID and avatar address. The preset interface framework may include a fourth interface element indicating user interaction feedback statistics, which can be determined directly or indirectly based on the target multimedia resource message to identify user interaction feedback statistics (such as the number of likes, comments, shares, etc. obtained by interacting with the server based on the multimedia resource ID carried in the target multimedia resource message), and then the state value of the fourth interface element is determined using the user interaction feedback statistics. Based on the state values ​​of the aforementioned interface elements, a preset interface framework is rendered to obtain an auxiliary display interface. The obtained auxiliary display interface can display the cover image of the target multimedia resource, the title of the target multimedia resource, the nickname of the publishing user, the avatar of the publishing user, and user feedback statistics of the target multimedia resource.

[0116] Of course, interface elements can also include interactive controls indicating playback control, interactive controls indicating appointment reminders, interactive controls indicating likes, interactive controls indicating comments, interactive controls indicating forwarding, and interactive controls indicating progress adjustment. In practical applications, in response to the triggering of the interactive control indicating likes, the red heart indicating likes lights up, and the like count is incremented by 1 and sent back to the server. The like count corresponding to the aforementioned fourth interface element is also updated based on the interaction with the server. In response to the triggering of the interactive control indicating forwarding, the address of the multimedia resource (such as the Uniform Resource Locator of the multimedia resource) is obtained, and based on the user's selection, an application on the physical device that can forward the multimedia resource's address is invoked to forward it. The user's triggering of the interactive control indicating comments can be by entering a comment in the input box; the client responds by sending the comment information back to the server.

[0117] After triggering an operation on an interactive control, the display area of ​​the auxiliary display interface can remain unchanged (i.e., the auxiliary display interface is always active), and the interaction result can be displayed on the auxiliary display interface with the unchanged display area; or the display area of ​​the auxiliary display interface relative to the main interface can be reduced (i.e., the auxiliary display interface disappears or is collapsed).

[0118] In an exemplary embodiment, before displaying the auxiliary display interface upon receiving the target multimedia resource message, the method further includes the following steps: 1) determining a first preset surface view control, wherein the first preset surface view control has a first object embedded in it for caching relevant playback data; and creating a first type of interactive operation control based on the first preset surface view control; 2) determining a second preset surface view control, wherein the second preset surface view control has a second object embedded in it for caching relevant interactive feedback information; and creating a second type of interactive operation control based on the second preset surface view control.

[0119] The SurfaceView control is a subclass of View. When a SurfaceView control is created, it embeds a corresponding Surface object, which serves as a logical entity for managing the data to be displayed. In constructing the first type of interactive control for playback control, a first preset SurfaceView control is used, whose embedded first object caches relevant playback data. Upon receiving a trigger operation, the first type of interactive control refreshes the relevant playback data in the first object using the SurfaceView control's functional properties to display the relevant multimedia resources through the first preset SurfaceView control. In constructing the second type of interactive control for interactive feedback, a second preset SurfaceView control is used, whose embedded second object caches relevant interactive feedback information. Upon receiving a trigger operation, the second type of interactive control refreshes the relevant interactive feedback information in the second object using the SurfaceView control's functional properties to display the information through the second preset SurfaceView control.

[0120] In one exemplary implementation, such as Figure 3 As shown, after displaying the auxiliary display interface, the method further includes the following steps.

[0121] In step S301, it is detected whether the preset audio and video playback permissions are enabled;

[0122] In step S302, when the preset audio and video playback permission is detected to be enabled, the playback data of the target multimedia resource is obtained;

[0123] In step S303, the target multimedia resource is played based on the playback data.

[0124] Whether preset audio and video playback permissions are enabled can be determined by whether the system or the corresponding application has enabled the readability switch for auxiliary display interfaces (such as the notification bar). When preset audio and video playback permissions are detected as enabled, playback data of the target multimedia resource can be obtained directly or indirectly based on the target multimedia resource message. If the target multimedia resource is a local resource, its local storage path can be determined based on the target multimedia resource message, and playback data can then be obtained through the local storage path. If the target multimedia resource is an online resource, its source address information (such as a network download address) can be determined based on the target multimedia resource message, and playback data can then be obtained through interaction with the server. Alternatively, the identifier of the target multimedia resource can be determined based on the target multimedia resource message, and then interaction with the server can be used to obtain playback data based on the identifier.

[0125] After obtaining the playback data, the target multimedia resource can be played. Considering the playback data acquisition strategy, the execution of steps S302 and S303 above can be done once or repeatedly. For example, considering the current network environment and acquiring playback data in segments, the first playback data corresponding to the first 10 seconds of the target video can be acquired first, and then the content of the first 10 seconds can be played based on the first playback data. At the same time, the second playback data corresponding to the 11th to 20th seconds of the target video can be acquired, and then the content of the 11th to 20th seconds can be played based on the second playback data, and so on.

[0126] With audio and video playback permissions enabled, playing the received target multimedia resource message can improve the efficiency of multimedia resource display. Enabling audio and video playback permissions indicates that the user is in an environment where they can easily access multimedia resources through hearing, which simplifies user operations, eliminating the need for the user to view auxiliary display content or click on related controls.

[0127] For example, the presence of a connected audio / video playback peripheral can be detected if preset audio / video playback permissions are enabled. Audio / video playback peripherals can include, but are not limited to, Bluetooth headsets, speaker devices, and video playback devices (such as smart TVs). When the presence of an audio / video playback peripheral is detected, playback data of the target multimedia resource is acquired and then sent to the audio / video playback peripheral, enabling the peripheral to play the target multimedia resource based on the playback data, such as through screen mirroring. For details on acquiring playback data and setting up playback of the target multimedia resource, please refer to the relevant descriptions in the preceding paragraphs. When a connected audio / video playback peripheral exists, that peripheral plays the target multimedia resource. The presence of a connected audio / video playback peripheral indicates that the user is in an environment where they are accessing multimedia resources through the peripheral, simplifying user operations as they no longer need to view the content displayed on the auxiliary display interface or click on related controls.

[0128] In one exemplary embodiment, when the number of target multimedia resource messages is at least two, each target multimedia resource message is displayed on the auxiliary display interface in the form of card components. The display items of each card component include description information of the corresponding target multimedia resource and a first type of interactive operation control indicating playback control. After displaying the auxiliary display interface, the method further includes: switching the target multimedia resource messages displayed in the auxiliary display interface in response to a sliding operation on the card component list; wherein the card component list is obtained by arranging the card components corresponding to each target multimedia resource message, and the sliding direction of the sliding operation is the same as the arrangement direction of each card component.

[0129] like Figure 8 As shown, when there are at least two target multimedia resource messages, each target multimedia resource message is displayed as a card component on the auxiliary display interface. The card components corresponding to each target multimedia resource message are arranged sequentially to form a card component list, which is presented on the auxiliary display interface. The arrangement direction of each card component can be horizontal, vertical, or other suitable display directions, without specific limitations. The display items of each card component include the description information of the corresponding target multimedia resource and the first type of interactive operation control indicating playback control. The definition of the description information of the target multimedia resource and the related interactive operation control can be referred to the relevant descriptions in the preceding paragraphs, and will not be repeated here.

[0130] The system receives a swipe operation from the target object on the card component list. The swipe direction is the same as the arrangement direction of each card component, for example, horizontal. Then, it switches the target multimedia resource message displayed in the auxiliary display interface. For example, the card component list on the auxiliary display interface is arranged horizontally, from left to right: card component 1 (corresponding to target multimedia resource message 1), card component 2 (corresponding to target multimedia resource message 2), card component 3 (corresponding to target multimedia resource message 3), and card component 4 (corresponding to target multimedia resource message 4). To ensure the application performance of the auxiliary display interface, the size of the user-visible area is often set based on the presentation of a target multimedia resource message. Correspondingly, the size of the user-visible area of ​​the auxiliary display interface matches the size of a card component that corresponds one-to-one with the target multimedia resource message. Therefore, the size of the user-visible area of ​​the auxiliary display interface is smaller than the size of the area containing the card component list. If before the swipe operation, the user-visible area displays card component 2 (corresponding to target multimedia resource message 2), and after the right-to-left swipe operation, the user-visible area displays card component 4 (corresponding to target multimedia resource message 4). During this swipe operation, as the swipe distance increases, firstly, the presentation binding between the user-visible area and card component 2 is released, and card component 2 gradually hides through a fade-in animation; then, card component 3 appears in the user-visible area through a fade-out animation; finally, card component 4 appears in the user-visible area through a fade-out animation and establishes a presentation binding with that user-visible area. While a presentation binding with a card component is established in the user-visible area, the target object can trigger operations on the interactive controls displayed on that card component.

[0131] By presenting two or more target multimedia resource messages in a list of card components within the auxiliary display interface, and using a swipe gesture to switch between the displayed messages, the efficiency of showcasing multiple target multimedia resource messages can be improved. Compared to presenting a single target multimedia resource message through a single auxiliary display interface, this approach optimizes the user interface and facilitates user viewing of related multimedia resource messages.

[0132] In one exemplary implementation, such as Figure 4 As shown, the auxiliary display interface also includes a third type of interactive control that indicates appointment reminders. After displaying the auxiliary display interface, the method further includes the following steps.

[0133] In step S401, in response to the triggering operation of the third type of interactive operation control indicating the reservation reminder, a time selection interface for making a reservation reminder for the live broadcast corresponding to the target multimedia resource is presented;

[0134] In step S402, in response to the selection operation triggered based on the time selection interface, the selected time is taken as the target time;

[0135] In step S403, a reminder notification for the live broadcast is received at the target time.

[0136] For live streaming scenarios, the target multimedia resource can be a live stream preview, and the target multimedia resource message can be a notification pushed to the target live stream preview. The server sends the target multimedia resource message to the client before the official start time of the live stream. Based on the information indicating the live stream preview in the target multimedia resource message, the client generates and displays an auxiliary display interface, including a third type of interactive operation control indicating a reservation reminder. After receiving a trigger operation from the target object, a time selection interface for live stream reservation reminders is presented. The target time can be determined using the time selection interface in the following ways: 1) The time selection interface comes from a reservation reminder application such as a calendar or alarm clock on the physical device called by the client, and the target object selects the target time; 2) The time selection interface comes from the client's own reservation reminder application, and the target object selects the target time. Of course, the target time can be a time earlier than the official start time of the live stream specified by the target object, or it can be a default target time after the target object confirms the need for a reservation reminder (e.g., 5 or 10 minutes before the official start time of the live stream). For the former, step S402 may further include switching the time selection interface to display a reservation reminder control. For the latter, in response to the triggering operation of the third type of interactive operation control indicating appointment reminder, the third type of interactive operation control indicating appointment reminder can be switched to be displayed as an appointment reminder control.

[0137] Receive a notification about the live stream at a target time (close to the official start time). This notification can be displayed via an auxiliary display interface and can remain on the screen (including by narrowing the display area) for a preset time period before the live stream starts (e.g., 1 minute). Correspondingly, users can trigger interactive controls on the auxiliary display interface to enter the live stream page and wait for the live stream to start or watch the live stream; alternatively, triggering these controls will display a page indicating whether the live stream is starting or the live stream page is actually being watched on the auxiliary display interface.

[0138] For live streaming scenarios, a third type of interactive control is added to the auxiliary display interface to indicate reservation reminders, which can improve the efficiency of users reserving live streams they are interested in. Reservations can be completed without entering the relevant live stream page within the application, reducing the number of steps required to switch between the auxiliary display interface and the relevant live stream page, and thus reducing the consumption of computing resources.

[0139] In step S202, when a trigger operation is performed on the first type of interactive operation control, playback data of the target multimedia resource is acquired, and the target multimedia resource is played on the auxiliary display interface based on the playback data; and / or, when a trigger operation is performed on the second type of interactive operation control, interactive feedback information associated with the second type of interactive operation control is displayed on the auxiliary display interface.

[0140] (i) Regarding the triggering of the first type of interactive operation controls, the playback data of the target multimedia resource can be obtained directly or indirectly based on the target multimedia resource message. If the target multimedia resource is a local resource, its local storage path can be determined based on the target multimedia resource message, and then playback data can be obtained through the local storage path. If the target multimedia resource is an online resource, its source address information (such as a network download address) can be determined based on the target multimedia resource message, and then playback data can be obtained through interaction with the server. Alternatively, the identifier of the target multimedia resource can be determined based on the target multimedia resource message, and then the server can be interacted with based on the identifier of the target multimedia resource to obtain playback data.

[0141] The target multimedia resource can be displayed in the auxiliary display interface using playback data, without needing to enter the application's relevant playback page. Of course, you can also enter the application's relevant playback page to view the target multimedia resource.

[0142] After obtaining the playback data, the target multimedia resource can be played. Considering the playback data acquisition strategy, the execution of steps S202 and S203 above can be a one-time event or repeated. For example, considering the current network environment and acquiring playback data in segments, the first playback data corresponding to the first 10 seconds of the target video can be acquired first, and then the content of the first 10 seconds can be played based on the first playback data. At the same time, the second playback data corresponding to the 11th to 20th seconds of the target video can be acquired, and then the content of the 11th to 20th seconds can be played based on the second playback data, and so on.

[0143] For example, playback data can indicate key content of the target multimedia resource (such as the climax of a film or television work), and play this key content on the auxiliary display interface. The auxiliary display interface also includes interactive controls that indicate entering normal playback mode. In response to the target object's triggering of these controls, the relevant playback page of the application is accessed, and the complete content of the target multimedia resource is played in normal mode.

[0144] In one exemplary implementation, such as Figure 5 As shown, playing the target multimedia resource may also include the following steps.

[0145] In step S501, a playback data display interface associated with the auxiliary display interface is invoked. The playback data display interface is less dependent on the operating environment than the auxiliary display interface.

[0146] In step S502, the target multimedia resource is played on the playback data display interface based on the playback data.

[0147] The playback data display interface has a lower dependency on the runtime environment compared to the auxiliary display interface. Calling the associated playback data display interface to display the target multimedia resources can reduce runtime resource overhead and ensure system performance reliability and stability. In practical applications, for example, the auxiliary display interface may use a notification bar style (see [link to relevant documentation]). Figure 6 The playback data display interface uses a lighter floating window style (see [link]). Figure 7 Therefore, when playing the target multimedia resource, the floating window can be used to play the target multimedia resource in a small window mode.

[0148] In one exemplary embodiment, playing the target multimedia resource on the auxiliary display interface based on the playback data includes: reducing the display area of ​​the auxiliary display interface relative to the main interface; and playing the target multimedia resource on the auxiliary display interface with the reduced display area based on the playback data.

[0149] For playback of target multimedia resources, the display area of ​​the auxiliary display interface can be adjusted as needed: 1) When the visual guidance requirement of the target multimedia resource is greater than or equal to the auditory guidance requirement, the display area of ​​the auxiliary display interface can be kept unchanged, and the target multimedia resource can be played on the auxiliary display interface with the unchanged display area (that is, the auxiliary display interface is always present, displaying the real-time playback page), or the display area of ​​the auxiliary display interface relative to the main interface can be expanded, and the target multimedia resource can be played on the auxiliary display interface with the expanded display area; 2) When the visual guidance requirement of the target multimedia resource is less than the auditory guidance requirement, the display area of ​​the auxiliary display interface relative to the main interface can be reduced, and the target multimedia resource can be played on the auxiliary display interface with the reduced display area (that is, the auxiliary display interface disappears, and the audio continues to be output; or, the auxiliary display interface is collapsed, only showing a certain application playing, and the audio continues to be output). This improves the flexibility of playing target multimedia resources using the auxiliary display interface.

[0150] (ii) Regarding the triggering of the second type of interactive operation controls, these controls can be controls indicating "like," "comment," "share," "favorite," or "report," etc. For example, controls indicating "comment" may further include controls indicating "comment input" and controls indicating "comment viewing."

[0151] The interactive feedback information associated with the second type of interactive operation control can be the complete or partial content of the interactive feedback information currently input by the target object, the real-time interactive feedback information that the target object currently expects to view, or the real-time interactive feedback statistics that the target object currently expects to view.

[0152] For example, 1) For the complete or partial content of the interactive feedback information currently input by the target user, the user can input comments by triggering the second type of interactive operation control, and thus view the complete or partial comments displayed on the auxiliary display interface. The user can also like the comments by triggering the second type of interactive operation control, and thus view the changes or additions of interface elements such as "heart" and "+1" indicating the completion of the like on the auxiliary display interface. 2) For the real-time interactive feedback information that the target user currently wants to view, the user can comment by triggering the second type of interactive operation control, and thus view the real-time comments displayed on the auxiliary display interface. Here, real-time comments refer to comments on the target multimedia resource up to the current time, without limiting the display logic of the comments on the auxiliary display interface (such as timeline logic, popularity logic). 3) For the real-time interactive feedback statistics that the target user currently wants to view, the user can like the comments by triggering the second type of interactive operation control, and thus view the real-time like count displayed on the auxiliary display interface. Here, the real-time like count refers to the number of likes on the target multimedia resource up to the current time.

[0153] The multimedia resource display method provided in the above embodiments can realize the playback of multimedia resources and / or user interactive feedback on the auxiliary display interface, providing a more flexible and vivid way to display multimedia resources. This greatly improves the ease of operation of the multimedia resources, attracts user clicks, and helps users quickly understand the multimedia resources. This allows users to promptly view multimedia resources of interest and provide interactive feedback, thereby improving the effectiveness of multimedia resource display. Simultaneously, it can increase user engagement with the relevant multimedia resource applications and improve user retention.

[0154] Figure 10This is a block diagram illustrating a multimedia resource display device 1000 according to an exemplary embodiment. (Refer to...) Figure 10 The device includes a display unit 1001 and a trigger unit 1002.

[0155] The display unit 1001 is configured to display an auxiliary display interface when a target multimedia resource message is received. The auxiliary display interface is independent of the main interface. The display items of the auxiliary display interface include description information of the target multimedia resource, a first type of interactive operation control indicating playback control, and / or a second type of interactive operation control indicating interactive feedback.

[0156] The triggering unit 1002 is configured to, when in response to a triggering operation on the first type of interactive operation control, acquire playback data of the target multimedia resource and, based on the playback data, play the target multimedia resource on the auxiliary display interface; and / or, when in response to a triggering operation on the second type of interactive operation control, display interactive feedback information associated with the second type of interactive operation control on the auxiliary display interface.

[0157] In one exemplary embodiment, the apparatus further includes:

[0158] The first type of interactive operation control creation unit is configured to determine a first preset surface view control, wherein the first preset surface view control has a first object embedded in it for caching relevant playback data; and to create the first type of interactive operation control based on the first preset surface view control.

[0159] The second type of interactive operation control creation unit is configured to determine a second preset surface view control, wherein the second preset surface view control has a second object embedded in it for caching relevant interactive feedback information; and to create the second type of interactive operation control based on the second preset surface view control.

[0160] In one exemplary embodiment, the apparatus further includes:

[0161] The permission detection unit is configured to detect whether preset audio and video playback permissions are enabled.

[0162] The playback data acquisition unit is configured to acquire the playback data of the target multimedia resource when the preset audio and video playback permission is detected to be enabled.

[0163] The first resource playback unit is configured to play the target multimedia resource based on the playback data.

[0164] In one exemplary embodiment, the playback data acquisition unit includes: a peripheral device detection unit configured to detect whether there is a connected audio / video playback peripheral device when the preset audio / video playback permission is enabled; and a playback data acquisition subunit configured to acquire playback data of the target multimedia resource when the audio / video playback peripheral device is detected to exist.

[0165] The first resource playback unit includes a resource playback subunit configured to send the playback data to the audio / video playback peripheral device, so that the audio / video playback peripheral device plays the target multimedia resource based on the playback data.

[0166] In one exemplary embodiment, the triggering unit includes:

[0167] The shrinking unit is configured to shrink the display area of ​​the auxiliary display interface relative to the main interface;

[0168] The playback subunit is configured to play the target multimedia resource on the auxiliary display interface with a reduced display area, based on the playback data.

[0169] In one exemplary embodiment, the apparatus further includes:

[0170] The calling unit is configured to execute a call to the playback data display interface associated with the auxiliary display interface, wherein the playback data display interface has a lower dependence on the runtime environment than the auxiliary display interface.

[0171] The second resource playback unit is configured to play the target multimedia resource on the playback data display interface based on the playback data.

[0172] In one exemplary embodiment, when the number of target multimedia resource messages is at least two, each target multimedia resource message is displayed on the auxiliary display interface in the form of a card component. Each card component includes a description of the corresponding target multimedia resource and a first type of interactive control indicating playback control. The device further includes:

[0173] The switching unit is configured to switch the target multimedia resource message displayed in the auxiliary display interface in response to a swipe operation on the card component list;

[0174] The card component list is obtained by arranging the card components corresponding to each target multimedia resource message, and the sliding direction of the sliding operation is the same as the arrangement direction of each card component.

[0175] In one exemplary embodiment, the apparatus further includes:

[0176] The presentation unit is configured to perform a trigger operation in response to the third type of interactive operation control that indicates the reservation reminder, and present a time selection interface for making a reservation reminder for the live broadcast corresponding to the target multimedia resource;

[0177] The selection unit is configured to perform a selection operation triggered based on the time selection interface, and to use the selected time as the target time.

[0178] The notification unit is configured to receive a reminder notification for the live stream at the target time.

[0179] In one exemplary embodiment, the apparatus further includes:

[0180] The candidate multimedia resource determination unit is configured to determine unplayed candidate multimedia resources from the local cache;

[0181] The target multimedia resource determination unit is configured to determine the target multimedia resource from the candidate multimedia resources based on the multimedia resource preference information of the target object;

[0182] The message generation unit is configured to generate a target multimedia resource message using information corresponding to the target multimedia resource.

[0183] In one exemplary embodiment, the apparatus further includes:

[0184] The message receiving unit is configured to receive the target multimedia resource message sent by the server;

[0185] The target multimedia resource message is selected and sent by the server based on the identification information of the target object.

[0186] In one exemplary embodiment, the display unit includes:

[0187] The first area display unit is configured to perform a first area display of a cover image indicating the target multimedia resource on the auxiliary display interface, wherein the cover image is one of a static image and a dynamic image.

[0188] The second area display unit is configured to execute a first type of interactive operation control for the second area display instruction playback control on the auxiliary display interface, and to adjust the display transparency of the first type of interactive operation control;

[0189] The overlapping unit is configured to perform an operation whereby the first region and the second region at least partially overlap when the adjusted display transparency meets a preset transparency threshold.

[0190] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0191] In an exemplary embodiment, an electronic device is also provided, including a processor; a memory for storing processor-executable instructions; wherein, when the processor is configured to execute the instructions stored in the memory, it implements the steps of the multimedia resource display method in any of the above embodiments.

[0192] The electronic device can be a terminal, a server, or a similar computing device. Taking a server as an example... Figure 11 This is a block diagram of an electronic device 1000 for implementing a method for displaying multimedia resources, according to an exemplary embodiment. The electronic device 1000 can vary significantly due to different configurations or performance characteristics. It may include one or more central processing units (CPUs) 1110 (CPUs 1110 may include, but are not limited to, display devices using microprocessors (MCUs) or programmable logic devices (FPGAs), a memory 1130 for storing data, and one or more storage media 1120 (e.g., one or more mass storage devices) for storing application programs 1123 or data 1122. The memory 1130 and storage media 1120 may be temporary or persistent storage. The program stored in the storage media 1120 may include one or more modules, each module including a series of instruction operations on the electronic device. Furthermore, the CPU 1111 may be configured to communicate with the storage media 1120 and execute the series of instruction operations in the storage media 1120 on the electronic device 1100. Electronic device 1100 may also include one or more power supplies 1160, one or more wired or wireless network interfaces 1150, one or more input / output interfaces 1140, and / or one or more operating systems 1121, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, etc.

[0193] The input / output interface 1040 can be used to receive or send data via a network. Specific examples of the network described above may include a wireless network provided by the communication provider of the electronic device 1000. In one example, the input / output interface 1040 includes a network interface controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In an exemplary embodiment, the input / output interface 100 can be a radio frequency (RF) module for wireless communication with the Internet.

[0194] Those skilled in the art will understand that Figure 11 The structure shown is for illustrative purposes only and does not limit the structure of the aforementioned electronic device. For example, electronic device 1100 may also include... Figure 11 The more or fewer components shown, or having the same Figure 11 The different configurations shown.

[0195] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory including instructions, which can be executed by the processor 1110 of the electronic device 1100 to complete the multimedia resource display method described above. Optionally, the computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0196] In an exemplary embodiment, a computer program product is also provided, comprising computer instructions stored in a computer-readable storage medium. A processor of an electronic device reads the computer program / instructions from the computer-readable storage medium and executes the computer program / instructions, causing the electronic device to perform the multimedia resource display method provided in any of the above embodiments.

[0197] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and RAMbus dynamic RAM (RDRAM), etc.

[0198] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0199] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A method for displaying multimedia resources, characterized in that, The method is applied to a client, and the method includes: Upon receiving a target multimedia resource message corresponding to the recommended target multimedia resource, an auxiliary display interface is displayed on the main interface. The auxiliary display interface is independent of the main interface. The items displayed on the auxiliary display interface include the description information of the target multimedia resource, a first type of interactive operation control indicating playback control, and / or a second type of interactive operation control indicating interactive feedback. The target multimedia resource message is a notification to push the target multimedia resource. The main interface indicates the main interface of the physical device or the main interface of the application. When a trigger operation is performed on the first type of interactive operation control, playback data of the target multimedia resource is acquired, and based on the playback data, the target multimedia resource is played on the auxiliary display interface, wherein the playback data indicates the complete content or key content of the target multimedia resource; and / or, when a trigger operation is performed on the second type of interactive operation control, interactive feedback information associated with the second type of interactive operation control is displayed on the auxiliary display interface. Playing the target multimedia resource on the auxiliary display interface based on the playback data includes: expanding or shrinking the display area of ​​the auxiliary display interface relative to the main interface; and playing the target multimedia resource on the auxiliary display interface after the display area has been expanded or shrunk based on the playback data.

2. The method according to claim 1, characterized in that, Before displaying the auxiliary display interface upon receiving the target multimedia resource message, the method further includes: A first preset surface view control is determined, wherein the first preset surface view control has a first object embedded in it for caching relevant playback data; and a first type of interactive operation control is created based on the first preset surface view control. A second preset surface view control is determined, wherein the second preset surface view control has a second object embedded in it for caching relevant interactive feedback information; and a second type of interactive operation control is created based on the second preset surface view control.

3. The method according to claim 1, characterized in that, After displaying the auxiliary display interface, the method further includes: Check if preset audio and video playback permissions are enabled; If the preset audio and video playback permission is detected to be enabled, the playback data of the target multimedia resource is obtained; The target multimedia resource is played based on the playback data.

4. The method according to claim 3, characterized in that: The step of obtaining playback data of the target multimedia resource when the preset audio / video playback permission is detected to be enabled includes: If the preset audio and video playback permission is detected to be enabled, the system will detect whether there are any connected audio and video playback peripherals. If the presence of the audio / video playback peripheral is detected, the playback data of the target multimedia resource is acquired; Playing the target multimedia resource based on the playback data includes: The playback data is sent to the audio / video playback peripheral device so that the audio / video playback peripheral device plays the target multimedia resource based on the playback data.

5. The method according to claim 1, characterized in that, After acquiring the playback data of the target multimedia resource in response to a trigger operation on the first type of interactive control, the method further includes: Call the playback data display interface associated with the auxiliary display interface. The playback data display interface is less dependent on the operating environment than the auxiliary display interface. Based on the playback data, the target multimedia resource is played on the playback data display interface.

6. The method according to claim 1, characterized in that, When the number of target multimedia resource messages is at least two, each target multimedia resource message is displayed on the auxiliary display interface in the form of a card component. The display items of each card component include the description information of the corresponding target multimedia resource and a first type of interactive operation control indicating playback control. After displaying the auxiliary display interface, the method further includes: In response to a swipe operation on the card component list, the target multimedia resource message displayed in the auxiliary display interface is switched; The card component list is obtained by arranging the card components corresponding to each target multimedia resource message, and the sliding direction of the sliding operation is the same as the arrangement direction of each card component.

7. The method according to claim 1, characterized in that, The auxiliary display interface also includes a third type of interactive control indicating appointment reminders. After displaying the auxiliary display interface, the method further includes: In response to the triggering operation of the third type of interactive operation control that indicates the reservation reminder, a time selection interface for making a reservation reminder for the live broadcast corresponding to the target multimedia resource is presented; In response to a selection operation triggered based on the time selection interface, the selected time is used as the target time; Receive a reminder notification for the live stream at the target time.

8. The method according to claim 1, characterized in that, Before displaying the auxiliary display interface, the method further includes: Identify unplayed candidate multimedia resources from the local cache; Based on the multimedia resource preference information of the target object, the target multimedia resource is determined from the candidate multimedia resources; The target multimedia resource message is generated using the information corresponding to the target multimedia resource.

9. The method according to claim 1, characterized in that, Before displaying the auxiliary display interface, the method further includes: Receive the target multimedia resource message sent by the server; The target multimedia resource message is selected and sent by the server based on the identification information of the target object.

10. The method according to claim 1, characterized in that, The auxiliary display interface includes: The first area of ​​the auxiliary display interface displays a cover image indicating the target multimedia resource, the cover image being either a static image or a dynamic image; The second area of ​​the auxiliary display interface displays a first type of interactive operation control that indicates playback control, and allows adjustment of the display transparency of the interactive operation control; When the adjusted display transparency meets the preset transparency threshold, the first region and the second region at least partially overlap.

11. A multimedia resource display device, characterized in that, The device is configured on a client, and the device includes: The display unit is configured to display an auxiliary display interface on the main interface when a target multimedia resource message corresponding to a recommended target multimedia resource is received. The auxiliary display interface is independent of the main interface. The display items of the auxiliary display interface include description information of the target multimedia resource, a first type of interactive operation control indicating playback control, and / or a second type of interactive operation control indicating interactive feedback. The target multimedia resource message is a notification to push the target multimedia resource. The main interface indicates the main interface of the physical device or the main interface of the application. The triggering unit is configured to, when responding to a triggering operation on the first type of interactive operation control, acquire playback data of the target multimedia resource, and, based on the playback data, play the target multimedia resource on the auxiliary display interface, wherein the playback data indicates the complete content or key content of the target multimedia resource; and / or, when responding to a triggering operation on the second type of interactive operation control, display interactive feedback information associated with the second type of interactive operation control on the auxiliary display interface. The triggering unit is also configured to expand or shrink the display area of ​​the auxiliary display interface relative to the main interface; and based on the playback data, play the target multimedia resource on the auxiliary display interface after the display area has been expanded or shrunk.

12. The apparatus according to claim 11, characterized in that, The device further includes: The first type of interactive operation control creation unit is configured to determine a first preset surface view control, wherein the first preset surface view control has a first object embedded in it for caching relevant playback data; and to create the first type of interactive operation control based on the first preset surface view control. The second type of interactive operation control creation unit is configured to determine a second preset surface view control, wherein the second preset surface view control has a second object embedded in it for caching relevant interactive feedback information; and to create the second type of interactive operation control based on the second preset surface view control.

13. The apparatus according to claim 11, characterized in that, The device further includes: The permission detection unit is configured to detect whether preset audio and video playback permissions are enabled. The playback data acquisition unit is configured to acquire the playback data of the target multimedia resource when the preset audio and video playback permission is detected to be enabled. The first resource playback unit is configured to play the target multimedia resource based on the playback data.

14. The apparatus according to claim 13, characterized in that: The playback data acquisition unit includes: a peripheral device detection unit, configured to detect whether there is a connected audio / video playback peripheral device when the preset audio / video playback permission is enabled; and a playback data acquisition subunit, configured to acquire the playback data of the target multimedia resource when the audio / video playback peripheral device is detected. The first resource playback unit includes a resource playback subunit configured to send the playback data to the audio / video playback peripheral device, so that the audio / video playback peripheral device plays the target multimedia resource based on the playback data.

15. The apparatus according to claim 11, characterized in that, The device further includes: The calling unit is configured to execute a call to the playback data display interface associated with the auxiliary display interface, wherein the playback data display interface has a lower dependence on the runtime environment than the auxiliary display interface. The second resource playback unit is configured to play the target multimedia resource on the playback data display interface based on the playback data.

16. The apparatus according to claim 11, characterized in that, When the number of target multimedia resource messages is at least two, each target multimedia resource message is displayed on the auxiliary display interface in the form of a card component. Each card component includes a description of the corresponding target multimedia resource and a first type of interactive control indicating playback control. The device further includes: The switching unit is configured to switch the target multimedia resource message displayed in the auxiliary display interface in response to a swipe operation on the card component list; The card component list is obtained by arranging the card components corresponding to each target multimedia resource message, and the sliding direction of the sliding operation is the same as the arrangement direction of each card component.

17. The apparatus according to claim 11, characterized in that, The device further includes: The presentation unit is configured to perform a trigger operation in response to the third type of interactive operation control that indicates the reservation reminder, and present a time selection interface for making a reservation reminder for the live broadcast corresponding to the target multimedia resource; The selection unit is configured to perform a selection operation triggered based on the time selection interface, and to use the selected time as the target time. The notification unit is configured to receive a reminder notification for the live stream at the target time.

18. The apparatus according to claim 11, characterized in that, The device further includes: The candidate multimedia resource determination unit is configured to determine unplayed candidate multimedia resources from the local cache; The target multimedia resource determination unit is configured to determine the target multimedia resource from the candidate multimedia resources based on the multimedia resource preference information of the target object; The message generation unit is configured to generate a target multimedia resource message using information corresponding to the target multimedia resource.

19. The apparatus according to claim 11, characterized in that, The device further includes: The message receiving unit is configured to receive the target multimedia resource message sent by the server; The target multimedia resource message is selected and sent by the server based on the identification information of the target object.

20. The apparatus according to claim 11, characterized in that, The display unit includes: The first area display unit is configured to perform a first area display of a cover image indicating the target multimedia resource on the auxiliary display interface, wherein the cover image is one of a static image and a dynamic image. The second area display unit is configured to execute a first type of interactive operation control for the second area display instruction playback control on the auxiliary display interface, and to adjust the display transparency of the first type of interactive operation control; The overlapping unit is configured to perform an operation whereby the first region and the second region at least partially overlap when the adjusted display transparency meets a preset transparency threshold.

21. An electronic device, characterized in that, include: processor; Memory used to store the processor's executable instructions; The processor is configured to execute the instructions to implement the method for displaying multimedia resources as described in any one of claims 1 to 10.

22. A computer-readable storage medium, wherein instructions in the computer-readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform a method for displaying multimedia resources as claimed in any one of claims 1 to 10.

23. A computer program product comprising a computer program / instructions, characterized in that, When the computer program / instructions are executed by the processor, they implement the method for displaying multimedia resources as described in any one of claims 1 to 10.

Images