Display device and recommended media asset display method
By creating a canvas component on the floating layer of the window that displays media recommendation data, and generating a jump interface image after starting the jump interface application, the problem of a single form of the recommended media playback interface is solved, and the synchronous display and interaction between the recommended media and the jump interface is realized.
Patent Information
- Application Number
- CN202411732129.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-08-30
- Filing Date
- 2024-11-28
- Publication Date
- 2025-04-18
- Estimated Expiration
- 2044-11-28
AI Technical Summary
When the display device plays recommended media, the recommended media playback interface is single, making it difficult for users to perform interactive operations.
By creating a canvas component on the floating layer of the window that displays media recommendation data, the canvas component blocks some window floating layers, realizes synchronous display of the image to be jumped and the recommended media data, and generates a jump interface image based on the jump interface after starting the jump interface application.
It realizes the synchronous display of images and recommended media data of the interface to be redirected, which increases the attractiveness of users to treat the redirected interface, reduces visual jumps, and supports users to quickly display applications.
Smart Images

Figure CN119854558A_ABST
Abstract
Description
[0001] This application claims the priority of the Chinese patent application filed with the China Patent Office on August 30, 2024, with application number 2024112189516 and invention name “A display device and recommended media display method”, the entire contents of which are incorporated by reference in this application. Technical Field
[0002] The present application relates to the technical field of display devices, and in particular to a display device and a method for displaying recommended media resources. Background Art
[0003] Display devices are intelligent devices that can present user interfaces and support user interaction. Taking smart TVs as an example, smart TVs are based on Internet application technology, have open operating systems and chips, have open application platforms, can realize two-way human-computer interaction functions, and are TV products that integrate multiple functions such as audio and video, entertainment, and data to meet the diverse and personalized needs of users. Display devices can play startup media during the startup process, or automatically play recommended media when a specific interface is displayed in an application, to display prompts and promotional content.
[0004] When the display device plays the recommended media, it will display the recommended media playback interface. The recommended media playback interface will be displayed for a certain period of time according to the playback process of the recommended media or the user's interactive operation. While displaying the recommended media playback interface, the display device can receive an interface jump instruction input by the user, and jump to the detailed interface corresponding to the recommended media in response to the interface jump instruction. For example, before displaying the homepage interface, the display device can display a splash screen advertisement. At this time, if the user presses the confirmation key, it can jump to the detailed interface of the product corresponding to the splash screen advertisement for the user to perform further interaction.
[0005] Since the recommended media playback interface is composed of videos, pictures, animated images, picture groups and other materials, users do not know the content and form of the recommended media jump interface. That is, when the display device displays the recommended media playback interface, the recommended media playback screen presented is single in form, which is not conducive to users performing interactive operations. Summary of the invention
[0006] In a first aspect, the present application provides a display device, comprising: a display configured to display a user interface; a communication device configured to establish a communication connection with a control device and a server, wherein the control device comprises at least one key, and the control device is configured to generate a key instruction in response to a key operation of a user; and a controller configured to:
[0007] In response to an input control instruction for displaying a target interface, the target interface is displayed; when a media request mark exists in the target interface, recommended media data is requested and a window floating layer is created, wherein the display level of the window floating layer is higher than the display level of the current user interface; the recommended media data is loaded in the window floating layer to play the recommended media data; a canvas component is created on the window floating layer, and a jump interface application is started, wherein the canvas component covers a portion of the window floating layer; a jump interface image is obtained, and the jump interface image is loaded in the canvas component, wherein the jump interface image is an image generated based on the jump interface, the jump interface is generated by the jump interface application according to the jump interface data, and the display level of the jump interface is lower than the window floating layer; an input jump instruction representing the display of the jump interface is received, the playing of the recommended media data is stopped, and the window floating layer and the canvas component are destroyed to display the jump interface.
[0008] On the basis of playing the media recommendation data on the target page, the present application realizes the synchronous display of the image of the interface to be jumped and the recommended media data by creating a canvas component on the floating layer of the window displaying the media recommendation data. The canvas component covers part of the window floating layer, thereby realizing the synchronous display of the image of the interface to be jumped and the recommended media data. At the same time, because the image of the interface to be jumped is generated according to the jump interface after starting the jump interface application, the consistency between the content displayed by the canvas component and the jump interface displayed with the jump application is realized. This consistency can not only increase the attractiveness of the image of the interface to be jumped that is displayed synchronously with the recommended media data to users, but also maintain consistency between the content of the page after the jump and the canvas component, thereby reducing visual jumps.
[0009] Furthermore, when creating a canvas component, an application with a jump interface is synchronously started, and the jump page is displayed in advance below the window floating layer. While ensuring the consistency between the content displayed by the canvas component and the jump interface displayed by the application with jump, the application can be displayed quickly after the jump without having to be started separately.
[0010] In a second aspect, the present application provides a display device, wherein the controller starts a jump interface application, including:
[0011] Run a jump interface application and create a jump interface display container, wherein the display level of the jump interface display container is lower than the window floating layer; load jump interface data in the jump interface display container to display the jump interface in the jump interface display container; the controller obtains the jump interface image, including: taking a screenshot of the jump interface to generate the jump interface image.
[0012] The jump interface display container is lower than the window floating layer so that the display of the recommended media asset data and the canvas component will not be affected while the pre-started jump application is implemented.
[0013] In a third aspect, the present application provides a display device, wherein after the controller creates a canvas component on the window floating layer, the controller is further configured to:
[0014] Obtain an end instruction, where the end instruction is generated according to an end playback event of the recommended media asset data, or is generated in response to a key operation representing skipping input by a user; in response to the end instruction, stop running the jump interface application, and remove the window floating layer and the canvas component; and control the display to display the target interface.
[0015] In a fourth aspect, the present application provides a display device, wherein the controller requests recommended media data and creates a window floating layer when a media resource request mark is present on a target interface, including:
[0016] Read the media resource request tag of the target interface; generate a media resource acquisition request according to the media resource request tag, and send the media resource acquisition request to the server, so that the server feeds back recommended media resource data according to the media resource acquisition request; create a window floating layer.
[0017] In a fifth aspect, the present application provides a display device, wherein the controller creates a canvas component on the window floating layer, and starts a jump interface application, including:
[0018] The jump interface information associated with the recommended media asset is read from the recommended media asset data; if the recommended media asset has associated jump interface information, a jump interface application is started according to the jump interface information; if the recommended media asset does not have associated jump interface information, the jump interface application is not started.
[0019] In a sixth aspect, the present application provides a display device, wherein the controller executes loading the jump interface image in the canvas component, and is further configured to:
[0020] Acquire the current screen size of the display and the target control size of the jump interface image; set the minimum display size of the canvas component according to the current screen size, and set the maximum display size of the canvas component according to the target control size; dynamically set the real-time display size of the canvas component, and the real-time display size changes periodically within the fluctuation range according to the preset frequency.
[0021] The dynamically adjusted display size can increase user appeal and enhance user attention to the content of the canvas component.
[0022] In a seventh aspect, the present application provides a recommended media resource display method corresponding to the display device of any of the above aspects and the corresponding controller execution steps. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0024] Figure 1 A schematic diagram showing usage scenarios of a display device in some embodiments of the present application;
[0025] Figure 2 A hardware configuration block diagram of a display device provided in some embodiments of the present application;
[0026] Figure 3 A schematic diagram of software configuration in a display device provided in some embodiments of the present application;
[0027] Figure 4 A schematic diagram of a screen-opening video display effect provided in some embodiments of the present application;
[0028] Figure 5 A schematic diagram of another open-screen video display effect provided in some embodiments of the present application;
[0029] Figure 6 A schematic diagram of a process of displaying a home page interface in response to a return key provided in some embodiments of the present application;
[0030] Figure 7 A schematic diagram of a process of displaying a product details interface in response to a confirmation key provided in some embodiments of the present application;
[0031] Figure 8 A flowchart of a method for displaying recommended media resources provided in some embodiments of the present application;
[0032] Fig. 9 A schematic diagram of a process for obtaining recommended media asset data provided in some embodiments of the present application;
[0033] Fig.10 A timing diagram of a method for displaying recommended media resources executed by a homepage application provided in some embodiments of the present application;
[0034] Fig.11 A timing relationship diagram of a method for displaying recommended media assets executed by an advertising service provided in some embodiments of the present application;
[0035] Fig.12 A display effect diagram of a canvas component located at the right edge provided in some embodiments of the present application;
[0036] Fig.13 A display effect diagram of a canvas component located at the bottom edge provided in some embodiments of the present application;
[0037] Fig.14 A schematic diagram of dynamically adjusting the display size of a canvas component provided in some embodiments of the present application;
[0038] Fig.15 A schematic diagram of a process for setting a display size according to audio waveform parameters provided in some embodiments of the present application;
[0039] Fig.16 Some embodiments of the present application provide a timing diagram of a method for displaying recommended media resources by adjusting a window floating layer display range. DETAILED DESCRIPTION
[0040] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.
[0041] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and common meanings.
[0042] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.
[0043] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.
[0044] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.
[0045] In the embodiment of the present application, the display device 200 generally refers to a device with image display and data processing capabilities. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.
[0046] Figure 1This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG. 1 , a user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. The control device 100 is used to receive operation instructions input by the user and convert the operation instructions into control instructions that can be recognized and responded to by the display device 200. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.
[0047] In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, and the display device 200 is controlled wirelessly or wired. The user may control the display device 200 by inputting user commands through buttons on the remote controller, voice input, control panel input, etc.
[0048] The mobile terminal 300 can be used as a control device for performing human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 and performing data interaction. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.
[0049] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application program for controlling the display device 200 .
[0050] like Figure 1 As also shown in FIG. 4 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.
[0051] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.
[0052] Figure 2 A hardware configuration block diagram of a display device 200 provided for some embodiments of the present application.
[0053] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.
[0054] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.
[0055] In some embodiments, the device interface 240 may include, but is not limited to, a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. The device interface 240 may also be a composite input / output interface formed by the above multiple interfaces.
[0056] The display device 200 can be connected to the external device 500 through the device interface 240. The external device 500 can be a set-top box, a game console, a PC, etc. When the display device 200 is connected to the external device 500 through the device interface 240, a corresponding signal source channel can be established, and an input signal can be received through the signal source channel. For example, the display device 200 can be connected to a game device through an HDMI interface to establish an HDMI channel, and receive audio and video signals sent by the game device based on the HDMI channel.
[0057] In some embodiments, the display 260 includes a display function component for presenting a picture, and a driving component for driving an image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, and components of a menu control interface and a user control UI interface.
[0058] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication modes. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.
[0059] The communication device 220 can enable the display device 200 to communicate with the external device or server 400 by wireless or wired connection. Among them, the wired connection can connect the display device 200 with the external device through components such as data cables and interfaces. The wireless connection can connect the display device 200 with the external device through wireless signals or wireless networks. The display device 200 can establish a connection relationship with the external device directly, or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.
[0060] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first interface to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.
[0061] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
[0062] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).
[0063] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or may be an external audio output device of the display device 200. In particular, for the external audio output device of the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.
[0064] In some embodiments, the user input interface 280 may be used to receive instructions from a user.
[0065] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface, for example, the operating system can directly control the display device to provide a user interface, or can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.
[0066] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.
[0067] The operating system can be divided into different modules or levels according to the functions implemented. For example, in some embodiments, Figure 3 As shown, taking the Android system as an example, the system is divided into four layers, from top to bottom, namely, the application layer (Applications layer) (referred to as "application layer"), the application framework layer (Application Framework layer) (referred to as "framework layer"), the system library layer and the kernel layer. In some embodiments, the operating system of the display device can also be other operating systems.
[0068] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on the applications. At least one application can be run in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. that come with the operating system; they can also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.
[0069] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access system resources and obtain system services during execution.
[0070] like Figure 3As shown, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to the application package currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.
[0071] In some embodiments, the activity manager is used to manage the life cycle of each application and the usual navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes, for example, reducing the display window, shaking the display, distorting the display, etc.
[0072] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.
[0073] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 3 As shown, the kernel layer may be configured with hardware drivers, and the drivers included in the kernel layer may be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.
[0074] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.
[0075] In some embodiments, the display device 200 can automatically play media data when executing a specific process or displaying a specific interface. The specific process may be a process that needs to be guided, or has a long operating cycle, or requires an interface refresh. Such as a boot process, an application installation process, a software upgrade process, etc. The specific interface may be an interface with a long rendering cycle, or with a recommendation function, or a comprehensive function. Such as a homepage interface, a media recommendation interface, an application interface, etc. The automatically played media data may be a video with a logo function, an information promotion function, an operation guidance function, a feature display function, etc. Such as a boot animation, a splash screen advertisement, a homepage recommendation video, a media trailer, etc.
[0076] It should be noted that, in the embodiments of the present application, media data generally refers to multimedia resources that require a certain amount of time to display. The media data can be conventional video media with video and audio content, or pure image video without sound, such as dynamic images, static images, text, etc. In some embodiments, the automatically played material can also be media without image content, such as media content with pure audio data. For ease of description, in the embodiments of the present application, the media data that is automatically played when a specific process is executed or a specific interface is displayed is referred to as recommended media data.
[0077] In some embodiments, the display device 200 can recommend media data playback through the synergy between the operating system, UI applications, and service processes. Among them, the operating system can provide a basic operating environment that allows applications and advertising services to run. In addition, the operating system can also provide various application interfaces (APIs) to allow applications to interact with system services. UI applications such as JUUI are used to present user interfaces. UI applications can provide interfaces for direct user interaction, and the interface can include a media display area. When an application needs to display recommended media data, the UI application will request the advertising service (ADservice) and other media service processes through the API to send the recommended media data to be displayed. The media service can be a built-in media recommendation system or a third-party service, such as ××AdMob, etc. The media service can provide media data content, including the loading, display, tracking, and interaction between users and the media playback process of media data.
[0078] Taking the display of a splash screen advertisement as an example, when displaying an advertisement, a UI application such as JUUI initiates an advertisement request by calling the API of the advertisement service. After receiving the request, the advertisement service obtains the advertisement content from the server 400 or the local storage. After obtaining the advertisement content, the advertisement service passes the advertisement content to the UI application through the API. The UI application renders the advertisement content on the user interface, that is, displays the advertisement content in the advertisement display area of the user interface.
[0079] The recommended media data may have different uses according to the specific process executed or the specific interface displayed by the display device 200. The media data for different uses may contain different contents and have different forms. The automatically played media data may come from the local storage of the display device 200 or from the server 400. The media data from the local storage may be stored in different media according to different uses.
[0080] In some embodiments, the media data used to form the boot animation may be a static image or dynamic image file built into the system file; the media data used to form the boot advertisement may be a video file stored in the boot call storage space; the media data used to form the interface guidance may be a video or image file contained in the interface configuration file; the media data used to form the homepage pop-up advertisement may be a video or image file pushed by the server 400.
[0081] In some embodiments, the display device 200 can obtain the recommended media data by parsing the system file. For example, when the display device 200 executes the boot process, it can obtain the recommended media data by reading the file name and storage address of the recommended media data set in the boot process and accessing the corresponding storage address.
[0082] In some embodiments, the display device 200 may also obtain the recommended media asset data by parsing the interface configuration file. For example, when the display device 200 displays the setting interface for the first time, it may extract the guide media asset data according to the guide video storage address recorded in the configuration file corresponding to the setting interface.
[0083] In some embodiments, the display device 200 may also send a media asset acquisition request to the server 400, so that the server 400 can feed back recommended media asset data to the display device 200 according to the media asset acquisition request. For example, when the display device 200 displays the media asset recommendation interface, it will send a media asset acquisition request to the server 400 before presenting the media asset recommendation interface. After receiving the media asset acquisition request, the server 400 extracts relevant media asset data from the database according to the type of the current interface to be displayed (i.e., the media asset recommendation interface) and the delivery strategy.
[0084] After obtaining the recommended media data, the display device 200 can call the relevant application to play it according to the specific type of the recommended media data. For example, for video type materials, the display device 200 can call a video player, and decode the media data through the video player to form a playback screen of the media data, and display the playback screen through the display 260.
[0085] In some embodiments, the recommended media asset data can be started through a related process, and the playback ends with the running status of the process or the rendering progress of the interface. Taking the playback process of the splash screen advertisement on the home page interface as an example, after the display device 200 is powered on, it will run the rendering process of the home page interface through the home page application. According to the rendering process of the home page interface, the advertising video media asset data can be requested from the advertising system through the advertising service. After the advertising system sends the advertising data, the display device 200 can receive the advertising data through the advertising service application, and decode and play the advertising data to form a splash screen advertisement. After the splash screen advertisement ends, or the playback time reaches the preset delivery time requirement, the display device 200 can cancel the display of the splash screen advertisement, and then display the home page interface.
[0086] In some embodiments, the playback screen of the recommended media asset data can be displayed through a separate interface. For example, during the boot-up process, the display device 200 can first display the boot-up interface, which can first display the brand logo, and then display system information and other content, and switch to display the boot-up video interface as the boot-up process progresses. After the boot-up video is played, the display device 200 switches to display the home page interface. That is, in the above display process, the boot-up interface, the boot-up video interface, and the home page interface are three independent interfaces.
[0087] In some embodiments, the playback screen of the recommended media asset data may also be displayed in a separate window in the interface to be displayed. Figure 4 As shown, the separate window for displaying the recommended media asset data playback screen may be a part of the interface to be displayed, such as an animation window, a specific position recommendation position, etc. in the interface to be displayed. Figure 5 As shown, the separate window for displaying the recommended media asset data playback screen may also be a floating window of the interface to be displayed.
[0088] In some embodiments, the display device 200 also supports interruption of playback control during playback of media data, that is, the display device 200 can control the stop of playback of media data by receiving an interruption instruction input by the user, or automatically generating an interruption instruction according to the running state, and display the user interface that should be displayed after the playback of the media data.
[0089] For example, when the display device 200 displays the home page interface for the first time after being powered on, a splash screen video may be displayed. The splash screen video may be displayed for 15 seconds according to the delivery strategy, that is, the splash screen video stops playing and the home page interface is displayed after playing for 15 seconds. During the splash screen video, the user may skip the splash screen video by pressing the return key on the control device 100, that is, input an interrupt command, and control the display device 200 to directly display the home page interface.
[0090] In some embodiments, the display device 200 may also support user interactive control when playing the recommended media data. That is, the display device 200 may receive control instructions input by the user during the display of the recommended media data playback screen, and different control instructions may control the display device 200 to perform different functional responses. For example, the user may control the display device 200 to stop playing the recommended media data by pressing the return key on the remote control. The user may also control the display device to switch to the detailed interface associated with the recommended media data by using the arrow keys.
[0091] During the display of the recommended media asset data, the display device 200 may display different user interfaces in response to different user interaction controls. In some embodiments, the display device 200 may display the user interface blocked by the playback image, i.e., the interface to be displayed, in response to the user interaction control. Figure 6 As shown, when the display device 200 is displaying a splash screen advertisement on the home page interface, the user presses the "return key" of the control device 100 to control the skipping of the splash screen advertisement, and the display device 200 can display the home page interface.
[0092] In some embodiments, the display device 200 may display a user interface associated with the recommended media resource, namely, a detailed interface, in response to the user's interactive control. Figure 7 As shown, when the display device 200 displays the splash screen advertisement on the home page interface, and the splash screen advertisement involves product A, the user presses the "confirm key" of the control device 100 to control the display device 200 to jump to the product details interface displaying product A.
[0093] It should be noted that in the embodiment of the present application, the user interface covered by the recommended media asset playback screen (interface to be displayed) and the user interface (details interface) jumped based on the recommended media asset playback screen are collectively referred to as a jump interface. Obviously, the jump interface refers to the user interface that can be displayed by the display device 200 in response to user interaction control, that is, the jump interface is the target interface specified by the display instruction or the details interface associated with the recommended media asset data.
[0094] In some embodiments, in order to present the jump interface content, the display device 200 can perform a recommended media display method to simultaneously display the playback screen of the recommended media and the jump interface content that matches the recommended media in the same interface space. Figure 8 As shown, the recommended media resource display method includes the following contents:
[0095] S100: In response to a display instruction, create a window floating layer.
[0096] The display device 200 can receive control instructions of different functions, and some control instructions can trigger the display device 200 to display the recommended media asset playback screen, which is called a display instruction. The recommended media asset playback screen is a screen generated by playing the recommended media asset data.
[0097] In some embodiments, the display instruction is used to trigger the display of the target page, and the target page triggers the creation of a window floating layer according to the media resource request tag, and the request for recommended media resource data. In some embodiments, since the display device 200 can display the recommended media resource playback screen in the form of a boot animation when it is powered on, the display instruction can be a control instruction for controlling the power on of the display device 200. For example, the display instruction can be input by pressing the power button on the control device 100 such as a remote controller.
[0098] In some embodiments, since the display device 200 can display the recommended media asset playback screen in the form of an open-screen media asset when displaying a specific user interface, the display instruction can be a control instruction for controlling the display device 200 to display a target interface. The target interface refers to a user interface that can present an open-screen media asset screen when displayed, such as a homepage interface, a media asset recommendation interface, an application interface, etc.
[0099] Depending on the type of target interface displayed by the display device 200, the display command can be input in different ways. For example, the home page interface display command can be input through the home button on the remote control, or triggered by exiting the application or exiting the non-home page interface. The application start command is input through the direction key and the confirmation key on the remote control, in conjunction with the focus mark in the application list interface.
[0100] In some embodiments, when the display device 200 supports voice interaction, touch interaction, somatosensory or gesture interaction, etc., the control instruction for triggering the automatic playback of video materials can also be input through the interaction method supported by the display device 200. For example, the user inputs a voice instruction with the content "display the home page interface" to input a display instruction to control the display device 200 to jump to the home page interface.
[0101] When the display instruction is a control instruction for controlling the display device 200 to display a target interface, after receiving the display instruction, the display device 200 may acquire the interface data of the target interface in response to the display instruction.
[0102] In some embodiments, the display device 200 may obtain interface data from the server 400. To this end, an interface application may be run in the display device 200, and an interface service system may be configured in the server 400. Taking the interface application as a JUUI application as an example, after receiving a display instruction for displaying a home page interface, the display device 200 may run the JUUI application. The JUUI application sends an interface data acquisition request to the home page service system of the server 400 according to the display instruction. The home page service system then sends the home page interface data to the display device 200 according to the interface data acquisition request.
[0103] After acquiring the interface data, the display device 200 may also parse the interface data and perform display control according to the results of the interface data parsing.
[0104] In some embodiments, the display device 200 may parse a media resource request tag from the interface data, where the media resource request tag is used to determine whether the current target interface supports displaying an open-screen media resource image.
[0105] If the target interface supports displaying the recommended media asset screen, the target interface may include at least one media asset request mark, wherein the media asset request mark is used to indicate that the opening screen media asset screen is displayed before the target interface is displayed.
[0106] If the media resource request tag is not parsed from the interface data, that is, the currently displayed target interface does not need to display the recommended media resource data, the display device 200 can generate the target interface according to the interface data through the interface application, and display the target interface. In some embodiments, taking the interface application as a JUUI application as an example, after the display device 200 obtains the interface data sent by the server 400, it can parse the media resource request tag "Adtag" from the interface data through the JUUI application. When it is determined by parsing the data that the interface data does not contain the media resource request tag "Adtag", the JUUI application can render the homepage interface according to the interface data. That is, the display device 200 can first parse the interface data into a format such as JSON, XML, etc. that the application can understand. The JUUI application then maps the parsed interface data to the data model of the Java or Kotlin class of the application. Bind the data model to the UI component. Then use the data in the data model to update the UI component. And re-render the view according to the updated UI component state.
[0107] If a media resource request tag is parsed from the interface data, that is, the currently displayed target interface needs to display recommended media resource data, the display device 200 can generate the target interface according to the interface data through the interface application, and obtain the recommended media resource data through the media resource service. The media resource service is used to obtain recommended media resource data, such as advertising service (Adservice), etc. In order to obtain recommended media resource data, the server 400 can also be configured with a media resource service system for storing and issuing recommended media resource data.
[0108] In some embodiments, the display device 200 can obtain the recommended media data from the local storage. For example, when the display device 200 is not connected to the network or the network configuration is not yet completed, the recommended media data can be obtained from the local storage. That is, the display device 200 also includes a memory, and the memory is configured to store the recommended media data. Before displaying the target interface, the display device 200 can generate a data call request and send the data call request to the memory to obtain the recommended media data stored in the memory.
[0109] In some embodiments, the media resource request mark used to determine whether the target interface needs to display the recommended media resource data can also be stored in a local configuration file. After receiving the display instruction, the display device 200 can read the configuration file from the local to perform display control according to whether the configuration file contains the media resource request mark.
[0110] For example, the configuration file of the target interface may include interface configuration parameters corresponding to the interface rendering process. When the display device 200 displays the target interface, it may perform the interface rendering and display process according to the configuration parameters. When the display device 200 executes a specific step, it may read the media resource request tag "Adtag". Then, the advertising service is called according to the media resource request tag to obtain the opening screen advertising material.
[0111] In some embodiments, the display device 200 can obtain the recommended media data from the local storage. When the display device 200 is not connected to the network or the network configuration is not completed, the recommended media data can be obtained from the local storage. That is, the display device 200 also includes a memory, and the memory is configured to store the recommended media data. Before displaying the target interface, the display device 200 can generate a data call request and send the data call request to the memory to obtain the recommended media data stored in the memory.
[0112] In some embodiments, Fig. 9As shown, the display device 200 can obtain the recommended media asset data through the server 400. That is, the display device 200 can read the media asset request tag of the target interface, wherein the target interface is the user interface displayed by the display device after displaying the recommended media asset playback screen, that is, the target interface. Then, a media asset acquisition request is generated according to the media asset request tag, and the media asset acquisition request is sent to the server 400, so that the server 400 feeds back the recommended media asset data according to the media asset acquisition request. The display device 200 then receives the recommended media asset data fed back by the server 400.
[0113] like Fig.10 As shown, in some embodiments, taking the opening screen advertisement display process of the home page interface as an example, the display device 200 may be configured with a home page application and an advertisement service application. The server 400 is configured with an advertisement system. After obtaining the display instruction for displaying the home page interface, the display device 200 may run the home page rendering and display process through the home page application. And after reading the media resource request tag, the media resource code (AdCode) is read from the media resource request tag. An advertisement acquisition request is generated according to the AdCode. The advertisement acquisition request is sent to the server 400 through the advertisement service to request advertisement data from the advertisement system in the server 400. After receiving the advertisement acquisition request, the advertisement system may read the AdCode. According to the AdCode and the current advertisement delivery strategy, the advertisement media resource data corresponding to the home page interface is issued. The advertisement media resource data may contain all the information of the advertisement material. The advertisement service then returns the advertisement data to the home page application for later display of the advertisement content.
[0114] After receiving the recommended media data, the display device 200 can create a window floating layer. The display level of the window floating layer is higher than the display level of the current user interface. Taking the display of the home page interface as an example, after receiving the advertising data, the display device 200 can create a transparent window floating layer, and the page display level of the window floating layer is above the home page interface. The window floating layer can be used to display the media playback screen.
[0115] In the process of creating a window floating layer, the display device 200 can create a window floating layer through the homepage application. Fig.10 As shown, after the advertising service application receives the recommended media asset data, the advertising service application can send the recommended media asset data to the homepage application. The homepage application then creates a window floating layer based on the homepage interface display container according to the recommended media asset data. In order to facilitate the control of the created window, the window floating layer created by the homepage application belongs to the homepage interface display container, but the display level is higher than other components in the homepage interface display container.
[0116] The display device 200 can also create a window pop-up layer through the advertising service application. Fig.11 As shown, after receiving the recommended media asset data, the advertising service application can create a window floating layer according to the recommended media asset data. The window floating layer created by the advertising service application may not belong to the interface display container of the home page interface, that is, the home page interface display container is window A, and the window floating layer created by the advertising service application is window B. Among them, the display level of window B is higher than that of window A.
[0117] S200: Loading recommended media asset data in the window floating layer to play the recommended media asset data.
[0118] After creating the window floating layer, the display device 200 loads the recommended media asset data in the window floating layer and calls the player to decode the recommended media asset data to play the recommended media asset data. During the playback process, an advertisement playback component can be dynamically created according to the layout data of the interface control. The advertisement playback component can load the advertisement video and display the playback screen of the recommended media asset after the video is loaded.
[0119] In some embodiments, the recommended media asset data acquired by the display device 200 may include the media asset data body and related information associated with the media asset data body, such as name (media asset ID), display duration, display type identifier, etc. After acquiring the recommended media asset data, the display device 200 may also read the acquired recommended media asset data to determine whether the recommended media asset data is associated with a jump interface.
[0120] In some embodiments, the display device 200 can determine whether the recommended media asset data is associated with the jump interface according to the read media asset ID or display type identifier. For example, after reading the media asset ID, the display device 200 determines the media asset category to which the media asset ID belongs. If the media asset ID belongs to the first type of media asset set that is not associated with the jump interface, the recommended media asset data can be loaded in the window floating layer, and the playback screen of the recommended media asset data can be directly displayed through the window floating layer.
[0121] If the media asset ID belongs to the second type of media asset set associated with the jump interface, after loading the recommended media asset data in the window floating layer, instead of directly displaying the playback screen of the recommended media asset data through the window floating layer, a canvas component is created on the window floating layer to display the associated jump interface content.
[0122] S300: Creating a canvas component on the window floating layer.
[0123] In some embodiments, the recommended media data is associated with a jump application. After adding the recommended media playback screen to the window floating layer, the display device 200 can create a canvas component on the window floating layer. Among them, the Canvas component is a class for drawing graphics, which is a core drawing component of the operating system. Canvas can provide a series of drawing methods to draw shapes, texts, pictures and other graphic objects on the user interface of the application.
[0124] In some embodiments, the display device determines whether to associate a jump page based on a predetermined parameter in the media asset data. If yes, a canvas component is created on the window floating layer, otherwise, no canvas component is created.
[0125] In some embodiments, a Canvas object can be created in the onCreate or onSizeChanged method of a custom view (View). Basic shapes can be drawn using methods such as drawRect, drawOval, drawArc, and drawLine. Complex paths can be drawn using the drawPath method, which can be defined using the Path class. Text can be drawn on the canvas using the drawText method. Bitmap images can be drawn using the drawBitmap method, or Picture objects can be drawn using the drawPicture method. The color and brush style used for drawing can be set using methods such as setColor and setStyle. Also, methods such as clipRect, clipPath, rotate, scale, and translate can be used to crop and geometrically transform the canvas. Use the save and restore methods to save and restore the state of the canvas.
[0126] The canvas component can be presented at different positions of the current display interface according to the material effect of the recommended media data. For example, the left edge, right edge, top edge, bottom edge and other areas of the interface are displayed and part of the window floating layer is blocked. It should be understood that the present embodiment of the present application takes the presentation of the canvas component at the right edge of the display screen as an example to illustrate the scheme, such as Fig.12 The same scheme can be applied to the left edge, top edge, and bottom edge (as shown in Fig.13 As shown in the figure, and other areas are displayed, the specific display effects will not be described in detail.
[0127] The display level of the canvas component can be higher than the display level of the recommended media playback screen in the window floating layer. Therefore, the canvas component can be used to present the jump interface image to display the screen content of the jump interface. In order to take into account the content display of the recommended media playback screen and the jump interface. In some embodiments, the display size of the canvas component is dynamically adjusted according to a preset frequency. After the display size is dynamically adjusted according to the preset frequency, the screen presented on the canvas component can form a parallel space-time effect that fluctuates according to a regular pattern to prompt the user to the specific content of the jump interface.
[0128] The display size may be the width and / or height of the canvas component. In some embodiments, the width of the canvas component is dynamically adjusted according to a preset frequency. Fig.14 As shown, when the display device 200 plays the recommended media asset data, the width of the display area corresponding to the jump interface is dynamically adjusted according to the preset frequency. For example, when playing to 00:00:01s of the recommended media asset, the width of the jump interface area is W1. When playing to 00:00:02s of the recommended media asset, the width of the jump interface area is adjusted to W2. When playing to 00:00:03s of the recommended media asset, the width of the jump interface area is adjusted back to W1. When playing to 00:00:04s of the recommended media asset, the width of the jump interface area is adjusted to W2 again. Therefore, a parallel space-time display effect that swings left and right can be obtained.
[0129] In some embodiments, the dynamically adjustable display size of the canvas component is related to the key interaction method supported by the display device 200 during the playback of the recommended media asset data. That is, the display device 200 can obtain the key value used to control the jump to the jump interface, and determine the fluctuation direction according to the key value. Then determine the adjustable display size of the canvas component according to the fluctuation direction. For example, when the display device 200 is playing a splash screen advertisement, the user presses the left direction key to control the display device 200 to jump to the splash screen advertisement product details interface. The display device 200 can determine that the key value for controlling the jump to the jump interface is "KEYCODE_DPAD_LEFT", and the corresponding fluctuation direction is horizontal, that is, left and right. Therefore, the width of the canvas component can be dynamically adjusted according to the preset frequency.
[0130] In some embodiments, in order to reduce the obstruction of the recommended media playback screen by the jump interface content, the display device 200 can also set the display area range of the canvas component. That is, the display device 200 can obtain the current screen size of the display 260 and the target control size of the jump interface image. Then set the minimum display size of the canvas component according to the current screen size. And, set the maximum display size of the canvas component according to the target control size. Thus, the real-time display size of the canvas component is set according to the preset frequency. Among them, the real-time display size changes periodically within the fluctuation range according to the preset frequency.
[0131] For example, for the splash screen advertisement playback process of the homepage interface, the display device 200 can first read the splash screen advertisement product details interface. Determine the control width Wb of the "Buy Now" control located on the far right in the product details interface. And determine the maximum display size W1 of the canvas component based on the control width of the "Buy Now" control, that is, W1=Wb. At the same time, obtain the current screen size. According to the screen width Ws in the screen size, determine the minimum display size W2 of the canvas component, such as W2=Ws / 20. Thereby determining the fluctuation interval, that is, [Ws / 20, Wb]. Make the display width of the canvas control change periodically in the fluctuation interval [Ws / 20, Wb] according to the preset frequency.
[0132] In some embodiments, the preset frequency in the process of adjusting the display size of the canvas component can be set according to the application scenario of the display device 200. That is, the display device 200 can obtain the user interface type corresponding to the display instruction, and determine the application scenario according to the user interface type. And set the preset frequency according to the application scenario. For example, for the display process of the home page interface splash screen advertisement, the display device 200 can determine that the application scenario is a TV scene according to the home page interface. Then obtain the sine wave frequency applicable to the TV scene, so that the display device 200 adjusts the width of the jump interface display area according to the sine wave law.
[0133] In some embodiments, the canvas component is dynamically adjusted at a preset frequency, and can also be set according to the currently playing recommended media asset data. Fig.15 As shown, the display device 200 can extract the audio track information from the recommended media asset data, and then extract the audio waveform parameters from the audio track information. Then traverse the waveform characteristic values in the audio waveform parameters, and the waveform characteristic values include the maximum peak value, the minimum trough value, and the intermediate fluctuation value. And set the minimum display size Wmin of the canvas component according to the maximum peak value. Then set the maximum display size Wmax of the canvas component according to the minimum trough value. Generate the preset frequency according to the intermediate fluctuation value to dynamically adjust the display size W of the canvas component according to the preset frequency.
[0134] For example, for the splash screen advertisement playback scenario of the home page interface, after the display device 200 obtains the recommended media asset data corresponding to the splash screen advertisement, it can extract the audio track information from the recommended media asset data. Then extract the loudness waveform parameters of the bass audio in the audio track information. And determine the maximum loudness of the bass and the minimum loudness of the bass. Then, according to the two waveform feature values of the extracted maximum loudness of the bass and the minimum loudness of the bass, set the minimum display size and the maximum display size respectively. After setting the minimum display size and the maximum display size, the display device 200 can obtain the bass loudness in real time. Then dynamically adjust the width of the canvas component according to the bass loudness to achieve the effect that the product details interface image moves with the rhythm of the advertising audio.
[0135] S400: Acquire a jump interface image, and load the jump interface image into the canvas component.
[0136] After creating the canvas component, the display device 200 can obtain a jump interface image. The jump interface image is an image generated based on the jump interface. The jump interface is a target interface or a detail interface associated with the recommended media asset data. The display device 200 can determine the jump interface type according to the recommended media asset type. That is, when the recommended media asset has an associated jump interface, the jump interface is a detail interface. When the recommended media asset does not have an associated jump interface, the jump interface is a target interface.
[0137] Based on this, the display device 200 can obtain the jump interface image in different ways according to different types of jump interfaces. In some embodiments, the jump interface information associated with the recommended media asset is read from the recommended media asset data. If the recommended media asset has associated jump interface information, the jump interface image is generated according to the jump interface information. If the recommended media asset does not have associated jump interface information, the jump interface image is generated according to the target interface.
[0138] In some embodiments, the display device 200 can create a canvas component and start running the jump interface application according to the jump interface application associated with the recommended media asset data after obtaining the display instruction and creating a window floating layer in response to the display instruction. The jump interface application can create a jump interface display container. Among them, the display level of the jump interface display container is lower than the window floating layer. The jump interface display container is used to display the jump interface. After the jump interface application is started, it requests the jump interface data from the server 400, and then loads the jump interface data into the jump interface display container to form and display the jump interface on the jump interface display container.
[0139] Since the display level of the jump interface display container is lower than the window floating layer, and the window floating layer is used to display the playback screen of the recommended media data, after the jump interface is formed on the jump interface display container, the jump interface is covered or partially covered by the playback screen of the recommended media data, and will not be fully displayed in the current user interface, reducing the impact on the normal display process of the recommended media playback screen.
[0140] After the jump interface is formed, the display device 200 can enable a screenshot process, or a screenshot tool built into the interface application, the media service application, or the jump application to take a screenshot of the jump interface to generate the jump interface image.
[0141] For example, when displaying a splash screen advertisement on a home page interface, the display device 200 can create a home page interface display container and a window floating layer through a home page application in response to a display instruction of the home page interface. The creation of the home page interface display container is used to generate the home page interface. The window floating layer is used to display the playback screen of the advertising material.
[0142] After creating the home page interface display container and the window floating layer, the display device 200 can run the advertising application associated with the home page splash screen advertisement. And create an interface display container for the advertising details page interface through the advertising application. The advertising application then sends a data acquisition request to the details page system built into the server 400 to obtain the details page interface data sent by the details page system. Then, the details page interface data is loaded into the interface display container of the advertising details page interface to generate a product details interface.
[0143] At this time, the user interface may include three display containers, namely, a home page interface display container at the bottom layer, an advertisement detail page display container at the middle layer, and an advertisement video display container (window floating layer) at the upper layer. Different screens are displayed at different display levels through the three display containers, and a product details interface can be displayed at the lower layer of the window floating layer. The display device 200 calls the built-in screenshot tool of the advertising application to take a screenshot of the display screen at the lower layer of the window floating layer to generate an interface image of the product details interface, that is, a jump interface image.
[0144] In some embodiments, after the display device 200 creates a window floating layer, it can also detect whether a jump interface application is currently installed. After obtaining the advertising data, the display device 200 can read the jump interface information in the advertising data to identify the identification information of the jump interface application in the jump interface information, and then determine the jump interface application that needs to be started based on the identification information of the jump interface application. At this time, the display device 200 can obtain the currently installed application list and match the jump interface application based on the identification information of the jump interface application. If the application list contains the identification information of the jump interface application, that is, the jump interface application associated with the current recommended media asset data has been installed in the display device 200, the jump interface application is started.
[0145] For example, after the display device 200 obtains the advertisement data through the advertisement service application, it can read the associated application ID, i.e., the TB application, in the advertisement data. Then, the application list is obtained. If the application list includes the TB application, the advertisement service application can send a startup instruction to the TB application to start running the TB application. After the TB application is started, it can create an interface display container of the TB application and perform operations such as screenshots in the manner described in the above embodiment to generate an interface image of the TB application interface, i.e., a jump interface image.
[0146] If the application list does not contain the identification information of the jump interface application, that is, the jump interface application associated with the current recommended media data is not installed in the display device 200, then the display device 200 can display the recommended media playback screen in different ways, or obtain the jump interface image in other ways, or prompt the user through prompt information or interface jump.
[0147] In some embodiments, if the application list does not include identification information of the jump interface application, the display device 200 may only load the recommended media video in the recommended media data into the window floating layer to display the playback screen of the recommended media data.
[0148] In some embodiments, if the application list does not contain identification information of the jump interface application, the display device 200 can obtain the jump interface image according to the target interface. For example, when the display device 200 displays the splash screen advertisement of the home page interface, if the jump interface associated with the splash screen advertisement is a JD application, and the display device 200 does not currently have the JD application installed, the display device 200 can generate the home page interface through the home page application. And display the home page interface in the lower layer of the window floating layer, and then call the built-in screenshot tool of the home page application to perform a screenshot of the lower layer of the window floating layer to generate an interface image of the home page interface as the jump interface image.
[0149] In some embodiments, when the display device 200 displays a splash screen advertisement on the home page interface, if the splash screen advertisement has no associated product details interface, the display device 200 may also run a home page application and generate a home page interface according to the home page application. The home page interface is displayed in the lower layer of the window floating layer, and then a screenshot tool is called to take a screenshot of the lower layer of the window floating layer to generate an interface image of the home page interface as a jump interface image.
[0150] In some embodiments, if the application list does not contain the identification information of the jump interface application, the display device 200 may also display prompt information. For example, when it is determined that the application list does not contain the identification information of the JD application, the display device 200 may add a text component in the window floating layer through the homepage application or the advertising service application, and the text component includes text such as "Install the JD application for a surprise".
[0151] After acquiring the jump interface image, the display device 200 can also add the jump interface image to the canvas component to form a jump interface display area in the currently displayed interface. In addition, since the display size of the canvas component can be dynamically adjusted according to a preset frequency, the display area of the jump interface display area is also dynamically adjusted according to the preset frequency to achieve a fluctuation effect.
[0152] S500: Displaying the window floating layer and the canvas component to simultaneously display the recommended media resource playback screen and the jump interface image.
[0153] After the display device 200 adds the window floating layer and the canvas component to the canvas component, the display of the window floating layer and the canvas component can be maintained to display the superimposed screen of the window floating layer and the canvas component. In the displayed interface, the recommended media playback screen and the jump interface image can be presented at the same time. It can be seen that the display device 200 can use Canvas to draw pictures in real time in combination with video playback to achieve dynamic effects, so that the video and the application have the same level of effect. By displaying the recommended media content and the jump page content at the same time, the user can be prompted to watch and guided to click to jump, thereby improving the user experience.
[0154] In some embodiments, after displaying the window floating layer and the canvas component, the display device 200 can also monitor global key events. Then, in response to the monitored key events, an interactive response is performed. In the process of displaying the recommended media playback screen and the jump interface, the display device 200 can perform different control functions according to the monitored key events. Among them, the key event is generated by the user pressing a specific key. For example, when the user presses the confirmation key, the onKeyDown and onKeyUp events of "KEYCODE_ENTER" corresponding to the key value of the confirmation key can be generated.
[0155] In order to monitor key events, the display device 200 may register a key monitoring process to monitor global key events through the key monitoring process. The key monitoring process is used to monitor key events input by the user during the playback of the recommended media asset data.
[0156] Taking the jump instruction representing the display jump interface as the target direction key instruction as an example, the display device 200 can respond to the press event of the target direction key being monitored, and increase the display size of the canvas component according to the target direction key. Among them, the target direction key is used to control the display device 200 to display the detail interface. The target direction key can be set according to the display position of the canvas component. For example, when the canvas component is located in the right area of the display screen, the target direction key can be the left direction key. When the canvas component is located in the lower area of the display screen, the target direction key can be the up direction key.
[0157] In some embodiments, after monitoring the pressing event of the target direction key, the display device 200 may parse the key event of the target direction key to obtain the key direction, and then obtain the display size adjustment direction of the canvas component. If the key direction is consistent with the display size adjustment direction, in response to the pressing event of the target direction key, the display size of the canvas component is increased according to the key direction.
[0158] After increasing the display size of the canvas component according to the key direction, the display device 200 can detect the display size of the canvas component in real time, and when the display size of the canvas component increases to be equal to the screen size of the display, remove the window floating layer and the canvas component, and control the display 260 to display the details interface.
[0159] like Fig.10 , Fig.11 As shown, the process of displaying the opening screen advertisement of the home page interface is taken as an example. The display device 200 can run the home page interface application and the advertising application. Since the level of the created window floating layer is high and the advertising video is displayed in full screen. After pulling up the home page interface application and the advertising application, the home page interface and the product details interface generated by the home page interface application and the advertising application will be in the lower layer of the window floating layer. After monitoring that the user presses the left button, the home page application or the advertising service application can control the left boundary of the canvas component to move from the right side to the left side of the current interface, and the drawing area of the canvas component gradually increases. When the width of the canvas component is equal to the screen width, the real-time drawing ends. The home page application or the advertising service application can remove the Canvas canvas component and the advertising player, turn off the display of the transparent window floating layer, and display the product details interface in the foreground.
[0160] In some embodiments, if the target direction key press event is not monitored, that is, the user does not perform a key operation on a specific key during the display of the recommended media asset playback screen, the display device 200 can switch to the target interface. That is, after displaying the window floating layer and the canvas component, the display device 200 can monitor the user's press event on the target direction key based on the registered key monitoring process. If the target direction key press event is not monitored during the playback of the recommended media asset data, an end instruction is obtained. Among them, the end instruction can be generated by the display device 200 according to the recommended media asset playback process, or input by the user. That is, in some embodiments, the end instruction is generated according to the end playback event of the recommended media asset data. In the process of calling the player to play the recommended media asset data, the display device 200 can monitor the playback process, and when the playback end event is monitored, the end instruction can be generated in response to the playback end event.
[0161] In some embodiments, the end instruction may be generated in response to a key operation input by the user to indicate skipping. That is, if the display device 200 does not monitor the pressing event of the target direction key during the display of the splash screen advertisement, but monitors the pressing event of the return key, it may respond to the pressing event of the return key. Since the return key is used to skip the splash screen advertisement, the end instruction may be generated.
[0162] After obtaining the end instruction, the display device 200 can stop running the jump interface application in response to the end instruction. And remove the window floating layer and the canvas component, and control the display to display the target interface. Taking the splash screen advertisement of the home page interface as an example, after the display device 200 pulls up the home page interface application and the advertising application, the home page interface and the product details interface generated by the home page interface application and the advertising application will be in the lower layer of the window floating layer. In the process of displaying the recommended media playback screen and the advertising details interface image, the display device 200 will detect the user's pressing event of the return key. When the user's pressing event of the return key is detected, that is, "onKeyDown(KEYCODE_BACK)", the Canvas canvas component and the advertising player can be removed, and the transparent window floating layer can be closed to make the home page interface of the display device 200 displayed in the foreground.
[0163] Similarly, if the display device 200 does not detect the pressing event of the target direction key during the display of the recommended media asset playback screen, after the video playback is finished, the advertising service application can notify the home page interface application to perform a closing operation. At the same time, the Canvas canvas component and the advertising player are removed, and the transparent window floating layer is closed, so that the home page interface of the display device 200 is displayed in the foreground.
[0164] Based on the recommended media display method described in the above embodiment, some embodiments of the present application also provide a display device 200, including: a display 260, a communication device 220 and a controller 250. The display 260 is configured to display a user interface. The communication device 220 is configured to establish a communication connection with the control device 100 and the server 400. The control device 100 includes at least one button, and the control device 100 is configured to generate a button instruction in response to a user's button operation.
[0165] The controller 250 is configured to perform the following steps:
[0166] In response to a display instruction for displaying a recommended media asset playback screen, a window floating layer is created, wherein a display level of the window floating layer is higher than a display level of a current user interface;
[0167] Loading the recommended media asset data in the window floating layer to play the recommended media asset data;
[0168] Creating a canvas component on the window floating layer, wherein the display size of the canvas component is dynamically adjusted according to a preset frequency;
[0169] Acquire a jump interface image, and add the jump interface image to the canvas component, wherein the jump interface image is an image generated based on a jump interface, and the jump interface is a target interface specified by the display instruction or a detail interface associated with the recommended media asset data;
[0170] The display is controlled to display the window floating layer and the canvas component, so as to simultaneously display the recommended media resource playback screen and the jump interface image.
[0171] It can be seen from the above technical solutions that some embodiments of the present application provide a display device and a method for displaying recommended media assets. When displaying the recommended media asset playback screen, the method creates a window floating layer to play the playback screen of the recommended media asset data. A canvas component whose display size is dynamically adjusted according to a preset frequency is created on the window floating layer to display a jump interface image. Then, by displaying the window floating layer and the canvas component, the effect of simultaneously displaying the recommended media asset playback screen and the jump interface is achieved. The method can match a jump interface that matches the recommended media asset while displaying the recommended media asset, and display it in the same interface space, and supports users to interact with the jump interface, which can enrich the user's visual experience and solve the problem that the display form of the recommended media asset is single and not conducive to performing interactive operations.
[0172] In some embodiments, the display device 200 can also obtain the same recommended media display effect as the above embodiment by adjusting the display range of the media playback screen. Fig.16As shown, the display device 200 runs the target interface application in response to the display instruction for displaying the target interface according to the recommended media resource display method provided in the above embodiment. The target interface application creates a target interface display container and obtains interface data, and then loads the target interface data from the interface display container to form the target interface.
[0173] The target interface application then creates a window floating layer, and obtains recommended media asset data from the media asset system of the server 400 through the media asset service application. At this time, the display device 200 can synchronously start and run the jump interface application. The jump interface application can create a jump interface display container and obtain jump interface data from the jump interface system of the server 400. Among them, the jump interface display container is used for display to generate a jump interface. The display level of the jump interface display container is lower than the window floating layer.
[0174] After acquiring the jump interface data, the display device 200 loads the jump interface data into the jump interface display container through the jump interface application to form and display the jump interface on the jump interface display container. At this time, the user interface may include three display containers, namely, the target interface display container at the bottom layer, the jump interface display container at the middle layer, and the window floating layer at the top layer. That is, the display device 200 forms a user interface by superimposing the screens of the three display containers.
[0175] In order to display the recommended media playback screen and the jump interface in the same interface space, the display device 200 can dynamically set the display area of the window floating layer through the target interface application or the media service application. After the display area of the window floating layer is dynamically set, the display area of the window floating layer can also be dynamically changed according to a preset frequency to dynamically increase or reduce the occlusion area of the jump interface by the recommended media playback screen.
[0176] Taking the display process of the home page interface splash screen advertisement as an example, after receiving the home page display instruction input by the user, the display device 200 can run the home page application. After the home page application is running, it can create a home page display container (Window A) and send an interface data request to the home page service system of the server to obtain the home page interface data. Then, the home page interface data is loaded into Window A to form the home page interface.
[0177] When the home page interface data includes a media resource request tag, the home page application can create a window floating layer (Window B), and send an advertisement data acquisition request to the advertisement system of the server 400 through the advertisement service application to acquire advertisement data, and then load the advertisement data into Window B to form an advertisement playing screen.
[0178] After acquiring the advertisement data, the homepage application can also read the advertisement data to determine the jump interface application associated with the current advertisement data, namely, the TB application. If the TB application is currently installed in the display device 200, the homepage application can send a startup instruction to the TB application. The TB application can start running in response to the startup instruction. A jump interface display container (Window C) is created, and a jump interface data acquisition request is sent to the jump interface service system of the server 400 to obtain the jump interface data. After acquiring the jump interface data, the TB application loads the jump interface data into Window C to form a TB application interface, namely, a jump interface.
[0179] At this time, in the user interface displayed by the display device 200, the display levels of each display container from low to high are Window A, Window C, and Window B. In order to obtain the effect of displaying the recommended media asset playback screen and the jump interface in the same interface space, the homepage application can dynamically adjust the display width of Window B according to a preset frequency during the process of Window B displaying the playback screen of the advertising data, so that the advertising playback screen covers part of the application interface of the TB application, so that the uncovered part of the application interface can be seen by the user.
[0180] In some embodiments, the covered area changes dynamically according to a preset frequency, that is, the homepage application or the advertising service application can dynamically adjust the display width of Window B according to a preset frequency.
[0181] In some embodiments, the display device 200 may also adjust the window floating layer display area according to the preset frequency in the manner of adjusting the canvas component in the above embodiment, that is, adjust the display width or height of the window floating layer. For example, when the display device 200 plays the recommended media asset data, the width of the display area corresponding to the recommended media asset playback screen in the window floating layer is dynamically adjusted according to the preset frequency. When playing to 00:00:01s of the recommended media asset, the width of the display area of the recommended media asset playback screen is W3. When playing to 00:00:02s of the recommended media asset, the width of the display area of the recommended media asset playback screen is adjusted to W4. When playing to 00:00:03s of the recommended media asset, the width of the display area of the recommended media asset playback screen is adjusted back to W3. When playing to 00:00:04s of the recommended media asset, the width of the display area of the recommended media asset playback screen is adjusted to W4 again. Therefore, a parallel space-time display effect of swinging left and right can be obtained.
[0182] Similarly, the preset frequency can also be set according to the way of adjusting the canvas component in the above embodiment, according to the current screen size and the target control size in the jump interface, or according to the audio track information in the recommended media data currently being played, which will not be repeated here.
[0183] In some embodiments, the display device 200 may also receive an end instruction. If the end instruction is used to control the display device 200 to skip the advertisement display home page interface, such as the end instruction input by the user by pressing the return key on the control device 100, or by recording the playback time of the advertisement data (i.e., the display time of Window B), when the playback time reaches the advertisement display time threshold, an end instruction is generated. The display device 200 may stop playing the advertisement data in response to the end instruction and jump to the display home page interface. That is, the window floating layer used to display the advertisement data is destroyed. At the same time, the jump application such as the TB application is stopped, and the jump interface display container is destroyed, so that the user interface of the display device 200 no longer contains the advertisement content and the jump interface content, and the home page interface is displayed.
[0184] If the end instruction is used to control the display device 200 to display the jump interface, such as the end instruction input by the user by pressing the left direction key on the control device 100, the display device 200 can respond to the end instruction, stop playing the advertisement data, and jump to display the jump interface. That is, the window floating layer used to display the advertisement data is destroyed. At the same time, the jump application such as the TB application is set to the foreground running state, so that the display device 200 displays the application interface of the TB application.
[0185] In some embodiments, in order to reduce the occupation of hardware resources by applications, the display device 200 can control the closing of some applications according to the execution subject when receiving the end instruction to display the corresponding interface. For example, when the end instruction is used to control the display device 200 to display the home page interface, if the window pop-up layer (Window B) used to display the advertising screen is created by the home page application, the home page application can send a close instruction to the advertising service application while destroying the window pop-up layer to close the advertising service application. It should be noted that since the advertising service application can be used to obtain advertising media data, and the home page application may also display advertising content in some cases, such as when the home page includes an advertising recommendation position, the advertising service application may not be closed. If the window pop-up layer used to display the advertising screen is created by the advertising service application, the advertising service application can destroy the window pop-up layer and set the home page application to the foreground running state.
[0186] When the end instruction is used to control the display device 200 to display the jump interface, if the window floating layer (Window B) displaying the advertisement screen is created by the homepage application, the homepage application can send a close instruction to the advertisement service application while destroying the window floating layer to close the advertisement service application. In addition, the homepage application can set the jump interface application to the foreground running state, and the homepage application enters the background running state. If the window floating layer for displaying the advertisement screen is created by the advertisement service application, the advertisement service application can destroy the window floating layer, set the jump interface application to the foreground running state, and set the homepage application to the background running state.
[0187] It can be seen from the above technical solutions that the recommended media display method provided in the above embodiments, when displaying the recommended media playback screen, creates a window floating layer to play the playback screen of the recommended media data. At the same time, the jump interface application is started and the jump interface is displayed in the lower layer of the window floating layer. Then, the display range of the window floating layer is adjusted according to the preset frequency to achieve the effect of displaying the recommended media playback screen and the jump interface at the same time. The method can match the jump interface that matches the recommended media while displaying the recommended media, and display it in the same interface space, and supports users to interact with the jump interface, which can enrich the user's visual experience and solve the problem that the display form of the recommended media is single and not conducive to performing interactive operations.
[0188] The same and similar parts between the various embodiments in this specification can be referenced to each other and will not be described again here.
[0189] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of various embodiments of the present invention or certain parts of the embodiments.
[0190] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
[0191] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.
Claims
1. A display device, characterized in that: include: a display configured to display a user interface; A communication device, configured to establish a communication connection with a control device and a server, wherein the control device includes at least one key, and the control device is configured to generate a key instruction in response to a key operation of a user; The controller is configured as: In response to the input control instruction for displaying the target interface, displaying the target interface; When a media resource request mark exists on the target interface, request recommended media resource data and create a window floating layer, wherein the display level of the window floating layer is higher than the display level of the current user interface; Loading the recommended media asset data in the window floating layer to play the recommended media asset data; Creating a canvas component on the window floating layer, and starting a jump interface application, wherein the canvas component covers a portion of the window floating layer; Acquire a jump interface image, and load the jump interface image in the canvas component, wherein the jump interface image is an image generated based on a jump interface, the jump interface is generated by the jump interface application according to jump interface data, and the display level of the jump interface is lower than the window floating layer; An input jump instruction representing a display jump interface is received, the playing of the recommended media asset data is stopped, and the window floating layer and the canvas component are destroyed to display the jump interface.
2. The display device according to claim 1, characterized in that The starting jump interface application includes: Running a jump interface application and creating a jump interface display container, wherein the display level of the jump interface display container is lower than the window floating layer; The jump interface display container loads the jump interface data so as to display the jump interface in the jump interface display container; The obtaining of the jump interface image comprises: A screenshot is taken on the jump interface to generate the jump interface image.
3. The display device according to claim 1, characterized in that After the controller creates a canvas component on the window floating layer, the controller is further configured to: Acquire an end instruction, where the end instruction is generated according to an end playback event of the recommended media asset data, or is generated in response to a key operation representing skipping input by a user; In response to the end instruction, stop running the jump interface application, and remove the window floating layer and the canvas component; The display is controlled to display the target interface.
4. The display device according to claim 1, characterized in that When a media resource request mark is present on the target interface, the controller requests recommended media resource data and creates a window floating layer, including: Read the media resource request tag of the target interface; Generate a media resource acquisition request according to the media resource request tag, and send the media resource acquisition request to the server, so that the server feeds back recommended media resource data according to the media resource acquisition request; Create a window popup.
5. The display device according to claim 4, characterized in that The controller creates a canvas component on the window floating layer and starts a jump interface application, including: Reading jump interface information associated with the recommended media resource from the recommended media resource data; If the recommended media resource has associated jump interface information, starting a jump interface application according to the jump interface information; If the recommended media asset does not have associated jump interface information, the jump interface application is not started.
6. The display device according to any one of claims 1 to 5, characterized in that: The controller executes loading the jump interface image in the canvas component, and is further configured to: Obtaining the current screen size of the display and the target control size of the jump interface image; Setting the minimum display size of the canvas component according to the current screen size, and setting the maximum display size of the canvas component according to the target control size; The real-time display size of the canvas component is dynamically set, and the real-time display size changes periodically within a fluctuation range according to a preset frequency.
7. A method for displaying recommended media resources, applied to a display device, characterized in that: The method comprises: In response to the input control instruction for displaying the target interface, displaying the target interface; When a media resource request mark exists on the target interface, request recommended media resource data and create a window floating layer, wherein the display level of the window floating layer is higher than the display level of the current user interface; Loading the recommended media asset data in the window floating layer to play the recommended media asset data; Creating a canvas component on the window floating layer, and starting a jump interface application, wherein the canvas component at least covers a portion of the window floating layer; Acquire a jump interface image, and load the jump interface image in the canvas component, wherein the jump interface image is an image generated based on a jump interface, the jump interface is generated by the jump interface application according to jump interface data, and the display level of the jump interface is lower than the window floating layer; An input jump instruction representing a display jump interface is received, the playing of the recommended media asset data is stopped, and the window floating layer and the canvas component are destroyed to display the jump interface.
8. The method according to claim 7, characterized in that The starting jump interface application includes: Running a jump interface application and creating a jump interface display container, wherein the display level of the jump interface display container is lower than the window floating layer; The jump interface display container loads the jump interface data so as to display the jump interface in the jump interface display container; The obtaining of the jump interface image comprises: A screenshot is taken on the jump interface to generate the jump interface image.
9. The method according to claim 7, characterized in that After creating a canvas component on the window floating layer, the method further includes: Acquire an end instruction, where the end instruction is generated according to an end playback event of the recommended media asset data, or is generated in response to a key operation representing skipping input by a user; In response to the end instruction, stop running the jump interface application, and remove the window floating layer and the canvas component; The display is controlled to display the target interface.
10. The method according to claim 7, characterized in that When there is a media resource request mark on the target interface, requesting recommended media resource data and creating a window floating layer includes: Read the media resource request tag of the target interface; Generate a media resource acquisition request according to the media resource request tag, and send the media resource acquisition request to a server, so that the server feeds back recommended media resource data according to the media resource acquisition request; Create a window popup.
Citation Information
Patent Citations
Display device and detail page display method
CN113115092A
Display method and display equipment for content corresponding to control
CN113467651A
Content display method and device, equipment and storage medium
CN115269105A
Method for playing video on floating layer and display equipment
CN115412753A
Control display method and display device
WO2021203677A1