Display device and playing interface button interaction method

Abstract

Some embodiments of the present application provide a display device and a playing interface key interaction method. The method can acquire a key instruction input by a user when the display device displays a recommended media playing interface. A key value is extracted from the key instruction, and a first key value set supported by a non-focus window is acquired. If the key value is in the first key value set, the key instruction is responded to by the non-focus window, and associated media data is acquired according to a key duration of the key instruction, so that the associated media data is displayed by the non-focus window. If the key value is not in the first key value set, the key instruction is responded to by the focus window. The method can perform key distribution between the focus window and the non-focus window based on the first key value set, and can improve the problem that some keys cannot be responded to. Different associated media data can be acquired according to different key durations, the recommended media style and the user interaction mode are enriched, and the user interaction experience is improved.

Description

Technical Field

[0001] This application relates to the field of display device technology, and in particular to a display device and a method for button interaction on a playback interface. Background Technology

[0002] Display devices are intelligent devices capable of presenting a user interface and supporting user interaction. Taking smart TVs as an example, smart TVs are television products based on Internet application technology, possessing an open operating system and chip, an open application platform, and enabling two-way human-computer interaction. They integrate multiple functions such as audio-visual entertainment and data to meet diverse and personalized user needs. Display devices can play boot-up media during the startup process or automatically play splash screen media when a specific interface is displayed in an application, used to display prompts or promotional content.

[0003] Taking a splash screen video as an example, when the display device shows the homepage, it can call media asset recommendation services such as ad services and obtain the splash screen media asset data to be played through the ad services. Then, the player is called to play the splash screen media asset data to form an automatically playing media asset screen. The playback process of the splash screen video or boot animation can last for a certain duration, such as a 15-second ad video.

[0004] Because automatically playing media assets can obscure the user interface to be displayed, users need to wait for the corresponding media asset to finish playing during the splash screen video or boot animation. To improve the user experience during this waiting period, display devices support receiving interactive commands from the user during automatic media asset playback, such as allowing the user to press the back button to skip the automatically playing media assets. However, for boot screens and splash screen videos, the display devices support fewer interactive methods, and many buttons are unresponsive, thus degrading the user experience. Summary of the Invention

[0005] Some embodiments of this application provide a method for button interaction on a display device and a playback interface to solve the problem that some buttons on the display device cannot respond when playing content such as the boot screen or splash screen video.

[0006] In a first aspect, some embodiments of this application provide a display device, including: a display, a communication device, and a controller. The display is configured to display a user interface; the communication device is configured to establish a communication connection with a control device and a server; the control device includes at least one button and is configured to respond to user button operations to obtain button commands; the controller is configured to perform the following steps:

[0007] The display is controlled to show a recommended media playback interface, which includes a focused window and an unfocused window;

[0008] Acquire user-input key input commands, the key input commands including key values ​​when the user performs key operations;

[0009] Extract the key value from the key command, and obtain the first set of key values ​​supported by the non-focus window;

[0010] If the key value is in the first key value set, the key command is responded to through the non-focus window, and the key duration corresponding to the key value in the key command is obtained; and the associated media data is obtained according to the key duration, so as to display the associated media data through the non-focus window;

[0011] If the key value is not in the first key value set, the key command is responded to through the focus window.

[0012] Secondly, some embodiments of this application also provide a display device, including: a display, a communication device, and a controller. The display is configured to display a user interface; the communication device is configured to establish a communication connection with a control device and a server; the control device includes at least one button and is configured to respond to user button operations to obtain button commands; the controller is configured to perform the following steps:

[0013] Control the display to show the recommended media playback interface;

[0014] Acquire user-input key input commands, the key input commands including key values ​​when the user performs key operations;

[0015] If the key value is in the third key value set, the key duration of the key instruction is obtained, and the associated media asset data is obtained according to the key duration. The display is controlled to show the media asset details interface, which is generated according to the associated media asset data. The third key value set includes key values ​​for displaying media asset details.

[0016] If the key value is not in the third key value set, add a prompt effect animation to the recommended media asset playback interface, and control the display to show the recommended media asset playback interface after adding the prompt effect animation.

[0017] Thirdly, some embodiments of this application also provide a playback interface button interaction method, applied to the display device described in the first aspect, the playback interface button interaction method comprising:

[0018] When displaying the recommended media asset playback interface, the key input commands of the user are obtained. The recommended media asset playback interface includes a focus window and a non-focus window. The key commands include the key values ​​when the user performs key operations.

[0019] Extract the key value from the key command, and obtain the first set of key values ​​supported by the non-focus window;

[0020] If the key value is in the first key value set, the key command is responded to through the non-focus window, and the key duration corresponding to the key value in the key command is obtained; and the associated media data is obtained according to the key duration, so as to display the associated media data through the non-focus window;

[0021] If the key value is not in the first key value set, the key command is responded to through the focus window.

[0022] Fourthly, some embodiments of this application also provide a playback interface button interaction method, applied to the display device described in the second aspect, the playback interface button interaction method comprising:

[0023] When displaying the recommended media asset playback interface, the key input commands of the user are obtained, including the key values ​​when the user performs key operations;

[0024] If the key value is in the third key value set, the key duration of the key instruction is obtained, and the associated media asset data is obtained according to the key duration. The display is controlled to show the media asset details interface, which is generated according to the associated media asset data. The third key value set includes key values ​​for displaying media asset details.

[0025] If the key value is not in the third key value set, add a prompt effect animation to the recommended media asset playback interface, and control the display to show the recommended media asset playback interface after adding the prompt effect animation.

[0026] As can be seen from the above technical solutions, some embodiments of this application provide a method for button interaction on a display device and a playback interface. This method can acquire user-inputted button commands when the display device displays a recommended media asset playback interface. It extracts button values ​​from the button commands and obtains a first set of key values ​​supported by the non-focus window. If the button value is in the first set of key values, the button command is responded to through the non-focus window, and associated media asset data is obtained based on the button duration, so that the associated media asset data is displayed through the non-focus window. If the button value is not in the first set of key values, the button command is responded to through the focus window. This method can perform button distribution between the focus window and the non-focus window based on the first set of key values, which can improve the problem of some buttons not responding. Furthermore, it can obtain different associated media asset data based on different button durations, enriching the recommended media asset styles and user interaction methods, and improving the user's interactive experience. Attached Figure Description

[0027] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0028] Figure 1 This is a schematic diagram illustrating the usage scenarios of the display device in some embodiments of this application;

[0029] Figure 2 Hardware configuration block diagrams of display devices provided in some embodiments of this application;

[0030] Figure 3 This is a schematic diagram of the software configuration in a display device provided in some embodiments of this application;

[0031] Figure 4 This application provides a schematic diagram illustrating the opening screen video display effect in some embodiments.

[0032] Figure 5 This is a schematic diagram illustrating another opening screen video display effect provided in some embodiments of this application;

[0033] Figure 6 This is a schematic diagram of a prompt window provided for some embodiments of this application;

[0034] Figure 7 This application provides a schematic flowchart of a playback interface button interaction method for some embodiments.

[0035] Figure 8 This application provides schematic diagrams illustrating the recommended media asset playback interface display process for some embodiments of the present application.

[0036] Figure 9 This application provides schematic diagrams of key distribution processes for some embodiments.

[0037] Figure 10 Timing diagrams for key distribution during homepage application execution provided in some embodiments of this application;

[0038] Figure 11 Timing diagrams for key distribution of advertising service applications provided in some embodiments of this application;

[0039] Figure 12 This is a schematic diagram illustrating the process of obtaining button duration provided in some embodiments of this application;

[0040] Figure 13 A sequence diagram showing the loading of associated media asset data for the details page application in some embodiments of this application;

[0041] Figure 14 Animated illustrations of prompting effects provided for some embodiments of this application;

[0042] Figure 15 Detailed interface diagrams provided for some embodiments of this application;

[0043] Figure 16 This application provides a flowchart illustrating the process of determining media asset type based on duration intervals in some embodiments.

[0044] Figure 17 Prompt graphic illustrations provided for some embodiments of this application;

[0045] Figure 18 This application provides a timing diagram for recommending media resources based on key press duration in some embodiments. Detailed Implementation

[0046] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0047] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0048] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0049] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0050] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0051] In this embodiment, the display device 200 generally refers to a device with screen display and data processing capabilities. For example, the display device 200 includes, but is not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0052] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1 As shown, a user can operate the display device 200 via touch operation, a mobile terminal 300, and a control device 100. The control device 100 receives user input commands and converts them into control commands that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus, a gamepad, etc.

[0053] In some embodiments, the control device 100 may be a remote control, and the communication between the remote control and the display device includes at least one of infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via a wired connection. Users can control the display device 200 by inputting user commands through buttons on the remote control, voice input, control panel input, etc.

[0054] The mobile terminal 300 can function as a control device for human-computer interaction between the user and the display device 200. It can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can have software applications installed on it and communicate with the display device 200 via network communication protocols to achieve one-to-one control and data communication. Furthermore, it can transmit audio and video content displayed on the mobile terminal 300 to the display device 200 for synchronized display.

[0055] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application that controls the display device 200.

[0056] like Figure 1 The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. This allows the display device 200 to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0057] Display device 200 can provide broadcast television reception function, and can also be equipped with intelligent network television function that provides computer support, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.

[0058] Figure 2 This is a hardware configuration block diagram of a display device 200 provided in some embodiments of this application.

[0059] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0060] In some embodiments, detector 230 is used to acquire signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0061] In some embodiments, device interface 240 may include, but is not limited to, a high-definition multimedia interface (HDMI), an analog or data high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. Device interface 240 may also be a composite input / output interface formed by multiple of the above interfaces.

[0062] Display device 200 can connect to external device 500 via device interface 240. External device 500 can be a set-top box, game console, PC, or other similar device. When display device 200 connects to external device 500 via device interface 240, a corresponding signal source channel can be established, and input signals can be received through this signal source channel. For example, display device 200 can connect to a game device via an HDMI interface to establish an HDMI channel, and receive audio and video signals sent by the game device based on the HDMI channel.

[0063] In some embodiments, the display 260 includes display function components for presenting images and driving components for driving image display. The display 260 is used to receive and display image signals output from the controller 250. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces, etc.

[0064] In some embodiments, the communication device 220 is a component used to communicate with external devices or the server 400 according to various communication protocol types. The display device 200 may have multiple communication devices 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, it may have a communication device 220 with WiFi functionality. When the display device 200 supports Bluetooth connectivity, it needs to have a communication device 220 with Bluetooth functionality.

[0065] The communication device 220 enables the display device 200 to communicate with external devices or the server 400 via wireless or wired connections. Wired connections utilize data cables, interfaces, or other components to connect the display device 200 to external devices. Wireless connections utilize wireless signals or wireless networks. The display device 200 can directly establish a connection with external devices or indirectly through gateways, routers, or other connection devices.

[0066] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200.

[0067] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0068] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface receives user input commands through the graphical user interface (GUI).

[0069] In some embodiments, the audio output device 270 can be a built-in speaker of the display device 200 or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, through which the audio output device can be connected to the display device 200 to output sound from the display device 200.

[0070] In some embodiments, the user input interface 280 can be used to receive instructions from user input.

[0071] To enable user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running an application. The operating system also allows users to interact with the display device 200.

[0072] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices.

[0073] An operating system can be divided into different modules or levels based on the functions it implements. For example, in some embodiments, such as... Figure 3 As shown, taking the Android system as an example, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the System Library layer, and the Kernel layer. In some embodiments, the operating system of the display device can also be other operating systems.

[0074] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer may contain at least one application, which may be a built-in Windows program, system settings program, or clock program of the operating system; or it may be an application developed by a third-party developer. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0075] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.

[0076] like Figure 3 As shown, the application framework layer in this embodiment includes a view system, managers, and content providers. The view system designs and implements the application's interface and interactions, and includes lists, grids, text boxes, and buttons. The managers include at least one of the following modules: an activity manager for interacting with all running activities in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0077] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling changes to the display window, such as shrinking the display window, shaking the display, or distorting the display.

[0078] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library contained in the system runtime library layer, such as the C / C++ instruction library, to implement the functions to be performed by the framework layer.

[0079] In some embodiments, the kernel layer is a functional layer situated between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, ... Figure 3 As shown, hardware drivers can be configured in the kernel layer. The drivers included in the kernel layer can be at least one of the following: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0080] It should be noted that the above examples are merely a simple division of operating system functions and do not limit the specific form of the operating system of the display device 200 in this application embodiment. Depending on the function of the display device, the type of operating system, and other factors, the number of levels and the specific level type of the operating system may be expressed in other forms.

[0081] In some embodiments, the display device 200 may automatically play media asset data when executing a specific process or displaying a specific interface. The specific process may be a process that requires guidance, has a long running cycle, or requires interface refresh, such as a boot process, application installation process, or software upgrade process. The specific interface may be an interface with a long rendering cycle, or with recommendation functions, or comprehensive functions, such as a homepage interface, a media asset recommendation interface, or an application interface. The automatically played media asset data may be videos with functions such as logo display, information promotion, operation guidance, and feature display, such as boot animations, splash screen advertisements, homepage recommendation videos, and media asset trailers.

[0082] It should be noted that, in this embodiment, media asset data refers to multimedia resources that require a certain amount of time to be displayed. The media asset data can be conventional video media assets with video and audio content, or it can be pure image video without sound, such as animated GIFs, static images, text, etc. In some embodiments, the automatically playing material can also be media assets without image content, such as media asset data that is purely audio content. For ease of description, in this embodiment, media asset data that is automatically played when a specific process is executed or a specific interface is displayed is referred to as recommended media asset data.

[0083] In some embodiments, the display device 200 can play recommended media asset data through the collaboration of the operating system, UI applications, and service processes. The operating system provides a basic operating environment that allows applications and advertising services to run. Furthermore, the operating system can provide various application programming interfaces (APIs) that allow applications to interact with system services. UI applications such as JUUI are used to present the user interface, providing a direct interactive interface that may include a media asset display area. When an application needs to display recommended media asset data, the UI application requests the recommended media asset data to be displayed via API from media asset service processes such as advertising services (AD services). The media asset service can be a media asset recommendation system built into the application or a third-party service, such as ××AdMob, which provides media asset data content, including loading, displaying, tracking, and user interaction during the media asset playback process.

[0084] Taking the display of a splash screen ad as an example, when displaying the ad, UI applications such as JUUI initiate an ad request by calling the ad service's API. After receiving the request, the ad service retrieves the ad content from the server (400 status code) or local storage. After retrieving the ad content, the ad service passes the ad content to the UI application via the API. The UI application then renders the ad content on the user interface, displaying it in the ad display area of ​​the user interface.

[0085] Recommended media asset data can have different uses depending on the specific process executed by the display device 200 or the specific interface displayed. Media asset data for different uses can contain different content and have different formats. Furthermore, autoplaying media asset data can originate from the local storage of the display device 200 or from the server 400. For media asset data originating from local storage, it can be stored on different media depending on its intended use.

[0086] In some embodiments, the media asset data used to form the boot animation may be a static or dynamic image file embedded in the system file; the media asset data used to form the boot advertisement may be a video file stored in the boot call storage space; the media asset data used to form the interface guide may be a video or image file included in the interface configuration file; and the media asset data used to form the homepage pop-up advertisement may be a video or image file pushed by the server 400.

[0087] In some embodiments, the display device 200 can obtain recommended media asset data by parsing system files. For example, when executing the boot process, the display device 200 can obtain the recommended media asset data by reading the filename and storage address of the recommended media asset data set in the boot process and accessing the corresponding storage address.

[0088] In some embodiments, the display device 200 can also obtain recommended media asset data by parsing the interface configuration file. For example, when the display device 200 displays the settings interface for the first time, it can extract the guide media asset data according to the guide video storage address recorded in the configuration file corresponding to the settings interface.

[0089] In some embodiments, the display device 200 can also send a media asset acquisition request to the server 400, so that the server 400, based on the media asset acquisition request, provides recommended media asset data back to the display device 200. For example, when displaying a media asset recommendation interface, the display device 200 sends a media asset acquisition request to the server 400 before presenting the media asset recommendation interface. After receiving the media asset acquisition request, the server 400 extracts relevant media asset data from the database according to the type of the current interface to be displayed (i.e., the media asset recommendation interface) and the delivery strategy.

[0090] After acquiring the recommended media asset data, the display device 200 can invoke relevant applications for playback based on the specific type of the recommended media asset data. For example, for video materials, the display device 200 can invoke a video player and decode the media asset data through the video player to form a playback screen of the media asset data, which is then displayed on the monitor 260.

[0091] In some embodiments, recommended media asset data can be started and played through a relevant process, and playback can end as the process runs or the interface renders. Taking the playback process of a homepage splash screen ad as an example, after the display device 200 starts up, it renders the homepage interface through the homepage application. According to the rendering process of the homepage interface, the advertising service application can request advertising media asset data from the advertising system. After the advertising system sends the advertising data, the display device 200 can decode the advertising data to form the splash screen ad. After the splash screen ad playback ends, or after the playback duration reaches the preset placement duration requirement, the display device 200 can cancel the display of the splash screen ad and then display the homepage interface.

[0092] In some embodiments, the playback screen of recommended media asset data can be displayed through a separate interface. For example, during the power-on process, the display device 200 can first display a boot screen, which may initially show the brand logo, then system information, and so on. As the boot process progresses, it switches to displaying a boot video screen. After the boot video finishes playing, the display device 200 switches to displaying a home screen. That is, during the above display process, the boot screen, the boot video screen, and the home screen are three independent interfaces.

[0093] In some embodiments, the playback screen of recommended media asset data can also be displayed through a separate window in the interface to be displayed. For example, Figure 4As shown, a separate window used to display the playback screen of recommended media asset data can be part of the interface to be displayed, such as an animated window or a recommended segment in a specific location within the interface. Figure 5 As shown, a separate window used to display the recommended media asset data playback screen can also be a floating window of the interface to be displayed.

[0094] In some embodiments, the display device 200 also supports playback interruption control during media data playback. That is, the display device 200 can control the cessation of media data playback and display the user interface that should be displayed after the media data playback is completed by receiving an interruption command input by the user or automatically generating an interruption command based on the operating status.

[0095] For example, when display device 200 first displays the homepage interface after powering on, it can show a splash video. The splash video can be set to a duration of 15 seconds according to the projection strategy, meaning that the splash video will stop playing after 15 seconds and the homepage interface will be displayed. During the playback of the splash video, the user can skip the splash video by pressing the back button on control device 100, i.e., by entering an interrupt command, and control display device 200 to directly display the homepage interface.

[0096] In some embodiments, the display device 200 can also support user interaction control when playing recommended media asset data. That is, during the playback of the recommended media asset data, the display device 200 can receive control commands input by the user, and different control commands can control the display device 200 to perform different functional responses. For example, the user can press the back button on the remote control to stop the display device 200 from playing the recommended media asset data. The user can also use the directional keys to control the display device to switch to the details interface associated with the recommended media asset data.

[0097] In some embodiments, when the display device 200 plays recommended media asset data, it may display a prompt window in the playback interface of the recommended media asset data. The prompt window may display information to the user about the currently supported interaction methods. For example, ... Figure 6 As shown, when displaying the advertising interface, the display device 200 can display a prompt window in the lower right corner in the form of a small window. The prompt window can include text with prompting function such as "Long press the right button for a surprise" or "Long press the menu button to jump to the product interface" to prompt the user to perform the corresponding interactive operation.

[0098] The prompt window is an independent window relative to the playback window. Because the operating system of the display device 200 has focus control logic, meaning only one window can receive focus at a time, and only the window with focus can respond to user-inputted control commands, when the display device 200 simultaneously displays the playback screen of recommended media data and the prompt window, some control commands may not be responded to due to the focus strategy, thus degrading the user experience.

[0099] To better respond to user input commands, some embodiments of this application provide a playback interface button interaction method. This playback interface button interaction method can distribute button commands through a button distribution strategy, enabling more accurate responses. The method can be applied to a display device 200. The display device 200 includes a display 260, a communication device 220, and a controller 250. The display 260 is configured to display a user interface; the communication device 220 is configured to establish communication connections with a control device 100 and a server 400. The control device 100 includes at least one button and is configured to respond to user button operations to obtain button commands.

[0100] like Figure 7 As shown, the controller 250 is configured to execute the playback interface button interaction method, including the following:

[0101] S100: When displaying the recommended media playback interface, obtain the key input commands from the user.

[0102] To execute the interactive playback interface, the display device 200 first needs to display a recommended media asset playback interface. This recommended media asset playback interface refers to the interface used to display recommended media asset data. The display device 200 can display the recommended media asset data playback interface in response to specific control commands. In some embodiments, the user can input a power-on command; in this case, the display device 200 can respond to the user's input power-on command, controlling the display 260 to display a power-on interface, and when the power-on process reaches a specific stage, controlling the display device 200 to display the power-on recommended media asset playback interface.

[0103] In some embodiments, the display device 200 can respond to a user-inputted display command to display a target interface. The target interface is a user interface that supports displaying recommended media data, such as a homepage interface, application interface, or settings interface. Upon receiving the display command, the display device 200 displays the target interface. Since the target interface supports automatically playing recommended media data before displaying it, the display device 200 can display the playback screen of the opening recommended media data via the display 260 before displaying the target interface.

[0104] The control commands for the display device 200 to display the recommended media playback interface can be input according to the interaction methods supported by the display device 200, such as one or more combinations of interaction methods such as button interaction, voice interaction, touch interaction, motion sensing interaction, and gesture interaction.

[0105] In some embodiments, after a user inputs a display command to display the home screen, the display device 200 can run a home screen application or other interface application, and render the home screen by running the home screen application. During the rendering process, the home screen application can create an interface display container, that is, an activity component used to display the interface content, such as an activity component.

[0106] like Figure 8 As shown, in some embodiments, the display device 200 can further parse the interface data after acquiring it, and perform display control based on the parsing results. The display device 200 can parse media asset request markers from the interface data. These markers are used to determine whether the current target interface supports displaying a splash screen media asset. If the target interface supports displaying a recommended media asset, the interface data of the target interface may include at least one media asset request marker. These markers indicate that a splash screen media asset needs to be displayed before displaying the target interface.

[0107] If the media asset request tag is not parsed from the interface data, meaning the target interface currently displayed does not need to display recommended media asset data, the display device 200 can generate and display the target interface through the interface application based on the interface data. Taking a JUUI application as an example, after receiving the interface data from the server 400, the display device 200 can parse the media asset request tag "Adtag" from the interface data through the JUUI application. If the parsing determines that the interface data does not contain the media asset request tag "Adtag," the JUUI application can render the homepage interface based on the interface data. That is, the display device 200 can first parse the interface data into formats such as JSON and XML that the application can understand. The JUUI application then maps the parsed interface data to the data model of the application's Java or Kotlin classes. The data model is then bound to the UI components. The data in the data model is then used to update the UI components, and the view is re-rendered based on the updated UI component state.

[0108] That is, Figure 9As shown, if a media asset request flag is parsed from the interface data, indicating that the currently displayed target interface needs to display recommended media asset data, the display device 200 can generate the target interface according to the interface data through the interface application, and simultaneously obtain the recommended media asset data through the media asset service. Since the homepage interface can display a splash screen video, it can call media asset services such as the advertising service (Adservice) based on the rendering process of the homepage interface. The media asset service then generates a media asset acquisition request based on the interface type of the homepage interface and sends the request to media asset systems such as the advertising system (Adsystem) to obtain the recommended media asset data. After obtaining the recommended media asset data, the operating system of the display device 200 receives an acknowledgment signal from the UI interface and, in response, calls the media player to decode and play the recommended media asset data to obtain the playback screen, which is then displayed through the media asset playback interface.

[0109] In some embodiments, the display device 200 can retrieve recommended media asset data from local storage. For example, the display device 200 can retrieve recommended media asset data from local storage when it is not connected to a network or when network configuration is not yet complete. That is, the display device 200 also includes a memory configured to store recommended media asset data. Before displaying a target interface, the display device 200 can generate a data retrieval request and send the request to the memory to retrieve the recommended media asset data stored therein.

[0110] In some embodiments, the display device 200 can obtain recommended media asset data from the server 400. Specifically, when obtaining recommended media asset data, the display device 200 generates a media asset acquisition request and sends the request to the server 400. To obtain the recommended media asset data, the server 400 may also be configured with a media asset service system, such as an advertising system, for storing and distributing the recommended media asset data. The media asset acquisition request is used to enable the server 400 to retrieve recommended media asset data associated with the current target interface. The display device 200 then receives the recommended media asset data from the server 400.

[0111] Taking a JUUI application as the user interface and an Adservice as the media asset service as an example, after the JUUI application parses the media asset request tag "Adtag" from the interface data, it can generate a media asset retrieval request based on the tag. This request is then sent to the advertising service system on server 400. Upon receiving the media asset retrieval request, the advertising service system can distribute recommended media asset data accordingly.

[0112] In some embodiments, the media asset request tag used to determine whether the target interface needs to display recommended media asset data can also be stored in a local configuration file. After receiving a display instruction, the display device 200 can read the configuration file locally to perform display control based on whether the configuration file contains the media asset request tag. For example, the configuration file for the target interface may include interface configuration parameters corresponding to the interface rendering process. When displaying the target interface, the display device 200 can execute the interface rendering and display process according to the configuration parameters. When the display device 200 executes a specific step, it can read the media asset request tag "Adtag". Then, based on this media asset request tag, it calls an advertising service to obtain splash screen advertising materials.

[0113] After acquiring the recommended media asset data, the display device 200 can create a media asset display container for playing the recommended media asset data through an interface application or a media asset service application. Taking the splash screen ad playback process as an example, after receiving the ad data from the homepage, the display device 200 can create a transparent window overlay, with the window overlay's page display layer above the homepage. The window overlay can be used to display the media asset playback screen.

[0114] Among these, media asset display containers can be created through the homepage application. For example... Figure 10 As shown, after receiving the recommended media asset data, the advertising service application can send the data to the home application. The home application then creates a window overlay based on the recommended media asset data, within the home interface display container. To facilitate control over the created window, the window overlay created by the home application belongs to the home interface display container, but its display hierarchy is higher than other components within the home interface display container.

[0115] Display device 200 can also create window overlays through advertising service applications. For example... Figure 11 As shown, after receiving the recommended media asset data, the advertising service application can create a window overlay based on the data. This window overlay can be independent of the main interface's display container; that is, if the main interface's display container is activity A, the window overlay created by the advertising service application is window B. Window B has a higher display hierarchy than activity A.

[0116] After creating the media asset display container, the display device 200 can load recommended media asset data into the media asset display container, and display the recommended media asset playback screen on the media asset display container by playing the recommended media asset data. The display device 200 then forms the recommended media asset playback interface by overlaying the images of the media asset display container and the interface display container.

[0117] The recommended media asset playback interface displayed on the display device 200 may include multiple windows. A window can refer to an independent window within the playback interface, or it can refer to a window component that forms the playback interface. Taking a window component as an example, it is one of the core parts of the user interface, responsible for displaying the application's interface and handling user interactions. Window components may involve the collaborative work of components or services such as Activity components, View components, and window managers to form the specific playback interface.

[0118] The windows in the recommended media asset playback interface can be used to display different types of content. In some embodiments, the recommended media asset playback interface may include two windows: a playback window and a notification window. The playback window displays the playback screen of the recommended media asset data, and the notification window displays notification information. Figure 6 As shown, taking a splash screen video advertisement as an example, when display device 200 displays an advertisement video for product A, it can display the video advertisement playback screen of product A through a playback window. A prompt window displays a "Long press the right button for a surprise" message, allowing the user to control display device 200 to jump to the product details page of product A by long-pressing the right arrow key on the remote control.

[0119] The recommended media playback interface can assign focus to one of its window components based on the operating system's focus control logic. Focus refers to the control or component that the user can currently interact with via an input device. Focus management can be handled automatically by the operating system or controlled by the application. Correspondingly, controls or components can include three focus states: no focus, focusable, and focused. Only focusable controls can receive focus. Taking Android as an example, whether a control can receive focus can be controlled by setting the focus attributes `android:focusable` and `android:focusable In TouchMode` of the control or component.

[0120] In the recommended media asset playback interface, the window that receives focus is called the focused window, and the window that does not receive focus is called the non-focused window. That is, the recommended media asset playback interface includes both focused and non-focused windows. In some embodiments, to better control the recommended media asset playback interface, the display device 200 can set the focused window of the recommended media asset playback interface to display the media asset data playback screen, and the non-focused window of the recommended media asset playback interface to display prompt information, through the operating system (or interface application, or media asset service application).

[0121] In some embodiments, such as Figure 8As shown, in order to form a recommended media asset playback interface including multiple windows, the display device 200 can respond to a display instruction for displaying a target interface, obtain a media asset request tag of the target interface, generate a media asset acquisition request according to the media asset request tag, and send the media asset acquisition request to the server, so that the server queries the recommended media asset data in the media asset recommendation system based on the media asset acquisition request. The recommended media asset data includes a media asset body and interactive resources associated with the media asset body. Then, receive the recommended media asset data returned by the server and play it.

[0122] When playing the recommended media asset data, the display device 200 can also load the media asset body and the interactive resources in a media asset display container, create a focused window and a non-focused window, map the media asset body to a playback component corresponding to the focused window, display the media asset body through the focused window, map the interactive resources to a playback component corresponding to the non-focused window, and display the interactive resources through the focused window.

[0123] During the process of the display device 200 displaying the recommended media asset playback interface, it can receive various control instructions input by the user. Some control instructions can be input through the buttons of a control device 100 such as a remote controller supporting the display device 200, which is called a button instruction. The button instruction is completed by the user through a button operation, so the button instruction can include the button value when the user performs the button operation.

[0124] For example, when the user inputs a button instruction by pressing the confirmation key, the button instruction can include the button value "KEYCODE_ENTER"; when the user inputs a button instruction by pressing the return key, the button instruction can include the button value "KEYCODE_BACK". Similarly, the button value corresponding to the home key is "KEYCODE_HOME", the button values corresponding to the volume up and down keys are "KEYCODE_VOLUME_UP" and "KEYCODE_VOLUME_DOWN" respectively, and the button values corresponding to the up, down, left, and right direction keys are "KEYCODE_DPAD_UP", "KEYCODE_DPAD_DOWN", "KEYCODE_DPAD_LEFT", "KEYCODE_DPAD_RIGHT", etc.

[0125] S200: Extract the button value from the button instruction, and obtain a first set of key values supported by the non-focused window.

[0126] After acquiring the key input from the user, the display device 200 can extract the key value from the key input and distribute the key input based on the key value and the set of key values ​​supported by each window. That is, key input supported by non-focused windows is distributed to non-focused windows, and key input supported by focused windows is distributed to focused windows.

[0127] Different windows can support different key events, and the display device 200 can determine the set of key values ​​supported by each window according to the specific function of the window. For ease of description, the set of key values ​​supported by the non-focus window is called the first set of key values, and the set of key values ​​supported by the focus window is called the second set of key values.

[0128] like Figure 9 , Figure 10 As shown, in some embodiments, the operating system, interface application, media asset service application, or other applications of the display device 200 may be configured with a key dispatch process. This key dispatch process is used to dispatch key commands based on the key availability of each window. The key dispatch process can execute key capture, key dispatch, event handling, and other key dispatch procedures. Specifically, when a user presses a key on a remote control, keyboard, or other input device, the display device 200 generates a key event. The key dispatch process first captures this key event and passes it to the currently active application. Event dispatch can be invoked when a key is pressed and released; that is, the key event is passed to the application through the Activity's onKeyDown and onKeyUp methods. After receiving the dispatched key event, the application can handle the key event by overriding onKeyDown and onKeyUp methods.

[0129] After requesting recommended media asset data, the display device 200 can initiate a key distribution process and listen for key input commands from the user through this process. When the user performs a key operation that generates a key press (onKeyDown) event and a key release (onKeyUp) event, the key distribution process can acquire the key event and key value.

[0130] Taking the process of displaying a splash screen ad on the homepage as an example, such as Figure 10 As shown, the display device 200 can create a media asset display container (Window overlay) on top of the homepage for displaying splash screen ads through the homepage application. Simultaneously, it determines whether the homepage interface supports multi-window splash screen ad display. If it does, it adds two window components to the media asset display container, serving as the focused window and the non-focused window respectively.

[0131] After creating the media asset display container and window components, the home application can also request ad creatives from the advertising system through the advertising service application. Since the home interface supports multi-window splash screen ad display, the advertising system can distribute interactive creatives and interactive button configuration files simultaneously with the ad creatives. After obtaining the ad creatives and interactive creatives, the home application loads the ad creatives on the current window (i.e., the focused window). Simultaneously, it loads the interactive creatives on the non-focused windows. Then, based on the distributed interactive button configuration files, it performs button distribution. When the user presses a button, the focused window passes the button event to the button distribution process. The button distribution process then distributes the buttons according to the interactive button configuration.

[0132] In addition to press and release events, the display device 200 can also determine other relevant parameters of the key command based on the key event corresponding to the key command. In some embodiments, the display device 200 can acquire the key duration. That is, the display device 200 can listen to the operation events of the user's key operation, specifically the press and release events generated when the user performs a key operation.

[0133] like Figure 12 As shown, when a press event is detected, the display device 200 can respond by recording a first moment. The first moment is the time when the user presses the button. When a release event is detected, the display device 200 can respond by recording a second moment, the time when the user releases the button. The button press duration is then generated by calculating the time difference between the first and second moments.

[0134] For example, when the button dispatch process of display device 200 detects the onKeyDown event, it can record the first moment Td corresponding to the onKeyDown event and continuously listen for the onKeyUp event within a preset listening period. When the onKeyUp event is detected, the second moment Tu corresponding to the onKeyUp event is obtained. Then, the case duration ΔT is obtained by calculating the first moment Td and the second moment Tu, i.e., ΔT = |Tu - Td|.

[0135] S300: If the key value is in the first key value set, respond to the key command through the non-focus window.

[0136] After obtaining the key value and the first set of key values ​​supported by the non-focus window, the display device 200 can compare the key value with the first set of key values. If the key value is in the first set of key values, it means that the currently input key command can be responded to by the non-focus window. Therefore, the display device 200 can send the key command to the application corresponding to the non-focus window through the key dispatch process, so that the non-focus window can respond to the key command.

[0137] like Figure 13 As shown, taking the splash screen advertisement on the homepage interface displayed on display device 200 as an example, the recommended media playback interface includes a product A video advertisement playback window (focused window) and a product A details interface jump prompt window (non-focused window). According to the light interaction button configuration file, the prompt window can respond to the directional keys and menu key, while the playback window can respond to the power button, back button, confirmation button, volume key, etc. Therefore, the first key value set includes "KEYCODE_DPAD_UP", "KEYCODE_DPAD_DOWN", "KEYCODE_DPAD_LEFT", "KEYCODE_DPAD_RIGHT", and "KEYCODE_MENU". When the display device 200 receives a key instruction from the user to press the right arrow key based on the prompt content in the prompt window, the key distribution process of the display device 200 can extract the key value "KEYCODE_DPAD_RIGHT" from the key instruction. Since the key value "KEYCODE_DPAD_RIGHT" is in the first key value set, the display device 200 can respond to the key instruction through the details page application (or advertising service application, or homepage application) corresponding to the prompt window. That is, the key instruction is responded to through the product A details interface display application, and the user is redirected to the product details interface of product A.

[0138] As can be seen, by setting the button distribution strategy, the display device 200 can reasonably distribute button commands to each window, including the window that has not yet acquired focus, when displaying the recommended media playback interface. This ensures that the response to button commands is not limited to the window that is currently in focus, thus alleviating the problem that buttons can only be given to the window that is currently in focus, while other windows cannot respond to the buttons.

[0139] S400: If the key value is not in the first key value set, respond to the key command through the focus window.

[0140] The display device 200 compares the key value with a first set of key values. If the comparison result is that the key value is not in the first set of key values, it means that the currently displayed non-focus window cannot respond to the key command corresponding to the current key value. Therefore, the display device 200 can distribute the key command to the application corresponding to the focus window through the key distribution process, so that the display device 200 can respond to the key command through the focus window.

[0141] For example, the button dispatch process dispatches buttons based on the Light Interaction button configuration file. The Light Interaction button configuration file contains the key values ​​of the buttons that the current Light Interaction needs to respond to. After the focus window passes the button to the button dispatch process, the button dispatch process determines whether the current button value is in the key value set of the Light Interaction button configuration. If it is not in the key value set of the Light Interaction button configuration, then this button needs to be dispatched to the focus window for processing.

[0142] The way the focus window responds to key commands is the same as the non-focus window. Both can determine the mapping relationship between supported key values ​​and actual functions through the configured key value set. First, the function item corresponding to the currently input key value is determined, then the corresponding function process is called according to the function item, and the corresponding function is implemented by executing the function process. For example, jumping to a different interface, skipping the recommended media playback process, adjusting the volume, and shutting down the device.

[0143] Since the focus window is used to display the playback screen of the recommended media when the display device 200 displays the recommended media playback interface, it cannot support all buttons. For unsupported button values, the display device 200 can also use animated effects with prompting functions to enrich the interface display content. Specifically, in some embodiments, when the display device 200 responds to the button command through the focus window, it can also obtain a second set of key values ​​supported by the focus window and compare the button value with the second set of key values ​​to determine whether the button value is in the second set of key values.

[0144] If the key value is in the second key value set, it means the focus window can respond to the key command. Therefore, the key function can be queried based on the key value, and the display can be controlled to show the user interface after the key function is executed. For example, when the display device 200 displays an advertisement video for product A, it detects that the user presses the back button on the remote control. Then, the display device 200 can receive the key command with the key value "KEYCODE_BACK". Through the key distribution process, it can be determined that the first key value set supported by the advertisement prompt window of product A does not include "KEYCODE_BACK", while the second key value set supported by the playback window of product A includes "KEYCODE_BACK". Therefore, the key distribution process can distribute the key command to the application corresponding to the playback window, namely the home application or the advertisement service application. After receiving the key command, the home application or the advertisement service application can query that the key function corresponding to "KEYCODE_BACK" is to skip the advertisement. Then, the home application or the advertisement service application can execute the skip advertisement program, that is, stop the playback process of the advertisement video of product A and destroy the media asset display container and the canvas component on the media asset display container, so as to control the display device 200 to continue displaying the home interface.

[0145] If the key value is not in the second key value set, it means that the focus window cannot respond to the key command either. In this case, the display device 200 can add a prompt effect animation to the focus window. For example, before displaying the home screen interface, during the display of a splash screen advertisement (i.e., the advertisement video of product A), if the user inputs a key command by pressing the home button, the display device 200 can obtain the key value "KEYCODE_HOME" from the key command. Since neither the playback window nor the prompt window supports the response of the home button, the display device 200 can determine that the current key value is not in the second key value set supported by the focus window. In this case, the display device 200 can respond to the key command by adding special effects views such as fireworks animation in the media asset display container to enrich the display content in the interface.

[0146] In some embodiments, to better reflect the prompting function of the animated prompt effect, the special effects view of the animated prompt effect can be associated with the window component corresponding to the non-focused window. This association means that the display position, display style, and display duration of the animated prompt effect can be set according to the display position, window style, and window display duration of the non-focused window. For example, ... Figure 14 As shown, for fireworks effect animations, the starting point of the fireworks animation can be located within the display area of ​​the non-focus window, so that the user can notice the content displayed in the non-focus window based on the fireworks effect.

[0147] As can be seen from the above technical solutions, the playback interface button interaction method provided in the above embodiments can receive button commands and obtain the button values ​​in the button commands and the first set of key values ​​supported by the non-focused windows in the recommended media playback interface when the display device 200 displays the recommended media playback interface. Therefore, when the button value is in the first set of key values, the button command is distributed to the non-focused windows for response. Thus, users can perform button operations between multiple windows, improving the user experience.

[0148] In some embodiments, the display device 200 can also obtain and display different types of media data based on the key press duration. That is, the display device 200 can obtain the key press duration corresponding to the key value in the key press instruction, and obtain associated media data based on the key press duration to display the associated media data.

[0149] When the display device 200 displays the recommended media asset playback interface, it can also enable the media asset recommendation process. The media asset recommendation process is used to query associated media asset data based on the key press duration, so that the display device 200 responds to the key press command and displays the interface corresponding to the associated media asset data.

[0150] During the process of displaying different types of media data acquired based on the key press duration, the display device 200 can use different methods to display the acquired media data depending on the type of the recommended media playback interface. In some embodiments, when the recommended media playback interface displayed by the display device 200 includes a focused window and a non-focused window, as in the interface type provided in the above embodiments, the display device 200 can display associated media data through the non-focused window. That is, when the key press instruction is executed through the non-focused window, the display device 200 can respond to the detected key press event and acquire the key value corresponding to the key press event.

[0151] Then, based on the key value, query the key function in the first key value set. If the key function is to display details, listen for the release event within a preset listening period. When the release event is heard, obtain the associated media asset data according to the time interval between the press event and the release event, and then control the display to display the media asset details interface. The media asset details interface is generated based on the associated media asset data.

[0152] For example, such as Figure 15 As shown, during the process of displaying the splash screen advertisement for product B, the display device 200 listens to the user pressing the right arrow key, i.e., the key value is "KEYCODE_DPAD_RIGHT" and the key event is "onKeyDown". Based on this, the display device 200 can start a timer through the home application or the advertising service application, starting the countdown from the moment the "onKeyDown" event occurs until the "onKeyUp" event of "KEYCODE_DPAD_RIGHT" is heard, at which point the countdown ends, thus obtaining the key press duration. Then, based on the key press duration, a related media asset retrieval request is generated and sent to the advertising system. This allows the advertising system to match the related media asset data of product B according to the key press duration in the related media asset retrieval request and to distribute the related media asset data. After obtaining the related media asset data, the advertising service application can pass the related media asset data to the home application, enabling the home application to generate and display the product details interface of product B based on the related media asset data.

[0153] In some embodiments, in order to obtain associated media asset data based on the key press duration, the display device 200 can query the media asset type associated with the key press duration. The amount of media asset data corresponding to the media asset type is positively correlated with the key press duration. For example, the longer the key press duration, the higher the clarity of the obtained associated media asset data.

[0154] like Figure 16As shown, in some embodiments, multiple duration intervals can be pre-set according to a push strategy, and each duration interval can correspond to a media asset type. When the display device 200 queries the media asset type associated with the button duration, it can determine the duration interval based on the button duration. If the duration interval is a first interval, the media asset type is marked as an image media asset; if the duration interval is a second interval, the media asset type is marked as an animated GIF media asset; if the duration interval is a third interval, the media asset type is marked as a frame animation media asset; and if the duration interval is a fourth interval, the media asset type is marked as a video media asset.

[0155] In this configuration, the minimum value of the second interval is greater than the maximum value of the first interval, the minimum value of the third interval is greater than the maximum value of the second interval, and the minimum value of the fourth interval is greater than the maximum value of the third interval. That is, the first, second, third, and fourth intervals are set sequentially according to the endpoint durations of the time intervals. Adjacent intervals can be separated using time thresholds. For example, time thresholds such as 200ms, 1s, and 2s can divide the first interval into [0, 200ms], the second interval into (200ms, 1s], the third interval into (1s, 2s], and the fourth interval into (2s, ∞). The media asset types corresponding to different intervals are as follows: the first interval is for image media assets, the second interval is for animated GIF media assets, the third interval is for frame animation media assets, and the fourth interval is for video media assets.

[0156] Therefore, after obtaining the key press duration, the display device 200 can determine the duration range to which the key command belongs based on the key press duration, determine the type of associated media asset data based on the duration range, and then obtain the associated media asset data based on the determined media asset type. That is, the display device 200 can generate an associated media asset acquisition request based on the media asset type and send the associated media asset acquisition request to the server 400, so that the server 400 can return associated media asset data that matches the media asset type, and the display device 200 can then receive the associated media asset data returned by the server 400.

[0157] To obtain different types of media assets, the display device 200 can access different resource addresses on the server 400 based on the key press duration. For example, if the key press duration is less than 200ms, it can access https: / / xxxx / xxx.png to obtain image resources. If the key press duration is greater than 200ms but less than 1 second, it can access https: / / xxxx / xxx.gift to obtain GIF animation resources. If the key press duration is greater than 1 second but less than 2 seconds, it can access https: / / xxxx / xxx.zip to obtain frame animation resources. If the key press duration is greater than 2 seconds, it can access https: / / xxxx / xxx.mp4 to obtain video resources with glasses-free 3D effects.

[0158] In some embodiments, the display device 200 may also display prompting content related to the key press duration through a non-focused window. That is, the display device 200 may display a prompt graphic in the non-focused window based on the key press event. The size of the prompt graphic is related to the key press duration.

[0159] For example, such as Figure 17 As shown, when display device 200 displays a prompt window showing product C's prompt information, it can add a progress bar view component to the window component corresponding to the prompt window after detecting that the user has pressed the right arrow key. The graphic representing the progress in the progress bar can gradually lengthen as the key press duration increases. When display device 200 determines the media asset type through multiple duration intervals, the home application or advertising service application can also adjust the color of the progress bar component according to the different duration intervals to which the key press duration belongs. For example, if the key press duration is less than 200ms, the home application sets the progress bar color to blue. As the user continues to press the right arrow key, increasing the key press duration to more than 200ms but less than 1s, the home application sets the progress bar color to yellow. If the key press duration increases to more than 1s but less than 2s, the progress bar color is orange. After the key press duration increases to more than 2s, the home application sets the progress bar color to red.

[0160] As can be seen, by displaying prompt graphics in the non-focus window, the user's key press event response can be shown, further enriching the content displayed in the recommended media playback interface and improving the user's interactive experience.

[0161] In some embodiments, after the display device 200 acquires associated media asset data of the corresponding type based on the button press duration, it can display the associated media asset data through a non-focus window, a focus window, or a new display interface, depending on the type of the acquired associated media asset data. Specifically, if the acquired associated media asset data corresponds to a first type of media asset, the associated media asset data is displayed through a non-focus window. If the acquired associated media asset data corresponds to a second type of media asset, the associated media asset data is displayed through a focus window or through a media asset details interface. The data volume of the second type of media asset is greater than that of the first type of media asset.

[0162] For example, if the first type of media asset is an image or animated GIF, the display device 200 can directly display the image or animated GIF in the prompt window (non-focus window) after obtaining the associated media asset data of the image or animated GIF type. If the second type of media asset is a frame animation or video, the display device 200 can call a video player after obtaining the associated media asset data of the frame animation or video type, and display the frame animation or video frame in the playback window (focus window).

[0163] Based on the playback interface button interaction method provided in the above embodiments, some embodiments of this application also provide a display device 200. The display device 200 may include a display 260, a communication device 220, and a controller 250. The display 260 is configured to display a user interface. The communication device 220 is configured to establish a communication connection with a control device 100 and a server 400. The control device 100 includes at least one button and is configured to respond to user button operations to obtain button commands. The controller 250 is configured to execute the playback interface button interaction method.

[0164] The display is controlled to show a recommended media playback interface, which includes a focused window and an unfocused window;

[0165] Acquire user-input key input commands, the key input commands including key values ​​when the user performs key operations;

[0166] Extract the key value from the key command, and obtain the first set of key values ​​supported by the non-focus window;

[0167] If the key value is in the first key value set, the key command is responded to through the non-focus window, and the key duration corresponding to the key value in the key command is obtained; and the associated media data is obtained according to the key duration, so as to display the associated media data through the non-focus window;

[0168] If the key value is not in the first key value set, the key command is responded to through the focus window.

[0169] As can be seen from the above technical solutions, the playback interface button interaction method and display device 200 provided in the above embodiments can obtain different types of associated media data based on the button duration when the user inputs a button command. They can interact with the user by pressing buttons when displaying interactive content. After the user presses a specified button, different display content is recommended to the user based on the duration between pressing the button and lifting the button, thereby improving the user's interactive experience.

[0170] In some embodiments, when the recommended media playback interface displayed by the display device 200 does not include multiple windows, the display device 200 can also obtain and display associated media data based on the key value and key duration in the key command. That is, Figure 18 As shown, the display device 200 can obtain key input commands from the user when displaying the recommended media asset playback interface. These key commands include the key values ​​input by the user when performing key operations. It also obtains a set of key values ​​used to trigger the display of the media asset details interface, i.e., a third set of key values.

[0171] If the key value is in the third key value set, it indicates that the user's current key command is used to control the display device 200 to display the media asset details interface. Therefore, the key duration of the key command can be obtained, and the associated media asset data can be obtained based on the key duration, and the display can be controlled to show the media asset details interface. The media asset details interface is generated based on the associated media asset data.

[0172] For example, when display device 200 is displaying an image advertisement for product D, it detects that the user has input a key input command by pressing the confirmation key. Upon receiving the key input command, display device 200 can parse the key value "KEYCODE_ENTER" from the command and obtain the third key value set "KEYCODE_ENTER" and "KEYCODE_DPAD_RIGHT" used by the current advertisement interface to jump to product details. Therefore, it can determine that the currently input key value is in the third key value set. Thus, display device 200 can obtain the duration of the user's key press. When the key press duration is less than 200ms, it can obtain the image details data of product D, generate the details interface of product D based on the image details data, and display the details interface of product D. Similarly, when the key press duration is greater than 2s, it can obtain the video details data of product D, call the player to play the video details data, and display the video details of product D through a details interface containing a video playback window.

[0173] If the key value is not in the third key value set, that is, the key command input by the user is not used to control the display device 200 to jump to the display details interface, then the display device 200 can add a prompt effect animation to the recommended media playback interface (S1706), and control the display to show the recommended media playback interface after adding the prompt effect animation (S1707). The prompt effect animation is the same as the prompt effect animation in the above embodiments, and can be an animation effect with a prompting function, such as fireworks, bubbles, petals, light effects, etc.

[0174] It should be noted that, although the above embodiments do not limit the recommended media asset playback interface to include a focus window and a non-focus window, the above button interaction method can also be applied to scenarios where the recommended media asset playback interface includes a focus window and a non-focus window.

[0175] Taking the process of displaying a splash screen ad on the homepage as an example, such as Figure 18As shown, the display device 200 can determine whether the homepage interface supports multi-window splash screen advertising through the homepage application. If it determines that the homepage interface does not support multi-window splash screen advertising, it sends a notification to the advertising service application, causing the advertising service application to create a media asset display container on top of the homepage interface for displaying the splash screen advertisement. Furthermore, the advertising service application can request advertising creatives from the advertising system. The advertising system then distributes advertising creatives, interactive creatives, and interactive button duration recommendation rule files based on the received creative request.

[0176] After acquiring the ad creatives and interactive creatives, the advertising service application loads the corresponding content into the media asset display container. It then starts a key-listening process, inputting the keys to be monitored according to the interactive key duration recommendation rule file. When a user presses a specified key, the key-listening process starts a timer. When the user releases the key, the process calculates the key duration. Based on the key duration, it generates a related data retrieval request and sends it to the advertising system. The advertising system then matches the relevant media asset data according to the key recommendation rules and sends this data back to the advertising service application. The advertising service application then loads and displays the relevant media asset data in the media asset display container.

[0177] Based on the playback interface button interaction method provided in the above embodiments, some embodiments of this application also provide a display device 200, which may include a display 260, a communication device 220, and a controller 250. The display 260 is configured to display a user interface. The communication device 220 is configured to establish a communication connection with a control device 100 and a server 400. The control device 100 includes at least one button and is configured to respond to user button operations to obtain button commands. The controller 250 is configured to execute the playback interface button interaction method.

[0178] Control the display to show the recommended media playback interface;

[0179] Acquire user-input key input commands, the key input commands including key values ​​when the user performs key operations;

[0180] If the key value is in the third key value set, the key duration of the key instruction is obtained, and the associated media asset data is obtained according to the key duration. The display is controlled to show the media asset details interface, which is generated according to the associated media asset data. The third key value set includes key values ​​for displaying media asset details.

[0181] If the key value is not in the third key value set, add a prompt effect animation to the recommended media asset playback interface, and control the display to show the recommended media asset playback interface after adding the prompt effect animation.

[0182] As can be seen from the above technical solutions, the playback interface button interaction method and display device 200 provided in the above embodiments can extract button values ​​from button commands when the user inputs button commands, and obtain a third set of button values ​​for the user to display media asset details interface. If the button value is in the third set of button values, then different types of associated media asset data are obtained according to the button duration, thereby displaying the media asset details interface generated according to the associated media asset data. The method can interact with the user by pressing buttons when displaying interactive content. After the user presses a specified button, different display content is recommended to the user according to the duration between pressing and releasing the button, thereby improving the user's interactive experience.

[0183] The same or similar parts between the various embodiments in this specification can be referred to each other, and will not be repeated here.

[0184] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solutions in the embodiments of the present invention, or the parts that contribute to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods of various embodiments or certain parts of the embodiments of the present invention.

[0185] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0186] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A display device, characterized by comprising: The application comprises: a display configured to display a user interface; a communication device configured to establish a communication connection with a control device and a server, the control device comprising at least one key, the control device being configured to obtain a key instruction in response to a key operation of a user; a controller configured to: control the display to display a recommended media playing interface, the recommended media playing interface comprising a focus window and a non-focus window, the focus window being a window with a focus mark, and the non-focus window being a window without a focus mark; obtain a key instruction input by a user, the key instruction comprising a key value when the user performs a key operation; extract the key value from the key instruction, and obtain a first key value set supported by the non-focus window; if the key value is in the first key value set, respond to the key instruction through the non-focus window, and obtain a key duration corresponding to the key value in the key instruction; and obtain associated media data according to the key duration, so as to display the associated media data through the non-focus window; if the key value is not in the first key value set, respond to the key instruction through the focus window.

2. The display device of claim 1, wherein, The server is configured with a media recommendation system; the controller is further configured to: obtain a media request mark of a target interface in response to a display instruction for displaying the target interface; generate a media acquisition request according to the media request mark; send the media acquisition request to the server, so that the server queries the recommended media data in the media recommendation system based on the media acquisition request, the recommended media data comprising a media body and an interactive resource associated with the media body; receive the recommended media data returned by the server.

3. The display device of claim 2, wherein, After receiving the recommended media data returned by the server, the controller is further configured to: load the media body and the interactive resource; create a focus window and a non-focus window, so as to display the media body through the focus window and display the interactive resource through the focus window; start a key distribution process and a media recommendation process, the key distribution process being used to distribute a key instruction according to the first key value set, and the media recommendation process being used to query associated media data according to a key duration; listen to a key instruction input by a user through the key distribution process.

4. The display device of claim 1, wherein, The controller configured to obtain a key instruction input by a user is specifically configured to: listen to an operation event of a key operation of a user, the operation event comprising a press event and a lift event; record a first time in response to listening to the press event, the first time being a time when a key is pressed when the user performs a key operation; record a second time in response to listening to the lift event, the second time being a time when a key is lifted when the user performs a key operation; calculate a time difference between the first time and the second time, so as to generate the key duration.

5. The display device of claim 4, wherein, The controller configured to respond to the key instruction through the non-focus window is specifically configured to: obtain a key value corresponding to the press event in response to listening to the press event; query a key function based on the key value in the first key value set; if the key function is a display detail function, display a prompt pattern in the non-focus window based on the press event, a size of the prompt pattern having a correlation with the key duration; when the lift event is listened to, control the display to display a media content detail interface, the media content detail interface being generated according to the associated media content data.

6. The display device of claim 1, wherein, The controller is configured to: query a media content type associated with the key duration, the media content type corresponding to a media content data amount positively correlated with the key duration; generate an associated media content acquisition request based on the media content type, and send the associated media content acquisition request to the server, so that the server feeds back associated media content data conforming to the media content type; receive the associated media content data fed back by the server.

7. The display device of claim 6, wherein, The controller is configured to: determine a duration interval according to the key duration; if the duration interval is a first interval, mark the media content type as a picture type; if the duration interval is a second interval, mark the media content type as an animated picture type, a minimum value of the second interval being greater than a maximum value of the first interval; if the duration interval is a third interval, mark the media content type as a frame animation type, a minimum value of the third interval being greater than a maximum value of the second interval; if the duration interval is a fourth interval, mark the media content type as a video type, a minimum value of the fourth interval being greater than a maximum value of the third interval.

8. The display device of claim 1, wherein, The controller is configured to: obtain a second key value set supported by the focus window; if the key value is in the second key value set, query a key function according to the key value, and control the display to display a user interface after the key function is executed; if the key value is not in the second key value set, add a prompt effect animation to the focus window, a display area of the prompt effect animation having a correlation with the non-focus window.

9. A display device, characterized by comprise: a display configured to display a user interface; a communication device configured to establish a communication connection with a control device, the control device comprising at least one key, the control device being configured to respond to a key operation of a user to obtain a key instruction; a controller configured to: control the display to display a recommended media content playing interface, the recommended media content playing interface comprising a focus window and a non-focus window, the focus window being a window marked with a focus, and the non-focus window being a window not marked with a focus; obtain a key instruction input by a user, the key instruction comprising a key value when the user performs a key operation; obtain a third key value set, the third key value set comprising a key value for displaying media content details; if the key value is in the third key value set, obtain a key duration of the key instruction, and obtain associated media content data according to the key duration, and display the associated media content data through the non-focus window; If the key value is not in the third key value set, an prompt effect animation is added in the recommended media playing interface, and the display is controlled to display the recommended media playing interface after the prompt effect animation is added; wherein the display area of the prompt effect animation has a correlation relationship with the display position of the non-focus window, and is used to guide the user to pay attention to the prompt content of the non-focus window.

10. A method for interacting with a play interface button, the method comprising: The display device of any one of claims 1-8, the playing interface key interaction method comprising: When displaying the recommended media playing interface, a key instruction input by a user is obtained, the recommended media playing interface comprising a focus window and a non-focus window; the key instruction comprising a key value when the user performs a key operation, the focus window being a window that has obtained a focus mark, and the non-focus window being a window that has not obtained a focus mark; The key value is extracted from the key instruction, and a first key value set supported by the non-focus window is obtained; If the key value is in the first key value set, the key instruction is responded to through the non-focus window, a key duration corresponding to the key value in the key instruction is obtained, and associated media data is obtained according to the key duration, so that the associated media data is displayed through the non-focus window; If the key value is not in the first key value set, the key instruction is responded to through the focus window.

Images