Display device and play interface key interaction method

Abstract

The embodiment of the invention provides a display device and a playing interface key interaction method. According to the method, a key instruction input by a user can be obtained when the display device displays a recommended media asset playing interface. Extracting a key value from the key instruction, and obtaining a first key value set supported by a non-focus window; and if the key value is in the first key value set, responding to the key instruction through the non-focus window, and obtaining the associated media resource data according to the key duration of the key instruction, so as to display the associated media resource data through the non-focus window. And if the key value is not in the first key value set, responding to the key instruction through the focus falling window. According to the method, key distribution can be executed between the focus-falling window and the non-focus-falling window based on the first key value set, and the problem that part of keys cannot respond can be solved. And different associated media asset data can be obtained according to different key pressing durations, so that media asset recommendation styles and user interaction modes are enriched, and the interaction experience of the user is improved.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a playback interface button interaction method. Background Art

[0002] Display devices are intelligent devices that can present user interfaces and support user interaction. Taking smart TVs as an example, smart TVs are based on Internet application technology, have open operating systems and chips, have open application platforms, can realize two-way human-computer interaction functions, and are TV products that integrate multiple functions such as audio and video, entertainment, and data to meet the diverse and personalized needs of users. Display devices can play startup media during the startup process, or automatically play opening screen media when a specific interface is displayed in the application, to display prompts and promotional content.

[0003] Taking the opening screen video as an example, when the display device displays the home page interface, it can call the media resource recommendation service such as the advertising service, and obtain the opening screen media resource data to be played through the advertising service. Then call the player to play the opening screen media resource data to form an automatically played media resource screen. The playing process of the opening screen video or boot animation can last for a certain length of time, such as a 15s opening screen video advertising video.

[0004] Since the automatically played media screen will block the user interface to be displayed, the user needs to wait for the corresponding media screen to finish playing during the playback of the opening screen video or the startup animation. In order to improve the user experience during the waiting process, the display device supports receiving interactive instructions input by the user during the automatic playback of the media screen, such as the user controlling the display device to skip the automatically played media screen by pressing the return key. However, for the playback process of the startup screen and the opening screen video, the display device supports fewer interactive methods, and many buttons cannot respond, which reduces the user experience. Summary of the invention

[0005] Some embodiments of the present application provide a display device and a playback interface button interaction method to solve the problem that some cases of the display device cannot respond when playing content such as a startup screen and a startup video.

[0006] In a first aspect, some embodiments of the present application provide a display device, including: a display, a communication device, and a controller. The display is configured to display a user interface; the communication device is configured to establish a communication connection with a control device and a server, the control device includes at least one button, and the control device is configured to respond to a user's button operation to obtain a button instruction; the controller is configured to perform the following steps:

[0007] Controlling the display to display a recommended media playback interface, wherein the recommended media playback interface includes an out-of-focus window and an out-of-focus window;

[0008] Acquire a key instruction input by a user, wherein the key instruction includes a key value when the user performs a key operation;

[0009] Extracting the key value from the key instruction, and acquiring a first key value set supported by the non-out-of-focus window;

[0010] If the key value is in the first key value set, respond to the key instruction through the non-focus window, and obtain the key duration corresponding to the key value in the key instruction; and obtain related media data according to the key duration, so as to display the related media data through the non-focus window;

[0011] If the key value is not in the first key value set, respond to the key instruction through the out-of-focus window.

[0012] In a second aspect, some embodiments of the present application further provide a display device, comprising: a display, a communication device, and a controller. The display is configured to display a user interface; the communication device is configured to establish a communication connection with a control device and a server, the control device includes at least one button, and the control device is configured to respond to a user's button operation to obtain a button instruction; the controller is configured to perform the following steps:

[0013] Controlling the display to display a recommended media playback interface;

[0014] Acquire a key instruction input by a user, wherein the key instruction includes a key value when the user performs a key operation;

[0015] If the key value is in the third key value set, the key duration of the key instruction is obtained, and the associated media asset data is obtained according to the key duration, and the display is controlled to display a media asset details interface, wherein the media asset details interface is generated according to the associated media asset data, and the third key value set includes a key value for displaying media asset details;

[0016] If the key value is not in the third key value set, a prompt effect animation is added to the recommended media asset playback interface, and the display is controlled to display the recommended media asset playback interface after the prompt effect animation is added.

[0017] In a third aspect, some embodiments of the present application further provide a playback interface key interaction method, which is applied to the display device described in the first aspect, and the playback interface key interaction method includes:

[0018] When displaying the recommended media playback interface, obtaining a key command input by the user, wherein the recommended media playback interface includes a focus window and a non-focus window; the key command includes a key value when the user performs a key operation;

[0019] Extracting the key value from the key instruction, and acquiring a first key value set supported by the non-out-of-focus window;

[0020] If the key value is in the first key value set, respond to the key instruction through the non-focus window, and obtain the key duration corresponding to the key value in the key instruction; and obtain related media data according to the key duration, so as to display the related media data through the non-focus window;

[0021] If the key value is not in the first key value set, respond to the key instruction through the out-of-focus window.

[0022] In a fourth aspect, some embodiments of the present application further provide a playback interface key interaction method, which is applied to the display device described in the second aspect, and the playback interface key interaction method includes:

[0023] When displaying the recommended media asset playback interface, obtaining a key instruction input by the user, wherein the key instruction includes a key value when the user performs a key operation;

[0024] If the key value is in the third key value set, the key duration of the key instruction is obtained, and the associated media asset data is obtained according to the key duration, and the display is controlled to display a media asset details interface, wherein the media asset details interface is generated according to the associated media asset data, and the third key value set includes a key value for displaying media asset details;

[0025] If the key value is not in the third key value set, a prompt effect animation is added to the recommended media asset playback interface, and the display is controlled to display the recommended media asset playback interface after the prompt effect animation is added.

[0026] It can be seen from the above technical solutions that some embodiments of the present application provide a display device and a playback interface key interaction method, which can obtain a key instruction input by a user when the display device displays a recommended media playback interface. And extract the key value from the key instruction, and obtain the first key value set supported by the non-focus window. If the key value is in the first key value set, respond to the key instruction through the non-focus window, and obtain the associated media data according to the key duration of the key instruction to display the associated media data through the non-focus window. If the key value is not in the first key value set, respond to the key instruction through the focus window. The method can perform key distribution between the focus window and the non-focus window based on the first key value set, which can improve the problem that some keys cannot respond. And different associated media data can be obtained according to different key durations, enriching the recommended media style and user interaction method, and improving the user's interactive experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0028] Figure 1 A schematic diagram showing usage scenarios of a display device in some embodiments of the present application;

[0029] Figure 2 A hardware configuration block diagram of a display device provided in some embodiments of the present application;

[0030] Figure 3 A schematic diagram of software configuration in a display device provided in some embodiments of the present application;

[0031] Figure 4 A schematic diagram of a screen-opening video display effect provided in some embodiments of the present application;

[0032] Figure 5 A schematic diagram of another open-screen video display effect provided in some embodiments of the present application;

[0033] Figure 6 A schematic diagram of a prompt window provided for some embodiments of the present application;

[0034] Figure 7 A schematic diagram of a playback interface button interaction method flow chart provided in some embodiments of the present application;

[0035] Figure 8 A schematic diagram of a display process of a recommended media playback interface provided in some embodiments of the present application;

[0036] Fig. 9 A schematic diagram of a key distribution process provided for some embodiments of the present application;

[0037] Fig.10 A timing diagram of key distribution execution for a homepage application provided in some embodiments of the present application;

[0038] Fig.11 A timing diagram of key distribution execution for an advertising service application provided in some embodiments of the present application;

[0039] Fig.12 A schematic diagram of a process for obtaining key duration provided in some embodiments of the present application;

[0040] Fig.13 A timing diagram of loading associated media asset data for a detail page application provided in some embodiments of the present application;

[0041] Fig.14 An animated schematic diagram of a prompt effect provided in some embodiments of the present application;

[0042] Fig.15 A schematic diagram of a detailed interface provided for some embodiments of the present application;

[0043] Fig.16 A schematic diagram of a process for determining a media asset type according to a duration interval provided in some embodiments of the present application;

[0044] Fig.17 A schematic diagram of prompt graphics provided for some embodiments of the present application;

[0045] Fig.18 A timing relationship diagram for recommending media resources based on key press duration provided in some embodiments of the present application. DETAILED DESCRIPTION

[0046] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0047] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0048] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0049] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0050] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0051] In the embodiment of the present application, the display device 200 generally refers to a device with image display and data processing capabilities. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0052] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG. 1 , a user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. The control device 100 is used to receive operation instructions input by the user and convert the operation instructions into control instructions that can be recognized and responded to by the display device 200. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0053] In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, and the display device 200 is controlled wirelessly or wired. The user may control the display device 200 by inputting user commands through buttons on the remote controller, voice input, control panel input, etc.

[0054] The mobile terminal 300 can be used as a control device for performing human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 and performing data interaction. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.

[0055] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application program for controlling the display device 200 .

[0056] like Figure 1 As also shown in FIG. 4 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0057] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.

[0058] Figure 2 A hardware configuration block diagram of a display device 200 provided for some embodiments of the present application.

[0059] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0060] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0061] In some embodiments, the device interface 240 may include, but is not limited to, a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. The device interface 240 may also be a composite input / output interface formed by the above multiple interfaces.

[0062] The display device 200 can be connected to the external device 500 through the device interface 240. The external device 500 can be a set-top box, a game console, a PC, etc. When the display device 200 is connected to the external device 500 through the device interface 240, a corresponding signal source channel can be established, and an input signal can be received through the signal source channel. For example, the display device 200 can be connected to a game device through an HDMI interface to establish an HDMI channel, and receive audio and video signals sent by the game device based on the HDMI channel.

[0063] In some embodiments, the display 260 includes a display function component for presenting a picture, and a driving component for driving an image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, and components of a menu control interface and a user control UI interface.

[0064] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication modes. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0065] The communication device 220 can enable the display device 200 to communicate with the external device or server 400 by wireless or wired connection. Among them, the wired connection can connect the display device 200 with the external device through components such as data cables and interfaces. The wireless connection can connect the display device 200 with the external device through wireless signals or wireless networks. The display device 200 can establish a connection relationship with the external device directly, or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

[0066] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first interface to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0067] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0068] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0069] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or may be an external audio output device of the display device 200. In particular, for the external audio output device of the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0070] In some embodiments, the user input interface 280 may be used to receive instructions from a user.

[0071] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface, for example, the operating system can directly control the display device to provide a user interface, or can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0072] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0073] The operating system can be divided into different modules or levels according to the functions implemented. For example, in some embodiments, Figure 3 As shown, taking the Android system as an example, the system is divided into four layers, from top to bottom, namely, the application layer (Applications layer) (referred to as "application layer"), the application framework layer (Application Framework layer) (referred to as "framework layer"), the system library layer and the kernel layer. In some embodiments, the operating system of the display device can also be other operating systems.

[0074] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on the applications. At least one application can be run in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. that come with the operating system; they can also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0075] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access system resources and obtain system services during execution.

[0076] like Figure 3 As shown, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to the application package currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0077] In some embodiments, the activity manager is used to manage the life cycle of each application and the usual navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes, for example, reducing the display window, shaking the display, distorting the display, etc.

[0078] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0079] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 3 As shown, the kernel layer may be configured with hardware drivers, and the drivers included in the kernel layer may be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0080] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0081] In some embodiments, the display device 200 can automatically play media data when executing a specific process or displaying a specific interface. The specific process may be a process that needs to be guided, or has a long operating cycle, or requires an interface refresh. Such as a boot process, an application installation process, a software upgrade process, etc. The specific interface may be an interface with a long rendering cycle, or with a recommendation function, or a comprehensive function. Such as a homepage interface, a media recommendation interface, an application interface, etc. The automatically played media data may be a video with a logo function, an information promotion function, an operation guidance function, a feature display function, etc. Such as a boot animation, a splash screen advertisement, a homepage recommendation video, a media trailer, etc.

[0082] It should be noted that, in the embodiments of the present application, media data refers to multimedia resources that require a certain amount of time to display. The media data may be conventional video media with video and audio content, or may be pure image video without sound, such as dynamic images, static images, text, etc. In some embodiments, the automatically played material may also be media without image content, such as media content with pure audio data. For ease of description, in the embodiments of the present application, the media data that is automatically played when a specific process is executed or a specific interface is displayed is referred to as recommended media data.

[0083] In some embodiments, the display device 200 can recommend media data playback through the synergy between the operating system, UI applications and service processes. Among them, the operating system can provide a basic operating environment that allows applications and advertising services to run. In addition, the operating system can also provide various application interfaces (APIs) to allow applications to interact with system services. UI applications such as JUUI are used to present user interfaces. UI applications can provide interfaces for direct user interaction, and the interface can include a media display area. When an application needs to display recommended media data, the UI application will request the media service process such as the advertising service (AD service) through the API to send the recommended media data to be displayed. The media service can be a built-in media recommendation system or a third-party service, such as ××AdMob, etc. The media service can provide media data content, including the loading, display, tracking of media data, and the interaction between users and the media playback process.

[0084] Taking the display of a splash screen advertisement as an example, when displaying an advertisement, a UI application such as JUUI initiates an advertisement request by calling the API of the advertisement service. After receiving the request, the advertisement service obtains the advertisement content from the server 400 or the local storage. After obtaining the advertisement content, the advertisement service passes the advertisement content to the UI application through the API. The UI application renders the advertisement content on the user interface, that is, displays the advertisement content in the advertisement display area of ​​the user interface.

[0085] The recommended media data may have different uses according to the specific process executed or the specific interface displayed by the display device 200. The media data for different uses may contain different contents and have different forms. The automatically played media data may come from the local storage of the display device 200 or from the server 400. The media data from the local storage may be stored in different media according to different uses.

[0086] In some embodiments, the media data used to form the boot animation may be a static image or dynamic image file built into the system file; the media data used to form the boot advertisement may be a video file stored in the boot call storage space; the media data used to form the interface guidance may be a video or image file contained in the interface configuration file; the media data used to form the homepage pop-up advertisement may be a video or image file pushed by the server 400.

[0087] In some embodiments, the display device 200 can obtain the recommended media data by parsing the system file. For example, when the display device 200 executes the boot process, it can obtain the recommended media data by reading the file name and storage address of the recommended media data set in the boot process and accessing the corresponding storage address.

[0088] In some embodiments, the display device 200 may also obtain the recommended media asset data by parsing the interface configuration file. For example, when the display device 200 displays the setting interface for the first time, it may extract the guide media asset data according to the guide video storage address recorded in the configuration file corresponding to the setting interface.

[0089] In some embodiments, the display device 200 may also send a media asset acquisition request to the server 400, so that the server 400 can feed back recommended media asset data to the display device 200 according to the media asset acquisition request. For example, when the display device 200 displays the media asset recommendation interface, it will send a media asset acquisition request to the server 400 before presenting the media asset recommendation interface. After receiving the media asset acquisition request, the server 400 extracts relevant media asset data from the database according to the type of the current interface to be displayed (i.e., the media asset recommendation interface) and the delivery strategy.

[0090] After obtaining the recommended media data, the display device 200 can call the relevant application to play it according to the specific type of the recommended media data. For example, for video type materials, the display device 200 can call a video player, and decode the media data through the video player to form a playback screen of the media data, and display the playback screen through the display 260.

[0091] In some embodiments, the recommended media asset data can be started through a related process, and the playback ends with the running status of the process or the rendering progress of the interface. Taking the playback process of the splash screen advertisement on the home page interface as an example, after the display device 200 is powered on, it will render the home page interface through the home page application. According to the rendering process of the home page interface, the advertising media asset data can be requested from the advertising system through the advertising service application. After the advertising system sends the advertising data, the display device 200 can decode the advertising data to form a splash screen advertisement. After the splash screen advertisement ends, or the playback time reaches the preset delivery time requirement, the display device 200 can cancel the display of the splash screen advertisement and then display the home page interface.

[0092] In some embodiments, the playback screen of the recommended media asset data can be displayed through a separate interface. For example, during the boot-up process, the display device 200 can first display the boot-up interface, which can first display the brand logo, and then display system information and other content, and switch to display the boot-up video interface as the boot-up process progresses. After the boot-up video is played, the display device 200 switches to display the home page interface. That is, in the above display process, the boot-up interface, the boot-up video interface, and the home page interface are three independent interfaces.

[0093] In some embodiments, the playback screen of the recommended media asset data may also be displayed in a separate window in the interface to be displayed. Figure 4As shown, the separate window for displaying the recommended media asset data playback screen may be a part of the interface to be displayed, such as an animation window, a specific position recommendation position, etc. in the interface to be displayed. Figure 5 As shown, the separate window for displaying the recommended media asset data playback screen may also be a floating window of the interface to be displayed.

[0094] In some embodiments, the display device 200 also supports interruption of playback control during playback of media data, that is, the display device 200 can control the stop of playback of media data by receiving an interruption instruction input by the user, or automatically generating an interruption instruction according to the running state, and display the user interface that should be displayed after the playback of the media data.

[0095] For example, when the display device 200 displays the home page interface for the first time after being powered on, a splash screen video may be displayed. The splash screen video may be displayed for 15 seconds according to the delivery strategy, that is, the splash screen video stops playing and the home page interface is displayed after playing for 15 seconds. During the splash screen video, the user may skip the splash screen video by pressing the return key on the control device 100, that is, input an interrupt command, and control the display device 200 to directly display the home page interface.

[0096] In some embodiments, the display device 200 may also support user interactive control when playing the recommended media data. That is, the display device 200 may receive control instructions input by the user during the display of the recommended media data playback screen, and different control instructions may control the display device 200 to perform different functional responses. For example, the user may control the display device 200 to stop playing the recommended media data by pressing the return key on the remote control. The user may also control the display device to switch to the detailed interface associated with the recommended media data by using the arrow keys.

[0097] In some embodiments, when the display device 200 plays the recommended media asset data, a prompt window may be displayed in the playback interface of the recommended media asset data, and the prompt window may display a message for prompting the user of the currently supported interaction methods. Figure 6 As shown, when the display device 200 displays the advertising interface, it can display a prompt window in the form of a small window in the lower right corner. The prompt window can include text with prompt functions such as "Press and hold the right button for a surprise" and "Press and hold the menu button to jump to the product interface" to prompt the user to perform corresponding interactive operations.

[0098] The prompt window is an independent window relative to the playback window. Since the operating system of the display device 200 is provided with a focus control logic, that is, only one window can obtain the focus at the same time, and the window that obtains the focus can respond to the control command input by the user, therefore, when the display device 200 simultaneously displays the playback screen and the prompt window of the recommended media asset data, some control commands cannot be responded to due to the focus strategy, which reduces the user experience.

[0099] In order to better respond to the interactive instructions input by the user, a playback interface key interaction method is provided in some embodiments of the present application. The playback interface key interaction method can distribute the key instructions through a key distribution strategy so that the key instructions can be responded to more accurately. The method can be applied to a display device 200. Among them, the display device 200 includes a display 260, a communication device 220 and a controller 250. Among them, the display 260 is configured to display a user interface; the communication device 220 is configured to establish a communication connection with the control device 100 and the server 400, and the control device 100 includes at least one button, and the control device 100 is configured to respond to the user's key operation to obtain the key instruction.

[0100] like Figure 7 As shown, the controller 250 is configured to execute the playback interface key interaction method, including the following contents:

[0101] S100: When displaying the recommended media resource playback interface, obtaining a key command input by the user.

[0102] In order to perform the interaction of the playback interface, the display device 200 needs to first display the recommended media playback interface. The recommended media playback interface refers to a playback interface for displaying recommended media data. The display device 200 can display the playback interface of the recommended media data in response to a specific control instruction. In some embodiments, the user can input a power-on instruction, and the display device 200 can control the display 260 to display the power-on interface in response to the power-on instruction input by the user, and when the power-on process is executed to a specific stage, the display device 200 can display the playback interface of the power-on recommended media.

[0103] In some embodiments, the display device 200 may display a display instruction of a target interface in response to a display instruction input by a user. The target interface is a user interface that supports displaying recommended media data, such as a homepage interface, an application interface, a settings interface, etc. After receiving the display instruction, the display device 200 displays the target interface. Since the target interface supports automatic playback of recommended media data before display, the display device 200 may display the playback screen of the recommended media data on the opening screen through the display 260 before displaying the target interface.

[0104] The control instructions for controlling the display device 200 to display the recommended media asset playback interface can be input according to the interaction methods supported by the display device 200, such as one or more combinations of button interaction, voice interaction, touch interaction, somatosensory interaction, gesture interaction, etc.

[0105] In some embodiments, after the user inputs a display instruction for displaying the home page interface, the display device 200 can run an interface application such as a home page application, and render the home page interface by running the home page application. During the rendering process, the home page application can create an interface display container, that is, an active component for displaying interface content, such as an activity component.

[0106] like Figure 8 As shown, in some embodiments, the display device 200 can also parse the interface data after acquiring the interface data. And perform display control according to the interface data parsing result. The display device 200 can parse the media resource request tag from the interface data, and the media resource request tag is used to determine whether the current target interface supports the display of the opening screen media resource picture. If the target interface supports the display of the recommended media resource picture, the interface data of the target interface may include at least one media resource request tag. The media resource request tag is used to indicate that the opening screen media resource picture needs to be displayed before the target interface is displayed.

[0107] If the media resource request tag is not parsed from the interface data, that is, the currently displayed target interface does not need to display the recommended media resource data, the display device 200 can generate the target interface according to the interface data through the interface application, and display the target interface. Taking the interface application as a JUUI application as an example, after the display device 200 obtains the interface data sent by the server 400, it can parse the media resource request tag "Adtag" from the interface data through the JUUI application. When it is determined by parsing the data that the interface data does not contain the media resource request tag "Adtag", the JUUI application can render the homepage interface according to the interface data. That is, the display device 200 can first parse the interface data into a format such as JSON, XML, etc. that the application can understand. The JUUI application then maps the parsed interface data to the data model of the Java or Kotlin class of the application. Bind the data model to the UI component. Then use the data in the data model to update the UI component. And re-render the view according to the updated UI component status.

[0108] That is Fig. 9As shown, if a media resource request tag is parsed from the interface data, that is, the currently displayed target interface needs to display recommended media resource data, the display device 200 can generate a target interface according to the interface data through the interface application on the one hand, and obtain recommended media resource data through the media resource service on the other hand. Since the home page interface can display the opening video, the media resource service (Adservice) and other media resource services can be called according to the rendering process of the home page interface. The media resource service then generates a media resource acquisition request according to the interface type of the home page interface, and sends the media resource acquisition request to the media resource system (Adsystem) and other media resource systems to obtain the recommended media resource data. After obtaining the recommended media resource data, the operating system of the display device 200 will receive the receipt signal of the UI interface, and call the mideaplayer player in response to the receipt signal to decode and play the recommended media resource data to obtain the playback screen, and then display it through the media resource playback interface.

[0109] In some embodiments, the display device 200 can obtain the recommended media data from the local storage. For example, when the display device 200 is not connected to the network or the network configuration is not yet completed, the recommended media data can be obtained from the local storage. That is, the display device 200 also includes a memory, and the memory is configured to store the recommended media data. Before displaying the target interface, the display device 200 can generate a data call request and send the data call request to the memory to obtain the recommended media data stored in the memory.

[0110] In some embodiments, the display device 200 can obtain recommended media data from the server 400, that is, when the display device 200 obtains the recommended media data, it generates a media acquisition request and sends the media acquisition request to the server 400. In order to obtain the recommended media data, the server 400 can also be configured with a media service system such as an advertising system for storing and issuing recommended media data. The media acquisition request is used to enable the server 400 to feedback the recommended media data associated with the current target interface. The display device 200 then receives the recommended media data fed back by the server 400.

[0111] For example, the interface application is a JUUI application and the media asset service is an Adservice. After the JUUI application parses the media asset request tag "Adtag" from the interface data, it can generate a media asset acquisition request according to the media asset request tag. And send the media asset acquisition request to the advertising service system in the server 400. After obtaining the media asset acquisition request, the advertising service system can issue recommended media asset data according to the media asset acquisition request.

[0112] In some embodiments, the media resource request tag used to determine whether the target interface needs to display recommended media resource data can also be stored in a local configuration file. After receiving the display instruction, the display device 200 can read the configuration file locally to perform display control based on whether the configuration file contains the media resource request tag. For example, the configuration file of the target interface may include interface configuration parameters corresponding to the interface rendering process. When the display device 200 displays the target interface, it can perform interface rendering and display processes according to the configuration parameters. When the display device 200 executes a specific step, it can read the media resource request tag "Adtag". Then, based on the media resource request tag, the advertising service is called to obtain the splash screen advertising material.

[0113] After obtaining the recommended media data, the display device 200 can create a media display container for playing the recommended media data through the interface application or the media service application. Taking the opening screen advertisement playing process as an example, after receiving the advertisement data of the home page interface, the display device 200 can create a transparent window floating layer, and the page display level of the window floating layer is above the home page interface. The window floating layer can be used to display the media playback screen.

[0114] The media resource display container can be created through the homepage application. Fig.10 As shown, after the advertising service application receives the recommended media asset data, the advertising service application can send the recommended media asset data to the homepage application. The homepage application then creates a window floating layer based on the homepage interface display container according to the recommended media asset data. In order to facilitate the control of the created window, the window floating layer created by the homepage application belongs to the homepage interface display container, but the display level is higher than other components in the homepage interface display container.

[0115] The display device 200 can also create a window pop-up layer through the advertising service application. Fig.11 As shown, after receiving the recommended media data, the advertising service application can create a window floating layer according to the recommended media data. The window floating layer created by the advertising service application may not belong to the interface display container of the home page interface, that is, the home page interface display container is activityA, and the window floating layer created by the advertising service application is window B. Among them, the display level of window B is higher than that of activityA.

[0116] After creating the media asset display container, the display device 200 can load the recommended media asset data into the media asset display container, play the recommended media asset data, and display the recommended media asset playback screen on the media asset display container. The display device 200 then forms a recommended media asset playback interface by displaying the superimposed screen of the media asset display container and the interface display container.

[0117] The recommended media asset playback interface displayed by the display device 200 may include multiple windows (Window). Among them, the window may refer to an independent window in the playback interface, or may refer to a window component that forms the playback interface. Taking the window component as an example, the window component is one of the core parts of the user interface, which is responsible for displaying the interface of the application and processing user interaction. The window component may involve the synergy of components or services such as the activity component (Activity), the view component (View), and the window manager to form a specific playback interface.

[0118] The windows in the recommended media asset playback interface can be used to display different types of content. In some embodiments, the recommended media asset playback interface may include two windows, namely a playback window and a prompt window, wherein the playback window is used to display the playback screen of the recommended media asset data, and the prompt window is used to display prompt information. Figure 6 As shown, taking the opening screen advertising video as an example, when the display device 200 displays the advertising video of product A, the video advertising playback screen of product A can be displayed through the playback window. And through the prompt window, a prompt screen of "Press and hold the right key for a surprise" is displayed, so that the user can control the display device 200 to jump to the product details interface of product A by pressing and holding the right direction key on the remote control.

[0119] The recommended media playback interface can set one of the window components to gain focus according to the focus control logic of the operating system. Among them, focus refers to the control or component that the user can currently interact with through the input device. Focus management can be handled automatically by the operating system or controlled by the application. Correspondingly, a control or component can include three focus states, namely, no focus, focusable, and focused, and only focusable controls can gain focus. Taking the Android system as an example, you can control whether a control can gain focus by setting the focus attributes android:focusable and android:focusable In TouchMode of the control or component.

[0120] For the window components in the recommended media asset playback interface, the window that obtains the focus mark can be called a focus window, and the window that does not obtain the focus mark is called a non-focus window. That is, the recommended media asset playback interface includes a focus window and a non-focus window. In some embodiments, in order to better control the recommended media asset playback interface, the display device 200 can set the focus window of the recommended media asset playback interface to be a window that displays the media asset data playback screen through the operating system (or interface application, or media asset service application), and the non-focus window of the recommended media asset playback interface is a window that displays prompt information.

[0121] In some embodiments, Figure 8As shown, in order to form a recommended media asset playback interface including multiple windows, the display device 200 can obtain the media asset request tag of the target interface in response to the display instruction for displaying the target interface. Then, a media asset acquisition request is generated according to the media asset request tag, and the media asset acquisition request is sent to the server, so that the server queries the recommended media asset data in the media asset recommendation system based on the media asset acquisition request, and the recommended media asset data includes the media asset entity and the interactive resources associated with the media asset entity. Then, the recommended media asset data returned by the server is received for playback.

[0122] When playing the recommended media data, the display device 200 can also load the media entity and the interactive resource in the media display container, create a focused window and a non-focused window, and map the media entity to the playback component corresponding to the focused window, display the media entity through the focused window, map the interactive resource to the playback component corresponding to the non-focused window, and display the interactive resource through the focused window.

[0123] The display device 200 can receive various control instructions input by the user during the process of displaying the recommended media asset playback interface. Some control instructions can be input through the buttons of the control device 100 such as the remote controller provided with the display device 200, which are called button instructions. The button instructions are input by the user by performing button operations, so the button instructions may include the button values ​​when the user performs button operations.

[0124] For example, when the user inputs a key command by pressing the confirmation key, the key command may include the key value "KEYCODE_ENT ER"; when the user inputs a key command by pressing the return key, the key command may include the key value "KEYCODE_BACK". Similarly, the key value corresponding to the home key is "KEYCODE_HOME", the key values ​​corresponding to the volume up and down keys are "KEYCODE_VOLUME_UP" and "KEYCODE_VOLUME_DOWN" respectively, and the key values ​​corresponding to the up, down, left and right direction keys are "KEYCODE_DPAD_UP", "KEYCODE_DPAD_DOWN", "KEYCODE_DPAD_LEFT", "KEYCODE_DPAD_RIGHT", etc.

[0125] S200: Extracting the key value from the key instruction, and acquiring a first key value set supported by the non-out-of-focus window.

[0126] After obtaining the key command input by the user, the display device 200 can extract the key value from the key command, and distribute the key command according to the key value and the key value set supported by each window. That is, the key command supported by the non-out-of-focus window is distributed to the non-out-of-focus window, and the key command supported by the out-of-focus window is distributed to the out-of-focus window.

[0127] Among them, different windows can support different key events, and the display device 200 can determine the key value set supported by each window according to the specific function of the window. For the convenience of description, the key value set supported by the non-focus window is called the first key value set, and the key value set supported by the focus window is called the second key value set.

[0128] like Fig. 9 , Fig.10 As shown, in some embodiments, a key distribution process may be configured in the operating system or interface application, media service application and other applications of the display device 200. Among them, the key distribution process is used to distribute key instructions according to the key conditions supported by each window. The key distribution process can execute key distribution processes such as key capture, key distribution, and event processing. That is, when it is detected that the user presses a key on the remote control, keyboard or other input device, the display device 200 will generate a key event. The key distribution process first captures this key event and passes it to the currently activated application. Event distribution can be called when the key is pressed and released, that is, the key event will be passed to the application through the onKeyDown and onKeyUp methods of the Activity. After receiving the distributed key event, the application can handle the key event by rewriting onKeyDown and onKeyUp.

[0129] After requesting to obtain the recommended media asset data, the display device 200 can start the key distribution process and monitor the key instructions input by the user through the key distribution process. When the user performs a key operation to generate a press (onKeyDown) event and a lift (onKeyUp) event, the key distribution process can obtain the key event and key value.

[0130] Take the process of displaying a splash screen advertisement on the home page as an example. Fig.10 As shown, the display device 200 can create a media display container (Window floating layer) for displaying a splash screen advertisement on the upper layer of the homepage through the homepage application. At the same time, it is determined whether the homepage interface supports multi-window splash screen advertisement display. When it is determined that the homepage interface supports multi-window splash screen advertisement display, two window components are added to the media display container, respectively serving as a defocused window and a non-defocused window.

[0131] After creating the media asset display container and window components, the homepage application can also request the advertising system to obtain advertising materials through the advertising service application. Since the homepage interface supports multi-window open-screen advertising display, the advertising system can also issue light interactive materials and light interactive button configuration files while issuing advertising materials. After obtaining the advertising materials and light interactive materials, the homepage application loads the advertising materials on the current window (i.e., the defocused window). At the same time, the light interactive materials are loaded on the window that is not defocused (i.e., the non-defocused window). Then, according to the issued light interactive button configuration file, button distribution is performed. When the user presses a button to interact, the defocused window passes the button event to the button distribution process. The button distribution process distributes buttons according to the light interactive button configuration.

[0132] In addition to the press event and the lift event, the display device 200 can also determine other relevant parameters of the key command for the key event corresponding to the key command. In some embodiments, the display device 200 can obtain the key duration. That is, the display device 200 can monitor the operation events of the user's key operation, that is, monitor the press event and lift event generated when the user performs the key operation.

[0133] like Fig.12 As shown, when a press event is detected, the display device 200 can record a first moment in response to the press event being detected. The first moment is the moment when the user presses the key when performing a key operation. When a lift event is detected, the display device 200 can record a second moment in response to the lift event being detected, wherein the second moment is the moment when the user lifts the key when performing a key operation. The key duration is then generated by calculating the time difference between the first moment and the second moment.

[0134] For example, when the key distribution process of the display device 200 monitors the onKeyDown event, it can record the first time Td corresponding to the onKeyDown event, and continue to monitor the onKeyUp event within the preset monitoring period. When the onKeyUp event is monitored, the second time Tu corresponding to the onKeyUp event is obtained. Then, the case duration ΔT is obtained by calculating the first time Td and the second time Tu, that is, ΔT = |Tu-Td|.

[0135] S300: If the key value is in the first key value set, respond to the key instruction through the non-out-of-focus window.

[0136] After obtaining the key value and the first key value set supported by the non-focus window, the display device 200 can compare the key value with the first key value set. If the key value is in the first key value set, it means that the currently input key command can be responded to by the non-focus window. Therefore, the display device 200 can send the key command to the application corresponding to the non-focus window through the key distribution process, so as to respond to the key command through the non-focus window.

[0137] like Fig.13 As shown, taking the display device 200 displaying the splash screen advertisement of the homepage interface as an example, the displayed recommended media playback interface includes the product A video advertisement playback window (out-of-focus window) and the product A details interface jump prompt window (non-out-of-focus window). Among them, according to the light interactive key configuration file, the prompt window can respond to the direction key and the menu key, and the playback window can respond to the power key, the return key, the confirmation key, the volume key, etc. Then the first key value set includes "KEYCODE_DPAD_UP", "KEYCODE_DPAD_DOWN", "KEYCODE_DPAD_LEFT", "KEYCODE_DPAD_RIGHT" and "KEYCODE_MENU". When the display device 200 receives a key instruction from the user to press the right direction key based on the prompt content in the prompt window, the key distribution process of the display device 200 can extract the key value "KEYCODE_DPAD_RIGHT" from the key instruction. Since the key value "KEYCODE_DPAD_RIGHT" is in the first key value set, the display device 200 can respond to the key instruction through the details page application (or advertising service application, or homepage application) corresponding to the prompt window, that is, respond to the key instruction through the product A details interface display application, and jump to the product details interface displaying product A.

[0138] It can be seen that by setting the key distribution strategy, the display device 200 can reasonably distribute key commands to various windows including windows that have not obtained focus when displaying the recommended media playback interface, so that the response of key commands is not limited to the out-of-focus window, thereby alleviating the problem that the key can only be given to the currently out-of-focus window and other windows cannot respond to the key.

[0139] S400: If the key value is not in the first key value set, respond to the key instruction through the out-of-focus window.

[0140] The display device 200 compares the key value with the first key value set. If the comparison result is that the key value is not in the first key value set, it means that the currently displayed non-out-of-focus window cannot respond to the key instruction corresponding to the current key value. Therefore, the display device 200 can distribute the key instruction to the application corresponding to the out-of-focus window through the key distribution process, so that the display device 200 responds to the key instruction through the out-of-focus window.

[0141] For example, the key distribution process distributes keys according to the light interaction key configuration file. The light interaction key configuration file contains the key value that needs to be responded to by the current light interaction. After the focus window passes the key to the key distribution process, the key distribution process determines whether the current key value is in the key value set of the light interaction key configuration. If it is not in the key value set of the light interaction key configuration, the key needs to be distributed to the focus window for processing.

[0142] The way the out-of-focus window responds to key commands is the same as the non-out-of-focus window. The mapping relationship between the supported key values ​​and the actual functions can be determined through the configured key value set. First, the function item corresponding to the currently input key value is determined, and then the corresponding function process is called according to the function item, and the corresponding function is implemented by executing the function process. For example, jump to the interface, skip the recommended media playback process, adjust the volume, shut down, etc.

[0143] Since the out-of-focus window is used to display the playback screen of the recommended media when the display device 200 displays the recommended media playback interface, the out-of-focus window cannot support all keys. For unsupported key values, the display device 200 can also prompt the user through some animation effects with prompt functions to enrich the interface display content. That is, in some embodiments, when the display device 200 responds to the key instruction through the out-of-focus window, it can also obtain the second key value set supported by the out-of-focus window, and compare the key value with the second key value set to determine whether the key value is in the second key value set.

[0144] If the key value is in the second key value set, it means that the out-of-focus window can respond to the key command, so the key function can be queried according to the key value, and the display can be controlled to display the user interface after executing the key function. For example, when the display device 200 displays the advertising video of product A, it is detected that the user presses the return key on the remote control, and the display device 200 can receive the key command of the "KEYCODE_BACK" key value. Through the key distribution process, it can be determined that the first key value set supported by the product A advertising prompt window does not include "KEYCODE_BACK", and the second key value set supported by the product A playback window includes "KEYCODE_BACK", so the key distribution process can distribute the key command to the application corresponding to the playback window, that is, the homepage application or the advertising service application. After receiving the key command, the homepage application or the advertising service application can query the key function corresponding to "KEYCODE_BACK" to skip the advertisement, then the homepage application or the advertising service application can execute the skip advertisement program, that is, stop the playback process of the product A advertising video, and destroy the media display container and the canvas component on the media display container to control the display device 200 to continue to display the homepage interface.

[0145] If the key value is not in the second key value set, it means that the out-of-focus window cannot respond to the key command. At this time, the display device 200 can add a prompt effect animation in the out-of-focus window. For example, before the display device 200 displays the home page interface, while displaying the splash screen advertisement (i.e., the advertising video of product A), the user inputs a key command by pressing the home button, and the display device 200 can obtain the key value "KEYCODE_HOME" from the key command. Since neither the playback window nor the prompt window supports the response of the home button, the display device 200 can determine that the current key value is not in the second key value set supported by the out-of-focus window. At this time, the display device 200 can respond to the key command and add special effect views such as fireworks effect animations in the media display container to enrich the display content in the interface.

[0146] In some embodiments, in order to better reflect the prompt function of the prompt effect animation, the special effect view of the prompt effect animation can be associated with the window component corresponding to the non-focus window. The association relationship means that the display position, display style, display duration, etc. of the prompt effect animation can be set according to the display position, window style and window display duration of the non-focus window. For example, Fig.14 As shown, for a fireworks effect animation, the starting point of the fireworks animation may be located in the display area of ​​the non-out-of-focus window, so that the user can notice the content prompted in the non-out-of-focus window based on the fireworks effect.

[0147] It can be seen from the above technical solution that the playback interface key interaction method provided in the above embodiment can receive key instructions and obtain the key value in the key instruction and the first key value set supported by the non-out-of-focus window in the recommended media playback interface when the display device 200 displays the recommended media playback interface, so that when the key value is in the first key value set, the key instruction is distributed to the non-out-of-focus window for response, thereby enabling users to perform key operations between multiple windows and improve user experience.

[0148] In some embodiments, the display device 200 can also obtain different types of media data for display according to the key duration. That is, the display device 200 can obtain the key duration corresponding to the key value in the key instruction, and obtain the associated media data according to the key duration to display the associated media data.

[0149] When the display device 200 displays the recommended media asset playback interface, the media asset recommendation process may also be enabled. The media asset recommendation process is used to query the associated media asset data according to the key press duration, so that the display device 200 displays the interface corresponding to the associated media asset data in response to the key press instruction.

[0150] In the process of the display device 200 acquiring different types of media data for display according to the key press duration, the acquired media data can be displayed in different ways according to the different types of the displayed recommended media playback interface. In some embodiments, when the recommended media playback interface displayed by the display device 200 includes a focus window and a non-focus window, similar to the interface type provided in the above embodiments, the display device 200 can display the associated media data through the non-focus window. That is, when executing the response to the key command through the non-focus window, the display device 200 can obtain the key value corresponding to the press event in response to monitoring the press event.

[0151] Then, based on the key value, the key function is queried in the first key value set. If the key function is a display details function, the lift event is listened to within a preset listening period, and when the lift event is listened to, the associated media data is obtained according to the time interval between the press event and the lift event, and then the display is controlled to display the media details interface, wherein the media details interface is generated according to the associated media data.

[0152] For example, Fig.15 As shown, during the process of displaying the splash screen advertisement of product B, the display device 200 monitors the user's pressing event of the right direction key, that is, the key value is "KEYCODE_DPAD_RIGHT" and the key event is "onKeyDown". Based on this, the display device 200 can start the timer through the home application or the advertising service application, starting the timing from the time when the "onKeyDown" event occurs until the "onKeyUp" event of "KEYCODE_DPAD_RIGHT" is monitored, and the timing ends to obtain the key duration. Then, an associated media acquisition request is generated according to the key duration, and the associated media acquisition request is sent to the advertising system, so that the advertising system matches the associated media data of product B according to the key duration in the associated media acquisition request, and sends the associated media data. After the advertising service application obtains the associated media data, it can pass the associated media data to the home application, so that the home application generates a product details interface of product B according to the associated media data for display.

[0153] In some embodiments, in order to obtain the associated media asset data according to the key press duration, the display device 200 may query the media asset type associated with the key press duration. The amount of media asset data corresponding to the media asset type is positively correlated with the key press duration. For example, the longer the key press duration, the higher the clarity of the associated media asset data obtained.

[0154] like Fig.16As shown, in some embodiments, multiple duration intervals can be pre-set according to the push strategy, and each duration interval can correspond to a type of media asset. When the display device 200 queries the media asset type associated with the key duration, it can determine the duration interval according to the key duration. If the duration interval is the first interval, the media asset type is marked as picture media asset; if the duration interval is the second interval, the media asset type is marked as animated media asset; if the duration interval is the third interval, the media asset type is marked as frame animation media asset; if the duration interval is the fourth interval, the media asset type is marked as video media asset.

[0155] Among them, the minimum value of the second interval is greater than the maximum value of the first interval, the minimum value of the third interval is greater than the maximum value of the second interval, and the minimum value of the fourth interval is greater than the maximum value of the third interval. That is, according to the endpoint duration of the duration interval, the first interval, the second interval, the third interval and the fourth interval are set in sequence. Adjacent intervals can be separated by duration thresholds. For example, duration thresholds such as 200ms, 1s, and 2s can be divided into the first interval as [0, 200ms], the second interval (200ms, 1s], the third interval as (1s, 2s], and the fourth interval as (2s, ∞). The media asset types corresponding to different intervals are: the first interval is picture media assets, the second interval is dynamic image media assets, the third interval is frame animation media assets, and the fourth interval is video media assets.

[0156] Therefore, after obtaining the key press duration, the display device 200 can determine the duration interval to which the key press instruction belongs according to the key press duration, determine the type of associated media asset data according to the duration interval, and then obtain the associated media asset data according to the determined media asset type. That is, the display device 200 can generate an associated media asset acquisition request based on the media asset type, and send the associated media asset acquisition request to the server 400, so that the server 400 feeds back associated media asset data that meets the media asset type, and the display device 200 then receives the associated media asset data fed back by the server 400.

[0157] In order to obtain different types of media data, the display device 200 can access different resource addresses in the server 400 according to the key press duration. For example, when the key press duration is less than 200ms, you can access https: / / xxxx / xxx.png to obtain image resources. When the key press duration is greater than 200ms but less than 1s, you can access https: / / xxxx / xxx.gift to obtain Gif animation resources. When the case duration is greater than 1s but less than 2s, you can access https: / / xxxx / xxx.zip to obtain frame animation resources. When the key press duration is greater than 2s, you can access https: / / xxxx / xxx.mp4 to obtain video resources with naked-eye 3D effects.

[0158] In some embodiments, the display device 200 may also display prompt content related to the key press duration through a non-focus window. That is, the display device 200 may display a prompt graphic in the non-focus window based on the press event. The size of the prompt graphic is associated with the key press duration.

[0159] For example, Fig.17 As shown, when the display device 200 displays the prompt window of the product C prompt information, in response to detecting that the user presses the right direction key, a bar view component can be added to the window component corresponding to the prompt window to display a progress bar. The graphic representing the progress in the progress bar can gradually become longer as the key press duration increases. When the display device 200 determines the media asset type through multiple duration intervals, the homepage application or the advertising service application can also adjust the color of the progress bar component according to the different duration intervals to which the key press duration belongs. For example, when the key press duration is less than 200ms, the homepage application sets the color of the progress bar to blue. As the user continues to press the right direction key, so that the key press duration increases to greater than 200ms but less than 1s, the homepage application sets the color of the progress bar to yellow. When the key press duration increases to greater than 1s but less than 2s, the color of the progress bar is orange. After the key press duration increases to greater than 2s, the homepage application sets the color of the progress bar to red.

[0160] It can be seen that by displaying the prompt graphic in the non-out-of-focus window, the user's key event response can be displayed, further enriching the content displayed in the recommended media asset playback interface and improving the user's interactive experience.

[0161] In some embodiments, after the display device 200 obtains the corresponding type of associated media asset data according to the key press duration, the associated media asset data can be displayed through a non-focus window, a focused window, or a new display interface according to the type of the acquired associated media asset data. That is, if the media asset type corresponding to the acquired associated media asset data is the first type of media asset, the associated media asset data is displayed through a non-focus window. If the media asset type corresponding to the acquired associated media asset data is the second type of media asset, the associated media asset data is displayed through a focused window, or through a media asset details interface. Among them, the amount of data of the second type of media asset is greater than that of the first type of media asset.

[0162] For example, if the first type of media assets are images, dynamic images, and other media assets, the display device 200 can directly display the images or dynamic images in the prompt window (non-focused window) after obtaining the associated media asset data of the image or dynamic image type. If the second type of media assets are frame animations, videos, and other media assets, the display device 200 can call a video player to display the frame animations or video images in the playback window (focused window) after obtaining the associated media asset data of the frame animations or video types.

[0163] Based on the playback interface key interaction method provided in the above embodiments, a display device 200 is also provided in some embodiments of the present application. The display device 200 may include a display 260, a communication device 220 and a controller 250. Among them, the display 260 is configured to display a user interface. The communication device 220 is configured to establish a communication connection with the control device 100 and the server 400. The control device 100 includes at least one button, and the control device 100 is configured to respond to the user's key operation to obtain a key instruction. The controller 250 is configured to execute the playback interface key interaction method:

[0164] Controlling the display to display a recommended media playback interface, wherein the recommended media playback interface includes an out-of-focus window and an out-of-focus window;

[0165] Acquire a key instruction input by a user, wherein the key instruction includes a key value when the user performs a key operation;

[0166] Extracting the key value from the key instruction, and acquiring a first key value set supported by the non-out-of-focus window;

[0167] If the key value is in the first key value set, respond to the key instruction through the non-focus window, and obtain the key duration corresponding to the key value in the key instruction; and obtain related media data according to the key duration, so as to display the related media data through the non-focus window;

[0168] If the key value is not in the first key value set, respond to the key instruction through the out-of-focus window.

[0169] It can be seen from the above technical solutions that the playback interface button interaction method and display device 200 provided in the above embodiments can obtain different types of associated media data according to the button pressing duration when the user inputs a button instruction, and can interact with the user through button pressing when displaying interactive content. After the user presses a specified button, different display content is recommended to the user based on the duration between the user pressing the button and lifting the button, thereby improving the user's interactive experience.

[0170] In some embodiments, when the recommended media asset playback interface displayed by the display device 200 does not include multiple windows, the display device 200 may also obtain and display the associated media asset data according to the key value and key duration in the key instruction. Fig.18 As shown, the display device 200 can obtain a key instruction input by a user when displaying the recommended media asset playback interface, wherein the key instruction includes a key value when the user performs a key operation, and obtain a key value set for triggering the display of the media asset details interface, namely, a third key value set.

[0171] If the key value is in the third key value set, it means that the current key command of the user is used to control the display device 200 to display the media asset details interface, so the key press duration of the key command can be obtained, and the associated media asset data can be obtained according to the key press duration, and the display can be controlled to display the media asset details interface. The media asset details interface is generated according to the associated media asset data.

[0172] For example, when the display device 200 is displaying the picture advertisement screen of product D, it is detected that the user inputs a key instruction by pressing the confirmation key. Then, after receiving the key instruction, the display device 200 can parse the key value "KEYCODE_ENTER" from the key instruction, and obtain the third key value set "KEYCODE_ENTER" and "KEYC ODE_DPAD_RIGHT" used to jump to the product details in the current advertisement interface, so it can be determined that the currently input key value is in the third key value set. Therefore, the display device 200 can obtain the duration of the user's key press on the confirmation key. When the key press duration is less than 200ms, the picture detail data of product D can be obtained, and the detail interface of product D can be generated based on the picture detail data, and the detail interface of product D can be displayed. Similarly, when the key press duration is greater than 2s, the video detail data of product D can be obtained, and the player can be called to play the video detail data, and the video details of product D can be displayed through the detail interface containing the video playback window.

[0173] If the key value is not in the third key value set, that is, the key command input by the user is not used to control the display device 200 to jump to the display details interface, the display device 200 can add a prompt effect animation to the recommended media playback interface (S1706), and control the display to display the recommended media playback interface after adding the prompt effect animation (S1707). Among them, the prompt effect animation is the same as the prompt effect animation in the above embodiment, and can be an animation special effect with a prompt function, such as fireworks, bubbles, petals, light effects, etc.

[0174] It should be noted that, in the above embodiment, although the recommended media playback interface is not limited to include out-of-focus windows and out-of-focus windows, the above button interaction method can also be applied to the scenario where the recommended media playback interface includes out-of-focus windows and out-of-focus windows.

[0175] Take the process of displaying a splash screen advertisement on the home page as an example. Fig.18As shown, the display device 200 can determine whether the homepage interface supports multi-window open screen advertising display through the homepage application. When it is determined that the homepage interface does not support multi-window open screen advertising display, a notification is sent to the advertising service application, so that the advertising service application creates a media display container for displaying open screen advertising on the upper layer of the homepage interface. In addition, the advertising service application can request the advertising system to obtain advertising materials. The advertising system sends advertising materials, light interactive materials, and light interactive button duration recommendation rule files based on the received material acquisition request.

[0176] After obtaining the advertising material and light interactive material, the advertising service application can load the corresponding material content in the media asset display container. Then start the key monitoring process, and input the keys to be monitored into the key monitoring process according to the light interactive key duration recommendation rule file. When it is detected that the user presses the specified key, the key monitoring process starts the timer and begins timing. When it is detected that the user lifts the key, the key monitoring process calculates the key duration. Then, based on the key duration, a request for obtaining associated data is generated, and the request for obtaining associated data is sent to the advertising system. The advertising system then matches according to the key recommendation rules, determines the associated media asset data, and feeds the associated media asset data back to the advertising service application. The advertising service application then loads the associated media asset data in the media asset display container and displays the associated media asset data.

[0177] Based on the playback interface key interaction method provided in the above embodiments, some embodiments of the present application also provide a display device 200, which may include a display 260, a communication device 220, and a controller 250. Among them, the display 260 is configured to display a user interface. The communication device 220 is configured to establish a communication connection with the control device 100 and the server 400. The control device 100 includes at least one key, and the control device 100 is configured to respond to the user's key operation to obtain a key instruction. The controller 250 is configured to execute the playback interface key interaction method:

[0178] Controlling the display to display a recommended media playback interface;

[0179] Acquire a key instruction input by a user, wherein the key instruction includes a key value when the user performs a key operation;

[0180] If the key value is in the third key value set, the key duration of the key instruction is obtained, and the associated media asset data is obtained according to the key duration, and the display is controlled to display a media asset details interface, wherein the media asset details interface is generated according to the associated media asset data, and the third key value set includes a key value for displaying media asset details;

[0181] If the key value is not in the third key value set, a prompt effect animation is added to the recommended media asset playback interface, and the display is controlled to display the recommended media asset playback interface after the prompt effect animation is added.

[0182] As can be seen from the above technical solutions, the playback interface key interaction method and display device 200 provided in the above embodiments can extract the key value from the key command when the user inputs the key command, and obtain the third key value set for the user to display the media asset details interface. If the key value is in the third key value set, different types of associated media asset data are obtained according to the key press duration, thereby displaying the media asset details interface generated according to the associated media asset data. The method can interact with the user through key presses when displaying interactive content. After the user presses a specified key, different display content is recommended to the user according to the duration between the user pressing the key and lifting the key, thereby improving the user's interactive experience.

[0183] The same and similar parts between the various embodiments in this specification can be referenced to each other and will not be described again here.

[0184] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of various embodiments of the present invention or certain parts of the embodiments.

[0185] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0186] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that: include: a display configured to display a user interface; A communication device, configured to establish a communication connection with a control device and a server, wherein the control device includes at least one key, and the control device is configured to respond to a key operation of a user to obtain a key instruction; The controller is configured as: Controlling the display to display a recommended media playback interface, wherein the recommended media playback interface includes an out-of-focus window and an out-of-focus window; Acquire a key instruction input by a user, wherein the key instruction includes a key value when the user performs a key operation; Extracting the key value from the key instruction, and acquiring a first key value set supported by the non-out-of-focus window; If the key value is in the first key value set, respond to the key instruction through the non-focus window, and obtain the key duration corresponding to the key value in the key instruction; and obtain related media data according to the key duration, so as to display the related media data through the non-focus window; If the key value is not in the first key value set, respond to the key instruction through the out-of-focus window.

2. The display device according to claim 1, characterized in that The server is configured with a media resource recommendation system; and the controller is further configured to: In response to a display instruction for displaying a target interface, obtaining a media resource request mark of the target interface; Generate a media resource acquisition request according to the media resource request tag; Sending the media asset acquisition request to the server, so that the server queries the recommended media asset data in the media asset recommendation system based on the media asset acquisition request, wherein the recommended media asset data includes a media asset entity and interactive resources associated with the media asset entity; Receive the recommended media asset data returned by the server.

3. The display device according to claim 2, characterized in that After receiving the recommended media asset data returned by the server, the controller is further configured to: Loading the media assets and the interactive resources; Creating a defocused window and a non-defocused window, so as to display the media entity through the defocused window and display the interactive resource through the defocused window; Starting a key distribution process and a media asset recommendation process, wherein the key distribution process is used to distribute key instructions according to the first key value set; and the media asset recommendation process is used to query related media asset data according to the key duration; The key distribution process monitors the key commands input by the user.

4. The display device according to claim 1, characterized in that The controller executes a key command to obtain a user input, and is specifically configured as follows: Monitor the operation events of the user's key operation, which include press events and lift events; In response to monitoring the pressing event, recording a first moment, where the first moment is the moment when the user presses the key when performing a key operation; In response to monitoring the lift event, recording a second moment, where the second moment is the moment when the user lifts the key when performing the key operation; The time difference between the first moment and the second moment is calculated to generate the key pressing duration.

5. The display device according to claim 4, characterized in that The controller executes the response to the key instruction through the non-defocused window, and is specifically configured as follows: In response to monitoring the press event, obtaining a key value corresponding to the press event; Querying a key function in the first key value set based on the key value; If the button function is a display details function, a prompt graphic is displayed in the non-focus window based on the pressing event, and the size of the prompt graphic is associated with the button pressing duration; When the lifting event is monitored, the display is controlled to display a media asset details interface, where the media asset details interface is generated according to the associated media asset data.

6. The display device according to claim 1, characterized in that The controller executes acquiring the associated media asset data according to the key press duration, and is specifically configured as follows: Querying the media asset type associated with the key press duration, where the amount of media asset data corresponding to the media asset type is positively correlated with the key press duration; generating an associated media asset acquisition request based on the media asset type, and sending the associated media asset acquisition request to the server, so that the server feeds back associated media asset data that conforms to the media asset type; Receive the associated media asset data fed back by the server.

7. The display device according to claim 6, characterized in that The controller executes querying the media resource type associated with the key duration, and is specifically configured as follows: Determine a duration interval according to the key press duration; If the duration interval is the first interval, marking the media asset type as picture media asset; If the duration interval is the second interval, the media asset type is marked as a dynamic image media asset, and the minimum value of the second interval is greater than the maximum value of the first interval; If the duration interval is the third interval, the media asset type is marked as frame animation media asset, and the minimum value of the third interval is greater than the maximum value of the second interval; If the duration interval is the fourth interval, the media asset type is marked as video media asset, and the minimum value of the fourth interval is greater than the maximum value of the third interval.

8. The display device according to claim 1, characterized in that The controller executes the response to the key instruction through the defocus window, and is specifically configured as follows: Obtain a second key value set supported by the out-of-focus window; If the key value is in the second key value set, query the key function according to the key value, and control the display to display a user interface after executing the key function; If the key value is not in the second key value set, a prompt effect animation is added to the out-of-focus window, and a display area of ​​the prompt effect animation is associated with the non-out-of-focus window.

9. A display device, characterized in that: include: a display configured to display a user interface; A communication device, configured to establish a communication connection with a control device, the control device comprising at least one key, the control device being configured to respond to a key operation of a user to obtain a key instruction; The controller is configured as: Controlling the display to display a recommended media playback interface; Acquire a key instruction input by a user, wherein the key instruction includes a key value when the user performs a key operation; If the key value is in the third key value set, the key duration of the key instruction is obtained, and the associated media asset data is obtained according to the key duration, and the display is controlled to display a media asset details interface, wherein the media asset details interface is generated according to the associated media asset data, and the third key value set includes a key value for displaying media asset details; If the key value is not in the third key value set, a prompt effect animation is added to the recommended media asset playback interface, and the display is controlled to display the recommended media asset playback interface after the prompt effect animation is added.

10. A playback interface key interaction method, characterized in that: Applied to the display device according to any one of claims 1 to 8, the playback interface button interaction method comprises: When displaying the recommended media playback interface, obtaining a key command input by the user, wherein the recommended media playback interface includes a focus window and a non-focus window; the key command includes a key value when the user performs a key operation; Extracting the key value from the key instruction, and acquiring a first key value set supported by the non-out-of-focus window; If the key value is in the first key value set, respond to the key instruction through the non-focus window, and obtain the key duration corresponding to the key value in the key instruction; and obtain related media data according to the key duration, so as to display the related media data through the non-focus window; If the key value is not in the first key value set, respond to the key instruction through the out-of-focus window.

Images