Display device and display control method

Abstract

The embodiment of the invention relates to the technical field of intelligent terminals, and discloses a display device and a display control method, the display device comprises a display configured to display a user interface; the controller is coupled with the display and is configured to obtain historical use data of the historical application program; in response to a display operation input by a user for displaying a historical application page, controlling the display to display the historical application page according to the historical use data, the historical application page comprising an application bit of the at least one application program; and in response to a first selection operation of a user on a first application bit in the application bits of the at least one application program, controlling the display to display historical contents of the first application program in the historical application page according to the historical use data, the first application program being an application program corresponding to the first application bit. By applying the technical scheme of the invention, the operation convenience of using the application program by a user can be improved.

Description

Technical Field

[0001] This application relates to the technical field of display devices, and in particular, to a display device and a display control method. Background Art

[0002] With the continuous development of intelligent terminals, intelligent terminals can provide users with a variety of functions by installing different application programs.

[0003] However, with the increasing number of application programs installed on intelligent terminals, the operation process for users to start and view the content of application programs has become more cumbersome. For example, for historical applications used by users, they may be application programs that users often use. However, when users want to open an application program or view the historical content of an application program, they often need to locate to the navigation interface of the application program to start the application program, and users also need to view the historical content in the historical interface of the application program after starting the application program. Therefore, the operation convenience of users using application programs is insufficient. Summary of the Invention

[0004] Embodiments of the present invention provide a display device and a display control method, which are used to solve the problem of insufficient operation convenience of users using application programs in the prior art.

[0005] To achieve the above object, the embodiments of the present invention adopt the following technical solutions:

[0006] According to one aspect of the embodiments of the present invention, a display device is provided, including: a display configured to display a user interface; a controller coupled to the display and configured to: obtain historical usage data of historical application programs, where the historical application programs include at least one application program that the display device has run during a historical time period, and the historical usage data includes historical content of the at least one application program; in response to a display operation for displaying a historical application page input by a user, control the display to display the historical application page according to the historical usage data, where the historical application page includes application positions of the at least one application program; in response to a first selection operation on a first application position in the application positions of the at least one application program by the user, control the display to display the historical content of a first application program in the historical application page, where the first application program is the application program corresponding to the first application position.

[0007] The above technical solution has the following advantages or beneficial effects: By displaying the historical application page to provide selectable application positions for the user, it is convenient for the user to view the historical content of the application program in the historical application page, enabling the user to understand the content information of the application program within a historical time period without opening the application program, which can facilitate the user to view the historical content of the application program and improve the interactivity of the historical application page, thereby enhancing the user experience.

[0008] In some embodiments of the present application, the historical content includes a recorded video or a content screenshot. The controller is configured to control the display to display the historical content of the first application program in the historical application page according to the historical usage data, and is specifically configured to: obtain the first recorded video corresponding to the first application program or the first content screenshot corresponding to the first application program according to the historical usage data; when the first recorded video is obtained, control the display to play the first recorded video at the first application position; when the first content screenshot is obtained, control the display to display the first content screenshot at the first application position.

[0009] The above technical solution has the following advantages or beneficial effects: By playing the recorded video of the application program or displaying the content screenshot of the application program at the application position of the application program in the historical application page, it can help the user quickly understand the historical running content of the application program and facilitate the user to operate the application program.

[0010] In some embodiments of the present application, the controller is further configured to: when displaying the historical content of the first application program in the historical application page, if a second selection operation for the first application position is detected, start the first application program and control the display to display the application interface of the first application program.

[0011] The above technical solution has the following advantages or beneficial effects: By this method, the startup speed of the application program can be improved, enabling the user not to start the application program from the navigation interface of the display device.

[0012] In some embodiments of the present application, the controller is further configured to: within the historical time period, detect whether the first application program triggers audio and video playback at a preset time interval; when it is detected that the first application program triggers audio and video playback, control the display to record the video played in the playback window of the first application program at a first time interval to obtain the first recorded video; or, when it is not detected that the first application program triggers audio and video playback, control the display to capture a screenshot of the content interface of the first application program at a second time interval to obtain the first content screenshot.

[0013] The above technical solution has the following advantages or beneficial effects: through this method, the historical content of the first application can be generated according to the running status of the first application.

[0014] In some embodiments of the present application, after controlling the display to display the historical application page, the controller is further configured to: when the playback window of the first application is at the bottom of the view layer of the historical application page, control the display to continue recording the video played in the playback window of the first application at the first time interval to obtain a second recorded video corresponding to the first application; or, when the content interface of the first application is at the bottom of the view layer of the historical application page, control the display to continue taking screenshots of the content interface of the first application at the second time interval to obtain a second content screenshot corresponding to the first application.

[0015] The above technical solution has the following advantages or beneficial effects: through this method, new historical content can be continuously generated during the operation of the application.

[0016] In some embodiments of the present application, the controller is further configured to: when controlling the display to play the first recorded video in the first application position, if the second recorded video is obtained according to the historical usage data, control the display to stop playing the first recorded video and play the second recorded video in the first application position, or, loop play the first recorded video and the second recorded video in the first application position; or, when controlling the display to display the first content screenshot in the first application position, if the second content screenshot is obtained according to the historical usage data, control the display to stop displaying the first content screenshot and display the second content screenshot in the first application position, or, loop display the first content screenshot and the second content screenshot in the first application position.

[0017] The above technical solution has the following advantages or beneficial effects: through the above method, new historical content can be generated according to the running status of the application program, and the new historical content can be displayed on the historical application page.

[0018] In some embodiments of the present application, the controller is further configured to: when controlling the display to record the video played in the playback window of the first application at the first time interval, if a new recorded video is generated, update the first recorded video to the new recorded video; or, when controlling the display to take a screenshot of the content interface of the first application at the second time interval, if a new content screenshot is generated, update the first content screenshot to the new content screenshot.

[0019] The above technical solution has the following advantages or beneficial effects: through this updating method, the recorded video or content screenshots can be continuously updated during the operation of the application, which can reduce the storage pressure of the display device.

[0020] In some embodiments of the present application, the historical application page also includes a recommended application position of at least one recommended application, and the controller is further configured to: in response to a user's third selection operation on a second application position in the historical application page, start a second application corresponding to the second application position, and control the display to display the application interface of the second application; wherein the second application position is any one of the application position of the at least one application and the recommended application position of the at least one recommended application.

[0021] The above technical solution has the following advantages or beneficial effects: through this method, recommended applications can be provided to users, so that users can quickly operate applications in the historical application page, which can improve the convenience of users operating applications.

[0022] In some embodiments of the present application, the controller is further configured to: in response to a user's first editing operation on the historical application page, control the historical application page to enter an editing state; and after controlling the historical application page to enter the editing state, in response to a user's second editing operation on any one or more application bits in the application bits of the at least one application, delete the any one or more application bits, or sort the any one or more application bits.

[0023] The above technical solution has the following advantages or beneficial effects: the user can edit the application location in the historical application page, which can meet the user's personalized needs.

[0024] According to another aspect of an embodiment of the present application, a display control method is provided, the method comprising: obtaining historical usage data of historical applications, the historical applications comprising at least one application run by a display device within a historical time period, the historical usage data comprising historical content of the at least one application; in response to a display operation input by a user to display a historical application page, controlling the display to display the historical application page according to the historical usage data, the historical application page comprising an application position of the at least one application; in response to a first selection operation of the user on a first application position in the application positions of the at least one application, controlling the display to display the historical content of the first application in the historical application page according to the historical usage data, the first application being the application corresponding to the first application position.

[0025] The above technical solution has the following advantages or beneficial effects: According to the historical usage data of historical application programs, when receiving a display operation for displaying a historical application page input by a user, the historical application page is displayed, and the user can select the application positions of the historical application programs in the historical application page, so that the historical content of the application programs can be displayed at the application positions, enabling the user to view the historical content of the application programs without opening the application programs.

[0026] According to the display device and display control method provided by the embodiments of the present application, the display device can obtain the historical usage data of historical application programs, and in response to a display operation for displaying a historical application page input by a user, according to the historical usage data, control the display to display the historical application page, where the historical application page includes application positions of at least one application program, and then in response to a first selection operation on a first application position among the application positions of at least one application program by the user, according to the historical usage data, control the display to display the historical content of the first application program in the historical application page, where the first application program is the application program corresponding to the first application position.

[0027] Applying this solution, the historical application page can be displayed to provide selectable application positions for the user, facilitating the user to view the historical content of the application programs in the historical application page, enabling the user to understand the content information of the application programs within a historical time period without opening the application programs, being able to provide convenience for the user to view the historical content of the application programs, and being able to improve the interactivity of the historical application page, thereby enhancing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0029] Figure 1 Schematic diagram of the operation scenario between a display device and a control device provided by some embodiments of the present application;

[0030] Figure 2 Schematic diagram of the hardware configuration of a display device provided by some embodiments of the present application;

[0031] Figure 3 Schematic diagram of the software configuration of a display device provided by some embodiments of the present application;

[0032] Figure 4 Flowchart of a display control method provided by some embodiments of the present application;

[0033] Figure 5 A schematic diagram of a historical application page provided by some embodiments of the present application;

[0034] Figure 6 Another schematic diagram of a historical application page provided by some embodiments of the present application;

[0035] Figure 7 A sub - flowchart of a display control method provided by some embodiments of the present application;

[0036] Figure 8 A flowchart of a monitoring method for an application program provided by some embodiments of the present application;

[0037] Figure 9 A flowchart of a method for playing a recorded video provided by some embodiments of the present application;

[0038] Figure 10 Another sub - flowchart of a display control method provided by some embodiments of the present application;

[0039] Figure 11 Another schematic diagram of a historical application page provided by some embodiments of the present application;

[0040] Figure 12 A flowchart of another display control method provided by some embodiments of the present application. Detailed implementation manners

[0041] The embodiments will be described in detail below, and the examples are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following embodiments do not represent all implementation manners consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application detailed in the claims.

[0042] It should be noted that the brief description of the terms in the present application is only for facilitating the understanding of the following described implementation manners, rather than intending to limit the implementation manners of the present application. Unless otherwise specified, these terms should be understood in their ordinary and general meanings.

[0043] The terms "first", "second", "third", etc. in the specification, claims and above - mentioned drawings of the present application are used to distinguish similar or like objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that such terms can be interchanged under appropriate circumstances.

[0044] The terms "comprise," "include," and "have," and any variations thereof, are intended to cover but not exclude inclusion; for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0045] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functionality associated with that element.

[0046] In the embodiments of the present application, the display device 200 generally refers to a device capable of displaying images and processing data. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0047] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG, a user can operate the display device 200 through touch operation, the mobile terminal 300, and the control device 100. The control device 100 is used to receive operation instructions input by the user and convert the operation instructions into control instructions that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus pen, a handle, etc.

[0048] The mobile terminal 300 can function as a control device for performing human-computer interaction between a user and the display device 200. The mobile terminal 300 can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, enabling connection and communication via a network communication protocol, enabling one-to-one control operations and data communication. Audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 for synchronized display.

[0049] In some embodiments, the mobile terminal 300 or other electronic devices can also simulate the functions of the control device 100 by running an application program for controlling the display device 200 .

[0050] like Figure 1 As shown in FIG, the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0051] The display device 200 can provide a broadcast receiving TV function, and can additionally provide an intelligent network TV function with computer support functions, including but not limited to, Internet TV, smart TV, Internet Protocol TV (IPTV), etc.

[0052] Figure 2 For some embodiments of this application Figure 1 The hardware configuration block diagram of the display device 200 in

[0053] In some embodiments, the display device 200 may include at least one of a tuner demodulator 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0054] In some embodiments, the detector 230 is used to collect signals from the external environment or interact with the outside. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of environmental light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures. Or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0055] In some embodiments, the display 260 includes a display function component for presenting a picture and a driving component for driving image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, components of a menu manipulation interface, and a user manipulation UI interface, etc.

[0056] In some embodiments, the communication device 220 is a component for communicating with external devices or a server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 according to different supported communication methods. For example, when the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0057] The communication device 220 can communicate and connect the display device 200 with external devices or the server 400 in a wireless or wired connection manner. Among them, the wired connection can connect the display device 200 with external devices through components such as data lines and interfaces. The wireless connection can connect the display device 200 with external devices through wireless signals or wireless networks. The display device 200 can directly establish a connection relationship with external devices, or can indirectly establish a connection relationship through gateways, routers, connection devices, etc.

[0058] In some embodiments, the controller 250 may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processor, and a power processor, and first to nth interfaces for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in a memory. The controller 250 controls the overall operation of the display device 200.

[0059] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0060] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0061] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may further be provided with an external audio output terminal, through which the audio output device may be connected to the display device 200 to output the sound of the display device 200.

[0062] In some embodiments, the user input interface 280 may be configured to receive instructions from a user.

[0063] To facilitate user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface. For example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0064] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0065] The operating system can be divided into different modules or layers according to the functions implemented, e.g. Figure 3As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (referred to as "application layer"), the application framework layer (referred to as "framework layer"), the system library layer and the kernel layer.

[0066] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer can host at least one application, which can include built-in window programs, system settings programs, clock programs, and the like, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0067] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer includes predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.

[0068] like Figure 3 As shown, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to the system location service; a package manager for retrieving various information related to the application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0069] In some embodiments, the activity manager is used to manage the life cycles of various applications and the general navigation back function, such as controlling the exit, opening, and back of applications. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling the changes of the display window. For example, reducing the display window, jittering the display, distorting the display, etc.

[0070] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction libraries included in the system runtime layer, such as C / C++ instruction libraries, to implement the functions that the framework layer is supposed to achieve.

[0071] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, as Figure 3 shown, hardware drivers can be configured in the kernel layer. The drivers included in the kernel layer can be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0072] It should be noted that the above examples are only simple divisions of the functions of the operating system, and do not limit the specific form of the operating system of the display device 200 in the embodiments of the present application. According to factors such as the functions of the display device and the type of the operating system, the number of levels and the specific level types included in the operating system can be in other forms.

[0073] Embodiments of the present invention provide a display control method. Figure 4 The flowchart of the display control method is shown. This method can be applied to Figure 1 the display device 200 shown.

[0074] Among them, the display device 200 (hereinafter simply referred to as the display device) can include a display 260 and a controller 250 coupled to the display 260. The display 260 can be used to display a user interface.

[0075] According to the display control method provided in an embodiment of the present application, the display device can obtain historical usage data of historical applications, and in response to a display operation of displaying a historical application page input by a user, control the display to display the historical application page according to the historical usage data, wherein the historical application page includes an application position of at least one application, and then in response to a first selection operation of the user on a first application position in the application position of at least one application, control the display to display the historical content of the first application in the historical application page according to the historical usage data, wherein the first application is the application corresponding to the first application position.

[0076] By applying this solution, users can be provided with selectable application locations by displaying a historical application page, making it easier for users to view the historical content of the application in the historical application page. This allows users to understand the content information of the application within the historical time period without opening the application. This can provide convenience for users to view the historical content of the application, and can improve the interactivity of the historical application page, thereby enhancing the user experience.

[0077] like Figure 4 As shown, the controller 250 (hereinafter referred to as the controller) is configured to perform the following steps S410 to S430:

[0078] Step S410: Acquire historical application usage data.

[0079] Among them, the historical application includes at least one application running on the display device within the historical time period, and the historical usage data includes the historical content of the at least one application. In other words, the historical application is one or more applications running on the display device within the historical time period. The historical usage data includes the historical content of each application in the historical application. Historical content refers to the content of the application running within the historical time period. Exemplarily, the historical content of the application can be the content of the application running in the last 10 seconds of the historical time period. In some cases, the historical content of the application can also be the content of the application running under special circumstances. For example, for game applications, the historical content can be the content recorded when the application triggers a "highlight moment" when running within the historical time period, wherein the "highlight moment" can be set by the game operator according to the game type, etc.

[0080] In this embodiment, while an application is running, the display device can monitor the application's running process and record the application's historical usage data, storing it locally or in the cloud. Therefore, when obtaining historical application usage data, the controller can search and obtain the application's historical usage data using a corresponding query method. For example, the controller can obtain the application's historical usage data for a historical period, such as the past week, based on the application's package name.

[0081] Step S420: In response to a display operation of displaying a history application page input by the user, the display is controlled to display the history application page according to the history usage data.

[0082] The historical application page refers to a page presenting historical applications, which includes the application location of the at least one application mentioned above.

[0083] In order to facilitate users to view and quickly start historical applications, the controller can receive user input for displaying the historical application page display operation. For example, the user can input the instruction to display the historical application page through touch, voice, etc., such as selecting the option or logo of the historical application page in the page displayed on the display to trigger the display operation of the historical application page, or input the voice command of "open the historical application page", or can also input the display operation of controlling the display device to display the historical application page through an external device such as a remote control. For example, when the display displays any page, if the user long presses the home button of the remote control, it is determined that the input is for the display operation of displaying the historical application page.

[0084] Then, the controller can respond to the user input of the display operation of displaying the history application page, control the display to display the history application page according to the acquired history usage data, and display the application position of the history application program according to the usage time in the history application page, such as Figure 5 As shown, the historical application page 500 includes the application bits of historical applications, namely, the application bit of application A, the application bit of application B, and the application bit of application C, wherein application A is the most recently used application, the usage time of application B is earlier than that of application A, and the usage time of application C is earlier than that of application B.

[0085] In some embodiments, in the history application page 500 , the focus is located on the leftmost application position, ie, the application position of application program A, by default.

[0086] In some embodiments, when the historical application includes multiple applications, if the application bits of all applications are displayed in the historical application page, it may cause more display area to be occupied, or even the application bits of all applications cannot be displayed in one page. Therefore, when controlling the display to display the historical application page, the application bits of a preset number of applications can be displayed in the historical application page, where the preset number is less than the number of applications of all applications in the historical application.

[0087] Alternatively, the application slots of the undisplayed applications may be collapsed in the history application page. When the user triggers the display of the application slots of the undisplayed applications, the history application page is controlled to display the application slots of the undisplayed applications.

[0088] By displaying the application bits of each application in the historical application page, it is convenient for users to understand the historical running status of each application and facilitate the selection of corresponding applications.

[0089] In some embodiments, if the user has not run an application during a historical time period, historical usage data cannot be obtained, or the obtained historical usage data is a null value. At this time, if an operation of displaying the historical application page is received from the user, the controller can still control the display to display the historical application page. For example, Figure 6 as shown, a prompt message "There is no recently used application" is displayed in the historical application page 600. At the same time, in order to recommend applications to the user, application programs recommended to the user can be displayed in the historical application page 600, such as Figure 6 the application program D, application program E, and application program F shown in. Among them, the focus is defaulted to the first application bit in the recommended application programs, that is, the application bit of application program D. In this way, record information of historical application programs can be provided to the user, and corresponding application programs can be recommended to the user to facilitate the user's selection.

[0090] Step S430: In response to a first selection operation on a first application bit in the application bits of at least one application program, according to the historical usage data, control the display to display the historical content of the first application program in the historical application page.

[0091] Among them, the first application program is the application program corresponding to the first application bit, which can be any one of the historical application programs. The first selection operation refers to an operation that triggers the display of the historical content of the application program. Exemplarily, it can be an operation in which the user moves the focus to the application bit of the application program, or the duration of the focus on the application bit of the application program exceeds a certain duration, or it can also be an operation in which the user clicks on the program bit of the application program, etc. This embodiment does not make specific limitations on this.

[0092] In the historical application page, the user can perform operation controls on each application program. For example, the user can select the program bit of the first application program, thereby controlling the display to display the historical content of the first application program in the historical application page. In this way, the user can quickly view the content of the application programs run during the historical time period without having to open the application programs, thus improving the convenience of the user's operation of historical application programs.

[0093] In some embodiments, the historical content may include a recorded video or a content screenshot. The recorded video refers to a video content segment recorded during the running of the application program, and the content screenshot refers to a content image captured during the running of the application program.

[0094] Accordingly, with reference to Figure 7 as shown, in step S430, according to historical usage data, controlling the display to display the historical content of the first application in the historical application page can be implemented by the following method:

[0095] Step S710: According to historical usage data, obtain the first recorded video corresponding to the first application or the first content screenshot corresponding to the first application.

[0096] After obtaining the historical usage data, exemplarily, the controller can search for the first recorded video corresponding to the first application or the first content screenshot corresponding to the first application in the historical usage data by using the application name or package name of the first application as an index.

[0097] Step S720: When the first recorded video is obtained, control the display to play the first recorded video at the first application position.

[0098] Step S730: When the first content screenshot is obtained, control the display to display the first content screenshot at the first application position.

[0099] The first application position can be presented as a card-type field in the historical application page. Thus, when the first recorded video is obtained, the controller can control the display to play the first recorded video at the first application position, or when the first content screenshot is obtained, display the first content screenshot at the first application position.

[0100] By the above method, the recorded video of the application or the content screenshot of the application can be played at the application position of the application in the historical application page, which can help the user quickly understand the historical running content of the application and facilitate the user to operate the application.

[0101] In some embodiments, the controller can detect whether the first application triggers audio-video playback at preset time intervals within a historical time period. When it is detected that the first application triggers audio-video playback, control the display to record the video played in the playback window of the first application at a first time interval to obtain the first recorded video; or, when it is not detected that the first application triggers audio-video playback, control the display to capture the content interface of the first application at a second time interval to obtain the first content screenshot.

[0102] Among them, the preset time interval can be set according to the detection requirements of the application, and the first time interval and the second time interval can also be custom-set according to the recording requirements of the historical content. This embodiment does not make specific limitations on this. In some cases, the preset time interval is greater than the first time interval and the second time interval.

[0103] That is to say, within a historical time period, the controller can detect whether the first application triggers audio and video playback at a preset time interval. When it detects that the first application triggers audio and video playback, it records the video played in the playback window of the first application at the first time interval to obtain a first recorded video. At this time, the first recorded video is a series of video segments. When it does not detect that the first application triggers audio and video playback, it takes a screenshot of the content interface of the first application to obtain a first content screenshot. At this time, the first content screenshot includes multiple screenshots. Through this method, the historical content of the first application can be generated according to the running state of the first application.

[0104] To illustrate the method for generating historical content in this embodiment, Figure 8 shows a monitoring method for an application provided in this embodiment. As Figure 8 shown, it may include the following steps:

[0105] Step S810: Monitor the running state of the application.

[0106] Exemplarily, when the display device is powered on, a specific power-on broadcast signal is sent. When the running program of the display device captures the power-on broadcast signal, the foreground system service is started. Among them, the foreground system service is a service that continuously runs in the system of the display device and is visible to the user. It can monitor the running state of all running applications through the Accessibility Service, such as whether the application starts, pauses, closes, etc.

[0107] In some embodiments, in step 810, the controller needs to detect whether an instruction to exit the monitoring is received. For example, during the process where the foreground system service continuously monitors the running state of the application, if an instruction to stop monitoring is received, it will terminate the monitoring of the running state of the application and release resources.

[0108] Step S820: Determine whether the application has audio output or establishes a media session. If yes, execute step S830. If not, execute step S870.

[0109] Whether the application has audio output means whether the application is currently playing sound through the audio output channels of the display device, such as speakers, headphones, etc. A media session is a connection or interaction mechanism established between the application and the system for managing media-related operations. When the application needs to play media content such as audio and video, the application will establish a media session with the system. Through this session, it can control operations such as playing, pausing, and switching of the media, and interact with the media management function of the system.

[0110] Therefore, when there is audio output in the application or a media session is established, it means that there is video playback behavior in the application. Conversely, if there is no audio output in the application or a media session is not established, it means that there is no video playback behavior in the application currently.

[0111] Step S830: Determine that there is video playback behavior in the application, and then create a screen recording session for video recording.

[0112] Step S840: Record the video played in the playback window of the application at a first time interval to obtain the recorded video corresponding to the application.

[0113] Exemplarily, when recording the video played in the playback window of the application at a first time interval, each time a new recorded video is generated, only the latest generated recorded video can be retained, and the previously generated recorded videos can be cleared. Or a certain number of recorded videos can also be retained, such as retaining the recorded videos generated continuously 10 times, to obtain the recorded video corresponding to the application.

[0114] Step S850: Establish an association relationship between the application package name and the recorded video corresponding to the application.

[0115] To facilitate obtaining the recorded video corresponding to the application, an association relationship between the application package name and the recorded video corresponding to the application can be established.

[0116] Step S860: Re-detect whether the application triggers audio playback at a preset time interval.

[0117] Exemplarily, after reaching the preset time interval, such as an interval of 30s, continue to re-detect whether the application triggers audio and video playback.

[0118] Step S870: Determine that there is no video playback behavior in the application, and then take a screenshot of the content interface of the application to obtain the content screenshot corresponding to the application.

[0119] Step S880: Save the content screenshot to the local display device.

[0120] Through the above method, it is possible to detect whether the application triggers audio and video playback. When it is determined that audio and video playback is triggered, the video played in the playback window of the application is recorded to obtain the recorded video. When it is determined that audio and video playback is not triggered, a screenshot of the content interface of the application is taken to obtain the content screenshot.

[0121] Figure 9 Illustrates a method for playing a recorded video provided in this embodiment. As Figure 9 shown, it may include the following steps:

[0122] Step S910: After displaying the historical application page, obtain the package name of each application in the historical application.

[0123] Step S920: Determine whether a recorded video corresponding to the application is found based on the application package name. If so, proceed to step S930; if not, proceed to step S990.

[0124] Step S930: Create a media player in the card view, initialize the media player, and load the recorded video corresponding to the application.

[0125] Step S940: Determine whether the application bit of the application is selected by the focus. If yes, go to step S950; if not, go to step S960.

[0126] Step S950: Play the recorded video of the application in the application location of the application.

[0127] Step S960: Pause the playback of the recorded video.

[0128] Step S970: Determine whether the user input to exit the history application page is received. If so, execute step S980; if not, return to step S940 to determine whether the focus continues to select the application location of the application.

[0129] Step S980: Exit the playback and release the video resources, and exit the history application page.

[0130] Step S990: Create an image view in a card view and display a content screenshot of the application.

[0131] Through the above method, after opening the historical application page, it is possible to determine whether the recorded video of the application is obtained. When the recorded video of the application is obtained, the recorded video of the application can be selected to play or pause according to the focus position. When the recorded video of the application is not obtained, a screenshot of the content of the application is displayed, which can provide users with effective content information of historical applications and facilitate users to view and operate historical applications.

[0132] In some embodiments, the controller may further perform the following method:

[0133] When controlling the display to record the video played in the playback window of the first application at a first time interval, if a new recorded video is generated, the first recorded video is updated to the new recorded video; or, when controlling the display to take a screenshot of the content interface of the first application at a second time interval, if a new content screenshot is generated, the first content screenshot is updated to the new content screenshot.

[0134] For example, when the controller controls the display to record the video played in the playback window of the first application at a first time interval, in order to reduce the storage pressure caused by continuously storing the recorded video, the recorded video can be replaced, that is, the first recorded video is updated to a new recorded video. In this way, the display device only needs to store the first recorded video.

[0135] Accordingly, when the controller controls the display to take screenshots of the content interface of the first application at the second time interval, the content screenshots can be replaced, that is, the first content screenshots are updated with new content screenshots, so that the display device only stores the first content screenshots. Therefore, through this updating method, the recorded video or content screenshots can be continuously updated while the application is running, which can reduce the storage pressure of the display device.

[0136] In some embodiments, the controller may further perform the following method:

[0137] When the historical content of the first application is displayed in the historical application page, if a second selection operation for the first application is detected, the first application is started and the display is controlled to display the application interface of the first application.

[0138] Among them, the second selection operation refers to the operation of triggering the launch of the application. According to the control method of the display device, it can be an operation of the user double-clicking the first application position, or long pressing the first application position, or it can be an operation of the user pressing the "Confirm" button on the remote control when the focus is on the first application position. This embodiment does not make specific limitations on this.

[0139] When the historical content of the first application is displayed in the historical application page, if a second selection operation for the first application position is detected, the controller can control the start of the first application and at the same time control the display to switch the historical application page to the application interface of the first application. In this way, the startup speed of the application can be improved, so that the user does not need to start the application from the navigation interface of the display device.

[0140] In some cases, after the display shows the historical application page, the application that was running during the historical time period may still be running. For example, when the historical application page is displayed, the application page is displayed at the bottom of the view layer of the historical application page. Based on this, after controlling the display to display the historical application page, the controller may also execute the following method:

[0141] When the playback window of the first application is located at the bottom of the view layer of the historical application page, control the display to continue recording the video played in the playback window of the first application at a first time interval to obtain a second recorded video corresponding to the first application; or, when the content interface of the first application is located at the bottom of the view layer of the historical application page, control the display to continue taking screenshots of the content interface of the first application at a second time interval to obtain a second content screenshot corresponding to the first application.

[0142] That is to say, when the historical application page is displayed and the playback window of the first application is located at the bottom of the view layer of the historical application page, in order to continuously generate a recorded video, the controller can control the display to continue recording the video played in the playback window of the first application on the historical application page at a first time interval to obtain a second recorded video.

[0143] Correspondingly, when the historical application page is displayed and the content interface of the first application is located at the bottom of the view layer of the historical application page, in order to continuously generate content screenshots, the controller can control the display to continue taking screenshots of the content interface of the first application at a second time interval to obtain a second content screenshot. That is, as time goes by, the controller can continue to generate new historical content according to the running situation of the first application.

[0144] Further, in some embodiments, when the controller controls the display to play the first recorded video in the first application position, if a second recorded video is obtained according to historical usage data, the controller can control the display to stop playing the first recorded video and play the second recorded video in the first application position, or loop-play the first recorded video and the second recorded video in the first application position.

[0145] That is, the controller can continuously obtain the recorded video of the first application. While playing the first recorded video, if a new recorded video, that is, the second recorded video, is obtained, the controller can control the display to stop playing the first recorded video and play the second recorded video, or can also loop-play the first recorded video and the second recorded video in the first application position.

[0146] In some embodiments, while playing the second recorded video, the controller can also control the display to display, at a preset position in the first application position, such as the upper left corner of the first application position, a prompt message indicating that the first application is playing a video and that the second recorded video is the most recently generated video, so as to prompt the user of the running state of the first application and the playback progress of the video corresponding to the first application.

[0147] Correspondingly, when controlling the display to display the first content screenshot in the first application position, if the second content screenshot is obtained according to the historical usage data, the controller controls the display to stop displaying the first content screenshot and display the second content screenshot in the first application position, or cyclically display the first content screenshot and the second content screenshot in the first application position.

[0148] In some embodiments, while displaying the second content screenshot, the controller can also control the display to display, at a preset position in the first application position, a prompt message indicating that the first application is in a running state and that the second content screenshot is the latest generated screenshot, so as to prompt the user of the running state of the first application and the content displayed by the first application.

[0149] Through the above method, new historical content can be generated according to the running state of the application program, and the new historical content can be displayed in the historical application page.

[0150] To facilitate the user to select the application programs of interest, in some embodiments, the historical application page may further include at least one recommended application position for recommending application programs, where the recommended application programs can be application programs determined according to the user's preferences for application programs. For example, according to the frequency of the user using the application programs, the application programs similar to the highest frequency can be used as the recommended application programs.

[0151] Based on this, the controller can also execute the following method:

[0152] In response to the user's third selection operation on the second application position in the historical application page, start the second application program corresponding to the second application position, and control the display to display the application interface of the second application program.

[0153] Wherein, the second application position is any one of the application positions of at least one application program and the recommended application positions of at least one recommended application program. The third selection operation refers to the operation of starting the application program. Exemplarily, it can be the operation of the user clicking on the application position of the application program, or the operation of the user sliding the application position of the application program in a certain direction, etc. This embodiment does not make specific limitations on this.

[0154] When receiving the user's third selection operation on the application position of any one application program in the historical application page, the controller can control the application program to start and control the display to jump to the application interface of the application program. In this way, the user can quickly start the application program without opening the navigation interface of the application program, so the convenience of the user using the application program can be improved.

[0155] In some embodiments, the recommended application can be an application already installed on the display device or an application not installed on the display device. When the recommended application is not installed, if the controller receives a third selection operation on the application bit of the recommended application by the user, the controller can start installing the recommended application. After completing the installation of the recommended application, it jumps to the application interface of the recommended application.

[0156] In some embodiments, referring to Figure 10 as shown, the controller can also perform the following method:

[0157] Step S1010: In response to a first editing operation by the user on the historical application page, control the historical application page to enter the editing state.

[0158] Wherein, the first editing operation refers to an operation in which the user triggers the editing of the application bit of the application program in the historical application page. Exemplarily, it can be an operation in which the user long presses on the blank space of the historical application page, or it can also be an operation in which the user selects the "Edit" control in the historical application page.

[0159] Step S1020: After controlling the historical application page to enter the editing state, in response to a second editing operation by the user on any one or more of the application bits of at least one application program, delete any one or more application bits, or sort any one or more application bits.

[0160] To meet the personalized needs of the user, the display device provides an editing function for the application bits, that is, when receiving a first editing operation by the user on the historical application page, control the historical application page to enter the editing state. As Figure 11 shown, when in the editing state, each application bit enters the editable state. Then, the user can edit the application bits of one or more application programs. For example, when receiving a second editing operation by the user on the application bits of one or more application programs, delete these application bits, or sort these application bits according to the second editing operation.

[0161] Figure 12 The flowchart of another display control method provided in this embodiment is provided. As Figure 12 shown, it can include the following steps:

[0162] Step S1210: Receive a display operation by the user to display the historical application page.

[0163] Exemplarily, in the case where the display device displays any page, if it receives that the user long presses the "Home" key of the remote control, it is determined that a display operation by the user to display the historical application page is received.

[0164] In some embodiments, the user can also input a display operation for the historical application page in other ways. For example, the user can input a voice command "Open the historical application page" in a voice manner to trigger the display operation.

[0165] Step S1220: Determine whether historical usage data is obtained. If so, execute step S1230; if not, execute step S1240.

[0166] When obtaining the historical usage data, the controller can search for the historical usage data of each application program at the corresponding storage address using the package name of each application program as an index.

[0167] Step S1230: Control the display to display the historical application page according to the historical usage data.

[0168] When the historical usage data is found, the historical application page can be displayed according to the historical usage data, and the application positions of the application programs in the historical usage data can be displayed on the historical application page.

[0169] Step S1240: Control the display to display the historical application page and prompt the user that there are no recently used application programs.

[0170] When the historical usage data is not found, it indicates that the user has not used the application programs during the historical time period. Then the controller can control the display to display the historical application page and display a prompt message to prompt the user that there are no recently used application programs.

[0171] In some embodiments, in step S1230 and step S1240, in order to facilitate the user to select the application programs of interest, recommended application programs can also be displayed.

[0172] Step S1250: When receiving an operation for starting the target application program input by the user, start the target application program.

[0173] Wherein, the target application program refers to any one of the historical application programs.

[0174] Exemplarily, when the focus is on the target application program, if the user presses the "Confirm" key on the remote control, or the duration of the focus on the application position of the target application program exceeds a certain duration, it is determined that an operation for starting the target application program input by the user is received, thereby starting the target application program and jumping to the application interface of the target application program.

[0175] Step S1260: When receiving an editing operation input by the user, control the historical application page to enter the editing state.

[0176] Exemplarily, when receiving that the user presses the "Menu" key on the remote control, it is determined that an editing operation input by the user is received. At this time, the controller can control the historical application page to enter the editing state. In the editing state, each application position in the historical application is presented as an editable state.

[0177] Step S1270: When receiving an operation of deleting the application position of a single application in the historical application, delete the application.

[0178] Step S1280: When receiving an operation of deleting the application positions of all applications in the historical application, delete all applications.

[0179] For example, in Figure 11 the historical application page 1100 as described above, the user can select a single application and delete it, or the user can also select the option of "Clear All" in the upper right corner to delete all applications in the historical application.

[0180] In some embodiments, the user can also sort the application positions of the historical applications in the historical application page.

[0181] In summary, according to the display control method provided in this embodiment, the historical application page can be displayed when receiving a display operation of the historical application page input by the user according to the historical usage data of the historical application, and the user can select the application positions of the historical applications in the historical application page, so that the historical content of the application can be displayed at the application position, enabling the user to view the historical content of the application without opening the application. At the same time, the user can edit the application positions of the historical applications in the historical application page, which can meet the personalized needs of the user.

[0182] An embodiment of the present invention provides a computer-readable storage medium, and the storage medium stores at least one executable instruction. When the executable instruction runs on a display device, the display device is enabled to execute the display control method in any of the above method embodiments.

[0183] The executable instruction can specifically be used to enable the display device to execute the above display control method.

[0184] In this embodiment, the computer-readable storage medium can be any tangible medium that contains or stores a program, and the program can be used by or in combination with an instruction execution system, apparatus, or device.

[0185] More specific examples (a non-exhaustive list) of computer-readable storage media may include: an electrical connection having one or more conductors, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), optical fibers, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0186] The algorithms or displays provided herein are not inherently related to any particular computer, virtual system or other device. In addition, the embodiments of the present invention are not directed to any particular programming language.

[0187] In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the present invention may be practiced without these specific details. Similarly, in order to streamline the present invention and aid in understanding one or more of the various inventive aspects, in the above description of exemplary embodiments of the present invention, various features of embodiments of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. The claims that follow the detailed description are hereby expressly incorporated into that detailed description, with each claim itself serving as a separate embodiment of the present invention.

[0188] Those skilled in the art will appreciate that the modules in the devices of the embodiments can be adaptively changed and installed in one or more devices different from the embodiments. The modules, units, or components in the embodiments can be combined into one module, unit, or component, and furthermore, they can be divided into multiple submodules, subunits, or subcomponents. Except that at least some of such features and / or processes or units are mutually exclusive.

Claims

1. A display device, characterized in that, Comprising: A display configured to display a user interface; A controller coupled to the display and configured to: Obtain historical usage data of historical applications, where the historical applications include at least one application that the display device has run during a historical time period, and the historical usage data includes historical content of the at least one application; In response to a display operation for displaying a historical application page input by a user, control the display to display the historical application page according to the historical usage data, where the historical application page includes application bits of the at least one application; In response to a first selection operation on a first application bit among the application bits of the at least one application by the user, control the display to display historical content of a first application in the historical application page, where the first application is the application corresponding to the first application bit.

2. The display device according to claim 1, wherein The historical content includes a recorded video or a content screenshot, and when the controller executes to control the display to display historical content of the first application in the historical application page according to the historical usage data, it is specifically configured to: Obtain a first recorded video corresponding to the first application or a first content screenshot corresponding to the first application according to the historical usage data; When the first recorded video is obtained, control the display to play the first recorded video at the first application bit; When the first content screenshot is obtained, control the display to display the first content screenshot at the first application bit.

3. The display device according to claim 1, wherein The controller is further configured to: When displaying historical content of the first application in the historical application page, if a second selection operation on the first application bit is detected, start the first application and control the display to display the application interface of the first application.

4. The display device according to claim 2, characterized in that, The controller is further configured to: During the historical time period, detect at preset time intervals whether the first application triggers audio - video playback; When it is detected that the first application triggers audio - video playback, control the display to record the video played in the playback window of the first application at a first time interval to obtain the first recorded video; Or, When it is not detected that the first application triggers audio - video playback, control the display to take a screenshot of the content interface of the first application at a second time interval to obtain the first content screenshot.

5. The display device according to claim 4, wherein After controlling the display to display the historical application page, the controller is further configured to: When the playback window of the first application is at the bottom of the view layer of the historical application page, control the display to continue recording the video played in the playback window of the first application at the first time interval to obtain a second recorded video corresponding to the first application; Or, When the content interface of the first application is located at the bottom of the view layer of the historical application page, control the display to continue taking screenshots of the content interface of the first application at the second time interval to obtain a second content screenshot corresponding to the first application.

6. The display device according to claim 5, wherein The controller is further configured to: When controlling the display to play the first recorded video at the first application position, if the second recorded video is obtained according to the historical usage data, control the display to stop playing the first recorded video and play the second recorded video at the first application position, or loop-play the first recorded video and the second recorded video at the first application position; Or, When controlling the display to display the first content screenshot at the first application position, if the second content screenshot is obtained according to the historical usage data, control the display to stop displaying the first content screenshot and display the second content screenshot at the first application position, or loop-display the first content screenshot and the second content screenshot at the first application position.

7. The display device according to claim 4, characterized in that, The controller is further configured to: When controlling the display to record the video played in the playback window of the first application at the first time interval, if a new recorded video is generated, update the first recorded video to the new recorded video; Or, When controlling the display to take screenshots of the content interface of the first application at the second time interval, if a new content screenshot is generated, update the first content screenshot to the new content screenshot.

8. The display device according to any one of claims 1-7, characterized in that The historical application page further includes at least one recommended application position for recommended application programs, and the controller is further configured to: In response to a third selection operation by the user on a second application position in the historical application page, start the second application program corresponding to the second application position and control the display to display the application interface of the second application program; Wherein, the second application position is any one of the application positions of the at least one application program and the recommended application positions of the at least one recommended application program.

9. The display device according to any one of claims 1-7, characterized in that, The controller is further configured to: In response to a first editing operation by the user on the historical application page, control the historical application page to enter an editing state; and, After controlling the historical application page to enter the editing state, in response to a second editing operation by the user on any one or more of the application positions of the at least one application program, delete the any one or more application positions, or sort the any one or more application positions.

10. A display control method, characterized in that, The method includes: Obtain historical usage data of historical application programs, where the historical application programs include at least one application program that the display device has run during a historical time period, and the historical usage data includes historical content of the at least one application program; In response to a display operation by the user to display the historical application page, control the display to display the historical application page according to the historical usage data, where the historical application page includes application positions of the at least one application program. In response to a user's first selection operation on a first application bit among the application bits of the at least one application, according to the historical usage data, control the display to display historical content of a first application in the historical application page, where the first application is the application corresponding to the first application bit.

Images