Display device and playback record display method for display device

Abstract

Provided in the present application are a display device and a playback record display method for the display device. In the method, a video playback record may be acquired in response to a display instruction configured to display a playback record interface, wherein a historical playback record may comprise historical videos that have been played by a player application within a preset time period; a cache directory of the player application is called, and the cache directory may be searched for dynamic images associated with the historical videos, wherein the dynamic images may be generated on the basis of image frames extracted from the historical videos; and finally, thumbnails of the historical videos are generated on the basis of the dynamic images, and a display unit may be controlled to display the thumbnails of the historical videos. In this way, a preset number of image frames can be captured from a video file and stored in advance, and the pre-stored image frames are dynamically presented when the video playback record is displayed, such that the video playback record supports synchronous dynamic presentation of multiple videos.

Description

Display device and playback record display method for display device

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to Chinese patent application No. 202311387759.5, filed on October 24, 2023, the entire contents of which are incorporated by reference into this application. Technical Field

[0003] The present application relates to the technical field of display devices, and in particular to a display device and a playback record display method for the display device. Background Art

[0004] Display devices refer to terminal devices capable of outputting specific display images. These devices can include smart TVs, communication terminals, smart advertising screens, projectors, and other terminal devices. Taking smart TVs as an example, they are based on Internet application technologies, feature open operating systems and chips, and possess an open application platform. They enable two-way human-computer interaction and integrate multiple functions, including audio, video, entertainment, and data, to meet the diverse and personalized needs of users.

[0005] The display device can play the corresponding video file based on the player application. To improve the user experience, the player application supports a historical playback function, which records the user's recently watched video content, playback time, playback progress and other information, so that users can quickly find previously watched content or continue watching the previous content.

[0006] To display historical playback history, the display device can capture the first frame or a keyframe in the video file and generate a thumbnail for display. To enhance the user experience, the display device can also implement dynamic display based on focus control. When a video file has focus, the player application loops and plays a fixed-length segment of the video file. However, due to the long initialization time of the player application, playback may be delayed. Multi-channel playback is not supported, and only the currently selected item is dynamically displayed.

[0007] Summary of the Invention

[0008] According to a display device in some embodiments of the present application, it may include a display, a memory and at least one processor, wherein the display may be configured to display an application interface of a player application; the memory may be configured to store computer instructions and / or data associated with the display device; the at least one processor may be configured to execute the computer instructions to enable the display device to perform the following program steps: in response to a display instruction for displaying a playback record interface, obtain a video playback record, and the historical playback record may include historical videos played by the player application within a preset time period; call a cache directory of the player application; query a dynamic image associated with the historical video in the cache directory, the dynamic image is generated based on image frames captured from the historical video; generate a thumbnail of the historical video based on the dynamic image, and control the display to display the thumbnail of the historical video.

[0009] According to some embodiments of the present application, a playback record display method for a display device may include: obtaining a video playback record in response to a display instruction for displaying a playback record interface, wherein the historical playback record may include historical videos played by a player application within a preset time period; calling a cache directory of the player application; querying the cache directory for a dynamic image associated with the historical video, wherein the dynamic image is generated based on image frames captured from the historical video; generating a thumbnail of the historical video based on the dynamic image, and controlling the display to display the thumbnail of the historical video. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] FIG1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to some embodiments of the present application;

[0011] FIG2 is a schematic diagram of a hardware configuration of a control device according to some embodiments of the present application;

[0012] FIG3 is a schematic diagram of a hardware configuration of a display device according to some embodiments of the present application;

[0013] FIG4 is a schematic diagram of software configuration of a display device according to some embodiments of the present application;

[0014] FIG5 is a structural diagram of a display system according to some embodiments of the present application;

[0015] FIG6 is a schematic diagram of a playback record interface according to some embodiments of the present application;

[0016] FIG7 is a flow chart of a method for displaying playback records on a display device according to some embodiments of the present application;

[0017] FIG8 is a schematic diagram of a process of capturing image frames during video playback according to some embodiments of the present application;

[0018] FIG9 is a schematic diagram of a process of capturing an image frame when a video exits playback according to some embodiments of the present application;

[0019] FIG10 is a schematic diagram of a process for generating thumbnails according to some embodiments of the present application;

[0020] FIG11 is a schematic diagram of an interface for generating thumbnails based on image frames captured during video playback according to some embodiments of the present application;

[0021] FIG12 is a schematic diagram of an interface for generating thumbnails based on image frames captured when a video exits playback according to some embodiments of the present application;

[0022] FIG13 is a schematic diagram of a process for deleting a target playback record according to some embodiments of the present application;

[0023] FIG14 is a schematic diagram of a process of deleting a target video according to some embodiments of the present application. DETAILED DESCRIPTION

[0024] In order to make the purpose, scheme and advantages of the example embodiments of the present application clearer, the scheme in the example embodiments of the present application will be clearly and completely described below in combination with the drawings in the example embodiments of the present application. Obviously, the described example embodiments are only part of the embodiments of the present application, not all of the embodiments.

[0025] Based on the embodiments shown in this application, all other embodiments obtained by persons of ordinary skill in the art without inventive effort are within the scope of protection of this application. In addition, although the disclosure in this application is presented based on one or more exemplary examples, it should be understood that each aspect of the disclosure can also constitute a complete solution on its own.

[0026] It should be understood that the terms "first," "second," "third," etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, for example, they can be implemented in an order other than those given in the diagrams or descriptions of the embodiments of this application. In addition, the terms "including" and "having" and any variations thereof are intended to cover, but not exclude, inclusion. For example, a product or device comprising a series of components is not necessarily limited to those components explicitly listed, but may include other components that are not explicitly listed or are inherent to these products or devices.

[0027] The display device of the embodiment of the present application can have various implementation forms, for example, it can be a television, a smart TV, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc. Figures 1 and 3 show a specific embodiment of the display device of the present application.

[0028] FIG1 is a schematic diagram of an operation scenario between a display device and a control device according to some embodiments of the present application. As shown in FIG1 , a user can operate a display device 200 through a smart device 300 or a control device 100 .

[0029] In some embodiments, the control device 100 may be a remote controller, and communication between the remote controller and the display device may include infrared protocol communication, Bluetooth protocol communication, or other short-range communication methods, to control the display device 200 wirelessly or wiredly. The user may control the display device 200 by inputting user commands through buttons on the remote controller, voice input, control panel input, etc.

[0030] In some embodiments, a smart device 300 (such as a mobile terminal, tablet computer, computer, laptop computer, etc.) can also be used to control the display device 200. For example, the display device 200 can be controlled using an application running on the smart device.

[0031] In some embodiments, the display device 200 may not use the aforementioned smart device or control device to receive instructions, but may receive user control through touch or gestures.

[0032] In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300. For example, the display device 200 can directly receive the user's voice command control through a module for obtaining voice commands configured inside the display device 200, or it can receive the user's voice command control through a voice control device set outside the display device 200.

[0033] In some embodiments, the display device 200 also communicates data with the server 400. The display device 200 can be connected to a local area network (LAN), a wireless local area network (WLAN), or other networks. The server 400 can provide various content and interactions to the display device 200. The server 400 can be a single cluster or multiple clusters, and can include one or more types of servers.

[0034] Figure 2 is a schematic diagram of the hardware configuration of a control device according to some embodiments of the present application. As shown in Figure 2, the control device 100 may include at least one processor 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input commands and convert them into commands that the display device 200 can recognize and respond to, acting as an intermediary for interaction between the user and the display device 200.

[0035] As shown in FIG3 , the display device 200 may include at least one of a tuner and demodulator 210 , a communication device 220 , a detector 230 , a device interface 240 , at least one processor 250 , a display 260 , an audio output interface 270 , a memory, a power supply, and a communication device interface 280 .

[0036] In some embodiments, the processor may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a random access memory (RAM), a read-only memory (ROM), a first interface to an nth interface for input / output, a communication bus (Bus), etc.

[0037] The display 260 may include a display screen component for presenting images and a driving component for driving image display. It can be used to receive image signals output from at least one processor, display video content, image content, and menu control interface components, as well as a user control user interface (UI) interface.

[0038] The display 260 may be a liquid crystal display, an organic light-emitting diode (OLED) display, a projection display, or a projection device and a projection screen.

[0039] The communication device 220 is a component used to communicate with external devices or servers using various communication protocols. For example, the communication device may include at least one of a wireless fidelity (Wi-Fi) module, a Bluetooth module, a wired Ethernet module, or other network communication protocol chip or a near-field communication protocol chip, as well as an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communication device 220.

[0040] The communication device interface 280 can be used to receive control signals from the control device 100 (eg, an infrared remote controller, etc.).

[0041] Detector 230 is used to collect signals from the external environment or external interactions. For example, detector 230 may include a light receiver, a sensor that can be used to collect information about ambient light intensity; or, detector 230 may include an image collector, such as a camera, that can be used to collect information about the external environment, user attributes, or user interaction gestures; or, detector 230 may include a sound collector, such as a microphone, that can be used to receive external sounds.

[0042] Device interface 240 may include, but is not limited to, any one or more of the following: a High Definition Multimedia Interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (Composite Video Broadcast Signal or Composite Video Blanking and Sync (CVBS)), a USB input interface (USB), an RGB port, or the like. Alternatively, a composite input / output interface may be formed by multiple of the aforementioned interfaces.

[0043] The tuner-demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio and video signals, such as an Electronic Program Guide (EPG) data signal, from a plurality of wireless or wired broadcast television signals.

[0044] In some embodiments, at least one processor 250 and the tuner / demodulator 210 may be located in different separate devices, that is, the tuner / demodulator 210 may also be located in an external device of the main device where the at least one processor 250 is located, such as an external set-top box.

[0045] At least one processor 250 controls the operation of the display device and responds to user operations through various software control programs / computer instructions stored in the memory. At least one processor 250 controls the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to be displayed on the display 260, the at least one processor 250 may perform operations related to the object selected by the user command.

[0046] A user may input a user command through a graphical user interface (GUI) displayed on display 260, and the user input interface receives the user input command through the GUI. Alternatively, a user may input a user command through a specific voice or gesture, and the user input interface receives the user input command by recognizing the voice or gesture through a sensor.

[0047] A "user interface" is the medium interface for interaction and information exchange between an application or operating system and a user. It enables the conversion between the internal form of information and a form acceptable to the user. A common form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operations that uses a graphical display. It can be an icon, window, control, or other interface element displayed on the display of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0048] As shown in Figure 4, in some embodiments, the system can be divided into four layers, from top to bottom, namely, the application layer (referred to as the "application layer"), the application framework layer (referred to as the "framework layer"), the Android runtime (Android runtime) and system library layer (referred to as the "system runtime library layer"), and the kernel layer.

[0049] In some embodiments, at least one application runs in the application layer. These applications can be window programs, system settings programs, clock programs, etc. that come with the operating system, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0050] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer may include predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.

[0051] As shown in Figure 4, in some embodiments of the present application, the application framework layer may include managers, content providers, etc., where the manager may include at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to the application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0052] In some embodiments, the activity manager can be used to manage the lifecycle of each application and common navigation back functions, such as controlling the exit, opening, and backing of an application. The window manager can be used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling display window changes (for example, shrinking the display window, shaking the display, distorting the display, etc.).

[0053] In some embodiments, the system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C / C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.

[0054] In some embodiments, the kernel layer can be a layer between hardware and software. As shown in FIG4 , the kernel layer includes at least one of the following drivers: an audio driver, a display driver, a Bluetooth driver, a camera driver, a Wi-Fi driver, a USB driver, an HDMI driver, a sensor driver (such as a fingerprint sensor, a temperature sensor, a pressure sensor, etc.), and a power driver.

[0055] Based on the above, the display device 200 can present specific screens. For example, a playback screen, a control interface, and other application interfaces. Depending on the developer or operator of the application, the applications installed on the display device 200 can include various forms, such as system applications and third-party applications. When the application list is displayed on the display 260, the user can select an application and control the display device 200 to run the application to implement the application's functions.

[0056] As shown in FIG5 , the display device 200 can render and display images in real time through an image generation (Image Producer) module, an image rendering (Surface Flinger) module, a synthesis (Composer) module, a video processing unit hardware (VPU hardware) module, and a display (screen).

[0057] In the process of displaying the picture, the graphics interface (openGLES) of the image generation module can be connected to the application on the display device 200 to generate image content and pass the image content to the image rendering module. The image rendering module can be used to control the display 260 display content, that is, to render the image content through the user interaction layer (UI layer) or the video layer (video layer) according to the image content. In order to obtain a better display effect, the image content of the UI layer can be rendered by the GPU component, thereby forming a picture frame for display in the synthesis module. Among them, the synthesis module can form the picture content by software or hardware. For example, the synthesis module can be a hardware synthesis (Hardware Composer, HWC) module.

[0058] The synthesis module can store image frames in both the frame buffer and the video buffer, and the video processing module can generate image content on the corresponding layers. Specifically, the image frames generated during video playback are generated on the video plane, while the image frames of other image frames (such as touch traces and graphics) are generated on the primary OSD plane. Finally, the display device 200 uses the blending unit of the video processing module to generate the final image, which is displayed on the display 260.

[0059] In some embodiments, the display device 200 may be installed with a player application that plays corresponding video files based on the player application to implement functions such as local video playback, online video on demand, and TV live broadcasts. The player application may be a system application or a third-party application developed based on a specific display device type and user needs.

[0060] To improve the user experience, the player application can support a historical playback record function. When the display device 200 runs the player application, it can record video playback record information such as the video content, playback time, and playback progress watched by the user within a preset time period. When the user wants to view the video playback history, the display device 200 can retrieve the recorded video playback history and control the display 260 to display it, so that the user can quickly find the previously watched content or continue the previous viewing progress.

[0061] In some embodiments, the video playback history may be displayed in a variety of ways. For example, the display device 200 may display information such as the video title, playback time, and playback progress of the video file in the video playback history, and sort the information by viewing date, viewing time, etc. To facilitate user browsing, the display device 200 may display the video playback history in the form of thumbnails. Thumbnails are small images generated by compressing the original image. The display device 200 may capture the first frame or a key frame in the video file, compress it into a thumbnail of a preset size, and display it on the user interface according to a preset display area.

[0062] To enhance the user experience, video playback records can also support dynamic display. The display device 200 can implement dynamic display of video playback records based on focus control. When a video file has focus, the player application loops and plays a fixed-length segment of the video file. However, due to the long initialization time of the player application, playback will be delayed. Multi-channel playback is not supported, and only the dynamic display of the currently selected item is supported.

[0063] For example, the display device 200 is equipped with a media player (MediaPlayer), which can play video files based on the media player. At the same time, the display device 200 can record information such as video files played within a preset time period by the media player, the playback time, and the playback progress, and store it in a database preset in the application layer of the display device 200. When the user inputs a display instruction for the playback record interface, the relevant information of the video playback record can be obtained from the database, and the display 260 can be controlled to display the video playback record according to the preset display method.

[0064] FIG6 is a schematic diagram of a playback record interface according to some embodiments of the present application. The interface may include video files played within a preset time period. When a user switches the focus of display device 200 to Video 1 through a specific interaction strategy, display device 200 may initialize a media player and loop fixed-length segments of Video 1 based on the media player. Because initializing the media player takes a long time, playback may be delayed, preventing immediate playback when the user switches focus to Video 1, thus reducing the user experience.

[0065] Moreover, the media player only supports single-channel playback and only dynamically displays the video file that has focus. When the user switches the focus to video 2, the display device 200 needs to exit the playback of video 1 and reinitialize the media player to loop the fixed-length segment of video 2, which takes a long time.

[0066] In order to solve the problem that video playback records do not support the synchronous dynamic display of multiple videos, a playback record display method for a display device according to some embodiments of the present application can pre-capture a preset number of image frames in a video file and save them. When displaying the video playback record, the synchronous dynamic display of multiple videos can be achieved by dynamically displaying the pre-stored image frames. The display device may include: a display, a memory, and at least one processor. The display may be configured to display an application interface of a player application; the memory may be configured to store computer instructions and / or data associated with the display device; and at least one processor may be configured to execute the above-mentioned computer instructions to enable the display device to execute the playback record display method, as shown in FIG7 . FIG7 is a flow chart of the playback record display method for a display device according to some embodiments of the present application, which may specifically include but is not limited to the following steps:

[0067] When a display device runs a player application, it can play a video file based on the player application. For the played video file, a preset number of image frames can be captured from the video file, and the preset number of image frames can be converted into a dynamic image (gif image), which is then associated with the video file and saved to the cache directory of the player application.

[0068] When a user wants to view the video playback history, a display instruction for displaying the playback history interface can be sent to the display device. In response to the display instruction, the display device can obtain the video playback history of the player application from the database of the application layer (S100), wherein the video playback history may include historical videos played by the player application within a preset time period.

[0069] After obtaining the video playback record, the display device can call the cache directory of the player application (S200), query the cache directory for the dynamic image associated with the historical video (S300), and generate a thumbnail of the historical video based on the dynamic image, and control the display 260 to display the thumbnail of the historical video (S400), thereby realizing the dynamic display of multiple videos, wherein the dynamic image can be generated based on the image frame captured from the historical video.

[0070] It is understood that for the video file being played, the display device captures a preset number of key frames from the video file and converts them into dynamic images for storage. When displaying the video playback record, the stored dynamic images are compressed into thumbnails of a preset size and displayed on the user interface according to the preset display area, thereby achieving synchronized dynamic display of multiple videos in the video playback record.

[0071] In some embodiments, the display device can capture image frames from a video file while the video file is playing. Because the display device plays video files based on the video plane, the image frames generated during video playback form the screen content through the video plane. Therefore, when the display device plays a video based on a player application, it can invoke the video plane's screenshot function and perform screenshot operations on the video plane's display screen at a preset frequency, thereby capturing image frames of the current video.

[0072] Among them, the preset frequency is the interval time for performing the screenshot operation, which can be set according to actual needs. For example, during video playback, the display device can perform a screenshot operation on the display screen of the video layer every 1ms to capture a frame of image.

[0073] Because the aspect ratio of the image frame may be inconsistent with the aspect ratio of the subsequently displayed thumbnail, after the display device acquires the image frame, it can detect the size of the image frame and compare the size of the image frame with the preset thumbnail size. If the size of the image frame is the same as the preset thumbnail size, no processing is performed. If the size of the image frame is different from the preset thumbnail size, the image frame is compressed according to the preset thumbnail size to compress the image frame size to the preset thumbnail size, so that the aspect ratio of the image frame is consistent with the aspect ratio of the subsequently displayed thumbnail.

[0074] After capturing a first threshold number of image frames in the video layer at a preset frequency, the image frames of the first threshold number can be converted into a dynamic image, and an association relationship between the dynamic image and the current video can be established, and finally the dynamic image can be stored in the cache directory of the player application.

[0075] In some embodiments, the display device may capture image frames of the current video at a preset frequency when the video starts playing, and stop the capture operation after capturing a first number of image frames.

[0076] To reduce the situation where the captured image frames are invalid frames (such as black screens or empty frames), the display device can capture image frames of the current video at a preset frequency after a preset time from the start of video playback, and stop the capture operation after capturing image frames that meet a first threshold number. For example, the display device can call the screenshot function of the video layer 3 seconds after the video starts playing, perform a screenshot operation on the display screen of the video layer at a preset frequency, and stop the screenshot operation after capturing image frames that meet the first threshold number.

[0077] In some embodiments, in order to make the displayed thumbnail close to the user's current viewing progress, the display device can capture the image frames of the first number threshold before the current video stops playing. Therefore, as shown in Figure 8, it is a flow chart of capturing image frames during video playback according to some embodiments of the present application. The display device can create an image list to store the image frames captured during video playback. When playing a video (S801), the image frames of the current video can be captured at a preset frequency (S804), and the image frames can be compressed according to a preset thumbnail size (S805), and the compressed image frames can be cached in the image list (S806). Then detect the number of images in the image list (S807), determine whether the number of images is greater than the first number threshold (S808), and when the number of images in the image list is greater than the first number threshold, delete the first or last image frame in the image list (S809) so that the image list can store the image frames of the first number threshold before the current playback time point in accordance with the video playback progress.

[0078] It is understood that deleting the first or last image frame in the image list means deleting the earliest captured image frame. Deleting the first image frame in the image list means that the first captured image frame is displayed at the top of the image list. Deleting the last image frame in the image list means that the first captured image frame is displayed at the end of the image list.

[0079] That is, the display device captures an image frame in the video layer and caches the image frame in an image list. The number of images in the image list is then checked (i.e., step S807). If the number of images is less than or equal to a first threshold, no processing is performed. If the number of images is greater than the first threshold, the oldest captured image frame is deleted from the image list (S809).

[0080] Determine whether an exit instruction for stopping playback is received (S810). When an exit instruction for stopping playback of the current video is received, the display device can respond to the exit instruction, stop the capture operation, convert the image frames in the image list into dynamic images (S813), and establish an association relationship between the dynamic image and the current video (S815), and finally store the dynamic image in the cache directory of the player application (S816).

[0081] In some embodiments, for video files with shorter video lengths, the operations of image frame capture and conversion into dynamic images may not be performed, or the video file may be directly converted into a dynamic image. Then, the display device may pre-set a length threshold and determine whether to perform the step of image frame capture based on the length threshold. As shown in Figure 8, the display device plays the video (S801) in response to the video playback instruction, and may detect the video length of the current video (S802), obtain a preset length threshold, compare the video length and the length threshold, and determine whether the video length is greater than the length threshold (S803). If the video length is greater than the length threshold, the subsequent step of intercepting the image frame of the current video is executed (the aforementioned S804). If the video length is less than or equal to the length threshold, the step of intercepting the image frame of the current video (the aforementioned S804) is not executed.

[0082] For video files whose length is less than or equal to the length threshold, the display device can directly convert the video file into a dynamic image (S814), establish an association between the dynamic image and the video file (S815), and finally store the dynamic image in the cache directory of the player application (S816). In other embodiments, the video file may not be processed. When displaying the video playback record, the first frame or a key frame in the video file may be captured and a thumbnail display may be generated.

[0083] For example, the preset length threshold is 10 seconds. In response to the video play instruction, the display device 200 detects the video length of the current video. If the video length is greater than 10 seconds, the display device 200 intercepts a first threshold number of image frames from the video layer at a preset frequency, and converts the first threshold number of image frames into a dynamic image. If the video length is less than or equal to 10 seconds, the display device 200 directly converts the current video into a dynamic image.

[0084] In some embodiments, in order to improve the quality of the converted dynamic image, a second quantity threshold can be pre-set, and the second quantity threshold can be the minimum number of images in the image list. As shown in Figure 8, upon receiving an exit instruction for stopping the playback of the current video, the display device can respond to the exit instruction by detecting the number of images in the image list (S811), obtaining a preset second quantity threshold, and determining whether the number of images is greater than the second quantity threshold (S812). If the number of images in the image list is greater than the second quantity threshold, the subsequent step of converting the image frames in the image list into dynamic images is performed (S813), and the playback of the current video is exited. If the number of images in the image list is less than or equal to the second quantity threshold, the image list is deleted (S817), the current save is canceled, and the playback of the current video is exited.

[0085] In some embodiments, an association relationship between a dynamic image and a video file can be established based on the video name of the video file. That is, after the display device converts the image frames in the image list into a dynamic image, it can read the video name of the current video, and the name of the dynamic image can be named as the video name to establish an association relationship between the dynamic image and the current video, and save it to the cache directory of the player application.

[0086] When the user inputs a display instruction for displaying the playback record interface to the display device. In response to the display instruction, the display device can obtain the video playback record of the player application from the database of the application layer and call the cache directory of the player application. For the historical videos played within a preset time period in the video playback record, the display device can read the video name of each historical video, query the cache directory for the dynamic image associated with the historical video based on the video name, generate a thumbnail of the historical video based on the dynamic image, and control the display to display the thumbnail of the historical video, thereby realizing the synchronous dynamic display of multiple videos in the video playback record.

[0087] In some embodiments, the display device can also establish an association relationship between the dynamic image and the video file based on the video path of the video file. After the display device converts the image frames in the image list into dynamic images, it can read the video path of the current video, name the dynamic image as the video path, to establish an association relationship between the dynamic image and the current video, and save it to the cache directory of the player application.

[0088] Similarly, for historical videos played within a preset time period in the video playback record, the display device can read the video path of each historical video and query the cache directory for dynamic images associated with the historical video based on the video path.

[0089] To improve data security and integrity, after reading the video file's video path, you can hash the video path and convert it into a fixed-length path value, which is used to establish an association between the dynamic image and the video file. That is, after the display device converts the image frames in the image list into a dynamic image, it can read the video path of the current video, calculate the path value of the video path, name the dynamic image based on the path value, establish an association between the dynamic image and the current video, and save it to the player application's cache directory.

[0090] The path value is a hash value obtained based on a preset hash algorithm for verifying the current video. For example, the display device 200 can obtain the video path of a video file and hash the video path based on the MD5 hash algorithm to obtain a fixed-length hash value. This hash value can be used to verify the integrity and uniqueness of the video file.

[0091] In some embodiments, for capturing image frames in a video file, the display device can capture them when the video file exits playback. As shown in Figure 9, it is a flow chart of capturing image frames when a video exits playback according to some embodiments of the present application. The display device plays the target video based on the player application, receives an exit instruction (S901) input by the user to the display device for stopping playback of the target video, and in response to the exit instruction, the display device exits playback of the target video and records the exit time point when the target video stops playing (S904). And according to the interception period, the image frame is intercepted in the target video (S905), wherein the exit time point may be the playback progress of the target video when the target video stops playing, and the interception period may be a preset time period before the exit time point or a preset time period after the exit time point.

[0092] For example, if the capture period is 10 seconds, the display device 200 responds to the exit instruction for stopping the target video and exits the target video, while recording the exit time corresponding to the target video playback progress when the target video is stopped. If the exit time is 5 seconds, the image frames between 5 seconds and 15 seconds are captured in the target video file.

[0093] After capturing an image frame according to the capture period, in order to make the aspect ratio of the captured image frame consistent with the aspect ratio of the thumbnail displayed subsequently, the display device can detect the size of the image frame and compare the size of the image frame with the preset thumbnail size. If the size of the image frame is the same as the preset thumbnail size, no processing is performed and the image frame is directly converted into a dynamic image. If the size of the image frame is different from the preset thumbnail size, the image frame is compressed according to the preset thumbnail size to compress the size of the image frame to the preset thumbnail size (S906), and the compressed image frame can be converted into a dynamic image (S907).

[0094] With reference to the above-mentioned operation of capturing image frames when playing a video file, for a video file with a shorter video length, the operation of capturing image frames and converting them into a dynamic image may not be performed, or the video file may be directly converted into a dynamic image. As shown in FIG9 , the display device responds to an exit instruction for stopping the playback of a target video, detects the video length of the target video (S902), obtains a preset length threshold, determines whether the video length is greater than the length threshold (S903), and if the video length is less than or equal to the length threshold, directly converts the video file into a dynamic image (S908) or does not process it. If the video length is greater than the length threshold, the exit time point when the target video is stopped is recorded (S904), image frames are intercepted in the target video according to the interception period (S905), and the intercepted image frames are converted into a dynamic image.

[0095] After the captured image frame is converted into a dynamic image, an association relationship between the dynamic image and the target video is established (S909), and the dynamic image is stored in the cache directory of the player application (S910). When the user inputs a display instruction for displaying the playback record interface, the display device can obtain the video playback record of the player application from the database of the application layer, and call the cache directory of the player application. For historical videos played within a preset time period in the video playback record, the dynamic image associated with the historical video can be queried in the cache directory, and a thumbnail of the historical video can be generated based on the dynamic image, and the display can be controlled to display the thumbnail of the historical video, thereby realizing the synchronous dynamic display of multiple videos in the video playback record.

[0096] When searching for dynamic images in the cache directory, it may happen that no dynamic image associated with the historical video is found in the cache directory, such as the case in the above embodiment where no dynamic image is generated for the video file. To improve the display effect, the display device can capture the first frame or a key frame from the historical video and generate a thumbnail based on the frame.

[0097] Therefore, when no dynamic image associated with the historical video is found in the cache directory, the display device can decode the image frame of the key frame from the historical video. If the image frame of the key frame is an empty frame or a black screen, the display device continues to decode the image frame of the frame after the key frame until the decoded image frame is not an empty frame or a black screen, and generates a thumbnail based on the decoded image frame.

[0098] To improve performance, the display device can set a decoding count threshold to limit the number of decodings. A time threshold can also be set to indicate the number of frames between decodings. The display device decodes the image frames of key frames from historical videos. If the image frame of the key frame is an empty frame or a black screen, and the number of decodings is less than or equal to the count threshold, the image frame with a preset time threshold after the key frame is decoded. If the image frame of the key frame is an empty frame or a black screen, and the number of decodings is greater than the count threshold, the image frame decoding operation is not performed. When displaying the video playback record, a preset placeholder image can be used for display.

[0099] As shown in Figure 10, it is a flow chart of generating thumbnails according to some embodiments of the present application. The display device receives a display instruction for displaying a playback record interface (S1001), which may be input by a user. In response to the display instruction for displaying a playback record interface input by the user, the display device obtains the video playback record of the player application from the database of the application layer (S1002), and calls the cache directory of the player application (S1003). For historical videos played within a preset time period in the video playback record, the cache directory is queried for dynamic images associated with the historical videos (S1004). It is determined whether a dynamic image is found (S1005). If a dynamic image is found, a thumbnail is generated based on the dynamic image (S1006), and the display is controlled to display the thumbnail (S1007).

[0100] If no dynamic image is found, decode the image frame of the Nth frame from the historical video (S1008), and determine whether the image frame of the Nth frame is an empty frame or a black frame (S1009). If the image frame of the Nth frame is an empty frame or a black screen, increase the value of N by 2 (N+=2) (S1010), that is, decode the image frame 2 seconds after the current frame. If the image frame 2 seconds after the current frame is an empty frame or a black screen, continue to increase the value of N by 2. Determine whether the number of decoding times is less than or equal to 3 times (N≤6) (S1011). If the decoded image frame is not an empty frame or a black screen within the number of decoding times less than or equal to 3 times (N≤6), generate a thumbnail based on the image frame (S1012). If the number of decoding times is greater than 3 times, and the corresponding decoded image frame is still an empty frame or a black screen, generate a thumbnail based on the preset placeholder image (S1013).

[0101] As shown in Figure 11, it is a schematic diagram of an interface for generating thumbnails based on image frames captured during video playback according to some embodiments of the present application. The interface may include playback records of multiple video files. For video files with dynamic images in the cache directory, their corresponding playback record items can dynamically display thumbnails, thereby realizing synchronous dynamic display of multiple videos in the video playback record. For video files without dynamic images in the cache directory, their corresponding playback record items can use placeholder images as thumbnail displays. The user can control the focus to move to a certain playback record item and enter a playback instruction. The display device can respond to the playback instruction, obtain the video file corresponding to the playback record item, and play the video file based on the player application.

[0102] Figure 12 shows a schematic diagram of an interface for generating thumbnails based on image frames captured when a video exits playback, according to some embodiments of the present application. This interface may include playback records of multiple video files, with each playback record corresponding to a dynamically displayed thumbnail, creating a synchronized, dynamic display of multiple videos. When the user controls the focus to a playback record, the display device can display the playback progress on the thumbnail. For example, "00:05 / 01:00" in Figure 12 indicates that Video 2 is 1 minute long and currently playing for 5 seconds.

[0103] For the above-mentioned playback record interface, when the user deletes a playback record in the playback record interface, the corresponding dynamic image in the cache directory can be deleted synchronously. As shown in Figure 13, it is a flow chart of deleting target playback records according to some embodiments of the present application. The user inputs a first deletion instruction for deleting the target playback record in the playback record interface, and the display device receives a first deletion instruction for deleting the target playback record (S1301). In response to the first deletion instruction, the video path of the target historical video in the target playback record is obtained (S1302), and the dynamic image associated with the target historical video is queried in the cache directory based on the video path (S1303). It is determined whether the dynamic image is found (S1304). If the dynamic image associated with the target historical video is found, the dynamic image associated with the target historical video is deleted in the cache directory (S1305), and the target playback record is deleted (S1306). If the dynamic image associated with the target historical video is not found, the target playback record is deleted (S1306).

[0104] It should be noted that the above querying dynamic graph based on video path means establishing an association relationship between dynamic graph and video file based on video path. Referring to the above method of establishing an association relationship between dynamic graph and video file, dynamic graph can also be queried based on video name and path value of video path.

[0105] For example, taking the playback record interface shown in Figure 11 as an example, if the user wants to delete the playback record corresponding to video 1, he can control the focus to move to the playback record option corresponding to video 1 and input a deletion instruction to the display device 200. In response to the deletion instruction, the display device 200 can delete the playback record and obtain the video path of video 1 at the same time. Based on the video path, the dynamic image associated with video 1 is queried in the cache directory of the player application. If the dynamic image associated with video 1 is queried, the dynamic image associated with video 1 is deleted in the cache directory.

[0106] Similarly, when the user deletes a video file, the historical record and the corresponding dynamic image in the cache directory can also be deleted synchronously. As shown in Figure 14, it is a schematic diagram of the process of deleting the target video according to some embodiments of the present application. The user inputs a second deletion instruction for deleting the target video, and the display device receives a second deletion instruction for deleting the target video (S1401). In response to the second deletion instruction, the target video is deleted (S1402). At the same time, the historical record of the target video can be queried in the database of the application layer (S1403), and it is determined whether the historical record is found (S1404). If the historical record is found, the historical record is deleted (S1405). At the same time, the video path of the target video can be read, and the dynamic image associated with the target video can be queried in the cache directory of the player application based on the video path (S1406). It is further determined whether the dynamic image is found (S1407). If the dynamic image associated with the target video is found, the dynamic image associated with the target historical video is deleted in the cache directory (S1408). If the dynamic image associated with the target video is not found, step S1406 is executed. If the dynamic image is not found, the process ends.

[0107] According to the display device and the playback record display method for the display device according to the above embodiment, a video playback record can be obtained in response to a display instruction for displaying a playback record interface, wherein the historical playback record may include historical videos played by the player application within a preset time period. The cache directory of the player application is called, and a dynamic image associated with the historical video is queried in the cache directory, wherein the dynamic image can be generated based on the image frames captured in the historical video. Finally, a thumbnail of the historical video is generated based on the dynamic image, and the display is controlled to display the thumbnail of the historical video. In this way, a preset number of image frames can be captured and saved in the video file in advance, and the pre-stored image frames can be dynamically displayed when the video playback record is displayed, so that the video playback record supports the synchronous dynamic display of multiple videos.

[0108] Finally, it should be noted that the above embodiments are only used to illustrate the solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the solutions described in the aforementioned embodiments, or make equivalent replacements for some or all of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding solutions from the scope of the embodiments of the present application.

Claims

1. A display device, comprising: A display configured to display an application interface of a player application; a memory configured to store computer instructions and / or data associated with the display device; At least one processor is configured to execute the computer instructions to cause the display device to perform: In response to a display instruction for displaying a playback record interface, obtaining a video playback record, wherein the historical playback record includes historical videos played by the player application within a preset time period; Calling the cache directory of the player application; Querying a dynamic image associated with the historical video in a cache directory, wherein the dynamic image is generated according to image frames captured from the historical video; Generate a thumbnail of the historical video based on the dynamic image, and control the display to display the thumbnail of the historical video.

2. The display device according to claim 1, wherein the display device has a video layer, and the video layer is configured to display a picture generated during a video playback process, and the at least one processor is further configured to execute the computer instructions to enable the display device to execute: When playing a video, a screenshot operation is performed on the display screen of the video layer at a preset frequency to capture an image frame of the current video; Compressing the image frame according to a preset thumbnail size, and caching the compressed image frame into an image list; When the number of images in the image list is greater than a first number threshold, deleting the first or last image frame in the image list; In response to an exit instruction for stopping playing the current video, converting the image frames in the image list into dynamic images; An association relationship between the dynamic image and the current video is established, and the dynamic image is stored in the cache directory.

3. The display device according to claim 2, wherein the at least one processor executes establishing an association relationship between the dynamic image and the current video, and is configured to execute the computer instructions to enable the display device to execute: Read the video path of the current video; Calculating a path value of the video path, where the path value is a hash value obtained based on a preset hash algorithm and used to verify the current video; Name the dynamic image as the path value to establish a relationship between the dynamic image and the current video. Related relationships; Alternatively, the video name of the current video is read, and the dynamic image is named as the video name to establish an association relationship between the dynamic image and the current video.

4. The display device of claim 2, wherein the at least one processor is further configured to execute the computer instructions to cause the display device to perform: Detecting the video length of the current video; Get the preset length threshold; If the video length is greater than the length threshold, executing the step of intercepting an image frame of the current video; If the video length is less than or equal to the length threshold, the step of capturing the image frame of the current video is not performed.

5. The display device of claim 2, wherein the at least one processor is further configured to execute the computer instructions to cause the display device to perform: In response to an exit instruction for stopping playing the current video, detecting the number of images in the image list; If the number of images in the image list is greater than a second number threshold, executing the step of converting the image frames in the image list into dynamic images; If the number of images in the image list is less than or equal to the second number threshold, the image list is deleted.

6. The display device of claim 1, wherein the at least one processor is further configured to execute the computer instructions to cause the display device to perform: In response to a first deletion instruction for deleting a target playback record in the playback record interface, obtaining a video path of a target historical video in the target playback record; Querying the dynamic graph associated with the target historical video in the cache directory based on the video path; Delete the target playback record, and delete the dynamic image associated with the target historical video in the cache directory.

7. The display device of claim 1, wherein the at least one processor is further configured to execute the computer instructions to cause the display device to perform: In response to a second deletion instruction for deleting a target video, reading a video path of the target video; Querying the dynamic graph associated with the target video in the cache directory based on the video path; Delete the target video, and delete the dynamic image associated with the target video in the cache directory.

8. The display device of claim 1, wherein the at least one processor is further configured to execute the computer instructions to cause the display device to perform: In response to an exit instruction for stopping playing the target video, recording an exit time point when the playing of the target video is stopped; Intercepting image frames in the target video according to an interception period, wherein the interception period is a preset time period before the exit time point or a preset time period after the exit time point; Compressing the image frame according to a preset thumbnail size, and converting the compressed image frame into a dynamic image; An association relationship between the dynamic image and the current video is established, and the dynamic image is stored in the cache directory.

9. The display device of claim 1, wherein the at least one processor is further configured to execute the computer instructions to cause the display device to perform: When no dynamic image associated with the historical video is found in the cache directory, decoding image frames of key frames from the historical video; If the image frame of the key frame is an empty frame or a black screen, and the number of decoding times is less than or equal to the number threshold, decode the image frame of the preset time threshold after the key frame; A thumbnail is generated based on the decoded image frame.

10. A playback record display method for a display device, comprising: In response to a display instruction for displaying a playback record interface, obtaining a video playback record, wherein the historical playback record includes historical videos played by the player application within a preset time period; Calling the cache directory of the player application; Querying a dynamic image associated with the historical video in a cache directory, wherein the dynamic image is generated according to image frames captured from the historical video; Generate a thumbnail of the historical video based on the dynamic image, and control the display to display the thumbnail of the historical video.

Images