Display device and method for realizing media resource playback progress display

Abstract

The present application discloses a display device and a method for realizing the display of media playback progress, comprising: a display and a controller connected in communication, wherein the controller is configured to: in response to an instruction for selecting a media control, request the media data to be played on the playback page of the display; send a preview image request to a server to request the acquisition of preview image data; receive an input adjustment instruction for the playback progress of the media data, obtain the index of the preview thumbnail and the download address of the preview original image according to the adjustment amount of the playback progress indicated by the adjustment instruction and the preview image data; request the acquisition of the preview original image according to the download address, and crop the preview thumbnail from the preview original image according to the index; control the display to display the preview thumbnail on the floating layer of the playback page. In the present application, the preview original image is downloaded on demand according to the adjustment instruction, and the preview thumbnail is dynamically cropped, thereby greatly reducing the loading amount of the preview thumbnail, improving the smoothness of the preview display, and enhancing the user experience.

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to a display device and a method for displaying the progress of media playback. Background Art

[0002] A smart TV is a television product that enables two-way human-computer interaction and integrates multiple functions, including audio, video, entertainment, and data. The user interface of a smart TV serves as a medium for interaction and information exchange with the user. To meet diverse user needs, it displays a variety of applications, including audio, video, and entertainment.

[0003] Currently, users can browse various media sources on smart TVs. During viewing, they can adjust the playback progress, typically by moving the media from one point in time to another using a progress bar. Each time point on the progress bar is accompanied by a small preview image, which allows users to rewind or preview the content, allowing them to precisely adjust the content to their desired position. Before displaying the playback progress of a media source, smart TVs typically cache the preview images needed to display the progress in memory.

[0004] Due to memory limitations and the Android system's automatic memory recycling mechanism on some smart TVs, when a large number of preview thumbnails are cached in memory, insufficient memory may occur, causing some cached preview thumbnails to be released. As a result, the preview thumbnails may not be displayed, reducing the user experience. Summary of the Invention

[0005] The present application provides a display device and a method for displaying the progress of media playback, so as to solve the technical problem in the prior art of poor display effect of media playback progress due to memory limitations and automatic memory recycling mechanism.

[0006] In order to solve the above technical problems, the embodiments of the present application disclose the following technical solutions:

[0007] In a first aspect, an embodiment of the present application discloses a display device, comprising:

[0008] monitor;

[0009] A controller is communicatively connected to the display, and the controller is configured to:

[0010] In response to an instruction to select a media asset control, sending a media asset request to a server, wherein the media asset control is used to display multimedia resources;

[0011] receiving media data fed back by the server according to the media request, and controlling the display to play the media data on a play page;

[0012] Sending a preview image request to the server, so that the server feeds back preview image data according to the preview image request;

[0013] Receiving an input instruction for adjusting the playback progress of the media asset data, and obtaining an index of a small preview image and a download address of the original preview image according to the adjustment amount of the playback progress indicated by the adjustment instruction and the preview image data;

[0014] Requesting the original preview image from the server according to the download address of the original preview image, and cropping the thumbnail preview image from the original preview image received from the server according to the index of the thumbnail preview image;

[0015] The display is controlled to display the cropped preview thumbnail on the floating layer of the play page.

[0016] In a second aspect, an embodiment of the present application discloses a method for displaying the progress of media playback, the method comprising:

[0017] In response to an instruction to select a media asset control, sending a media asset request to a server, wherein the media asset control is used to display multimedia resources;

[0018] receiving media data fed back by the server according to the media request, and controlling the display to play the media data on a play page;

[0019] Sending a preview image request to the server, so that the server feeds back preview image data according to the preview image request;

[0020] Receiving an input instruction for adjusting the playback progress of the media asset data, and obtaining an index of a small preview image and a download address of the original preview image according to the adjustment amount of the playback progress indicated by the adjustment instruction and the preview image data;

[0021] Requesting the original preview image from the server according to the download address of the original preview image, and cropping the thumbnail preview image from the original preview image received from the server according to the index of the thumbnail preview image;

[0022] The display is controlled to display the cropped preview thumbnail on the floating layer of the play page.

[0023] Compared with the prior art, the present invention has the following advantages:

[0024] This application provides a display device and a method for displaying media playback progress. When a user selects a media control on the display device, the display device responds to the user's operation and sends a media request to a server to obtain media data for playback. While playing the media, the display device continues to request preview image data from the server. While viewing media data on the display device, the user can adjust the playback progress of the current media by sending an adjustment command to the display device. Based on the adjustment command and the preview image data, the display device obtains the index of the preview thumbnail and the download address of the original preview image. The display device requests the original preview image from the server based on the download address and crops the preview thumbnail from the original preview image based on the index of the preview thumbnail. Finally, the display device displays the preview thumbnail in a floating layer on the playback page. In this application, based on the user's adjustment command for the media data playback progress, the corresponding original preview image is downloaded on demand, and the preview thumbnail is dynamically cropped according to the adjustment position of the playback progress indicated by the adjustment command. This significantly reduces the amount of preview thumbnails loaded, significantly reduces memory overhead, reduces the system load of the display device, improves the smoothness of the preview display, and thus enhances the user experience.

[0025] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solution of the present application, the following is a brief introduction to the drawings required for use in the embodiments. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0027] Figure 1 Schematic diagram showing an operation scenario between a display device and a control apparatus according to some embodiments;

[0028] Figure 2 exemplarily shows a hardware configuration block diagram of the control device 100 according to some embodiments;

[0029] Figure 3 exemplarily shows a hardware configuration block diagram of a display device 200 according to some embodiments;

[0030] Figure 4 exemplarily shows a schematic diagram of software configuration in the display device 200 according to some embodiments;

[0031] Figure 5 exemplarily shows a schematic diagram of the display effect of the preview original image according to some embodiments;

[0032] Figure 6hereinafter is a flowchart illustrating a method for displaying the progress of media playback according to some embodiments;

[0033] Figure 7 exemplarily shows a schematic diagram of the display effect of the main page of the display device 200 according to some embodiments;

[0034] Figure 8 exemplarily shows a schematic diagram of the display effect of the display device 200 playing a page according to some embodiments;

[0035] Figure 9 exemplarily shows an interactive flow chart of a method for displaying media asset playback progress according to some embodiments. DETAILED DESCRIPTION

[0036] In order to make the purpose and implementation of this application clearer, the exemplary implementation of this application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of this application. Obviously, the described exemplary embodiments are only part of the embodiments of this application, not all of the embodiments.

[0037] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.

[0038] In the specification and claims of this application and the accompanying drawings, the terms "first," "second," "third," etc. are used to distinguish similar or similar objects or entities, and are not necessarily intended to limit a particular order or sequence, unless otherwise noted. It should be understood that the terms used in this manner are interchangeable under appropriate circumstances.

[0039] The terms "comprise," "include," and "have," and any variations thereof, are intended to cover but not exclude inclusion; for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0040] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functionality associated with that element.

[0041] Figure 1 Schematic diagram of an operation scenario between a display device and a control device according to an embodiment. Figure 1 As shown, the user can operate the display device 200 through the smart device 300 or the control apparatus 100 .

[0042] In some embodiments, the control device 100 may be a remote controller. Communication between the remote controller and the display device may include infrared protocol communication, Bluetooth protocol communication, or other short-range communication methods, and the display device 200 may be controlled wirelessly or wired. The user may control the display device 200 by inputting user commands through buttons on the remote controller, voice input, control panel input, and the like.

[0043] In some embodiments, a smart device 300 (such as a mobile terminal, tablet computer, computer, laptop computer, etc.) can also be used to control the display device 200. For example, the display device 200 can be controlled using an application running on the smart device.

[0044] In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300. For example, the user's voice command control can be directly received through a module for obtaining voice commands configured inside the display device 200, or the user's voice command control can be received through a voice control device set outside the display device 200.

[0045] In some embodiments, the display device 200 also communicates data with the server 400. The display device 200 may be connected to a local area network (LAN), a wireless local area network (WLAN), or other networks. The server 400 may provide various content and interactions to the display device 200. The server 400 may be a single cluster or multiple clusters, and may include one or more types of servers.

[0046] Figure 2 Schematically shows a block diagram of the configuration of the control device 100 according to an exemplary embodiment. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, acting as an interaction medium between the user and the display device 200.

[0047] Figure 3 FIG. 2 is a block diagram showing a hardware configuration of the display device 200 according to an exemplary embodiment.

[0048] In some embodiments, the display apparatus 200 includes at least one of a tuner 210 , a communicator 220 , a detector 230 , an external device interface 240 , a controller 250 , a display 260 , an audio output interface 270 , a memory, a power supply, and a user interface.

[0049] In some embodiments, the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, and first to nth interfaces for input / output.

[0050] In some embodiments, the display 260 includes a display screen component for presenting images, and a driving component for driving image display, a component for receiving image signals output from a controller, and a component for displaying video content, image content, and a menu control interface and a user control UI interface.

[0051] In some embodiments, the display 260 may be a liquid crystal display, an OLED display, a projection display, or a projection device and a projection screen.

[0052] In some embodiments, the communicator 220 is a component used to communicate with external devices or servers using various communication protocols. For example, the communicator may include at least one of a Wi-Fi module, a Bluetooth module, a wired Ethernet module, or other network communication protocol chip or a near-field communication protocol chip, as well as an infrared receiver. The display device 200 can use the communicator 220 to send and receive control signals and data signals with the external control device 100 or the server 400.

[0053] In some embodiments, the user interface may be configured to receive a control signal from the control device 100 (eg, an infrared remote controller, etc.).

[0054] In some embodiments, detector 230 is used to collect signals from the external environment or external interactions. For example, detector 230 may include a light receiver, such as a sensor for collecting ambient light intensity; or an image collector, such as a camera, for collecting external environmental scenes, user attributes, or user interaction gestures; or a sound collector, such as a microphone, for receiving external sounds.

[0055] In some embodiments, the external device interface 240 may include, but is not limited to, any one or more of the following: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input / output interface formed by multiple of the above interfaces.

[0056] In some embodiments, the tuner-demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

[0057] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0058] In some embodiments, controller 250 controls the operation of the display device and responds to user operations via various software control programs stored in memory. Controller 250 controls the overall operation of display device 200. For example, in response to receiving a user command to select a UI object for display on display 260, controller 250 may perform operations related to the object selected by the user command.

[0059] In some embodiments, the object may be any selectable object, such as a hyperlink, an icon, or other operable control. Operations associated with the selected object include: displaying a page, document, or image connected to the hyperlink, or executing a program corresponding to the icon.

[0060] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM Random Access Memory (RAM), ROM (Read-Only Memory, ROM), a first interface to an nth interface for input / output, a communication bus (Bus), etc.

[0061] The CPU is used to execute operating system and application instructions stored in memory, as well as various interactive instructions received from external input, to execute various applications, data, and content, ultimately displaying and playing various audio and video content. The CPU can include multiple processors, such as a main processor and one or more sub-processors.

[0062] In some embodiments, a graphics processor is used to generate various graphical objects, such as icons, operation menus, and graphics displayed in response to user input commands. The graphics processor includes an arithmetic unit, which performs operations based on various user interaction commands and displays various objects according to display attributes; and a renderer, which renders the various objects generated by the arithmetic unit. These rendered objects are then displayed on the display.

[0063] In some embodiments, the video processor is used to receive an external video signal and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal to obtain a signal that can be directly displayed or played on the display device 200.

[0064] In some embodiments, the video processor includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used to demultiplex the input media data stream. The video decoding module is used to process the demultiplexed video signal, including decoding and scaling processing. The image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator according to user input or itself with the scaled video image to generate an image signal for display. The frame rate conversion module is used to convert the input video frame rate. The display formatting module is used to receive the frame rate converted video output signal and change the signal to conform to the display format signal, such as outputting an RGB data signal.

[0065] In some embodiments, the audio processor is used to receive an external audio signal, perform decompression and decoding according to the standard codec protocol of the input signal, as well as noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in a speaker.

[0066] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command through a specific sound or gesture, and the user input interface may recognize the sound or gesture through a sensor to receive the user input command.

[0067] In some embodiments, a "user interface" is a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. A common form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It can be an interface element such as an icon, window, or control displayed on the display screen of an electronic device, where a control can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0068] In some embodiments, the system of the display device may include a kernel, a command parser (shell), a file system, and applications. The kernel, shell, and file system together form the basic operating system structure, which allows users to manage files, run programs, and use the system. After power is turned on, the kernel starts, activates kernel space, abstracts hardware, initializes hardware parameters, runs and maintains virtual memory, schedulers, signals, and inter-process communication (IPC). After the kernel starts, the shell and user applications are loaded. After startup, the application is compiled into machine code to form a process.

[0069] See also Figure 4 In some embodiments, the system is divided into four layers, from top to bottom: the application layer (referred to as the "application layer"), the application framework layer (referred to as the "framework layer"), the Android runtime and system library layer (referred to as the "system runtime library layer"), and the kernel layer.

[0070] In some embodiments, at least one application runs in the application layer. These applications can be window programs, system settings programs, clock programs, etc. that come with the operating system, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0071] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer includes predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.

[0072] like Figure 4As shown, in the embodiment of the present application, the application framework layer includes managers, content providers, etc., wherein the manager includes at least one of the following modules: an activity manager (ActivityManager) is used to interact with all activities running in the system; a location manager (Location Manager) is used to provide system services or applications with access to system location services; a package manager (Package Manager) is used to retrieve various information related to the application packages currently installed on the device; a notification manager (NotificationManager) is used to control the display and clearing of notification messages; a window manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0073] In some embodiments, the activity manager is used to manage the lifecycle of each application and common navigation back functions, such as controlling the exit, opening, and backing of an application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling display window changes (such as shrinking the display window, shaking the display, distorting the display, etc.).

[0074] In some embodiments, the system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C / C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.

[0075] In some embodiments, the kernel layer is a layer between hardware and software. Figure 4 As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0076] The hardware or software architecture in some embodiments may be based on the introduction in the above embodiments, and in some embodiments may be based on other similar hardware or software architectures, as long as the technical solutions of the present application can be implemented.

[0077] Based on the display device 200, users can browse various media resources through the display device 200. During media viewing, users can adjust the playback progress bar to move the media from one time point to another, that is, adjust the playback progress of the media by fast forwarding and rewinding (seeking) to perform seek preview. During seek preview, the display device 200 caches a preview thumbnail for each seek time point in memory. When the playback progress bar moves, the display device 200 retrieves the corresponding preview thumbnail for loading and display.

[0078] Currently, an episode of a TV series or a movie is usually divided into 4-5 parts, each part corresponds to a preview original image, and each preview original image corresponds to a download address. Figure 5 FIG. 4 is a schematic diagram showing the display effect of previewing the original image according to some embodiments. Figure 5 As shown, the original preview image refers to the preview image corresponding to the video file, including the preview thumbnails corresponding to each seek time point, wherein each preview thumbnail can be cropped into several (100) preview small images in the original preview image.

[0079] When the user opens the movie for the first time, the display device 200 first obtains the first preview original image according to the first download address, and crops the first preview original image into multiple preview small images, summarizes them into the image list, and caches them in the memory. Figure 5 As shown, 100 preview thumbnails are cropped from the preview original image. The cropping process can be to start from the first image and crop one by one in the first row. After cropping the first row, crop the second row, and so on, until all 100 images are cropped. The display device 200 summarizes the 100 cropped preview thumbnails into a picture list. If the user quickly adjusts the playback progress and skips several preview original images in the middle, such as a 40-minute movie is divided into four parts, and the user moves the movie from the 1st minute to the 25th minute, the display device 200 needs to download 3 preview original images, crop 300 preview thumbnails, summarize them into a picture list, and cache them in the memory. When the display device 200 receives an adjustment instruction from the user to adjust the playback progress, it retrieves the corresponding preview thumbnails from the picture list for display according to the playback progress indicated by the adjustment instruction.

[0080] When the user quickly adjusts the playback progress, due to the small memory remaining in some display devices, affected by memory limitations and the Android system's automatic memory recycling mechanism, a large number of preview thumbnails will be loaded into the memory, resulting in insufficient memory, which in turn causes some cached images to be released, so that the released preview thumbnails cannot be displayed. At the same time, because the user quickly adjusts the playback progress, the display device downloads the original preview image and crops the preview thumbnails more than 200 times, resulting in an increase in CPU usage, causing the preview thumbnails to load slowly, resulting in the problem that the preview thumbnails cannot be displayed. In addition, since a large number of preview thumbnails are loaded into the memory, a large amount of system memory is occupied, affecting the smoothness of operation and the normal function of the application, and may cause problems such as application restart due to ANR (Application Not Responding) or OOM (Out Of Memory). In order to avoid the above problems, some embodiments of the present application provide a display device and a method for displaying the progress of media playback.

[0081] The following describes, with reference to the accompanying drawings, a process for displaying the progress of media playback provided in some embodiments of the present application.

[0082] Figure 6 The present application provides a display device 200 in some embodiments, which includes a display 260 and a controller 250, wherein the controller 250 is in communication with the display 260, and the controller is configured to execute Figure 6 The process of realizing the display of media playback progress in . Figure 6 The process of displaying the progress of media playback is as follows:

[0083] S601: In response to an instruction to select a media asset control, a media asset request is sent to a server, wherein the media asset control is used to display multimedia resources.

[0084] Figure 7 FIG. 1 shows an exemplary diagram of the display effect of the main page of the display device 200 according to some embodiments. Figure 7 As shown, on the main page of display device 200, media resource controls are provided in different recommendation slots under different channels to display corresponding multimedia resources. For example, within the movie channel, display device 200 displays various films in the media resource controls. Users can browse the films displayed by each media resource control and then select their favorite films to watch. The user can select the media resource control in the recommendation slot through control device 100. In response to the user's selection instruction, display device 200 sends a media resource request containing a media resource identifier to server 400, so that server 400 can obtain the relevant media resource information.

[0085] In some embodiments, the user can also search for media resources for viewing through the display device 200. For example, a smart TV may be installed with various viewing apps (applications). After opening the app, the user can search for a movie of their choice. When the user selects the media resource to be played by selecting the media resource control, the display device 200 responds to the user's selection and sends a media resource request to the server 400.

[0086] S602: Receive media data fed back by the server according to the media request, and control the display to play the media data on a play page.

[0087] In some embodiments, after receiving a media resource request, server 400 checks the media resource identifier carried in the request and searches the media resource pool for the corresponding media resource data based on the media resource identifier. After finding the media resource data, server 400 sends it to display device 200. Display device 200 receives the media resource data searched by server 400 based on the media resource request and controls the display to jump from the current page to the playback page to play the media resource data.

[0088] S603: Sending a preview image request to the server, so that the server feeds back preview image data according to the preview image request.

[0089] In some embodiments, after display device 200 starts playing media asset data, it may continue to send a preview image request to the server, wherein the preview image request carries the same media asset identifier as that in the media asset request. Upon receiving the preview image request, server 400 searches for preview image data corresponding to the media asset based on the media asset identifier and feeds it back to display device 200.

[0090] In some embodiments, the preview image data includes the media asset licensee corresponding to the preview image, the address list of the preview original image, the number of preview thumbnails that can be cropped from one preview original image, the pixel width of one preview original image, the pixel height of one preview original image, the pixel width of each preview thumbnail, the pixel height of each preview thumbnail, and the duration corresponding to each preview thumbnail. Here, the address list of the preview original image lists the download addresses of all preview original images corresponding to the media asset, the number of preview thumbnails that can be cropped from one preview original image is the number of preview thumbnails contained in the preview original image, the pixel width of one preview original image and the pixel height of one preview original image are the pixel dimensions of the preview original image, and the pixel width of one preview thumbnail and the pixel height of one preview thumbnail are the pixel dimensions of the preview thumbnails.

[0091] The preview image data is exemplarily described below through Table 1.

[0092] Table 1:

[0093]

[0094] In some embodiments, when the display device 200 receives a user input selecting a media asset control, it may simultaneously send a media asset request to the server 400 and obtain the corresponding preview image data. After receiving the request from the display device 200, the server 400 obtains the media asset data and preview image data corresponding to the media asset identifier and feeds them back to the display device 200.

[0095] S604: Receive an input instruction for adjusting the playback progress of the media asset data, and obtain an index of a small preview image and a download address of the original preview image according to the adjustment amount of the playback progress indicated by the adjustment instruction and the preview image data.

[0096] Figure 8 FIG. 4 is a schematic diagram showing the display effect of a page played by the display device 200 according to some embodiments. Figure 8 As shown, when a user watches media data through the playback page, if he is not interested in the current playback content and wants to fast forward to the part he wants to watch, or wants to rewatch the played content, he can send adjustment instructions to the display device 200 through the left and right direction buttons of the remote control.

[0097] In some embodiments, after the user sends the adjustment instruction, the display device 200 controls the display to display a view list and a play progress control on the floating layer of the play page. The view list displays a preview thumbnail corresponding to the seek time point.

[0098] In some embodiments, the display device 200 obtains the index of the preview thumbnail and the download address of the preview original image based on the adjustment amount of the playback progress indicated by the received adjustment instruction and the preview image data. Here, the adjustment amount of the playback progress indicated by the adjustment instruction refers to the length of time for the user to control the playback progress to fast forward or rewind.

[0099] The following is the process of obtaining the index of the preview thumbnail.

[0100] The index of a preview thumbnail refers to the coordinate value corresponding to the preview thumbnail and / or the mark value representing the respective position. The index of the preview thumbnail in the preview original image is marked based on 0. For example, in a preview original image containing 100 preview thumbnails, the corresponding index (index) value is [0-99].

[0101] In some embodiments, when the display device 200 receives an adjustment instruction sent by the user, the display device 200 obtains the current playback progress of the media asset data and accumulates the current playback progress with the adjustment amount of the playback progress indicated by the adjustment instruction to obtain the adjusted playback progress of the media asset data. For example, if the current playback progress of the media asset data is 16 minutes and 20 seconds, and each fast forward and rewind time is 10 seconds, and the user presses the right direction button on the remote control (herein referred to as a short press), the playback progress is adjusted by 10 seconds, and the adjusted playback progress of the media asset data is 16 minutes and 30 seconds.

[0102] In some embodiments, the display device 200 can obtain the duration of each preview thumbnail based on the preview image data. For example, if the duration of the first preview thumbnail is 1-15 seconds and the duration of the second preview thumbnail is 16-30 seconds, then the duration of each preview thumbnail is 15 seconds.

[0103] In some embodiments, the display device 200 obtains the playback time represented by the adjusted playback progress, rounds up the playback time, and then obtains the ratio of the playback time to the duration occupied by each preview thumbnail to obtain the index of the preview thumbnail corresponding to the adjusted playback progress. Continuing with the above example, if the playback progress of the media asset data after adjustment is 16 minutes and 30 seconds, and the duration of each preview thumbnail is 15 seconds, then the index of the preview thumbnail corresponding to the adjusted playback progress is 67. For another example, if the playback progress of the media asset data after adjustment is 10 minutes and 25 seconds, and the duration of each preview thumbnail is 10 seconds, then the index of the preview thumbnail corresponding to the adjusted playback progress is 63.

[0104] In some embodiments, after obtaining the index of the preview thumbnail, the display device 200 can obtain the corresponding duration in the preview image data according to the index of the preview thumbnail, and obtain the timestamp corresponding to the preview thumbnail according to the duration corresponding to the preview thumbnail.

[0105] In some embodiments, the timestamp corresponding to the preview thumbnail is obtained based on the duration of the preview thumbnail in the preview image data. For example, if the duration of the preview thumbnail is 31 seconds to 40 seconds, the timestamp corresponding to the preview thumbnail is 00:00:40. For another example, if the duration of the preview thumbnail is 5 minutes 21 seconds to 5 minutes 30 seconds, the timestamp corresponding to the preview thumbnail is 00:05:30.

[0106] In some embodiments, when the display device 200 controls the display of the preview thumbnail, a timestamp corresponding to the preview thumbnail is displayed on the layer displaying the preview thumbnail.

[0107] The following is the process of obtaining the download address of the preview original image.

[0108] In some embodiments, the preview image data includes download addresses of multiple preview original images corresponding to the movie. The display device 200 needs to obtain the required download addresses and request the corresponding preview original images from the server according to the download addresses.

[0109] In some embodiments, when the value represented by the index of the preview thumbnail is less than the number of preview thumbnails included in the original preview image, the first download address in the address list is selected as the download address of the original preview image to be obtained. When the value represented by the index of the preview thumbnail is greater than or equal to the number of preview thumbnails included in the original preview image, the result is rounded up to an integer, and the download address in the address list that matches the result is selected as the download address of the original preview image to be obtained.

[0110] In some embodiments, when the value represented by the index of the preview thumbnail is greater than or equal to the number of preview thumbnails contained in the original preview image, and the value represented by the index of the preview thumbnail can be divided evenly by the number of preview thumbnails contained in the original preview image, the download address corresponding to the result of adding 1 to the quotient is the download address of the original preview image to be obtained.

[0111] For example, the index corresponding to the preview thumbnail calculated through the above preview thumbnail index acquisition process is 96. Each preview original image contains 100 preview thumbnails. 96 is less than 100, so the preview thumbnail belongs to the first preview original image. To obtain this preview thumbnail, you need to download the preview original image corresponding to the first download address in the address list. For another example, the index corresponding to the preview thumbnail calculated is 230. Each preview original image contains 100 preview thumbnails. 230 is greater than 100. 230 and 100 are rounded up to 3. Therefore, the preview thumbnail belongs to the third preview original image. To obtain this preview thumbnail, you need to download the preview original image corresponding to the third download address in the address list.

[0112] S605: Requesting the original preview image from the server according to the download address of the original preview image, and cropping a small preview image from the original preview image received from the server according to the index of the small preview image, wherein the original preview image is composed of a plurality of small preview images.

[0113] In some embodiments, after obtaining the download address of the preview original image, the display device 200 obtains the corresponding preview original image according to the download address, and caches the preview original image in the memory and the local disk respectively. For example, the current adjusted playback progress is 10 minutes, and the first preview original image is downloaded at this time, and it is cached in the memory and the local disk respectively. If the user watches for 15 minutes, based on the Android system's automatic memory recycling mechanism, the memory releases the first preview large image, while the disk still caches the first preview original image. When the user fast rewinds to the 9th minute, the display device 200 no longer needs to request from the server, and can be directly retrieved from the local disk for use.

[0114] In some embodiments, after the preview original image is downloaded, the display device 200 determines the position of the preview thumbnail in the preview original image based on the index of the preview thumbnail, and then crops the preview thumbnail at the position of the preview thumbnail in the preview original image based on the pixel size of the preview thumbnail and the pixel size of the preview original image. In other words, the display device 200 first accurately locates the preview original image based on the index of the preview thumbnail, and then crops the preview thumbnail indicated by the index of the preview thumbnail. For example, if the calculated index corresponding to the preview thumbnail is 101, and each preview original image contains 100 preview thumbnails, then the preview thumbnail is located at the first position of the second preview original image. After determining the position, the preview thumbnail is cropped from the preview original image in combination with the size parameters and using the corresponding cropping algorithm. The cropped preview thumbnail is cached in the memory, waiting for the user interface to be refreshed and loaded.

[0115] S606: Control the display to display the cropped preview thumbnail on the floating layer of the play page.

[0116] In some embodiments, after cropping the preview thumbnail, the display device 200 controls the display 260 to display it on the floating layer of the play page. Here, the floating layer of the play page displays a view list and a play progress control. The view list displays the preview thumbnail, and the play progress control is used to indicate the current play progress of the media asset data.

[0117] In some embodiments, the display device 200 can control the number of preview thumbnails displayed in the view list, such as Figure 8 As shown in , 5 preview thumbnails are displayed in the view list, that is, each time an adjustment instruction is received from the user, the display device 200 displays 5 preview thumbnails on the floating layer of the play interface. Of course, the preview thumbnail corresponding to the play progress after the adjustment instruction is adjusted is displayed in the center.

[0118] In some embodiments, the memory of the display device 200 does not need to cache all the preview thumbnails in the preview original image in the form of an image list, but only stores the preview thumbnails displayed in the current view list.

[0119] In some embodiments, assuming that the display device 200 controls the display of 5 preview thumbnails in the view list, and each preview thumbnail takes 10 seconds, if the user controls the media playback progress to be adjusted from the current playback position 00:11:00 to 00:13:00, since the display device 200 needs to gradually adjust from 00:11:00 to 00:13:00 according to a certain step length (10 seconds) when responding to the adjustment instruction, first, in the first adjustment step, the display device 200 calculates the indexes of the 5 preview thumbnails according to 00:10:50, 00:11:00, 00:11:10, 00:11:20 and 00:11:30, and locates and crops the corresponding preview original images according to the calculated indexes of the 5 preview thumbnails, and loads the cropped preview thumbnails into the memory, waiting to be read. Then, in the second adjustment step, the display device 200 obtains the indexes of the five preview thumbnails at 00:11:00, 00:11:10, 00:11:20, 00:11:30, and 00:11:40, respectively, and obtains the preview thumbnails corresponding to the indexes of the five preview thumbnails, and loads the obtained preview thumbnails into the memory, waiting for reading. And so on, until the preview thumbnail at 00:13:00 is presented. It should be noted that since the preview thumbnails corresponding to 00:11:00, 00:11:10, 00:11:20, and 00:11:30 in the two adjustment steps are repeated, the preview thumbnails obtained in the first adjustment step can be reused in the second adjustment step, and only the preview thumbnail corresponding to 00:11:40 can be obtained separately. The preview thumbnail corresponding to 00:10:50 no longer needs to be displayed in the view list and can be released. During the above progress adjustment process, the display device 200 only needs to cache 5 preview thumbnails in the memory.

[0120] In some embodiments, when the display device 200 controls the view list to display multiple preview thumbnails, after calculating the first index of the preview thumbnail corresponding to the adjusted playback progress, the display device 200 obtains multiple second indexes before and after the first index, based on the duration of each preview thumbnail, where the first index refers to the index of the preview thumbnail corresponding to the adjusted playback progress. Multiple preview thumbnails corresponding to the second indexes are cropped from the corresponding original preview image, so that the floating layer displays multiple preview thumbnails in the view list.

[0121] The following is a further description of the process of displaying the progress of media playback with reference to the accompanying figures.

[0122] Figure 9 exemplarily shows an interactive flow chart of a method for displaying the progress of media playback according to some embodiments. Figure 9 As shown, based on the bottom layer of the display device 200 software, it includes a user interface module (UI module), a player module (Player module), an operation processing module (Provider module) and an image tool module (ImageUtils module). Among them, the user interface module is used to respond to user control events (click to play, fast forward and rewind response, preview image display refresh), the player module is used to encapsulate the player, start the media playback and obtain the preview image data, the operation processing module is used to process the preview image data and calculate the corresponding preview original image index and preview thumbnail index in combination with the fast forward and rewind progress, and the image tool module is used to load the preview original image and cut the preview thumbnail and cache it in the memory. The following is a detailed description of the process of realizing the display of media playback progress.

[0123] When a user selects a video, they trigger the Start button in the user interface module, which in turn triggers the player module to start playing the media asset. Simultaneously, the player module obtains preview image data (SeekPreviewInfo) and transmits it to the operation processing module. The progress adjustment data processing submodule (SeekDataProvider) in the operation processing module receives the preview image data and extracts the address list, the original preview image pixel size, and the preview thumbnail pixel size. The operation processing module feeds the duration of the preview thumbnail in the preview image data back to the user interface module. To adjust the playback progress, the user triggers the Seek button in the user interface module, which in turn triggers the player module to adjust the playback progress of the media asset. Specifically, the Seek button obtains the current playback progress (position) of the media asset and the user's adjustment amount (duration) and sends them to the playback progress preview submodule (PlayerSeekPreview) in the user interface module. The playback progress preview submodule calculates the preview thumbnail index based on the received data. The view list submodule (RecyclerView) in the user interface module collects the duration and index of the preview thumbnails and prepares them for display in the view list. The view list submodule calculates the index of the preview original image, that is, the download address (url) of the preview original image, based on the fast forward and rewind operations triggered by the user and the position of the focus movement. The operation processing module also needs to further calculate the coordinates (pos) of the index of the preview thumbnail in the corresponding preview original image. The operation processing module transmits the calculated url and pos to the image tool module. The image tool module downloads the corresponding preview original image according to the url, and crops the image according to pos, the pixel size of the preview original image and the pixel size of the preview thumbnail, and caches the cropped preview thumbnail in the form of a bitmap. The cached preview thumbnail is provided to the view list submodule for interface refresh, so that the user interface module displays the preview thumbnail in the view list.

[0124] In this application, the corresponding preview original image is downloaded on demand according to the user's adjustment instructions for the playback progress of the media data, and the corresponding small image is cropped from the preview original image according to the adjustment position of the playback progress indicated by the adjustment instruction, loaded and dynamically cropped out. No redundant preview small images are loaded, thereby greatly reducing the loading amount of preview small images, greatly reducing memory overhead, reducing the system load of the display device, improving the smoothness of the preview display, and thus improving the user experience.

[0125] Based on the same inventive concept as the display device described above, some embodiments of the present application further provide a method for displaying media playback progress. The method includes: in response to an instruction selecting a media control, the display device 200 sends a media request to a server 400, wherein the media control is used to display multimedia resources. The display device 200 receives media data fed back by the server 400 in response to the media request and controls the display 260 to play the media data on a playback page. The display device 200 sends a preview image request to the server 400, causing the server 400 to feed back preview image data in response to the preview image request. The display device 200 receives an input instruction to adjust the playback progress of the media data and, based on the adjustment amount indicated in the adjustment instruction and the preview image data, obtains an index of a preview thumbnail and a download address for the original preview image. The display device 200 requests the original preview image from the server based on the download address of the original preview image and crops a preview thumbnail from the received original preview image based on the thumbnail index, wherein the original preview image is composed of a plurality of the preview thumbnails. The display device 200 controls the display 260 to display the cropped preview thumbnail on the floating layer of the play page.

[0126] In some embodiments, the preview image data includes the duration corresponding to the preview thumbnail, and obtaining the index of the preview thumbnail based on the adjustment amount of the playback progress indicated by the adjustment instruction and the preview image data includes: the display device 200 obtains the current playback progress of the media asset data, and accumulates it with the adjustment amount of the playback progress indicated by the adjustment instruction to obtain the adjusted playback progress of the media asset data. The display device 200 rounds up the playback duration represented by the adjusted playback progress and compares it with the duration corresponding to the preview thumbnail. The ratio obtained is the index of the preview thumbnail corresponding to the adjusted playback progress.

[0127] In some embodiments, the preview image data includes the number of preview thumbnails contained in the original preview image and an address list, the address list includes the download address of at least one preview original image, and obtaining the download address of the preview original image according to the adjustment amount of the playback progress indicated by the adjustment instruction and the preview image data includes: when the value represented by the index of the preview thumbnail is less than the number of preview thumbnails contained in the original preview image, the display device 200 selects the first download address in the address list as the download address of the preview original image to be obtained. When the value represented by the index of the preview thumbnail is greater than or equal to the number of preview thumbnails contained in the original preview image, the result is rounded up to obtain, and the download address in the address list that is the same as the result is selected as the download address of the preview original image to be obtained.

[0128] In some embodiments, the preview image data includes the pixel size of the preview thumbnail and the pixel size of the original preview image. Cropping the preview thumbnail from the original preview image received from the server based on the index of the preview thumbnail includes: the display device 200 determines the position of the preview thumbnail in the original preview image based on the index of the preview thumbnail. The display device 200 crops the preview thumbnail at the position of the preview thumbnail in the original preview image based on the pixel size of the preview thumbnail and the pixel size of the original preview image.

[0129] Since the above embodiments are all described by reference in combination with other embodiments, different embodiments have the same parts, and the same and similar parts between the various embodiments in this specification can be referred to each other. No further detailed explanation is given here.

[0130] It should be noted that, in this specification, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a circuit structure, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such circuit structure, article or device. In the absence of further restrictions, the presence of an element defined by the phrase "includes a..." does not exclude the presence of other identical elements in the circuit structure, article or device comprising the element.

[0131] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the disclosure of the invention herein. This application is intended to cover any variations, uses, or adaptations of the present invention that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, and the true scope and spirit of the present application are indicated by the claims.

[0132] The above embodiments of the present application do not constitute a limitation on the protection scope of the present application.

Claims

1. A display device, characterized in that: The display device comprises: monitor; A controller is communicatively connected to the display, and the controller is configured to: In response to an instruction to select a media asset control, sending a media asset request to a server, wherein the media asset control is used to display multimedia resources; receiving media data fed back by the server according to the media request, and controlling the display to play the media data on a play page; Sending a preview image request to the server, so that the server feeds back preview image data according to the preview image request; receiving an input instruction for adjusting the playback progress of the media asset data, obtaining an index of a small preview image and a download address of the original preview image according to the adjustment amount of the playback progress indicated by the adjustment instruction and the preview image data, wherein the playback progress is adjusted according to a preset adjustment step size; Requesting the original preview image from the server according to the download address of the original preview image, and cropping a preset number of preview thumbnails from the received original preview image fed back by the server according to the index of the preview thumbnails and caching them into memory, wherein the original preview image is composed of a plurality of the preview thumbnails; the preset number of preview thumbnails include preview thumbnails corresponding to the adjusted playback progress and the progress before and after the adjusted playback progress; after adjusting from the first playback progress to the second playback progress, releasing the preview thumbnails corresponding to the first playback progress in the memory, and the interval between the first playback progress and the second playback progress is the preset adjustment step size; The display is controlled to display a preset number of cropped preview thumbnails on a floating layer of the play page.

2. The display device according to claim 1, wherein The preview image data includes a duration corresponding to the preview thumbnail. In the step of obtaining an index of the preview thumbnail according to the adjustment amount of the playback progress indicated by the adjustment instruction and the preview image data, the controller is configured to: Obtaining the current playback progress of the media asset data, and accumulating the current playback progress with the adjustment amount of the playback progress indicated by the adjustment instruction to obtain the adjusted playback progress of the media asset data; The playback duration represented by the adjusted playback progress is rounded up and compared with the duration corresponding to the preview thumbnail to obtain the index of the preview thumbnail corresponding to the adjusted playback progress.

3. The display device according to claim 1, wherein The preview image data includes the number of preview thumbnails included in the preview original image and an address list, the address list including a download address of at least one preview original image. In the step of obtaining the download address of the preview original image according to the adjustment amount of the playback progress indicated by the adjustment instruction and the preview image data, the controller is configured to: When the value represented by the index of the preview thumbnail is less than the number of preview thumbnails contained in the preview original image, selecting the first download address in the address list as the download address of the preview original image to be obtained; When the value represented by the index of the preview thumbnail is greater than or equal to the number of preview thumbnails contained in the preview original image, the result is rounded up to obtain the integer, and the download address in the address list that is the same as the result is selected as the download address of the preview original image to be obtained.

4. The display device according to claim 1, wherein The preview image data includes the pixel size of the preview thumbnail and the pixel size of the preview original image. In the step of cropping the preview thumbnail from the preview original image fed back by the server according to the index of the preview thumbnail, the controller is configured to: Determine the position of the preview thumbnail in the preview original image according to the index of the preview thumbnail; The preview thumbnail is cropped at a position of the preview thumbnail in the preview original image according to the pixel size of the preview thumbnail and the pixel size of the preview original image.

5. The display device according to claim 2, wherein: The index of the preview thumbnail corresponding to the adjusted playback progress is the first index. After calculating the first index of the preview thumbnail corresponding to the adjusted playback progress, the controller is further configured to: Taking the duration corresponding to the preview thumbnail as a unit, obtain multiple second indexes before and after the first index; A plurality of preview thumbnails corresponding to the second indexes are respectively cropped from the corresponding preview original images, so that the floating layer displays a plurality of preview thumbnails in the view list.

6. The display device according to claim 1, wherein The controller is further configured to: The preview original image received from the server is cached in a local disk.

7. A method for displaying the progress of media playback, characterized in that: The method comprises: In response to an instruction to select a media asset control, sending a media asset request to a server, wherein the media asset control is used to display multimedia resources; receiving media data fed back by the server according to the media request, and controlling the display to play the media data on a play page; Sending a preview image request to the server, so that the server feeds back preview image data according to the preview image request; receiving an input instruction for adjusting the playback progress of the media asset data, obtaining an index of a small preview image and a download address of the original preview image according to the adjustment amount of the playback progress indicated by the adjustment instruction and the preview image data, wherein the playback progress is adjusted according to a preset adjustment step size; Requesting the original preview image from the server according to the download address of the original preview image, and cropping a preset number of preview thumbnails from the received original preview image fed back by the server according to the index of the preview thumbnails and caching them into memory, wherein the original preview image is composed of a plurality of the preview thumbnails; the preset number of preview thumbnails include preview thumbnails corresponding to the adjusted playback progress and the progress before and after the adjusted playback progress; after adjusting from the first playback progress to the second playback progress, releasing the preview thumbnails corresponding to the first playback progress in the memory, and the interval between the first playback progress and the second playback progress is the preset adjustment step size; The display is controlled to display a preset number of cropped preview thumbnails on a floating layer of the play page.

8. The method for displaying the progress of media playback according to claim 7, wherein: The preview image data includes a duration corresponding to the preview thumbnail, and obtaining an index of the preview thumbnail according to the adjustment amount of the playback progress indicated by the adjustment instruction and the preview image data includes: Obtaining the current playback progress of the media asset data, and accumulating the current playback progress with the adjustment amount of the playback progress indicated by the adjustment instruction to obtain the adjusted playback progress of the media asset data; The playback duration represented by the adjusted playback progress is rounded up and compared with the duration corresponding to the preview thumbnail to obtain the index of the preview thumbnail corresponding to the adjusted playback progress.

9. The method for displaying the progress of media playback according to claim 7, wherein: The preview image data includes the number of preview thumbnails included in the preview original image and an address list, the address list includes a download address of at least one preview original image, and obtaining the download address of the preview original image according to the adjustment amount of the playback progress indicated by the adjustment instruction and the preview image data includes: When the value represented by the index of the preview thumbnail is less than the number of preview thumbnails contained in the preview original image, selecting the first download address in the address list as the download address of the preview original image to be obtained; When the value represented by the index of the preview thumbnail is greater than or equal to the number of preview thumbnails contained in the preview original image, the result is rounded up to obtain the integer, and the download address in the address list that is the same as the result is selected as the download address of the preview original image to be obtained.

10. The method for displaying the progress of media playback according to claim 7, wherein: The preview image data includes the pixel size of the preview thumbnail and the pixel size of the preview original image, and the step of cropping the preview thumbnail from the preview original image fed back by the server according to the index of the preview thumbnail includes: Determine the position of the preview thumbnail in the preview original image according to the index of the preview thumbnail; The preview thumbnail is cropped at a position of the preview thumbnail in the preview original image according to the pixel size of the preview thumbnail and the pixel size of the preview original image.

Images