Media playing processing method and display device

Abstract

The application discloses a media playing processing method and a display device. An unloading event of an external storage device is listened to. A media data being played is inquired, and the media data comes from a target interface of the external storage device. The target interface is closed, and playing resources occupied by the media data are released. Therefore, when other media resources are played or other playing channels are switched, playing is not affected, and problems such as black screen and playing abnormality do not occur. Therefore, media playing performance in a scene of plugging and unplugging the external storage device is improved, and experience of a user in watching media resources is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the multimedia field, and in particular to a media playing processing method and a display device. BACKGROUND

[0002] The display device can be connected to an external storage device through a specified interface, and the external storage device is not limited to a U disk, a mobile hard disk, a card reader, and the like. A user can select to play a local file saved in the external storage device on the display device. The local file is not limited to a media type such as an image, an audio, a video, and the like.

[0003] The external storage device has a pluggable feature. In some application scenarios, the display device is playing a media file in the external storage device. If the external storage device is unexpectedly detached from a port or the external storage device is unplugged due to a user's misoperation, media playing may be abnormal, for example, a black screen phenomenon occurs, and the like. In general, the display device needs to be restarted to recover to normal. SUMMARY

[0004] To overcome the defects in the background art, the present application provides a media playing processing method and a display device. When the display device plays a media file in the external storage device, if the external storage device is unloaded, the display device can exit media playing in a timely manner and release corresponding underlying playing resources, thereby solving the problem of media playing abnormality in this scenario.

[0005] The first aspect provides a display device, comprising:

[0006] an external interface configured to connect an external storage device;

[0007] a display configured to display a user interface;

[0008] a controller configured to perform:

[0009] listen to an unloading event of the external storage device, query a target interface that is playing media data, and the media data is from the target interface of the external storage device;

[0010] close the target interface and release playing resources occupied by the media data.

[0011] In a first example implementation manner of the first aspect, the controller is configured to query the target interface in the following manner:

[0012] obtain a current interface stack, the interface stack comprising N display interface layers;

[0013] traverse the interface stack in a top-down order, and filter M target interfaces from the interface stack, 0≤M≤N.

[0014] In a second example implementation of the first aspect, the controller is configured to query the target interface in the following manner:

[0015] If it is detected that the current display interface layer includes a playing interface for playing media data, the first path from which the media data is played is queried in the playing interface;

[0016] The second path corresponding to the external storage device is read from the unmounting event;

[0017] If the first path matches the second path, the playing interface is identified as the target interface.

[0018] In a third example implementation of the first aspect, the controller is further configured to perform:

[0019] If the first path does not match the second path, the current display interface layer is maintained, and the next display interface layer is jumped to, and it is identified whether the next display interface layer is the target interface.

[0020] In a fourth example implementation of the first aspect, the controller is further configured to perform:

[0021] If it is detected that the current display interface layer includes an associated setting page, the associated setting page is closed after saving the function setting information in the associated setting page; the associated setting page is a function setting interface associated with the path of the external storage device read from the unmounting event.

[0022] In the above embodiments of the first aspect, the display device can listen to the plugging and unplugging actions of the external storage device. When the external storage device is plugged into the corresponding interface of the display device, the external storage device is mounted, and the user can play the media files in the external storage device. Of course, the user can also watch the local files stored in the built-in disk of the display device or the network media asset. Therefore, when the external storage device is unmounted, the display device needs to detect whether there is a media file from the external storage device being played. Considering that the display device can maintain multiple layers of UI interfaces at the same time, the target interface satisfying the aforementioned determination condition is queried therefrom. The media playing of the target interface will be affected by the unmounting action of the external storage device. Therefore, the target interface needs to be closed, and the underlying resources occupied by the media data played by the target interface, such as audio and video decoding resources, audio output channels, and video display channels, are released. Thus, when other media assets are played or other playing channels are switched, the playing is not affected, and problems such as black screen do not occur, thereby improving the media playing performance in the scenario of plugging and unplugging the external storage device and improving the user experience of watching media assets.

[0023] In a fifth exemplary implementation of the first aspect, the controller is further configured to perform:

[0024] If the media type played by the current display interface layer is an image, in response to an image zoom instruction, an image zoom interface is displayed;

[0025] The image zoom interface displays a subject image and a panoramic view window, the subject image is obtained by zooming the current image according to a zooming magnification indicated by a current zooming mode, and the panoramic view window displays a full view of the current image in the form of a small window.

[0026] In a sixth exemplary implementation of the first aspect, the controller is further configured to display the image zoom interface as follows:

[0027] According to an original size of the current image and a preset ratio, the current image is zoomed to obtain a panoramic thumbnail, and the panoramic thumbnail is filled into the panoramic view window;

[0028] According to a screen resolution, the preset ratio and the current zooming mode, a screen boundary box is generated and displayed; the screen boundary box is used to frame a display area of the screen.

[0029] In a seventh exemplary implementation of the first aspect, the controller is further configured to generate the panoramic view window as follows:

[0030] The size of the panoramic thumbnail is compared with the size of the screen boundary box;

[0031] If the width of the panoramic thumbnail is greater than the width of the screen boundary box, a leftward control is displayed on the left side of the screen boundary box, and a rightward control is displayed on the right side of the screen boundary box;

[0032] And / or, if the height of the panoramic thumbnail is greater than the height of the screen boundary box, an upward control is displayed on the upper side of the screen boundary box, and a downward control is displayed on the lower side of the screen boundary box.

[0033] In an eighth exemplary implementation of the first aspect, the controller is further configured to perform:

[0034] In response to a first preset operation, the zooming mode is switched in sequence, and the size of the screen boundary box is adaptively adjusted according to the switched zooming mode;

[0035] And / or, in response to a second preset operation of adjusting the visible region of the image, moving the subject image in an opposite direction according to a direction indicated by the second preset operation and a first preset step size, and moving the screen boundary frame in the same direction within the panoramic window according to a second preset step size; wherein the second preset step size is calculated according to the first preset step size and the preset ratio.

[0036] In the fifth to eighth embodiments of the first aspect, when the display device plays an image from a network, an external storage device or the like, the user can select a zoom mode, such as fit to screen, 100%, 200%, 300%, etc. When the image zoom interface is entered, the subject image matching the current zoom mode is displayed. If the size of the subject image exceeds the screen resolution, only the first image region within the screen is visible, and the second image region beyond the screen is invisible. The user needs to move the subject image complicatedly to make the second image region enter the screen visual range, so that the user can perceive the overall image and locate the local image feature of interest. Obviously, this way needs the user to operate complicatedly and cannot provide better experience for the user. Therefore, the application improves the zoom display function of the image. After the image zoom interface is entered, in addition to displaying the subject image, a panoramic window is also displayed. The panoramic window displays the overall image in the form of a small window. When the user views the large image, the user can also view the overall features of the image through the panoramic window. The screen boundary frame can also be displayed in the panoramic window. Through the relative position distribution between the screen boundary frame and the panoramic thumbnail, the user can intuitively perceive the image features within and outside the screen boundary frame. If a local feature of interest and details are located outside the frame, according to the direction of the local feature compared with the screen boundary frame, the user can quickly move the subject image to make the local feature of interest enter the frame, so as to realize the function coverage of the image zoom from the overall to the local, and improve the user experience.

[0037] The second aspect provides a media playing processing method, and the method comprises the following steps:

[0038] Listening to an unloading event of an external storage device, querying a target interface that is playing media data and that comes from the external storage device;

[0039] Closing the target interface and releasing playing resources occupied by the media data.

[0040] The other further implementation manners and the beneficial effects possessed by the second aspect can be adaptively referred to the description of the first aspect, and will not be described here. BRIEF DESCRIPTION OF DRAWINGS

[0041] In order to make the technical solutions in the embodiments of the present application or the prior art clearer, the accompanying drawings needed in the embodiments will be briefly introduced. Obviously, the accompanying drawings in the following description only aim to some embodiments of the present application, and for those skilled in the art, other drawings can be obtained based on these drawings without any creative effort.

[0042] Figure 1 A use scenario of the display device is shown;

[0043] Figure 2 A hardware configuration block diagram of the control device 100 is shown;

[0044] Figure 3 A hardware configuration block diagram of the display device 200 is shown;

[0045] Figure 4 A software configuration diagram in the display device 200 is shown;

[0046] Figure 5 A home page is exemplarily shown;

[0047] Figure 6 A file selection page is exemplarily shown;

[0048] Figure 7 UI changes of the file selection page after selecting a play path are exemplarily shown;

[0049] Figure 8 A directory preview page under a U disk is exemplarily shown;

[0050] Figure 9 A zoom mode setting page is exemplarily shown;

[0051] Figure 10 An image play interface after switching the zoom mode is exemplarily shown;

[0052] Figure 11 An image visual area distribution diagram when the image size exceeds the screen resolution is exemplarily shown;

[0053] Figure 12 An image play interface is exemplarily shown;

[0054] Figure 13 A menu bar displayed on the image play interface is exemplarily shown;

[0055] Figure 14 An image zoom interface is exemplarily shown;

[0056] Figure 15Exemplary distribution of the first type of panoramic thumbnail and the screen boundary box is shown.

[0057] Figure 16 Exemplary distribution of the second type of panoramic thumbnail and the screen boundary box is shown.

[0058] Figure 17 Exemplary distribution of the third type of panoramic thumbnail and the screen boundary box is shown.

[0059] Figure 18 Exemplary distribution of the fourth type of panoramic thumbnail and the screen boundary box is shown.

[0060] Figure 19 Exemplary distribution of the fifth type of panoramic thumbnail and the screen boundary box is shown.

[0061] Figure 20 Exemplary UI change diagram of the image zoom interface when the user adjusts the image visible area upward in the Figure 19

[0062] Figure 21 Exemplary flow chart of the first media playing processing method is shown.

[0063] Figure 22 Exemplary flow chart of the second media playing processing method is shown.

[0064] Figure 23 Exemplary flow chart of the third media playing processing method is shown.

[0065] Figure 24 Exemplary bottom layer processing logic of the media playing is shown. DETAILED DESCRIPTION

[0066] In order to make the purpose and implementation of the present application more clear, the following will combine the drawings in the exemplary embodiments of the present application to clearly and completely describe the exemplary implementation of the present application. Obviously, the described exemplary embodiments are only some of the embodiments of the present application, but not all of the embodiments.

[0067] It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the following described embodiments, and is not intended to limit the implementation of the present application. Unless otherwise specified, these terms should be understood according to their ordinary and general meanings.

[0068] The terms "first", "second", "third" and the like in the specification and claims of the present application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit the specific order or sequence, unless otherwise specified. It should be understood that the terms used in this way can be interchanged under appropriate circumstances.​

[0069] The terms "comprises", "comprising", "includes", "including", "has", "having" and their conjugates mean that the product or device includes but is not limited to, such as the listed items, and any equivalents thereof.

[0070] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that can perform the functions described with respect to that element.

[0071] Figure 1 is a schematic diagram of a use scenario of the display device in the embodiments. As shown in Figure 1 The display device 200 also communicates data with the server 400, and the user can operate the display device 200 through the smart device 300 or the control device 100.

[0072] In some optional embodiments, the control device 100 can be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication or Bluetooth protocol communication, and other short-distance communication modes, to control the display device 200 in a wireless or wired manner. The user can input user instructions through at least one of a button on the remote controller, voice input, control panel input, etc., to control the display device 200.

[0073] In some optional embodiments, the smart device 300 can include any one of a mobile terminal, a tablet computer, a computer, a notebook computer, an AR / VR device, etc.

[0074] In some optional embodiments, the smart device 300 can also be used to control the display device 200. For example, an application running on the smart device is used to control the display device 200.

[0075] In some optional embodiments, the smart device 300 and the display device can also be used to communicate data.

[0076] In some optional embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300, for example, the display device 200 can directly receive voice instructions from the user through a voice instruction acquisition module configured inside the display device 200, or the display device 200 can receive voice instructions from the user through a voice control device arranged outside the display device 200.

[0077] In some alternative embodiments, the display device 200 is also in data communication with the server 400. The display device 200 can be allowed to be communicatively connected through a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 can provide various contents and interactions to the display device 200. The server 400 can be one cluster or multiple clusters, and can include one or more types of servers.

[0078] In some alternative embodiments, a software step performed by one step performing subject can be migrated to another step performing subject in data communication therewith for execution upon demand. For example, a software step performed by the server can be migrated to the display device in data communication therewith for execution upon demand, and vice versa.

[0079] Figure 2 An exemplary configuration block diagram of the control device 100 according to an exemplary embodiment is shown. As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, a power supply. The control device 100 can receive input operation instructions from a user, and convert the operation instructions into instructions recognizable and responsive by the display device 200, to serve as an intermediary for interaction between the user and the display device 200. Figure 2

[0080] In some alternative embodiments, the communication interface 130 is used for external communication, and includes at least one of a WIFI chip, a Bluetooth module, an NFC or an alternative module.

[0081] In some alternative embodiments, the user input / output interface 140 includes at least one of a microphone, a touchpad, a sensor, a key, or an alternative module.

[0082] Figure 3 An exemplary hardware configuration block diagram of the display device 200 according to an exemplary embodiment is shown.

[0083] In some alternative embodiments, the display device 200 includes at least one of a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0084] In some alternative embodiments, the controller includes a central processing unit, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an n-th interface for input / output.

[0085] ​In some optional embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving the image display, for receiving an image signal from the output of the controller, for displaying video content, image content, and menu control interface components, and user control UI interface, etc.

[0086] In some optional embodiments, the display 260 can be at least one of a liquid crystal display, an OLED display, and a projection display, and can also be a projection device and a projection screen.

[0087] In some optional embodiments, the tuner demodulator 210 receives broadcast television signals through wired or wireless reception, and demodulates audio and video signals, EPG data signals, etc. from a plurality of wireless or wired broadcast television signals.

[0088] In some optional embodiments, the communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example, the communicator can include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

[0089] In some optional embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, the detector 230 includes a light receiver for collecting ambient light intensity, or the detector 230 includes an image collector such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures, or the detector 230 includes a sound collector such as a microphone, etc. for receiving external sounds.

[0090] In some optional embodiments, the external device interface 240 can include, but is not limited to, any one or more of the following: a high-definition multimedia interface (HDMI), an analog or data high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It can also be a composite input / output interface formed by the above multiple interfaces.

[0091] In some optional embodiments, the controller 250 and the tuner demodulator 210 can be located in different split devices, i.e. the tuner demodulator 210 can also be in an external device of the main device where the controller 250 is located, such as an external set-top box, etc.

[0092] In some alternative embodiments, the controller 250 controls the operation of the display device and responds to user operations by storing various software control programs in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object displayed on the display 260, the controller 250 can perform an operation related to the object selected by the user command.

[0093] In some alternative embodiments, the object can be any one of the selectable objects, such as a hyperlink, an icon, or another operable control. The operation related to the selected object can be an operation of displaying a page connected to the hyperlink, a document, an image, etc., or an operation of executing a program corresponding to the icon.

[0094] In some alternative embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a RAM (Random Access Memory), a ROM (Read-Only Memory), a first interface to an n-th interface for input / output, a communication bus, etc.

[0095] The CPU processor is configured to execute operating system and application program instructions stored in the memory, and to execute various application programs, data, and content according to various interaction instructions received from external input, so as to finally display and play various audio and video content. The CPU processor can include a plurality of processors. For example, the CPU processor can include a main processor and one or more sub-processors.

[0096] In some alternative embodiments, the graphics processor is configured to generate various graphical objects, such as at least one of an icon, an operation menu, and a user input instruction display graphic. The graphics processor includes an operator configured to perform operations by receiving various interaction instructions from a user, and to display various objects according to display attributes; and a renderer configured to perform rendering on various objects obtained based on the operations of the operator, and the rendered objects are used for display on the display.

[0097] In some alternative embodiments, the video processor is configured to receive an external video signal, and to perform at least one of video processing, such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis, according to a standard codec protocol of the input signal, so as to obtain a signal directly displayable on the display device 200.

[0098] In some optional embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, etc. The demultiplexing module is configured to perform demultiplexing processing on the input audio / video data stream. The video decoding module is configured to process the demultiplexed video signal, including decoding and scaling processing, etc. The image synthesizing module, such as an image synthesizer, is configured to perform superimposition and mixing processing on the video image after scaling processing and the GUI signal generated by the graphics generator according to the user input or itself, to generate an image signal for display. The frame rate conversion module is configured to convert the input video frame rate. The display formatting module is configured to change the output signal of the video after frame rate conversion to a signal conforming to the display format, such as an output RGB data signal.

[0099] In some optional embodiments, the audio processor is configured to receive external audio signals, perform at least one of decompression and decoding, noise reduction, digital-to-analog conversion, and amplification processing, etc. according to the standard codec protocol of the input signal, to obtain sound signals that can be played on a loudspeaker.

[0100] In some optional embodiments, the user can input a user command through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user can input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor.

[0101] In some optional embodiments, the "user interface" is a medium interface for interaction and information exchange between an application program or an operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The commonly used form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an icon, window, control, etc. interface element displayed in the display screen of an electronic device, wherein the control can include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. visual interface element.

[0102] In some optional embodiments, the user interface 280 is an interface (such as a physical button on the body of the display device, or the like) that can be used to receive control input.

[0103] In some alternative embodiments, the system of the display device can include a kernel, a shell, a file system and an application. The kernel, the shell and the file system together form a basic operating system structure, which allows a user to manage files, run programs and use the system. After power on, the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, runs and maintains virtual memory, a scheduler, signals and inter-process communication (IPC). After the kernel starts, the shell and the user application are loaded. The application is compiled into machine code after starting, forming a process.

[0104] Referring to Figure 4 In some alternative embodiments, the system is divided into four layers, from top to bottom, the application layer (referred to as "application layer"), the application framework layer (referred to as "framework layer"), the Android runtime and system library layer (referred to as "system runtime library layer"), and the kernel layer.

[0105] In some alternative embodiments, at least one application is running in the application layer, which can be a window program, a system setting program or a clock program provided by the operating system, or an application developed by a third-party developer. In specific implementation, the application package in the application layer is not limited to the above examples.

[0106] The framework layer provides an application programming interface (API) and a programming framework for the application in the application layer. The application framework layer includes some pre-defined functions. The application framework layer is equivalent to a processing center, which decides the action of the application in the application layer. The application can access the resources in the system and obtain the services of the system through the API interface in the execution.

[0107] As Figure 4As shown, the application framework layer in this embodiment includes managers, content providers, etc., wherein the managers include at least one of the following modules: ActivityManager, which interacts with all activities running in the system; LocationManager, which provides access to system location services for system services or applications; PackageManager, which retrieves various information related to application packages currently installed on the device; NotificationManager, which controls the display and clearing of notification messages; and WindowManager, which manages icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0108] In some optional embodiments, the activity manager is used to manage the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The window manager is used to manage all window programs, such as obtaining the screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling display window changes (e.g., shrinking the display window, shaking the display, distorting the display, etc.).

[0109] In some alternative embodiments, the system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system runs the C / C++ libraries contained in the system runtime layer to implement the functions that the framework layer needs to perform.

[0110] In some alternative embodiments, the kernel layer is a layer between the hardware and software. For example... Figure 4 As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.

[0111] The above embodiments describe the hardware / software architecture and functional implementation of the display device. For device terminals that are the same as or similar to the display device, an external interface can be provided for connecting to an external storage device. The external interface is not limited to USB interfaces, and the external storage device is not limited to USB flash drives, external hard drives, and card readers. The external storage device can store different types of media files, including video, audio, images, and text.

[0112] The external storage device has a pluggable feature. When the external storage device is plugged into the external interface, the display device can sense that the external storage device enters a mounting state, so as to realize data interaction between the display device and the external storage device, for example, the display device reads and plays a user-specified media file from the external storage device, or the display device can import a downloaded file into the external storage device, etc. When the user actively ejects the external storage device in the peripheral management process, or the external storage device is separated from the interface due to an accident, or the user unplugs the external storage device due to other misoperations when no ejection operation is performed, the display device can sense that the external storage device switches to an unmounting state, the data interaction between the two is terminated, and the display device responds and processes in a timely manner according to the unmounting event of the external storage device.

[0113] In some embodiments, the display device can play an image from a path such as a network, a local disk, an external storage device, etc. Optionally, the display device can create an image player, the image player obtains and loads a display image from a specified path, and supports user interaction through a UI interface associated with the image player, for example, editing an image, switching an image, image zooming, etc.

[0114] In some embodiments, the user can zoom an image according to use requirements, for example, the user wants to view a local feature A in an image 1, but the size of the image 1 is small, so that the user cannot clearly see the details of the local feature A, and then the image 1 can be zoomed in to make the local feature A be zoomed in synchronously. In this regard, the image zooming function generally provides multiple zooming modes, the zooming mode is used to limit the degree of adjustment and zooming of the image compared with the original size, and the zooming mode is not limited to including adaptive screen, 100%, 200%, 300%, 400%, etc., wherein the adaptive screen is to adjust the width and height of the image to a size that is adapted to the screen resolution, 100% is the original size (i.e., the magnification is 1), and 200% to 400% represent the magnification of 2 to 4, respectively. Optionally, the zooming mode further includes a custom mode, i.e., the user customizes the magnification, for example, 150%.

[0115] In some embodiments, a UI operation flow of an image zooming scheme one is provided. First, the user accesses the media center application through a specified entry, for example, referring to the example of Figure 5 , setting an icon of the media center application in a system home page (Launcher), the user clicks the “media center” icon through a remote controller, so as to start the media center application, and display a file selection page of the example of Figure 6 .

[0116] In some embodiments, referring to the example of Figure 6The file selection page includes a path option 61 and a file selection control 62. The user clicks a list control 611 to display a path list 612. The path list 612 includes at least one path identifier. The path identifier can be a specific path name, such as a local disk D, a U disk, a network, and the like. After the user selects a target path from the path list 612, for example Figure 6 the user selects the U disk, the UI changes to Figure 7 the path list 612 is hidden, and the selected "U disk" is displayed at the path option 61. Then, the user triggers the file selection control 62 to automatically jump to a directory preview page under the selected path.

[0117] In some embodiments, refer to Figure 8 the directory preview page under the U disk. The directory displays each media file currently stored in the U disk to the user. Optionally, the media file is intuitively and visually presented to the user in the form of a preview image 81. The preview image is, for example, a folder icon, an audio icon, a video thumbnail, and an image thumbnail. To facilitate the user to accurately distinguish and distinguish the file, file information 82 can be added below each preview image. The file information 81 is, for example, a folder name, media resource information, and the like. The media resource information includes, but is not limited to, resource name, video introduction, resource format (such as jpg, avi, mp3), and the like.

[0118] In some embodiments, the preview image can be associated with a play link of the media file. For example, when the display device responds to the operation instruction of the user clicking the thumbnail image with the name "group photo", the image player is automatically started. The image player obtains the corresponding image data from the U disk and loads and displays it in the play interface.

[0119] If the user wants to start playing the target media file in the directory, the user needs to first locate the preview image position of the target media file, and then click the preview image to jump to the corresponding media play interface. In some embodiments, the user can switch the file focus in the directory by operating the remote controller. For example, the user can move the remote controller or press the direction keys on the remote controller. Optionally, the display device can highlight the file where the focus is located. Refer to Figure 8 the current focus moves to "group photo.jpg". A focus frame can be set around the thumbnail image of "group photo.jpg". The display effect of the focus frame (including thickness, line type, and the like) is not limited. Of course, other feasible focus reminding methods can also be used, such as appropriately zooming the thumbnail image pointed by the focus, so that the user can quickly and intuitively distinguish the focus. When the focus is settled on the target media file that the user wants to play, the user can trigger the OK / confirmation key on the remote controller to confirm the selected file. The display device immediately starts the player matched with the media type of the file to realize the play control of the media file.

[0120] In some embodiments, referring to Figure 8 , a search control 83 can also be provided in the catalog preview page, in which the user can input at least one keyword related to the file, and then click the OK / confirmation key. If the display device retrieves a target file matching the keyword in the external storage device, only the searched target file is displayed in the search result page, and other files are filtered out. This way can facilitate the user to quickly find and locate the target file for browsing, especially in the scenario where a large amount of files are stored in the external storage device, and the efficiency of locating and indexing the file by the user is improved. For example, if the user inputs the keyword "Happy Melody" in the search control, the target file "Happy Melody Episode 10" can be searched. In other possibilities, if the display device does not retrieve a target file matching the keyword, i.e., the search target is empty, a prompt can be given in the search result page that no matching media file is searched.

[0121] After selecting the image to be played according to the UI flow of Figures 6-8 , the display device automatically starts the image player, the image player obtains the image data from the U disk path, and loads the image data to be displayed on the image playing interface. At this time, the image is displayed in a first default zoom mode, which can be the last set zoom mode (which has been recorded as the current zoom mode) or 100% (original image size) and the like.

[0122] In some embodiments, when the image playing interface is displayed, the user can switch the zoom mode at any time. For example, the user can trigger the Menu / menu key on the remote controller to call up the image display menu, and click the zoom mode setting item in the image display menu. As shown in the example of Figure 9 , the zoom mode setting page can be displayed in the half-screen mode on the current image playing interface, which lists several preset zoom modes, including but not limited to "Adapt to screen", "100%" (original image size), "200%", "300%", "400%", "Custom" and the like. The zoom mode is not limited to enlarging the image (i.e., magnification greater than 1), but can also be reducing the image (i.e., magnification less than 1), such as setting "50%" mode, "75%" mode and the like. In some scenarios, the original image size is large, and the user expects to see the whole image, so the image is reduced.

[0123] In some embodiments, after the user switches the focus to the preferred zoom mode, the OK key of the remote controller is triggered, and the target zoom mode where the focus is located is selected. The current zoom mode is reset to the target zoom mode. For example, the user selects the "200%" mode, and the zoom mode setting page is automatically closed, and the current image is enlarged to twice the original size, as shown in the example of Figure 10 .

[0124] In some embodiments, if the size of the zoomed image exceeds the screen resolution, resulting in that part of the zoomed image is not visualized on the screen, i.e. the image is not fully displayed, the orientation control is displayed on the edge of the image playing interface, referring to Figure 10 The up control 101 is displayed on the upper edge of the image playing interface, the down control 102 is displayed on the lower edge of the image playing interface, the left control 103 is displayed on the left edge of the image playing interface, and the right control 104 is displayed on the right edge of the image playing interface. The user can trigger the orientation control or click the direction button on the remote controller to move the image in the specified direction, thereby adjusting the visible area of the image. If the size of the zoomed image does not exceed the screen resolution, i.e. the image can be fully displayed on the screen, the orientation control does not need to be set in the image playing interface.

[0125] In the above-mentioned image zooming scheme I, if the size of the image exceeds the screen resolution, referring to Figure 11 subgraph (a), the image and the image are concentric, the area A in the image is in the screen, and the area B in the periphery of the image is out of the screen. Therefore, the area A has visibility, and the area B does not have visibility. After the user browses the area A, the user can move the image in the up, down, left and right directions to adjust the visible area of the image.

[0126] Referring to Figure 11 subgraph (b), taking the user triggering the up control 101 (equivalent to moving the image downward) as an example, in the case of maintaining the current zooming mode, although the areas of the area A and the area B do not change, the relative position distribution of the area A and the area B changes. Since the area A is moved upward as a whole compared with the area B, the height hi of the area segment above the area B is gradually compressed, and the height h2 of the area segment below the area B is gradually increased, until hi is reduced to zero, and h2 is increased to H1-H0, H1 is the height of the image in the current zooming mode, and H0 is the height of the screen. It is indicated that the image is moved to the limit, and the up control 101 can be cancelled at this time. The case when the user triggers the down control 102 is similar.

[0127] Referring to Figure 11 subgraph (c), taking the user triggering the left control 103 (equivalent to moving the image to the right) as an example, since the area A is moved to the left as a whole compared with the area B, the width w1 of the area segment to the left of the area B is gradually compressed, and the width w2 of the area segment to the right of the area B is gradually increased, until w1 is reduced to zero, and w2 is increased to W1-W0, W1 is the width of the image in the current zooming mode, and W0 is the width of the screen. It is indicated that the image is moved to the limit, and the left control 103 can be cancelled at this time. The case when the user triggers the right control 104 is similar.

[0128] From Figure 11As the example shows, in scenarios where the image size exceeds the screen resolution, users cannot intuitively browse panoramic images. They must manually adjust the visible area of ​​the image to gradually perceive the whole picture and locate the local features of interest. Obviously, this method requires tedious operation and cannot provide a better user experience.

[0129] In some embodiments, this application also provides an image scaling scheme two and its UI interaction, which can also be implemented according to... Figures 6-8 The UI process selects an image and displays it in non-scaling mode in the image playback interface. The non-scaling mode displays the original image. If the user then inputs an image scaling command, the image scaling interface will be displayed.

[0130] In some embodiments, while the original image is displayed, the user can click a designated button on the remote control (such as the OK button, Menu button, or a certain directional key, etc.), or trigger... Figure 12 The menu control 121 on the example image playback interface is as follows: Figure 13 For example, the menu bar 131 is displayed in a preset location on the image playback interface (e.g., at the bottom of the interface). See reference... Figure 13 The menu bar 131 includes at least a zoom control 131A. Users input image zoom commands by triggering the zoom control 131A. The display device responds to the image zoom command by changing the UI, thus entering the image zoom interface. Of course, other functional controls can also be set in the menu bar 131, such as an editing control 131B, a forward switching control 131C, and a backward switching control 131D. The editing control 131B is not limited to cropping, rotating, or adding filters to the current image. If the current image comes from a folder or album on an external storage device, and the folder or album contains multiple images, the displayed image can be switched using the forward switching control 131C and the backward switching control 131D.

[0131] In some embodiments, such as Figure 14 The example image scaling interface displays the main image 141 and the panoramic window 142 simultaneously. The main image 141 is the image obtained by scaling the original image according to the current scaling mode. The current scaling mode can be the scaling mode set and recorded last time, or the default initial 100% mode, etc.

[0132] In some embodiments, refer to Figure 14 The panoramic window 142 displays the entire current image in a small window format. The panoramic window 142 is displayed at a preset position on the image zoom interface, for example... Figure 14The full-panoramic window is displayed in the lower right corner of the interface. The full-panoramic window 142 includes a full-panoramic thumbnail 142A, which is a small image obtained by reducing the original image according to a preset ratio. For example, if the size of the original image is 1280*720 and the preset ratio is 8, the size of the full-panoramic thumbnail is 160*90. The size of the full-panoramic window is the same as that of the full-panoramic thumbnail, and the full-panoramic thumbnail is used as a background image to fill the full-panoramic window. At the same time, the image zoom interface also displays a screen boundary box 143 for framing the display area of the screen. The size and position distribution of the screen boundary box 143 are different, and the visible area and invisible area of the image are also different.

[0133] In some embodiments, the size and position of the full-panoramic window 142 and the full-panoramic thumbnail 142A are relatively fixed, and the size and position of the screen boundary box 143 are variable. Alternatively, the size of the screen boundary box 143 is calculated according to the screen resolution, the aforementioned preset ratio, and the current zoom mode. For example, if the screen resolution is 1920*1080, the preset ratio is 8, and the current zoom mode is 200%, the size of the screen boundary box 143 is 120*67.5. Then, a screen boundary box 143 matching the size is generated and displayed. The screen boundary box 143 is a rectangular box, and the color, line type, line thickness, etc. of the screen boundary box 143 can be flexibly configured, which is not limited in the present application. From the perspective of layer distribution, the screen boundary box 143 should avoid being covered and blocked by the main image 141 and the full-panoramic window 142, and the full-panoramic window 142 should avoid being covered and blocked by the main image 141, so that the full-panoramic window 142 and the screen boundary box 143 can be visualized.

[0134] In some embodiments, the current zoom mode is displayed at a specified position outside the full-panoramic window 142. For example, as shown in Figure 14 , “200%” is displayed below the full-panoramic window 142.

[0135] In some embodiments, the zoom mode can be divided into two categories: the first category is the conventional image zoom-in or zoom-out mode, such as 50% mode, 100% mode, 200% mode, 300% mode, etc.; and the second category is the adaptive screen mode, which can be further divided into three sub-modes: adaptive screen width, adaptive screen height, and full screen. The sub-mode can be adaptively matched according to the characteristics of the image.

[0136] In some embodiments, if the image aspect ratio is greater than or equal to 1, i.e. the image is in landscape mode, and the image aspect ratio is different from the screen aspect ratio, the screen width adaptation sub-mode can be implemented. Assuming that the screen resolution is 1920*1080 (i.e. the screen aspect ratio is 16:9) and the image aspect ratio is 17:9, the main image obtained after the screen width adaptation has a width W1 = 1920 (the screen width W0) and a height H1 = 1920*9 / 17 = 1016.5, i.e. the size of the main image 141 is adapted to 1920*1016.5.

[0137] In some embodiments, if the image aspect ratio is equal to the screen aspect ratio, the full screen sub-mode can be implemented. Assuming that the screen resolution is 1920*1080 (i.e. the screen aspect ratio is 16:9) and the image aspect ratio is 16:9, the main image obtained after the full screen sub-mode has a width W1 = 1920 (the screen width W0) and a height H1 = 1080 (the screen height H0), i.e. the size of the main image 141 is adapted to 1920*1080.

[0138] In some embodiments, if the image aspect ratio is less than 1, i.e. the image is in portrait mode, the screen height adaptation sub-mode can be implemented. Assuming that the screen resolution is 1920*1080 (i.e. the screen aspect ratio is 16:9) and the image aspect ratio is 9:16, the main image obtained after the screen height adaptation has a width W1 = 1080*9 / 16 = 607.5 and a height H1 = 1080 (the screen height H0), i.e. the size of the main image 141 is adapted to 607.5*1080.

[0139] In some embodiments, the display device can maintain a scaling mode set including S scaling modes, and the scaling mode set can be sorted according to certain rules. For example, the scaling mode set is {100%, 200%, 300%, 400%, Fit}, i.e. S is equal to 5, wherein the scaling modes are sorted in descending order of the magnification factor, and the screen adaptation (Fit) mode has the highest priority. It should be noted that the sorting rules and the number of scaling modes in the scaling mode set are not limited, e.g. the scaling mode set can only include magnification modes with different magnification factors, and can not include the screen adaptation mode.

[0140] For the first image zooming scheme, each time the zoom mode is switched, the zoom mode setting page needs to be called out again, and the target zoom mode to be switched to needs to be selected from the zoom mode setting page, which leads to complicated user operation and poor user experience. In some embodiments of the second image zooming scheme, when the display device displays the image zooming interface, the user can quickly switch the zoom mode by inputting a first preset operation, for example, clicking the OK key on the remote controller, which is equivalent to a single click on the screen. The display device switches to the zoom mode next to the current zoom mode in the zoom mode set in response to the first preset operation. For example, the zoom mode set is {100%, 200%, 300%, 400%}, the current zoom mode is 200%, and the user clicks the OK key once to switch to the 300% mode, and clicks the OK key again to switch to the 400% mode. Since the 400% mode is the last in the zoom mode set, the user clicks the OK key when the current zoom mode is 400% to switch to the 100% mode at the beginning of the set, and so on, to achieve the circular switching of the zoom mode according to the set order, improve the switching efficiency of the zoom mode, and improve the user UI interaction experience. The first preset operation is not limited to the example in this embodiment.

[0141] In some embodiments, the first prompt information is also displayed in the image zooming interface, and the first prompt information is used to guide the user to switch the zoom mode by inputting the first preset operation, for example Figure 14 In the above embodiment, the first prompt information is displayed as "click the OK key on the remote controller to switch the zoom mode". Alternatively, when the image zooming interface is displayed, the display device receives the operation instruction sent by the remote controller, and obtains the intention of the user to switch the zoom mode after analyzing the key value of the operation instruction, so as to switch the zoom mode. The first prompt information can be cancelled after the zoom mode is switched, or the first prompt information can be automatically cancelled after the display time reaches the preset time length, so as to avoid the influence of the first prompt information on the user's browsing of the image.

[0142] In some embodiments, since the size of the screen boundary frame 143 is affected by the zoom mode, when the user switches the zoom mode, the main image 141 and the screen boundary frame 143 need to be refreshed synchronously. For example, when the user switches the zoom mode from 200% to 300%, the main image 141 is refreshed to be 3 times the size of the original image, and the size of the screen boundary frame 143 is relatively reduced. When the image magnification increases, the main image 141 presents an enlargement rule, and the screen boundary frame 143 presents a reduction rule. Conversely, when the image magnification decreases, the main image 141 presents a reduction rule, and the screen boundary frame 143 presents an enlargement rule. That is, the zoom rules of the main image 141 and the screen boundary frame 143 are negatively correlated. Through the size change of the screen boundary frame 143, the zoom degree and trend of the image can be measured. The "panoramic thumbnail 142A + screen boundary frame 143" is equivalent to a "main image 141 + screen" in miniature, so that the user can control the overall image zooming mode.

[0143] In some embodiments, the size and position relationship between the panoramic thumbnail 142A and the screen boundary frame 143 affects the visible area distribution of the main image 141. Assuming that the width of the panoramic thumbnail / panoramic window is W2, the height of the panoramic thumbnail / panoramic window is H2, the width of the screen boundary frame is w0, and the height of the screen boundary frame is h0, in the subgraph (a) of Figure 15 the panoramic thumbnail is in landscape mode, and in the subgraph (b) of Figure 15 the panoramic thumbnail is in portrait mode, and both satisfy h0 greater than H2 and w0 greater than W2, that is, the panoramic thumbnail is completely located in the screen boundary frame, which means that the main image under the current zoom mode is completely in the screen, and the main image is entirely visible. In such a scenario, the orientation control for adjusting the visible area of the image does not need to be set on the periphery of the screen boundary frame.

[0144] In some embodiments, Figure 16 the panoramic thumbnail is in landscape mode in the subgraph (a) of Figure 16 the panoramic thumbnail is in portrait mode in the subgraph (b) of Figure 16 the panoramic thumbnail is in landscape mode in the subgraph (c) of Figure 16 satisfy w0 equal to W2 and h0 greater than H2; satisfy w0 greater than W2 and h0 equal to H2; satisfy w0 equal to W2 and h0 equal to H2. The distribution rule is that at least one of the width and height of the panoramic thumbnail and the screen boundary frame is equal, and the panoramic thumbnail does not exceed the framing area of the screen boundary frame. The main image under the current zoom mode is completely in the screen, and the main image is entirely visible. In such a scenario, the orientation control for adjusting the visible area of the image does not need to be set on the periphery of the screen boundary frame.

[0145] In some embodiments, for Figure 15 and Figure 16The zooming scenario of the whole subject image being visible can also not display the panorama window 142 and the screen boundary box 143 to avoid occlusion of the subject image, and only display the panorama window 142, the screen boundary box 143 and the orientation control when there is an invisible region of the subject image.

[0146] In some embodiments, Figure 17 The panorama thumbnail in subgraph (a) is in landscape, and satisfies w0 is less than W2, and h0 is equal to H2; Figure 17 The panorama thumbnail in subgraph (b) is in landscape, and satisfies w0 is less than W2, and h0 is greater than H2. That is Figure 17 The distribution rule of the panorama thumbnail satisfies w0 is less than W2, and h0 is greater than or equal to H2, and the width of the subject image exceeds the screen limit, resulting in the subject image being only partially visible, so the leftward control 103 is displayed on the left side of the screen boundary box, and the rightward control 104 is displayed on the right side of the screen boundary box, and in this mode, the bidirectional orientation control is displayed. The user triggers the leftward control 103 or clicks the left key of the remote controller, which is equivalent to moving the whole subject image to the right, so that the invisible region of the left part of the subject image gradually enters the screen display range; the user triggers the rightward control 104 or clicks the right key of the remote controller, which is equivalent to moving the whole subject image to the left, so that the invisible region of the right part of the subject image gradually enters the screen display range, thereby adjusting the visible region of the subject image.

[0147] In some embodiments, Figure 18 Subgraph (a) satisfies w0 is greater than W2, and h0 is less than H2; Figure 18 Subgraph (b) satisfies w0 is equal to W2, and h0 is less than H2, that is Figure 17 The distribution rule of the panorama thumbnail satisfies w0 is greater than or equal to W2, and h0 is less than H2, and the height of the subject image exceeds the screen limit, resulting in the subject image being only partially visible, so the upward control 101 is displayed on the upper side of the screen boundary box, and the downward control 102 is displayed on the lower side of the screen boundary box, and in this mode, the bidirectional orientation control is displayed. The user triggers the upward control 101 or clicks the up key of the remote controller, which is equivalent to moving the whole subject image downward, so that the invisible region of the upper part of the subject image gradually enters the screen display range; the user triggers the downward control 102 or clicks the down key of the remote controller, which is equivalent to moving the whole subject image upward, so that the invisible region of the lower part of the subject image gradually enters the screen display range, thereby adjusting the visible region of the subject image.

[0148] In some embodiments, Figure 19When w0 is less than W2 and h0 is less than H2, i.e., the width and height of the main image exceed the screen limit, the main image is only partially visible, and therefore the up control 101 is displayed on the upper side of the screen boundary box, the down control 102 is displayed on the lower side of the screen boundary box, the left control 103 is displayed on the left side of the screen boundary box, and the right control 104 is displayed on the right side of the screen boundary box, thereby displaying four directional controls. By triggering any directional control or any direction key on the remote controller, the invisible area on any side of the main image can be gradually adjusted into the screen display range.

[0149] In some embodiments, for the scenario of Figures 17-19 When the main image has invisible areas, the image zoom interface further displays second prompt information for guiding the user to adjust the visible area of the main image by inputting a second preset operation, which can be triggering a directional control in the image zoom interface or clicking a direction key on the remote controller. For example, the second prompt information is “click the direction key on the interface or the remote controller to adjust the visible area of the image”. The second prompt information can be cancelled after the user clicks the specified direction key on the interface or the remote controller, or the second prompt information can be automatically cancelled after the display time reaches a preset length, thereby avoiding the influence of the second prompt information on the user's browsing of the image.

[0150] In some embodiments, as shown in the example of Figure 20 When the user inputs the second preset operation to adjust the visible area of the image, the second preset operation indicates the directional information, and the main image is moved in the opposite direction. For example, the user triggers the up control 101 and the up key on the remote controller, the second preset operation indicates the direction “up”, and the main image needs to be moved downward as a whole. The display device can set a first preset step length, which is used to represent the moving distance of the main image when the directional control or the direction key on the remote controller is triggered once. If the user long-presses the directional control or the direction key on the remote controller, the moving distance of the main image is continuously accumulated according to the first preset step length.

[0151] In some embodiments, referring to Figure 20When the user inputs the second preset operation to adjust the image visible region, not only the subject image 141 needs to be moved, but also the screen boundary frame 143 needs to be moved synchronously, presenting a linkage effect of the subject image and the screen boundary frame, but the moving directions of the two are opposite. The screen boundary frame moves in the same direction as indicated by the second preset operation. For example, if the user triggers the up control 101 and the up key of the remote controller, the direction indicated by the second preset operation is "up", and the screen boundary frame needs to be moved upward as a whole. The display device can set a second preset step length, which is used to represent the moving distance of the screen boundary frame when the direction key of the remote controller is triggered once. The first preset step length and the second preset step length can form a mapping relationship. Alternatively, the second preset step length can be calculated according to the first preset step length and a preset ratio. If the user long-presses the direction key of the remote controller, the moving distance of the screen boundary frame is accumulated continuously according to the second preset step length.

[0152] In some embodiments, referring to the example of Figures 17-19 , for the scenario that the subject image has an invisible region, if the user does not adjust the image visible region, the subject image and the screen share a common center point (i.e., the center points coincide), and the panoramic thumbnail / panoramic viewfinder and the screen boundary frame also share a common center point. Once the user inputs the second preset operation to adjust the image visible region, the above common center point state is broken, and the center points are misaligned: from a global perspective, the screen center point does not change, and the center point of the subject image moves in the opposite direction according to the first preset step length; from a zoomed-in perspective, the center point of the panoramic thumbnail / panoramic viewfinder does not change, and the center point of the screen boundary frame moves in the same direction according to the second preset step length. This embodiment realizes the dynamic positioning of the subject image and the screen boundary frame when switching the image visible region, and realizes the accurate transformation of the image zooming interface.

[0153] The above embodiments take the zoomed image from the U disk as an example, but the premise is to ensure that the U disk is in a mounted state. If the U disk is unexpectedly disconnected from the USB interface, or the user forcibly removes the U disk due to misoperation, it will not only affect the U disk image playback, but also cause the resources (such as image processing, UI, etc.) occupied by the image player to be unable to release. When the display device plays other media or switches to other signal channels, it may appear playback abnormal problems such as black screen, and often needs to be restarted to recover. As a scenario, due to the pluggable nature of external storage devices, if the display device is playing a media file (not limited to images, videos, audios, etc.) from an external storage device, if the external storage device suddenly changes to an unmounted state, the current media file needs to be stopped immediately, and the related resources occupied by it need to be released.

[0154] In some embodiments, the display device can detect the mounting / demounting action of the external storage device according to the connection state of the external interface. When the external interface (e.g. USB) is switched from the unconnected state to the connected state, it indicates that the external storage device is mounted. When the external interface is switched from the connected state to the unconnected state, it indicates that the external storage device is demounted.

[0155] In some embodiments, Figure 21 A first media playing processing method is provided, which is executed by the controller 250 and includes the following program steps:

[0156] In step S211, the demounting event of the external storage device is listened to, and the target interface playing the media data from the external storage device is queried.

[0157] In step S212, the target interface is closed, and the related playing resources occupied by the media data are released.

[0158] The target interface is not limited to the front-end UI interface associated with the media playing process such as the image player, the video player, the audio player, and the text reader. That is, as long as it is determined that the media is currently playing and the media file is from the external storage device path, the media playing interface is immediately closed, and the underlying playing resources occupied by the media are released, so as to avoid the influence on the subsequent media playing.

[0159] In some embodiments, Figure 22 A second media playing processing method is provided, which is executed by the controller 250 and includes the following program steps:

[0160] In step S221, the demounting event of the external storage device is listened to, and the current interface stack is obtained.

[0161] Optionally, from the UI perspective, the interface manager can create and maintain a plurality of display interface layers layer i , where subscript i is used to represent the layer level of the display interface layer, 1≤i≤N, N display interface layers are arranged in layers from top to bottom, thereby forming an interface stack, N is the total number of display interface layers contained in the interface stack, and the display interface layer at the top of the interface stack is the current visible layer, and other display interface layers can be covered. The interface stack is dynamic and updatable. When a new interface display layer A is created, the interface display layer A is added to the interface stack, and when a user closes an interface display layer B, the interface display layer B is deleted from the interface stack.

[0162] Optionally, the interface stack also records the path information and the interface category corresponding to the display interface layer layer i , where the path information is used to indicate the display interface layer layer iThe source of the displayed content, such as a USB drive path, local disk path, network path (e.g., expressed as a URL, URI, etc.); the interface category and display interface layer. i The content displayed is related to, but is not limited to, the homepage (Launcher), application pages, settings pages, and media playback interfaces.

[0163] Step S222: Traverse the interface stack in a top-down order and select M target interfaces that are playing media data from an external storage device from the interface stack.

[0164] Step S223: Determine if M is zero. Where 0≤M≤N, if M=0, it means there is no media data currently playing, or the media data currently playing is not from an external storage device, then proceed to step S225; if 0<M≤N, it means there is media data in the playback interface playing from an external storage device, then proceed to step S224.

[0165] Step S224: Close the M target interfaces and release the playback resources occupied by the media data played on the M target interfaces.

[0166] Step S225: The display device maintains its current state.

[0167] In some embodiments, Figure 23 A third media playback processing method is provided, which is executed by the controller 250 and includes the following program steps:

[0168] Step S231: Listen for the unloading event of the external storage device and obtain the current interface stack.

[0169] Step S232: Query the current display interface layer. i Does it include the associated settings page?

[0170] You can choose to start from i=1 and screen each display interface layer from top to bottom until the interface stack traversal is complete. The associated settings page is a function settings interface associated with the path to the external storage device read from the unload event, such as the current display interface layer. i To play images from a USB drive, Figure 9 The example zoom mode settings page is a type of related settings page; another example is the currently displayed interface layer. i When playing video files from an external hard drive, the video playback settings menu is also a type of associated settings page; similarly, when a user configures settings for an external storage device, that settings page is also a type of associated settings page. If the currently displayed interface layer... iIf the current display interface layer layer i does not include the associated setting page, step S234 is performed.

[0171] In step S233, after saving the function setting information in the associated setting page, the display is controlled to close the current display interface layer layer i and delete the current display interface layer layer i from the interface stack. The function setting information is a state setting value related to the associated setting page, for example, the state setting value of the zoom mode "200%" is cached in a variable before the zoom mode setting page is closed, so that the default zoom mode is 200% when the image in the U disk is played next time. After step S233, step S2310 is performed. Figure 9

[0172] In step S234, it is inquired whether the current display interface layer layer i includes a play interface.

[0173] The play interface is a play or browse interface of media files such as images, videos and audios. If the current display interface layer layer i includes the play interface, step S235 is performed; if the current display interface layer layer i does not include the play interface, step S239 is performed.

[0174] In step S235, it is inquired where the play data in the play interface comes from.

[0175] In step S236, the second path corresponding to the external storage device is read from the unloading event.

[0176] In step S237, it is judged whether the first path and the second path match.

[0177] If the first path and the second path match, it is indicated that the play data in the current display interface layer layer i comes from the external storage device, so the current display interface layer layer i is identified as the target interface, and step S238 is performed; if the first path and the second path do not match, it is indicated that the play data in the current display interface layer layer i does not come from the external storage device, so the current display interface layer layer i is not the target interface, and the unloading of the external storage device does not affect the play of the current display interface layer layer i , and step S239 is performed.​

[0178] Step S238, control the display to close the current display interface layer layer i , and delete the current display interface layer layer i from the interface stack, while releasing the playing resource occupied by the on-air data of the current display interface layer layer i . After step 238, jump to step S2310. Among them, for step S233 and step S238, taking the UI of Figure 9 as an example, if the current display interface layer layer i simultaneously includes the setting page associated and the playing interface of the media file,

[0179] Step S239, retain the current display interface layer layer i . After step 239, jump to step S2310.

[0180] Step S2310, detect whether the traversal layer number is N. If the traversal layer number is N, that is, the interface stack is traversed completely, then the flow ends; if the traversal layer number is less than N, then execute step S2311.

[0181] Step S2311, i=i+1, and return to step S232.

[0182] That is, the value of i is accumulated by 1, and then according to the processing logic of step S232-step S239, continue to identify whether the next layer display interface layer is the target interface, until the traversal layer number is N, that is, after the identification and screening of the display interface layer at the bottom layer are completed, the flow ends. The present application traverses from the top layer of the interface stack to the bottom layer, that is, the value of i gradually increases from 1 to N, and the processing logic is executed for N times in total, so as to screen out, close and release the playing interface of the media file from the external storage device and the setting page associated in the interface stack layer by layer, so as to ensure the effective use and distribution of the playing resource, and avoid the playing abnormal problem.

[0183] The display device can listen to the plugging and unplugging actions of the external storage device. When the external storage device is unloaded, the display device needs to detect whether there is a media file from the external storage device being played. Considering that the display can maintain multiple UI interfaces at the same time, the target interface that meets the aforementioned judgment condition is screened from the interface stack. The media playing of the target interface will be affected by the unloading action of the external storage device. Therefore, the target interface needs to be closed, and the underlying resources occupied by the media data played by the target interface are released, such as audio and video decoding resources, audio output channels, video display channels, and the like. Therefore, when playing other media or switching other playing channels, the playing is not affected, and problems such as black screen and other playing abnormalities do not occur. Thus, the media playing performance in the scenario of plugging and unplugging the external storage device is improved, and the user experience of watching media is improved. When the external storage device is mounted, the display device can play the image in the external storage device, and execute the aforementioned image zooming scheme two, so that the user can view the zoomed main image and synchronously view the overall image through the window. Based on the size and position distribution of the screen boundary box, the corresponding orientation control is used to enable the user to accurately master the visible area and invisible area of the current image, and dynamically adjust the visible area of the main image. The image zooming function and user experience are optimized.

[0184] Figures 21-23 The above description is from the perspective of the controller, and describes a media playing processing scheme in the scenario of unloading of the external storage device. In other embodiments, such as Figure 24 The underlying processing logic of the media playing of the example involves a media center application, a UI layer, and a media player.

[0185] In some embodiments, with reference to Figure 24 , the user starts the media center application, and the media center application initializes the DeviceSourceManager (device resource manager). In the initialization process, the DeviceSourceManager registers to listen to the state notifications of the external storage device, including the Mounted notification, the Unmounted notification, and the Eject notification. The Mounted notification is broadcast after the external storage device is inserted into the corresponding interface, and is used to indicate that the external storage device is in the mounted state. The Unmounted notification is broadcast after the user normally ejects the external storage device, and is used to indicate that the external storage device is in the unmounted state due to normal ejection. The Eject notification is broadcast when the external storage device is unexpectedly separated from the interface or the user forcibly ejects the external storage device due to misoperation, and is used to indicate that the external storage device is in the unmounted state due to abnormal ejection. When the external storage device is inserted, ejected, or unplugged, the DeviceSourceManager listens to the corresponding state notification and immediately transfers it to the media center application.

[0186] In some embodiments, with reference to Figure 24, the user inserts the external storage device, the media center application receives the Mounted notification, the control UI layer automatically fills the path of the external storage device in the file selection page, the user can specify the path as the external storage device, and select the media file to be played or browsed from the external storage device, then the media center application sends a play instruction to the corresponding media player, and the media play instruction can include the file identifier of the media file; the media player responds to the play instruction, obtains the media file corresponding to the file identifier from the external storage device, and performs play control on the media file.

[0187] In some embodiments, with reference to Figure 24 , the user ejects the external storage device, the media center application receives the Eject notification, the path information (for example, / storage / 5ACE-ABCD) of the external storage device is written in the Eject notification, the DeviceSourceManager processes and encapsulates the Eject notification, and then forwards it to the UIActivityManger (interface manager) of the media center application; after the UIActivityManger receives the callback Eject notification, the onDeviceRemoved processing function is called to start the media play processing logic during the unloading of the external storage device.

[0188] In some embodiments, with reference to Figure 23 , the UIActivityManger first queries whether there is an associated interface in the media center application to display in the foreground of the UI layer, that is, whether the media center application is running in the foreground. If the media center application is running in the foreground, the UIActivityManger obtains the interface stack maintained by itself, traverses the interface stack in top-down order, and screens out the target interface layer layer by layer, the target interface layer includes the play interface and / or the associated setting page matching the external storage device, the traversal and screening method of the interface stack can refer to the example of Figure 24 , which will not be described here.

[0189] In some embodiments, with reference to ​For example, the target interface layers screened by the UIActivityManger include layer 1 and layer 3, where layer 1 plays a video file in an external storage device, and layer 3 is a setting page associated with the external storage device. The UIActivityManger sends a first instruction to the UI layer, where the first instruction includes the interface layer identifiers corresponding to layer 1 and layer 3. Meanwhile, the media center application sends a second instruction to the media player corresponding to layer 1. The UI layer closes the display interface layers corresponding to layer 1 and layer 3 in response to the first instruction, and then sends a closing success indication to the UIActivityManger. The UIActivityManger deletes layer 1 and layer 3 from the interface stack in response to the closing success indication. Synchronously, the media player stops the media playing process, releases the relevant resources occupied by itself, and completes resource resetting in response to the second instruction, thereby avoiding subsequent playing abnormal problems.

[0190] For the media playing processing scheme in the external storage device uninstallation scenario, the user can first start the media center application and select a media file to be played in the file selection page in the application, or the user can also open the media file through a specified access entrance, for example, the user previews the U disk directory and clicks a media file, and then the media center application is automatically started, and a player of a media type matched with the media file is pulled up to complete the playing of the media file. When the uninstallation action of the U disk is listened to, the media playing processing logic in the scenario is triggered, the interface stack is traversed, and all the interfaces in the stack that affect the subsequent media playing are closed and the underlying resources occupied by the invalid interfaces are released. In addition, the underlying architecture and program configuration of the media playing processing logic are not limited to the examples of the present application.

[0191] In some embodiments, the UIActivityManger screens the target interface layers layer by layer from top to bottom when traversing the interface stack. One target interface layer can be immediately closed and the resources occupied by the target interface layer can be released after the target interface layer is screened, that is, the layer-by-layer screening and immediate processing are realized. Alternatively, the M target interface layers screened can be uniformly closed and the underlying resources can be released after the traversal of the interface stack is completed, that is, the layer-by-layer screening and centralized processing are realized.

[0192] It should be understood that the image display and zooming UI interaction provided by the present application is only exemplary, and the actual product design and application should be used as the reference. The image zooming display scheme of the present application can be modified and extended according to the image size, image aspect ratio, image screen orientation (landscape or portrait), screen resolution, diversified zooming mode, and other multiple factors, to adapt to other feasible schemes. The mapping relationship between the global and the zoomed image during zooming and the UI display effect can be more richly and flexibly set, and the number and category of the zooming modes are not limited to the examples of the embodiments of the present application.

[0193] In some embodiments, the present application further provides a computer storage medium which can store a program. When the computer storage medium is located in the display device 200, the program is executed to include the program steps involved in the image zooming display method and the media playing processing method when the external storage device is unloaded. The computer storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0194] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions recorded in the above embodiments, or make equivalent replacement for part or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

[0195] For the convenience of explanation, the above description has been made in combination with specific embodiments. However, the above exemplary discussion is not intended to exhaust or limit the embodiments to the specific forms disclosed above. Various modifications and variations can be derived according to the above teachings. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different modified embodiments suitable for specific use considerations.

Claims

1. A display device, characterized by comprising: The application comprises: an external interface for connecting an external storage device; a display for displaying a user interface; a controller configured to perform: listening to an unmounting event of the external storage device, querying a target interface playing media data, and the media data coming from a path of the external storage device; closing the target interface and releasing playing resources occupied by the media data; if detecting that a current display interface layer includes an associated setting page, saving function setting information in the associated setting page, wherein the associated setting page is a function setting interface associated with the path of the external storage device read from the unmounting event; closing the associated setting page.

2. The display device of claim 1, wherein, The controller is configured to query the target interface in the following manner: obtaining a current interface stack, the interface stack including N display interface layers; traversing the interface stack in a top-down order and screening M target interfaces from the interface stack, 0≤M≤N.

3. The display device of claim 2, wherein, The controller is configured to query the target interface in the following manner: if detecting that a current display interface layer includes a playing interface for playing media data, querying a first path from which data in the playing interface is played; reading a second path corresponding to the external storage device from the unmounting event; if the first path matches the second path, identifying the playing interface as the target interface.

4. The display device of claim 3, wherein, The controller is further configured to perform: if the first path does not match the second path, keeping the current display interface layer and jumping to a next display interface layer to identify whether the next display interface layer is the target interface.

5. The display device of claim 1, wherein, The controller is further configured to perform: if a media type played by a current display interface layer is an image, displaying an image zoom interface in response to an image zoom instruction; wherein the image zoom interface displays a main image and a panoramic view window, the main image being obtained by zooming a current image according to a magnification indicated by a current zoom mode, and the panoramic view window displaying a full view of the current image in a small window form.

6. The display device of claim 5, wherein, The controller is further configured to display the image zoom interface in the following manner: zooming the current image according to an original size of the current image and a preset ratio to obtain a panoramic thumbnail, and filling the panoramic thumbnail into the panoramic view window; generating and displaying a screen boundary box according to a screen resolution, the preset ratio and the current zoom mode; the screen boundary box being used to frame a display area of the screen.

7. The display device of claim 6, wherein, The controller is further configured to generate the panoramic view window in the following manner: comparing sizes of the panoramic thumbnail and the screen boundary box; if a width of the panoramic thumbnail is greater than a width of the screen boundary box, displaying a leftward control on a left side of the screen boundary box and a rightward control on a right side of the screen boundary box; and / or, if a height of the panoramic thumbnail is greater than a height of the screen boundary box, displaying an upward control on an upper side of the screen boundary box and a downward control on a lower side of the screen boundary box.

8. The display device of claim 7, wherein, The controller is further configured to perform: In response to a first preset operation, the scaling mode is switched in sequence, and the size of the screen boundary frame is adaptively adjusted according to the switched scaling mode; In response to a second preset operation of adjusting the image visible area, the main body image is moved in the opposite direction according to the direction indicated by the second preset operation and at a first preset step size, and the screen boundary frame is moved in the same direction within the panoramic window according to a second preset step size, wherein the second preset step size is calculated according to the first preset step size and the preset ratio.

9. A media playback processing method, characterized by, The method comprises: Listening to an unloading event of an external storage device, querying a target interface that is playing media data and that comes from the external storage device; Closing the target interface and releasing the playing resource occupied by the media data; If it is detected that the current display interface layer includes an associated setting page, saving the function setting information in the associated setting page, wherein the associated setting page is a function setting interface associated with the path of the external storage device read from the unloading event; Closing the associated setting page.

Images