Display device and method for presenting a dynamic painting

Abstract

The application provides a display device and a display method of a dynamic picture. In a first mode, if a target art picture in an immersive atmosphere category is detected to be played, the display device can determine the target art picture as a dynamic picture. The display device displays the target art picture by playing a video file corresponding to the target art picture. The video file has a limited time length. In order to realize loop playing of the video file and avoid pause and black insertion during loop playing, after decoding audio data and video data, the display time stamp of an audio frame and a video frame is modified to realize loop display of each audio / video frame, and the display time stamp of the same audio / video frame in each loop is ensured to match the video time length to realize seamless loop playing.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a dynamic artwork display method. BACKGROUND

[0002] A display device refers to a terminal device capable of outputting a specific display picture, and can be a smart television, a mobile terminal, a smart advertising screen, a projector, or the like. Taking a smart television as an example, a smart television is based on Internet application technology, has an open operating system and a chip, has an open application platform, and has a bidirectional man-machine interaction function, and integrates audio, video, entertainment, data, and other functions into one, and is used to meet the diversified and personalized needs of users.

[0003] Generally, a user mainly uses a display device as a device with a video and audio playback function. In order to more fully develop the use value of the display device, a first application can be configured for the display device to provide a first mode through the first application. The first application can also be referred to as an art application, an art mode application, or the like. The first mode can also be referred to as an art mode, a gallery mode, or the like. In the first mode, the display device can display an art painting as a decoration in a space. Moreover, the art painting can be simulated as a real art painting, so that the user can immerse in the art painting. For example, a paper-like screen or the like is used as a display screen or the like.

[0004] In the first mode, the display effect of the art painting is an important factor affecting the user experience. Therefore, ensuring the display effect and display quality of the art painting is the most important issue for the art mode application. SUMMARY

[0005] The present application provides a display device and a dynamic artwork display method to improve the display effect and display quality of the art painting.

[0006] In a first aspect, the present application provides a display device, comprising:

[0007] a controller configured to:

[0008] a controller configured to:

[0009] In the first mode, a target art painting in the immersive atmosphere category is listened to, a video file corresponding to the target art painting is decoded, and audio data and video data are obtained;

[0010] identify that the video file corresponding to the target artwork is in a loop playing mode, calculate, according to a loop number corresponding to a current loop and a clip source length of the video file, a first display timestamp of each audio frame in the audio data in the current loop and a second display timestamp of each video frame in the video data in the current loop;

[0011] control the display to loop play the video file corresponding to the target artwork in a display page of the first application, wherein, in each loop playing process, a corresponding audio frame is played according to the first display timestamp, and a corresponding video frame is displayed according to the second display timestamp.

[0012] In some embodiments of the present application, the clip source length of the video file is a maximum value in the display timestamps of the audio frames in the audio data, a maximum value in the display timestamps of the video frames in the video data, and a maximum value in the video lengths in the file descriptions.

[0013] In some embodiments of the present application, the controller, when identifying that the video file corresponding to the target artwork is in a loop playing mode, calculates, according to a loop number corresponding to a current loop and a clip source length of the video file, a first display timestamp of each audio frame in the audio data in the current loop and a second display timestamp of each video frame in the video data in the current loop, is configured to:

[0014] After the first display timestamp and the second display timestamp are calculated each time, it is judged whether the decoding of the video file has been completed;

[0015] If not, the decoding of the video file is continued;

[0016] If yes, the loop number is increased by 1, and the video file is re-decoded.

[0017] In some embodiments of the present application, the controller controls the display to loop play the video file corresponding to the target artwork in a display page of the first application, and is configured to:

[0018] Lock a thread with a faster rendering speed between an audio thread for rendering the audio data and a video thread for rendering the video data;

[0019] After the audio thread and the video thread are synchronized, the thread with the faster rendering speed is unlocked.

[0020] In some embodiments of the present application, after the controller locks the thread with the faster rendering speed between the audio thread for rendering the audio data and the video thread for rendering the video data, the controller is further configured to:

[0021] When it is detected that the target artwork is exited from the display, or it is detected that the video file is re-decoded, the thread with faster rendering speed is unlocked.

[0022] In some embodiments of the present application, the controller controls the display to play the video file corresponding to the target artwork in a loop in the display page of the first application, and is configured to:

[0023] When the clock of the audio is the master clock, if it is detected that the speed of writing the audio data in the audio thread is too fast, the clock of the video is switched to be the master clock.

[0024] When it is detected that the speed of writing the audio data in the audio thread is within a speed range, the audio thread and the video thread are synchronized, the out-of-sync part of the audio data is discarded, and the clock of the audio is switched to be the master clock.

[0025] In some embodiments of the present application, the controller, in the first mode, detects that the target artwork in the immersive atmosphere category is played, decodes the video file corresponding to the target artwork to obtain audio data and video data, and is configured to:

[0026] Identify the mute data in the beginning and the end of the audio data.

[0027] If the length of the mute data is less than a mute length, the mute data is removed from the audio data, and the data corresponding to the mute data is removed from the video data.

[0028] If the length of the mute data is greater than or equal to the mute length, the mute data is kept.

[0029] In a second aspect, the present application also provides a display method of a dynamic artwork, applied to the display device of any one of the second aspect.

[0030] The method comprises:

[0031] In the first mode, the target artwork in the immersive atmosphere category is detected to be played, and the video file corresponding to the target artwork is decoded to obtain audio data and video data.

[0032] When it is identified that the video file corresponding to the target artwork is in a loop playing mode, the first display timestamp of each audio frame in the audio data in the current round and the second display timestamp of each video frame in the video data in the current round are calculated according to the loop number corresponding to the current round and the clip source length of the video file.

[0033] In the display page of the first application, the video file corresponding to the target artwork is played in a loop, wherein, in each round of playing, the corresponding audio frame is played according to the first display timestamp, and the corresponding video frame is displayed according to the second display timestamp.

[0034] In some embodiments of the present application, the playing of the video file corresponding to the target artwork in the display page of the first application comprises:

[0035] locking the thread with a faster rendering speed between the audio thread for rendering the audio data and the video thread for rendering the video data;

[0036] after the synchronization of the audio thread and the video thread, unlocking the thread with the faster rendering speed.

[0037] In some embodiments of the present application, the decoding of the video file corresponding to the target artwork in the first mode to obtain the audio data and the video data comprises:

[0038] identifying the mute data in the beginning and the end of the audio data;

[0039] if the duration of the mute data is less than the mute duration, removing the mute data from the audio data and the data corresponding to the mute data from the video data;

[0040] if the duration of the mute data is greater than or equal to the mute duration, keeping the mute data.

[0041] In the first mode, if the display device listens to the target artwork to be played in the immersive atmosphere category, it can determine the target artwork as a dynamic artwork. The display device displays the target artwork by playing the video file corresponding to the target artwork. The duration of the video file is limited. In order to realize the loop playing of the video file and avoid the pause and black insertion during the loop playing, after the decoding of the audio data and the video data, the display time stamps of the audio frames and the video frames are modified to realize the loop display of the audio and video frames, and the display time stamp of the same audio and video frame in each loop is matched with the video duration to realize the seamless loop playing effect. BRIEF DESCRIPTION OF DRAWINGS

[0042] In order to more clearly illustrate the technical solutions of the present application, the following will briefly introduce the drawings needed in the embodiments. Obviously, for those skilled in the art, other drawings can also be obtained without creative labor on the basis of these drawings.

[0043] Figure 1 Fig. 1 is a schematic diagram of an operating scenario between a display device and a control device in an embodiment of the present application;

[0044] Figure 2 Fig. 2 is a hardware configuration block diagram of the control device 100 in an embodiment of the present application;

[0045] Figure 3 Fig. 3 is a hardware configuration block diagram of the display device 200 in an embodiment of the present application;

[0046] Figure 4 Fig. 4 is an operating system configuration diagram of the display device 200 in an embodiment of the present application;

[0047] Figure 5 Fig. 5 is a flowchart of the display device 200 displaying a showcase page in an embodiment of the present application;

[0048] Figure 6 Fig. 6 is a flowchart of the display device 200 quickly switching the displayed art works in an embodiment of the present application;

[0049] Figure 7 Fig. 7 is a flowchart of the display device 200 processing a target art work in an embodiment of the present application;

[0050] Figure 8 Fig. 8 is a flowchart of the display device 200 displaying an art work corresponding to a target art work in an embodiment of the present application;

[0051] Figure 9 Fig. 9 is a flowchart of the display device 200 obtaining a target art work with a three-dimensional frame effect in an embodiment of the present application;

[0052] Figure 10 Fig. 10 is a schematic diagram of the display device 200 synthesizing a target art work with a three-dimensional frame effect in an embodiment of the present application;

[0053] Figure 11 Fig. 11 is a flowchart of the display device 200 dynamically adding a frame to a target art work in an embodiment of the present application;

[0054] Figure 12 Fig. 12 is a schematic diagram of the display device 200 with an installed hardware frame in an embodiment of the present application;

[0055] Figure 13 Fig. 13 is a flowchart of the display device 200 dynamically adding a frame to a target art work in an embodiment of the present application;

[0056] Figure 14 Fig. 14 is a flowchart of the display device 200 displaying an art work in a showcase page in an embodiment of the present application;

[0057] Figure 15FIG. 6 is a schematic diagram of a change process of a display page in an embodiment of the present application;

[0058] Figure 16 FIG. 7 is a schematic diagram of displaying a lower definition art work in an embodiment of the present application;

[0059] Figure 17 FIG. 8 is a flowchart of adjusting a screen orientation of a display screen when displaying an art work by a display device 200 in an embodiment of the present application;

[0060] Figure 18 FIG. 9 is a schematic diagram of an adjustment process of a display screen in an embodiment of the present application;

[0061] Figure 19 FIG. 10 is a flowchart of adjusting a screen orientation of a display screen and displaying an art work corresponding to a target art work by a display device 200 in an embodiment of the present application;

[0062] Figure 20 FIG. 11 is a schematic diagram of a change process of a display screen and a target art work in an embodiment of the present application;

[0063] Figure 21 FIG. 12 is a flowchart of adjusting a screen orientation of a display screen and displaying an art work corresponding to a target art work by a display device 200 in an embodiment of the present application;

[0064] Figure 22 FIG. 13 is a schematic diagram of a change process of a display screen and a target art work in an embodiment of the present application;

[0065] Figure 23 FIG. 14 is a flowchart of zooming in a target art work by a display device 200 in an embodiment of the present application;

[0066] Figure 24 FIG. 15 is a schematic diagram of zooming in a target art work in an embodiment of the present application;

[0067] Figure 25 FIG. 16 is a flowchart of switching a zoomed-in position by a display device 200 in an embodiment of the present application;

[0068] Figure 26 FIG. 17 is a flowchart of zooming in a target art work by a display device 200 in an embodiment of the present application;

[0069] Figure 27 FIG. 18 is a flowchart of implementing a holiday theme function by a display device 200 in an embodiment of the present application;

[0070] Figure 28 FIG. 19 is a schematic diagram of a hierarchical preview page in an embodiment of the present application;

[0071] Figure 29 FIG. 20 is a schematic diagram of a hierarchical preview page in an embodiment of the present application;

[0072] Figure 30 Flowchart for the display device 200 entering the hierarchical preview page in an embodiment of the present application;

[0073] Figure 31 Flowchart for the display device 200 displaying the hierarchical preview page according to the first art work in an embodiment of the present application;

[0074] Figure 32 Schematic diagram of the hierarchical preview page in an embodiment of the present application;

[0075] Figure 33 Schematic diagram of the hierarchical preview page in an embodiment of the present application;

[0076] Figure 34 Schematic diagram of the hierarchical preview page in an embodiment of the present application;

[0077] Figure 35 Schematic diagram of the hierarchical preview page in an embodiment of the present application;

[0078] Figure 36 Schematic diagram of the hierarchical preview page in an embodiment of the present application;

[0079] Figure 37 Flowchart for the display device 200 updating the preview picture list in response to the user's selection of the first-level category in an embodiment of the present application;

[0080] Figure 38 Schematic diagram of the hierarchical preview page in an embodiment of the present application;

[0081] Figure 39 Flowchart for the display device 200 updating the preview picture list in response to the user's selection of the second-level category in an embodiment of the present application;

[0082] Figure 40 Schematic diagram of the hierarchical preview page in an embodiment of the present application;

[0083] Figure 41 Flowchart for the display device 200 switching the art works displayed in the display page in an embodiment of the present application;

[0084] Figure 42 Schematic diagram of the hierarchical preview page in an embodiment of the present application;

[0085] Figure 43 Flowchart for the display device 200 switching the art works displayed in the display page in an embodiment of the present application;

[0086] Figure 44 Schematic diagram of the hierarchical preview page in an embodiment of the present application;

[0087] Figure 45FIG. 6 is a flowchart illustrating a process of displaying a photo according to an embodiment of the disclosure;

[0088] Figure 46 FIG. 7 is a flowchart illustrating a process of displaying a photo according to an embodiment of the disclosure;

[0089] Figure 47 FIG. 8 is a flowchart illustrating a process of displaying a photo according to an embodiment of the disclosure;

[0090] Figure 48 FIG. 9 is a flowchart illustrating a process of displaying a photo according to an embodiment of the disclosure;

[0091] Figure 49 FIG. 10 is a flowchart illustrating a process of displaying a photo according to an embodiment of the disclosure;

[0092] Figure 50 FIG. 11 is a flowchart illustrating a process of displaying a photo according to an embodiment of the disclosure;

[0093] Figure 51 FIG. 12 is a flowchart illustrating a process of displaying a photo according to an embodiment of the disclosure;

[0094] Figure 52 FIG. 13 is a flowchart illustrating a process of displaying a photo according to an embodiment of the disclosure;

[0095] Figure 53 FIG. 14 is a flowchart illustrating a process of displaying a photo according to an embodiment of the disclosure;

[0096] Figure 54 FIG. 15 is a flowchart illustrating a process of displaying a photo according to an embodiment of the disclosure;

[0097] Figure 55 FIG. 16 is a flowchart illustrating a process of displaying a photo according to an embodiment of the disclosure;

[0098] Figure 56 FIG. 17 is a flowchart illustrating a process of displaying a photo according to an embodiment of the disclosure;

[0099] Figure 57 FIG. 18 is a flowchart illustrating a process of displaying a photo according to an embodiment of the disclosure;

[0100] Figure 58 FIG. 19 is a flowchart illustrating a process of displaying a photo according to an embodiment of the disclosure;

[0101] Figure 59 FIG. 20 is a flowchart illustrating a process of displaying a photo according to an embodiment of the disclosure;

[0102] Figure 60 FIG. 21 is a flowchart illustrating a process of displaying a photo according to an embodiment of the disclosure;

[0103] Figure 61 a schematic diagram of the first artwork information in an embodiment of the present application;

[0104] Figure 62 a flowchart of the display device 200 changing the font color of the artwork information in an embodiment of the present application;

[0105] Figure 63 a flowchart of the display device 200 displaying the artwork information of the artwork currently displayed in the showcase page in the hierarchical preview page in an embodiment of the present application;

[0106] Figure 64 a schematic diagram of the first artwork information in an embodiment of the present application;

[0107] Figure 65 a flowchart of the display device 200 dynamically displaying and hiding the artwork information in an embodiment of the present application;

[0108] Figure 66 a schematic diagram of the flow of dynamically displaying and hiding the artwork information in an embodiment of the present application;

[0109] Figure 67 a schematic diagram of the hierarchical preview page in an embodiment of the present application;

[0110] Figure 68 a schematic diagram of the hierarchical preview page in an embodiment of the present application;

[0111] Figure 69 a schematic diagram of the hierarchical preview page in an embodiment of the present application;

[0112] Figure 70 a flowchart of the display device 200 setting the artwork information of the artwork in an embodiment of the present application;

[0113] Figure 71 a schematic diagram of the custom page in an embodiment of the present application;

[0114] Figure 72 a flowchart of the display device 200 displaying the dynamic artwork in an embodiment of the present application;

[0115] Figure 73 a flowchart of the display device 200 playing the video file in a loop in an embodiment of the present application;

[0116] Figure 74 a flowchart of the display device 200 processing the mute data in an embodiment of the present application;

[0117] Figure 75 a flowchart of the display device 200 ensuring the audio-artwork synchronization of the dynamic artwork in an embodiment of the present application;

[0118] Figure 76Flowchart for audio-visual synchronization of display device 200 in embodiments of the present application. DETAILED DESCRIPTION

[0119] The embodiments will be described in detail with reference to the drawings, wherein the following described embodiments are examples of implementation of the present application. Unless otherwise indicated, the same numbers in different drawings indicate the same or similar components. The implementations described in the following embodiments are not meant to represent all implementations consistent with the present application. Rather, they are merely examples of implementations consistent with some aspects of the present application as detailed in the claims.

[0120] It should be noted that the brief description of terms in the present application is only for the convenience of understanding the following described embodiments, and is not intended to limit the implementations of the present application. Unless otherwise indicated, these terms should be understood according to their ordinary and common meanings.

[0121] The terms "first", "second", "third", and the like in the specification and claims of the present application and the above-described drawings are used to distinguish similar or like objects or entities, and do not necessarily mean a specific order or sequence, unless otherwise indicated. It should be understood that the terms used in this way can be interchanged under appropriate circumstances.

[0122] The terms "include" and "have" and any variations thereof are intended to cover but not exclusive inclusion, for example, a product or device including a series of components does not have to be limited to all components clearly listed, but can include other components not clearly listed or inherent to these products or devices.

[0123] In embodiments of the present application, the display device generally refers to a device with picture display and data processing capabilities. For example, the display device includes but is not limited to smart TV, mobile terminal, computer, monitor, advertising screen, wearable device, virtual reality device, augmented reality device, etc.

[0124] Figure 1 The schematic diagram of the operation scenario between the display device and the control device is provided for some embodiments of the present application. As shown in Figure 1 The user can operate the display device 200 through touch operation, voice, control device 100 and mobile terminal 300, as shown in

[0125] As shown in Figure 1 It is also shown in

[0126] The display device 200 can provide a broadcast receiving television function, and can additionally provide a smart network television function supporting a computer function, including but not limited to a network television, a smart television, an Internet protocol television (IPTV), and the like.

[0127] Figure 2 For some embodiments of the present application Figure 1 A hardware configuration block diagram of the control device 100 is provided.

[0128] As shown in Figure 2 The control device 100 can include a controller 110, a communication interface 120, a user input / output interface 130, a memory 140, and a power supply 150.

[0129] The controller 110 can include a processor 111, a RAM (Random Access Memory) 112, a ROM (Read-Only Memory) 113, and a communication bus.

[0130] The communication interface 120 can include at least one of a WiFi chip 121, a Bluetooth module 122, an NFC module 123, and other near field communication modules.

[0131] The user input / output interface 130, wherein the input interface can include at least one of a microphone 131, a touchpad 132, a sensor 133, a key 134, and other input interfaces.

[0132] In some embodiments, the control device 100 can include at least one of the communication interface 120 and the input / output interface 130.

[0133] The memory 140 is configured to store various running programs, data, and applications for driving and controlling the control device 100 under the control of the controller 110. The memory 140 can store various control signal instructions input by the user.

[0134] The power supply 150 is configured to provide operating power support for various elements of the control device 100 under the control of the controller 110.

[0135] The control device 100 is configured with a plurality of keys, and the display device 200 is configured with a key value-function mapping table including a mapping relationship between a key value corresponding to each key on the control device 100 and a corresponding function.

[0136] In some embodiments, the control device 100 is configured with keys including basic keys such as a power key, a number key, a direction key, a volume key, a home key, a back key, and the like. Based on the basic keys, a user can control the display device 100 to implement corresponding basic functions. The control device 100 is also configured with keys including special keys such as a color key and the like. Based on the special keys, a user can control the display device 200 to implement specific functions in different scenarios.

[0137] Figure 3 For some embodiments of the present application Figure 1 A hardware configuration block diagram of the display device 200 is provided.

[0138] In some embodiments, the display device 200 can include at least one of a tuner and demodulator 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a user input interface 280, a memory, a power supply.

[0139] In some embodiments, the communication device 220 is a component for communicating with an external device or a server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 according to different supported communication modes. The communication device 220 can enable the display device 200 to be communicatively connected to the external device or the server 400 through wireless or wired connection.

[0140] In some embodiments, the detector 230 is used to collect signals of external environment or external interaction. For example, the detector 230 includes a light receiver for collecting ambient light intensity, or an image collector such as a camera for collecting external environment scenes, user attributes or user interaction gestures, or a sound collector such as a microphone for receiving external sound.

[0141] In some embodiments, the device interface 240 is used to access external devices.

[0142] In some embodiments, the controller 250 is used to control the overall operation of the display device 200. The controller 250 can include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a power supply processor, a first interface to an n-th interface for input / output, and the like. The controller 250 controls the operation of the display device 200 and responds to user operations through various software control programs stored in the memory.

[0143] In some embodiments, the controller 250 and the tuner demodulator 210 can be located in different devices, i.e., the tuner demodulator 210 can also be located in an external device of the main device where the controller 250 is located, such as an external set-top box, etc.

[0144] In some embodiments, the display 260 is configured to receive image signals output from the controller 250 for display. The display 260 can include display functional components for presenting a picture, and driving components for driving the image display.

[0145] In some embodiments, the user can input user commands through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface 280 can receive the user commands through the GUI.

[0146] In some embodiments, the audio output device 270 can be a native speaker of the display device 200, or an external audio output device connected to the display device 200.

[0147] In some embodiments, the user input interface 280 can be configured to receive instructions from user input.

[0148] In order to perform user interaction, in some embodiments, the display device 200 can run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200.

[0149] The operating system can be a native operating system based on a specific operating platform, a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device 200.

[0150] The operating system can be divided into different modules or levels according to the functions implemented, for example, as shown in FIG. 1, in some embodiments, the system can be divided into four layers, from top to bottom, the Applications layer (referred to as the “application layer”), the Application Framework layer (referred to as the “framework layer”), the system runtime library layer, and the kernel layer. Figure 4

[0151] In some embodiments, the application layer is configured to provide services and interfaces for applications, so that the display device 200 can run applications and interact with users based on the applications. For example, the application layer can include a voice assistant, which provides voice interaction functions, and users can interact with the display device through the voice assistant in the form of voice. ​

[0152] The framework layer can provide an application programming interface (API) and a programming framework for the application program. The application framework layer includes some pre-defined functions. The application framework layer is equivalent to a processing center that decides which application in the application layer to act. The application program can access the resources in the system and obtain the services of the system through the API interface during execution.

[0153] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library included in the system runtime library layer, such as the C / C++ instruction library, to implement the functions of the framework layer.

[0154] In some embodiments, the kernel layer is a functional layer between the hardware and the software of the display device 200. The kernel layer can implement hardware abstraction, multitasking, memory management, and the like.

[0155] It should be noted that the above examples are only a simple division of the functions of the operating system, and do not limit the specific operating system form of the display device 200 in the embodiments of the present application. According to the function of the display device, the type of the operating system, and the like, the number and specific type of the layers included in the operating system can be in other forms.

[0156] Generally, users mainly use the display device as a device with audio and video playback functions. In order to more fully develop the use value of the display device, the display device can be configured with a first application to provide a first mode through the first application. The first application can also be referred to as an art application, an art mode (Art Mode) application, a gallery (Gallery) application, a frame (Frame) application, and the like. The first mode can also be referred to as an art mode, a gallery mode, a frame mode, and the like. In the first mode, the display device can display an art painting as a decoration of the space. Moreover, the art painting can be simulated as a real art painting, so that the user can immerse in the browsing of the art painting. For example, a paper screen or the like is used as a display screen or the like.

[0157] In the embodiments of the present application, the first application is taken as an art mode application, and the first mode is taken as an art mode as an example for specific description.

[0158] In some embodiments, the art paintings provided by the art mode application can be divided into different painting categories according to scenes, picture contents, and the like. In this way, the user can quickly find the art paintings according to different painting categories.

[0159] In some embodiments, the artistic paintings in the same painting category can be further divided into different painting categories. The same painting category can be referred to as a superior painting category, and the painting categories contained therein can be referred to as inferior painting categories. In this way, the user can further quickly search for artistic paintings according to different inferior painting categories in the same superior painting category.

[0160] In the embodiments provided in the present application, the artistic paintings are divided into two levels of painting categories, the superior painting category is the first level category, and the inferior painting category is the second level category. The first level category can include an artistic gallery category, a photo set category, an immersive atmosphere category, a favorite category, etc. The second level categories included in the artistic gallery category can include a landscape category, a figure category, a modern category, a still life category, etc. The second level categories included in the photo set category can include a my photo category and a photo theme category. The second level categories included in the immersive atmosphere category can include an immersive atmosphere category, and the second level categories included in the favorite category can include a favorite category.

[0161] In the artistic mode, the display effect and display quality of the artistic paintings are important factors affecting the user experience, and therefore, ensuring the display effect and display quality of the artistic paintings is the most important issue for the artistic mode application.

[0162] In some embodiments, in order to improve the display effect and display quality of the artistic paintings, reference can be made to the operating system shown in Figure 4 which is configured with a module related to displaying artistic paintings.

[0163] Among them, the picture playing module, the display control module, the key processing module, the playing parameter setting module and the video playing module can be configured in the application layer. The display control module can decode the artistic paintings, call the system picture player to play the artistic paintings, and call the system video player to play the artistic paintings with dynamic effects. The key processing module can receive key events and respond to the key events, such as switching artistic paintings. The playing parameter setting module can set different playing parameters, such as carousel parameters and picture quality parameters, according to different artistic paintings.

[0164] The Phone Window Helper and the Alerm Manager can be configured in the framework layer. The Phone Window Helper can be used to identify the foreground displayed application. The Alerm Manager can be used to control the carousel time.

[0165] The input device driver source code file (Driver / input / input.c) and the input driver (Input Driver) can be configured in the kernel layer. The Input Driver and the Driver / input / input.c can be used to receive the key of the control device 100 and distribute the key event layer by layer.

[0166] In the following, the specific functions of each module will be described in combination with the specific implementation process.

[0167] The display device 200 can display the show page according to the flow shown in the figure, and the specific steps are as follows: Figure 5

[0168] S501, in response to the first instruction of the user, enter the art mode.

[0169] In some embodiments, the display device 200 can be configured to: in the shutdown state, in response to the first instruction of the user short pressing the power key of the control device 100, start the art mode application after booting, and enter the art mode after starting the art mode application.

[0170] In some embodiments, the display device 200 can be configured to: in the shutdown state, in response to the instruction of the user long pressing the power key of the control device 100, display the system home page, and in response to the first instruction of the user short pressing the power key or the home key of the control device 100, start the art mode application, and enter the art mode after starting the art mode application.

[0171] In some embodiments, the display device 200 can be configured to: in the shutdown state, in response to the first instruction of the user inputting through the art mode key of the control device 100, start the art mode application after booting, and enter the art mode after starting the art mode application.

[0172] In some embodiments, the display device 200 can be configured to: when displaying the system home page, in response to the instruction of the user selecting the icon of the art mode application, enter the art mode. The icon of the art mode application can be configured on the system home page, or can be configured in the sidebar of the system home page.

[0173] In some embodiments, the display device 200 can be configured to: in the boot state and not in the art mode, in response to the first instruction of the user short pressing the power key of the control device 100, enter the art mode.

[0174] ​In some embodiments, the display device 200 can be configured to enter the art mode in response to a first instruction input by the user based on the art mode key of the control device 100 when the display device 200 is in the power-on state and has not entered the art mode.

[0175] In other embodiments, if the user turns on the timing power-on and sets the power-on time, the display device 200 can be configured to start the art mode application after the power-on and enter the art mode after starting the art mode application when the system time matches the power-on time in the power-off state.

[0176] In some embodiments, the control device 100 generates a press signal in response to the user pressing the key and sends the press signal to the display device 200. The control device 100 also generates a release signal in response to the user lifting the key and sends the release signal to the display device 200. Accordingly, the display device 200 can determine whether the user performs a short press operation or a long press operation on the key by listening to the press event and the release event of the key. For example, the display device 200 can capture the key event using the dispatchKeyEvent method, and the captured key event can include the press (KeyEvent.ACTION_DOWN) event and the release (KeyEvent.ACTION_UP) event. When the display device 200 listens to the key event, it detects whether it is the first press. If it is detected that it is the first press, such as event.getRepeatCount() == 0, a timer (such as Handler and Runnable) is started, and the timer counts a predefined time, such as 500 ms. If the display device 200 does not listen to the release event within the predefined time, the timer triggers the long press event, i.e., it can be determined that the user performs the long press operation on the key. If the display device 200 listens to the release event within the predefined time, the timer is cancelled. Since the timer does not trigger the long press event, it can be determined that the user performs the short press operation on the key.

[0177] In some embodiments, the control device 100 can periodically send the key value signal to the display device 200 in response to the user pressing the key until the user releases the key. The display device 200 can determine whether the user performs a short press operation or a long press operation on the key according to the number of received key value signals. If the number of received key value signals is less than or equal to a preset number, the display device 200 can determine that the user performs a short press operation on the key. If the number of received key value signals is greater than the preset number, the display device 200 can determine that the user performs a long press operation on the key. For example, the preset number is 1. If the number of received key value signals is 1, the display device 200 can determine that the user performs a short press operation on the key. If the number of received key value signals is greater than 1, the display device 200 can determine that the user performs a long press operation on the key.

[0178] In some embodiments, the display device 200 can be configured with a second application. The second application can call the application data of the first application running in the background, such as the art painting, the quality parameter, the carousel parameter, and the like. In this way, the display device 200 is in the second mode after entering the second application. In the second mode, the display device 200 displays the screen saver page of the second application and displays the art painting provided by the first application on the screen saver page, thereby realizing the display of the art paintings provided by the first application in the form of a screen saver. In the second mode, the user cannot use the related functions of the first application, that is, cannot set the art painting, and the like.

[0179] In some embodiments, the second application can also be referred to as an art screen saver application, a gallery screen saver application, a picture frame screen saver application, and the like. The second mode can also be referred to as an art screen saver mode, a gallery screen saver mode, a picture frame screen saver mode, and the like.

[0180] In the embodiments of the present application, the second application is taken as an art screen saver application, and the second mode is taken as an art screen saver mode for illustration.

[0181] The display device 200 can enter the art screen saver mode in the following manner:

[0182] In some embodiments, the display device 200 can be configured to, in a powered-on state and before entering the art mode, enter the art screen saver mode if a first condition is met. The first condition can include that no user operation is detected in a specified time period in a non-physical channel or no signal input is detected in a currently used physical channel.

[0183] In some embodiments, the signal channels of the display device 200 can include physical channels and non-physical channels. Among them, the physical channel refers to a channel that transmits signals through a physical medium, which can be a cable, an optical fiber, a satellite antenna, etc. The physical channel can include a TV channel, an AV channel, an HDMI channel, etc. The non-physical channel refers to a channel that transmits signals through wireless means without the need for physical connection to transmit signals. Signals other than physical channels can be referred to as non-physical channels, and non-physical channels can include: launcher home page, third-party applications, etc.

[0184] S502, in the art mode, display the display page of the art mode application, and display the first art painting in the display page, which is the art painting displayed when the art mode was last exited.

[0185] The display device 200 displays the display page and the art painting in the display page after entering the art mode.

[0186] In some embodiments, the display page is a user display interface set in the first mode. For example, the display page can be the home page of the first application, i.e. the first page displayed after entering the first mode. The display page can also be a specified user display interface.

[0187] The display device 200 can be configured to record the relevant parameters of the currently displayed art painting, such as the picture ID of the art painting and the classification of the art painting, when exiting the art mode, and to display the corresponding art painting, i.e. the art painting displayed when the art mode was last exited, according to the recorded relevant parameters of the art painting when entering the art mode again.

[0188] In some embodiments, the code design for the display device 200 to display the art painting displayed when the art mode was last exited after entering the art mode can refer to the following examples:

[0189] When exiting the art mode, store the last art painting played successfully. For example, the picture ID of the played art painting can be stored through SharedPreferences.

[0190] / / Get the SharedPreferences object

[0191] SharedPreferences sharedPreferences = getSharedPreferences("MyPrefs", MODE_PRIVATE);

[0192] / / Get the Editor object

[0193] SharedPreferences.Editor editor = sharedPreferences.edit() ;

[0194] / / Store primary category primaryId

[0195] editor.putInt("primary_id", primaryId) ;

[0196] / / Store secondary category secondaryId

[0197] editor.putInt("secondary_id", secondaryId) ;

[0198] / / Store ID

[0199] editor.putInt("image_id", imageId) ;

[0200] / / Commit changes

[0201] editor.apply() ;

[0202] Get image Id when the application is launched again, get the image storage path in the database according to the image id, and display the user image.

[0203] / / Get SharedPreferences object

[0204] SharedPreferences sharedPreferences = getSharedPreferences("MyPrefs", MODE_PRIVATE) ;

[0205] / / Read string, return default value 0 if key does not exist

[0206] int imageId = sharedPreferences.getInt("image_id", 0) ;

[0207] int primaryId = sharedPreferences.getInt("primary_id", 0) ;

[0208] int secondaryId = sharedPreferences.getInt("secondary_id", 0) ;

[0209] According to the imageId\primaryId\secondaryId, the corresponding art paintings are obtained in the array library.

[0210] S503, starting from the first art painting, the art paintings in the classification of the first art painting are displayed in the display page in turn according to the rotation time and the rotation order.

[0211] Each art painting has a corresponding classification, that is, a first classification and a second classification to which the art painting belongs. The art painting has a binding relationship or a mapping relationship with the first classification and the second classification to which it belongs, that is, according to the art painting, the first classification and the second classification to which it belongs can be determined.

[0212] The art mode application can be configured with a rotation function, and the rotation parameters related to the rotation function can include rotation time, rotation range, and rotation order in the rotation range, etc.

[0213] The rotation time refers to the time interval of rotating the art paintings. The art mode application can be configured with a default rotation time, and the user can also customize the rotation time.

[0214] The rotation range refers to the art paintings participating in the rotation.

[0215] In some embodiments, the rotation range can be all art paintings in the same second classification.

[0216] In some embodiments, the rotation range can be all art paintings included in each second classification in the same first classification.

[0217] In some embodiments, the rotation range can be all art paintings included in each second classification in a plurality of first classifications, and the plurality of first classifications can be adjacent first classifications or non-adjacent first classifications (in the embodiments of the present application, the adjacent relationship of the first classification and the second classification refers to the adjacent relationship between the display positions of the corresponding titles in the application home page).

[0218] In some embodiments, the rotation range can be all art paintings in part of the second classifications in the same first classification, and the part of the second classifications can be adjacent second classifications or non-adjacent second classifications.

[0219] In some embodiments, the rotation range can be all art paintings included in part of the second classifications in a plurality of first classifications, and the plurality of first classifications can be adjacent first classifications or non-adjacent first classifications, and the part of the second classifications can be adjacent second classifications or non-adjacent second classifications.

[0220] In some embodiments, the carousel range can be part of artistic works in the same secondary classification. The part of artistic works can be adjacent artistic works or non-adjacent artistic works.

[0221] In some embodiments, the carousel range of artistic works can be a default carousel range applied by the artistic mode or a carousel range customized by a user.

[0222] The carousel order refers to the order of artistic works in the carousel range, wherein, in the carousel process, the artistic works with higher order are displayed first and the artistic works with lower order are displayed later.

[0223] After the display device 200 enters the artistic mode, the related parameters of the first artistic work, such as the picture ID and the classification to which the artistic work belongs, can be obtained after determining the first artistic work, which can be referred to as step S502, and details are not described herein. The display device 200 can also obtain the carousel parameters, such as the carousel time and the carousel range, and determine the carousel range and the carousel order corresponding to the first artistic work according to the related parameters of the first artistic work.

[0224] For example, the carousel range set in the carousel parameters is all artistic works in each secondary classification in the same primary classification, if the primary classification to which the first artistic work belongs is the artistic gallery classification, then the carousel range corresponding to the first artistic work is all artistic works in each secondary classification in the artistic gallery classification. After determining the carousel range corresponding to the first artistic work, the carousel order of each artistic work in the carousel range can be determined. The starting point of the current carousel process can be located according to the first artistic work, and each artistic work in the carousel range after the first artistic work can be sequentially carousel according to the carousel order.

[0225] In some embodiments, the code design for implementing the display device 200 to carousel artistic works can be referred to the following examples:

[0226]

[0227]

[0228] In some embodiments, in the carousel process, the user can manually and quickly switch the played artistic works, and the display device 200 can quickly switch the displayed artistic works according to the Figure 6 flow shown in the figure, and the specific steps are as follows:

[0229] S601, in response to the switching instruction of the user, switching the display of the artistic works in the display page.

[0230] The display device 200 can be configured to switch the display of the artistic works in response to the switching instruction input by the user based on the direction keys of the control device 100.

[0231] In some embodiments, the left key and the right key in the control device 100 can be configured as keys for inputting a switching instruction, wherein if the switching instruction is an instruction input by a user based on the left key of the control device 100, the last art piece of the currently displayed art piece is switched to be displayed in the display page; if the switching instruction is an instruction input by a user based on the right key of the control device 100, the next art piece of the currently displayed art piece is switched to be displayed in the display page.

[0232] S602, starting from the switched art piece, each art piece in the art classification to which the first art piece belongs is sequentially displayed in the display page according to the rotation time and the rotation order.

[0233] Step S602 can refer to step S503, which will not be described here.

[0234] In this way, in the art mode, during the process in which the display device 200 rotates the art pieces, the user can manually and quickly switch the displayed art pieces, so as to quickly review the displayed art pieces, quickly skip the art pieces that the user does not want to watch, and the like.

[0235] In some embodiments, the rotation task can be controlled by an alarm manager. The display device 200 starts a timer when displaying an art piece, and sends a notification to the display device 200 when the timer counts to the rotation time, and the display device 200 will switch to display the next art piece according to the notification, and restart the timer when displaying the next art piece.

[0236] In some embodiments, the display device 200 restarts the timer after displaying the switched art piece in response to the switching instruction of the user, even if the timer corresponding to the art piece before switching does not count to the rotation time. In this way, it can be ensured that the switched art piece is still displayed for a long enough time.

[0237] In some embodiments, the picture resolution of the target art piece to be displayed can be different from the resolution supported by the display. In order to adapt to the resolution of the display, the target art piece can be processed according to the resolution of the display before displaying the target art piece, and then the processed target art piece is displayed.

[0238] In some embodiments, the display device 200 can process the target art piece according to the flow shown in FIG. 7, and the specific steps are as follows: Figure 7

[0239] S701, determining a target art piece to be displayed, and obtaining a first resolution of the target art piece.

[0240] ​In some embodiments, after entering the art mode, the target art picture to be displayed is taken as a first art picture.

[0241] In some embodiments, during the carousel of art pictures, the target art picture to be displayed is taken as a next art picture of the currently displayed art picture.

[0242] In some embodiments, during the switching of art pictures in response to the switching instruction of the user, the target art picture to be displayed is taken as a switched art picture.

[0243] The first resolution is a picture resolution of the target art picture.

[0244] S702, processing the target art picture according to the first resolution and a second resolution of the display.

[0245] If the first resolution is lower than the second resolution, the target art picture is enlarged to the second resolution to obtain an enlarged target art picture.

[0246] The embodiments provided in the present application are exemplarily described with the second resolution supported by the display being 4K as an example.

[0247] If the first resolution is lower than 4K, the display device 200 enlarges the target art picture to 4K and performs image optimization processing on the enlarged target art picture.

[0248] If the first resolution is equal to the second resolution, the target art picture is not processed.

[0249] If the first resolution is equal to 4K, the target art picture does not need to be processed and can be directly displayed.

[0250] If the first resolution is higher than the second resolution, the target art picture is compressed to the second resolution to obtain a compressed target art picture.

[0251] If the first resolution is higher than 4K, the target art picture needs to be compressed to 4K and the compressed target art picture is displayed.

[0252] In some embodiments, when the display device 200 compresses the target art picture, a scaling ratio, which can also be referred to as a sampling rate of the picture, is calculated and the target art picture is compressed according to the scaling ratio.

[0253] In some embodiments, the display device 200 always stores original picture data of the target art picture.

[0254] In some embodiments, the code design for display device 200 to identify whether the first resolution of the target artwork is lower than or equal to 4K and to perform scaling on the target artwork can refer to the following example:

[0255]

[0256] In some embodiments, the code design for display device 200 to identify whether the first resolution of the target artwork is higher than 4K and to perform scaling on the target artwork can refer to the following example:

[0257]

[0258] In some embodiments, the code design for display device 200 to calculate the sampling rate of the picture can refer to the following example:

[0259]

[0260]

[0261] S703, display the processed target artwork in the display page.

[0262] In this way, the displayed target artwork can meet the resolution requirements of the display screen.

[0263] In some embodiments, the art mode application can be configured with a frame function, that is, a frame can be added to the artwork, and a three-dimensional effect can be added to the added frame to simulate the real artwork mounting effect.

[0264] In some embodiments, the art mode application can be configured to start the frame function by default. Alternatively, the user can customize to start or stop the frame function according to the needs. The user can start or stop the frame function through the setting item of the frame function, and set the style of the frame after starting the frame function.

[0265] After starting the frame function, when displaying the artwork in the display page, the artwork needs to be added with a frame. If the sizes of the front and rear artworks are different, when switching the artworks, the problem of mismatch between the frame and the artwork may occur, that is, the artwork has been switched, but the added frame is still adapted to the artwork before switching, and is not adapted to the artwork after switching, resulting in mismatch between the frame and the artwork. Especially when the user manually switches the artwork, since the speed of switching the displayed artwork is faster, the problem of mismatch between the frame and the artwork will be more likely to occur.

[0266] In order to solve the problem of mismatch between the frame and the artwork, in some embodiments, display device 200 can perform the following operations according to the size of the target artwork: Figure 8The flow shown displays the target artwork corresponding to the artwork, and the specific steps are as follows:

[0267] S801, determine the target artwork to be displayed, and obtain the frame parameter.

[0268] The process of determining the target artwork to be displayed can refer to step S701, which is not described here.

[0269] In some embodiments, the frame parameter can include whether to add a frame, and when adding a frame, it also includes the style of the frame to be added. The style of the frame can include the color, texture, etc. of the frame.

[0270] S802, if the frame parameter includes a frame of the first style, before displaying the target artwork, the target artwork is processed according to the frame of the first style to obtain the target artwork with a three-dimensional frame effect.

[0271] If the user enables the frame function, the frame parameter includes adding a frame, and includes the style of the frame to be added, that is, the frame of the first style. The first style can be the default style applied by the art mode, or the style set by the user.

[0272] In order to avoid the problem that the target artwork and the matching frame are not synchronized, that is, the displayed target artwork does not match the displayed frame, before displaying the target artwork, the target artwork is first processed according to the frame of the first style to obtain the target artwork with a three-dimensional frame effect, and then the target artwork and the matching frame are displayed as a whole, that is, the target artwork with a three-dimensional frame effect.

[0273] In some embodiments, the display device 200 can display the target artwork with a three-dimensional frame effect according to the following steps: Figure 9 The flow shown obtains the target artwork with a three-dimensional frame effect, and the specific steps are as follows:

[0274] S901, create a first frame background according to the frame of the first style, scale the target artwork according to the specified scaling ratio to obtain the scaled target artwork, and draw a first three-dimensional effect line according to the edge of the scaled target artwork.

[0275] The size of the first frame background can match the display size of the display screen, that is, in a full-screen state. The style of the first frame background is the same as the first style, that is, the color, background, etc. of the first frame background are consistent with the first style.

[0276] The artistic mode application can pre-configure at least one zoom scale for the user to select, for example, 90%, 80%, 70%, etc. When the target artistic painting is scaled according to the zoom scale, the target artistic painting is the target artistic painting processed according to steps S701-S702, instead of the original target artistic painting. Thus, after the target artistic painting processed according to steps S701-S702, if the display device 200 detects that the picture frame function is turned on, the display device 200 further scales the target artistic painting processed according to the set zoom scale. For example, if the set zoom scale is 90%, the display device 200 scales the target artistic painting processed to 90% in proportion.

[0277] The size of the target artistic painting scaled will be smaller than the display size of the display screen.

[0278] The target artistic painting scaled is the artistic painting to be displayed in the exhibition page, thus, the edge of the target artistic painting scaled is used to draw the stereoscopic effect line, i.e., the first stereoscopic effect line. The first stereoscopic effect line will match the outer contour of the target artistic painting scaled, achieving the effect of fitting the outer contour of the target artistic painting processed.

[0279] S902, synthesizing the target artistic painting scaled, the first picture frame background, and the first stereoscopic effect line to obtain the target artistic painting with the stereoscopic picture frame effect. Wherein, the target artistic painting scaled is superimposed on the first picture frame background, and located in the central region of the first picture frame background, and the first stereoscopic effect line is superimposed on the edge of the target artistic painting scaled.

[0280] The target artistic painting scaled, the first picture frame background, and the first stereoscopic effect line are synthesized to obtain a picture, which is the target artistic painting with the stereoscopic picture frame effect.

[0281] Reference can be made to the synthesis process shown in Figure 10 , wherein, as shown in ① of Figure 10 , the target artistic painting scaled 1002 is superimposed on the first picture frame background 1001, and the first stereoscopic effect line 1003 is superimposed on the edge of the target artistic painting scaled 1002. Wherein, the target artistic painting scaled 1002 is superimposed on the central region of the first picture frame background 1001, so that in the target artistic painting with the stereoscopic picture frame effect obtained by synthesis, the target artistic painting is located in the central region of the picture frame, which will be closer to the real mounting effect. The target artistic painting with the stereoscopic picture frame effect obtained after synthesis can be referred to Figure 10 ②.

[0282] In some embodiments, the code design for the display device 200 to synthesize the target artistic painting and the picture frame can refer to the following example:

[0283]

[0284]

[0285] wherein Canvas canvas = new Canvas(background) ;

[0286] canvas.drawColor(color) ;

[0287] canvas.drawBitmap(scaledImage, left, top, null) ;

[0288] The drawColor and drawBitmap methods of Canvas are methods for drawing a color and a Bitmap onto a Canvas. When drawing pictures, there is an occlusion relationship between pictures drawn multiple times. The occlusion relationship refers to the fact that a picture drawn later occludes a picture drawn earlier.

[0289] Specifically, Canvas uses a stack-based drawing mechanism. Each time the drawBitmap method is called, a new Bitmap is pushed into the stack and is drawn on top of a Bitmap drawn earlier, thereby occluding the Bitmap drawn earlier. In this way, if the drawBitmap method is called multiple times, each Bitmap is drawn on top of a Bitmap drawn earlier, thereby occluding the Bitmap drawn earlier.

[0290] S803, display the target art painting with a stereoscopic picture frame effect in the display page.

[0291] The target art painting with a stereoscopic picture frame effect is directly displayed in the display page. Since the target art painting with a stereoscopic picture frame effect includes both a target art painting and a picture frame with a stereoscopic effect, the problem of mismatch between the target art painting and the picture frame due to asynchronization between the target art painting and the picture frame when the target art painting is switched can be effectively avoided.

[0292] In some embodiments, when the picture frame function is turned on, the display device 200 can also dynamically add a picture frame to the target art painting according to whether a hardware picture frame has been installed.

[0293] When the picture frame function is turned on, the display device 200 can dynamically add a picture frame to the target art painting according to the flow shown in Figure 11 The specific steps are as follows:

[0294] S1101, identify whether a hardware picture frame has been installed.

[0295] In some embodiments, the display device 200 can obtain power-on navigation settings parameters, which may include whether a hardware picture frame is installed. For example, a corresponding identifier is added to the flag bit corresponding to the hardware picture frame. The display device 200 can determine whether a hardware picture frame has been installed by recognizing the identifier added to the flag bit.

[0296] In some embodiments, the display device 200 may provide a sensor at the location where the hardware frame is installed, the sensor being used to sense whether the hardware frame is installed.

[0297] In some embodiments, the display device 200 may be configured with an automatic light sensing function, that is, automatically adjusting the brightness of the display screen according to the brightness of the surrounding environment. The brightness of the surrounding environment is affected by the hardware decoration of the picture frame; in the same environment, if a hardware picture frame is installed, the brightness of the surrounding environment will be relatively low; if no hardware picture frame is installed, the brightness of the surrounding environment will be relatively high. The display device 200 can obtain the brightness of the display screen used over a recent period and estimate whether a hardware picture frame is installed based on these brightness values ​​and their trends. For example, if these brightness values ​​are all low, or drop suddenly from a high value to a low value, it can be determined that a hardware picture frame is installed. If these brightness values ​​are all high, or rise suddenly from a low value to a high value, it can be determined that no hardware picture frame is installed.

[0298] S1102 If a hardware frame is already installed, the target artwork will not be processed with a 3D frame effect, and the target artwork will be displayed on the display page.

[0299] If a hardware frame is already installed, and then a 3D frame effect is applied to the target artwork (i.e., a frame is added to the target artwork), the hardware frame and the added frame will appear simultaneously, resulting in a double frame situation. This will negatively impact the display effect of the target artwork.

[0300] Therefore, in order to avoid the situation of double frames, if a hardware frame is already installed, the display device 200 can mark it not to display the frame, and according to the mark, it will not process the target artwork with a 3D frame effect, but will directly display the target artwork on the display page.

[0301] You can refer to this. Figure 12 The display device 200 shown has a hardware frame 1201 installed on its bezel. When displaying a target artwork, even if the frame parameters include a first-style frame, the display device 200 does not apply a 3D frame effect to the target artwork, but instead... Figure 12As shown, the target artwork 1202 is displayed directly in the display page. At this time, the real mounting effect is simulated by the hardware frame 1201.

[0302] S1103, if the hardware frame is not currently installed, the target artwork is processed with the stereoscopic framing effect according to the frame of the first style, and the target artwork with the stereoscopic framing effect is displayed in the display page.

[0303] If the hardware frame is not currently installed, it means that even if the frame is added to the target artwork, there will be no double framing, so the target artwork can be processed with the stereoscopic framing effect according to steps S901-S902, and the target artwork with the stereoscopic framing effect is displayed in the display page.

[0304] In some embodiments, based on step S801, if the frame parameter includes no frame, i.e. the frame function is turned off, the target artwork is not processed with the stereoscopic framing effect, and the target artwork is directly displayed in the display page.

[0305] In some embodiments, when the frame function is turned off, the display device 200 can also add a frame to the target artwork according to whether the hardware frame has been installed.

[0306] When the frame function is turned off, the display device 200 can add a frame to the target artwork according to whether the hardware frame has been installed. Figure 13 The flow shown dynamically adds a frame to the target artwork, and the specific steps are as follows:

[0307] S1301, identify whether the hardware frame has been installed.

[0308] Step S1301 can refer to step S1101, which will not be described here.

[0309] S1302, if the hardware frame has been installed, the target artwork is not processed with the stereoscopic framing effect, and the target artwork is displayed in the display page.

[0310] If the hardware frame has been installed, it means that even if the frame function is not turned on, the real mounting effect can be simulated by the hardware frame. Therefore, the target artwork can not be processed with the stereoscopic framing effect, and the target artwork can be directly displayed in the display page.

[0311] S1303, if the hardware frame is not currently installed, the target artwork is processed with the stereoscopic framing effect according to the frame of the second style, the target artwork with the stereoscopic framing effect is obtained, and the target artwork with the stereoscopic framing effect is displayed in the display page, wherein the frame of the second style is the frame of the art mode application default style.

[0312] If the hardware frame is not currently installed, the target art painting displayed lacks a mounting effect because the frame function is also not currently enabled. Therefore, the display device 200 can automatically perform a three-dimensional frame effect process on the target art painting and add a default style frame to the target art painting to achieve a mounting effect of the target art painting.

[0313] When the display device 200 displays an art painting in a display page, the corresponding art painting needs to be loaded, for example, the display art painting is rendered, the art painting is added with a corresponding quality parameter, and the like. The process of loading the art painting needs to consume a certain amount of time. If the display device 200 switches the display art painting in response to a switching instruction of the user, the response is too slow because the loading process of the switched art painting is slow.

[0314] To reduce the influence of the loading process of the art painting on the user experience, the display device 200 can display the art painting in the display page according to the process shown in FIG. 13, and the specific steps are as follows. Figure 14

[0315] S1401, determine the switched art painting and decode the switched art painting to obtain a bitmap object.

[0316] The process of determining the switched art painting can refer to step S601, which is not described herein.

[0317] The display device 200 decodes the switched art painting into a bitmap object (Bitmap).

[0318] S1402, in the display page, display the switched art painting with a first definition in a first view according to the bitmap object, and render the switched art painting with a second definition in a second view according to the bitmap object and an application quality parameter corresponding to the switched art painting. The first view is located on the second view, and the first definition is lower than the second definition.

[0319] ​The display device 200 inputs the Bitmap of the switched artistic painting into an image view (ImageView) and an image player (Image Player) of the artistic mode application respectively after obtaining the Bitmap, so as to load the corresponding switched artistic painting through the ImageView and the Image Player respectively. The process of loading the switched artistic painting by the Image Player includes calling the Image Player, rendering the artistic painting with high definition (second definition), adding the corresponding application quality parameters, etc. The loading process is slow, but the switched artistic painting with high definition is obtained, and the switched artistic painting has the quality effect meeting the requirement. The process of loading the switched artistic painting by the Image View includes rendering the artistic painting with low definition (first definition) and using the whole machine quality parameters, without calling the Image Player or adding the application quality parameters corresponding to the switched artistic painting, etc. Therefore, the loading process is fast, but the switched artistic painting with low definition is obtained, and the quality effect of the switched artistic painting does not meet the requirement.

[0320] The first view and the second view are created in the display page, i.e., the first view and the second view are located in the same OSD layer. The first view is located on the second view, and therefore, the picture displayed in the first view will be blocked on the picture displayed in the second view.

[0321] In some embodiments, when the display device 200 controls the blocking relationship between the views using the Constraint Layout, the z order of the views is specified using the android:elevation attribute. The view with a higher elevation value will be drawn above the view with a lower elevation value. Therefore, the display device 200 can configure a higher elevation value for the first view and a lower elevation value for the second view, so as to draw the first view on the second view.

[0322] In order to display the switched artistic painting as soon as possible, the switched artistic painting with the first definition loaded by the Image View can be displayed in the first view, and the switched artistic painting with the second definition can be loaded in the background through the Image Player.

[0323] S1403, after obtaining the switched artistic painting with the second definition, the first view is hidden, so as to display the switched artistic painting with the second definition in the display page.

[0324] After Image Player loads the artwork with a second resolution, it displays the artwork in a second view. Following this, by hiding the first view, the artwork in the second view is exposed within the display page, thus achieving the effect of loading the artwork from a lower resolution to a higher resolution.

[0325] In some embodiments, the code design for implementing the display device 200 to display artworks with different resolutions in the first and second views can refer to the following example:

[0326]

[0327]

[0328] You can refer to this. Figure 15 The process of changing the displayed page, as shown, is such that after the display device 200 determines the artwork after the switch, it can... Figure 15 As shown in Figure ①, a first view 1501 and a second view 1502 are created within the display page, with the first view 1501 situated on top of the second view 1502. The first view 1501 displays a lower-resolution artwork, while a higher-resolution artwork is loaded in the background via Image Player. The resulting display effect is as follows: Figure 15 As shown in ②. After Image Player finishes loading and a high-resolution artwork is obtained, as shown... Figure 15 As shown in ③, the high-resolution artwork is displayed in the second view 1502, while the first view 1501 is hidden. At this point, the overall display effect is as follows: Figure 15 As shown in ④.

[0329] In some embodiments, when the display device 200 displays a lower-resolution artwork on a display page, to prevent users from mistakenly believing that the switched artwork itself has a lower resolution, a loading indicator can be displayed on the lower-resolution artwork to prompt the user that a higher-resolution artwork is being loaded. See also... Figure 16 The display page shown has a lower-resolution artwork 1601 displayed on the display device 200, while a higher-resolution artwork is loaded in the background. To indicate to the user that a higher-resolution artwork is being loaded, a loading indicator 1602 can be displayed on the lower-resolution artwork 1601.

[0330] The display direction of the artwork refers to the natural direction of the artwork, that is, the direction consistent with the content and design intention of the artwork, and is a fixed attribute of the artwork. The display direction of the artwork can include a horizontal direction and a vertical direction, wherein the horizontal direction refers to a width of the artwork being greater than a height of the artwork, and the vertical direction refers to the height of the artwork being greater than the width of the artwork.

[0331] The display direction of the artwork refers to the natural direction of the artwork, that is, the direction consistent with the content and design intention of the artwork, and is a fixed attribute of the artwork. The display direction of the artwork can include a horizontal direction and a vertical direction, wherein the horizontal direction refers to a width of the artwork being greater than a height of the artwork, and the vertical direction refers to the height of the artwork being greater than the width of the artwork.

[0332] The screen direction of the display screen of the display device 200 includes a horizontal screen and a vertical screen, wherein the horizontal screen refers to a state in which the display screen is horizontally wider than vertically high, and the vertical screen refers to a state in which the display screen is vertically higher than horizontally wider.

[0333] The display device 200 can effectively ensure the display effect of the artwork only when the screen direction of the display screen is consistent with the display direction of the artwork when displaying the artwork. The screen direction of the display screen being consistent with the display direction of the artwork can include: the display screen being in a horizontal screen state and the display direction of the artwork being a horizontal direction, and the display screen being in a vertical screen state and the display direction of the artwork being a vertical direction.

[0334] If the screen direction of the display screen is inconsistent with the display direction of the artwork, the display size of the artwork will be limited by the display screen, thereby affecting the display effect of the artwork. The screen direction of the display screen being inconsistent with the display direction of the artwork can include: the display screen being in a horizontal screen state and the display direction of the artwork being a vertical direction, and the display screen being in a vertical screen state and the display direction of the artwork being a horizontal direction.

[0335] If the display screen of the display device 200 is a rotatable display screen, the display device 200 can adjust the screen direction of the display screen when displaying the artwork according to the flow shown in FIG. 17B, and the specific steps are as follows: Figure 17

[0336] S1701, determine a target artwork to be displayed.

[0337] Step S1701 can refer to step S701, which will not be described here.

[0338] S1702, obtain a display direction corresponding to the target artwork, and detect a current screen direction of the display screen.

[0339] The display direction corresponding to the target artwork can be a horizontal direction or a vertical direction.

[0340] The current screen direction of the display screen can be a horizontal screen or a vertical screen.

[0341] ​In some embodiments, the code design for achieving the display device 200 to obtain the display direction corresponding to the target art piece can refer to the following examples:

[0342]

[0343] S1703, when the current screen direction of the display screen is inconsistent with the display direction corresponding to the target art piece, rotating the screen direction of the display screen to be consistent with the display direction corresponding to the target art piece.

[0344] When the current screen direction of the display screen is consistent with the display direction corresponding to the target art piece, there is no need to adjust the screen direction of the display screen, and the target art piece corresponding to the art piece can be directly displayed.

[0345] When the current screen direction of the display screen is inconsistent with the display direction corresponding to the target art piece, the display screen will limit the display size of the target art piece, and there will be a blank area when displaying the target art piece, resulting in poor display effect of the target art piece. The display device 200 can control the display screen to rotate to adjust the screen direction of the display screen to be consistent with the display direction corresponding to the target art piece.

[0346] The adjustment process can be referred to as shown in Figure 18 , as shown in ① of Figure 18 , the current screen direction of the display screen 1801 of the display device 200 is portrait, and if the display direction corresponding to the target art piece 1802 is landscape, the two are inconsistent. At this time, if the target art piece 1802 is displayed, the effect shown in Figure 18 ① will be presented. The display screen 1801 will limit the display size of the target art piece 1802. The display device 200 can rotate the display screen 1801, as shown in Figure 18 ②, adjust the screen direction of the display screen 1801 to portrait, and display the target art piece 1802 in the display screen 1801 in portrait state. At this time, the target art piece 1802 can be displayed in a larger display size.

[0347] If the target art piece is the first art piece, that is, the first art piece displayed when entering the art mode, the probability of the user entering the hierarchical preview page of the art mode application (which will be described in detail later) is relatively high. In some embodiments, the display device 200 can be configured to: when the current screen direction of the display screen is inconsistent with the display direction corresponding to the first art piece, if no user operation is detected within a first time period, rotate the screen direction of the display screen to be consistent with the display direction corresponding to the first art piece, wherein the first time period is less than the carousel time. In this way, the use of the art mode application by the user can be avoided, and unnecessary rotation process can be reduced.

[0348] In some embodiments, the display device 200 can also be configured to, when the current screen direction of the display screen is inconsistent with the display direction corresponding to the target artwork to be displayed, if no user operation is detected within a second time period, rotate the screen direction of the display screen to be consistent with the display direction corresponding to the target artwork, wherein the second time period is less than the carousel time. In this way, the situation that the display device 200 continuously rotates the display screen for a short time due to the user's continuous switching of the artwork and the like can be avoided.

[0349] In some embodiments, the display device 200 can also be configured to, when the current screen direction of the display screen is consistent with the display direction corresponding to the target artwork and in a vertical screen state, if an instruction to enter the hierarchical preview page of the art mode application is received, enter the hierarchical preview page in response to the instruction, and control the display screen to rotate to a horizontal screen state to better adapt to the display requirements of the hierarchical preview page and facilitate the user to use the hierarchical preview page.

[0350] The display device 200 can adjust the screen direction of the display screen and display the artwork corresponding to the target artwork in the following manner, which is as follows:

[0351] In some embodiments, the display device 200 can adjust the screen direction of the display screen and display the artwork corresponding to the target artwork in the following manner, which is as follows: Figure 19

[0352] S1901, before adjusting the screen direction of the display screen, display the target artwork corresponding to the target artwork in the display direction corresponding to the target artwork in the display page.

[0353] When the screen direction of the display screen is inconsistent with the display direction corresponding to the target artwork, the target artwork corresponding to the target artwork can be displayed in the display direction corresponding to the target artwork before rotating the display screen.

[0354] Taking the current screen direction of the display screen as a horizontal screen and the display direction corresponding to the target artwork as a vertical direction as an example, referring to the change process of the display screen and the target artwork shown in FIG. 2B, as shown in FIG. 2B, the display screen 2001 is in a horizontal screen state, and the target artwork 2002 is displayed in the display page in a vertical direction before the display screen 2001 is rotated. Figure 20 Figure 20

[0355] S1902, rotate the screen direction of the display screen to be consistent with the display direction corresponding to the target artwork, and keep the current display direction of the target artwork unchanged when rotating the display screen.

[0356] ​​​During the rotation of the display screen, the current display orientation of the target artwork remains unchanged, that is, the target artwork is kept in the corresponding display orientation. In some embodiments, this can be achieved by rotating the target artwork in the opposite direction to the rotation direction of the display screen.

[0357] In this way, the target artwork remains in the corresponding display direction during the rotation of the screen, allowing users to still browse the normal target artwork.

[0358] like Figure 20 As shown in Figure ②, the rotating display screen 2001 maintains the target artwork 2002 in a vertical position throughout the process.

[0359] S1903: After rotating the screen orientation of the display to match the display orientation of the target artwork, the size of the target artwork is enlarged.

[0360] After rotating the display screen to match the display orientation of the target artwork, the size of the target artwork is enlarged. The enlarged target artwork can be enlarged to full screen mode or enlarged to a preset size.

[0361] like Figure 20 As shown in ③, after rotating the display screen 2001 to portrait mode, the target artwork 2002 is enlarged to full-screen mode.

[0362] In other embodiments, the display device 200 may be in accordance with Figure 21 The process shown adjusts the screen orientation and displays the artwork corresponding to the target artwork. The specific steps are as follows:

[0363] S2101, before adjusting the screen orientation of the display screen, the target artwork corresponding to the target artwork is displayed on the display page in a display orientation consistent with the current screen orientation of the display screen.

[0364] The display device 200 can display the target artwork in a display orientation consistent with the current screen orientation of the display screen. Because this display orientation is consistent with the current screen orientation, when the target artwork is displayed in this orientation, its corresponding display direction is also consistent with the current screen orientation. Essentially, the target artwork, which would normally be displayed in its corresponding display orientation, is first rotated to align with the current screen orientation before being displayed, thus adapting to the current display screen and avoiding limitations imposed by the display screen on the display size.

[0365] Taking the current screen orientation as landscape and the target artwork's display orientation as portrait as an example, refer to... Figure 22The display screen and the changing process of the target artwork shown are as follows: Figure 22 As shown in Figure ①, the display screen 2201 is in landscape mode. Before rotating the display screen 2201, the target artwork 2202 is displayed on the display page with the landscape orientation.

[0366] In some embodiments, if a frame is required for the target artwork, the frame is displayed on the target artwork when it is displayed in a display orientation consistent with the current screen orientation of the display. The frame matches both the target artwork and the screen size of the display.

[0367] S2102, rotate the screen orientation of the display to match the display orientation of the target artwork.

[0368] After rotating the screen orientation of the display device 200 to match the display orientation of the target artwork, the target artwork can be displayed with the display orientation of the target artwork as the display orientation.

[0369] like Figure 22 As shown in Figure ②, after rotating the display screen 2201 to vertical orientation, the target artwork 2202 will also be vertical, which is the display direction corresponding to the target artwork 2202.

[0370] In some embodiments, if the first resolution of the target artwork displayed is higher than the second resolution of the display, the art mode application can provide the user with a partial magnification function of the target artwork.

[0371] In some embodiments, the display device 200 can be configured to... Figure 23 The process is illustrated by zooming in on the target artwork; the specific steps are as follows:

[0372] S2301, in response to the user's zoom command, obtains the first coordinates of the center point of the display screen corresponding to the target artwork.

[0373] In some embodiments, a zoom-in button may be configured within the display page. If a user wants to browse the details of an artwork, they can select the zoom-in button to input a zoom-in command, thereby controlling the display device 200 to display a partially magnified version of the target artwork within the display page.

[0374] In response to the magnification command, the display device 200 obtains the first coordinates of the center point of the display screen corresponding to the original image of the target artwork. At this time, the first coordinates are exactly the coordinates corresponding to the center point of the original image of the target artwork. The center point of the display screen is also exactly the center point of the compressed target artwork.

[0375] S2302, based on the first coordinates, the display width and display height of the display screen, extract a first image that conforms to the second resolution from the target artwork.

[0376] Based on this first coordinate, a point at the corresponding location within the target artwork can be determined. Using this point as the center, a rectangular area can be cropped from the original image of the target artwork, known as the first image. The width of this first image is parallel to the width of the display screen, and the height of the first image is parallel to the height of the display screen. Furthermore, the width of the first image equals the display width of the display screen, and the height of the first image equals the display height of the display screen; that is, the first image conforms to the second resolution. The image content contained in the first image is the enlarged image content centered on the center point of the compressed target artwork.

[0377] You can refer to this. Figure 24 The display page described in section ① displays a compressed target artwork 2401 and a zoom-in button 2402, allowing the user to input a zoom-in command by selecting the zoom-in button 2402. For illustrative purposes, the center point O of the display screen can be mapped to the center point O' of the original image of the target artwork. In response to the zoom-in command, the display device 200 obtains the first coordinate of O' on the original image of the target artwork. Centered on the first coordinate, and based on the display width and height of the display screen, a first image 2403 is cropped from the original image of the target artwork.

[0378] S2303, the first image is displayed on the display page.

[0379] The first image captured is displayed on the showcase page; you can refer to that. Figure 24 As shown in ②, the first image 2403 is displayed on the display page to achieve a local magnification effect.

[0380] In some embodiments, the display device 200 can create a view above the compressed target artwork within the display page and display the first image in that view. This does not affect the display of the compressed target artwork in the lower view. If the user does not wish to use the zoom function, they can enter an exit command using the back button on the control device 100. In response to this exit command, the display device 200 closes the view, and the compressed target artwork can be displayed again, restoring the normal display effect.

[0381] In some embodiments, the code design for implementing partial magnification of the target artwork by the display device 200 can refer to the following example:

[0382] Get the coordinates of the center point of the image

[0383]

[0384] The following method is a method of intercepting a 4k picture with a center coordinate:

[0385]

[0386]

[0387] In some embodiments, during the zooming-in process, the display device 200 can switch the position of the local zooming according to the flow shown in FIG. 9, and the specific steps are as follows: Figure 25

[0388] S2501, in response to a moving instruction of the user, moving the position of the center point of the display screen on the target artwork, and determining a second coordinate corresponding to the center point of the display screen on the target artwork after the moving according to the first coordinate and a preset moving step.

[0389] In some embodiments, the user can control the position of the focus of the center point of the display screen on the original picture of the target artwork by using the direction keys on the control device 100. For example, the preset moving step can be the distance of the displacement of the center point of the display screen on the target artwork in response to one short press of the direction keys by the user. In this way, the display device 200 can calculate the total distance of the displacement of the center point of the display screen relative to the first coordinate according to the preset moving step, and determine the coordinate corresponding to the center point of the display screen on the target artwork after the moving, i.e., the second coordinate, according to the total distance.

[0390] S2502, intercepting a second picture meeting the second resolution from the target artwork according to the second coordinate, the display width and the display height of the display screen.

[0391] S2503, displaying the second picture in the exhibition page.

[0392] The steps S2502-S2503 can refer to the steps S2402-S2403, which are not described here.

[0393] In some other embodiments, the display device 200 can zoom in the target artwork according to the flow shown in FIG. 10, and the specific steps are as follows: Figure 26

[0394] S2601, in response to a zooming-in instruction of the user, obtaining a third coordinate corresponding to the first position of the focus on the display screen on the target artwork.

[0395] ​​In some embodiments, a zoom-in button can be configured in the display page. If the user wants to browse the details of the art piece, the zoom-in button can be selected. The display device 200 displays a focus point in response to the selection instruction, which is used to indicate the center point of the area to be zoomed in. The user can control the focus point to move on the target art piece by the directional keys of the control device 100, to move the focus point to the position where the user wants to zoom in, and input a zoom-in instruction by the confirmation key or OK key of the control device 100 after the focus point moves to the position, to control the display device 200 to display the target art piece zoomed in in the display page.

[0396] The display device 200 obtains a third coordinate of the target art piece corresponding to the first position of the focus point on the display screen in response to the zoom-in instruction. For example, the display device 200 can determine the second position of the first position on the compressed target art piece according to the first position of the focus point on the display screen, and determine the third position on the original drawing of the target art piece corresponding to the second position according to the compression ratio, and then obtain the coordinate of the third position, i.e. the third coordinate.

[0397] S2602, according to the third coordinate, the display width and the display height of the display screen, the third picture conforming to the second resolution is cut from the target art piece.

[0398] S2603, the third picture is displayed in the display page.

[0399] Steps S2602-S2603 can refer to steps S2402-S2403, which will not be described here.

[0400] In some embodiments, the art mode application can also be configured with a holiday theme function. The display device 200 can implement the holiday theme function according to the flowchart shown in FIG. 27, and the specific steps are as follows: Figure 27

[0401] S2701, according to the system date, whether the current day is a preset holiday is identified.

[0402] The preset holiday can include international holidays, national holidays, regional holidays, etc. It can be set by the user.

[0403] S2702, if the current day is a preset holiday, a picture of a holiday theme corresponding to the preset holiday is displayed before the first art piece is displayed in the display page, and the first art piece is displayed after the carousel time.

[0404] ​If the current day is a preset festival, in order to prompt the user that the current day is a preset festival, the display device 200 displays the picture corresponding to the festival theme of the preset festival in the display page in priority after entering the art mode. Each preset festival has a corresponding festival theme, and each festival theme has a corresponding picture. For example, the festival theme corresponding to the International Children's Day is a children's day theme, and the picture corresponding to the children's day theme is a scene of several children having a party together, and a happy children's day caption.

[0405] The display duration of the picture of the festival theme can be set as a carousel time, or can be set as other duration. When the display duration of the picture of the festival theme reaches a preset duration, the first art work is displayed, and the carousel process of the art work is entered.

[0406] S2703, if the current day is not a preset festival, the first art work is displayed in the display page.

[0407] If the current day is not a preset festival, the display device 200 can directly display the first art work, and enter the carousel process of the art work.

[0408] In some embodiments, the display device 200 can only preferentially display the picture of the festival theme when automatically entering the art mode. When passively entering the art mode in response to the user's control, the picture of the festival theme is not displayed. For example, in response to the instruction input by the user selecting the icon of the art mode application, the art mode key, etc., the first art work is directly displayed, and the picture of the festival theme is not displayed.

[0409] Since the art mode application can provide a large number of art works for the user, even if the art mode application classifies and categorizes the art works for the convenience of the user to find the art work to be browsed. However, the user still needs to enter a certain two-level classification in a one-level classification according to the classification and categorization when finding the art work to be browsed, and if the two-level classification does not include the art work to be browsed, the user still needs to exit level by level and enter the one-level classification and the two-level classification again level by level until the art work to be browsed is found. It can be seen that the above operation of finding the art work to be browsed is very cumbersome, and requires the user to spend a lot of time and effort.

[0410] In order to solve the above problem and facilitate the user to quickly find the art work to be browsed, the art mode application can be configured with a hierarchical preview page to realize that the user quickly previews the art works of each level classification based on the same page.

[0411] In some embodiments, the hierarchical preview page may include a first menu and a second menu. The first menu includes titles for primary categories, and the second menu displays titles for secondary categories included in the primary category that is selected or has received focus. The second menu also includes a preview image list, which is in a single-line format and includes preview images of artworks included in the secondary category that is selected or has received focus.

[0412] In some embodiments, the first menu and the second menu can be distributed in different positions on the hierarchical preview page as needed. In the embodiments provided in this application, the example of the first menu being located at the top of the hierarchical preview page and the second menu being located at the bottom of the hierarchical preview page will be used for illustration.

[0413] In some embodiments, the title that receives focus can be displayed by: changing the background color of the area where the object is located, changing the display effect of the area where the object is located (such as a raised effect, a recessed effect, etc.), or adding one or more of these to the area where the object is located. Of course, it is not limited to the styles mentioned above.

[0414] In some embodiments, the selected title may be displayed as one or a combination of the following: changing the font color, bolding the font, enlarging the font, and adding an underline. Of course, it is not limited to the styles mentioned above.

[0415] You can refer to this. Figure 28 The tiered preview page shown includes a first menu 2801 and a second menu 2802. The first menu 2801 includes titles for primary categories, such as Art Gallery, Photo Gallery, Immersive Atmosphere, and Favorites. Art Gallery is selected. Based on the selected Art Gallery status, the second menu 2802 includes titles for secondary categories within the Art Gallery category, such as Landscape, People, Modern, Still Life, and Others. Landscape is the focus here. The second menu 2802 also includes a preview image list 2803, which, based on the focus on Landscape, includes preview images of artworks included in the Landscape category. Examples include preview images for Landscape 13, Landscape 14, Landscape 15, Landscape 16, Landscape 17, Landscape 18, and Landscape 19.

[0416] In this embodiment of the application, for ease of illustration, the corresponding artworks are represented by the format of "secondary category + order of the image in that secondary category". For example, landscape 16 represents the 16th artwork in the landscape category.

[0417] In some embodiments, the background of the tiered preview page may be transparent, as can be seen in the following reference. Figure 28 The background 2804 is transparent.

[0418] In some embodiments, the background of the hierarchical preview page can be in an opaque state, or in a semi-transparent state.

[0419] In some embodiments, the first menu can be in a semi-transparent state, and the transparency gradually increases from top to bottom, and the second menu can also be in a semi-transparent state, and the transparency is uniform everywhere.

[0420] In some embodiments, the first menu and the second menu can be in an opaque state, or in a transparent state.

[0421] In the embodiments of the present application, the background of the hierarchical preview page is in a transparent state, and the first menu and the second menu are in a semi-transparent state, and the transparency gradually changes, which is described as an example.

[0422] Reference can be made to the hierarchical preview page shown in Figure 29 Compared with the hierarchical preview page shown in Figure 28 The first menu 2901 is in a semi-transparent state, and the transparency gradually increases from top to bottom, and the second menu 2902 is in a semi-transparent state, and the transparency is uniform everywhere.

[0423] In some embodiments, the display device 200 can enter the hierarchical preview page according to the flow shown in Figure 30 The specific steps are as follows:

[0424] S3001, in response to a first instruction of the user, enter the art mode, and display a display page of the art mode application, and display a first art work in the display page.

[0425] Step S3001 can refer to steps S501-S502, which will not be described here. It is worth noting that the entered art mode does not include the art screen saver mode.

[0426] S3002, in response to a second instruction of the user, display a hierarchical preview page on the upper layer of the display page according to the first art work.

[0427] In some embodiments, the user can input the second instruction through the confirmation key or OK key of the control device 100.

[0428] The display device 200 displays the corresponding hierarchical preview page according to the art work currently displayed on the display page. Among them, according to the first level classification and the second level classification to which the art work currently displayed belongs, the second level classification displayed in the second menu is determined, and the classification title that obtains the focus and the classification title that is in the selected state are determined. When the display page currently displays the first art work, the hierarchical preview page is displayed according to the first art work.

[0429] The title of the target first-level category to which the first artwork belongs is in a selected state, the second menu includes titles of second-level categories included in the target first-level category, and the title of the target second-level category to which the first artwork belongs is focused on. The preview list includes preview pictures of artworks included in the target second-level category.

[0430] In some embodiments, the display device 200 can display the hierarchical preview page according to the first artwork in the following manner: Figure 31 The flowchart shown in the figure displays a hierarchical preview page according to a first artwork, and the specific steps are as follows:

[0431] S3101, obtain picture information of the first artwork.

[0432] The picture information includes a target first-level category and a target second-level category to which the first artwork belongs.

[0433] The process of obtaining the picture information can refer to step S502, which will not be described here.

[0434] S3102, obtain artworks included in the target second-level category.

[0435] According to the second-level categories to which the artworks belong, the artworks belonging to the target second-level category can be obtained.

[0436] S3103, display the title of the target first-level category in a selected state according to the target first-level category, focus on the title of the target second-level category according to the target second-level category, and display a preview list according to the artworks included in the target second-level category.

[0437] The display device 200 displays the title of each first-level category in the first menu, and displays the title of the target first-level category in a selected state to indicate that the first-level category to which the first artwork currently displayed by the user belongs is the target first-level category.

[0438] The display device 200 displays the titles of the second-level categories included in the target first-level category in the second menu, and focuses on the title of the target second-level category to indicate that the second-level category to which the first artwork currently displayed by the user belongs is the target second-level category. And, by focusing on the title of the target second-level category, the user can directly move the focus on the titles of the second-level categories to quickly switch between the second-level categories in the target first-level category.

[0439] The preview list includes preview pictures of artworks under the target second-level category.

[0440] In some embodiments, if the picture information of the first artwork acquired by the display device 200 includes the order of the first artwork in the target secondary classification, the preview list first displayed in the second menu can be determined according to the order and the maximum number N of the preview pictures that can be displayed at one time, the preview list first displayed in the second menu includes the preview picture of the first artwork, and the preview picture of the first artwork is located in the middle position of the preview list.

[0441] Taking the first artwork as the landscape 16 as an example, the hierarchical preview page shown in FIG. 16 can be referred to. Figure 28 The preview list 1603 first displayed in the second menu 1602 includes the preview picture corresponding to the landscape 16, and the preview picture is located in the middle position of the preview list 1603.

[0442] In other embodiments, if the picture information of the first artwork acquired by the display device 200 does not include the order of the first artwork in the target secondary classification, the preview list first displayed in the second menu can be determined according to the maximum number N of the preview pictures that can be displayed at one time, the preview list first displayed in the second menu includes the preview pictures of the first N artworks from the first artwork in the target secondary classification. The preview list first displayed in the second menu can include the preview picture of the first artwork or can not include the preview picture of the first artwork.

[0443] Taking the first artwork as the landscape 16 as an example, the hierarchical preview page shown in FIG. 16 can be referred to. Figure 32 The preview list 3202 first displayed in the second menu 3201 includes the preview pictures corresponding to the landscape 1, the landscape 2, the landscape 3, the landscape 4, the landscape 5, the landscape 6, and the landscape 7, and does not include the preview picture corresponding to the landscape 16.

[0444] In some embodiments, the art mode application can be configured to display different pages through a multi-level OSD layer structure. The OSD layer at a higher level is displayed on the OSD layer at a lower level, and the OSD layer at the highest level is displayed as the uppermost layer, and the focus is obtained by the OSD layer at the uppermost layer.

[0445] The art mode application is configured such that the level of the OSD layer for displaying the hierarchical preview page is higher than the level of the OSD layer for displaying the display page. Therefore, the hierarchical preview page will be displayed above the display page, and the focus will be obtained by the hierarchical preview page.

[0446] In the embodiments of the present application, the display page can be configured to be displayed on the first OSD layer, the hierarchical preview page can be configured to be displayed on the second OSD layer, the global preview page (which will be described in detail later) can be configured to be displayed on the third OSD layer, and the pop-up window, prompt box and the like can be configured to be displayed on the fourth OSD layer. Among them, in the order of display layer from bottom to top, they are the first OSD layer, the second OSD layer, the third OSD layer, and the fourth OSD layer.

[0447] In combination with the hierarchical preview page shown in FIG. 13B, the process of displaying the hierarchical preview page above the display page can refer to FIG. 13C. Figure 28 As shown in FIG. 13D, the display page 3301 is displayed on the first OSD layer, and the hierarchical preview page 3302 is displayed on the second OSD layer. Among them, the second OSD layer is located above the first OSD layer. The effect of displaying the hierarchical preview page 3302 above the display page 3301 can refer to FIG. 13E. Figure 33 As shown in FIG. 13D, the display page 3301 is displayed on the first OSD layer, and the hierarchical preview page 3302 is displayed on the second OSD layer. Among them, the second OSD layer is located above the first OSD layer. The effect of displaying the hierarchical preview page 3302 above the display page 3301 can refer to FIG. 13E. Figure 33 Figure 33

[0448] In some embodiments, when the title of the target secondary classification obtains the focus, the display device 200 can display a preview list including a preview of the first art piece in response to a downward instruction of the user, and obtain the focus on a first preview corresponding to the first art piece, and display the title of the target secondary classification as a selected state.

[0449] In some embodiments, the user can input the downward instruction through the down key of the control device 100.

[0450] In some embodiments, when the title of the target secondary classification obtains the focus, if the preview list first displayed in the second menu includes the preview of the first art piece, and the preview of the first art piece is located in the middle position of the preview list, the display device 200 can directly move the focus to the preview of the first art piece in response to the downward instruction. In the above process of moving the focus, the preview in the preview list will not change.

[0451] In combination with the hierarchical preview page shown in FIG. 13B, the process of displaying the hierarchical preview page above the display page can refer to FIG. 13C. Figure 28 As shown in FIG. 13D, the display page 3301 is displayed on the first OSD layer, and the hierarchical preview page 3302 is displayed on the second OSD layer. Among them, the second OSD layer is located above the first OSD layer. The effect of displaying the hierarchical preview page 3302 above the display page 3301 can refer to FIG. 13E. Figure 34

[0452] ​​​In some embodiments, when the focus is obtained by the title of the target secondary category, if the list of preview images displayed in the second menu first includes preview images of N pieces of artwork starting from the first artwork in the target secondary category, and the preview images do not include the first preview image of the first artwork, the display device 200 needs to display the first preview image of the first artwork in the list of preview images first in response to the downward instruction. In the embodiments provided in the present application, the preview images of the artworks can be sequentially scrolled to the list of preview images for display in the order of arrangement of the artworks. Therefore, the process of displaying the first preview image of the first artwork in the list of preview images can be that the preview images of the artworks are sequentially scrolled to the list of preview images until the first preview image is scrolled to the middle position of the list of preview images, and after the first preview image is displayed at the middle position of the list of preview images, the focus is moved to the first preview image.

[0453] In combination with Figure 32 the hierarchical preview page shown in FIG. 30B, the display device 200 can scroll the preview image of the landscape 16 to the middle position of the list of preview images, move the focus to the preview image of the landscape 16, and display the landscape category in the selected state in response to the downward instruction. Figure 34

[0454] In some embodiments, the second menu can further include a first information display area for displaying the category information of the secondary category in the selected state or where the focus is located, which can include the total number of artworks included in the secondary category, etc.

[0455] In combination with Figure 35 the hierarchical preview page shown in FIG. 30B, the hierarchical preview page can further include a first information display area 3501. Taking the landscape category in the selected state as an example, the total number of artworks included in the landscape category, such as 30 pieces, is displayed in the first information display area 3501.

[0456] In some embodiments, the preview images in the list of preview images are displayed in a horizontal display area. In combination with Figure 28 the list of preview images 2803 shown in FIG. 28B, the list of preview images 2803 includes display areas for displaying preview images, and each display area is in a horizontal direction, i.e., a horizontal display area.

[0457] Taking the first preview image as an example, if the first preview image is in a vertical direction, the first preview image can be displayed in the horizontal display area in the following manner:

[0458] In some embodiments, in order to display the complete first preview image, the first preview image can be proportionally reduced so that the first preview Figure 1 ​All items are displayed in the horizontal display frame.

[0459] In some embodiments, to accommodate the size of the display frame, the width of the first preview image can be adapted to the width of the display frame, so that the first preview image can be displayed in full screen within the horizontal display frame. However, the first preview image cannot be fully displayed within the horizontal display frame at once. In this case, key parts of the first preview image can be displayed within the horizontal display frame. For example, if the first preview image is a portrait image, the parts including the face can be displayed within the horizontal display frame.

[0460] When the first preview image gains focus, if the first preview image is vertical and not fully displayed in the horizontal display area at once, the first preview image can be scrolled up and down within the horizontal display area.

[0461] You can refer to this. Figure 36 The hierarchical preview page shown in ① focuses on the preview image of person 14. Because the preview image of person 14 is vertical and cannot be fully displayed within the horizontal display frame, the parts of person 14 that include the face image can be displayed first. This can be done as follows: Figure 36 As shown in ②, the preview image of character 14 is scrolled up and down within the horizontal display frame to show the full content of the preview image of character 14.

[0462] When displaying preview images in a vertical display area in the preview image list, if the first preview image is horizontal, you can refer to the process of scrolling to display the first vertical preview image within the horizontal display frame. In this case, you can scroll left and right within the vertical display frame to display the first preview image.

[0463] In some embodiments, the display device 200 can be configured to... Figure 37 The process shown updates the preview image list in response to the user's selection of a primary category. The specific steps are as follows:

[0464] S3701, in response to a user's instruction to move the focus, moves the focus on the title of the first-level category.

[0465] After entering the tiered preview page, the user can input an upward command by pressing the up button on the control device 100. The display device 200 responds to the upward command and gains focus from the title of the target primary category.

[0466] After the title of the target primary category gains focus, the user can input a command to move the focus using the left or right mouse button on the control device 100. The display device 200 responds to this command by moving the focus to the titles of each primary category.

[0467] S3702, when the first primary classification is focused on by the title of the first primary classification, obtaining the first secondary classification included by the first primary classification, and obtaining the art works included by the first secondary classification, and canceling the selected state of the title of the target primary classification.

[0468] The first primary classification is a primary classification that the user wants to browse.

[0469] According to the mapping relationship between the primary classification and the secondary classification, all secondary classifications included by the first primary classification, i.e., the first secondary classification, can be obtained. And after obtaining the first secondary classification, the first first secondary classification in each first secondary classification can be determined, and then the art works belonging to the first first secondary classification can be obtained according to the secondary classification to which each art work belongs. After the title of the first primary classification is focused on, the selected state of the title of the target primary classification is canceled.

[0470] In combination Figure 28 As shown in the hierarchical preview page, when the art gallery is focused on, the focus can be moved on the title of each primary classification in response to the user's instruction to move the focus. For example, as shown in the hierarchical preview page Figure 38 The selected state of the art gallery is canceled. The secondary classifications included by the photo set are obtained, such as my photos and photo themes. Among them, the first first secondary classification is my photos, and the art works included by my photos, i.e., each imported photo, are obtained.

[0471] S3703, displaying the title of the first secondary classification in the second menu, wherein the title of the first first secondary classification is in a selected state; updating the preview list, the updated preview list including the preview of the art work included by the first first secondary classification, the preview of the first art work included by the first first secondary classification being displayed at the first position of the preview list; and switching the first art work displayed in the display page to the first art work included by the first first secondary classification.

[0472] Referring to Figure 38 As shown in the hierarchical preview page, my photos and photo themes are displayed in the second menu 3801, and my photos are in a selected state. The display device 200 updates the preview list, and the updated preview list includes the previews of photo 1 to photo 5, wherein the preview of the first art work, i.e., the preview of photo 1, is displayed at the first position of the preview list, and the previews of photo 2 to photo 5 are displayed in turn. The display device 200 switches the landscape 16 displayed in the display page to photo 1.

[0473] In some embodiments, when the focus is obtained by the first first-subcategory title, the display device 200 can obtain the focus by the first first-subcategory title in response to the user inputting a downward instruction through the down key of the control device 100, and display the first first-subcategory title in a selected state.

[0474] In some embodiments, when the focus is obtained by the first first-subcategory title, and the first artwork included in the first first-subcategory is displayed in the display page, the display device 200 can obtain the focus by the preview image of the first artwork in response to the user inputting a downward instruction through the down key of the control device 100, and display the first first-subcategory title in a selected state.

[0475] In some embodiments, the display device 200 can update the preview image list in response to the user selecting a subcategory, as shown in the flow, and the specific steps are as follows: Figure 39

[0476] S3901, in response to the user inputting an instruction of moving the focus, moving the focus on the title of the subcategory.

[0477] After entering the hierarchical preview page, the focus is obtained by the title of the target subcategory. The user can input an instruction of moving the focus through the left key or the right key of the control device 100. The display device 200 moves the focus on the title of each subcategory in response to the instruction.

[0478] S3902, when the focus is obtained by the title of the second subcategory, obtaining the artworks included in the second subcategory, and displaying the title of the target subcategory in a selected state.

[0479] The second subcategory is the subcategory included in the target first category and wanted to be browsed by the user.

[0480] The process of obtaining the artworks included in the second subcategory can refer to the process of obtaining the artworks included in the first first-subcategory in step S3702, which is not described here.

[0481] The display device 200 displays the title of the target subcategory in a selected state to indicate the subcategory to which the artwork currently displayed in the display page belongs.

[0482] S3903, updating the preview image list, and the updated preview image list includes the preview images of the artworks included in the second subcategory, and the preview image of the first artwork included in the second subcategory is displayed at the first position of the preview image list.

[0483] Step S3903 can refer to step S3703. After updating the preview image list, the display device 200 does not follow the updated preview image list to switch the artwork displayed in the display page.​

[0484] Combination Figure 28 The hierarchical preview page shown allows the focus to be moved to the titles of each sub-category in response to user commands when the "Landscape" category gains focus. For example, when the title of the "People" category gains focus, the focus can be moved to the titles of the sub-categories. Figure 40 The tiered preview page shows the landscape category title as selected. It retrieves the artworks included in the people category and updates the preview image list, which now includes preview images for people 1 through 7. The first artwork preview image, i.e., the preview image for person 1, is displayed at the top of the preview image list, followed by preview images for people 2 through 7 in sequence. Landscape 16 is still displayed on the page.

[0485] In some embodiments, the display device 200 can be configured to... Figure 41 The process shown here switches between the displayed artworks on the page. The specific steps are as follows:

[0486] S4101, in response to a user's command to move the focus, moves the focus on each preview image.

[0487] S4102, when the target preview image gains focus, in response to the user's instruction to select the target preview image, the artwork displayed on the display page is switched to the artwork corresponding to the target preview image, and the hierarchical preview page is exited.

[0488] When a user moves their focus to a target preview image that they want to zoom in on, the user can control the display device 200 to select that target preview image. The display device 200 then switches the first artwork displayed on the page to the artwork corresponding to the target preview image and exits the hierarchical preview page.

[0489] After the display device 200 switches the artwork displayed on the page to the artwork corresponding to the target preview image, it starts to rotate through the artwork corresponding to the target preview image.

[0490] You can refer to this. Figure 42 As shown in ①, on the tiered preview page, if the user wants to zoom in on the preview image of landscape 18, they can move the focus to the preview image of landscape 18 and select it. The display device 200 will then... Figure 42 As shown in ②, scenery 18 is displayed on the display page, and the hierarchical preview page is exited.

[0491] In other embodiments, the display device 200 may be in accordance with Figure 43 The process shown here switches between the displayed artworks on the page. The specific steps are as follows:

[0492] S4301, in response to a user's command to move the focus, moves the focus on each preview image.

[0493] S4302, when the focus is obtained by the target preview picture, if no user operation is detected within a specified time period, the art painting displayed in the showcase page is switched to the art painting corresponding to the target preview picture.

[0494] When the focus moves on the preview picture, if the display device 200 does not detect a user operation within a specified time period, it indicates that the focus has been on a preview picture for a long time, such as on the target preview picture. The display device 200 switches the art painting displayed in the showcase page to the art painting corresponding to the target preview picture, but does not exit the hierarchical preview page.

[0495] After the display device 200 switches the art painting displayed in the showcase page to the art painting corresponding to the target preview picture, it starts to cycle from the art painting corresponding to the target preview picture.

[0496] Reference can be made to the hierarchical preview page shown in Figure 44 If the user controls the focus to move to the preview picture of landscape 18, and there is no operation within a specified time period, such as within 1 min, the display device 200 displays landscape 18 in the showcase page as shown in Figure 44

[0497] In some embodiments, the art mode application can be configured so that the focus can be moved between each second-level category under the same first-level category without the user manually switching the second-level category, thereby realizing seamless switching between each second-level category under the same first-level category.

[0498] In some embodiments, the display device 200 can move the focus on the preview picture corresponding to the art painting included in the target first-level category including all second-level categories in response to the user's instruction to move the focus.

[0499] Wherein, according to the first order of all second-level categories included in the target first-level category, the first order is consistent with the display order of the title of the second-level category in the second menu, when the preview picture of the first art painting included in the current second-level category obtains the focus, in response to the user's instruction to move the focus to the left, update the preview picture list, and the updated preview picture list includes the preview picture of the art painting included in the previous second-level category, and the preview picture of the art painting included in the previous second-level category obtains the focus.

[0500] When the preview picture of the last art painting included in the current second-level category obtains the focus, in response to the user's instruction to move the focus to the right, update the preview picture list, and the updated preview picture list includes the preview picture of the art painting included in the next second-level category, and the preview picture of the art painting included in the next second-level category obtains the focus. ​

[0501] In some embodiments, the art mode application may be configured with a global preview function. The second menu may also be configured with a first arrow, which is displayed in a position corresponding to the preview image list, such as below the preview image list. The first arrow is used to instruct the user to enter the global preview page using a first directional key on the control device 100 that indicates the same direction as the first arrow. For example, if the first arrow is a downward arrow, the user can use the down arrow key on the control device 100 to control the display device 200 to enter the global preview page.

[0502] In some embodiments, when a first artwork is displayed on the display page and focuses on the first preview image, the display device 200, in response to a user's instruction input based on a first directional key, can display a global preview page based on the focused first preview image. This global preview page includes a third menu and a global preview image list. The third menu includes titles of the second-level categories included in the target first-level category, wherein the focus is obtained from the title of the target second-level category. The global preview image list is in a grid format and includes preview images of artworks included in the target second-level categories. Thus, through the global preview page, the user can browse preview images of artworks in each second-level category within the first-level category of the currently displayed artwork.

[0503] In some embodiments, upon entering the global preview page, the first thing displayed is a list of global preview images corresponding to the selected secondary categories in the hierarchical preview page. This initial list of global preview images is equivalent to the preview images displayed when the entire list in the hierarchical preview page is expanded. This ensures consistency between the content displayed on the hierarchical preview page and the global preview page.

[0504] In some embodiments, the global preview page is opaque.

[0505] You can refer to this. Figure 45 The hierarchical preview page shown in Figure ① includes a first arrow 4501, which is displayed below the preview image list 4502. The display device 200 can respond to a user's input via a down arrow key on the control device 100, and display the following on top of the hierarchical preview page: Figure 45 The global preview page shown in ② is a third menu 4503. Taking the currently displayed landscape 16 as an example, the third menu 4503 includes titles for the secondary categories of the art gallery, such as Landscape, Portrait, Modern, Still Life, and Other. The title of the Landscape category is the focal point. The global preview page also includes a global preview image list 4504, which contains preview images of all artworks included in the Landscape category. Taking all artworks included in the Landscape category as Landscapes 1-18 as an example, the global preview image list 4504 includes preview images of Landscapes 1-18.

[0506] In some embodiments, if the list of global preview images cannot be displayed all at once in the global preview page, the user can control the display device 200 to scroll the list of global preview images in the global preview page.

[0507] In some embodiments, when the user controls the display device 200 to scroll the list of global preview images in the global preview page, a top button can be configured in the global preview page for quickly displaying the first row of preview images. Based on the top button, the user can control the display device 200 to quickly scroll to the first row of preview images in the list of global preview images.

[0508] Reference can be made to the top button 4505 in Figure 45

[0509] In some embodiments, the top button can be displayed in the global preview page all the time. When the first row of preview images is displayed in the global preview page, i.e., the list of global preview images has not been scrolled in the global preview page, the top button can be grayed out to indicate that the first row of preview images is currently displayed and the top button is not available. When the first row of preview images is not displayed in the global preview page, i.e., the list of global preview images is scrolled in the global preview page, the top button can be ungrayed.

[0510] In some other embodiments, the top button can be hidden when the first row of preview images is displayed in the global preview page. The top button can be displayed when the first row of preview images is not displayed in the global preview page.

[0511] In some embodiments, the user can switch the art piece displayed in the display page based on the global preview page. The user can control the display device 200 to move the focus to a target preview image that the user wants to zoom in and select the target preview image. The display device 200 exits the global preview page and switches the art piece displayed in the display page to the art piece corresponding to the target preview image. After the display device 200 switches the art piece displayed in the display page to the art piece corresponding to the target preview image, the display device 200 starts to cycle through the art pieces starting from the art piece corresponding to the target preview image.

[0512] To enable the user to customize the displayed art pieces, the art mode application is configured with a photo import function. In this way, the user can import photos to the display device 200. Correspondingly, the first-level categories of the art mode application include a photo set category, and the second-level categories included in the photo set category can include a my photos category. The art mode application can configure a photo import entry in the list of preview images corresponding to the my photos category. In this way, the user can import photos based on the import entry. If the user imports photos to the display device 200, the my photos category includes the imported photos (hereinafter referred to as photos).

[0513] ​In some embodiments, in the art mode, the user can control the display device 200 to enter a my photo category, in which the display device 200 displays a list of preview images including preview images of photos and an import entry of the photos. The display device 200 can exit the hierarchical preview page and switch the art paintings in the showcase page to the selected photo and carousel the photos starting from the selected photo in response to an instruction of the user selecting a preview image of a photo. However, the showcase effect of the carousel photos is relatively lack of personalized style and poor in visual effect.

[0514] To solve the above problems, the art mode application can be configured with different themes for showcasing the photos, each theme corresponding to a different showcase style. For example, a dynamic album theme, the showcase style of which can be to play the photos in the form of picture fade-in and fade-out; a magazine theme, the showcase style of which can be to play the photos in a magazine style and a rotation mode; a collage theme, the showcase style of which can be to add a photo frame to the photos with animation; a multi-frame theme, the showcase style of which can be to showcase multiple photos at the same time and add a photo frame to each photo; a memory theme, the showcase style of which can be to play the photos in a rotation and magnification form. Correspondingly, the secondary categories included in the photo set category further include a photo theme category, which includes at least one theme. In this way, the user can select any one of the at least one theme to play the photos. The way of playing the photos according to the user's selected theme can more fully reflect the user's personalization, and since the theme has rich showcase styles, the visual effect of showcasing the photos can be improved.

[0515] In some embodiments, each theme is associated with at least one theme template. The theme template can include a to-be-replaced picture and a background picture. The to-be-replaced picture is located on the upper layer of the background picture, and the to-be-replaced picture can be replaced by a photo while the background picture cannot be replaced by a photo when the theme template is used.

[0516] The display direction of the to-be-replaced picture can be horizontal or vertical, where if the width of the to-be-replaced picture is greater than the height, the display direction is horizontal; if the height of the to-be-replaced picture is greater than the width, the display direction is vertical.

[0517] The number of to-be-replaced pictures is greater than or equal to 1, that is, the theme template includes at least one to-be-replaced picture, that is, at least one photo can be displayed using the theme template.

[0518] The to-be-replaced picture can be displayed vertically, horizontally, or at a certain angle.

[0519] The to-be-replaced picture can be located at different positions on the background picture.

[0520] If there are multiple images to be replaced, these images may or may not overlap.

[0521] The image to be replaced can be the default image provided by the Art Mode application.

[0522] At least one theme template associated with each theme has a style consistent with the theme's presentation style.

[0523] In some embodiments, different theme templates can be configured for the corresponding theme according to the display direction, quantity, display angle, occlusion relationship, display position, etc. of the images to be replaced.

[0524] For example, you can refer to the dynamic photo album theme. Figure 46 The theme template shown. The Dynamic Album theme can be linked with 14 other theme templates, in order to... Figure 46 As shown in ①, the theme template includes images 4601 and 4602 to be replaced, and a background image 4603. Among them, as... Figure 46 The theme templates shown in ①-④ all include images to be replaced in a horizontal orientation. For example... Figure 46 The theme templates shown in ⑤-⑧ all consist of only one vertical image to be replaced. For example... Figure 46 middle The shown theme templates all include two vertically oriented images to be replaced. For example... Figure 46 middle The theme templates shown all include three vertically arranged images to be replaced.

[0525] The art mode application is configured so that after the user selects a theme, it automatically chooses a suitable target theme template from the associated theme templates and displays the photos according to that target theme template. This target theme template can be matched with the number of photos and the display orientation, thus ensuring the quality and effect of the photo display. Therefore, users only need to select their preferred display style, i.e., the theme, without having to spend time manually matching photos with various theme templates.

[0526] In some embodiments, the display device 200 can be configured to... Figure 46 The process shown displays photos according to their themes, and the specific steps are as follows:

[0527] S4701, in response to the user opening a photo theme category, update the preview image list, the updated preview image list includes preview images of at least one theme.

[0528] Taking the example that the display device 200 currently displays the first art painting in the exhibition page, the display device 200 can enter the hierarchical preview page according to steps S3001-S3002, which are not described herein.

[0529] When displaying the hierarchical preview page, the display device 200 can open the photo set classification according to the flow shown in FIG. 48, and the specific steps are as follows: Figure 47

[0530] S4801, in response to the instruction of the user moving the focus to the title of the photo set classification, obtaining the focus from the title of the photo set classification.

[0531] Step S4801 can refer to the process of moving the focus to the title of the target first-level classification shown in step S3701, which is not described herein.

[0532] S4802, judging whether the theme is currently set.

[0533] When the title of the photo set classification obtains the focus, the display device 200 acquires the second-level classifications included in the photo set classification, such as the My Photos classification and the Photo Themes classification. The display device 200 also acquires the setting parameters of the theme, for example, if the user has ever entered the Photo Themes classification and used the themes in it to display photos, or has set the theme to be used, the setting parameters of the theme include the theme that has been used last time, or the theme that has been set. If the user has not used the themes in the Photo Themes to display photos, and has not set the theme to be used, the setting parameters of the theme include no theme. In this way, the display device 200 can judge whether the theme is currently set according to the setting parameters of the theme, wherein if the setting parameters include the theme that has been used last time, or the theme that has been set, the theme is currently set. If the setting parameters include no theme, the theme is not currently set.

[0534] In some embodiments, whether the theme is set can be recorded by a theme flag bit, for example, 0 represents no theme, and 1-5 respectively represent one of the Dynamic Album theme, the Magazine theme, the Collage theme, the Multi-Frame theme, and the Memories theme. In this way, the display device 200 can judge whether the theme is currently set by reading the theme flag bit, wherein if the theme flag bit is 0, the theme is not currently set. If the theme flag bit is one of the values 1-5, the theme is currently set, and the set theme is the theme corresponding to the value.

[0535] In some embodiments, the Art Mode application can configure the setting item of the photo theme in the Art Mode setting page, which can refer to FIG. 49. Figure 48 ​The illustrated artistic mode setting page includes a photo theme setting item 4901, which can be a menu setting item. In response to a user selecting the photo theme setting item 4901, the display device 200 displays a drop-down menu below the photo theme setting item 4901, which includes themes included in the photo theme classification, in the same order as in the hierarchical preview page. The user can select a target theme from the drop-down menu, and the display device 200 sets the target theme as the theme used by default after entering the photo theme classification. Figure 49 As illustrated, the drop-down menu includes a dynamic album. The drop-down menu also includes no theme. If the user does not want to use a theme to display photos, the user can select no theme, and the display device 200 sets no theme as the theme used by default after entering the photo theme classification.

[0536] In some embodiments, when displaying the display page, the display device 200 can display a shortcut menu on the display page in response to a user inputting an instruction through a first key of the control device 100. The shortcut menu includes an entry of the artistic mode application setting page. In response to a user selecting the entry, the display device 200 displays the artistic mode application setting page.

[0537] In some embodiments, the first key can be a system application key of the control device 100, i.e., a key having a default system function, such as a menu key, a color key, or the like.

[0538] In some embodiments, the first key can be a special key of the control device 100, which does not have a default system function, but is used only to open an application setting menu.

[0539] In the embodiments of the present application, the first key is taken as an example of a menu key.

[0540] S4803, if no theme is currently set, the title of the my photo classification is in a selected state, and after receiving an instruction of the user moving the focus to the title of the photo theme classification, the title of the photo theme classification obtains the focus to open the photo theme classification.

[0541] In some embodiments, the display device 200 can display the photos in the order of Figure 49 As illustrated, the display device 200 displays the photos in the order of

[0542] S5001, if no theme is currently set, the title of the my photo classification is in a selected state, and after receiving an instruction of the user moving the focus to the title of the photo theme classification, the title of the photo theme classification obtains the focus to open the photo theme classification.

[0543] S5002, starting from the first photo, carousel each photo.

[0544] Steps S5001-S5002 can refer to steps S3703, which will not be repeated here. The carousel process can refer to step S503, which will not be repeated here either.

[0545] The user can refer to Figure 50 The hierarchical preview page shown in FIG. 5B, when the title of the photo set classification is focused, if the theme is not currently set, the title of the my photo classification is in the selected state, the preview list includes the preview of the photo, such as the preview of photo 1-photo 3, and also includes the import entry 5101 of the photo, which is displayed after the last photo.

[0546] If the user wants to import photos, the user can import photos through the import entry 5101.

[0547] If the user wants to play photos using a theme, the user can control the focus to move to the title of the photo theme, and when the title of the photo theme classification is focused, the display device 200 will open the photo theme classification

[0548] S4804, if the theme is currently set, the title of the photo theme classification is in the selected state to open the photo theme classification.

[0549] If the theme is currently set, it means that the user is more inclined to use the theme to display the photos, so the title of the photo theme classification is preferentially in the selected state to preferentially open the photo theme classification.

[0550] After the display device 200 opens the classification of the photo theme, the preview list will be updated, and the updated preview list includes the preview of the themeless and the preview of each theme. The user can refer to Figure 51 The hierarchical preview page shown in FIG. 5B, when the title of the photo set classification is focused, if the theme is not currently set, the title of the my photo classification is in the selected state, the preview list includes the preview of the photo, such as the preview of photo 1-photo 3, and also includes the import entry 5101 of the photo, which is displayed after the last photo.

[0551] In some embodiments, the preview of each theme can be the preview of any theme template included in the theme.

[0552] In other embodiments, the preview of the currently set theme can be the preview of the last used theme template.

[0553] In some embodiments, if a theme has been set, the display device 200 displays the photos in the showcase page according to the theme that has been set after the title of the photo theme is displayed in the selected state.

[0554] S4702, in response to the instruction that the user selects the first theme, the hierarchical preview page is exited, and the photos included in the my photo category are displayed in the showcase page according to the first theme. Wherein, each photo is displayed according to the target first theme template associated with the first theme.

[0555] The number and display direction of the to-be-replaced pictures included in the target first theme template match the number and display direction of the photos.

[0556] In some embodiments, the display device 200 can display the photos according to the first theme as shown in the flow, and the specific steps are as follows: Figure 52

[0557] S5301, determine the target first theme template from the first theme templates associated with the first theme.

[0558] In some embodiments, a first theme template can be randomly determined from the first theme templates as the target first theme template.

[0559] In some embodiments, the target first theme template can be determined according to the number and display direction of the photos.

[0560] For example, if the number of photos is small, such as less than or equal to the minimum number of to-be-replaced pictures in each first theme template, a first theme template whose to-be-replaced pictures can include the display direction of each photo can be determined from the first theme templates with the minimum number of to-be-replaced pictures, and the first theme template is taken as the target first theme template.

[0561] For another example, if the number of photos is large, such as more than the minimum number of to-be-replaced pictures in each first theme template, a first theme template whose to-be-replaced pictures can be divided by the number of photos can be selected, and a first theme template whose to-be-replaced pictures can include the display direction of each photo can be further selected from the first theme templates, and the first theme template is taken as the target first theme template.

[0562] Wherein, the display direction of the to-be-replaced pictures can include the display direction of each photo means that if the display direction of each photo is horizontal, the first theme template can only include to-be-replaced pictures in horizontal direction; if the display direction of each photo is vertical, the first theme template can only include to-be-replaced pictures in vertical direction; if the display direction of each photo is both horizontal and vertical, the first theme template needs to include to-be-replaced pictures in horizontal direction and to-be-replaced pictures in vertical direction.

[0563] ​S5302, obtain the first number and display direction of the images to be replaced in the target first theme template.

[0564] Based on the configuration file corresponding to the target primary theme template, the images to be replaced in the target primary theme template can be determined, thereby determining the total number of images to be replaced, i.e., the primary number, and the display direction of each image to be replaced.

[0565] S5303: Each time, a first number of photos to be displayed are selected from the photos to obtain at least one set of photos to be displayed. The display direction of each set of photos to be displayed is the same as the display direction of the image to be replaced, and the photos to be displayed in each set are not repeated.

[0566] Following the logic of matching photos to a fixed theme template, the photos to be displayed are determined. Among them, the photos that will be displayed simultaneously in the target first theme template are the same group of photos to be displayed.

[0567] When matching photos, photos can be selected sequentially to form the first set of photos to be displayed, with no repetition between sets. The photos in a set must meet the display orientation requirements for constituting a set of photos. This requirement includes that the display orientation of the set of photos is consistent with the display orientation of each image to be replaced in the target primary theme template. For example, if the target primary theme template includes one horizontal image to be replaced and one vertical image to be replaced, then only one horizontal photo and one vertical photo can constitute a set of photos to be displayed.

[0568] Taking the first theme as a dynamic photo album as an example, combined with Figure 53 The theme templates shown and Figure 46 The photo shown. If randomly determined... Figure 54 The theme template shown in section ⑤ is the target first theme template. Photos 1-8 can be selected sequentially as a group of photos to be displayed. During the selection process, two photos are selected at a time as a group of photos to be displayed. Based on the display orientation of the images to be replaced and the display orientation of the photos themselves, it can be determined that photos 1 and 2 cannot form a group of photos to be displayed, while photos 1 and 3 can form a group of photos to be displayed. After forming a group of photos to be displayed, the grouping process continues starting from the first unselected photo, i.e., starting from photo 2. Therefore, photos 2 and 4 can form a group of photos to be displayed. Similarly, photos 5 and 6 can form a group of photos to be displayed, and photos 7 and 8 can form a group of photos to be displayed.

[0569] In some embodiments, to ensure that there is no repetition between groups of photos to be displayed, selected photos can be marked or removed from the queue of photos to be selected.

[0570] In some embodiments, when matching the photos according to the fixed theme template, the display direction of the unselected photos may not meet the requirement of the display direction of the group of photos to be displayed, and if the unselected photos are forced to form a group of photos to be displayed, the display direction of the photos may be different from the display direction of the specified pictures to be replaced, resulting in incomplete display of the photos.

[0571] To solve this problem, in some embodiments, the display device 200 can form a group of photos to be displayed by the unselected photos and the specified pictures. The group of photos to be displayed includes at least one unselected photo and at least one specified picture, and the display direction of the at least one unselected photo and the at least one specified picture meets the requirement of the display direction of the group of photos to be displayed.

[0572] For example, if the unselected photos include the portrait photo 9 and the portrait photo 10, the display device 200 can form a group of photos to be displayed by the portrait photo 9 and a specified picture in landscape, and form another group of photos to be displayed by the portrait photo 10 and a specified picture in landscape. In this way, the display effect of the portrait photo 9 and the portrait photo 10 can be ensured. Figure 46 For example, if the unselected photos include the portrait photo 9 and the portrait photo 10, the display device 200 can form a group of photos to be displayed by the portrait photo 9 and a specified picture in landscape, and form another group of photos to be displayed by the portrait photo 10 and a specified picture in landscape. In this way, the display effect of the portrait photo 9 and the portrait photo 10 can be ensured.

[0573] In other embodiments, the display device 200 can also determine a target first theme template according to the unselected photos, and the number and display direction of the specified pictures included in the determined target first theme template can match the number and display direction of the unselected photos.

[0574] For example, if the unselected photos include the portrait photo 9 and the portrait photo 10, the display device 200 can form a group of photos to be displayed by the portrait photo 9 and a specified picture in landscape, and form another group of photos to be displayed by the portrait photo 10 and a specified picture in landscape. In this way, the display effect of the portrait photo 9 and the portrait photo 10 can be ensured. Figure 46 For example, if the unselected photos include the portrait photo 9 and the portrait photo 10, the display device 200 can form a group of photos to be displayed by the portrait photo 9 and a specified picture in landscape, and form another group of photos to be displayed by the portrait photo 10 and a specified picture in landscape. In this way, the display effect of the portrait photo 9 and the portrait photo 10 can be ensured.

[0575] In some embodiments, when matching the photos according to the fixed theme template, the number of unselected photos may be less than the number of specified pictures to be replaced in the target first theme template, and in this case, there may be a vacancy in the target first theme template.

[0576] To solve this problem, in some embodiments, the display device 200 can form a group of photos to be displayed by the unselected photos and the specified pictures, and the total number of the unselected photos and the specified pictures is equal to the number of the specified pictures to be replaced, and the display direction of the unselected photos and the specified pictures meets the requirement of the display direction of the group of photos to be displayed.

[0577] For example, if the unselected photos include the portrait photo 9 and the portrait photo 10, the display device 200 can form a group of photos to be displayed by the portrait photo 9 and a specified picture in landscape, and form another group of photos to be displayed by the portrait photo 10 and a specified picture in landscape. In this way, the display effect of the portrait photo 9 and the portrait photo 10 can be ensured. Figure 46For example, if the unselected photos include a portrait photo 9, if the photo 9 is displayed in the target first theme template alone, a vacancy will appear. The display device 200 can group the portrait photo 9 and a designated picture in a horizontal direction into a set of photos to be displayed, and fill the vacancy in the target first theme template with the designated picture.

[0578] In some embodiments, the display device 200 can also determine a target first theme template according to the unselected photos, and the target first theme template determined again includes a number of pictures to be replaced and a display direction that can match a number of unselected photos and a display direction.

[0579] In some embodiments, the designated picture can be a default picture. The default picture can be a corresponding picture to be replaced in the target first theme template, or an artwork in an art gallery.

[0580] In some embodiments, the designated picture can be a selected photo. For example, if the unselected photos include a portrait photo 9, the display device 200 can group the portrait photo 9 and a selected photo 1 into a set of photos to be displayed, i.e., reuse the photo 1. Figure 46 For example, if the unselected photos include a portrait photo 9, the display device 200 can group the portrait photo 9 and a selected photo 1 into a set of photos to be displayed, i.e., reuse the photo 1.

[0581] S5304, display the at least one set of photos to be displayed in the display page according to the target first theme template.

[0582] After determining the sets of photos to be displayed, exit the hierarchical preview page, and display each set of photos to be displayed in the display page according to the target first theme template.

[0583] In some embodiments, each set of photos to be displayed is displayed for a preset display duration. The preset display duration is a display duration of each set of photos to be displayed, and when the display duration of each set of photos to be displayed reaches the preset display duration, the next set of photos to be displayed is switched to be displayed.

[0584] For example, if the groups are a group of the photo 1 and the photo 3, a group of the photo 2 and the photo 4, a group of the photo 5 and the photo 6, and a group of the photo 7 and the photo 8, the preset display duration is 10 minutes, and the dynamic album theme is used, the photo 1 and the photo 3 are displayed first, after 10 minutes, the photo 2 and the photo 4 are switched to be displayed, after 10 minutes, the photo 5 and the photo 6 are switched to be displayed, and after 10 minutes, the photo 7 and the photo 8 are switched to be displayed.

[0585] In some embodiments, the display device 200 can display the photos according to the first theme as shown in the flowchart of FIG. 13. Figure 46 The display device 200 displays the photos according to the first theme as shown in the flowchart of FIG. 13, and the specific steps are as follows:

[0586] S5501, group the photos according to their order to obtain at least one group of photos to be displayed, wherein the number of photos to be displayed in each group is the second quantity.

[0587] The second number is less than or equal to the maximum number of images to be replaced in each of the first theme templates.

[0588] The second number of photos to be displayed in each group can be the same or different.

[0589] The order in which the photos are to be displayed in each group is consistent with the order of the photos themselves, and the order in which the photos are to be displayed within each group is also consistent with the order of the photos themselves.

[0590] Each group should present photos that are not repeated.

[0591] S5502, based on the display direction of each group of photos to be displayed, determine the target first theme template corresponding to each group of photos to be displayed from the first theme templates associated with the first theme. The target first theme template includes a second number of replacement images, and the display direction of the second number of replacement images is consistent with the display direction of the corresponding group of photos to be displayed.

[0592] Following the logic of matching a theme template to a fixed set of photos to be displayed, a target first theme template is determined for each set of photos to be displayed. Each target first theme template for a set of photos to be displayed includes a second number of replacement images equal to the number of photos in that set, and the display orientation of these replacement images is consistent with the display orientation of the photos in that set.

[0593] Taking the first theme as a dynamic photo album as an example, combined with Figure 55 The theme templates shown and Figure 46 The photos are shown. If each group includes two photos to be displayed, then the groups are: Photos 1 and 2 as the first group, Photos 3 and 4 as the second group, Photos 5 and 6 as the third group, and Photos 7 and 8 as the fourth group. The first group can correspond to... Figure 54 The theme template shown in ① or ② can be used in the second group. Figure 46 The theme templates shown in ⑨ or ⑩ can be found in the third group. Figure 46 The theme template shown in ⑤ or ⑥ can be found in the fourth group. Figure 46 The theme template shown in ⑤ or ⑥.

[0594] S5503, on the display page, at least one set of photos to be displayed is displayed sequentially according to the target first theme template corresponding to each set of photos to be displayed.

[0595] After determining the groups of photos to be displayed and the target first theme templates corresponding to the groups of photos to be displayed, the hierarchical preview page is exited, and the groups of photos to be displayed are sequentially displayed in the display page according to the target first theme templates corresponding to the groups of photos to be displayed.

[0596] If the preset display duration is 10 min, as in the above example, the theme templates shown in 46① or ② are used to display photos 1 and 2, 10 min later, the theme templates shown in 46⑨ or ⑩ are used to display photos 3 and 4, 10 min later, the theme templates shown in 46⑤ or ⑥ are used to display photos 5 and 6, 10 min later, the theme templates shown in 46⑤ or ⑥ are used to display photos 7 and 8. Figure 46 Figure 46 Figure 48

[0597] In some embodiments, the code design for establishing the mapping relationship between the photos and the pictures to be replaced in the target first theme templates, and replacing the pictures to be replaced with the photos to be displayed when displaying the photos to be displayed according to the target first theme templates can refer to the following examples:

[0598] Taking the theme template shown in 46 as an example, in order to quickly realize the corresponding animation effect, the AE integrated Lottie plug-in can be used, and a json configuration file is exported. According to the 14 theme templates, 14 json configuration files are generated. In each json configuration file, the picture IDs of the pictures to be replaced and the background pictures included in the corresponding theme template are included, and the picture ID is used to uniquely identify the corresponding picture in the corresponding json configuration file. Therefore, the json configuration file has a mapping relationship with the picture IDs included therein. The json configuration file also includes the attributes of each picture therein, including whether the picture can be replaced, wherein the attributes of the pictures to be replaced include replaceable, and the attributes of the background pictures include unreplaceable. The json configuration file can also include the height and width of each picture to be replaced and the occlusion relationship with other pictures to be replaced. Figure 46 When matching the theme templates with the photos, the corresponding pictures to be replaced and the sizes of the pictures to be replaced can be determined according to the json configuration files corresponding to the theme templates, and the display direction can be determined according to the sizes of the pictures to be replaced. The display device 200 can match the photos according to the number of pictures to be replaced and the display direction. After determining the matching relationship, a mapping relationship can be established between the picture IDs of the pictures to be replaced in each target theme template and the photos to be displayed, and the groups of photos to be displayed are formed into a display task queue.

[0599]

[0600] ​​​​When displaying each group of photos to be displayed according to the display task queue, the setImageAssetDelegate method of LottieAnimationView can be used to replace the picture to be replaced with the user-imported picture according to the corresponding relationship between the picture ID and the picture. The pseudo code is as follows:

[0601] / / Call the setImageAssetDelegate method

[0602] lottieAnimationView.setImageAssetDelegate(lottieImageAsset->{

[0603] / / Get the picture ID

[0604] String imageId=lotttieImageAsset.getId();

[0605] / / Find the bitmap of the photo from the imageId mapping relationship

[0606] Bitmap bitmap=imageMapper.get(imageId).getBitmap();

[0607] Return bitmap;

[0608] })

[0609] The callback method of setImageAssetDelegate gets the LottieImageAsset object, and then gets the picture ID of the picture to be replaced. The imageMapper stores the mapping relationship between the picture ID of the picture to be replaced and the bitmap of the photo to be displayed. Therefore, returning the mapped bitmap can achieve dynamic replacement of the picture to be replaced.

[0610] When displaying each group of photos to be displayed according to the target first theme template, it is necessary to load multiple photos to be displayed included in the group. If the resolution of the photos is high and the quality is large, without intervention, the process of real-time decoding and displaying the photos may cause the system load to be too high, and even cause the problem of animation frame loss and lag during dynamic display.

[0611] To solve the above problems, in some embodiments, the display device 200 can obtain the width and height of the to-be-replaced picture to be replaced in advance according to the established mapping relationship between the to-be-displayed picture and the to-be-replaced picture before displaying each group of to-be-displayed pictures according to the target first theme template. When the to-be-displayed picture is actually displayed, the corresponding to-be-displayed picture can be directly compressed according to the width and height of the to-be-replaced picture that has been obtained, and the compressed to-be-displayed picture is used to replace the to-be-replaced picture. The compression ratio is guaranteed to be lossless.

[0612] In some embodiments, when the display device 200 displays at least one group of to-be-displayed pictures in the display page in sequence, the to-be-displayed pictures are preloaded, wherein n groups of to-be-displayed pictures are preloaded each time.

[0613] Preloading to-be-displayed pictures is a producer-consumer relationship. When the to-be-displayed picture needs to be displayed, the producer is started to generate a bitmap of the to-be-displayed picture. The bitmap of the to-be-displayed picture is compressed to generate a bitmap object (bitmap) and stored in the memory. After the bitmap of each to-be-displayed picture is generated, the task is stored in the queue, and the LottieImageView (consumer) is notified to start the animation. After the consumer gets the task, the to-be-displayed picture is displayed.

[0614] In some embodiments, in order to prevent the producer from producing too fast and generating a large number of bitmaps to cause memory jitter, the producer preloads at most n groups of to-be-displayed pictures, such as 1-3 groups of to-be-displayed pictures. In this way, the smoothness of displaying each group of to-be-displayed pictures can be effectively guaranteed.

[0615] In some embodiments, in order to guarantee that the proportion of the to-be-displayed picture is not distorted, after the to-be-displayed picture is compressed according to the height and width of the to-be-replaced picture, the width of the compressed to-be-displayed picture may be greater than the width of the to-be-replaced picture, or the height of the compressed to-be-displayed picture may be greater than the height of the to-be-replaced picture. Therefore, when the to-be-displayed picture is displayed in the target first theme template by replacing the to-be-replaced picture, the to-be-displayed picture may not be displayed completely.

[0616] To solve the above problems, the display device 200 can display the picture with an excessively large size according to the flow shown in Figure 46 The specific steps are as follows:

[0617] S5601, if the height or width of the to-be-displayed picture is greater than the height or width of the corresponding to-be-replaced picture, the to-be-displayed picture is displayed by scrolling.

[0618] If the height of the to-be-displayed picture is greater than the height of the corresponding to-be-replaced picture, the to-be-displayed picture is displayed by scrolling up and down.

[0619] If the width of the to-be-displayed photo is greater than the width of the corresponding to-be-replaced picture, the to-be-displayed photo can be displayed by scrolling left and right.

[0620] In some embodiments, if a plurality of to-be-displayed photos in a group of to-be-displayed photos have a height or width greater than the height or width of the corresponding to-be-replaced picture, the plurality of to-be-displayed photos can be displayed by scrolling simultaneously or by scrolling one by one.

[0621] S5602, if the scrolling duration of the scrolling of the to-be-displayed photo is greater than or equal to the preset display duration of each group of to-be-displayed photos, after the to-be-displayed photo is scrolled, the next group of to-be-displayed photos is switched to be displayed.

[0622] The scrolling duration of the scrolling of the to-be-displayed photo is the total duration required for all to-be-displayed photos that need to be scrolled to complete the scrolling. If the scrolling duration is greater than or equal to the preset display duration, the next group of to-be-displayed photos is switched to be displayed after the to-be-displayed photo completes the scrolling, so as to ensure that the to-be-displayed photo that needs to be scrolled can be displayed completely.

[0623] S5603, if the scrolling duration of the scrolling of the to-be-displayed photo is less than the display duration, after the to-be-displayed photo is scrolled, the next group of to-be-displayed photos is switched to be displayed when the display duration of the current group of to-be-displayed photos reaches the preset display duration.

[0624] If the scrolling duration is less than the preset display duration, after the to-be-displayed photo that needs to be scrolled completes the scrolling, the next group of to-be-displayed photos is switched to be displayed after the display duration of the group of to-be-displayed photos reaches the preset display duration, so as to ensure that each group of to-be-displayed photos can be displayed for a long enough time.

[0625] In some embodiments, based on step S4804, if the user continues to input the downward instruction after the focus moves to the title of the photo theme classification, the display device 200 will directly display the focus on the preview picture of the second theme that is the currently set theme in response to the downward instruction. When the preview picture of the second theme obtains the focus, the display device 200 will switch the art paintings displayed in the display page to the photos displayed according to the second theme if no user operation is detected within a specified duration. Wherein, each photo is displayed according to a target second theme template associated with the second theme, and the target second theme template includes a number of to-be-replaced pictures and a display direction that match the total number and the display direction of the photos. Wherein, the process of the display device 200 displaying the photos according to the second theme can refer to the process of displaying the photos according to the first theme, which will not be described here.

[0626] In some embodiments, the display device 200 can Figure 56The illustrated flow shows a global preview page related to photo set classification, and the specific steps are as follows:

[0627] S5701, when a preview image in the preview image list obtains focus, in response to a user instruction to display a global preview page, a secondary classification in a currently selected state is identified;

[0628] In some embodiments, the process in which the user can input instructions by controlling the first direction key of the device 100 can refer to the description of the global preview function above, and will not be described here.

[0629] When the user indicates to enter the global preview page, the display device 200 first identifies the secondary classification in the currently selected state.

[0630] S5702, if the secondary classification in the currently selected state is the my photo classification, enter the global preview page.

[0631] The global preview page includes the title of the my photo classification and a global preview image list, and the global preview image list includes preview images of each photo.

[0632] Referring to the global preview page shown in ② of 45, the title of the my photo classification can be displayed in the third menu. It should be noted that, because the global preview page is configured not to display the global preview list corresponding to the photo theme classification, the third menu does not include the title of the photo theme classification.

[0633] S5703, if the secondary classification in the currently selected state is the photo theme classification, do not enter the global preview page.

[0634] If the secondary classification in the currently selected state is the photo theme classification, because the artistic mode application is configured not to display the global preview list corresponding to the photo theme classification, the global preview page is not entered. In some embodiments, the display device 200 can also display a prompt information to prompt the user that the photo theme classification has no global preview page.

[0635] In some embodiments, part of the functions provided by the artistic mode application are not applicable to the scenario of displaying photos according to themes. For example, functions related to the carousel function, such as carousel time, picture frame background color, painting information, and the like. The artistic mode application usually configures setting items of the provided functions in the artistic mode application setting page, wherein the setting items corresponding to the functions not applicable to the scenario of displaying photos according to themes can be referred to as setting items irrelevant to photo theme classification, or first setting items. When displaying photos according to themes, the user can open the artistic mode application setting page to customize various functions. However, if the user sets the functions not applicable to the scenario of displaying photos according to themes, the display device 200 can not respond to the user's settings, or the effect of the response is not obvious or the effect of the response is not displayed, resulting in a decrease in the user's experience. In order to avoid the above problems, when displaying photos according to themes, if the artistic mode application setting page is entered, the first setting items are in a disabled state. The disabled state can be grayed out, or the user is prompted that the function is not available in response to the user's setting instructions.

[0636] In some embodiments, the following examples can be referred to for implementing the corresponding effects of the photo theme:

[0637] For the implementation of the rotation angle: a layer can be defined, and a rotation attribute is added to the layer, and a plurality of key frames are added on the time axis to control the rotation angle of the layer at different time points. The Lottie library can perform interpolation according to these key frame information during the animation playing process, so as to realize the smooth rotation effect. The above process can be realized through the Canvas.rotate API.

[0638] For the implementation of the dynamic animation background: the dynamic animation background refers to setting a static background on the animation playing layer. The setBackGroundResource method can be called when initializing the LottieAnimationView to implement the dynamic animation background.

[0639] For the implementation of the fade-in and fade-out: the fade-in and fade-out effect can be realized by controlling the progress of the animation and setting the transparency (alpha) of the animation, wherein the progress can be a value from 0 to 1, indicating the position of the animation playing, in the fade-in stage, the progress is from 0 to 1, and the transparency of the animation is controlled from completely transparent to completely opaque. In the fade-out stage, the progress is from 1-0, and the animation is controlled from completely opaque to completely transparent.

[0640] For the realization of zoom in and zoom out: zoom in and zoom out effect can be realized by controlling the Scale attribute of animation. The Scale of animation can be divided into Scale X and Scale Y, and then the Scale value between each key frame is calculated using interpolation algorithm to generate smooth zoom effect. Among them, zoom in effect increases the Scale value, and zoom out effect reduces the Scale value.

[0641] For the realization of "photo frame" and "magazine" effect: "photo frame" and "magazine" effect is to add a frame to the displayed photo. The picture resource, position and size of each photo frame can be defined first, and then the size, resource id and position of the display content in each photo frame are defined. After the animation starts, the bitmap of the corresponding resource id is dynamically set.

[0642] In some embodiments, the art mode application can be configured with a function of providing painting information. In this way, the user can understand the painting information of the art painting when browsing the art painting. Among them, the painting information can include the author, age, introduction and other works of the art painting.

[0643] When browsing art paintings, for art paintings that are more familiar, in order to be more immersive, the painting information of the art painting is usually not displayed on the display page. For art paintings that are less familiar, in order to understand the painting information of the art painting, it is also desired that the painting information can be displayed on the display page.

[0644] In some embodiments, the art mode application can be configured with a switch of painting information display function. When the switch is in the on state, that is, when the painting information display function is turned on, the painting information of the art painting is also displayed when the art painting is displayed in the display page. When the switch is in the off state, that is, when the painting information display function is turned off, the painting information of the art painting is not displayed when the art painting is displayed in the display page.

[0645] In some embodiments, the art mode application can configure a switch of the painting information display function in an application setting menu. The application setting menu is distinguished from the system setting menu, and is a setting menu in the art mode application. The application setting menu includes menu items for setting parameters related to the art painting. The parameters set based on the application setting menu do not affect the overall parameters of the display device 200. In some embodiments, the application setting menu can be a shortcut menu. When the display page is displayed, the display device 200 can open the application setting menu in response to a control instruction input by the user based on the menu key of the control device 100. The application setting menu can be configured to be displayed in the third OSD layer, so that the application setting menu is displayed above the display page. In this way, when the user uses the application setting menu, the user can simultaneously browse the art painting in the display page and observe the setting effect after setting through the application setting menu.

[0646] Reference can be made to the application setting menu 5801 shown in Figure 57 . The application setting menu 5801 can include a menu item of painting information, which is a switch of the painting information display function. The user can switch the switch state of the painting information display function by selecting the menu item of painting information. The current state is displayed on the menu item of painting information, such as Figure 58 . The menu item of painting information displays “on”, indicating that the painting information display function is currently turned on. If the user selects the menu item, the painting information display function will be turned off.

[0647] In other embodiments, the art mode application can also configure a switch of the painting information display function in an art mode setting page. The art mode setting page is a setting page of the art mode application. The setting page is distinguished from the system setting page and is used for setting parameters related to the art painting. The parameters set based on the art mode setting page do not affect the overall parameters of the display device 200. It can be considered that the art mode setting page is a page corresponding to the application setting menu. Based on the art mode setting page, the user can more focusedly set each parameter. In some embodiments, the art mode setting page can be configured to be displayed in the third OSD page.

[0648] In some embodiments, the entrance of the art mode setting page can be configured in the application setting menu. Reference can be made to the application setting menu 5801 in Figure 58 . In this way, the user can enter the art mode setting page through the application setting menu and adjust the state of the painting information display function through the art mode setting page.

[0649] Reference can be made to the art mode setting page shown in Figure 58 . The art mode setting page includes a setting item of painting information, which is a switch of the painting information display function. As shown inFigure 59 As shown, the painting information display function is currently in an open state.

[0650] If the user wants to display the corresponding painting information while displaying the artistic painting, the painting information display function can be opened based on the application setting menu or the artistic mode setting page. If the user does not want to display the corresponding painting information while displaying the artistic painting, the painting information display function can be closed based on the application setting menu or the artistic mode setting page.

[0651] In some embodiments, the display device 200 can display the painting information in the following manner: Figure 59 As shown in the flow, the specific steps are as follows:

[0652] S6001, in response to a first instruction of the user, enter the artistic mode and display a display page of the artistic mode application, and display a first artistic painting in the display page.

[0653] Step S6001 can refer to steps S501-S502, which will not be described here.

[0654] S6002, identify whether the painting information display function is currently opened.

[0655] In some embodiments, the display device 200 can read the state of the painting information display function from the configuration file of the artistic mode application. The configuration file can include a flag bit for indicating the state of the painting information display function. If the flag bit is true or 1, it indicates that the painting information display function is currently opened. If the flag bit is false or 0, it indicates that the painting information display function is currently closed.

[0656] S6003, when the painting information display function is currently opened, obtain first painting information of the first artistic painting, and display the first painting information in the display page.

[0657] In some embodiments, the artistic painting and the address of the painting information have a mapping relationship. The painting information of the artistic painting can be pre-stored in the local storage of the artistic mode application, or can be stored in the cloud server. Correspondingly, the address of the painting information of the artistic painting can be a local address or a network address. The display device 200 can determine the address of the painting information corresponding to the artistic painting according to the mapping relationship, and obtain the corresponding painting information according to the address.

[0658] To realize displaying the artwork information on the upper layer of the artistic artwork, when the artwork information needs to be displayed, a second view can be created on the upper layer of the first view where the artistic artwork is located, and the artwork information is displayed in the second view. The first view and the second view belong to the same OSD layer, and the display level of the second view is higher than that of the first view, so the second view blocks the first view.

[0659] Referring to the display page shown in Figure 60 , when the first artistic artwork is displayed, the first artwork information is also displayed on the first artistic artwork, such as "Geometry, Anonymous, 2024. This landscape painting uses simple geometric shapes to represent the landscape."

[0660] S6004, when the artwork information display function is currently turned off, the first artwork information is not displayed in the display page.

[0661] In this way, when the user is browsing the first artistic artwork, the user will not be disturbed by the first artwork information, and can more immersedly browse the first artistic artwork.

[0662] In some embodiments, the artistic mode application can be configured with a function of changing the display position of the artwork information for the user to select the position of displaying the artwork information. For example, the artistic mode application can configure the function of selecting the display position under the setting item of the artwork information on the artistic mode setting page. Referring to the artistic mode setting page shown in Figure 61 , when the setting item of the artwork information is in an open state, the setting item of the display position of the artwork information can be displayed below the setting item of the artwork information. Based on the setting item, the user can set the display position of the artwork information. The artistic mode application can preset at least one display position, such as the lower left corner, the upper left corner, the lower right corner, and the upper right corner. The user can select the display position from the preset display positions.

[0663] Taking the lower left corner as an example of the set display position, referring to the display page shown in Figure 59 , the first artwork information is displayed in the lower left corner of the first artistic artwork.

[0664] In some embodiments, the artistic mode application can be configured with a function of changing the font color of the artwork information. The display device 200 can change the font color of the artwork information according to the flow shown in Figure 61 , and the specific steps are as follows:

[0665] S6201, calculating the average color value of the first artistic artwork.

[0666] The average color value of the first artistic artwork can reflect the depth of the overall color of the first artistic artwork.

[0667] S6202, determine a font color of the first artwork information according to the average color value of the first artwork, the font color meeting a preset color difference requirement with the color difference of the average color value of the first artwork.

[0668] The logic of determining the font color of the first artwork information can be: if the overall color of the first artwork is darker, a font color with lighter color is used; if the overall color of the first artwork is lighter, a darker font color is used.

[0669] In some embodiments, the code design for adjusting the font color of the artwork information can refer to the following examples:

[0670]

[0671]

[0672] S6203, display the first artwork information on the first artwork using the font color of the first artwork information.

[0673] In some embodiments, when the artwork information display function is turned on, the display device 200 can display the artwork information of the artwork currently displayed in the display page in the hierarchical preview page according to the flow shown in Figure 62 The specific steps are as follows:

[0674] S6301, in response to a second user instruction, display a hierarchical preview page on the upper layer of the display page according to the first artwork.

[0675] Step S6301 can refer to step S3002, which will not be described here.

[0676] At this time, the first artwork information of the first artwork is always displayed in the display page.

[0677] S6302, if the first position of the first artwork information overlaps with the position of the second menu, move the first artwork information to a second position for display, the second position not overlapping with the position of the second menu.

[0678] The first position of the first artwork information is the display position of the first artwork information in the display page. In combination with the display page shown in Figure 63 The first position of the first artwork information is the lower left corner. If the second menu is displayed at the bottom of the hierarchical preview page, the first position overlaps with the position of the second menu. This will cause the second menu to block the display of the first artwork information in the display page when the hierarchical preview page is displayed.

[0679] To avoid the second menu from blocking the first artwork information, the display position of the first artwork information can be adjusted according to the second menu, so as to adjust the first artwork information to a second position which does not overlap with the position of the second menu, for example, the second position can be above the second menu. In combination with Figure 61 the display page shown in FIG. 6A, when the hierarchical preview page is displayed, the display position of the first artwork information can be adjusted according to the position of the second menu, for example, the first artwork information can be adjusted to be displayed above the second menu 6401, as shown in the hierarchical preview page shown in FIG. 6B. Figure 61

[0680] In some embodiments, when the hierarchical preview page is displayed, in order to avoid too much content being displayed and causing a crowded effect, the first artwork information can be replaced by second artwork information which is a summary of the first artwork information, that is, more concise first artwork information. In this way, the artwork information can be displayed while the crowded effect of the overall page is reduced as much as possible.

[0681] In some embodiments, when the artwork information display function is currently closed, when the display page is displayed, the artwork information will not be displayed on the artistic artwork. At this time, if the user wants to know the artwork information of the artistic artwork, the user needs to manually open the artwork information display function and manually close the artwork information after browsing the artwork information, which obviously increases the complexity of user operation. In order to make the operation of the user to browse the artwork information at any time more convenient, the artistic mode application can be configured to dynamically display and hide the artwork information in response to the key instruction of the user.

[0682] In some embodiments, the display device 200 can dynamically display and hide the artwork information according to the flow shown in FIG. 6C, and the specific steps are as follows: Figure 64

[0683] S6501, when the display page is displayed, in response to the first key instruction of the user, it is identified whether the first artwork information is currently displayed.

[0684] In some embodiments, the user can input the key instruction through the down key of the control device 100.

[0685] S6502, if the first artwork information is not currently displayed, the first artwork information is displayed in the display page.

[0686] If the first artwork information is not currently displayed, the display device 200 obtains the first artwork information, and the process can refer to step S6003, which will not be described here. After obtaining the first artwork information, the first artwork information is displayed on the first artistic artwork. In this way, the user can browse the artwork information of the artistic artwork at any time.

[0687] ​​S6503, If the information of the first painting is already displayed, then hide the information of the first painting.

[0688] In this way, users can switch off the display of artwork information after browsing the artwork at any time, so as to continue to immerse themselves in the artwork.

[0689] You can refer to this. Figure 65 The process of dynamically showing and hiding artwork information is shown below. Figure 66 As shown in Figure ①, the display device 200 displays the first artwork on the display page, but does not display the first artwork information based on the function of turning off the artwork information display. The display device 200 can respond to the first key input by the user via the down key, such as... Figure 66 As shown in Figure ②, the information of the first painting is displayed on the display page. When displaying the first painting information, if the user inputs the first key command again, the display device 200 responds to the first key command, such as... Figure 66 As shown in ③, the information of the first painting is hidden.

[0690] In some embodiments, when the display device 200 responds to a first button instruction and displays first artwork information, it can also play a first voice message corresponding to the first artwork information, that is, display the first artwork information to the user through voice broadcast.

[0691] In some embodiments, in response to a first button instruction, the display device 200 may play only the first voice corresponding to the first artwork information without displaying the first artwork information, so as to avoid affecting the display of the first artwork.

[0692] In some embodiments, the code design for dynamically displaying and hiding painting information, as well as playing painting information via voice, can refer to the following example:

[0693] Register key listener

[0694]

[0695]

[0696] Methods of broadcasting painting information via voice

[0697] Use the TextToSpeech class for voice broadcasting

[0698] Initialize TextToSpeech:

[0699]

[0700] Processing voice broadcasts:

[0701]

[0702] In some embodiments, the art mode application can be configured to display the corresponding artwork information to the user on the preview image when the graded preview page is displayed.

[0703] In some embodiments, a third artwork information may be displayed below each preview image in the second menu. This third artwork information may be relatively brief to meet the size requirements of the second menu. See also... Figure 66 The graded preview page shown displays the corresponding third artwork information below each preview image.

[0704] In some embodiments, if the third artwork information cannot be displayed all at once, the complete third artwork information can be displayed in a scrolling manner when the preview image gains focus. Taking the first preview image gaining focus as an example, the third artwork information corresponding to the first preview image is displayed in a scrolling manner, while the third artwork information of other preview images that have not gained focus remains stationary.

[0705] In some embodiments, to further streamline the hierarchical preview page, only the third artwork information of the preview image that has received focus is displayed.

[0706] In some embodiments, information about a corresponding third painting can be displayed below the first preview image that has gained focus, such as... Figure 67 As shown in ①, the corresponding third artwork information can also be displayed as a floating layer on the first preview image that has gained focus, such as... Figure 68 As shown in ②.

[0707] In some embodiments, the art mode application is also configured with the ability for users to customize the artwork information. For example, the art mode application can configure custom theme categories under photo collection categories, which can be referenced. Figure 68 The tiered preview page shown includes various custom templates for different themes, such as holiday, anniversary, meeting, birthday, and party templates, to meet users' needs for different occasions. Each theme template features different backgrounds, layouts, text, patterns, and animation effects. After selecting a custom template, users can then set the artwork and display effects to be shown within that template.

[0708] In some embodiments, the display device 200 can be configured to... Figure 69 The process shown outlines the steps for setting up artwork information.

[0709] S7001, in response to the user's instruction to select the first custom template, displays the first custom template on the display page.

[0710] The first custom template includes replaceable pictures and replaceable texts. The replaceable pictures can be replaced by pictures customized by the user, and the replaceable texts can be replaced by texts customized by the user.

[0711] S7002, in response to the operation of the user opening the custom page, displaying the custom page on the display page.

[0712] In some embodiments, an entry of the custom page, such as a custom button, can be configured in an application setting menu. When the user opens the application setting menu by controlling the menu key of the display device 200, the display device 200 identifies whether the current is under the custom theme category, and if so, displays the custom button in the application setting menu for the user to customize. If not, the custom button is not displayed in the application setting menu. The user can control the display device 200 to open the custom page by selecting the custom button.

[0713] In some embodiments, the custom page can include a first adding entry and a second adding entry. The first adding entry is used to add a custom picture, and the second adding entry is used to add a custom text. The number of the first adding entries is equal to the number of replaceable pictures in the first custom template. The number of the second adding entries is equal to the number of replaceable texts in the first custom template. In this way, the user can accurately add custom pictures and custom texts.

[0714] In some embodiments, the custom page can be displayed with the first custom template as the background, and the first adding entry and the second adding entry are displayed at corresponding positions of the replaceable pictures and the replaceable texts, and an association relationship is established between the replaceable pictures and the first adding entries, and between the replaceable texts and the second adding entries. In this way, the user can more intuitively add custom pictures and custom texts. For example, refer to Figure 70 The custom page is shown in the replaceable picture 7101, and the first adding entry 7102 is displayed on the replaceable text 7103.

[0715] S7003, in response to the operation of the user adding the first custom picture and the first custom text, replacing the corresponding replaceable picture with the first custom picture, and replacing the corresponding replaceable text with the first custom text to obtain a custom painting.

[0716] In some embodiments, in response to the instruction of the user selecting the first adding entry, the display device 200 can display a list of pictures to be selected, which includes pictures that can be added to the first custom template. These pictures can include artistic paintings, photos, etc.

[0717] In some embodiments, the display device 200 can display an input box in response to the user selecting the second adding portal, and the user can input the custom text based on the input box.

[0718] After the user selects the first custom picture, the display device 200 replaces the replaceable picture at the corresponding position with the first custom picture.

[0719] After the user inputs the first custom text, the display device 200 replaces the replaceable text at the corresponding position with the first custom text.

[0720] S7004, displaying the custom painting in the showcase page.

[0721] In some embodiments, the custom page can further include other adding portals, such as an adding portal for adding custom music, an adding portal for adding custom animation effects, an adding portal for adding filters, and the like, so as to achieve more personalized styles. In some embodiments, the code design for implementing the custom function can refer to the following examples:

[0722]

[0723]

[0724] In some embodiments, the immersive atmosphere category includes artistic paintings with dynamic effects, i.e., the artistic paintings under this category are essentially videos. Therefore, when displaying the dynamic paintings under this category, it is necessary to ensure the dynamic effects of the dynamic paintings. When displaying this type of dynamic paintings, it is equivalent to playing the video file of the dynamic painting in a loop, which may cause problems such as pauses, black inserts, and the like between each loop of playing the video file, resulting in discontinuity of the dynamic effects.

[0725] To solve the above problems, when playing the dynamic painting, multiple video players can be created, and when using a video player to play the video of the current round, other video players are preloaded to directly use the preloaded video player for the next round of playing after the current round of video is played, thereby achieving seamless loop playing of the video file. However, in the above process, multiple video players need to be maintained at the same time, which will occupy a lot of system memory resources, and in the case of high system load, the problem of frame loss and frame sticking may occur.

[0726] To solve the above problems, the embodiments of the present application can provide a display method of dynamic paintings to achieve seamless loop playing of dynamic paintings. The display device 200 can display the dynamic paintings according to the flow shown in Figure 71 The specific steps are as follows:

[0727] S7201, in the art mode, the target art painting in the immersive atmosphere category is played, the video file corresponding to the target art painting is decoded, and audio data and video data are obtained.

[0728] In some embodiments, the user can select the target art painting to be displayed in the display page by selecting the preview image included in the immersive atmosphere category in the hierarchical preview page.

[0729] In some embodiments, the user can select the target art painting to be displayed in the display page by selecting the preview image included in the immersive atmosphere category in the global preview page.

[0730] In some embodiments, if the display device 200 displays the art painting in the immersive atmosphere category when it exits the art mode or the art screen saver mode last time, it will display the art painting when it enters the art mode or the art screen saver mode next time.

[0731] When the display device 200 listens to the target art painting in the immersive atmosphere category that needs to be displayed at present, it first reads the video file corresponding to the target art painting, demuxes the video file to obtain the basic audio stream and the basic video stream. By decoding the basic audio stream, audio data with pulse code modulation (PCM) format can be obtained. By decoding the basic video stream, video data with color coding (YUV) format can be obtained.

[0732] S7202, when it is identified that the video file corresponding to the target art painting is in the loop playing mode, the first display timestamp of each audio frame in the audio data in the current round and the second display timestamp of each video frame in the video data in the current round are calculated according to the loop number corresponding to the current round and the clip source length of the video file.

[0733] After the display device 200 enters the immersive atmosphere category, the corresponding playing mode, i.e. the loop playing mode, can be read. After the display device 200 identifies the loop playing mode, a video player is created and the loop playing is marked for the video player.

[0734] The display device 200 can refer to the following formula to calculate the first display timestamp of each audio frame in the audio data in the current round and the second display timestamp of each video frame in the video data in the current round. Figure 72The flow plays the video file in a loop. After the video file is unpacked to obtain audio data and video data, if it is identified that the loop playing mode is used, the display time stamp (PTS) of the audio data and the video data can be modified in a loop to make each audio frame and video frame have a display time stamp conforming to the display time of the current loop process, so as to realize the effect of playing the video file in a loop by using one video player.

[0735] In each loop process, the first display time stamp of each audio frame in the current loop and the second display time stamp of each video frame in the current loop can be calculated according to the following formula:

[0736] newPTS = currentPTS + the number of loops corresponding to the current loop and the clip source length of the video file

[0737] In the formula, newPTS is the display time stamp of the audio / video frame in the current loop, and currentPTS is the display time stamp before modification, that is, the display time stamp in the last loop.

[0738] In some embodiments, the clip source length of the video file is the maximum value in the display time stamps of the audio frames in the audio data, the maximum value in the display time stamps of the video frames in the video data, and the maximum value in the video length in the file description.

[0739] In some embodiments, in the same loop, the first display time stamp and the second display time stamp of the corresponding audio frame and video frame are the same, that is, the display time stamps of the audio / video frames that need to be synchronized are consistent.

[0740] In each loop process, after the PTS of the audio / video frame is calculated and modified, it is determined whether the decoding of the video file is completed. If not, the video file is continuously decoded. If yes, the number of loops is increased by 1, and the video file is re-decoded, for example, seeking to the starting position of the video file and performing the decoding and playing process again to realize the loop playing effect.

[0741] S7203, the video file corresponding to the target artistic painting is played in a loop in the display page of the artistic mode application. In each playing process, the corresponding audio frame is played according to the first display time stamp, and the corresponding video frame is displayed according to the second display time stamp.

[0742] Based on the display timestamp calculated according to the above formula, the time difference of the display timestamps corresponding to the same audio-video frame in each cycle is equal to the video length. Thus, after the last audio-video frame of the video is played, the first audio-video frame of the video can be directly connected to play, thereby achieving a seamless cycle effect.

[0743] The beginning and / or end part of the audio data in the video file can have low-amplitude audio data, which can be difficult for human ears to distinguish, similar to a mute effect. This section of audio data can be referred to as mute data. During the loop playing process, when the mute data is played, a mute effect will occur. If the duration of the mute data is short, it can present an audio pause effect.

[0744] To solve this problem, based on step S7201, the display device 200 can process the mute data according to the flow shown in Figure 73 The specific steps are as follows:

[0745] S7401, identifying the mute data in the beginning and end part of the audio data.

[0746] For example, the ffmpeg silencedetect filter can be used for detection. This filter can detect the start and end time of the mute part. The api provided by IJKPlayer can also be used to detect the mute data in the PCM data.

[0747] S7402, if the duration of the mute data is less than the mute duration, the mute data is removed from the audio data, and the data corresponding to the mute data in the video data is removed.

[0748] If the duration of the mute data is less than the mute duration, for example, 2s, it can be considered that the mute data will present a pause effect during the loop playing process. Therefore, the mute data is dropped from the audio data to avoid playing the mute data and thus avoiding the mute. At the same time, the data corresponding to the mute data in the video data is removed to ensure that the remaining video data and audio data can still be audio-video synchronized.

[0749] S7403, if the duration of the mute data is greater than or equal to the mute duration, the mute data is retained.

[0750] If the duration of the mute data is greater than or equal to the mute duration, it can be considered that the mute duration is relatively long, and the effect presented does not belong to the pause effect. Therefore, the mute data is retained.

[0751] In some embodiments, during the loop playing of the video file, the display device 200 can guarantee the audio-video synchronization of the dynamic painting according to the flow shown in Figure 74 The specific steps are as follows:

[0752] S7501, locking the thread with faster rendering speed in the audio thread for rendering audio data and the video thread for rendering video data.

[0753] After the first display timestamp and the second display timestamp are calculated, in order to ensure audio-visual synchronization, the threads for rendering audio data and video data are locked, and the thread that finishes rendering needs to wait until the other thread also finishes rendering, and then enters the next rendering process.

[0754] S7502, after the audio thread and the video thread are synchronized, the thread with faster rendering speed is unlocked.

[0755] In some embodiments, the thread with faster rendering speed is unlocked when it is detected that the target artwork is exited from display, or when it is detected that the video file is re-decoded.

[0756] If the thread with faster rendering speed is waiting for the other thread to render, and the process of exiting the display of the target artwork or seeking to the start of the video file occurs, the thread with faster rendering speed is unlocked to prevent blocking.

[0757] In some embodiments, the display device 200 can perform audio-visual synchronization according to the flowchart shown in FIG. 7, and the specific steps are as follows: Figure 75 Figure 76

[0758] S7601, when the clock of audio is used as the master clock, if it is detected that the speed of writing audio data in the audio thread is too fast, the clock of video is used as the master clock.

[0759] S7602, when it is detected that the speed of writing audio data in the audio thread is within the speed range, the audio thread and the video thread are synchronized, the out-of-sync data in the audio data is discarded, and the clock of audio is used as the master clock.

[0760] If the clock of audio is used as the master clock, when the speed of writing audio data in the audio track is too fast, the video data can have frame loss due to too fast clock increase. The master clock can be switched to the clock of video first, when the speed of writing in the audio track is normal, the audio-visual data is synchronized, the out-of-sync data in the audio data is discarded, and the master clock is switched back to the clock of audio.

[0761] The above description has been made in combination with specific embodiments for the convenience of explanation. However, the above description in some embodiments is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed. Various modifications and variations can be derived from the above teachings. The selection and description of the above embodiments are for better explanation of the content of the disclosure, so that those skilled in the art can better use the embodiments.​

Claims

1. A display device, characterized by comprising: Comprising: A controller configured to: In a first mode, listen to a target artwork in an immersive atmosphere category to be played, decode a video file corresponding to the target artwork to obtain audio data and video data; When it is identified that the video file corresponding to the target artwork is in a loop playing mode, calculate, according to a loop number corresponding to a current loop and a clip source length of the video file, a first display timestamp of each audio frame in the audio data in the current loop and a second display timestamp of each video frame in the video data in the current loop; Control a display to play the video file corresponding to the target artwork in a loop in a display page of a first application, wherein, in each loop playing process, a corresponding audio frame is played according to the first display timestamp, and a corresponding video frame is displayed according to the second display timestamp; The controller configured to control the display to play the video file corresponding to the target artwork in a loop in the display page of the first application is further configured to: Lock a thread with a faster rendering speed between an audio thread for rendering the audio data and a video thread for rendering the video data; After the audio thread and the video thread are synchronized, unlock the thread with the faster rendering speed; When a clock of audio is used as a master clock, if it is listened that a writing speed of the audio data in the audio thread is too fast, a clock of video is used as the master clock; When it is listened that the writing speed of the audio data in the audio thread meets a speed range, the audio thread and the video thread are synchronized, asynchronous part of the audio data is discarded, and the clock of audio is used as the master clock.

2. The display device of claim 1, wherein, The clip source length of the video file is a maximum value among display timestamps of each audio frame in the audio data, a maximum value among display timestamps of each video frame in the video data, and a maximum value among video lengths in file descriptions.

3. The display device of claim 1, wherein, The controller configured to, when it is identified that the video file corresponding to the target artwork is in the loop playing mode, calculate, according to the loop number corresponding to the current loop and the clip source length of the video file, the first display timestamp of each audio frame in the audio data in the current loop and the second display timestamp of each video frame in the video data in the current loop is further configured to: After the first display timestamp and the second display timestamp are calculated each time, it is judged whether the decoding of the video file has been completed; If not, continue to decode the video file; If yes, add 1 to the loop number, and re-decode the video file.

4. The display device of claim 1, wherein, The controller configured to lock the thread with the faster rendering speed between the audio thread for rendering the audio data and the video thread for rendering the video data is further configured to: When it is listened that the target artwork is exited from being displayed or that the video file is re-decoded, unlock the thread with the faster rendering speed.

5. The display device of claim 1, wherein, The controller configured to, in the first mode, listen to a target artwork in an immersive atmosphere category to be played, decode a video file corresponding to the target artwork to obtain audio data and video data is further configured to: identify silence data in a beginning portion and an ending portion of the audio data; if a length of the silence data is less than a silence length, eliminate the silence data from the audio data and data corresponding to the silence data from the video data; if the length of the silence data is greater than or equal to the silence length, keep the silence data.

6. A method of displaying a dynamic painting, characterized by, application to a display device The method comprises: in a first mode, listening to a target artwork in an immersive atmosphere category to be played, decoding a video file corresponding to the target artwork to obtain audio data and video data; when it is identified that the video file corresponding to the target artwork is in a loop playing mode, calculating a first display timestamp of each audio frame in the audio data in a current round and a second display timestamp of each video frame in the video data in the current round according to a loop number corresponding to the current round and a clip source length of the video file; in a display page of a first application, loop playing the video file corresponding to the target artwork, wherein in each round of playing, corresponding audio frames are played according to the first display timestamp and corresponding video frames are displayed according to the second display timestamp; wherein the loop playing the video file corresponding to the target artwork in the display page of the first application comprises: locking a thread with a faster rendering speed between an audio thread for rendering the audio data and a video thread for rendering the video data; after the audio thread and the video thread are synchronized, unlocking the thread with the faster rendering speed; wherein when an audio clock is a master clock, if it is listened that the speed of writing the audio data in the audio thread is too fast, a video clock is switched to be the master clock; when it is listened that the speed of writing the audio data in the audio thread meets a speed range, the audio thread and the video thread are synchronized, asynchronous part of the audio data is discarded, and the audio clock is switched to be the master clock.

7. The method of claim 6, wherein, The listening to the target artwork in the immersive atmosphere category to be played, decoding the video file corresponding to the target artwork to obtain the audio data and the video data in the first mode comprises: identifying silence data in a beginning portion and an ending portion of the audio data; if a length of the silence data is less than a silence length, eliminating the silence data from the audio data and data corresponding to the silence data from the video data; if the length of the silence data is greater than or equal to the silence length, keeping the silence data. application to a display device The method comprises: in a first mode, listening to a target artwork in an immersive atmosphere category to be played, decoding a video file corresponding to the target artwork to obtain audio data and video data; when it is identified that the video file corresponding to the target artwork is in a loop playing mode, calculating a first display timestamp of each audio frame in the audio data in a current round and a second display timestamp of each video frame in the video data in the current round according to a loop number corresponding to the current round and a clip source length of the video file; in a display page of a first application, loop playing the video file corresponding to the target artwork, wherein in each round of playing, corresponding audio frames are played according to the first display timestamp and corresponding video frames are displayed according to the second display timestamp; wherein the loop playing the video file corresponding to the target artwork in the display page of the first application comprises: locking a thread with a faster rendering speed between an audio thread for rendering the audio data and a video thread for rendering the video data; after the audio thread and the video thread are synchronized, unlocking the thread with the faster rendering speed; wherein when an audio clock is a master clock, if it is listened that the speed of writing the audio data in the audio thread is too fast, a video clock is switched to be the master clock; when it is listened that the speed of writing the audio data in the audio thread meets a speed range, the audio thread and the video thread are synchronized, asynchronous part of the audio data is discarded, and the audio clock is switched to be the master clock. The listening to the target artwork in the immersive atmosphere category to be played, decoding the video file corresponding to the target artwork to obtain the audio data and the video data in the first mode comprises: identifying silence data in a beginning portion and an ending portion of the audio data; if a length of the silence data is less than a silence length, eliminating the silence data from the audio data and data corresponding to the silence data from the video data; if the length of the silence data is greater than or equal to the silence length, keeping the silence data.

Images