Dynamic wallpaper display method and terminal equipment

Abstract

The embodiment of the invention provides a dynamic wallpaper display method and terminal equipment. The method can be applied to the terminal equipment, the diversity and the display effect of displaying the wallpaper on the terminal equipment can be improved, and therefore the use experience of a user can be enriched. According to the method, the framing principle of human eyes is utilized, display elements including icons, cards, characters and the like on terminal equipment or manually added display elements serve as reference display elements, the dynamic wallpaper can be divided into two parts of pixel areas, one part of the pixel area is displayed above the reference display elements, and the other part of the pixel area is displayed above the reference display elements. And the other part of the pixel region is displayed below the reference display element, so that the display mode of the dynamic wallpaper can be enriched. Moreover, in different frames of images of the dynamic wallpaper, part of the pixel region displayed in the reference display element changes, so that the effect that an object in the dynamic wallpaper passes through the reference display element can be realized.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a dynamic wallpaper display method and a terminal device. Background Art

[0002] With the popularization of terminal devices, users not only pursue various functions of terminal devices, but also pay attention to the desktop layout and aesthetics of terminal devices. In order to avoid aesthetic fatigue caused by users using the same wallpaper for a long time, the terminal device provides users with a wallpaper setting portal, so that users can easily set their favorite wallpapers.

[0003] Currently, wallpapers set by users include static wallpapers and dynamic wallpapers, and the display forms are relatively simple. How to improve the diversity and display effect of displayed wallpapers has important research significance. Summary of the invention

[0004] The present application provides a dynamic wallpaper display method and a terminal device, which can improve the diversity and display effect of wallpapers displayed on the terminal device, thereby enriching the user experience.

[0005] In the first aspect, an embodiment of the present application provides a method for displaying a dynamic wallpaper. The method can be applied to a terminal device, comprising: displaying a first interface at a first moment, the first interface comprising a first frame image of the dynamic wallpaper, M pixel areas in the first frame image being displayed on a reference display element, and pixel areas other than the M pixel areas being displayed under the reference display element, wherein M is a positive integer; and displaying a second interface at a second moment, the second interface comprising a second frame image of the dynamic wallpaper, N pixel areas in the second frame image being displayed on a reference display element, and pixel areas other than the N pixel areas being displayed under the reference display element, wherein N is a positive integer.

[0006] In this method, the framework principle of the human eye is used, and the display elements such as icons, cards, and text included in the terminal device, or manually added display elements, are used as reference display elements, so that the dynamic wallpaper can be divided into two pixel areas, one of which is displayed above the reference display element, and the other is displayed below the reference display element, thereby enriching the display method of the dynamic wallpaper. In addition, in different frame images of the dynamic wallpaper, the partial pixel area displayed on the reference display element can change, so that the effect of the object in the dynamic wallpaper passing through the reference display element can be achieved.

[0007] In a possible implementation manner, the reference display element includes but is not limited to at least one of the following display elements:

[0008] (1) at least one of application icons, time information, network information, power information, desktop widgets, and text information on the desktop display interface;

[0009] (2) at least one of the following: shortcut icons, time information, network information, battery information, lock screen widgets, and text information on the lock screen display interface;

[0010] (3) At least one reference display element is preset.

[0011] In this implementation, by using existing display elements of the terminal device or manually added display elements, it is possible to use these display elements as shielding objects, thereby enhancing the three-dimensional effect of the dynamic wallpaper and enriching the display method of the dynamic wallpaper.

[0012] In a possible implementation, the terminal device is a foldable screen mobile phone; the at least one pre-set reference display element is set in the bending area of ​​the main screen and the sub-screen of the foldable screen mobile phone.

[0013] In this embodiment, in the folding screen mobile phone, based on the folding characteristics of the folding screen mobile phone, a reference display element can be added at the bending area, thereby enhancing the three-dimensional display effect of the dynamic wallpaper and avoiding affecting the original display elements of the folding screen mobile phone.

[0014] In a possible implementation, the first moment is earlier than the second moment; the N pixel regions and the M pixel regions have the same display content but different display positions; and the N pixel regions and the M pixel regions have different display content.

[0015] In this embodiment, in different frame images of the dynamic wallpaper, the partial pixel area displayed on the reference display element changes, so that the effect of objects in the dynamic wallpaper passing through the reference display element can be achieved, and even the effect of repeated crossing can be achieved through more frame images of the dynamic wallpaper.

[0016] In a possible implementation, the display contents of the N pixel areas are different from those of the M pixel areas; the N pixel areas are first proportional areas of the target object, and the M pixel areas are second proportional areas of the target object, and the first proportional area is larger or smaller than the second proportional area.

[0017] In this implementation, the effect of an object in the dynamic wallpaper passing through a reference display element may be that the object gradually approaches the screen, or the object gradually moves away from the screen, which can enrich the display effect of the dynamic wallpaper.

[0018] In a possible implementation, the M pixel areas and the N pixel areas are in the same screen area of ​​the terminal device, and the screen area includes: a right screen area, a left screen area, an upper screen area, a lower screen area, or a preset screen area.

[0019] In this implementation, the effect of an object in the dynamic wallpaper crossing the reference display element can also be that when the object crosses the dividing line, it crosses from the top of the reference display element to the bottom of the reference display element, or from the bottom of the reference display element to the top of the reference display element. The dividing line can be set in a variety of ways, for example, it can be set at the vertical center line of the screen, the horizontal center line, or any line in the screen.

[0020] In a possible implementation, the M pixel regions and the N pixel regions belong to a display area of ​​a target object, and the target object is an object of interest in the dynamic wallpaper.

[0021] In this implementation, by extracting the object of interest in the dynamic wallpaper and displaying the object of interest above the reference display element, the stereoscopic display effect of the dynamic wallpaper can be improved.

[0022] In a possible implementation, before displaying the first interface at the first moment, the method also includes: detecting and responding to preset events, the preset events including: when unlocking, when displaying the lock screen interface, when triggered by the user, when displaying the desktop interface, or when the user clicks on a preset switch widget on the desktop interface or the lock screen interface.

[0023] In this implementation, by triggering some preset events, the dynamic wallpaper display effect provided by the embodiment of the present application can be achieved in a variety of scenarios.

[0024] In a possible implementation, before displaying the first interface at the first moment, the method further includes: turning on the naked-eye 3D effect function through a setting entry, and the setting entry is included in: a theme application APP, a setting APP, or a desktop editing state.

[0025] In this implementation, the terminal device can provide a setting entry for the user, so that the user can more flexibly turn on or off the naked-eye 3D effect.

[0026] In a possible implementation, before displaying the first interface at the first moment, the method further includes: performing image segmentation on each frame image included in the dynamic wallpaper to obtain an occluding dynamic wallpaper and a background dynamic wallpaper. Displaying the first interface at the first moment includes: obtaining the M pixel areas based on the first frame image of the occluding dynamic wallpaper, and displaying them on a reference display element; and obtaining a pixel area other than the M pixel areas based on the first frame image of the background dynamic wallpaper, or displaying the first frame image of the dynamic wallpaper below a reference display element; wherein the first frame image of the occluding dynamic wallpaper and the first frame image of the background dynamic wallpaper are obtained based on the first frame image of the dynamic wallpaper.

[0027] In this embodiment, by segmenting the dynamic wallpaper, the object of interest in the dynamic wallpaper can be extracted. Further, the object of interest can be displayed above the reference display element, which can enhance the stereoscopic display effect of the dynamic wallpaper.

[0028] In a possible implementation, the transparency of the pixel area other than the M pixel areas in the first frame image of the occluded dynamic wallpaper is a preset value. In this implementation, by setting the transparency of other pixel areas of the occluded dynamic wallpaper, the occlusion effect on the reference display element can be avoided.

[0029] In a second aspect, an embodiment of the present application further provides a terminal device, comprising a memory and one or more processors; wherein the memory is used to store computer program code, and the computer program code comprises computer instructions; when the computer instructions are executed by the processor, the terminal device executes a method in any possible design of the above-mentioned first aspect.

[0030] In a third aspect, an embodiment of the present application further provides a wallpaper display device, which includes a module / unit for executing the method in any possible design of the first aspect above. These modules / units can be implemented by hardware, or by hardware executing corresponding software implementations. For example, the module / unit can at least perform the following steps: displaying a first interface at a first moment, the first interface including a first frame image of the dynamic wallpaper, M pixel areas in the first frame image are displayed above a reference display element, and pixel areas other than the M pixel areas are displayed below the reference display element, and M is a positive integer; displaying a second interface at a second moment, the second interface including a second frame image of the dynamic wallpaper, N pixel areas in the second frame image are displayed above a reference display element, and pixel areas other than the N pixel areas are displayed below the reference display element, and N is a positive integer.

[0031] In a fourth aspect, a computer-readable storage medium is provided, which stores a computer program (also referred to as code, or instruction) which, when executed on a computer, enables the computer to execute a method in any possible design of the first aspect.

[0032] In a fifth aspect, a computer program product is provided, which includes: a computer program (also referred to as code, or instruction), which, when executed, enables a computer to execute a method in any possible design of the first aspect.

[0033] In the sixth aspect, a graphical user interface on a terminal device is also provided, the terminal device having a display screen, one or more memories, and one or more processors, the one or more processors being used to execute one or more computer programs stored in the one or more memories, the graphical user interface including the graphical user interface displayed when the terminal device executes any possible implementation method of the first aspect of the embodiment of the present application.

[0034] In a seventh aspect, the present application also provides a chip, which is used to read a computer program stored in a memory and execute any of the above aspects and possible methods designed to be executed by a terminal device.

[0035] In an eighth aspect, the present application further provides a chip system, which includes a processor for supporting a computer device to implement any of the above aspects and methods for execution of each possible design terminal device. In one possible design, the chip system also includes a memory, which is used to store programs and data necessary for the computer device. The chip system can be composed of a chip, or it can include a chip and other discrete devices.

[0036] It should be noted that for the beneficial effects of the various designs of the terminal devices provided in the second to eighth aspects of the embodiments of the present application, please refer to the beneficial effects of any possible design in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1a This is a schematic diagram of a dynamic wallpaper interface;

[0038] Figure 1b A schematic diagram of the visual saliency framework principle;

[0039] Figure 2 A schematic diagram of a hardware architecture of a terminal device provided in an embodiment of the present application;

[0040] Figure 3 A software system architecture block diagram of a terminal device provided in an embodiment of the present application;

[0041] Figure 4 One of the interface schematic diagrams of a dynamic wallpaper display method provided in an embodiment of the present application;

[0042] Figure 5 A second interface diagram of a dynamic wallpaper display method provided in an embodiment of the present application;

[0043] Figure 6 A third interface diagram of a dynamic wallpaper display method provided in an embodiment of the present application;

[0044] Figure 7 A fourth interface diagram of a dynamic wallpaper display method provided in an embodiment of the present application;

[0045] Figure 8 A fifth interface diagram of a dynamic wallpaper display method provided in an embodiment of the present application;

[0046] Fig. 9 A schematic diagram of a scene of a setting entry of a dynamic wallpaper display method provided in an embodiment of the present application;

[0047] Fig.10 A diagram of the setting interface of the dynamic wallpaper display method provided in an embodiment of the present application;

[0048] Fig.11 A dynamic wallpaper segmentation effect display diagram of a wallpaper processing method provided in an embodiment of the present application;

[0049] Fig.12 A dynamic wallpaper segmentation effect display diagram of a wallpaper processing method provided in an embodiment of the present application;

[0050] Fig.13 A schematic diagram of a layer of a dynamic wallpaper display method provided in an embodiment of the present application;

[0051] Fig.14 Another layer schematic diagram of a dynamic wallpaper display method provided in an embodiment of the present application;

[0052] Fig.15 A depth image of a dynamic wallpaper display method provided in an embodiment of the present application;

[0053] Fig.16 A schematic flow chart of a dynamic wallpaper display method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0054] The embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0055] The embodiments of the present application can be applied to the field of terminal technology, and specifically can be applied to the scenario of displaying wallpaper on a terminal device. The wallpaper can be a static wallpaper, a dynamic wallpaper, etc. The scenario of displaying the wallpaper on the terminal device can be a scenario of displaying the wallpaper on the desktop, or a scenario of displaying the wallpaper on the lock screen. The following first explains the technical terms that may be involved in the embodiments of the present application:

[0056] 1) Dynamic wallpapers, which are generally presented in the form of two-dimensional (2D) video or three-dimensional (3D) real-time rendering. Although dynamic wallpapers in the form of 2D videos can enhance the user's sense of freshness through the diversification of wallpaper materials, dynamic wallpapers in the form of 2D videos lack the way to interact with users and are only passively displayed to users, which is lacking in both gameplay and freshness. For example, Figure 1a This is a schematic diagram of a dynamic wallpaper interface. It can be understood that when a dynamic wallpaper is used in a mobile phone, Figure 1a The display interface shown can be a frame of image during the display of dynamic wallpaper. The complete dynamic wallpaper can be, for example, in the form of a 2D video of a fish swimming. In addition, in addition to displaying wallpaper on the desktop, the desktop of the terminal device often has desktop elements such as time, application (application, APP) icons, and desktop widgets. The dynamic wallpaper displayed in the form of traditional 2D videos does not interact with the desktop elements and fails to bring an immersive experience to the user. In addition, dynamic wallpapers can also be displayed on the lock screen of the terminal device. The lock screen of the terminal device generally also has lock screen elements such as time, lock screen widgets, lock screen cards, and notification cards. The dynamic wallpaper displayed in the form of traditional 2D videos does not interact with the lock screen elements and also fails to bring an immersive experience to the user.

[0057] 2) Flat naked-eye 3D, most of its effects use the visual illusion of the visual saliency frame. When the brain selects a reference object whose position and distance do not change, and the dynamic image appears around the fixed visual reference object with occlusion, crossing, near big and far small perspective effects, the brain will automatically supplement the depth of the dynamic object, thus forming a visual illusion and producing stereoscopic vision. For example, the two white lines that often appear in naked-eye 3D movie clips, or the fixed borders of street corner screens, all use this principle. For example, Figure 1b A schematic diagram of the visual saliency framework principle. Figure 1b The characters in the film are motionless, and the spiraling white lines are blocked by the human body during movement, thus forming a naked-eye 3D visual effect.

[0058] In view of this, an embodiment of the present application provides a dynamic wallpaper display method. In this method, based on the principle of planar naked-eye 3D, considering that the desktop interface of the terminal device also includes desktop elements such as APP icons and desktop widgets, the desktop elements can be used as reference objects, and the pixels or pixel areas in the original dynamic wallpaper are divided into different layers for display by segmenting the video of the original dynamic wallpaper. Exemplarily, it can be considered that when the terminal displays the desktop, it is decomposed into at least three layers for display, which may include a background layer, a reference layer and a shielding layer, the background layer may be displayed below the reference layer, and the shielding layer may be displayed above the reference layer. In this way, the pixels or pixel areas in the original dynamic wallpaper can be divided into the background layer and the shielding layer for display, respectively, so that the visual effect of naked-eye 3D can be formed with the help of desktop elements, so that the display effects such as the stereoscopic sense of the terminal device displaying the wallpaper can be improved, and the user experience can be improved. Among them, when the wallpaper is displayed on the desktop, the reference layer may include desktop elements such as APP icons, time information, and search boxes, and when the wallpaper is displayed on the lock screen, the reference layer may include lock screen elements such as time information, weather information, and lock screen widgets.

[0059] The terminal devices applied in the embodiments of the present application may be terminal devices such as mobile phones, tablet computers, laptops, folding screen mobile phones, large screens, large car screens, smart watches, etc. that can display wallpapers. It is understandable that the embodiments of the present application do not impose any restrictions on the specific types of terminal devices. The terminal devices to which the embodiments of the present application can be applied include, but are not limited to, Or terminal devices of other operating systems.

[0060] Figure 2 : A schematic diagram of the hardware structure of a possible terminal device is shown. The terminal device 200 includes: a radio frequency (RF) circuit 210, a power supply 220, a processor 230, a memory 240, an input unit 250, a display unit 260, an audio circuit 270, a communication interface 280, and a wireless fidelity (Wi-Fi) module 290 and other components. Those skilled in the art can understand that Figure 2 The hardware structure of the terminal device 200 shown in the figure does not constitute a limitation on the terminal device 200. The terminal device 200 provided in the embodiment of the present application may include more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. Figure 2 The various components shown in the drawings may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0061] Combine the following Figure 2The components of the terminal device 200 are described in detail:

[0062] The RF circuit 210 can be used for receiving and sending data during communication or calls. In particular, after receiving downlink data from the base station, the RF circuit 210 sends it to the processor 230 for processing; in addition, the uplink data to be sent is sent to the base station. Generally, the RF circuit 210 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, etc.

[0063] In addition, the RF circuit 210 can also communicate with other devices through a wireless communication network. The wireless communication can use any communication standard or protocol, including but not limited to global system of mobile communication (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), long term evolution (LTE), email, short messaging service (SMS), etc.

[0064] Wi-Fi technology is a short-range wireless transmission technology. The terminal device 200 can connect to an access point (AP) through the Wi-Fi module 290 to access the data network. The Wi-Fi module 290 can be used for receiving and sending data during the communication process.

[0065] The terminal device 200 can be physically connected to other devices through the communication interface 280. Optionally, the communication interface 280 is connected to the communication interface of the other device through a cable to achieve data transmission between the terminal device 200 and the other device.

[0066] The terminal device 200 can also implement communication services and interact with service-side devices or other terminal devices. Therefore, the terminal device 200 needs to have a data transmission function, that is, the terminal device 200 needs to include a communication module. Figure 2Communication modules such as the RF circuit 210, the Wi-Fi module 290, and the communication interface 280 are shown, but it is understandable that at least one of the above components or other communication modules (such as a Bluetooth module) for implementing communication exist in the terminal device 200 to perform data transmission.

[0067] For example, when the terminal device 200 is a mobile phone, the terminal device 200 may include the RF circuit 210, and may also include the Wi-Fi module 290, or may include a Bluetooth module ( Figure 2 When the terminal device 200 is a computer, the terminal device 200 may include the communication interface 280, and may also include the Wi-Fi module 290, or may include a Bluetooth module ( Figure 2 When the terminal device 200 is a tablet computer, the terminal device 200 may include the Wi-Fi module, or may include a Bluetooth module ( Figure 2 not shown).

[0068] The memory 240 can be used to store software programs and modules. The processor 230 executes various functional applications and data processing of the terminal device 200 by running the software programs and modules stored in the memory 240. Optionally, the memory 240 may mainly include a program storage area and a data storage area. Among them, the program storage area can store an operating system (mainly including software programs or modules corresponding to the kernel layer, system layer, application framework layer, and application layer, etc.).

[0069] In addition, the memory 240 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device. In the embodiment of the present application, the memory 240 may store relevant data such as theme files and wallpapers downloaded by the user.

[0070] The input unit 250 can be used to receive the editing operations of various different types of data objects such as digital or character information input by the user, and generate key signal input related to the user settings and function control of the terminal device 200. Optionally, the input unit 250 can include a touch panel 251 and other input devices 252.

[0071] The touch panel 251, also called a touch screen, can collect user touch operations on or near it (such as operations performed by a user using a finger, stylus, or any other suitable object or accessory on or near the touch panel 251), and drive the corresponding connection device according to a pre-set program. In an embodiment of the present application, the touch panel 251 can collect user operations on the desktop interface, such as one or more touch operations of the user in the theme APP, and the one or more touch operations can be used to set the dynamic wallpaper display method provided in the embodiment of the present application, or can be used to change wallpaper, etc.

[0072] Optionally, the other input device 252 may include, but is not limited to, one or more of a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a mouse, a joystick, etc. In the embodiment of the present application, the other input device 252 may be, for example, an acceleration sensor or a gravity sensor, etc., and the dynamic effect of the wallpaper may be triggered by shaking the terminal device 200, etc. For example, the terminal device 200 is a mobile phone, and the mobile phone may be shaken or swung to trigger the dynamic effect of the wallpaper.

[0073] The display unit 260 can be used to display information input by the user or information provided to the user and various menus of the terminal device 200. The display unit 260 is the display system of the terminal device 200, which is used to present an interface and realize human-computer interaction. The display unit 260 may include a display panel 261. Optionally, the display panel 261 can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. In an embodiment of the present application, the display unit 260 can be used to display a desktop interface for the user. Through the dynamic wallpaper display method provided by the present application, the display effect of objects in the dynamic wallpaper can be achieved when they change dynamically, and the display effect of passing through the desktop elements can be achieved, thereby enhancing the three-dimensional sense of the wallpaper displayed by the terminal device and enhancing the user experience.

[0074] The processor 230 is the control center of the terminal device 200. It connects various components using various interfaces and lines, executes various functions of the terminal device 200 and processes data by running or executing software programs and / or modules stored in the memory 240, and calls data stored in the memory 240, thereby realizing various services based on the terminal device 200. In the embodiment of the present application, the processor 230 can be used to implement the dynamic wallpaper display method provided in the embodiment of the present application. In addition, although Figure 2Not shown, the terminal device 200 may also include a graphics processing unit (GPU), and the GPU may also be used to implement the dynamic wallpaper display method provided in the embodiment of the present application. Alternatively, in the embodiment of the present application, the processor 230 and the GPU may also be used together to implement the dynamic wallpaper display method provided in the embodiment of the present application.

[0075] The terminal device 200 also includes a power supply 220 (such as a battery) for supplying power to various components. Optionally, the power supply 220 can be logically connected to the processor 230 through a power management system, so that the power management system can manage functions such as charging, discharging, and power consumption.

[0076] like Figure 2 As shown, the terminal device 200 also includes an audio circuit 270, a microphone 271 and a speaker 272, which can provide an audio interface between the user and the terminal device 200. The audio circuit 270 can be used to convert audio data into a signal that can be recognized by the speaker 272, and transmit the signal to the speaker 272, which is converted into a sound signal and output by the speaker 272. The microphone 271 is used to collect external sound signals (such as the sound of a person speaking, or other sounds, etc.), and convert the collected external sound signals into signals that can be recognized by the audio circuit 270, and send them to the audio circuit 270. The audio circuit 270 can also be used to convert the signal sent by the microphone 271 into audio data, and then output the audio data to the RF circuit 210 to send it to, for example, another terminal device, or output the audio data to the memory 240 for subsequent further processing.

[0077] although Figure 2 Not shown, the terminal device 200 may also include a camera, at least one sensor, etc., which will not be described in detail here. The at least one sensor may include but is not limited to a pressure sensor, an air pressure sensor, an acceleration sensor, a distance sensor, a fingerprint sensor, a touch sensor, a temperature sensor, etc.

[0078] The operating system (OS) involved in the embodiment of the present application is the most basic system software running on the terminal device 200. The software system of the terminal device 200 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes an operating system adopting a layered architecture as an example to exemplify the software system architecture of the terminal device 200.

[0079] Figure 3 A software system architecture block diagram of a terminal device provided in an embodiment of the present application. Figure 3As shown, the software system architecture of the terminal device can be a layered architecture, for example, the software can be divided into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into five layers, from top to bottom, namely, the application layer, the application framework layer (framework, FWK), the runtime and system library, the kernel layer, and the hardware layer.

[0080] The application layer can include a series of application packages. Figure 3 As shown, the application layer may include a user interface (UI), a camera, settings, a skin module, a third-party application, etc. Among them, the third-party application may include a wireless local area network (WLAN), music, calls, Bluetooth, videos, themes, wallpapers, etc. In the embodiments of the present application, the focus is on the theme APP, wallpaper APP, etc., which are used for wallpaper display, or the application layer may also include a program package in the form of a process, such as a desktop process, which may also provide a user with a setting entry for implementing the method provided in the embodiments of the present application.

[0081] In the embodiment of the present application, the application layer can be used to realize the presentation of the desktop interface. The above desktop interface can realize the display of dynamic wallpaper based on the dynamic wallpaper display method in the following embodiment.

[0082] In one possible implementation, applications can be developed using the Java language by calling the application programming interface (API) provided by the application framework layer. Developers can interact with the background layer (such as the hardware layer, kernel layer, etc.) of the operating system through the application framework layer to develop their own applications. The application framework layer is mainly a series of services and management systems of the operating system.

[0083] The application framework layer provides application programming interfaces and programming frameworks for applications in the application layer. The application framework layer includes some predefined functions. Figure 3 As shown, the application framework layer may include an activity manager, a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0084] The activity manager is used to manage the life cycle of each application and provide common navigation back functions, providing an interactive interface for all program windows.

[0085] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data and make the data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0086] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0087] The phone manager is used to provide communication functions for terminal devices, such as the management of call status (including answering, hanging up, etc.).

[0088] The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc. In the embodiment of the present application, when the user selects a theme in the theme APP, all the themes stored locally can be displayed to the user by calling the resource manager. In addition, in the embodiment of the present application, the user can also preview themes that have not been downloaded in the theme APP, and can preview the display effects that can be provided based on the method provided by the present application; wherein, the resource manager can provide the main APP with various resources for previewing themes.

[0089] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, the terminal device vibrates, the indicator light flashes, etc.

[0090] The runtime includes the core library and the virtual machine. The runtime is responsible for the scheduling and management of the operating system.

[0091] The core library consists of two parts: one is the function that the Java language needs to call, and the other is the core library of the operating system. The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0092] The system library may include multiple functional modules, such as a surface manager, a media framework, a 3D graphics processing library (such as OpenGL ES), a 2D graphics engine (such as SGL), etc.

[0093] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0094] The media framework supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media framework can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0095] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0096] A 2D graphics engine is a drawing engine for 2D drawings.

[0097] In some embodiments, the 3D graphics processing library may be used to draw 3D motion images, and the 2D graphics engine may be used to draw 2D motion images.

[0098] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0099] The hardware layer can include various types of sensors, such as accelerometers, gravity sensors, touch sensors, etc.

[0100] Usually, the terminal device 200 can run multiple applications at the same time. In a simpler way, one application can correspond to one process, and in a more complex way, one application can correspond to multiple processes. Each process has a process number (process ID).

[0101] It should be understood that in the embodiments of the present application, "at least one of the following" or similar expressions refer to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b or c can represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or multiple. "Multiple" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship.

[0102] In addition, it should be understood that, in the description of this application, words such as "first" and "second" are only used for the purpose of distinguishing the description, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying an order.

[0103] It should be understood that the hardware structure of the terminal device can be as follows Figure 2 As shown, the software system architecture can be Figure 3 As shown, the software programs and / or modules corresponding to the software system architecture in the terminal device can be stored in the memory 240, and the processor 230 can run the software programs and applications stored in the memory 240 to execute the process of a dynamic wallpaper display method provided in an embodiment of the present application.

[0104] In order to facilitate understanding of the dynamic wallpaper display method provided by this application, the following Figures 4 to 15 The content shown introduces the implementation process of the method provided by the present application. Taking the terminal device 200 as a mobile phone as an example, the following first describes the application scenarios applicable to the embodiments of the present application through multiple examples. It can be understood that the embodiments of the present application are not limited to the following application scenarios.

[0105] Scenario 1, Figure 4 The following is a schematic diagram of an interface of a dynamic wallpaper display method provided in an embodiment of the present application. Figure 4 As can be seen from the display interface 401 shown in FIG. 4 , some of the fish in the wallpaper can be displayed on the upper layer of the desktop elements such as the APP icon, and the other part of the fish can be displayed on the lower layer of the desktop elements such as the APP icon. Figure 1a The traditional display form of the 2D dynamic wallpaper shown, Figure 4 In the display form of wallpaper, by using desktop elements such as icons displayed on the mobile phone as reference, the three-dimensional sense of wallpaper display can be increased. It can be understood that Figure 4 The display interface shown in is one frame of the display interface when the mobile phone displays dynamic wallpaper.

[0106] In addition, for the display of wallpaper on the lock screen of the terminal device, please refer to Figure 4 The wallpaper is displayed on the desktop as shown, wherein the lock screen elements on the lock screen can be used as a reference, and the specific scenario will not be repeated here.

[0107] Scenario 2, Figure 5 Another interface schematic diagram of a dynamic wallpaper display method provided in an embodiment of the present application. Figure 5 The interfaces 501, 502 and 503 shown in the figure can be represented as three frames of images in the process of the mobile phone displaying the dynamic wallpaper. Among them, the dynamic wallpaper applied by the mobile phone in this scene can be a dynamic video of multiple small fish swimming in the water.

[0108] Figure 5 The displayed content in the included interface 501 may include small fish 500a, small fish 500b, small fish 500c and small fish 500d. Among them, small fish 500a and small fish 500b may be displayed above desktop elements such as icons, and small fish 500c and small fish 500d may be displayed below desktop elements such as icons.

[0109] Figure 5 The displayed content in the included interface 502 still includes small fish 500a, small fish 500b, small fish 500c and small fish 500d. Compared with the interface 501, the display positions of small fish 500a, small fish 500b, small fish 500c and small fish 500d change with the change of dynamic wallpaper. At this time, small fish 500a, small fish 500c and small fish 500d can be displayed above desktop elements such as icons, and small fish 500b is displayed below desktop elements such as icons.

[0110] Figure 5 The displayed content in the included interface 503 includes fish 500a, fish 500b and fish 500c. Compared with the interface 502 or 501, the display positions of fish 500a, fish 500b, fish 500c and fish 500d change with the change of the dynamic wallpaper. At this time, fish 500c can be displayed above desktop elements such as icons, fish 500a and fish 500b are displayed below desktop elements such as icons, and fish 500d is no longer displayed in the dynamic wallpaper.

[0111] In an optional embodiment, in combination Figure 5 In the interface 501 to the interface 503, the dynamic wallpaper display method provided in the embodiment of the present application can be displayed based on the depth information of the object included in the dynamic wallpaper. It can be understood that when the depth information of the small fish relative to the screen is less than the preset depth threshold (it can also be understood as the relative distance from the screen is close), it can be displayed in the upper layer of the icon, such as the small fish 500a and 500b in the interface 501, and the small fish 500a, 500c and 500d in the interface 502, or the small fish 500c in the interface 503. Similarly, when the depth information of the small fish relative to the screen is greater than or equal to the preset depth threshold (it can also be understood as the relative distance from the screen is far), it can be displayed in the lower layer of the icon, such as the small fish 500c and 500d in the interface 501, and the small fish 500b in the interface 502, or the small fish 500a and 500c in the interface 503.

[0112] Through the content introduced in scenario 2, different layers are displayed based on the depth information of the target object, so that objects with different depth information can be displayed in different layers, so that the layer where desktop elements such as APP icons are located can be used as a reference to enhance the three-dimensional sense of the wallpaper. In addition, as the position of the target object in the dynamic wallpaper changes, the depth information of the target object can change. When the depth information meets the display conditions for switching to different layers, the effect of the object passing through desktop elements such as APP icons can be achieved, thereby enhancing the fun of the dynamic wallpaper display.

[0113] Scenario 3, Figure 6 Another interface schematic diagram of a dynamic wallpaper display method provided in an embodiment of the present application. Figure 6 The interfaces 601, 602 and 603 shown in the figure can be represented as three frames of images in the process of the mobile phone displaying the dynamic wallpaper. Among them, the dynamic wallpaper applied by the mobile phone in this scene can be a dynamic video of multiple small fishes swimming in the water.

[0114] Figure 6 The displayed content in the included interface 601 may include small fish 600a, small fish 600b, small fish 600c and small fish 600d. Among them, the right half of small fish 600a can be displayed above desktop elements such as icons, and the left half can be displayed below desktop elements such as icons, small fish 600b and small fish 600d can be displayed above desktop elements such as icons, and small fish 600c is displayed below desktop elements such as icons.

[0115] Figure 6 The displayed content in the included interface 602 still includes small fish 600a, small fish 600b, small fish 600c and small fish 600d. Compared with the interface 601, the display positions of small fish 600a, small fish 600b, small fish 600c and small fish 600d change with the change of dynamic wallpaper. At this time, small fish 600a, small fish 600b and small fish 600d can be displayed on desktop elements such as icons, the right half of small fish 600c can be displayed on desktop elements such as icons, and the left half can be displayed below desktop elements such as icons.

[0116] Figure 6 The display content in the included interface 603 includes fish 600a, fish 600b and fish 600c. Compared with the interface 602 or 601, the display positions of fish 600a, fish 600b, fish 600c and fish 600d change with the change of the dynamic wallpaper. At this time, fish 600a, fish 600b and fish 600c can all be displayed on desktop elements such as icons, while fish 600d is no longer displayed in the dynamic wallpaper.

[0117] Combination Figure 6In the interface 601 to the interface 603, the dynamic wallpaper display method provided in the embodiment of the present application can also be displayed based on the dividing line set in the dynamic wallpaper; for example, the dividing line can be as follows Figure 6 The central dotted line in the figure can be understood as follows. Figure 6 The central dotted line in the figure is for ease of understanding and may not be displayed in practice. It is understood that when the fish crosses the dividing line, it may be switched from being displayed below the icons or other desktop elements to being displayed above the icons or other desktop elements, or it may be switched from being displayed above the icons or other desktop elements to being displayed below the icons or other desktop elements.

[0118] In one possible embodiment, Figure 6 In the example, the left half of the screen is displayed below the icons and other desktop elements, and the right half is displayed above the icons and other desktop elements. In actual implementation, each fish can also be set separately. For example, if fish 1 is displayed above the icons and other desktop elements in the left half, fish 1 can be switched to be displayed below the icons and other desktop elements after crossing the dividing line to the right half. For another example, if fish 2 is displayed below the icons and other desktop elements in the left half, fish 2 can be switched to be displayed above the icons and other desktop elements after crossing the dividing line to the right half.

[0119] In another possible embodiment, the embodiment of the present application does not limit the setting form of the dividing line. For example, Figure 7 Another interface schematic diagram of a dynamic wallpaper display method provided in an embodiment of the present application. Figure 7 Interfaces 701, 702 and 703 included in the figure show several other possible settings of the boundary line. For example, the boundary line can be set to Figure 6 The vertical mode shown in the figure can also be set to the horizontal mode shown in interface 701, can also be set to the curve mode shown in interface 702, or can be set to the elliptical form shown in interface 703.

[0120] Through the content introduced in scenario 3, based on setting a dividing line in the dynamic wallpaper, when the position of the target object changes with the change of the dynamic wallpaper, it can be switched to display in different layers on both sides of the dividing line, so as to achieve the display effect of crossing the desktop elements such as APP icons and enhance the three-dimensional sense of the dynamic wallpaper. In addition, it should be noted that although Figure 6 and Figure 7 The content shown takes a dividing line as an example. Multiple dividing lines can also be set when implementing the present application, so that the display interface of the terminal device can be divided into multiple display areas. When the target object moves from one display area to another, it can be switched to display in different layers, thereby achieving the display effect of repeatedly crossing desktop elements such as APP icons.

[0121] In addition, based on the contents introduced in scenes 2 and 3, the method provided in the embodiment of the present application can display dynamic wallpaper based on time information or image frame in addition to the depth information of the target object, the set demarcation line and other information. For example, periodic switching display can be performed based on time information or image frame, such as fish 1 can be displayed below desktop elements such as icons in the first time period, fish 1 can be switched to be displayed above desktop elements such as icons in the second time period, and fish 1 can be switched to be displayed below desktop elements such as icons in the third time period, and so on; for example, fish 2 can be displayed above desktop elements such as icons in the first image frame, fish 2 can be switched to be displayed below desktop elements such as icons in the second image frame, and fish 2 can be switched to be displayed above desktop elements such as icons in the third image frame, and so on. In this way, by periodically switching the display, it can be achieved that the target object can repeatedly cross the top and bottom of desktop elements such as APP icons in the process of changing the position of the dynamic wallpaper.

[0122] Scene 4: In scenes 1 to 3, desktop elements such as APP icons are used as reference objects, and the target object is switched between being displayed above and below desktop elements such as APP icons. Another possible implementation method is to set a fixed visual reference object.

[0123] For example, Figure 8 A schematic diagram of an interface of a dynamic wallpaper display method provided in an embodiment of the present application. For example, a reference line can be set at the bend of the folding screen mobile phone (which can also be understood as the junction of the main screen and the secondary screen), and the target object in the dynamic wallpaper can be moved around the line. For example, Figure 8 The small fish 800a in the interface 801 shown in FIG. 8 can be displayed above the reference line, and the small fish 800b can be displayed below the reference line, thereby enhancing the three-dimensional effect of the dynamic wallpaper through the reference line.

[0124] It should be noted that the style and form of the visual reference objects are not limited in the embodiments of the present application. For example, other styles besides reference lines can also be used, such as vines, leaves, etc. It should also be noted that the number and display position of the visual reference objects are not limited in the embodiments of the present application. Figure 8 The method of adding reference lines in the interface 801 shown is to set a fixed visual reference object on a terminal device such as a mobile phone, large screen, tablet computer, large screen or car-mounted large screen, which can be set in a position such as the central gap of the screen. This application does not limit this.

[0125] Scenario 5, based on the wallpaper display effects introduced in scenarios 1 to 4, this scenario introduces the setting entry of the terminal device that can achieve the above wallpaper display effects. The setting entry of the method provided in the embodiment of the present application can reuse the path for setting wallpaper on the terminal device, and can be added during the process of setting wallpaper to prompt the user to enable the display effects that can be provided by the method provided in the embodiment of the present application; or, the setting entry can also be set in any possible location, such as on the notification bar page, on the negative one screen interface, on the lock screen interface, or on the desktop interface. Controls for turning on the naked eye 3D effect can also be added, etc. This application does not limit the setting entry used to achieve the wallpaper display effect provided by this application. For example, Fig. 9 A scene diagram of a setting entry of a dynamic wallpaper display method provided in an embodiment of the present application. Fig. 9 Interfaces 900a, 900b, and 900c shown in the figure provide three possible settings entry points. As shown in interface 900a, the setting entry point for the method provided by the present application can be added in the theme APP 901; or, as shown in interface 900b, the setting entry point for the method provided by the present application can be added in the "Desktop and Wallpaper" category 902 included in the settings APP; or, as shown in interface 900c, the setting entry point for the method provided by the present application can also be added in the desktop shortcut tool, such as through the user operation of pinching the desktop interface with two fingers to trigger the display of the desktop shortcut tool, and the desktop shortcut tool can include the "Change Wallpaper" shortcut tool 903.

[0126] In one possible embodiment, Fig.10 This is a diagram of the setting interface of the dynamic wallpaper display method provided in the embodiment of the present application. Fig.10 Any setting entry shown in the Fig.10Interface 1001 is shown, and interface 1001 is used for users to preview wallpapers. Exemplarily, in response to the user's touch operation on wallpaper 1000a in interface 1001, the mobile phone can display interface 1002, and interface 1002 can be used to preview wallpaper 1000a. Then, in response to the user's touch operation on the "Apply" control 1000b in interface 1002, the mobile phone can display interface 1003, and interface 1003 can be used to set wallpaper 1000a before displaying it. The content of setting wallpaper may include but is not limited to: blur processing, filter selection, setting as lock screen, setting as desktop, setting at the same time, and "whether to turn on naked eye 3D effect" 1000c using the method provided in the embodiment of the present application. In response to the user's selection operation on "whether to turn on naked eye 3D effect" 1000c, the mobile phone can process the selected wallpaper 1000a based on the method provided in the embodiment of the present application and then display it. For example, when the user chooses to set wallpaper 1000a as desktop wallpaper in interface 1003, the display effect can be as follows Figure 4 or Figure 5 or Figure 6 As shown, the specific implementation will not be repeated here.

[0127] In addition, in an embodiment of the present application, the naked eye 3D effect can be triggered in response to a preset event, and a preset display duration or a preset number of loops can be set. Among them, the preset events include, but are not limited to: when unlocking, on the lock screen wallpaper, when triggered by the user, when returning to the desktop, or when the user clicks on the preset switch widget on the desktop or lock screen. The preset display duration can be, for example, 3 seconds, and it can be understood that the traditional dynamic wallpaper display form can be restored after 3 seconds. The preset number of loops can be, for example, 1 time, and it can be understood that the traditional dynamic wallpaper display form can be restored from the second time the dynamic wallpaper is played in a loop. It should be noted that this implementation can be triggered when it is detected that the size of the target object is larger than the preset size, thereby avoiding affecting the user's desktop browsing; it can be understood that when the size of the target object is small, it generally does not affect the user's desktop browsing, so that this implementation can be not triggered.

[0128] Based on the above description of the wallpaper display effect that can be achieved by the method provided in the embodiment of the present application, the following describes the implementation process of the dynamic wallpaper display method provided by the present application to illustrate how to use the method provided by the present application to achieve the above-mentioned effect. Figures 4 to 10 The wallpaper display effect shown can enhance the three-dimensional sense of dynamic wallpaper display. The implementation process of the method provided in the embodiment of the present application can be mainly divided into the following parts:

[0129] (1) Dynamic wallpaper segmentation

[0130] It can be understood that a dynamic wallpaper may generally include multiple frames of images, so segmenting the dynamic wallpaper may be implemented by segmenting the multiple frames of images frame by frame.

[0131] In an optional embodiment, dynamic wallpaper segmentation can be used to divide the dynamic wallpaper to be displayed into a foreground part and a background part. The foreground part can highlight the subject in the wallpaper, and can also be understood as the pixel area in the wallpaper that is closer to the camera lens, for example, in a person shot image, the person body can be understood as the foreground object; the background part can enhance the perspective, spatial sense and depth of the wallpaper, and can also be understood as the pixel area in the wallpaper that is farther from the camera lens, for example, in a person shot image, the area other than the person body can be understood as the background area.

[0132] In the embodiment of the present application, the segmentation of the dynamic wallpaper can be implemented as follows: marking the foreground object of interest (such as the small fish in the above embodiment) in one frame of the dynamic wallpaper, and then extracting the mask of the foreground object included in each frame of the dynamic wallpaper through the model to obtain the mask information of the dynamic wallpaper; wherein the mask information can be used to mark the size and position information of the foreground object in the dynamic wallpaper. For example, Fig.11 A diagram showing the dynamic wallpaper segmentation effect of a wallpaper processing method provided in an embodiment of the present application. Fig.11 The included interface 1101 may show a frame of image in the original dynamic wallpaper, which is a person-type image; the interface 1102 may show a schematic diagram based on the mask information extracted by the interface 1101, wherein the black area in the interface 1102 is the background area, and the white area is the area where the foreground object is located, and the position and size edges of the foreground object may be marked through the interface 1102; the interface 1103 may show the result of simultaneously displaying the original image frame (such as the interface 1101) and the mask information image (such as the interface 1102), and the target object in the original image frame (such as the interface 1101) may be extracted through the mask information image (such as the interface 1102), and then the segmented target object may be obtained as the foreground object, as shown in the interface 1104, and the transparency of the display area other than the target object may be set to 0.

[0133] It can be understood that by extracting the mask information of the dynamic wallpaper, the position and size edge of each frame image in the dynamic wallpaper can be marked based on the mask information, so that the foreground object in the dynamic wallpaper can be easily processed, and then the foreground object can be easily processed, for example, the foreground object can be displayed on the desktop elements such as the APP icon. Therefore, it can be understood that the foreground part in the dynamic wallpaper can also be understood as the target object that this application focuses on.

[0134] In another optional embodiment, the dynamic wallpaper segmentation can also be performed based on the region of interest (ROI), for example, for a dynamic wallpaper generated by 3D modeling, or for example, for a dynamic wallpaper obtained by rendering software, the model maker or the dynamic wallpaper maker can provide the ROI corresponding to the dynamic wallpaper, so that it can be divided into the target object area and the background part area. Fig.12 A diagram showing the dynamic wallpaper segmentation effect of a wallpaper processing method provided in an embodiment of the present application. Fig.12 The included interface 1201 may show a frame of image in the original dynamic wallpaper, which is a landscape image; the interface 1202 may show a schematic diagram based on the mask information extracted from the interface 1201, the black area in the interface 1202 is the background area, the white area is the area where the foreground object is located, and the position and size edges of the foreground object may be marked through the interface 1202; the interface 1203 shows the result of simultaneously displaying the original image frame (such as the interface 1201) and the mask information image (such as the interface 1202), and multiple target objects (i.e., small fish) in the original image frame (such as the interface 1201) may be extracted through the mask information image (such as the interface 1202), and then multiple small fish after segmentation may be obtained as foreground objects, such as shown in the interface 1204. From Fig.12 It can be seen that the mask information image may include one or more target objects. The embodiment of the present application does not limit the number of target objects and can be determined according to the characteristics of the dynamic wallpaper.

[0135] (II) Display mode determination

[0136] In an optional embodiment, in order to achieve the wallpaper display effect achieved by scenes 1 to 4 in the above embodiments, the dynamic wallpaper can be displayed in multiple layers. Fig.13 A layer diagram of a dynamic wallpaper display method provided in an embodiment of the present application. Figure 4The interface 401 shown in is taken as an example. The interface 401 can be displayed by at least superimposing the background layer 1301, the reference layer 1302 and the occlusion layer 1303 to realize the wallpaper display. Among them, the background layer 1301 can be used to display the original dynamic wallpaper, and is displayed below the reference layer 1302, and can also be understood as a layer farther away from the screen; the reference layer 1302 can be used to display desktop elements including but not limited to APP icons, time information, network information, search boxes, etc., and other areas except the APP can be set to transparent; the occlusion layer 1303 can be used to display the extracted target object based on the mask information of the target object, and is displayed above the reference layer 1302, and can also be understood as a layer closer to the screen. In addition, other areas except the target object can be set to transparent. In this way, the target object located in the occlusion layer 1303 can shield the desktop elements such as the APP icon in the same position in the reference layer 1302, for example Fig.13 The two small fish at the top of the included interface 401 have a shielding effect on the APP icon at the same position, thereby creating an effect that some fish swim from the bottom of the reference layer 1302 to the top of the reference layer 1302, achieving a naked-eye 3D effect.

[0137] Among them, in the scenario where the terminal device displays a dynamic wallpaper on the desktop, the reference layer 1302 can be desktop elements such as various APP icons, desktop widgets, cards, time information, network information, etc. on the desktop; in the scenario where the terminal device displays a dynamic wallpaper on the lock screen, the reference layer 1302 can be lock screen elements such as time information, lock screen widgets, etc. on the lock screen.

[0138] In another optional embodiment, based on Figure 8 As shown in the figure, a fixed visual reference can be set, and multiple layers can also be divided into a background layer of a dynamic wallpaper, a cover layer of an action wallpaper, and a reference layer. Fig.14 A layer diagram of a dynamic wallpaper display method provided in an embodiment of the present application. Figure 8Taking the interface 801 shown in as an example, the interface 801 can be displayed by at least superimposing the background layer 1401, the reference layer 1402 and the occlusion layer 1403 to realize wallpaper display. Among them, the background layer 1401 can be used to display the original dynamic wallpaper, and is displayed below the reference layer, and can also be understood as a layer farther from the screen; the reference layer 1402 can be used to display a fixed visual reference object, and other areas except the visual reference object can be set to transparent; the occlusion layer 1403 can be used to display the target object based on the mask information of the target object, and is displayed above the reference layer, and can also be understood as a layer closer to the screen, and other areas except the target object can be set to transparent. In this way, the target object located in the occlusion layer 1403 can shield the reference object in the same position of the reference layer 1402, for example Fig.14 The two small fish at the top of the interface 801 have a shielding effect on the reference line, thereby creating an effect of some fish swimming around the reference line, achieving a naked-eye 3D effect.

[0139] It should be noted that Fig.13 and Fig.14 Taking the example of dividing the dynamic wallpaper into two layers for display, and there is a reference layer between the two layers, the reference layer can be implemented by desktop elements such as APP icons, or lock screen elements such as lock screen widgets, or it can also be implemented by setting a fixed visual reference. It can be understood that when the present application is implemented, the dynamic wallpaper can also be divided into more layers for display, such as three layers, four layers, or more; wherein there is at least one reference layer between the multiple layers, for example, it can include a background layer and multiple occlusion layers. In this way, a hierarchical display of the target object can be achieved, thereby enhancing the sense of hierarchy of the naked eye 3D effect.

[0140] (III) Determination of occlusion mode

[0141] Through the contents introduced in the above scenes 1 to 5, the occlusion mode of the target object can be determined based on the depth information of the target object, the set boundary line, time information, or image frame information, so that the display of dynamic wallpaper can be realized to achieve the naked eye 3D visual effect. Among them, the information used by the terminal device to determine the occlusion mode can be a default setting, or it can be determined based on the characteristics of the dynamic wallpaper, or it can be randomly selected, and this application does not limit this.

[0142] Method A: Determine the occlusion mode of the target object based on the depth information of the target object

[0143] In an optional embodiment, when the depth information of the target object relative to the screen is less than a preset depth threshold (which can also be understood as when the relative distance from the screen is relatively close), it can be displayed above the reference layer; when the depth information of the target object relative to the screen is greater than or equal to the preset depth threshold (which can also be understood as when the relative distance from the screen is relatively far), it can be displayed below the reference layer. For example, Fig.15 A depth image of a dynamic wallpaper display method provided in an embodiment of the present application. Fig.15 Interface 1501 in the figure may be a frame image of the original dynamic wallpaper, and interface 1502 may be a depth image corresponding to interface 1501. A display area with denser lines may be closer to the screen, and the corresponding depth value is smaller. A display area with less dense lines or even no lines may be farther from the screen, and the corresponding depth value is larger. For example, the top fish in interface 1502 is closest to the screen, and the fishes displayed downward are farther and farther from the screen.

[0144] In the above embodiment, the depth information of the target object in the dynamic wallpaper can be obtained based on the depth estimation technology; or, the depth information of the target object in the dynamic wallpaper can be obtained based on a depth camera or 3D modeling. The present application does not limit the implementation method of obtaining the depth information of the target object in the dynamic wallpaper.

[0145] In another optional embodiment, in a scene where a dynamic wallpaper obtained by a depth camera or a video obtained by 3D modeling is used as a dynamic wallpaper, the average value of all depth values ​​corresponding to the target object extracted based on the mask information image can also be counted. Based on the statistical results, the average depth change value of each target object can be obtained. Furthermore, based on the average depth change value of each target object, the total average depth value of the target object in the dynamic wallpaper can be calculated. Among them, the calculation method of the average depth of a single target object in a frame of image can be shown in the following formula 1:

[0146]

[0147] In formula 1, d f It is used to indicate the average depth of the target object area in the fth frame; d i Used to indicate the depth of the i-th pixel included in the target object area calibrated based on the mask information image of the target object in the depth image of the f-th frame image; n is used to indicate the total number of pixel values ​​included in the target object area; f is used to indicate that the current calculation is for the f-th frame.

[0148] Based on the average depth of the target object in a single frame image, the total average depth of the target object in the dynamic wallpaper can be expressed as the following formula 2:

[0149]

[0150] In formula 2, Used to indicate the total average depth of the target object in the entire dynamic wallpaper; d f Used to indicate the average depth of the object area in the fth frame; F is used to indicate the total number of frames included in the dynamic wallpaper.

[0151] It can be understood that when a dynamic wallpaper includes multiple target objects, the average depth of each target object in each frame image and the total average depth in the dynamic wallpaper can be calculated separately.

[0152] Based on the total average depth of the target object in the dynamic wallpaper, one or more target objects can be selected from the smallest to the largest total average depth, and the target objects segmented from the dynamic wallpaper can be obtained based on the dynamic wallpaper segmentation content introduced above. Then, based on the depth information and the segmented target object, the dynamic wallpaper can be divided into an occlusion dynamic wallpaper and a background dynamic wallpaper; it can be understood that all or part of the segmented target object can be used as an occlusion dynamic wallpaper. Fig.15 As shown, the dynamic wallpaper includes four small fishes. Based on the total average depth of the four small fishes in the dynamic wallpaper, two small fishes can be selected from small to large total average depths, so that the two small fishes with smaller total average depths can be displayed as foregrounds in the occlusion layer, such as shown in interface 1504, and the remaining two small fishes with larger total average depths can be displayed as backgrounds in the background layer, such as shown in interface 1503. In addition, the background layer can also display the original dynamic wallpaper, thereby reducing the amount of calculation required to segment the background part. Among them, the form of the occlusion dynamic wallpaper includes but is not limited to various forms of videos, such as transparent channel videos, frame animations, etc.

[0153] In another possible embodiment, a depth image corresponding to each frame of the dynamic wallpaper can be obtained by a depth estimation algorithm. Since the depth image corresponding to each frame of the dynamic wallpaper obtained by the depth estimation algorithm is an estimated value, not a true absolute depth value, the absolute depth value of the depth image corresponding to each frame of the dynamic wallpaper cannot accurately reflect the depth change of the pixel or pixel area between the image frames. In this scenario, in different frames of the dynamic wallpaper, different proportions of depth ranges belonging to the target object area can be selected according to the depth image, so that target objects of different sizes can be displayed in the occlusion layer. For example, in the first frame of the dynamic wallpaper, 10% of the pixels corresponding to the depth range belonging to the target object area can be selected from the minimum depth value; in the second frame of the dynamic wallpaper, 20% of the pixels corresponding to the depth range belonging to the target object area can be selected from the minimum depth value; in the third frame of the dynamic wallpaper, 30% of the pixels corresponding to the depth range belonging to the target object area can be selected from the minimum depth value, so that the wallpaper display effect of the target object gradually increasing in the occlusion layer can be obtained, which can also be understood as the display effect of the target object gradually approaching the screen. For another example, in the first frame image, 80% of the pixels corresponding to the depth range belonging to the target object area may be selected starting from the minimum depth value; in the second frame image, 60% of the pixels corresponding to the depth range belonging to the target object area may be selected starting from the minimum depth value; in the third frame image, 40% of the pixels corresponding to the depth range belonging to the target object area may be selected starting from the minimum depth value, thereby obtaining a wallpaper display effect in which the target object gradually becomes smaller in the occlusion layer, which can also be understood as a display effect in which the target object gradually moves away from the screen.

[0154] Among them, the preset depth threshold can be determined according to factors such as the size of the target object and the number of target objects to be displayed. For example, in order to avoid the target object being too large and causing too much occlusion of the APP, the size of the target object displayed in the occlusion layer can be set to be smaller than a certain preset range by adjusting the preset depth threshold. For another example, when there are multiple target objects (such as multiple small fish), the number of target objects displayed in the occlusion layer can be set to one or more, such as one small fish, by adjusting the preset depth threshold.

[0155] Method B: Determine the occlusion mode of the target object based on the set boundary line

[0156] Scenario 3 in the above embodiment introduces the wallpaper display effect of displaying wallpaper based on the set dividing line. Here, how to achieve the wallpaper display effect is introduced.

[0157] Based on the dynamic wallpaper segmentation content introduced in the first part, the target object segmented from the dynamic wallpaper can be obtained. By setting the dividing line and the display mode of the target object with the dividing line as a reference, it can be determined based on the display position of the target object whether all or part of the target object is displayed in the occlusion layer or the background layer. Among them, the display mode can be understood as that the target object is displayed in the background layer within the first dividing area of ​​the screen and in the occlusion layer within the second dividing area of ​​the screen; wherein the first dividing area and the second dividing area can be determined according to the set dividing line.

[0158] Referring to the implementation method in method A, when it is determined that the target object needs to be displayed in the occlusion layer, one or more target objects or a partial pixel area of ​​the target object that needs to be displayed in the occlusion layer can be segmented from all the segmented target objects based on the segmented target object, so that an occlusion dynamic wallpaper can be generated; in addition, a background dynamic wallpaper can also be generated. Therefore, the generated occlusion dynamic wallpaper can be displayed in the occlusion layer.

[0159] (IV) Dynamic wallpaper display

[0160] In an optional embodiment, based on the occlusion dynamic wallpaper and background dynamic wallpaper obtained in the above embodiment, the occlusion dynamic wallpaper can be displayed in the occlusion layer, and the background dynamic wallpaper can be displayed in the background layer. Therefore, the layered display of the dynamic wallpaper can be realized, and the reference layer can be used as a visual reference, so as to achieve the visual illusion of the visual saliency framework.

[0161] In another optional embodiment, based on the shielding dynamic wallpaper and the original dynamic wallpaper obtained in the aforementioned embodiment, the shielding dynamic wallpaper can be displayed on the shielding layer, and the original dynamic wallpaper can be displayed on the background layer.

[0162] It is understandable that the occlusion dynamic wallpaper and the background dynamic wallpaper (or the original dynamic wallpaper) need to be played together, and synchronous playback can be achieved by aligning the start frame position and setting the playback rate. For example, if it is implemented in the form of frame animation, the occlusion dynamic wallpaper frame and the background dynamic wallpaper frame can be marked to achieve aligned playback.

[0163] The method provided in the embodiment of the present application obtains a foreground part and a background part by segmenting the original dynamic wallpaper; then based on the foreground part and the background part, a blocking dynamic wallpaper can be obtained, and a background dynamic wallpaper can be obtained, and the blocking dynamic wallpaper can be displayed in different layers. In this way, with the APP or a fixed reference object set as a reference, a naked-eye 3D display effect can be achieved by relying on relative movement and blocking of visual reference objects, thereby enhancing the three-dimensional sense of the dynamic wallpaper. Moreover, by processing the image of the original dynamic wallpaper, the requirements for the material can be reduced compared to the implementation method of preparing multiple sets of materials.

[0164] Fig.16 A schematic flow chart of a dynamic wallpaper display method provided in an embodiment of the present application may include the following steps:

[0165] Step 1601, displaying a first interface at a first moment, wherein the first interface includes a first frame image of the dynamic wallpaper, wherein M pixel regions in the first frame image are displayed above a reference display element, and pixel regions other than the M pixel regions are displayed below the reference display element, wherein M is a positive integer;

[0166] Step 1602, displaying a second interface at a second moment, the second interface including a second frame image of the dynamic wallpaper, N pixel regions in the second frame image being displayed above a reference display element, and pixel regions other than the N pixel regions being displayed below the reference display element, wherein N is a positive integer. N and M may be the same or different.

[0167] The specific implementation process of step 1601 and step 1602 can refer to the content introduced in the above embodiment, which will not be repeated here.

[0168] Based on the above embodiments, the present application also provides a terminal device, which includes multiple functional modules; the multiple functional modules interact with each other to implement the functions performed by the terminal device in each method described in the embodiments of the present application. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on the specific implementation. Fig.16 The terminal device in the illustrated embodiment executes steps 1601 to 1602.

[0169] Based on the above embodiments, the present application further provides a terminal device, which includes at least one processor and at least one memory, wherein the at least one memory stores computer program instructions, and when the terminal device is running, the at least one processor executes the functions executed by the terminal device in each method described in the embodiments of the present application. Fig.16 The terminal device in the illustrated embodiment executes steps 1601 to 1602.

[0170] Based on the above embodiments, the present application also provides a computer program product, which includes: a computer program (also referred to as code, or instructions), which enables a computer to execute the methods described in the embodiments of the present application when the computer program is executed.

[0171] Based on the above embodiments, the present application further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a computer, the computer executes the methods described in the embodiments of the present application.

[0172] Based on the above embodiments, the present application further provides a chip, which is used to read a computer program stored in a memory to implement the methods described in the embodiments of the present application.

[0173] Based on the above embodiments, the present application provides a chip system, which includes a processor for supporting a computer device to implement the methods described in the embodiments of the present application. In a possible design, the chip system also includes a memory, which is used to store the necessary programs and data of the computer device. The chip system can be composed of a chip, or it can include a chip and other discrete devices. It should be understood by those skilled in the art that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0174] The present application is described with reference to the flowchart and / or block diagram of the method, device (system), and computer program product according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the process and / or box in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the function specified in one process or multiple processes in the flowchart and / or one box or multiple boxes in the block diagram.

[0175] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0176] These computer program instructions may also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0177] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the scope of protection of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A dynamic wallpaper display method, characterized in that: Applied in terminal equipment, including: Displaying a first interface at a first moment, the first interface including a first frame image of the dynamic wallpaper, M pixel regions in the first frame image are displayed above a reference display element, and pixel regions other than the M pixel regions are displayed below the reference display element, where M is a positive integer; A second interface is displayed at a second moment, the second interface including a second frame image of the dynamic wallpaper, N pixel areas in the second frame image are displayed above a reference display element, and pixel areas other than the N pixel areas are displayed below the reference display element, where N is a positive integer.

2. The method according to claim 1, characterized in that The reference display element includes at least one of the following display elements: At least one of application icons, time information, network information, power information, desktop widgets, and text information on the desktop display interface; At least one of the following: a quick icon, time information, network information, power information, a lock screen widget, and text information on the lock screen display interface; At least one reference display element is preset.

3. The method according to claim 2, characterized in that The terminal device is a foldable screen mobile phone; The at least one pre-set reference display element is arranged in the bending area of ​​the main screen and the secondary screen of the folding screen mobile phone.

4. The method according to any one of claims 1 to 3, characterized in that The first moment is earlier than the second moment; The N pixel areas and the M pixel areas have the same display content but different display positions; The display contents of the N pixel regions are different from those of the M pixel regions.

5. The method according to claim 4, characterized in that When the display contents of the N pixel areas are different from those of the M pixel areas; The N pixel areas are a first proportion area of ​​the target object, and the M pixel areas are a second proportion area of ​​the target object, and the first proportion area is larger or smaller than the second proportion area.

6. The method according to claim 4, characterized in that The M pixel areas and the N pixel areas are in the same screen area of ​​the terminal device, and the screen area includes: a right screen area, a left screen area, an upper screen area, a lower screen area, or a preset screen area.

7. The method according to any one of claims 1 to 6, characterized in that The M pixel areas and the N pixel areas belong to the display area of ​​a target object, and the target object is an object of interest in the dynamic wallpaper.

8. The method according to any one of claims 1 to 7, characterized in that Before displaying the first interface at the first moment, the method further includes: Detect and respond to preset events, including: when unlocking, when displaying the lock screen interface, when triggered by the user, when displaying the desktop interface, or when the user clicks on a preset switch widget on the desktop interface or on the lock screen interface.

9. The method according to any one of claims 1 to 8, characterized in that Before displaying the first interface at the first moment, the method further includes: The naked eye 3D effect function is turned on through the setting entrance, and the setting entrance is included in: the theme application APP, the setting APP, or the desktop editing state.

10. The method according to any one of claims 1 to 9, characterized in that Before displaying the first interface at the first moment, the method further includes: Performing image segmentation on each frame of the dynamic wallpaper to obtain an occlusion dynamic wallpaper and a background dynamic wallpaper; The displaying the first interface at the first moment includes: Obtaining the M pixel regions based on the first frame image of the shielding dynamic wallpaper, and displaying them on the reference display element; and Obtaining a pixel region other than the M pixel regions based on the first frame image of the background dynamic wallpaper, or displaying the first frame image of the dynamic wallpaper under the reference display element; Among them, the first frame image of the blocking dynamic wallpaper and the first frame image of the background dynamic wallpaper are obtained based on the first frame image of the dynamic wallpaper.

11. The method according to claim 10, characterized in that The transparency of the pixel area other than the M pixel areas in the first frame image of the shielding dynamic wallpaper is a preset value.

12. A terminal device, characterized in that: The system comprises at least one processor coupled to at least one memory, wherein the at least one processor is configured to read a computer program stored in the at least one memory to execute the method according to any one of claims 1 to 11.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, which, when executed on a computer, enable the computer to execute the method according to any one of claims 1 to 11.

14. A computer program product comprising instructions, characterized in that When the computer program product is run on a computer, the computer is caused to execute the method according to any one of claims 1 to 11.

Images