Wallpaper setting method and related apparatus

Abstract

A wallpaper setting method and a related apparatus. In the wallpaper setting method, an electronic device can allow a user to set a multi-frame asset or a single-frame asset in a photo album as a wallpaper, and allow the user to set the wallpaper from a plurality of paths. The electronic device can also optimize the wallpaper selected by the user. The electronic device can perform image recomposition on the wallpaper, remove distracting elements in the wallpaper, and process unstable or visually unappealing frames therein, and can add a new dynamic effect to the wallpaper, so that the resulting wallpaper becomes more focused, smoother, and more expressive and personalized. In this way, the electronic device can provide users with a highly rich and scalable wallpaper function, thereby meeting users' personalized wallpaper requirements.

Description

A method for setting wallpaper and related devices

[0001] This application claims priority to Chinese Patent Application No. 202411481104.9, filed with the China National Intellectual Property Administration on October 22, 2024, entitled "An Implementation Scheme for Wallpaper Setting with Supplementary Frames"; priority to Chinese Patent Application No. 202411481379.2, filed with the China National Intellectual Property Administration on October 22, 2024, entitled "An Implementation Scheme for Wallpaper Setting with Supplementary Frames"; and priority to Chinese Patent Application No. 202510370499.3, filed with the China National Intellectual Property Administration on March 26, 2025, entitled "A Wallpaper Setting Method and Related Device," the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of terminal technology, and in particular to a wallpaper setting method and related apparatus. Background Technology

[0003] For current mobile devices, wallpaper presentation has become the first step in the user's interaction with the device. When using a mobile device, users always see the wallpaper first before performing other operations.

[0004] However, users are no longer satisfied with using the default wallpaper provided by the system or simply setting the original camera image as their phone wallpaper. Users want to set their wallpapers according to their own preferences and needs. And different users have significantly different wallpaper experience requirements.

[0005] Therefore, how to meet the diverse wallpaper experience needs of different users and provide users with rich and scalable wallpaper functions is a question worth considering. Summary of the Invention

[0006] This application provides a wallpaper setting method and related apparatus. In this method, the electronic device supports users setting multi-frame and single-frame resources from their photo albums as wallpapers, and supports users setting wallpapers from multiple paths. The electronic device can also optimize the wallpaper selected by the user. It can reconstruct the wallpaper image, remove interfering elements, process unstable frames that affect the viewing experience, and add new dynamic effects, making the final wallpaper more focused, smoother, more expressive, and more personalized. In this way, the electronic device can provide users with highly rich and scalable wallpaper functionality to meet their personalized wallpaper needs.

[0007] In a first aspect, this application provides a wallpaper setting method, the method comprising: displaying a first interface, the first interface displaying one or more image resources; detecting a first operation of setting the first image resource as the wallpaper of an electronic device; responding to the first operation, performing image processing on the first image resource; the first image resource including a video or animated image, the first image resource including a subject; the difference between the processed first image resource and the original first image resource includes one or more of the following: the display mode of the subject, the number of image frames; and setting the processed first image resource as the wallpaper of the electronic device.

[0008] Electronic devices allow users to set wallpapers and can optimize the image resources selected by the user during the wallpaper setting process, thereby improving the wallpaper's expressiveness and enhancing the user experience.

[0009] In conjunction with the first aspect, the first image resource includes a first image frame and a second image frame. The difference between the processed first image resource and the first image resource includes the display method of the subject, including: the position jump of the subject in the first image frame and the second image frame in the processed first image resource is less than the position jump of the subject in the first image frame and the second image frame in the first image resource.

[0010] Electronic devices can optimize wallpaper stability, making the main objects in the wallpaper more stable and reducing positional changes caused by device vibration, thereby improving the appearance of the wallpaper and enhancing the user experience.

[0011] In conjunction with the first aspect, the first image resource includes at least one image frame, the at least one image frame includes unstable frames, and the difference between the processed first image resource and the first image resource includes the number of image frames: the number of unstable frames in the processed first image resource is less than the number of unstable frames in the first image resource.

[0012] In conjunction with the first aspect, image processing is performed on the first image resource, specifically including:

[0013] Remove unstable frames from the first image resource.

[0014] In this way, electronic devices can reduce unstable frames in the wallpaper, improve the stability of the wallpaper image, make the main objects in the wallpaper more stable, reduce the positional jumps of the main objects caused by device shaking, and improve the visual appeal of the wallpaper. This enhances the user experience.

[0015] In conjunction with the first aspect, the unstable frames include: blurred frames, frames with sudden image changes, frames with repeated images, black screen frames, green screen frames, and frames with distorted images.

[0016] In conjunction with the first aspect, at the frame time of the unstable frame, the jitter amplitude of the electronic device is greater than a first threshold, and the jitter amplitude is collected by the gravity sensor of the electronic device.

[0017] In this way, electronic devices can identify unstable frames in the first image resource. Once unstable frames are identified, the electronic device can improve the stability of the wallpaper by reducing these frames, making the main objects in the wallpaper more stable and reducing positional shifts caused by device shake, thus improving the overall visual appeal and enhancing the user experience.

[0018] In conjunction with the first aspect, image processing is performed on the first image resource, specifically including: obtaining image frames from the first image resource whose jitter amplitude is less than a second threshold; obtaining the processed first image resource based on the image frames whose jitter amplitude is less than the second threshold; wherein the first threshold is greater than the second threshold.

[0019] In this way, the electronic device can extract the most stable segment from the first image resource, in which the main object has the least shaking, focusing more on the main object, making the main object stand out more, and improving the visual experience of the wallpaper.

[0020] In conjunction with the first aspect, the first image resource includes a first image frame and a second image frame. The processed first image resource includes an image frame after cropping the first image frame and an image frame after cropping the second image frame. The processed first image frame and the processed second image frame contain the same subject. The relative positional distance between the same subject in the processed first image frame and the processed second image frame is less than or equal to the relative positional distance between the same subject in the first image frame and the second image frame.

[0021] In conjunction with the first aspect, image processing is performed on the first image resource, specifically including: obtaining image frames from the first image resource whose jitter amplitude is less than a second threshold; wherein the image frames whose jitter amplitude is less than the second threshold include a first image frame and a second image frame; and cropping the image frames including the first image frame and the second image frame based on the same subject.

[0022] In this way, electronic devices can align each frame in the image resource and, through cropping and splicing, keep the position of the main object in the picture consistent, making the whole picture more stable and focused on the main object, resulting in a better wallpaper effect and improved user experience.

[0023] In conjunction with the first aspect, the cropping ratio is related to the screen size of the electronic device and / or the display status of the electronic screen.

[0024] In this way, electronic devices can adjust the aspect ratio of the image during cropping according to the screen size and display status, making the cropped wallpaper more suitable for the current display mode of electronic devices, improving the adaptability of wallpaper processing to various situations, and ensuring the user experience.

[0025] In conjunction with the first aspect, the image processing includes frame interpolation; the number of image frames in the processed first image resource is greater than the number of image frames in the first image resource; the additional image frames in the processed first image resource relative to the first image resource are obtained by the electronic device through frame interpolation of the first image resource.

[0026] In this way, electronic devices can perform frame interpolation on image resources. When the image resource selected by the user has too few frames due to processing methods such as removing unstable frames and extracting segments, or when the resource itself has insufficient frames, the electronic device can interpolate the image resource to increase the frame rate of the wallpaper, enhance the smoothness of the wallpaper, and improve the user experience.

[0027] In conjunction with the first aspect, the first image resource includes a first image frame, and the image processing of the first image resource further includes: performing one or more of the following processing on the first image frame of the first image resource: background blurring, enhancing brightness contrast, color contrast and warm / cool contrast, and image sharpening.

[0028] In conjunction with the first aspect, the number of non-subject elements in the processed first image resource is less than the number of non-subject elements in the first image resource.

[0029] In this way, electronic devices can use intelligent composition and imperfection removal to highlight the subject of an image and reduce the interference of background elements, thereby enhancing the expressiveness of the image and improving the user experience.

[0030] In conjunction with the first aspect, the first operation includes the user's selection of wallpaper processing methods, which include: intelligent composition, imperfection removal, frame stabilization, frame supplementation, and adding dynamic effects.

[0031] Electronic devices can personalize wallpapers based on user preferences and settings. Therefore, even when selecting the same image resource, the personalized wallpaper processing can result in different wallpapers, satisfying the diverse wallpaper needs of different users.

[0032] In conjunction with the first aspect, before setting the processed first image resource as the wallpaper of the electronic device, the method further includes: displaying a preview of the processed first image resource.

[0033] In this way, after processing the wallpaper, the electronic device can first display a preview of the processing result, and the user can choose the next step according to whether they are satisfied. They can choose to set the wallpaper or reprocess it, thus ensuring the user experience.

[0034] In a second aspect, this application provides an electronic device comprising: a processor and a memory coupled to the processor, the memory being used to store computer program code including computer instructions, wherein when the processor reads the computer instructions from the memory, the electronic device causes the electronic device to perform the method described in the first aspect.

[0035] Thirdly, this application provides a chip system applied to an electronic device, the chip system including one or more processors, the processors being used to invoke computer instructions to cause the execution of the methods described in the first aspect.

[0036] Fourthly, this application provides a computer-readable storage medium including a computer program that, when run on an electronic device, causes the electronic device to perform the method described in the first aspect.

[0037] Fifthly, this application provides a computer program product that, when run on a computer, causes the electronic device to perform the method described in the first aspect. Attached Figure Description

[0038] Figure 1A is a software architecture diagram of the electronic device 100 provided in an embodiment of this application;

[0039] Figure 1B is a schematic diagram of the software architecture for a wallpaper setting method provided in an embodiment of this application;

[0040] Figure 2 is a wallpaper module 200 provided in an embodiment of this application;

[0041] Figure 3A is a schematic diagram of the interface for setting wallpaper on an electronic device 100 according to an embodiment of this application;

[0042] Figure 3B is a schematic diagram of the interface for setting wallpaper on an electronic device 100 according to an embodiment of this application;

[0043] Figure 3C is a schematic diagram of the interface for setting wallpaper on an electronic device 100 according to an embodiment of this application;

[0044] Figure 3D is a schematic diagram of the interface for setting wallpaper on an electronic device 100 according to an embodiment of this application;

[0045] Figure 3E is a schematic diagram of the interface for setting wallpaper on an electronic device 100 according to an embodiment of this application;

[0046] Figure 3F is a schematic diagram of the interface for setting wallpaper on an electronic device 100 according to an embodiment of this application;

[0047] Figure 3G is a schematic diagram of the interface for setting wallpaper on an electronic device 100 according to an embodiment of this application;

[0048] Figure 3H is a schematic diagram of the interface for setting wallpaper on an electronic device 100 according to an embodiment of this application;

[0049] Figure 3I is a schematic diagram of the interface for setting wallpaper on an electronic device 100 according to an embodiment of this application;

[0050] Figure 4A is a schematic diagram of the wallpaper selection process of an electronic device 100 provided in an embodiment of this application;

[0051] Figure 4B is a schematic diagram of the wallpaper selection process of an electronic device 100 provided in an embodiment of this application;

[0052] Figure 4C is a schematic diagram of the wallpaper selection process of an electronic device 100 provided in an embodiment of this application;

[0053] Figure 5 is a flowchart illustrating a wallpaper setting method provided in an embodiment of this application;

[0054] Figure 6A is a schematic diagram of the effect of intelligent mapping of an electronic device 100 provided in an embodiment of this application;

[0055] Figure 6B is a schematic diagram of the effect of intelligent mapping of an electronic device 100 provided in an embodiment of this application;

[0056] Figure 7A is a schematic diagram of the effect of impurity removal in an electronic device 100 according to an embodiment of this application;

[0057] Figure 7B is a schematic diagram of the effect of impurity removal in an electronic device 100 provided in an embodiment of this application;

[0058] Figure 8A is a schematic diagram illustrating the effect of subject recognition by an electronic device 100 according to an embodiment of this application.

[0059] Figure 8B is a schematic diagram illustrating the effect of subject recognition by an electronic device 100 according to an embodiment of this application.

[0060] Figure 9 is a schematic diagram of the steps of stabilizing frames in the electronic device 100 provided in the embodiment of this application;

[0061] Figure 10A is a schematic diagram of gravity sensing information of a multi-frame resource provided in an embodiment of this application;

[0062] Figure 10B is a schematic diagram of gravity sensing information of a multi-frame resource provided in an embodiment of this application;

[0063] Figure 11A is a conceptual schematic diagram of an image frame cropping provided in an embodiment of this application;

[0064] Figure 11B is a conceptual schematic diagram of an image frame cropping provided in an embodiment of this application;

[0065] Figure 12 is a schematic diagram of the structure of a wallpaper processing module provided in an embodiment of this application;

[0066] Figure 13A is a schematic diagram of image frames of a dynamic image provided in an embodiment of this application;

[0067] Figure 13B is a schematic diagram of the dynamic effect of the "protagonist moment" provided in the embodiment of this application;

[0068] Figure 13C is a schematic diagram of the dynamic effect of "looping playback" provided in the embodiment of this application;

[0069] Figure 13D is a schematic diagram of the dynamic effect of the "motion path" provided in the embodiment of this application;

[0070] Figure 13E is a schematic diagram of the dynamic effect of the "micro-motion moment" provided in the embodiment of this application;

[0071] Figure 14 is a schematic diagram of the hardware structure of the electronic device 100 provided in an embodiment of this application. Detailed Implementation

[0072] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0073] The terminology used in the following embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. As used in the specification and appended claims of this application, the singular expressions “a,” “an,” “the,” “the,” “the,” and “this” are intended to include the plural expressions as well, unless the context clearly indicates otherwise. The terms “first” and “second” are used for descriptive purposes only and should not be construed as implying relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as “first” or “second” may explicitly or implicitly include one or more of that feature. “First” and “second,” etc., are used to distinguish different objects, not to describe a particular order of objects. For example, a first object and a second object are used to distinguish different objects, not to describe a particular order of objects.

[0074] In the description of the embodiments in this application, unless otherwise stated, "multiple" means two or more. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.

[0075] In the embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is an example, illustration, or description. Any embodiment or related scheme described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of the terms "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0076] The term "and / or" in this application is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent three cases: A existing alone, A and B existing simultaneously, and B existing alone.

[0077] To better understand the technical solutions provided in this application, before describing the technical solutions, the applicable electronic device 100 with a camera function will first be described in conjunction with the accompanying drawings. In the embodiments of this application, the electronic device 100 may include, but is not limited to, devices with a camera function such as mobile phones, tablets, and smartwatches. This application does not limit the specific form or type of the electronic device 100.

[0078] The term "user interface (UI)" used in the following embodiments of this application refers to the medium interface through which an application or operating system interacts and exchanges information with the user. It realizes the conversion between the internal form of information and the form that the user can accept. The user interface is source code written in a specific computer language such as Java or Extensible Markup Language (XML). The interface source code is parsed and rendered on the electronic device, ultimately presenting content that the user can recognize. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be visible interface elements such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets displayed on the screen of an electronic device.

[0079] In some examples, electronic devices can allow users to set wallpapers and provide specific wallpaper templates through some applications. However, these wallpapers are mostly templated, fixed, and static, which are not attractive enough to users and cannot meet their personalized needs.

[0080] Users can also download images or take photos to use as wallpaper materials according to their own preferences. However, since users generally choose trendy images as wallpapers, the downloaded images tend to be repetitive and monotonous. When users take their own photos, they often result in monotonous, unrefined images, low success rates, and unsatisfactory photo quality, ultimately compromising the quality of the final wallpaper.

[0081] To address the aforementioned issues and meet users' personalized wallpaper needs, this application provides a wallpaper setting method. In this method, the electronic device allows users to create different types of wallpapers, such as static photos, animated photos, and videos, making wallpapers more diverse. Furthermore, the electronic device can support subsequent creation and generation of wallpapers, optimizing their content and enhancing their expressiveness.

[0082] To better understand the technical solutions provided in this application, before describing the technical solutions, the electronic device 100 to which this application applies will first be described in conjunction with the accompanying drawings. In the embodiments of this application, the electronic device 100 may include, but is not limited to, devices with shooting functions and / or wallpaper setting functions, such as mobile phones, tablets, and smartwatches. The electronic device 100 can store single-frame resources such as still photos, as well as multi-frame resources such as dynamic photos and videos. The embodiments of this application do not limit the specific form or type of the electronic device 100.

[0083] The software structure of the electronic device 100 provided in the embodiments of this application will be introduced first below.

[0084] The electronic device 100 provided in this application embodiment can run an operating system (OS). This operating system can be various operating systems used in industry, such as an operating system based on OpenHarmony, like HarmonyOS; or other operating systems such as Android. TM An operating system can refer to the iOS mobile operating system; it can also refer to various open-source operating systems or their derivatives, such as Linux OS and other embedded operating systems; or it can refer to future new operating systems, such as AI operating systems based on artificial intelligence. An operating system is a set of interconnected system software programs that manage and control the operation of electronic devices, utilize and run hardware and software resources, and provide public services to organize user interactions. In electronic devices, the operating system connects downwards to the physical devices at the hardware layer and upwards to provide a runtime environment for application software.

[0085] An operating system typically includes a kernel layer, a middleware layer, and an application layer. The application layer includes applications, which can include system applications and third-party applications. The middleware layer includes a suite of software providing various services to application developers, or frameworks providing services such as databases, multimedia, and graphics, or capabilities such as distributed scheduling and system scaling. For example, the middleware layer may include a framework layer and / or a system service layer. The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The system service layer includes the system's core capabilities, providing services to applications through the framework layer. The kernel layer is the layer between hardware and software. The kernel layer may include hardware drivers and the operating system kernel. In addition to providing hardware drivers, the kernel layer also supports functions such as memory management and system process management.

[0086] The electronic devices we use in our daily lives come in various types and forms, and are applied in a wide range of scenarios. Therefore, based on the different forms and functions of electronic devices, different application scenarios, and different user needs, the operating systems used in these devices may also differ. The basic functions implemented by the electronic device provided in this application can be implemented using a general-purpose operating system or a dedicated operating system. To more clearly illustrate the implementation of the embodiments of this application under a specific operating system, the architecture of HarmonyOS is shown below. Those skilled in the art can deduce the implementation of the embodiments of this application under other specific operating systems, such as Android™.

[0087] As shown in Figure 1A, in some embodiments, the software architecture of the electronic device 100, from bottom to top, consists of: a kernel layer, a system service layer, a framework layer, and an application layer. The layers communicate with each other through software interfaces. System functions can be tailored, added, or combined at the subsystem level in different device deployment scenarios, and each subsystem can also be tailored, added, or combined at the functional level.

[0088] kernel layer

[0089] The Kernel Abstraction Layer (KAL) provides basic kernel capabilities to upper layers by shielding the differences between multiple kernels, including but not limited to process / thread management, memory management, file system, network management, and peripheral device management.

[0090] Kernel Subsystem: Supports the selection of a suitable OS kernel for different resource-constrained devices, including but not limited to Linux kernel, HarmonyOS kernel, LiteOS (Lite Operating System), etc.

[0091] Driver Subsystem: The driver framework is the foundation for the open system hardware ecosystem, providing unified peripheral access capabilities and a framework for driver development and management. The driver framework includes: display drivers, camera drivers, audio drivers, Bluetooth drivers, sensor drivers, etc.

[0092] System service layer

[0093] The system service layer comprises the core capabilities of the system, providing services to applications through the framework layer. This layer includes, but is not limited to, the following subsystems:

[0094] The system's basic capability subsystem set provides fundamental capabilities for the operation, scheduling, and migration of distributed applications across multiple devices. This set may include distributed soft bus, distributed data management, distributed task scheduling, and Ark multi-language runtime; it may also include multi-modal input subsystem, graphics subsystem, security subsystem, and AI business subsystem.

[0095] Basic software service subsystem set: provides public and general software services; the basic software service subsystem set may include event notification subsystem, telephone service subsystem, multimedia subsystem, etc.

[0096] Enhanced software service subsystem suite: Provides differentiated enhanced software services for different devices; the enhanced software service subsystem suite may include smart screen proprietary business subsystem, wearable proprietary business subsystem, IoT proprietary business subsystem, etc.

[0097] Hardware service subsystem set: Provides hardware services; the hardware service subsystem set may include location service subsystem, user IAM (Identity and Access Management) subsystem, wearable proprietary hardware service subsystem, biometric identification, IoT proprietary hardware service subsystem, etc.

[0098] Distributed task scheduling enables distributed service management (discovery, synchronization, registration, and invocation), supporting remote startup, remote invocation, remote connection, and migration of applications across devices.

[0099] Distributed data management enables data synchronization, data storage, data sharing, and data access across all scenarios and devices.

[0100] The distributed soft bus provides communication-related capabilities for seamless interconnection between multiple devices, including: WLAN service capabilities, Bluetooth service capabilities, soft bus, inter-process communication RPC (Remote Procedure Call), and StarFlash communication capabilities.

[0101] Ark Multilingual Runtime is a unified compilation runtime platform designed to support the joint compilation and execution of multiple programming languages ​​and multiple chip platforms.

[0102] Framework layer

[0103] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The framework layer includes: the ArkUI framework (which provides a complete infrastructure for UI development of system applications, including UI functions such as components, layouts, animations, and interactive events, as well as a real-time interface preview tool), the user application framework, and the Ability framework (an Ability is a lightweight application; the Ability framework schedules and manages the operation and lifecycle of Abilities). Different devices may have different operating systems, and the APIs they support may also differ.

[0104] The HarmonyOS API is a series of open capabilities provided to support HarmonyOS application development. The HarmonyOS API can be set at the framework layer or independently of the framework layer. The HarmonyOS API includes the Audio API (audio service), Push API (push service), and Account API (account service), among others.

[0105] Application layer

[0106] Applications can include system apps and extended / third-party apps. System apps can include the desktop, control bar, settings, contacts, phone, camera, etc., while extended / third-party apps can include social apps, travel apps, etc.

[0107] Figure 1B exemplarily illustrates a software architecture diagram for a wallpaper setting method. In this embodiment, the electronic device 100 can implement the wallpaper setting method provided in this embodiment based on the software architecture shown in Figure 1B.

[0108] The application layer of electronic device 100 may include system applications and third-party applications.

[0109] The frame layer of the electronic device 100 may include a wallpaper selection module, a wallpaper processing module, a wallpaper preview module, and a wallpaper setting module.

[0110] The wallpaper selection module is used to determine the wallpaper type. After receiving user input and confirming the selected wallpaper material, the wallpaper selection module can send the wallpaper material to the wallpaper processing module.

[0111] The wallpaper processing module can be used to process the wallpaper selected by the selection module. Processing methods can include highlighting key elements, removing imperfections, and stabilizing frames. After processing the wallpaper, the wallpaper processing module can send the processed wallpaper to the wallpaper preview module.

[0112] The wallpaper preview module can display and preview the processed wallpaper and receive user feedback for further processing. If it receives a reprocessing instruction, the wallpaper preview module can trigger the wallpaper processing module to re-execute the wallpaper processing operation. If the wallpaper preview module receives confirmation from the user that the wallpaper has been set, it can send the processed wallpaper to the wallpaper setting module.

[0113] The wallpaper settings module can be used to generate and set wallpapers.

[0114] The service layer of the electronic device 100 may include a wallpaper module, which can be used to support the implementation of various capabilities of the electronic device 100 mentioned above. The wallpaper service module may have the ability to select, process, preview, set, and other basic capabilities for the wallpaper setting process.

[0115] The kernel layer of the electronic device 100 may include system and hardware-related resources, such as an image processing module that can provide image processing capabilities, resources and algorithms, a video processing module and a low-level algorithm processing module, which are used to call relevant hardware resources during wallpaper processing.

[0116] The following uses an electronic device 100 as an example to illustrate the wallpaper setting method provided in the embodiments of this application.

[0117] In this embodiment, the electronic device 100 may include a wallpaper module 200, which can be used to implement the wallpaper setting method provided in this embodiment. The wallpaper module 200 can be a system capability, a software development kit, a resident service, or a low-level hardware capability, etc. This embodiment does not limit the specific form of the wallpaper module 200. As shown in Figure 2, the wallpaper module 200 may consist of the wallpaper selection module, wallpaper processing module, wallpaper preview module, and wallpaper setting module shown in Figure 1B.

[0118] The wallpaper module 200 can be used to support the entire process of users setting wallpapers, including steps such as selecting wallpapers, processing wallpapers, previewing wallpapers, and setting wallpapers.

[0119] The wallpaper selection module allows users to choose suitable wallpapers, and the wallpaper materials provided by the wallpaper selection module can be in a variety of formats.

[0120] For example, wallpaper materials can include single-frame resources, multi-frame resources, and other types. Single-frame resources can include resources such as still images. Multi-frame resources can include resources such as animated images and videos.

[0121] The wallpaper selection module can also be used to receive user selections and determine the wallpaper material chosen by the user.

[0122] After determining the wallpaper material selected by the user, the electronic device 100 can optimize the wallpaper through the wallpaper processing module to enhance its expressiveness and make it more visually appealing.

[0123] Then, the electronic device 100 can display the processed wallpaper through the wallpaper preview module so that users can view the status of the wallpaper material after processing.

[0124] Finally, if the electronic device 100 receives confirmation from the user that the wallpaper has been selected, it will generate the processed wallpaper material through the wallpaper setting module and set it as the wallpaper of the electronic device 100.

[0125] Thus, the electronic device 100 can complete a wallpaper setting process, including the wallpaper processing step, through the wallpaper module 200. Figures 3A-3I will illustrate in detail a user interface diagram of the entire process of this wallpaper setting method.

[0126] As shown in Figure 3A, the electronic device 100 can display a user interface 300A, which can be referred to as the desktop of the electronic device 100. The user interface 300A may include a theme control 301, a photo album control 302, and a settings control 303.

[0127] Electronic device 100 can receive user operations on corresponding controls and open the corresponding user interface.

[0128] For example, the electronic device 100 can receive a click operation on the theme control 301 and display the theme settings interface. The theme settings interface can be used by the user to set the decorative theme of the electronic device 100, including wallpaper, lock screen, icon type and other content.

[0129] The electronic device 100 can also receive click operations on the album control 302 to display the album interface. The album interface can be used to display static and dynamic resources in the electronic device 100, including static pictures, animated pictures, videos, and other content.

[0130] The electronic device 100 can also receive clicks on the settings control 303 to display a system settings interface. This system settings interface allows users to adjust user-defined system-level operating parameters. These system-level operating parameters may include personalized display parameters, such as wallpaper content.

[0131] The wallpaper selection module of Electronic Device 100 allows users to choose wallpaper materials from two sources: one is from the application, and the other is from the resource library. Below, we will first introduce the entire process of setting a wallpaper using the example of selecting wallpaper materials from the application.

[0132] In some examples, electronic device 100 can receive user clicks on setting control 303 and display user interface 300B.

[0133] As shown in Figure 3B, the user interface 300B can also be referred to as the system settings interface of the electronic device 100. The user interface 300B includes multiple controls for users to adjust various system parameters, including control 304. Control 304 is used to trigger the electronic device 100 to display the "Desktop and Personalization" settings interface, where users can set the theme, wallpaper, always-on display, magazine lock screen, icons, and other content of the electronic device 100.

[0134] For example, electronic device 100 can receive a click operation on control 304 to display user interface 300C as shown in FIG3C, and user interface 300C may include control 305. Electronic device 100 can receive a click operation on control 305 to display wallpaper setting interface.

[0135] As shown in Figure 3D, in response to a click on control 305, electronic device 100 can display user interface 300D. User interface 300D can be used to display the currently set wallpaper on electronic device 100, as well as recommended wallpapers, etc. User interface 300D may also include a wallpaper setting control 306, which can be used to access the photo album of electronic device 100. Electronic device 100 can display resources in the photo album for the user to select wallpaper materials.

[0136] As shown in Figure 3E, in response to a click on the wallpaper setting control 306, the electronic device 100 can display a user interface 300E, which can be referred to as the photo album interface of the electronic device 100. The photo album of the electronic device 100 can include various resources that can be used as wallpaper materials, such as static resources and dynamic resources. For example, the user interface 300E can include dynamic pictures 307, videos 308, and static pictures 309.

[0137] The electronic device 100 can receive a user's selection operation for any of the resources among the animated image 307, video 308, and still image 309, and use that resource as wallpaper material for further processing.

[0138] For example, if the user selects animated image 307, the electronic device 100 can process the animated image 307 through the wallpaper processing module.

[0139] In some examples, as shown in Figure 3F, when the electronic device 100 is processing wallpaper, the electronic device 100 can display a user interface 300F, display a dynamic image 307 at full screen size as a background, and display an activity indicator 310 on the screen. This activity indicator 310 can be used to notify the user that the electronic device 100 is currently processing wallpaper.

[0140] For details regarding the wallpaper processing step performed by the electronic device 100, please refer to the descriptions of Figures 5-12 below, which will not be repeated here.

[0141] After the electronic device 100 completes the wallpaper processing, the result can be displayed through the wallpaper preview module. As shown in Figure 3G, the processed animated image 307 can be displayed in the user interface 300G of the electronic device 100. The user interface 300G may also include an identifier 311, which can be used to indicate to the user that the electronic device 100 is in wallpaper preview mode. In some examples, as shown in Figure 3G, the identifier 311 can be an "eye" shape, located in the upper right corner of the screen. Of course, the shape, size, and position of the identifier 311 shown in Figure 3G are only examples, and the identifier 311 can also be displayed in other positions on the screen and in other shapes. This application embodiment does not limit the specific shape or position of the identifier 311.

[0142] The user interface 300G may also include controls 312, 313, and 314. Control 312 can be used to apply the wallpaper displayed by the wallpaper preview module as the wallpaper of the electronic device 100. Control 313 can be used to process the current wallpaper again. Control 314 can be used to turn the dynamic effects of the wallpaper on or off. In the case shown in Figure 3G, the dynamic effects of the wallpaper are off, and the electronic device 100 can receive the user's click operation on control 314 to turn on the dynamic wallpaper preview mode. Alternatively, if the wallpaper material confirmed by the wallpaper selection module of the electronic device 100 is a multi-frame resource, the electronic device 100 will usually also obtain a dynamic wallpaper after processing the dynamic resource. When previewing the dynamic wallpaper, the electronic device 100 can turn on the dynamic effects of the wallpaper preview by default. The rules for turning the dynamic effects of the wallpaper on and off can also be set by the user, and this embodiment does not limit this.

[0143] In response to a click on control 312, electronic device 100 can set the processed wallpaper as its wallpaper via the wallpaper setting module. Electronic device 100 can display a user interface 300H as shown in Figure 3H, where the wallpaper bar 315 displays the currently set wallpaper. It can be seen that the wallpaper of electronic device 100 has been changed to a wallpaper related to the content of the animated image 307, which is obtained by processing the animated image 307 using the wallpaper processing module. An icon 316 can also be displayed in the wallpaper bar 315; icon 316 can be used to identify that the wallpaper is a live wallpaper. If the wallpaper set by electronic device 100 is a static wallpaper, icon 316 will not be displayed.

[0144] In this way, the electronic device 100 can complete the entire wallpaper setting process. The electronic device 100 can receive the user's selection, process the selected wallpaper material, and set it as the wallpaper of the electronic device 100, thereby meeting the user's personalized needs.

[0145] Optionally, for the wallpaper selection module of the electronic device 100, in some examples, the electronic device 100 may also support users selecting wallpaper materials from resources. As shown in Figure 3I, the electronic device 100 may display a user interface 300I, which can be referred to as the gallery interface of the electronic device 100. The electronic device 100 may display a live image 307 and a control 317 in the user interface 300I. The control 317 can be used to trigger the electronic device 100 to display more option controls regarding the live image 307, such as option control 318. This option control 318 can be used to set the live image 307 as the wallpaper of the electronic device 100.

[0146] Thus, in addition to selecting wallpaper materials in the system settings, the wallpaper selection module of the electronic device 100 can also allow users to select wallpaper materials from the resources section. After the user selects a wallpaper material from the resources section, the electronic device 100 can still perform the wallpaper processing and subsequent steps. The specific process can still be referred to the description of Figures 3F-3H above, and will not be repeated here.

[0147] Optionally, regarding the wallpaper processing module of the electronic device 100, in some examples, the wallpaper processing steps performed by the electronic device 100 may be set by the system default of the electronic device 100. For example, when the electronic device 100 sends the wallpaper material selected in the wallpaper selection module to the wallpaper processing module, the wallpaper processing module can identify the type of wallpaper material and adaptively adjust the subsequent wallpaper processing steps based on the type of wallpaper material. Exemplarily, the wallpaper processing steps that the electronic device 100 can perform through the wallpaper processing module may include, but are not limited to: intelligent composition, imperfection removal, frame stabilization, and frame supplementation.

[0148] Optionally, in some embodiments, the electronic device 100 may also support the user to independently select the desired wallpaper processing step. For example, in the step shown in FIG3H above, after the user selects the wallpaper material and before the electronic device 100 performs the wallpaper processing step, the electronic device 100 may prompt the user to select the desired wallpaper processing step.

[0149] As shown in Figure 4A, after the electronic device 100 receives the user's selection of wallpaper material through the wallpaper selection module, before performing wallpaper processing, the electronic device 100 can display a user interface 400A. The user interface 400A may include a prompt box 401, which can prompt the user to choose between the system-recommended wallpaper processing step or manually select the desired wallpaper processing step. The prompt box 401 may include a control 402, which can be used to trigger the electronic device 100 to enter the manual wallpaper selection processing step. In response to a click operation on the control 402, the electronic device 100 can display a user interface 400B.

[0150] As shown in Figure 4B, the user interface 400B may include a selection bar 403, which may display one or more wallpaper processing methods.

[0151] For example, the wallpaper processing methods displayed in the selection bar 403 may include smart composition, imperfection removal, frame stabilization, and supplementary frames. The electronic device 100 can receive the user's selection and determine the operations to be performed in subsequent wallpaper processing steps.

[0152] In this way, the electronic device 100 can not only adjust the wallpaper processing steps based on preset rules or by recognizing the type of wallpaper material, but also allow users to customize the wallpaper processing steps.

[0153] Next, after determining the operations or steps included in the wallpaper processing stage, the electronic device 100 can process the wallpaper step by step. The wallpaper processing stage of the electronic device 100 will be described in detail below with reference to the accompanying drawings. See Figure 5, which exemplarily illustrates a flowchart of the wallpaper processing procedure performed by the electronic device 100.

[0154] It should be understood that in the steps shown in Figure 5, the electronic device 100 may selectively perform one or more of the steps. The specific number of steps performed may depend on the type of wallpaper material received by the wallpaper processing module, or be determined by the user's autonomous selection as shown in Figures 4A and 4B above.

[0155] Optionally, as shown in Figure 4C, the electronic device 100 can detect the wallpaper material selected by the user. When the user-selected wallpaper material is detected to be a multi-frame resource, the electronic device 100 can also display a user interface 400C. The user interface 400C may include a selection bar 404, which can be used by the user to select the dynamic effects to be added, such as "loop playback," "protagonist moment," "motion path," "micro-motion instant," etc. The electronic device 100 can further process the multi-frame resource. The user can also select "original effect," in which case the electronic device 100 will not add dynamic effects to the wallpaper material. For details on the dynamic effects, please refer to the description of Figures 13A-13E below, which will not be repeated here. This application embodiment does not limit the specific number and type of dynamic effects that the electronic device 100 can add.

[0156] As shown in Figure 5, the wallpaper processing step of the electronic device 100 may include the following steps.

[0157] S501. Electronic device 100 intelligently processes elements in wallpaper materials through a wallpaper processing module to highlight key elements.

[0158] In some examples, after receiving a wallpaper image selected by the user, the electronic device 100 can determine the focal point of the wallpaper image, which can be a person, animal, building, or other subject. Then, the electronic device 100 can compose the wallpaper image based on these focal points to highlight them, resulting in a better composition and a more sophisticated and refined wallpaper.

[0159] For example, if the wallpaper material received by the wallpaper selection module focuses on people, the electronic device 100 will perform intelligent composition based on the people to highlight the people and reduce the interference of other things such as the background. The processing of wallpaper materials by the electronic device 100 is shown below based on Figures 6A and 6B.

[0160] As shown in Figure 6A, which exemplarily illustrates an image with a person as the focal point, when the electronic device 100 receives a user's selection of Figure 6A as wallpaper, it performs intelligent processing on Figure 6A. In some examples, the electronic device 100 can determine that the focal point in Figure 6A is a person. Then, the electronic device 100 can determine to perform intelligent composition based on the person type.

[0161] For example, the electronic device 100 can detect the main subject (human figure) in an image based on an algorithm and determine the human figure area. Then, the electronic device 100 can separate the human figure area from the background into an independent layer and distinguish non-human elements in the image, such as the sky, buildings, and vegetation. Finally, the electronic device 100 can perform processing such as blurring on the non-human figure areas in the image to weaken the influence of the background and make the human figure area stand out more.

[0162] The result of the electronic device 100 processing Figure 6A can be seen in Figure 6B. The electronic device 100 blurred the background other than the person in Figure 6A to highlight the person.

[0163] Optionally, the electronic device 100 can also optimize the figure area, such as edge optimization, using algorithms to smooth jagged edges at the boundary between the figure and the background, enhancing the naturalness of the cutout. Another example is local brightening, automatically brightening areas such as the face and clothing, and enhancing texture details, such as hair strands and clothing texture.

[0164] The above descriptions of Figures 6A and 6B are merely examples, and the specific operations of smart mapping that the electronic device 100 can perform are not limited in the embodiments of this application.

[0165] It should be understood that this intelligent wallpaper composition process is personalized and tailored to individual terminal devices. For example, for the same wallpaper material, the wallpaper processing result of electronic device 100 and electronic device 300 (not shown in the figure) may be different. Electronic device 100 can plan a general intelligent wallpaper composition process according to user preferences, and users can achieve different target styles through their personalized settings. Even using the same original wallpaper material, different devices can ultimately set wallpapers with different styles. Therefore, the wallpaper setting method provided in this application embodiment can also meet the diverse wallpaper needs of different users.

[0166] S502. Electronic device 100 processes or removes distracting items from wallpaper materials using a wallpaper processing module.

[0167] Electronic device 100 can process and remove distracting elements in the wallpaper, and can perform targeted processing based on user preferences to reduce the impact of impurities on the wallpaper.

[0168] For a single frame resource, the impurity removal operations that the electronic device 100 can perform may include, but are not limited to, elimination, replacement, and other operations.

[0169] For example, as shown in Figure 7A, a scenario occurs where a user, while taking photos during a visit, accidentally includes other tourists in the frame. The user actually intends to photograph elephant 701 in Figure 7A. However, due to crowd density, shooting angle, and other factors, tourist 702 is inevitably also captured in the frame. When processing Figure 7A, the electronic device 100 can identify and remove elements from Figure 7A based on the user's selection. For instance, the electronic device 100 can remove tourist 702 from Figure 7A, resulting in the image shown in Figure 7B, where only elephant 701 remains, thus satisfying the user's needs.

[0170] Alternatively, the electronic device 100 can replace the tourist 702 in Figure 7A with other objects to fill the screen, reducing the emptiness of the screen caused by the elimination operation. This application embodiment does not limit the specific operations that the electronic device 100 can perform when processing interference items.

[0171] For multi-frame resources, the imperfection removal operations that the electronic device 100 can perform can include not only processing methods for single-frame resources such as elimination, replacement, and enhancement, but also processing for imperfection frames. For example, for frames that are accidentally captured, unstable, or unattractive in a multi-frame resource, the electronic device 100 can delete these frames to improve the overall visual effect of the multi-frame resource.

[0172] The above descriptions of steps S501 and S502 both involve the recognition and filtering of objects in the image. Below, we introduce some algorithms that electronic device 100 can utilize to achieve the above effects.

[0173] 1. Saliency segmentation algorithm based on main object detection algorithm

[0174] A salient segmentation algorithm is an algorithm used to accurately segment the most salient objects in an input image. The electronic device 100 can perform salient segmentation on objects within a detection bounding box to obtain pixel-level masks for each object in the image. The mask can be used to annotate the contour and position of each object. The electronic device 100 can use the pixel-level mask to distinguish between target pixels and background pixels in the image, achieving pixel-level segmentation of key elements.

[0175] For example, taking Figures 6A and 7A above as examples, when the electronic device 100 processes the image shown in Figure 6A, it can detect the main body 601 of the person. The exemplary detection result can be referred to Figure 8A, where the electronic device 100 can detect the area 801 occupied by the main body 601.

[0176] When processing the image shown in Figure 7A, the electronic device 100 can detect not only the elephant 701 but also the tourist 702. An exemplary detection result can be seen in Figure 8B, where the electronic device 100 can identify the area 802 occupied by the elephant 701 and the area 803 occupied by the tourist 702, respectively.

[0177] It should be understood that the subject detection and region segmentation shown in Figures 8A and 8B are merely examples. In practice, the electronic device 100 can also perform pixel-level region segmentation, and the region identified by the electronic device 100 can be segmented along the edge pixels of the target subject. This application does not limit the specific method by which the electronic device 100 runs the saliency segmentation algorithm.

[0178] Optionally, if there are multiple subjects in the image, as shown in Figure 7A, the electronic device 100 can also detect specific subjects according to user needs, such as detecting only human subjects or only animal subjects. The electronic device 100 can use human subjects as target detection subjects, or it can use other subjects as target detection subjects. This application embodiment does not limit this.

[0179] 2. Semantic Segmentation Algorithm

[0180] The electronic device 100 can segment pixels according to their semantic meaning in an image. The segmentation types can include 10 categories: people, sky, greenery, food, cats and dogs, buildings, flowers, water, sand, and mountains. The electronic device 100 can also simultaneously identify multiple subject categories in an image using a semantic segmentation algorithm. For example, the description of step S501 above involves distinguishing non-human subject elements.

[0181] It is understood that steps S501 and S502 described above can be used for processing both single-frame and multi-frame resources. The electronic device 100 can determine whether to perform these two steps based on user operation, without being limited by the type of wallpaper material.

[0182] The electronic device 100 can perform operations such as detection and segmentation of the subject using the two algorithms described above. Other algorithms can also be used to achieve similar effects. This application does not limit the specific method used by the electronic device 100.

[0183] S503. Electronic device 100 performs stable frame processing on multi-frame resources through a wallpaper processing module.

[0184] When the wallpaper material selected by the user is a multi-frame resource, the electronic device 100 can also perform frame stabilization processing. The electronic device 100 processes the multi-frame resource, uses the most stable subframe from the multi-frame resource for presentation, and selects N stable frames to present dynamic effects.

[0185] Referring to Figure 9, the frame stabilization process performed by the electronic device 100 may include the following three steps.

[0186] S901. Electronic device 100 acquires multiple frame resources, removes unstable frames, and obtains stable frame resources.

[0187] First, when processing stable frames, the electronic device 100 can first remove unstable frames from the multi-frame resources. Removing unstable frames can make the final wallpaper effect smoother. Unstable frames can include various types, such as blurry, abrupt, black screen, green screen, distorted screen, and broken frames. The electronic device 100 can first determine the unstable frames in the multi-frame resources through information recorded in the device and scene matching.

[0188] In some examples, when processing multi-frame resources, electronic device 100 can obtain the timestamps corresponding to the multi-frame resources, as well as the gravity sensor information of electronic device 100 and the timestamps corresponding to the gravity sensor information. The gravity sensor information may include data such as the device orientation, gravity sensing value, acceleration, gravity direction, and motion path of electronic device 100, which can be used to indicate the device's motion state. Then, electronic device 100 can obtain the gravity sensor information corresponding to the multi-frame resources by aligning the two timestamps. In this way, electronic device 100 can determine its motion state when capturing the multi-frame resources. If the movement of electronic device 100 is large, it indicates that the lens shake was also large during shooting, resulting in unstable frames such as blurriness and abrupt changes in the captured multi-frame resources. By analyzing the gravity sensor information corresponding to the multi-frame resources, electronic device 100 determines the segment containing the unstable frames in the multi-frame resources.

[0189] For example, as shown in Figure 10A, Figure 10A illustrates gravity sensor information corresponding to a multi-frame resource.

[0190] The horizontal axis indicates the timeline of the multi-frame resource, while the vertical axis indicates the gravity sensor value of the electronic device 100 at the corresponding moment. The electronic device 100 can determine its stability at that time by the magnitude of the change in the gravity sensor value, and thus determine whether the corresponding multi-frame resource is stable. The electronic device 100 can preset a change threshold. If the magnitude of the change in the gravity sensor value of the electronic device 100 is large within a certain time period, exceeding the change threshold, it indicates that the movement amplitude of the electronic device 100 and the lens shake amplitude are large within this time period, and the multi-frame resource at the captured location is likely to be unstable, as shown in segments 1001 and 1002 in Figure 10A.

[0191] Based on the change in gravity sensor values, electronic device 100 can determine that segments 1001 and 1002 are unstable frame segments in the multi-frame resource. In subsequent processing, electronic device 100 can remove the two segments from the multi-frame resource to obtain stable frame resources.

[0192] Alternatively, the electronic device 100 can also determine other types of unstable frames through scene matching or other methods.

[0193] For example, if electronic device 100 detects that the Kth frame and the K+1th frame in a multi-frame resource are completely identical, electronic device 100 can determine that there are duplicate frames, and then electronic device 100 can delete one of the frames.

[0194] For example, if electronic device 100 detects a black segment of the screen content, it can determine that a black screen phenomenon exists.

[0195] Other scenarios with unstable frames can also be pre-stored in the electronic device 100. When the electronic device 100 determines that the scenario has occurred, it can determine that there are unstable frames of the corresponding type, remove the unstable frames, and finally obtain stable frame resources.

[0196] S902. Electronic device 100 extracts stable frame fragments from stable frame resources.

[0197] After removing unstable frames and obtaining stable frame resources, the electronic device 100 can extract a stable frame segment from these resources. This stable frame segment is the most stable among all segments in the stable frame resource. The electronic device 100 can determine the stability of a segment by calculating its variance, as shown in the following formula: S^2={(x1-m)^2+(x2-m)^2+(x3-m)^2+…+(xn-m)^2} / n.

[0198] In this context, for a given segment, x1, x2…xn can be data from the gravity sensor information mentioned above, such as the gravity sensing values ​​shown in Figure 10A. m is the average of all data, such as the average of the gravity sensing values. n is the number of data points, such as the number of seconds or frames in the segment. S^2 represents the variance. The smaller the variance of a segment, the more stable the segment. The electronic device 100 can calculate the n frame segments with the smallest variance from the multi-frame resource and use them as stable frame segments.

[0199] In some examples, the electronic device 100 may set the value of n to 60. That is, the target number of frames for the stable frame segment extracted by the electronic device 100 is 60 frames. The electronic device 100 may also set the value of n to 90 or other values. The specific value of n is not limited in this embodiment.

[0200] Optionally, the electronic device 100 may not limit the value of n. When the variance is less than a certain threshold, the electronic device 100 can extract as many stable frame segments as possible from the multi-frame resources.

[0201] Optionally, in some examples, when extracting stable frame segments, the electronic device 100 may prioritize extracting from the middle segment of the stable frame resource. This is because, according to typical user shooting habits, users are usually highly focused during the middle segment of the shooting process, maintaining device stability and aiming at the subject. Therefore, extracting stable frame segments from the middle segment of the video increases the probability of obtaining high-quality segments. As shown in Figure 10B, the middle segment of segment 1003, a multi-frame resource, shows relatively small fluctuations in the gravity sensor value corresponding to the frame resource, indicating that the electronic device 100 was relatively stable when shooting segment 1003.

[0202] Optionally, in step S901 above, the electronic device 100 can also determine unstable frame segments by calculating variance. For example, the electronic device 100 may have a preset variance threshold. If the variance of a segment is greater than the variance threshold, the electronic device 100 can determine that the segment is an unstable frame segment and delete the segment.

[0203] S903. Electronic device 100 performs enhanced stabilization operation on the stabilized frame segment.

[0204] After extracting the stable frame segments, the electronic device 100 can also perform frame enhancement operations on the stable frame segments to achieve a powerful frame stabilization effect. When enhancing the stable frames, the electronic device 100 can crop the image to make the overall image more stable and highlight the key elements in the image.

[0205] For example, as shown in Figure 11A, the i-th, k-th, and j-th frames of a stable frame segment can be any three frames within a stable frame segment. Each of these three frames includes region 1101. Region 1101 can include the subject object captured in this video segment. When shooting video, if the subject object is moving or the user wants to capture a moving effect, it is difficult for the user to maintain the subject object in the same relative position in the frame. Thus, even if the electronic device 100 performs the aforementioned processes such as removing unstable frames and extracting stable frame segments, it is difficult to guarantee that the position of the subject object remains consistent in the stable frame. When the relative position of the subject object in the frame changes significantly across multiple frames, it can also cause the user to perceive the frame as unstable. Therefore, the electronic device 100 can solve this problem by enhancing the stabilization operation.

[0206] In some examples, as shown in Figure 11B, the electronic device 100 can crop the i-th frame, the k-th frame, and the j-th frame respectively. The cropping rules can be referred to in Figure 11B. The electronic device 100 can align the regions 1101 in the i-th frame, the k-th frame, and the j-th frame and crop out a common region 1102 for the three frames.

[0207] Region 1102 has a larger area than region 1101, and in any frame, region 1102 can include all the pixels of region 1101. This is because the user's shooting process is usually dynamic, and the objects in the captured wallpaper material also change. Using a larger region 1102 to align with region 1101 ensures that pixels of the subject matter are not lost during multi-frame processing. When setting wallpaper later, the electronic device 100 can select a suitable area from region 1102 as the wallpaper content based on the screen size of the electronic device.

[0208] For example, after cropping the image, the electronic device 100 ensures that the relative position of region 1101 remains consistent across all frames. Then, the electronic device 100 can set region 1101 as wallpaper.

[0209] The i-th, k-th, and j-th frames shown in Figures 11A and 11B are merely examples. In practice, when performing enhanced stabilization operations, the electronic device 100 can crop each frame in the stabilization frame segment to achieve the effect of maintaining a consistent relative position of the subject in each frame.

[0210] In some examples, the electronic device 100 can set the image ratio of region 1102 in the above-mentioned content to 4:3. This allows for better compatibility with various device models, such as candybar phones, foldable phones, and tablets, during subsequent wallpaper settings. However, this application embodiment does not limit the specific image ratio of the cropped area.

[0211] Optionally, during the cropping process, the portion to be cropped, including the top, bottom, left, and right sides, shall not exceed 10% of the image, and the cropped image shall always maintain the original aspect ratio to facilitate better subsequent synthesis of stable frames. This 10% is a value determined based on the current 4:3 cropping area and the size of the area containing the subject to be used as wallpaper. Customization is possible if the device differs. For example, if the subject photographed by the user is small and needs to be emphasized, the 10% can be further increased to crop out more unnecessary parts of the image.

[0212] In some examples, when the electronic device 100 performs frame stabilization processing, it can also perform operations such as subject detection and segmentation to achieve effects such as highlighting the visual focus and optimizing the wallpaper layout. The electronic device 100 can implement these operations using methods such as saliency segmentation algorithms based on subject object detection algorithms described above. This application embodiment does not limit the specific methods involved in the frame stabilization operation of the electronic device 100.

[0213] Optionally, for multi-frame resources, the electronic device 100 can also process them using an optical flow algorithm to obtain the density of object motion flows in the multi-frame resources, which can be used to analyze, for example, the density of traffic or pedestrian flow. The electronic device 100 can divide the multi-frame resources into regions based on these densities, for example, dividing multi-frame resources involving traffic flow into regions with high and low traffic flow density. This achieves the specific effect desired by the user. The electronic device 100 can also use the optical flow algorithm to distinguish moving objects from static backgrounds in an image, or to eliminate video jitter, maintain stability, etc. Alternatively, the electronic device 100 can also use the optical flow algorithm to generate intermediate frames, which can be used in the supplementary frame stage of step S504 below.

[0214] The wallpaper processing module of electronic device 100 will be described in more detail below, focusing on the stable frame processing step in step S503.

[0215] As shown in Figure 12, the structure of the wallpaper processing module of the electronic device 100 may include a decoding unit, a judgment unit, a cropping and scaling unit, a stabilizing frame unit, and an encoding unit. The stabilizing frame unit may include a hardware feature extraction unit, a registration and homography matrix unit, and a geometric deformation and cropping unit.

[0216] In some examples, the wallpaper processing module of electronic device 100 can receive wallpaper material selected by the user in the wallpaper selection module. The wallpaper material is then decoded. The purpose of decoding is to convert the compressed video stream into raw pixel data that can be directly manipulated by the algorithm, providing a prerequisite for pixel-level processing.

[0217] Then, the electronic device 100 can perform an entry judgment through the judgment unit to determine the subsequent processing steps. The judgment unit can make judgments based on the user's selection and the type of wallpaper material. Specific judgment criteria can be found in the descriptions of Figures 4B and 5 above, and will not be repeated here. This explanation will use the wallpaper processing module of the electronic device 100 performing stable frame operations on multi-frame resources as an example.

[0218] In one possible implementation, the electronic device 100 can first crop and resize the wallpaper material to highlight the key elements in the wallpaper material. For the specific effect, please refer to the description of step S501 above, which will not be repeated here.

[0219] Subsequently, the electronic device 100 can perform frame stabilization operations on the wallpaper material through the frame stabilization unit. The electronic device 100 can also remove unstable frames and extract stable frame segments from the wallpaper material through the hardware feature extraction unit. For specific operation procedures, please refer to the description of steps S901 and S902 above, which will not be repeated here.

[0220] After extracting the stable frame segment, the electronic device 100 can input the stable frame segment into the registration + homography matrix unit to align the multi-frame images of the stable frame segment, aligning the key objects in each frame. Then, the electronic device 100 can perform geometric deformation and cropping operations to crop and stitch the multi-frame images to ensure that the relative positions of the key objects in each frame are consistent, thereby enhancing the effect of stable frames. The specific effect of enhancing stable frames can be referred to the description of step S903 above, and will not be repeated here.

[0221] Finally, the electronic device 100 encodes the processed data through the encoding unit to obtain the processed wallpaper material, and outputs it to the wallpaper preview module for users to view.

[0222] Optionally, after encoding, the electronic device 100 can also generate path information of the current material and send it to the image library for the image library interface to display the processing results. The electronic device 100 can display the wallpaper generated by this processing in the image library.

[0223] S504. Electronic device 100 performs supplementary frame processing on wallpaper materials through the wallpaper processing module.

[0224] In some examples, the electronic device 100 can also perform frame supplementation on the wallpaper material. This step is mainly for processing when the user wants a multi-frame wallpaper effect. The original wallpaper material selected by the user can be a single-frame resource or a multi-frame resource. The electronic device 100 can supplement the original wallpaper material by adding M frames, making the effect of the multi-frame resource more vivid and smooth, reducing abrupt changes, or giving the single-frame resource dynamic effects.

[0225] If the user selects a single-frame wallpaper, the electronic device 100 can use an artificial intelligence module to identify the main subject in the single-frame resource and predict its movement path, generating multiple frames based on that path. In the generated multiple frames, the position of the main subject differs from that in the original single-frame resource. Then, the electronic device 100 can stitch the original single frame and the generated multiple frames together to create a new multi-frame resource, thus generating a multi-frame resource from a single-frame resource through frame interpolation.

[0226] When a user selects a multi-frame resource, the electronic device 100 typically performs frame interpolation if the resource has too few frames. This can be due to several reasons: the multi-frame resource itself has insufficient frames, the difference between consecutive frames is too large, resulting in poor dynamic effects; or the multi-frame resource is not stable enough, and after frame stabilization processing, many unstable frames are removed. In this way, the electronic device 100 can perform frame interpolation to make the multi-frame resource smoother.

[0227] It should be understood that the order of steps S501-S504 described above is only an example. The specific steps of the electronic device 100 in the embodiments of this application are not limited. In specific embodiments, one or more processing steps can be selected to process the image according to the actual situation. For example, the image can be processed according to the optimization method selected in Figure 4B.

[0228] Through the wallpaper processing module, the electronic device 100 can personalize the wallpaper material selected by the user, enhance the expressive effect of the wallpaper, and improve the user experience.

[0229] S505. Electronic Device 100 adds dynamic effects to wallpaper materials.

[0230] If the wallpaper material selected by the user is a multi-frame material, such as an animated image or video, the electronic device 100 can add dynamic effects to the wallpaper material after completing the frame stabilization process. The dynamic effects added by the electronic device 100 can be determined by the user's selection in the interface shown in Figure 4C. Examples include "Main Moment," "Loop Playback," "Motion Path," and "Micro-Motion Moment." The following figures 13A-13E provide exemplary descriptions of these dynamic effects.

[0231] First, let's introduce the display effect of "Protagonist Moment". This "Protagonist Moment" effect is used to indicate that the background area of ​​the image in multiple frames of material is blurred or blurred, thereby highlighting the target image. That is, the target area processed by the "Protagonist Moment" effect is the background area. Optionally, the electronic device 100 can also complete the "Protagonist Moment" processing when performing step S501 in the above content.

[0232] When the electronic device 100 detects that the user has selected the "Protagonist Moment" effect based on the dynamic image to be processed, it can identify the target object and background area included in each image frame of the dynamic image. The electronic device can process the background area in each image frame, such as blurring or fuzzing the background area, or superimposing the background areas of all previous image frames as the background area of ​​the current frame. This makes the target object display area clearer relative to the background area, thus highlighting the target object.

[0233] Taking animated image 307 as an example, Figure 13A exemplarily illustrates four image frames in animated image 307. Using the four image frames of animated image 307 as an example, the electronic device can identify the target objects and background areas included in each image frame. For example, it can identify that the image includes target object 1301 "person" and target object 1302 "dog". The electronic device can select target object 1301 "person" as the "protagonist" of the dynamic effect of "protagonist moment", and use the area outside target object 1301 "person" as the background area. As shown in Figure 13B, the electronic device 100 can blur the background area, thereby making the target object 1301 more prominent.

[0234] In some embodiments, the background regions of all image frames preceding the current frame are superimposed. Specifically, this can be achieved by summing the corresponding pixels in all image frames preceding the current frame and taking the average. In other words, the pixel value of each pixel in the background region of the target dynamic image is the average of the corresponding pixels in all previous image frames.

[0235] In some embodiments, when an image frame includes multiple objects, the objects to be highlighted in the "protagonist moment" display effect can be selected by the electronic device. For example, the electronic device can identify the object located in the middle area of ​​the image as the object to be highlighted, and then identify the other areas besides the object as the background area, and then adjust the sharpness of the background area. The sharpness of the background area in the target moving image is lower than the sharpness of the moving image to be processed, and since the sharpness of the object area is not changed, the sharpness of the background area will be lower than the sharpness of the object area.

[0236] Alternatively, the target object to be highlighted in the "protagonist moment" display effect can be selected by the user. The electronic device 100 can first display information about multiple target objects (such as the target object's label box, target object type, or target object number, etc.), and the user can select the target object to be highlighted by selecting the target object's label box.

[0237] The following describes the display effect of "Loop Playback". This "Loop Playback" effect is used to indicate that multiple relatively stable image frames will be selected from the dynamic image to be processed, and then the selected image frames will be looped. That is, the entire area of ​​the selected image frames will be looped.

[0238] When electronic device 100 detects that the user has selected a "looping" display effect based on the dynamic image to be processed, electronic device 100 can identify the dynamic image to be processed and determine several relatively stable frames captured within it, for example, selecting 60 image frames. Then, electronic device 100 loops through the selected image frames. Alternatively, electronic device 100 can globally align multiple frames of the dynamic image to be processed, obtaining multiple image frames where the background area and / or target object are in similar positions, and then loops through the processed image frames.

[0239] For example, if the animated image to be processed has a first number of image frames, the electronic device 100 can select a third number of image frames based on the motion sensor information of each image frame in the first number of image frames. A video segment can be obtained according to the shooting time of the third number of image frames. Then, the video segments corresponding to the third number of image frames are looped, for example, a preset number of loops, to obtain a video (i.e., a second video) with a second number of image frames. The second video has at least two identical video segments. Here, the third number is a positive number, the first number and the second number are both positive numbers greater than 2, and the third number is less than the first number, and the second number is greater than the first number.

[0240] For example, electronic device 100 can loop multiple processed image frames a preset number of times to create a video of the target animated image. Taking a 60-frame animated image processed by electronic device 100 as an example, and a 600-frame animated image for the generated "looping" display effect as an example, it means that electronic device 100 needs to repeat the processed animated image 10 times to obtain the video of the target animated image. Alternatively, electronic device 100 can also limit the total duration of the video of the target animated image generated by the "looping" effect, looping the selected image frames until the total video duration is a preset duration.

[0241] For example, as shown in FIG13C, the electronic device 100 can repeat the four image frames of the dynamic picture 307 multiple times in chronological order to obtain a video of the target dynamic picture with a "looping" effect. For example, the electronic device 100 can loop the selected image frames a preset number of times, and thus, the target dynamic picture generated by the electronic device 100 includes the target object that moves repeatedly.

[0242] Optionally, in some embodiments, during the repeated playback of the processed multiple image frames by the electronic device 100, the playback order of the multiple image frames can be changed for each round of playback. Taking an example where the electronic device 100 selects 60 image frames, and the generated "looping" display effect has 600 frames, the first 60 frames of the target dynamic image are multiple image frames in the original timeline order, frames 61 to 120 are multiple image frames in reverse order, frames 121 to 180 are multiple image frames in the original timeline order again, and so on. Therefore, the final generated target dynamic image can present the effect of the target object repeatedly moving back and forth.

[0243] For example, for the four image frames of the animated image 307, the electronic device 100 can also generate a video of the target animated image based on the first frame, second frame, third frame, fourth frame, fourth frame, third frame, second frame, first frame, first frame, second frame, third frame, fourth frame, ... and so on of the animated image 307.

[0244] The following describes the display effect of "Motion Path". This "Motion Path" effect is used to indicate that the target object image in the dynamic image to be processed is superimposed frame by frame, that is, the target area processed by the "Motion Path" effect is the target object display area.

[0245] When electronic device 100 detects that a user has selected a "motion path" effect based on a dynamic image to be processed, it can identify the target object and background area included in each image frame of the dynamic image. Based on the position and image of the target object in each image frame, electronic device 100 can generate a target dynamic image. A single image frame in the target dynamic image may include the image of the target object in the current frame, and may also include images of the target object from several previous frames. Furthermore, as the target dynamic image plays, the images of the target object can be gradually superimposed, thus displaying the motion path of the target object.

[0246] For example, as shown in Figure 13D, taking the target object 1301 "person" as an example, under the display effect of "motion path", the second frame of the target dynamic image also includes the image of the target object 1301 from the first frame, compared to the original second frame image. The third frame of the target dynamic image also includes the images of the target object 1301 from the first frame and the second frame, compared to the original third frame image, and so on. Furthermore, the last frame can include the images of the target object 1301 "person" from all the previous frames, and the motion path of the target object 1301 "person" can be seen intuitively through the last frame.

[0247] Optionally, a single frame in the target dynamic image may include images of the target object from all frames preceding the current frame, or it may only include images of the target object from a predetermined number of frames preceding the current frame. For example, the current frame may only include images of the target object from the previous three frames.

[0248] Optionally, the target object to be displayed in the "motion path" display effect can be determined by the electronic device 100 or selected by the user. The method of determining the target object can also refer to the relevant description of the "protagonist moment" display effect mentioned above, which will not be repeated here.

[0249] Optionally, in some embodiments, the electronic device 100 may also process the background area. For example, the electronic device 100 may adjust the clarity of the background area or blur the image of the target object in previous frames. For example, as shown in FIG13D, the electronic device 100 may blur the image of the target object "person" in previous frames. For example, in the fourth frame, it includes the image of the target object 1301 "person" in the fourth frame, as well as the blurred images of the target object 1301 "person" in the first to third frames. Furthermore, the electronic device 100 also blurs the images of the background area in each image frame.

[0250] The following describes the display effect of "Micro Motion Moment". This "Micro Motion Moment" effect is used to indicate that the background area in the dynamic image to be processed will be replaced with the same static image, that is, the target area processed by the "Motion Path" effect is the background area.

[0251] When the electronic device 100 detects that the user has selected the "micro-motion moment" display effect based on the dynamic image to be processed, the electronic device 100 can identify the target object and background area included in each image frame of the dynamic image to be processed. Then, it replaces the background area of ​​each image frame in the video included in the dynamic image to be processed with the same image, so that the background area has a static effect when the target dynamic image is played, thereby highlighting the movement of the target object.

[0252] For example, as shown in Figure 13E, taking target object 1301 "person" as an example, the background area includes target object 1302 "dog," and in the first to fourth frames shown at the top of Figure 13E, both target object 1301 and target object 1302 are in motion. Electronic device 100 can select one frame as the background area of ​​the target dynamic image. For example, electronic device 100 uses the background area of ​​the first image frame as the background area of ​​the target dynamic image. Furthermore, electronic device 100 can replace target object 1301 in the first image frame with target object 1301 in the current frame to generate a new image frame. For example, the newly generated first image frame is composed of the background area of ​​the first image frame and target object 1301 of the first image frame; the newly generated second image frame is composed of the background area of ​​the first image frame and target object 1301 of the second image frame, and so on. Therefore, in the resulting target dynamic image, only target object 1301 is moving, while target object 1302 is stationary, which can highlight the movement of the "person" in the target dynamic image.

[0253] In some embodiments, the target object may be a target object with a larger motion amplitude (e.g., a target object with a motion amplitude greater than a preset amplitude value) determined by the electronic device 100 based on the motion amplitude of each target object.

[0254] In other embodiments, the target object can be selected by the user. Alternatively, the electronic device 100 can also invoke the semantic segmentation algorithm described above to identify the type of target object included in each image frame, such as people, animals, plants, etc. The user can also select according to the type of target object, and the electronic device 100 will use the specified type of target object as the target object that maintains motion under the "micro-motion moment" display effect based on the type selected by the user.

[0255] Alternatively, the electronic device 100 can divide each image frame in the dynamic image to be processed into multiple regions, such as dividing the image frame into 9 regions using a 9-grid layout. The user can also select regions based on the image frame. Based on the region selected by the user, the electronic device 100 replaces all images except the specified region with a uniform background region image.

[0256] For example, the electronic device 100 selects the first image frame as the cover image, or selects the clearest frame as the cover image. Alternatively, the cover image can also be selected by the user. It should be understood that this application does not impose specific limitations on the method of determining the cover image and preview image of the wallpaper material after adding dynamic effects.

[0257] In other embodiments, the electronic device 100 can combine at least two display effects from "looping playback," "protagonist moment," "motion path," and "micro-motion instant" to obtain the target dynamic image. For example, the electronic device 100 can obtain the target dynamic image based on "micro-motion instant" and "looping playback." For instance, for the "micro-motion instant" dynamic image obtained in Figure 13E, the electronic device 100 can also loop playback to obtain a dynamic image showing continuous movement of the area corresponding to the target object 1301 "person." Alternatively, the electronic device 100 can also obtain the target dynamic image based on "protagonist moment" and "motion path," as specifically described in the relevant description of Figure 13D above. That is, the background area in the target dynamic image is blurred, and the target dynamic image can also display the movement path of the target object.

[0258] Optionally, the electronic device 100 can also select a specific image frame from the multiple processed image frames as the cover image. The cover image can be used to display as shown in Figure 3G or Figure 3H to identify the currently being processed or the currently set wallpaper.

[0259] Based on this, the wallpaper setting method provided in this application embodiment can provide users with a rich and scalable wallpaper function.

[0260] The wallpaper processing by the electronic device 100 through the wallpaper processing module is an important step in the wallpaper setting method provided in this application embodiment. The electronic device 100 can process wallpaper materials based on the wallpaper processing module, making the processed wallpaper more stable, with richer dynamic effects, better performance, a more focused main subject, smoother multi-frame resources, and also enabling personalized wallpaper layouts to meet users' individual needs.

[0261] Finally, the hardware structure of the exemplary electronic device 100 provided in the embodiments of this application is described. Figure 14 illustrates a schematic diagram of the hardware structure of the electronic device 100 provided in the embodiments of this application.

[0262] It should be understood that the electronic device 100 may have more or fewer components than shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.

[0263] Electronic device 100 may include: processor 110, external memory interface 120, internal memory 121, universal serial bus (USB) interface 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0264] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0265] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.

[0266] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0267] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0268] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the electronic device 100.

[0269] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.

[0270] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0271] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.

[0272] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the electronic device 100 to capture images. The processor 110 and the display screen 194 communicate via the DSI interface to enable the electronic device 100 to display images.

[0273] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0274] The SIM interface can be used to communicate with the SIM card interface 195 to transmit data to or read data from the SIM card.

[0275] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.

[0276] It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0277] The charging management module 140 is used to receive charging input from the charger. The charger can be a wireless charger or a wired charger.

[0278] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, internal memory 121, external memory, display 194, camera 193, and wireless communication module 160, etc.

[0279] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0280] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0281] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0282] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0283] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0284] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0285] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0286] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.

[0287] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0288] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and color. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0289] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0290] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.

[0291] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0292] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0293] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0294] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, applications required for at least one function (such as facial recognition, fingerprint recognition, mobile payment, etc.). The data storage area may store data created during the use of electronic device 100 (such as facial information template data, fingerprint information templates, etc.). Furthermore, internal memory 121 may include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0295] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0296] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0297] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or make hands-free calls through the speaker 170A.

[0298] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.

[0299] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. Electronic device 100 may have at least one microphone 170C. In some embodiments, electronic device 100 may have two microphones 170C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, electronic device 100 may also have three, four, or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, etc.

[0300] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.

[0301] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the intensity of the touch operation based on pressure sensor 180A. Electronic device 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example, when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.

[0302] The gyroscope sensor 180B can be used to determine the motion attitude of the electronic device 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device 100 about three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the shake of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the electronic device 100 by moving in the opposite direction, thus achieving image stabilization. The gyroscope sensor 180B can also be used in navigation and motion-sensing game scenarios.

[0303] The barometric pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates altitude using the air pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.

[0304] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip cover. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover using the magnetic sensor 180D. Then, based on the detected opening and closing state of the cover or the flip cover, features such as automatic flip unlocking can be set.

[0305] The 180E accelerometer can detect the magnitude of acceleration of electronic device 100 in various directions (typically three axes). When electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic devices and applied to applications such as screen orientation switching and pedometers.

[0306] A distance sensor 180F is used to measure distance. Electronic device 100 can measure distance via infrared or laser. In some embodiments, during a shooting scene, electronic device 100 can utilize the distance sensor 180F to measure distance for rapid focusing.

[0307] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The electronic device 100 emits infrared light outward through the LED. The electronic device 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 may use the proximity sensor 180G to detect when a user holds the electronic device 100 close to their ear for a call, so as to automatically turn off the screen to save power. The proximity sensor 180G can also be used in holster mode and pocket mode for automatic unlocking and locking of the screen.

[0308] The ambient light sensor 180L is used to sense the brightness of ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 based on the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also work with the proximity sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

[0309] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can utilize the characteristics of the collected fingerprints to achieve fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering calls with fingerprints, etc.

[0310] Temperature sensor 180J is used to detect temperature. In some embodiments, electronic device 100 uses the temperature detected by temperature sensor 180J to execute a temperature handling strategy. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, electronic device 100 performs thermal protection by reducing the performance of a processor located near temperature sensor 180J to reduce power consumption. In other embodiments, when the temperature is below another threshold, electronic device 100 heats battery 142 to prevent abnormal shutdown of electronic device 100 due to low temperature. In still other embodiments, when the temperature is below yet another threshold, electronic device 100 boosts the output voltage of battery 142 to prevent abnormal shutdown due to low temperature.

[0311] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of electronic device 100, in a different position than display screen 194.

[0312] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of electronic device 100.

[0313] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to touch operations performed on different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations performed on different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

[0314] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.

[0315] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and detach from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, and other SIM cards. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communication.

[0316] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0317] As used in the above embodiments, depending on the context, the term "when..." can be interpreted as meaning "if...", "after...", "in response to determining...", or "in response to detecting...". Similarly, depending on the context, the phrase "when determining..." or "if (the stated condition or event) is interpreted as meaning "if determining...", "in response to determining...", "when (the stated condition or event) is detected", or "in response to detecting (the stated condition or event)".

[0318] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state drive), etc.

[0319] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

Claims

1. A method for setting wallpaper, characterized in that, The method includes: The first interface is displayed, and the first interface displays one or more image resources; The first operation of setting the first image resource as the wallpaper of the electronic device is detected; In response to the first operation, image processing is performed on the first image resource; the first image resource includes a video or animated image, and the first image resource includes a subject; the difference between the processed first image resource and the first image resource includes one or more of the following: the display method of the subject and the number of image frames; The processed first image resource is set as the wallpaper of the electronic device.

2. The method according to claim 1, characterized in that, The first image resource includes a first image frame and a second image frame. The difference between the processed first image resource and the first image resource includes the display method of the subject, including: the position jump of the subject in the first image frame and the second image frame in the processed first image resource is less than the position jump of the subject in the first image frame and the second image frame in the first image resource.

3. The method according to claims 1 and 2, characterized in that, The first image resource includes at least one image frame, the at least one image frame includes unstable frames, and the difference between the processed first image resource and the first image resource includes the number of image frames: the number of unstable frames in the processed first image resource is less than the number of unstable frames in the first image resource.

4. The method according to claims 1-3, characterized in that, Image processing is performed on the first image resource, specifically including: Remove unstable frames from the first image resource.

5. The method according to claim 3 or 4, characterized in that, The unstable frames include: blurred frames, frames with sudden image changes, frames with repeated images, black screen frames, green screen frames, and frames with distorted images.

6. The method according to any one of claims 2-5, characterized in that, At the frame time of the unstable frame, the jitter amplitude of the electronic device is greater than a first threshold, and the jitter amplitude is collected by the gravity sensor of the electronic device.

7. The method according to claims 1-6, characterized in that, Image processing is performed on the first image resource, specifically including: Obtain image frames from the first image resource whose jitter amplitude is less than the second threshold; The first image resource is obtained from image frames whose jitter amplitude is less than the second threshold; wherein the first threshold is greater than the second threshold.

8. The method according to any one of claims 1-7, characterized in that, The first image resource includes a first image frame and a second image frame. The processed first image resource includes an image frame after cropping the first image frame and an image frame after cropping the second image frame. The processed first image frame and the processed second image frame contain the same subject. The relative positional distance of the same subject in the processed first image frame and the processed second image frame is less than or equal to the relative positional distance of the same subject in the first image frame and the second image frame.

9. The method according to claim 8, characterized in that, Image processing is performed on the first image resource, specifically including: Image frames with jitter amplitude less than a second threshold are obtained from the first image resource; wherein, the image frames with jitter amplitude less than the second threshold include the first image frame and the second image frame; Based on the same subject, the first image frame and the second image frame are cropped.

10. The method according to claims 8 and 9, characterized in that, The cropping ratio is related to the screen size of the electronic device and / or the display status of the electronic screen.

11. The method according to any one of claims 1-10, characterized in that, The difference between the processed first image resource and the first image resource includes the number of image frames: the number of image frames in the processed first image resource is greater than the number of image frames in the first image resource; wherein, the extra image frames in the processed first image resource relative to the first image resource are obtained by the electronic device by interpolating frames in the first image resource.

12. The method according to any one of claims 1-11, characterized in that, The first image resource includes a first image frame, and the image processing of the first image resource further includes: The first image frame of the first image resource is subjected to one or more of the following processing methods: background blurring, enhanced brightness and darkness contrast, color contrast and warm and cool contrast, and image sharpening.

13. The method according to any one of claims 1-12, characterized in that, The number of non-subject elements in the processed first image resource is less than the number of non-subject elements in the first image resource.

14. The method according to any one of claims 1-13, characterized in that, The first operation includes the user's selection of wallpaper processing methods, which include: intelligent composition, imperfection removal, frame stabilization, frame supplementation, and adding dynamic effects.

15. The method according to any one of claims 1-14, characterized in that, Before setting the processed first image resource as the wallpaper of the electronic device, the method further includes: Display a preview of the processed first image resource.

16. An electronic device, characterized in that, include: A processor and a memory, the memory being coupled to the processor, the memory being used to store computer program code, the computer program code including computer instructions, which, when the processor reads the computer instructions from the memory, cause the electronic device to perform the method as described in any one of claims 1-15.

17. A chip system applied to an electronic device, the chip system comprising one or more processors, characterized in that, The processor is used to invoke computer instructions to perform the method as described in any one of claims 1-15.

18. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a computer program that, when run on an electronic device, causes the electronic device to perform the method as described in any one of claims 1-15.

19. A computer program product, characterized in that, When the computer program product is run on a computer, it causes the electronic device to perform the method as described in any one of claims 1-15.

Images