Wallpaper processing method, electronic device and storage medium
By providing wallpaper selection and editing interfaces in electronic devices, users can combine multiple pictures to generate dynamic wallpaper videos, solving the problem of single display of lock screen wallpaper and improving the user experience.
Patent Information
- Application Number
- PCT/CN2024/076928
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-02-08
- Publication Date
- 2025-08-14
AI Technical Summary
In the prior art, lock screen wallpaper display form is single, lacks flexibility, and affects the user experience.
Provides a wallpaper processing method, which allows users to select multiple wallpaper pictures by displaying the wallpaper selection interface, and combines at least two pictures in the editing interface to generate dynamic wallpaper videos, and plays them on the lock screen interface to enrich the display form.
Users can generate dynamic wallpaper videos that meet their needs based on their personal preferences, which improves the authenticity and interactivity of lock screen wallpapers and enhances the user experience.
Smart Images

Figure CN2024076928_14082025_PF_FP_ABST
Abstract
Description
Wallpaper processing method, electronic device and storage medium Technical Field
[0001] The present application relates to the field of terminal technology, and in particular to a wallpaper processing method, electronic device, and storage medium. Background Art
[0002] Currently, users can set the lock screen wallpaper of electronic devices according to their preferences, such as selecting wallpapers provided by wallpaper services or setting pictures in the gallery as wallpapers. However, the wallpaper display format in the prior art is single and lacks flexibility, which affects the user experience.
[0003] Summary of the Invention
[0004] The present application provides a wallpaper processing method, an electronic device, and a storage medium to enrich the display form of lock screen wallpapers and enhance user experience.
[0005] In a first aspect, an embodiment of the present application provides a wallpaper processing method, applied to an electronic device, the method comprising: receiving a first operation from a user; in response to the first operation, displaying a wallpaper selection interface, the wallpaper selection interface including multiple wallpaper images; receiving a second operation from the user on a first wallpaper image among the multiple wallpaper images; in response to the second operation, displaying an editing interface corresponding to the first wallpaper image, the editing interface including multiple images corresponding to the first wallpaper image; receiving a third operation from the user on at least two images among the multiple images; in response to the third operation, displaying at least two images in an editing area of the editing interface; receiving a fourth operation from the user; in response to the fourth operation, obtaining image content of the at least two images currently displayed in the editing area and exiting the editing interface; and, if a preset condition is met, playing a target video on a lock screen interface, wherein the target video includes image content corresponding to the at least two images. After the electronic device exits the editing interface in response to the fourth operation, it returns to the desktop of the electronic device. The wallpaper image may specifically be a thumbnail of a dynamic wallpaper.
[0006] The multiple images included in the editing interface are wallpaper resources pre-stored for the first wallpaper image, specifically including multiple types of wallpaper resources, each wallpaper resource including multiple images. The user can select at least two images from the multiple images according to their own preferences, and combine the at least two images into a wallpaper through a third operation. For example, if the first wallpaper image is a thumbnail of a flower arrangement wallpaper, the user can select their favorite leaf images and flower images, and combine these leaf images and flower images to simulate the flower arrangement experience, and then synthesize a flower arrangement wallpaper. When the lock screen interface is subsequently displayed, the video of the flower arrangement wallpaper can be played on the lock screen interface.
[0007] This method displays a wallpaper selection interface, allowing users to select a first wallpaper image according to their preferences, select at least two images in the editing interface corresponding to the first wallpaper image, and perform a third operation according to their needs. Upon receiving the fourth operation, the electronic device obtains the image content of the at least two images currently displayed in the editing area, and can subsequently play the target video corresponding to the image content on the lock screen interface. Because the image content is generated by user operation, the target video corresponding to the image content is a dynamic wallpaper that meets the user's preferences, allowing users to experience the experience of synthesizing their favorite wallpapers. For example, by editing a flower arrangement wallpaper, users can experience the flower arrangement experience and express their inner world. Furthermore, the wallpaper synthesized by the user's operation is more realistic in the form of a video on the lock screen interface, which can enhance the user experience.
[0008] In one possible implementation, when at least two pictures include a first picture, and a preset condition is met, a target video is played on the lock screen interface, including: playing the first target video on the lock screen interface when the preset condition is met; when at least two pictures include a second picture, and a preset condition is met, the target video is played on the lock screen interface, including: playing the second target video on the lock screen interface when the preset condition is met, wherein the first picture is different from the second picture, and the first target video is different from the second target video.
[0009] It is understood that different images selected by the user in the editing interface will result in different target videos displayed on the lock screen. For example, if the user selects images of leaf 1 and flower 1, the target video will be a video including leaf 1 and flower 1; if the user selects images of leaf 2 and flower 2, the target video will be a video including leaf 2 and flower 2.
[0010] Additionally, if the user selects the same image and then performs different editing operations on it, the target video displayed on the lock screen will also be different. For example, if the user selects two images, one of Leaf 1 and the other of Flower 1, and the user places Leaf 1 to the left of Flower 1, the target video will be a video of Leaf 1 to the left of Flower 1; if the user places Leaf 1 to the right of Flower 1, the target video will be a video of Leaf 1 to the right of Flower 1.
[0011] By adopting this method, users can select pictures according to their preferences, and the electronic device will play a target video that matches the picture selected by the user on the lock screen interface, which can improve the user experience.
[0012] In a possible implementation, the editing interface includes at least two wallpaper resource selection areas, each wallpaper resource selection area includes multiple pictures of the same type; the third operation includes a selection operation and an editing operation;
[0013] In response to a third operation, at least two images are displayed in the editing area of the editing interface, including: in response to a selection operation of at least two images in the wallpaper resource selection area, the user-selected images are displayed in the editing area, the user-selected images including the third image; and in response to an edit operation on the third image, the user-edited third image is displayed in the editing area. For example, the selection operation may be a click operation by the user.
[0014] For example, if the first wallpaper image selected by the user is a thumbnail of a plant-based flower arrangement wallpaper, the wallpaper resource selection area in the editing interface may include a leaf selection area, a flower selection area, and a bird and insect selection area. The user can select their favorite leaves from the leaf selection area and their favorite flowers from the flower selection area, and then combine the leaves and flowers into a single plant by adjusting their positions. Furthermore, they can also select an insect image from the bird and insect selection area and adjust it on the leaves of the plant to make the dynamic wallpaper more vivid.
[0015] The user's selection operation for the image can be a click operation or a drag operation. For example, the user can select a favorite leaf from the leaf selection area and then drag the leaf to the wallpaper editing area by dragging it.
[0016] By adopting this method, the editing area provides a user editing function, and the user can select pictures according to his or her own preferences and edit the selected pictures, so that the target video finally played on the lock screen interface better meets the user's needs.
[0017] In one possible implementation, in response to an editing operation on the third picture, the third picture edited by the user is displayed in the editing area, including: in response to the user's editing operation of dragging the third picture, adjusting the position of the third picture in the editing area according to the user's dragging trajectory; in response to the user's editing operation of scaling the third picture, adjusting the size of the third picture displayed in the editing area.
[0018] By adopting this method, users can flexibly adjust the position and size of the selected pictures, and can more conveniently adjust and combine the selected pictures according to their own preferences.
[0019] In a possible implementation, the editing area displays a rotation control and / or an add control for the third picture;
[0020] In response to an edit operation on the third image, the edited third image is displayed in the editing area, including: in response to the user operating the rotation control, rotating the third image according to a preset rotation direction and a preset rotation angle; and in response to the user operating the add control, adding a third image to the editing area. The preset rotation direction and the preset rotation angle are both pre-set. For example, the preset rotation direction can be left rotation or right rotation, and the preset rotation angle can be 15 degrees, 30 degrees, or 90 degrees, or other angles, which are not limited in this embodiment of the present application.
[0021] By adopting this method, users can flexibly adjust the angle of the selected picture, which can meet the user's various adjustment needs for the picture, thereby generating a dynamic wallpaper that meets the user's preferences and improving the user experience.
[0022] In a possible implementation, the editing area further displays a close control for the third picture;
[0023] After displaying at least two images in the editing area of the editing interface in response to the third operation, the method further includes: upon receiving a user operation of closing a control, deleting the third image from the editing area in response to the user operation of closing the control. In this way, the user can conveniently delete unnecessary images, further enhancing the user's editing flexibility.
[0024] In one possible implementation, playing a target video on the lock screen interface when a preset condition is met includes: playing the target video on the lock screen interface when a user touches the lock screen interface. As an example, the touch operation can be a single click or a double click. When the user touches the lock screen interface, the electronic device plays the target video on the lock screen interface, thereby increasing interactivity with the user.
[0025] In a possible implementation, when a preset condition is met, playing the target video on the lock screen interface includes: when the electronic device receives a notification message, playing the target video on the lock screen interface.
[0026] Among them, the notification message is any notification message that can trigger the lock screen interface to light up, such as a text message, an application notification message, etc. In this way, in various situations where the lock screen interface needs to be displayed, the target video can be played on the lock screen interface, bringing aesthetic enjoyment to the user.
[0027] In one possible implementation, playing a target video on the lock screen when a preset condition is met includes playing a target video corresponding to current scene information on the lock screen when the preset condition is met, where the current scene information includes the lock screen state and user operation information. By playing different target videos in different scenes, the lock screen wallpaper can be made more vivid and avoid being too monotonous.
[0028] In one possible implementation, playing a target video corresponding to the current scene information on the lock screen interface includes:
[0029] If the current scene information is the first preset scene information, the third target video corresponding to the first preset scene information is played on the lock screen interface, wherein the lock screen interface state included in the first preset scene information is the state of switching from off screen to bright screen, and the user operation information included in the first preset scene information is the operation of the user triggering the lock screen interface to light up the screen; optionally, when the electronic device receives a notification message, the lock screen section switches from off screen to bright screen state. In this case, the target video played on the lock screen interface is also the third target video.
[0030] If the current scene information is the second preset scene information, the fourth target video corresponding to the second preset scene information is played on the lock screen interface, wherein the lock screen interface state included in the second preset scene information is the screen-on state, and the user operation information included in the second preset scene information is the fifth operation of the user on the lock screen interface;
[0031] If the current scene information is the third preset scene information, the fifth target video corresponding to the third preset scene information is played on the lock screen interface, wherein the lock screen interface state included in the third preset scene information is the bright screen state, and the user operation information included in the third preset scene information is the user's sixth operation on the lock screen interface, and one of the fifth operation and the sixth operation is a click operation, and the other is a double-click operation.
[0032] Among them, the operation of the user triggering the lock screen interface to light up can be a click operation on the lock screen interface, or a physical button operation of pressing the electronic device, or any operation triggered by the user to light up the lock screen interface, such as voice wake-up.
[0033] By adopting this method, different target videos are played for the user when the screen is on and when the user clicks or double-clicks the screen while the screen is on, thereby increasing interaction with the user and further improving the user experience.
[0034] In one possible implementation, the wallpapers corresponding to the multiple wallpaper pictures are all dynamic wallpapers (plant cultivation wallpapers) in which the growth status of the plant changes over time, and the image content of at least two pictures is the target plant composed of at least two pictures; the current scene information also includes growth stage information; the growth stage information included in the first preset scene information is the current growth stage of the target plant, and the third target video is the growth video of the target plant in the current growth stage; the growth stage information included in the second preset scene information is the current growth stage of the target plant, and the fourth target video is a video of the target plant swaying left and right in the current growth stage; the growth stage information included in the third preset scene information is the current growth stage of the target plant, and the fifth target video is a video of the target plant being watered in the current growth stage.
[0035] For example, in the germination stage, if the user clicks the screen when the screen is locked or on, a video of the germinating target plant shaking left and right will be played; in the blooming stage, if the user clicks the screen when the screen is locked or on, a video of the blooming target plant shaking left and right will be played.
[0036] This method can simulate the user's experience of growing plants in the real world, and can bring the user a real-world experience and sense of happiness.
[0037] In a possible implementation, the growth stage information includes a preset number of growth stages of the target plant, and each growth stage corresponds to a time interval.
[0038] For example, the generation stages of the target plant may include the germination stage, the stage when the plant leaves have grown, the stage when the plant grows flower buds, and the stage when the flowers are in full bloom, etc. As time goes by, the user can be shown the dynamic effects of the plant from germination to full bloom, which can give the user the experience of growing flowers in the real world.
[0039] In a possible implementation, the image content includes user editing data of at least two pictures;
[0040] After obtaining the image content of at least two images currently displayed in the editing area in response to the fourth operation, the method further includes: generating multiple videos corresponding to the image content based on the editing data, each video corresponding to a preset scene information; and playing a target video corresponding to the current scene information on the lock screen interface when a preset condition is met, including: searching for a target video corresponding to the current scene information from the multiple videos when the preset condition is met, and playing the target video on the lock screen interface. As can be seen, after the user completes editing, the electronic device can pre-generate videos corresponding to each preset scene information based on the user's editing data. Then, when the preset condition is met, the target video corresponding to the current scene information can be quickly obtained and played, which can improve response speed and enhance user experience.
[0041] In one possible implementation, the electronic device includes a settings module, a dynamic wallpaper service, a theme package configuration service, and a multimedia codec module;
[0042] In response to the fourth operation, the image content of at least two pictures currently displayed in the editing area is obtained, including: the setting module records editing data based on the at least two pictures in the editing area in response to the user's fourth operation on the preset control in the editing interface; generating multiple videos corresponding to the image content based on the editing data, including: the setting module sends the editing data to the dynamic wallpaper service, the editing data including identification information of at least two pictures; the dynamic wallpaper service reads the target resource package corresponding to the editing data from the theme package configuration service, the target resource package including multiple video compression packages matching the editing data, each video compression package corresponding to a preset scene information; the dynamic wallpaper service sends multiple video compression packages to the multimedia codec module; the multimedia codec module performs video encoding and decoding on each video compression package respectively to generate multiple videos corresponding to the image content. It can be understood that each video corresponds to a preset scene information.
[0043] Among them, the preset control can be the "Apply" button in the wallpaper editing interface. After the user clicks the button, it means that the user has set the lock screen wallpaper to the wallpaper edited in the editing interface. Since the target resource package corresponding to the editing data is pre-stored, the user can quickly generate videos under various preset scene information for the user after clicking the "Apply" button, which improves the speed of successful switching of the lock screen wallpaper. And although the wallpaper edited by the user in the editing interface is in the form of a picture, the dynamic wallpaper service actually calls the multimedia codec module to generate videos under various preset scenes corresponding to the wallpaper, so that videos under various preset scenes can be played on the lock screen interface later, thereby displaying dynamic wallpapers to the user, solving the problem of single display of lock screen wallpapers, and improving the user experience.
[0044] Furthermore, the setting module only needs to send the edited data to the dynamic wallpaper service without sending at least two pictures edited by the user, which can reduce transmission overhead, have less impact on the load of the electronic device, and improve setting efficiency.
[0045] In one possible implementation, after the multimedia codec module performs video encoding and decoding on each video compression packet and generates multiple video segments corresponding to the image content, the method further includes: the multimedia codec module splices the multiple video segments into an overall video and records the frame number intervals of the videos corresponding to each preset scene information in the overall video; the multimedia codec module sends the mapping relationship between the frame number intervals and the preset scene information to the dynamic wallpaper service. When the preset conditions are met, the target video corresponding to the current scene information is searched from the multiple video segments, and the target video is played on the lock screen interface, including: when the preset conditions are met, the dynamic wallpaper service searches for the target frame number interval corresponding to the current scene information based on the mapping relationship between the frame number intervals and the preset scene information; the dynamic wallpaper service sends the target frame number interval to the multimedia codec module; the multimedia codec module searches for the target video corresponding to the target frame number interval from the overall video, and plays the target video on the lock screen interface.
[0046] For example, frames 0-3 are videos of the lock screen lighting up, frames 4-6 are videos of clicking the lock screen interface when the screen is on, and frames 7-9 are videos of double-clicking the lock screen interface when the screen is on.
[0047] Using this method, the dynamic wallpaper service can quickly locate the target frame number interval corresponding to the current scene information. This allows the multimedia codec module to quickly locate and play the target video based on the target frame number interval. This simple and fast search method eliminates the need for video transmission between the dynamic wallpaper service and the multimedia codec module, improving the responsiveness of the dynamic wallpaper display. Furthermore, the target video played on the lock screen matches the current scene, enabling user interaction and a smoother interactive experience.
[0048] In one possible implementation, the identification information is the resource type and resource number of at least two pictures, and the editing data also includes the coordinates and rotation angles of at least two pictures; the dynamic wallpaper service reads the target resource package corresponding to the editing data from the theme package configuration service, including: the dynamic wallpaper service reads the target resource package that matches the resource type and resource number of at least two pictures from the theme package configuration service, and the target resource package also includes the coordinates and rotation angles of at least two pictures; the multimedia codec module performs video encoding and decoding on each video compression package respectively to generate multiple video segments corresponding to the image content, including: the multimedia codec module calculates the coordinate offset and rotation angle offset of each of the at least two pictures based on the coordinates and rotation angles of the at least two pictures in the editing data and the coordinates and rotation angles in the target resource package; performs video encoding and decoding on each video compression package based on the coordinate offset and rotation angle offset of each of the at least two pictures to generate multiple video segments corresponding to the image content.
[0049] It is understood that the theme package configuration service stores target resource packages corresponding to various combinations of resource types and resource numbers. The coordinates and rotation angles of the images included in these resource packages are fixed. The coordinates and rotation angles of the images included in the resource packages are the same as the coordinates and rotation angles of the same images in the video represented by the video compression package.
[0050] In this way, the theme package configuration service stores a target resource package for each combination of resource type and resource number, saving storage resources. Subsequent multimedia codecs can perform video encoding and decoding on the compressed video package based on the calculated coordinate offset and rotation angle offset, ensuring that the resulting video matches the coordinates and rotation angles of at least two images edited by the user. This allows the lock screen to display a dynamic wallpaper that matches the user-edited image content, improving the user experience.
[0051] In one possible implementation, the identification information is the resource type and resource number of at least two pictures, and the editing data also includes the coordinates and rotation angles of at least two pictures; the dynamic wallpaper service reads the target resource package corresponding to the editing data from the theme package configuration service, including: the dynamic wallpaper service reads the target resource package that matches the resource type, resource number, coordinates and rotation angle included in the editing data from the theme package configuration service.
[0052] When the user edits at least two pictures in the editing interface, the editing must be performed within the pre-set range of rotation angles and positional relationships supported by each picture. If the user's editing operation exceeds the range, the user can be reminded.
[0053] In this implementation, the theme package configuration service stores resource packages corresponding to various combinations of fine-grained resource types, resource numbers, coordinates, and rotation angles, so that the target resource package that completely matches the user's editing data can be accurately found, allowing the multimedia codec module to directly generate multiple videos corresponding to the image content based on the target resource package, and enabling the target video played on the lock screen interface to accurately match the user's editing data, thereby improving the display effect of the dynamic wallpaper.
[0054] In a second aspect, an embodiment of the present application provides a wallpaper processing method, which is applied to an electronic device, the method comprising: receiving a first operation from a user; in response to the first operation, displaying a wallpaper selection interface, the wallpaper selection interface including a plurality of wallpaper pictures; receiving a second operation from the user on a first wallpaper picture among the plurality of wallpaper pictures; in response to the second operation, displaying an editing interface corresponding to the first wallpaper picture, the editing interface including a plurality of pictures corresponding to the first wallpaper picture; receiving a third operation from the user on at least two pictures among the plurality of pictures; in response to the third operation, displaying at least two pictures in an editing area of the editing interface; receiving a fourth operation from the user; in response to the fourth operation, recording editing data based on the image content of at least two pictures in the editing area, generating a plurality of videos corresponding to the image content based on the editing data, and exiting the editing interface, wherein each video corresponds to a preset scene information, the preset scene information including at least a lock screen interface status and user operation information; when the preset conditions are met, searching for a target video corresponding to the current scene information from the multiple videos, and playing the target video on the lock screen interface.
[0055] This method displays a wallpaper selection interface, allowing users to select a first wallpaper image according to their preferences, select at least two images in the editing interface of the first wallpaper image, and perform a third operation according to their needs. When the electronic device receives the fourth operation, it obtains the image content of the at least two images currently displayed in the editing area and generates multiple videos corresponding to the image content. The target video corresponding to the current scene information can then be played on the lock screen interface. Because the image content is generated by user operation, the target video corresponding to the image content is a dynamic wallpaper that meets the user's preferences, allowing users to experience the experience of synthesizing their favorite wallpapers. For example, by editing a flower arrangement wallpaper, users can experience the flower arrangement experience and express their inner world. In addition, the wallpaper synthesized by the user operation is more realistic in the form of a video on the lock screen interface, which can enhance the user experience.
[0056] In one possible implementation, the electronic device includes a settings module, a dynamic wallpaper service, a theme package configuration service, and a multimedia codec module;
[0057] In response to the fourth operation, editing data is recorded based on the image content of at least two pictures in the editing area, and multiple videos corresponding to the image content are generated based on the editing data, including: the setting module records the editing data based on the image content composed of at least two pictures in the editing area in response to the user's fourth operation on the preset control in the editing interface; the setting module sends the editing data to the dynamic wallpaper service, and the editing data includes identification information of at least two pictures; the dynamic wallpaper service reads the target resource package corresponding to the editing data from the theme package configuration service, and the target resource package includes multiple video compression packages matching the editing data, and each video compression package corresponds to a preset scene information; the dynamic wallpaper service sends multiple video compression packages to the multimedia codec module; the multimedia codec module performs video encoding and decoding on each video compression package respectively to generate multiple videos corresponding to the image content.
[0058] Since the target resource package corresponding to the editing data is pre-stored, the user can quickly generate videos for the user under various preset scene information after clicking the "Apply" button, which improves the speed of successful switching of the lock screen wallpaper. Although the wallpaper edited by the user in the editing interface is in the form of a picture, the dynamic wallpaper service actually calls the multimedia codec module to generate videos under various preset scenes corresponding to the wallpaper, so that videos under various preset scenes can be played on the lock screen interface later, thereby displaying dynamic wallpapers to the user, solving the problem of single lock screen wallpaper display, and improving user experience. In addition, the setting module only needs to send the editing data to the dynamic wallpaper service, without sending at least two pictures edited by the user, which can reduce transmission overhead and improve setting efficiency.
[0059] In one possible implementation, after the multimedia codec module performs video encoding and decoding on each video compression packet to generate multiple video segments corresponding to the image content, the method further includes: the multimedia codec module splices the multiple video segments into an overall video and records the frame number intervals of the videos corresponding to each preset scene information in the overall video; the multimedia codec module sends the mapping relationship between the frame number intervals and the preset scene information to the dynamic wallpaper service. When the preset conditions are met, the target video corresponding to the current scene information is searched from the multiple video segments, and the target video is played on the lock screen interface, including: when the preset conditions are met, the dynamic wallpaper service searches for the target frame number interval corresponding to the current scene information based on the mapping relationship between the frame number intervals and the preset scene information; the dynamic wallpaper service sends the target frame number interval to the multimedia codec module; the multimedia codec module searches for the target video in the target frame number interval from the overall video, and plays the target video on the lock screen interface.
[0060] Using this method, the dynamic wallpaper service can quickly locate the target frame number interval corresponding to the current scene information. This allows the multimedia codec module to quickly locate and play the target video based on the target frame number interval. This simple and fast search method eliminates the need for video transmission between the dynamic wallpaper service and the multimedia codec module, improving the responsiveness of the dynamic wallpaper display. Furthermore, the target video played on the lock screen matches the current scene, enabling user interaction and a smoother interactive experience.
[0061] In a possible implementation, the identification information is the resource type and resource number of the at least two pictures, and the editing data further includes the coordinates and rotation angles of the at least two pictures;
[0062] The dynamic wallpaper service reads the target resource package corresponding to the editing data from the theme package configuration service, including: the dynamic wallpaper service reads the target resource package that matches the resource type and resource number of at least two pictures from the theme package configuration service, and the target resource package also includes the coordinates and rotation angles of at least two pictures; the multimedia codec module performs video encoding and decoding on each video compression package respectively to generate multiple video segments corresponding to the image content, including: the multimedia codec module calculates the coordinate offset and rotation angle offset of each of the at least two pictures based on the coordinates and rotation angles of the at least two pictures in the editing data and the coordinates and rotation angles in the target resource package; performs video encoding and decoding on each video compression package based on the coordinate offset and rotation angle offset of at least two pictures to generate multiple video segments corresponding to the image content.
[0063] In this way, the theme package configuration service stores a target resource package for each combination of resource type and resource number, saving storage resources. Subsequent multimedia codecs can perform video encoding and decoding on the compressed video package based on the calculated coordinate offset and rotation angle offset, ensuring that the resulting video matches the coordinates and rotation angles of at least two images edited by the user. This allows the lock screen to display a dynamic wallpaper that matches the user-edited image content, improving the user experience.
[0064] In a possible implementation, the identification information is the resource type and resource number of the at least two pictures, and the editing data further includes the coordinates and rotation angles of the at least two pictures;
[0065] The dynamic wallpaper service reads the target resource package corresponding to the edit data from the theme package configuration service, including: the dynamic wallpaper service reads the target resource package that matches the resource type, resource number, coordinates and rotation angle included in the edit data from the theme package configuration service.
[0066] Since the theme package configuration service stores resource packages corresponding to multiple combinations of fine-grained resource types, resource numbers, coordinates and rotation angles, the dynamic wallpaper service can accurately find the target resource package that completely matches the user's editing data, allowing the multimedia codec module to directly generate multiple videos corresponding to the image content based on the target resource package, and can make the target video played on the lock screen interface accurately match the user's editing data, thereby improving the display effect of the dynamic wallpaper.
[0067] In one possible implementation, when preset conditions are met, searching for a target video corresponding to the current scene information from multiple videos and playing the target video on the lock screen includes: upon receiving a user touch operation on the lock screen, searching for a target video corresponding to the current scene information from multiple videos and playing the target video on the lock screen. As an example, the touch operation can be a single click or a double click. When the user touches the lock screen, the electronic device plays the target video on the lock screen, thereby increasing interactivity with the user.
[0068] In one possible implementation, when preset conditions are met, a target video corresponding to the current scene information is searched from multiple videos, and the target video is played on the lock screen interface, including: when the electronic device receives a notification message, a target video corresponding to the current scene information is searched from multiple videos, and the target video is played on the lock screen interface.
[0069] Among them, the notification message is any notification message that can trigger the lock screen interface to light up, such as a text message, an application notification message, etc. In this way, in various situations where the lock screen interface needs to be displayed, the target video can be played on the lock screen interface, bringing aesthetic enjoyment to the user.
[0070] In one possible implementation, the wallpapers corresponding to the multiple wallpaper images are all dynamic wallpapers whose growth status changes over time, and the image content of at least two images is a target plant formed by combining at least two images. The preset scene information also includes growth stage information.
[0071] When the current scene information is the first preset scene information, the target video is a growth video of the target plant in its current growth stage, wherein the lock screen interface state included in the first preset scene information is a state switched from off-screen to bright-screen, the user operation information included in the first preset scene information is an operation of the user triggering the lock screen interface to brighten the screen, and the growth stage information included in the first preset scene information is the current growth stage of the target plant; optionally, when the electronic device receives a notification message, the lock screen section switches from off-screen to bright-screen state. In this case, the target video played on the lock screen interface is also a growth video of the target plant in its current growth stage.
[0072] When the current scene information is the second preset scene information, the target video is a video of the target plant swaying left and right at the current growth stage, wherein the lock screen interface state included in the second preset scene information is the screen-on state, the user operation information included in the second preset scene information is the fifth operation performed by the user on the lock screen interface, and the growth stage information included in the second preset scene information is the current growth stage of the target plant;
[0073] When the current scene information is the third preset scene information, the target video is a video of the target plant being watered in the current growth stage, wherein the lock screen interface state included in the third preset scene information is the screen-on state, the user operation information included in the third preset scene information is the user's sixth operation on the lock screen interface, the growth stage information included in the third preset scene information is the current growth stage of the target plant, one of the fifth operation and the sixth operation is a click operation, and the other is a double-click operation.
[0074] This method can simulate the user's experience of growing plants in the real world, and can bring the user a real-world experience and sense of happiness.
[0075] In a third aspect, an embodiment of the present application provides an electronic device, comprising: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute the method described in the first aspect and any possible implementation of the first aspect, or execute the method described in the second aspect and any possible implementation of the second aspect.
[0076] In a fourth aspect, an embodiment of the present application provides a chip system, which is applied to an electronic device, and the chip system includes one or more processors, which are used to call computer instructions to enable the electronic device to execute the method described in the first aspect and any possible implementation method of the first aspect, or execute the method described in the second aspect and any possible implementation method of the second aspect.
[0077] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, including a computer program. When the computer program is run on an electronic device, the electronic device executes the method described in the first aspect and any possible implementation of the first aspect, or executes the method described in the second aspect and any possible implementation of the second aspect.
[0078] In a sixth aspect, an embodiment of the present application provides a computer program product, which includes: computer program code, which, when the computer program code runs on an electronic device, enables the electronic device to execute the method described in the first aspect and any possible implementation of the first aspect, or execute the method described in the second aspect and any possible implementation of the second aspect.
[0079] It is understandable that the electronic device provided in the third aspect, the chip system provided in the fourth aspect, the computer storage medium provided in the fifth aspect, and the computer program product provided in the sixth aspect are all used to perform the methods provided in this application. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding methods and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0080] The drawings described herein are used to provide further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute improper limitations on the present application.
[0081] FIG1 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;
[0082] FIG2 is a software structure block diagram of an electronic device provided in an embodiment of the present application;
[0083] Figures 3a to 3g are schematic diagrams of interface changes corresponding to the wallpaper setting process provided in an embodiment of the present application;
[0084] Figures 3h and 3i are exemplary schematic diagrams of two lock screen interfaces provided in embodiments of the present application;
[0085] FIG4 is a schematic diagram of a wallpaper processing method provided in an embodiment of the present application;
[0086] FIG5 is a flowchart of a wallpaper processing method provided in an embodiment of the present application;
[0087] FIG6 is a flow chart showing a plant cultivation wallpaper according to an embodiment of the present application;
[0088] FIG7 is an exemplary schematic diagram of a video resource provided in an embodiment of the present application;
[0089] FIG8 is an exemplary schematic diagram of a lock screen interface when the screen is switched from off to on state according to an embodiment of the present application;
[0090] FIG9 is an exemplary schematic diagram of a lock screen interface when the screen switches from off to on state upon receiving a notification message according to an embodiment of the present application;
[0091] FIG10 is an exemplary schematic diagram of a lock screen interface when a user clicks on the lock screen interface provided by an embodiment of the present application;
[0092] FIG11 is an exemplary schematic diagram of a lock screen interface when a user selects different wallpaper resources according to an embodiment of the present application;
[0093] FIG12 is an exemplary schematic diagram of a lock screen interface when a user performs different editing operations on a wallpaper resource, as provided in an embodiment of the present application. DETAILED DESCRIPTION
[0094] To make the objectives, technical solutions, and advantages of this application more clearly understood, the present application is further described below with reference to the accompanying drawings and examples. It is apparent that the described examples are only a portion of the embodiments of this application, and not all of them. All other embodiments derived by persons of ordinary skill in the art based on the examples in this application are intended to fall within the scope of protection of this application.
[0095] An embodiment of the present application provides a wallpaper processing method, which is applied to electronic devices, such as mobile phones, tablet computers, televisions, wearable devices, in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), and other electronic devices with display screens.
[0096] FIG1 is a schematic diagram of an electronic device provided in an embodiment of the present application. The electronic device shown in FIG1 may include a processor 110, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, a button 190, a motor 191, an indicator 192, cameras 1-N 193, a display 194, and subscriber identification module (SIM) card interfaces 1-N 195. The sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.
[0097] It is understood that the structures illustrated in the embodiments of the present application do not constitute specific limitations on the electronic device. In other embodiments of the present application, the electronic device may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0098] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor, a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0099] The controller can be the nerve center and command center of the electronic device. The controller can generate operation control signals based on instruction operation codes and timing signals to complete the control of instruction fetching and execution.
[0100] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly retrieve it from the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.
[0101] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, etc.
[0102] The wireless communication function of the electronic device can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.
[0103] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in an electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.
[0104] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied in electronic devices. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0105] In the application embodiment, the mobile communication module may also be referred to as a cellular module, and the two may be described interchangeably.
[0106] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker, a receiver, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.
[0107] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (WIFI) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc., which are applied to electronic devices. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2. In some embodiments, at least some functional modules of the wireless communication module 160 can be set in the processor 110.
[0108] In some embodiments of the present application, the electronic device can establish a wireless connection with other electronic devices through the wireless communication module 160 (such as a Bluetooth module and a WLAN module) and the antenna 2 to achieve data transmission between the electronic device and the other electronic devices.
[0109] In some embodiments, antenna 1 of the electronic device is coupled to mobile communication module 150 , and antenna 2 is coupled to wireless communication module 160 , so that the electronic device can communicate with the network and other devices through wireless communication technology.
[0110] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is only for illustrative purposes and does not constitute a structural limitation on the electronic device. In other embodiments of the present application, the electronic device may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.
[0111] The charging management module 140 is configured to receive charging input from a charger. While charging the battery 142 , the charging management module 140 can also power the electronic device through the power management module 141 .
[0112] The electronic device implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0113] The display screen 194 is used to display images, videos, etc. In some embodiments, the electronic device may include 1 or N display screens 194 , where N is a positive integer greater than 1.
[0114] The electronic device can realize the shooting function through the ISP, camera 193, video codec, GPU, display 194 and application processor.
[0115] The ISP is used to process data fed back by the camera 193. The camera 193 is used to capture still images or videos. In some embodiments, the electronic device may include one or N cameras 193, where N is a positive integer greater than one.
[0116] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when an electronic device selects a frequency, the DSP performs a Fourier transform on the frequency energy.
[0117] The electronic device can implement audio functions such as music playback and recording through the audio module 170, speakers, receivers, microphones, headphone jacks, and application processors.
[0118] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device.
[0119] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a screen projection function, a network sharing function, etc.), etc. The data storage area can store data created during the use of the electronic device (such as video data, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0120] Keys 190 include a power button, a volume button, and the like. Keys 190 may be mechanical keys or touch-sensitive keys. The electronic device may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device.
[0121] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or touch vibration feedback. Indicator 192 can be an indicator light that can be used to indicate charging status, power level changes, messages, missed calls, notifications, etc.
[0122] SIM card interface 195 is used to connect a SIM card. A SIM card can be connected to and disconnected from the electronic device by inserting or removing it from the SIM card interface 195. An electronic device may support one or N SIM card interfaces, where N is a positive integer greater than one.
[0123] The software system of the electronic device can adopt a layered architecture, event-driven architecture, micro-kernel architecture, micro-service architecture, or cloud architecture. The embodiment of the present application takes the Android system with a layered architecture as an example to illustrate the software system of the electronic device. As shown in Figure 2, the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into three layers,
[0124] From top to bottom, they are the application layer, application framework layer, and kernel layer.
[0125] The application layer can include a series of application packages. As shown in Figure 2, the application package may include settings, wallpaper applications, gallery, smart middle platform, video editing applications, and multimedia codec modules. Optionally, it may also include camera, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message applications, etc. (not shown in Figure 2).
[0126] Among them, the wallpaper application can provide dynamic wallpaper service and theme package configuration service. The theme package configuration service is used to store various theme packages. The dynamic wallpaper service supports users to flexibly set wallpapers. For example, it can support the configuration of the user's selected theme package in the electronic device, and also support users to personalize the wallpaper.
[0127] The smart middle platform can provide functions such as secondary composition, smart recommendations and all-things cutout. Electronic devices can use the capabilities of the smart middle platform to synthesize the pictures required in the theme package.
[0128] The video editing module is used to perform video editing and video synthesis on the required videos when generating the dynamic wallpaper in the theme package, so as to generate the video resources required for the dynamic wallpaper in the theme package.
[0129] The multimedia codec module is used to perform video codec processing on the video resources in the theme package, thereby generating a dynamic wallpaper video that can be played on the screen.
[0130] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions. As shown in Figure 2, the application framework layer can include a window manager, content provider, view system, telephony manager, resource manager, notification manager, and algorithm framework.
[0131] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.
[0132] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0133] The view system includes visual controls, such as those for displaying text and images. The view system is used to build the application's display interface. A display interface can be composed of one or more views. For example, the display interface for a text notification icon might include a view for displaying text and a view for displaying an image.
[0134] The phone manager is used to provide communication functions for terminal devices, such as call status management (including answering, hanging up, etc.).
[0135] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0136] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.
[0137] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, sensor driver, etc.
[0138] It is understood that the layers in the software structure shown in FIG2 and the components contained in each layer do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer layers than shown, and each layer may include more or fewer components, and this application does not limit this.
[0139] The following embodiment of the present application takes an electronic device having the structure shown in Figures 1 and 2 as an example to introduce in detail the wallpaper processing method provided in the embodiment of the present application.
[0140] The embodiment of the present application provides a wallpaper type that can be customized by the user. After the user sets this type of wallpaper, the user can interact with the wallpaper and experience flower arrangement, plant and animal cultivation, etc. Through user-defined settings, the user can express his inner world. In addition to bringing aesthetic enjoyment to the user, it can also bring the user a real-world experience and a sense of happiness.
[0141] In order to enable users to customize wallpaper settings, electronic devices pre-store various types of theme packages, such as flower arrangement theme packages and animal training theme packages. These theme packages include the resources required to synthesize dynamic wallpapers, and the wallpaper resources corresponding to each theme package are pre-stored in the settings application.
[0142] First, the process of users setting wallpaper is introduced.
[0143] 3a-3g are schematic diagrams of interface changes corresponding to the wallpaper setting process provided in an embodiment of the present application.
[0144] For example, a foldable phone can be used as an example. As shown in Figure 3a, a user can tap a settings application (APP) 301 on the desktop to access the phone's settings interface, as shown in Figure 3b. The settings interface can include a desktop and personalized controls 302. The user taps these controls to access the desktop and personalized settings interface, as shown in Figure 3d.
[0145] Among them, the embodiment of the present application does not limit the name of the desktop and personalized control 302. For example, in some mobile phones, the name of the control can also be desktop and wallpaper, wallpaper or theme, etc.
[0146] Optionally, as shown in FIG3c , the user can also quickly enter the desktop and personalized settings interface as shown in FIG3d through a two-finger pinch gesture on the lock screen interface.
[0147] As shown in Figure 3d, the desktop and personalized settings interface supports settings for wallpaper, off-screen display, magazine lock screen, themes, fonts, icons and desktop. In the embodiment of the present application, an external screen area control 303 is added to the desktop and personalized settings interface. In response to the user clicking the external screen area control 303 (the first operation), the mobile phone jumps to the settings interface of the external screen area, as shown in Figure 3e.
[0148] It should be noted that in foldable phones, the settings interface for the external screen area allows users to set the lock screen wallpaper displayed on the external screen of the foldable phone. The method provided in the embodiment of the present application is also applicable to non-foldable phones. In non-foldable phones, the dynamic wallpaper in the embodiment of the present application can be set through the theme settings interface. A new control can also be added to the desktop and personalization interface. When the user clicks the control, it can also jump to the settings interface shown in Figure 3e. The embodiment of the present application does not limit the name of the control.
[0149] Figure 3e shows two types of wallpaper thumbnails: the three wallpaper thumbnails in the first row are plant-based dynamic wallpapers (also known as flower arrangement wallpapers), and the three wallpaper thumbnails in the second row are animal-based dynamic wallpapers. When the user clicks on any wallpaper thumbnail (the second action), the phone jumps to the wallpaper editing interface corresponding to that wallpaper thumbnail (the editing interface for the first wallpaper image). For example, if the user clicks on the second wallpaper thumbnail in the first row, the phone jumps to the editing interface shown in Figure 3f.
[0150] In FIG3f , wallpaper resources (multiple images corresponding to the first wallpaper image) available for user selection are exemplarily shown. For example, leaves of various shapes are shown in the leaf selection area, various types of flowers are shown in the flower selection area, and various types of insects and birds are shown in the bird and insect selection area. It should be noted that the number of wallpaper resources shown in FIG3f is only an example. In actual implementation, fewer or more wallpaper resources can be displayed to the user according to the size of the display screen, and the selection area for each type of resource can also support sliding display. For example, the user can place a finger on the leaf selection area and slide the leaf selection area left or right or up and down to view more shapes of leaves.
[0151] The user can select wallpaper resources according to their preferences and match the positions of the selected wallpaper resources to generate a personalized dynamic wallpaper. The user can select (selection operation) by clicking or dragging, and the selected wallpaper resource will be displayed in the wallpaper editing area 304.
[0152] Taking selection by dragging as an example, in Figure 3f, the user drags the three types of leaves in the leaf selection area to the wallpaper editing area 304, drags the third type of flower in the flower selection area to the wallpaper editing area 304, and drags the third type of insect in the bird and insect selection area to the wallpaper editing area 304.
[0153] Each wallpaper resource can support multiple selections. For example, if the user wants to select the same flower twice, they can do so by dragging the same flower twice, or by clicking the controls around the flower after selecting it once. For example, in the wallpaper editing area 304 of Figure 3f, three controls are displayed around the flower selected by the user: a cross-shaped close control, a "+1" control (add control), and a rotation control. In response to the user clicking the "+1" control, the phone will display the same flower again in the wallpaper editing area 304.
[0154] It is understandable that when the user clicks the rotation control, the mobile phone can rotate the flower. And, if the user wants to delete the flower, the user can click the close control. In response to the click operation of the close control, the mobile phone deletes the flower from the wallpaper editing area 304.
[0155] The user can also adjust the position of each wallpaper resource by dragging it in the wallpaper editing area 304 (dragging the third image), and resize it by pinching with two fingers (zooming the third image). The positions of the wallpaper resources can overlap.
[0156] For example, in the wallpaper editing area 304 in Figure 3f, the user can combine selected leaves, flowers, and insects into a flower arrangement wallpaper with a nurturing effect by adjusting the position and angle. The resulting effect is shown in Figure 3g. After the user completes the adjustments, they click the Apply control 305 (the fourth operation). The phone then synthesizes the video corresponding to the flower arrangement wallpaper and exits the editing interface, returning to the desktop.
[0157] Later, when the lock screen is displayed, the video corresponding to the flower arrangement wallpaper can be played on the lock screen. For example, if the plant is in the flowering stage and the phone screen is off and the user clicks, the video corresponding to the flower arrangement wallpaper will be played on the lock screen in response to the click. As shown in Figure 3h, the wallpaper in Figure 3h is actually displayed with a slowly growing animation.
[0158] In the interface of Figure 3h, if the user double-clicks, a video of watering the plant shown in Figure 3h plays in response to the double-click. As shown in Figure 3i, a kettle appears above the plant, watering the plant. After the watering is completed, if the lock screen is still in the bright state, the kettle disappears and the corresponding growth animation in Figure 3h continues to play.
[0159] As shown in Figure 4, Figure 4 is a schematic diagram of the wallpaper processing method provided in an embodiment of the present application, wherein the gallery includes plug-ins for computer vision (CV) services, wallpaper editing, wallpaper templates, and video editing and synthesis functions. In conjunction with the description of the above embodiments, the user can quickly access the settings interface of the external screen area shown in Figure 3e through the lock screen interface, and then enter the wallpaper editing interface, or gradually enter the wallpaper editing interface through the settings application.
[0160] The wallpaper editing plug-in can obtain the wallpaper resource corresponding to the wallpaper thumbnail selected by the user from the wallpaper template plug-in, and display the obtained wallpaper resource in the wallpaper editing interface, so that the user can edit the dynamic wallpaper according to his or her preferences in the wallpaper editing interface. After the user completes the editing, the wallpaper editing plug-in stores the user's editing results in the media library (Media Library), and calls the video editing and synthesis plug-in so that the video editing and synthesis plug-in synthesizes the corresponding video according to the dynamic wallpaper edited by the user through the video editing middle platform, and then sets the lock screen wallpaper so that the dynamic wallpaper edited by the user can be dynamically displayed on the lock screen interface.
[0161] Among them, the theme package involved in the embodiment of this application is pre-generated. In the process of pre-generating the theme package, the wallpaper editing plug-in calls the smart middle platform to process the image. The CV service can also call the smart middle platform to process the image. The smart middle platform has functions such as secondary composition, smart recommendation, and all-things cutout. In addition, the CV service is also used to call the function of the smart middle platform to generate wallpaper resources corresponding to the theme package and provide them to the wallpaper template plug-in.
[0162] It should be noted that both the wallpaper editing plug-in and the wallpaper template plug-in are plug-ins for setting up applications. In the process of the user performing editing operations in the editing interface shown in FIG3f , in response to the user's selection operation of the wallpaper resource, the wallpaper editing plug-in determines the resource type and resource number of the wallpaper resource selected by the user. Among them, the resource type and resource number of the wallpaper resource corresponding to each wallpaper are pre-set. For example, in FIG3f , the resource types are leaf, flower, and bird, respectively. The resource numbers of the three leaves shown in the leaf selection area are 1, 2, and 3, respectively. The resource numbers of the three flowers shown in the flower selection area are 1, 2, and 3, respectively. The resource numbers of the insects and birds shown in the bird and insect selection area are 1, 2, 3, 4, 5, and 6, respectively.
[0163] After the wallpaper editing plug-in determines the wallpaper resource and resource number selected by the user, during the subsequent user editing of the wallpaper resource, the wallpaper editing plug-in will record and update the coordinates and rotation angle of the wallpaper resource according to the user's operation. The record format can be {resource type, resource number, coordinates, rotation angle}.
[0164] When the user completes the editing operation and clicks the Apply control 305 in the editing interface shown in Figure 3g, the wallpaper editing plug-in saves the resource type, resource number, coordinates, and rotation angle of each resource currently in the wallpaper editing area as user-edited data, for example, in an XML file. In response to this click, the electronic device generates a video resource corresponding to the user-edited image content based on the user-edited data.
[0165] As an example, user edit data includes:
[0166] {leaf, 1, {60.80}, 60°}
[0167] {flower, 1, {120.80}, 30°}
[0168] {leaf, 3, {60.120}, 45°}
[0169] {leaf, 2, {120.120}, 70°}
[0170] {bird, 1, {70.70}, 10°}.
[0171] Next, after the user completes wallpaper editing and clicks the apply control 305, the electronic device generates a video resource corresponding to the image content edited by the user. As shown in FIG5 , the method includes:
[0172] S501: In response to a user clicking an application control, user edited data is sent to a dynamic wallpaper service.
[0173] In the case where the wallpaper selection interface includes multiple wallpaper images, the user editing data also includes the identifier of the wallpaper thumbnail (first wallpaper image) selected by the user in FIG. 3e .
[0174] S502: The dynamic wallpaper service reads the target resource package corresponding to the user edited data from the theme package configuration service.
[0175] The theme package configuration service stores at least two resource packages corresponding to each wallpaper type included in the wallpaper selection interface, and the theme package configuration service stores the resource type, resource number, coordinates, and rotation angle of the wallpaper resources in each resource package. Each resource package includes a video compression package of multiple preset scene information.
[0176] In a first embodiment, the dynamic wallpaper service reads a target resource package from the theme package configuration service that matches the resource type and resource number in the user edited data. The at least two resource packages corresponding to a wallpaper specifically include resource packages corresponding to multiple combinations of the wallpaper's resource type and resource number.
[0177] For example, if the resource types and resource numbers in the user edited data are {leaf, 1}, {flower, 1}, {leaf, 3}, {leaf, 2}, and {bird, 1}, respectively, and the resource types and resource numbers of the wallpaper resources in a resource package stored by the theme package configuration service are also {leaf, 1}, {flower, 1}, {leaf, 3}, {leaf, 2}, and {bird, 1}, then it can be determined that the resource package is the target resource package that matches the resource type and resource number in the user edited data. In this way, the target resource package corresponding to the edited data can be quickly read based on the resource type and resource number, and the dynamic wallpaper only needs to store one resource package for each combination of resource type and resource number, which can save storage space.
[0178] Furthermore, the multimedia codec module can calculate the coordinate offset and rotation angle offset of each wallpaper resource in the user editing data based on the coordinates and rotation angle of each wallpaper resource in the user editing data and the coordinates and rotation angle in the target resource package, and then perform video encoding and decoding on each video compression package based on the coordinate offset and rotation angle offset to generate a video corresponding to each preset scene information.
[0179] For example, the user-edited data includes a piece of data: {leaf, 1, {60.80}, 60°}, and the corresponding data in the target resource package is {leaf, 1, {70.90}, 50°}. This means that in the video compression package, the coordinates of leaf 1 are {70.90} and the rotation angle is 50°, while in the user-edited data, the coordinates of leaf 1 are {60.80} and the rotation angle is 60°. The multimedia codec module can calculate the coordinate offset and angle offset of leaf 1 based on these two sets of data, and then adjust the coordinates and angles of leaf 1 in the video according to the calculated coordinate offset and angle offset during the video encoding and decoding process of the video compression package, so that the coordinates of leaf 1 in the final generated video are {60.80} and the rotation angle is 60°, which is consistent with the user-edited data.
[0180] In this embodiment, when a user selects a wallpaper resource in the editing interface shown in FIG3f , the user is allowed to arbitrarily combine the wallpaper resources in the wallpaper editing interface and adjust the selected wallpaper resource to any position and rotation angle. Optionally, if the position and rotation angle of the wallpaper resource adjusted by the user cause the spliced plant to not conform to the plant combination characteristics, such as a plant petiole attached to a flower, the user may be prompted to make modifications.
[0181] In a second embodiment, the dynamic wallpaper service reads a target resource package from the theme package configuration service that matches the resource type, resource number, coordinates, and rotation angle in the edit data. The at least two resource packages corresponding to a wallpaper specifically include: resource packages corresponding to various rotation angles and coordinates supported by the wallpaper resources in the combination under various wallpaper resource combinations of the wallpaper. It can be understood that each combination of wallpaper resources corresponds to multiple resource packages, and the difference between the multiple resource packages is that the rotation angles and coordinates of the wallpaper resources are different.
[0182] It should be noted that, in the second embodiment, the combination methods supported by the wallpaper resources corresponding to a wallpaper are pre-set, and the rotation angles and coordinates supported by the wallpaper resources included in each combination method are also pre-set. That is to say, when the user selects a wallpaper resource in the editing interface shown in FIG3f, the user needs to select the wallpaper resource within the range of the pre-set combination method. If the user selects a resource that does not support the combination, the user will be reminded that the selection failed. In addition, when the user adjusts the coordinates and rotation angle of the wallpaper resource, it is also necessary to rotate it within the range of the pre-set rotation angle and coordinates. For example, the petiole of a leaf is usually connected to the stem of the plant, and not to another leaf. Therefore, when the user adjusts the position of the leaf, it is not supported to connect the petiole to another leaf.
[0183] Because a resource package includes the resource types, resource numbers, coordinates, and rotation angles of multiple wallpaper resources, as well as corresponding video compression packages for various preset scenarios, it can be understood that the video corresponding to the video compression package corresponding to each preset scenario is consistent with the wallpaper resources included in the resource package. For example, if the preset scenario is a click scene with the screen in the bright state, the corresponding video is a video of a plant swaying from side to side. The shape of the leaves and flowers in the plant, as well as the relative positional relationship between the leaves and flowers, all match the resource type, resource number, coordinates, and rotation angle included in the resource package.
[0184] Based on this, the dynamic wallpaper service can search for multiple resource packages corresponding to the wallpaper selected by the user from the theme package configuration service based on the identifier of the wallpaper, and then search for the target resource package from these resource packages that completely matches the {resource type, resource number, coordinates, rotation angle} included in the user edited data.
[0185] For example, a resource package corresponding to the wallpaper includes the following data:
[0186] {leaf, 1, {60.80}, 60°}
[0187] {flower, 1, {120.80}, 30°}
[0188] {leaf, 3, {60.120}, 45°}
[0189] {leaf, 2, {120.120}, 70°}
[0190] {bird, 1, {70.70}, 10°}
[0191] Since the {resource type, resource number, coordinates, rotation angle} are consistent with those included in the user edited data, it can be determined that the resource package is the target resource package corresponding to the user edited data.
[0192] S503: The theme package configuration service sends the target resource package to the dynamic wallpaper service in response to the read operation of the dynamic wallpaper service.
[0193] S504: The dynamic wallpaper service sends the video compression packages of each preset scene included in the target resource package to the multimedia codec module to trigger the multimedia codec module to perform a video codec operation on the video compression packages.
[0194] It is understandable that after the multimedia codec module performs video codec operations on the video compression package of each preset scene, a video can be generated. Finally, the videos corresponding to the preset scenes can be combined into one video, or the videos corresponding to each preset scene can be saved separately.
[0195] Among them, the method in which the multimedia encoding and decoding module generates a video based on the video compression package of each preset scene will be introduced in subsequent embodiments.
[0196] S505: The multimedia codec module stores the video encoded and decoded to obtain the video.
[0197] When the multimedia codec module synthesizes the videos corresponding to the preset scenes into one video, the complete video can be directly stored and then S506 is executed. Alternatively, a video segment can be stored for each preset scene.
[0198] The media library in FIG4 belongs to the multimedia codec module, and the multimedia codec module can store videos in the media library.
[0199] S506: The multimedia encoding and decoding module sends a mapping relationship between the video resource location and the preset scene information to the dynamic wallpaper service.
[0200] The video resource location may be represented by a frame number interval of the video. As an example, the mapping relationship may be:
[0201] {Frames 1-3, video resources of the lock screen lighting up}
[0202] {Frames 4-6, video resources where the screen turns off after a timeout}
[0203] {Frames 7-9, click on the lock screen video resource}
[0204] {Frames 10-12, double-click the lock screen video resource}
[0205] {Frames 13-15, video resources after watering 10}
[0206] …….
[0207] Among them, this mapping relationship is only an example. In plant cultivation wallpapers, the division granularity of preset scenes is finer. For example, the video resources that light up the lock screen can be refined into video resources that light up the lock screen in various stages of plant growth. Specifically, for example, frames 1-3 are video resources that light up the lock screen in the germination stage of the plant, frames 4-6 are video resources that light up the lock screen in the seedling stage of the plant, and frames 7-9 are video resources that light up the lock screen in the flowering stage of the plant.
[0208] It is understandable that after the user completes the wallpaper editing and clicks the apply control, the wallpaper setting is completed. When the lock screen interface needs to be displayed later, the video corresponding to the current scene can be played on the lock screen interface. The specific process is as follows:
[0209] S507: The screen sends a touch message to the lock screen in response to the user's touch operation on the screen.
[0210] It is understandable that when the electronic device is in the locked screen state, after the screen recognizes the user's touch operation, it will send a touch message to the locked screen.
[0211] The touch message includes the user's touch mode, for example, the touch mode may be a click or a double-click operation.
[0212] S508: The lock screen forwards the touch message to the dynamic wallpaper service.
[0213] S509: The dynamic wallpaper service determines the current scene information, and determines the frame number interval corresponding to the current scene information based on the mapping relationship.
[0214] Among them, if the touch method included in the touch message is click, and the electronic device is in a bright screen state before the user clicks the lock screen interface, the current scene information is the click scene in the bright screen state.
[0215] If the touch method included in the touch message is a double-click, and the electronic device is in a bright screen state before the user double-clicks the lock screen interface, the current scene information is a double-click scene in the bright screen state.
[0216] If the user's touch operation causes the lock screen to light up, the current scene information is the scene in which the lock screen lights up.
[0217] For example, in a plant-growing wallpaper, the current scene information also includes the plant's growth stage. For example, when the lock screen is on and the plant's growth stage is flowering, a click triggers the plant's left-right swaying effect. A double-click triggers the watering effect. After the lock screen is lit, the plant's growth effect in the flowering stage is triggered.
[0218] S510: The dynamic wallpaper service triggers the multimedia codec module to play the video at the target video resource location on the lock screen interface.
[0219] As an example, taking the wallpaper edited by the user in Figure 3g as an example, this wallpaper supports the cultivation effect, and the dynamic wallpaper service has generated videos of various growth stages through the multimedia codec module, wherein the duration of each growth stage can be preset, that is, the plant has a preset number of generation stages, and each growth stage corresponds to a time interval. For example, a new growth stage is entered every day. On the first day when the wallpaper is applied, the dynamic wallpaper displayed on the lock screen interface is the video of the germination stage of the plant in Figure 3g; on the second day, the dynamic wallpaper displayed on the lock screen interface is a video of the same plant leaves having grown; on the third day, the dynamic wallpaper displayed on the lock screen interface is a video of the plant growing buds; on the fourth day, the dynamic wallpaper displayed on the lock screen interface is a video of the plant flowers in full bloom, that is, the video of the state of the plant displayed in the wallpaper editing area 304 in Figure 3g.
[0220] In addition, to increase interaction with users, when users click on the dynamic wallpaper on the lock screen, a video of plants swaying left and right in the current growth stage can be played.
[0221] In addition, the function of watering plants can be realized by double-clicking. In response to the user's double-click operation, a video of watering plants can be played. The specific process is shown in Figure 6. The process can be executed by the dynamic wallpaper service and specifically includes the following steps:
[0222] S601: Identify the user's double-click operation on the lock screen.
[0223] S602: Determine whether the watering times are greater than or equal to the preset times.
[0224] As an example, the preset number of times may be 10 times.
[0225] If not, execute S603; if so, execute S605.
[0226] S603: Play watering animation.
[0227] It is understandable that when the dynamic wallpaper service recognizes a double-click operation, it can determine that the current user's operation is a watering operation, and then find the corresponding video resource location when the number of watering times is less than 10 times in the current growth stage of the plant, and then instruct the multimedia codec module to play the video at the video resource location, so that the watering animation can be played on the lock screen interface.
[0228] S604: Add 1 to the recorded watering times.
[0229] S605: Play the growth animation corresponding to the preset number of watering times.
[0230] It is understandable that when the dynamic wallpaper service recognizes a double-click operation, it can determine that the current user's operation is a watering operation, and then find the frame number interval corresponding to the current growth stage of the plant when the number of watering times is greater than or equal to 10 times, and then instruct the multi-body codec application to play the video corresponding to the frame number interval. For example, the growth effect of the plant can be played on the lock screen interface.
[0231] It can be seen that in this process, users can interact with the lock screen wallpaper and experience the real cultivation experience, which can enhance the fun of the lock screen wallpaper and bring users a real-world experience and sense of happiness.
[0232] In the process shown in Figure 5, the multimedia codec module can generate a video based on the video compression package of each preset scene information. In addition to the video resources corresponding to the wallpaper resources selected by the user when editing the wallpaper, the video compression package can also include video resources in various interactive scenarios, such as a video of a kettle watering.
[0233] It is understandable that since there is an overlapping and occlusion relationship between various wallpaper resources when the wallpaper is displayed on the lock screen in the form of video, the multimedia codec module can call the video editing and synthesis capabilities of the video editing center to synthesize the video.
[0234] Among them, the video editing middle platform can obtain each video resource in the video compression package, and create a video track to carry the underlying video resources based on the overlay relationship between each video resource, and then add more video tracks so that other video resources are superimposed on the underlying video resources according to the overlay relationship, thereby generating the video corresponding to the video compression package.
[0235] It should be noted that the video resources in the embodiment of the present application include color information and Alpha channel information of each pixel, wherein the Alpha channel is used to record transparency information of the pixel.
[0236] As an example, as shown in Figure 7, the depth of black and white in the black and white image on the left side of Figure 7 (a) is used to represent the Alpha channel of each pixel in the video, where Alpha = 00 corresponding to black (000000) indicates full transparency; Alpha = FF corresponding to white (FFFFFF) indicates opaque.
[0237] For example, the alpha value of point A in the black and white image on the left in FIG7 (a) is converted to binary as 255, indicating opacity, and the alpha value of point B is converted to binary as 9, indicating near full transparency.
[0238] The image on the right in (a) of Figure 7 is actually a color image. The RGB values of each point in the image are used to represent the color information of each pixel in the video. For example, the R value of point A is 229, the G value is 198, and the B value is 240. The R value of point B is 6, the G value is 1, and the B value is 11.
[0239] In the process of synthesizing videos, the effect after synthesis based on color information and alpha channel information is (b) in Figure 7. (b) in Figure 7 is actually a color image, that is, each pixel in the synthesized video contains color information and transparency information. For example, point A includes Alpha value: 255, as well as R value: 229, G value: 198, and B value: 240; point B includes Alpha value: 9, R value: 6, G value: 1, and B value: 11.
[0240] It can be seen that in the corresponding effect after synthesis, the background part of the image on the right in (a) in Figure 7 is almost completely transparent. In this way, when multiple video resources are superimposed, a good superposition effect can be achieved, making the generated dynamic wallpaper more realistic.
[0241] It should be noted that, corresponding to the first implementation in S502, after the dynamic wallpaper service reads the target resource package corresponding to the resource type and resource number from the theme package configuration service, it sends the target resource package and the editing data to the multimedia codec module. The multimedia codec module then calculates, for each wallpaper resource in the target resource package, the coordinate offset and rotation angle offset between the coordinates and rotation angle of the wallpaper resource in the target resource package and the coordinates and rotation angle in the editing data, and then synthesizes a video that conforms to the editing data based on the coordinate offset and rotation angle offset.
[0242] For example, if point C in the bottom-level video resource included in a video compression package is at the same position as point D in the upper-level video resource, assuming point C is a point on a leaf and point D is a point on a flower, that is, in the video compression package, there is an occlusion relationship between points D and C. However, in the user's edited data, point C on the leaf and point D on the flower are at different positions. When the video codec module generates the video, it can calculate the actual positional relationship between the points included in each layer of the video resource based on the coordinates and angles of each point in the video resource and the coordinates and angles in the edited data. For example, if it is determined that point C on the leaf and point E on the flower are at the same position, then a pixel point in the video is synthesized based on point C on the leaf and point E on the flower, so that there is an occlusion relationship between point C on the leaf and point E on the flower. This generates a video that matches the user's edited data.
[0243] Corresponding to the second implementation in S502, the dynamic wallpaper service reads a target resource package from the theme package configuration service that matches the resource type, resource number, coordinates and rotation angle in the editing data, that is, the target resource package matches the editing data itself, so the video that matches the user's editing data can be directly synthesized based on the video resources in the target resource package.
[0244] In combination with the description of the above embodiments, the following takes plant cultivation dynamic wallpaper as an example to introduce three scenarios involved in the embodiments of this application.
[0245] Scenario 1: Different user operations on the lock screen trigger the lock screen to play different target videos.
[0246] As shown in (a) in Figure 8, the mobile phone is in the screen-off state. If the user triggers the lock screen interface to light up, the lock screen interface of the mobile phone switches from the screen-off state to the screen-lighting state, and a video of the growth effect of the plant in the current growth stage is played on the lock screen interface. At this time, the plant in the lock screen interface is shown in (b) in Figure 8.
[0247] Alternatively, as shown in FIG9 (a), the phone is in the screen-off state. If the phone receives a notification message (such as a text message), the lock screen interface of the phone will also switch from the screen-off state to the screen-on state, and then as shown in FIG9 (b), the text message notification message "A new message has been received" can be displayed on the lock screen interface, and a video of the growth effect of the plant in the current growth stage can be played on the lock screen interface. The notification message can be any message that can trigger the lock screen interface to light up, such as a notification from various applications. The embodiment of the present application does not limit the display position of the notification message on the lock screen interface.
[0248] Next, taking (b) in Figure 8 as an example, if a user click operation is received when the plant growth effect shown in (b) in Figure 8 is displayed, a video of the plant swaying left and right in the current growth stage is played on the lock screen interface as shown in Figure 10. The dotted line of the plant in Figure 10 represents the position of the plant displayed in the previous frame of the video, and the solid line is the current position of the plant, that is, the effect of the plant swaying from right to left. It should be noted that after the left-right swaying video is played, if the lock screen interface is still in the bright screen state, it returns to the interface shown in (b) in Figure 8 and replays the video of the plant's growth effect in the current growth stage.
[0249] Based on (b) in FIG. 8 or FIG. 10 , if a double-click operation by the user is received, a video of watering plants at the current growth stage is played, as shown in FIG. 3 i .
[0250] It can be seen that different user operations will trigger the lock screen interface to play different videos, allowing users to interact with the lock screen wallpaper and improve the user experience.
[0251] Scenario 2: When the user edits a wallpaper, if the wallpaper resource they select is different, the video played on the lock screen will also be different.
[0252] For example, if the user selects the wallpaper resource in the editing area 304 shown in FIG. 3 g , then when the screen is subsequently turned on, the plants in the video played will be as shown in (a) in FIG. 11 .
[0253] If the insect selected by the user in the editing area 304 is not a ladybug but an ant, and the other wallpaper resources selected by the user are the same as the wallpaper resources displayed in the editing area 304 of Figure 3g, then when the screen is turned on, the plants in the video played will be as shown in (b) in Figure 11.
[0254] Scenario 3: When a user edits a wallpaper, after selecting a wallpaper resource, performing different editing operations on the same wallpaper resource will also result in different videos being played on the lock screen.
[0255] For example, if the final editing effect obtained by the user is the editing effect in the editing area 304 shown in FIG. 3g , then when the screen is subsequently turned on, the plants in the video played will be as shown in (a) in FIG. 12 .
[0256] If the user drags the selected insect picture onto another leaf in the editing area 304 , then when the screen is turned on, the plant in the video played will be as shown in (b) in FIG. 12 .
[0257] It can be seen from Scene 2 and Scene 3 that different wallpaper resources selected by the user, as well as different editing operations on the same wallpaper resources, will result in different videos played on the subsequent lock screen interface. Therefore, users can edit dynamic wallpapers according to their preferences, so that the videos played on the lock screen interface subsequently are more in line with the user's preferences and needs, which can improve the user experience.
[0258] Based on the same inventive concept, according to the wallpaper processing method provided in the above-mentioned embodiment of the present application, the embodiment of the present application also provides a computer-readable storage medium, including a computer program. When the computer program runs on an electronic device, the electronic device executes the wallpaper processing method described in the above-mentioned method embodiment.
[0259] In another embodiment provided by the present application, a computer program product is further provided. The computer program product includes: computer program code. When the computer program code runs on an electronic device, the electronic device executes the wallpaper processing method described in the above method embodiment.
[0260] In another embodiment provided in the present application, a chip system is also provided. The chip system is applied to an electronic device. The chip system includes one or more processors. The processor is used to call computer instructions so that the electronic device executes the wallpaper processing method described in the above method embodiment.
[0261] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When software is used for implementation, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).
[0262] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply the existence of any such actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.
[0263] Each embodiment in this specification is described in a related manner. Similar portions between the embodiments can be referred to in conjunction with each other. Each embodiment focuses on the differences from other embodiments. In particular, the device embodiments are generally similar to the method embodiments, so their description is relatively simple. For related portions, refer to the description of the method embodiments.
[0264] The above description is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application.
Claims
1. A wallpaper processing method, characterized in that: Applied to electronic equipment, the method includes: receiving a first operation from a user; In response to the first operation, displaying the wallpaper selection interface, wherein the wallpaper selection interface includes a plurality of wallpaper images; receiving a second operation of the user on a first wallpaper image among the multiple wallpaper images; In response to the second operation, displaying an editing interface corresponding to the first wallpaper picture, the editing interface including multiple pictures corresponding to the first wallpaper picture; receiving a third operation from the user on at least two pictures of the plurality of pictures; In response to the third operation, displaying the at least two pictures in the editing area of the editing interface; receiving a fourth operation from the user; In response to the fourth operation, obtaining the image contents of the at least two pictures currently displayed in the editing area, and exiting the editing interface; When a preset condition is met, a target video is played on the lock screen interface, wherein the target video includes image content corresponding to the at least two pictures.
2. The method according to claim 1, characterized in that When the at least two pictures include the first picture, playing the target video on the lock screen interface when a preset condition is met includes: When the preset condition is met, playing the first target video on the lock screen interface; In a case where the at least two pictures include the second picture, playing the target video on the lock screen interface when a preset condition is met includes: When the preset condition is met, the second target video is played on the lock screen interface, wherein the first picture is different from the second picture, and the first target video is different from the second target video.
3. The method according to claim 1, characterized in that The editing interface includes at least two wallpaper resource selection areas, each wallpaper resource selection area includes multiple pictures of the same type; the third operation includes a selection operation and an editing operation; The step of displaying the at least two pictures in the editing area of the editing interface in response to the third operation includes: In response to a selection operation on pictures in the at least two wallpaper resource selection areas, displaying the pictures selected by the user in the editing area, wherein the pictures selected by the user include a third picture; In response to an editing operation on the third picture, the third picture edited by the user is displayed in the editing area.
4. The method according to claim 3, characterized in that In response to the editing operation on the third picture, displaying the third picture edited by the user in the editing area includes: In response to a user's editing operation of dragging the third picture, adjusting a position of the third picture within the editing area according to a dragging trajectory of the user; In response to a user editing operation of zooming in or out of the third picture, the size of the third picture displayed in the editing area is adjusted.
5. The method according to claim 3 or 4, characterized in that The editing area displays a rotation control and / or an add control for the third picture; In response to the editing operation on the third picture, displaying the third picture edited by the user in the editing area includes: In response to a user operation on the rotation control, rotating the third picture according to a preset rotation direction and a preset rotation angle; In response to the user's operation on the adding control, the third picture is added to the editing area.
6. The method according to claim 5, characterized in that The editing area also displays a close control for the third picture; After displaying the at least two pictures in the editing area of the editing interface in response to the third operation, the method further includes: If a user operation on the close control is received, the third picture is deleted from the editing area in response to the user operation on the close control.
7. The method according to any one of claims 1 to 6, characterized in that Play the target video on the lock screen when the preset conditions are met, including: When a touch operation on the lock screen interface is received from the user, the target video is played on the lock screen interface.
8. The method according to any one of claims 1 to 6, characterized in that Play the target video on the lock screen when the preset conditions are met, including: When the electronic device receives the notification message, the target video is played on the lock screen interface.
9. The method according to any one of claims 1 to 8, characterized in that The step of playing the target video on the lock screen interface when a preset condition is met includes: When the preset conditions are met, the target video corresponding to the current scene information is played on the lock screen interface, wherein the current scene information includes the lock screen interface status and user operation information.
10. The method according to claim 9, characterized in that Playing the target video corresponding to the current scene information on the lock screen interface includes: If the current scene information is the first preset scene information, then the third target video corresponding to the first preset scene information is played on the lock screen interface, wherein the lock screen interface state included in the first preset scene information is the state of switching from off-screen to bright-screen, and the user operation information included in the first preset scene information is the operation of the user triggering the lock screen interface to brighten the screen; If the current scene information is the second preset scene information, then playing the fourth target video corresponding to the second preset scene information on the lock screen interface, wherein the lock screen interface state included in the second preset scene information is the bright screen state, and the user operation information included in the second preset scene information is the fifth operation of the user on the lock screen interface; If the current scene information is the third preset scene information, the fifth target video corresponding to the third preset scene information is played on the lock screen interface, wherein the lock screen interface state included in the third preset scene information is the bright screen state, and the user operation information included in the third preset scene information is the user's sixth operation on the lock screen interface, and one of the fifth operation and the sixth operation is a click operation, and the other is a double-click operation.
11. The method according to claim 10, characterized in that The wallpapers corresponding to the multiple wallpaper images are all dynamic wallpapers in which the growth status of plants changes over time; the image content of the at least two images is the target plant formed by the combination of the at least two images; the current scene information also includes growth stage information; The growth stage information included in the first preset scene information is the current growth stage of the target plant, and the third target video is a growth video of the target plant in the current growth stage; The growth stage information included in the second preset scene information is the current growth stage of the target plant, and the fourth target video is a video of the target plant shaking left and right in the current growth stage; The growth stage information included in the third preset scene information is the current growth stage of the target plant, and the fifth target video is a video of the target plant being watered in the current growth stage.
12. The method according to claim 11, characterized in that The growth stage information includes a preset number of growth stages of the target plant, and each growth stage corresponds to a time interval.
13. The method according to claim 9, characterized in that The image content includes user editing data of the at least two pictures; After obtaining the image contents of the at least two pictures currently displayed in the editing area in response to the fourth operation, the method further includes: generating a plurality of videos corresponding to the image content based on the editing data, each video corresponding to a preset scene information; When the preset condition is met, playing the target video corresponding to the current scene information on the lock screen interface includes: When the preset condition is met, the target video corresponding to the current scene information is searched from the multiple videos, and the target video is played on the lock screen interface.
14. The method according to claim 13, characterized in that The electronic device includes a setting module, a dynamic wallpaper service, a theme package configuration service and a multimedia codec module; The step of obtaining, in response to the fourth operation, image contents of the at least two pictures currently displayed in the editing area includes: The setting module records the editing data based on the at least two pictures in the editing area in response to a fourth operation of the user on a preset control in the editing interface; Generating a plurality of videos corresponding to the image content based on the editing data includes: The setting module sends the editing data to the dynamic wallpaper service, where the editing data includes identification information of the at least two pictures; The dynamic wallpaper service reads a target resource package corresponding to the edit data from the theme package configuration service, wherein the target resource package includes a plurality of video compression packages matching the edit data, each video compression package corresponding to a preset scene information; The dynamic wallpaper service sends the multiple video compression packets to the multimedia codec module; The multimedia encoding and decoding module performs video encoding and decoding on each video compression packet respectively to generate multiple video segments corresponding to the image content.
15. The method according to claim 14, characterized in that After the multimedia encoding and decoding module performs video encoding and decoding on each video compression packet to generate multiple video segments corresponding to the image content, the method further includes: The multimedia encoding and decoding module stitches the multiple video segments into an overall video, and records the frame number interval of the video corresponding to each preset scene information in the overall video; The multimedia codec module sends a mapping relationship between a frame number interval and preset scene information to the dynamic wallpaper service; When the preset conditions are met, searching for the video corresponding to the current scene information from the multiple videos The target video is played on the lock screen interface, including: When the preset condition is met, the dynamic wallpaper service searches for a target frame number interval corresponding to the current scene information based on a mapping relationship between frame number intervals and preset scene information; The dynamic wallpaper service sends the target frame number interval to the multimedia codec module; The multimedia encoding and decoding module searches for a target video corresponding to the target frame number interval from the overall video, and plays the target video on the lock screen interface.
16. The method according to claim 14 or 15, characterized in that The identification information is the resource type and resource number of the at least two pictures, and the editing data further includes the coordinates and rotation angles of the at least two pictures; The dynamic wallpaper service reads the target resource package corresponding to the edit data from the theme package configuration service, including: The dynamic wallpaper service reads a target resource package that matches the resource type and resource number of the at least two pictures from the theme package configuration service, wherein the target resource package further includes the coordinates and rotation angles of the at least two pictures; The multimedia encoding and decoding module performs video encoding and decoding on each video compression packet to generate multiple video segments corresponding to the image content, including: The multimedia encoding and decoding module calculates a coordinate offset and a rotation angle offset of each of the at least two pictures based on the coordinates and rotation angles of the at least two pictures in the edited data and the coordinates and rotation angles in the target resource package; Video encoding and decoding are performed on each video compression packet based on the coordinate offset and rotation angle offset of each picture in the at least two pictures to generate multiple video segments corresponding to the image content.
17. The method according to claim 14 or 15, characterized in that The identification information is the resource type and resource number of the at least two pictures, and the editing data further includes the coordinates and rotation angles of the at least two pictures; The dynamic wallpaper service reads the target resource package corresponding to the edit data from the theme package configuration service, including: The dynamic wallpaper service reads a target resource package from the theme package configuration service that matches the resource type, resource number, coordinates, and rotation angle included in the editing data.
18. A wallpaper processing method, characterized in that: Applied to electronic equipment, the method includes: receiving a first operation from a user; In response to the first operation, displaying the wallpaper selection interface, wherein the wallpaper selection interface includes a plurality of wallpaper images; receiving a second operation of the user on a first wallpaper image among the multiple wallpaper images; In response to the second operation, displaying an editing interface corresponding to the first wallpaper picture, the editing interface including multiple pictures corresponding to the first wallpaper picture; receiving a third operation from the user on at least two pictures of the plurality of pictures; In response to the third operation, displaying the at least two pictures in the editing area of the editing interface; receiving a fourth operation from the user; In response to the fourth operation, recording editing data based on the image content of the at least two images in the editing area, generating multiple videos corresponding to the image content based on the editing data, and exiting the editing interface, wherein each video corresponds to a preset scene information, and the preset scene information at least includes a lock screen interface state and user operation information; When a preset condition is met, a target video corresponding to the current scene information is searched from the multiple videos, and the target video is played on the lock screen interface.
19. The method according to claim 18, characterized in that The electronic device includes a setting module, a dynamic wallpaper service, a theme package configuration service and a multimedia codec module; In response to the fourth operation, recording editing data based on the image contents of the at least two pictures in the editing area, and generating a plurality of videos corresponding to the image contents based on the editing data, comprises: The setting module records the editing data based on the image content formed by the combination of the at least two pictures in the editing area in response to a fourth operation of the user on a preset control in the editing interface; The setting module sends the editing data to the dynamic wallpaper service, where the editing data includes identification information of the at least two pictures; The dynamic wallpaper service reads a target resource package corresponding to the edit data from the theme package configuration service, wherein the target resource package includes a plurality of video compression packages matching the edit data, each video compression package corresponding to a preset scene information; The dynamic wallpaper service sends the multiple video compression packets to the multimedia codec module; The multimedia encoding and decoding module performs video encoding and decoding on each video compression packet respectively to generate multiple video segments corresponding to the image content.
20. The method according to claim 19, characterized in that After the multimedia encoding and decoding module performs video encoding and decoding on each video compression packet to generate multiple video segments corresponding to the image content, the method further includes: The multimedia encoding and decoding module stitches the multiple video segments into an overall video, and records the frame number interval of the video corresponding to each preset scene information in the overall video; The multimedia codec module sends a mapping relationship between a frame number interval and preset scene information to the dynamic wallpaper service; The method of searching for a target video corresponding to the current scene information from the multiple videos when a preset condition is met, and playing the target video on the lock screen interface, includes: When the preset condition is met, the dynamic wallpaper service searches for a target frame number interval corresponding to the current scene information based on a mapping relationship between frame number intervals and preset scene information; The dynamic wallpaper service sends the target frame number interval to the multimedia codec module; The multimedia codec module searches for a target video in the target frame number interval from the overall video, and plays the target video on the lock screen interface.
21. The method according to claim 19 or 20, characterized in that The identification information is the resource type and resource number of the at least two pictures, and the editing data further includes the coordinates and rotation angles of the at least two pictures; The dynamic wallpaper service reads the target resource package corresponding to the edit data from the theme package configuration service, including: The dynamic wallpaper service reads a target resource package that matches the resource type and resource number of the at least two pictures from the theme package configuration service, wherein the target resource package further includes the coordinates and rotation angles of the at least two pictures; The multimedia encoding and decoding module performs video encoding and decoding on each video compression packet to generate multiple video segments corresponding to the image content, including: The multimedia encoding and decoding module is based on the coordinates and rotation angles of the at least two pictures in the editing data. and the coordinates and rotation angles in the target resource package, calculating the coordinate offset and rotation angle offset of each of the at least two pictures; Video encoding and decoding are performed on each video compression packet based on the coordinate offset and the rotation angle offset of the at least two pictures to generate multiple video segments corresponding to the image content.
22. The method according to claim 19 or 20, characterized in that The identification information is the resource type and resource number of the at least two pictures, and the editing data further includes the coordinates and rotation angles of the at least two pictures; The dynamic wallpaper service reads the target resource package corresponding to the edit data from the theme package configuration service, including: The dynamic wallpaper service reads a target resource package from the theme package configuration service that matches the resource type, resource number, coordinates, and rotation angle included in the editing data.
23. The method according to any one of claims 18 to 22, characterized in that When a preset condition is met, searching for a target video corresponding to the current scene information from the multiple videos and playing the target video on the lock screen interface includes: When a touch operation on the lock screen interface is received from the user, a target video corresponding to the current scene information is searched from the multiple videos, and the target video is played on the lock screen interface.
24. The method according to any one of claims 18 to 22, characterized in that When a preset condition is met, searching for a target video corresponding to the current scene information from the multiple videos and playing the target video on the lock screen interface includes: When the electronic device receives the notification message, it searches for a target video corresponding to the current scene information from the multiple videos and plays the target video on the lock screen interface.
25. The method according to claim 24, characterized in that The wallpapers corresponding to the multiple wallpaper images are all dynamic wallpapers in which the growth status of a plant changes over time; the image content of the at least two images is a target plant formed by combining the at least two images; and the preset scene information further includes growth stage information; In a case where the current scene information is the first preset scene information, the target video is a growth video of the target plant at a current growth stage, wherein the lock screen interface state included in the first preset scene information is a state of switching from an off screen to a bright screen, the user operation information included in the first preset scene information is an operation by a user triggering the lock screen interface to brighten the screen, and the growth stage information included in the first preset scene information is the current growth stage of the target plant; When the current scene information is the second preset scene information, the target video is a video of the target plant swaying left and right at the current growth stage, wherein the lock screen interface state included in the second preset scene information is the screen-on state, the user operation information included in the second preset scene information is a fifth operation performed by the user on the lock screen interface, and the growth stage information included in the second preset scene information is the current growth stage of the target plant; When the current scene information is the third preset scene information, the target video is a video of the target plant being watered in the current growth stage, wherein the lock screen interface state included in the third preset scene information is the screen-on state, the user operation information included in the third preset scene information is the user's sixth operation on the lock screen interface, the growth stage information included in the third preset scene information is the current growth stage of the target plant, and one of the fifth operation and the sixth operation is a click operation, and the other is a double-click operation.
26. An electronic device, characterized in that: include: one or more processors and memory; The memory is coupled to the one or more processors, and the memory is used to store computer program code, wherein the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute the method as described in any one of claims 1 to 17, or execute the method as described in any one of claims 18 to 25.
27. A computer-readable storage medium, characterized in that The invention comprises a computer program, which, when running on an electronic device, causes the electronic device to execute the method according to any one of claims 1 to 17, or execute the method according to any one of claims 18 to 25.
28. A computer program product, characterized in that The method comprises a computer program code, which, when executed on an electronic device, causes the electronic device to execute the method according to any one of claims 1 to 17, or to execute the method according to any one of claims 18 to 25.
Citation Information
Patent Citations
Image processing method and image processing device
CN103823678A
Dynamic background display method and apparatus
CN106951247A
Dynamic wallpaper acquisition method and device
CN113114841A
Dynamic image making method, mobile terminal and storage medium
CN113793407A
Linkage animation display method and related device
CN116166349A
Cited By
Interaction method and electronic equipment
CN121578909A