Picture display method and electronic device
By using AI-recommended and dimension-matched image display methods, the problem of low user efficiency in changing lock screen wallpapers is solved, enabling users to quickly select suitable images.
Patent Information
- Application Number
- PCT/CN2024/104702
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-10
- Publication Date
- 2026-01-15
AI Technical Summary
Users have to search for suitable images from a large number of photos when changing their lock screen wallpaper, which is inefficient and time-consuming.
This paper provides an image display method that uses AI recommendation and dimensional matching to display images that match the current lock screen wallpaper in different dimensions, including first-category images and second-category images, thus simplifying the user selection process.
Users can quickly and efficiently select suitable lock screen wallpapers, reducing the time spent searching through a vast number of images and improving the user experience.
Smart Images

Figure CN2024104702_15012026_PF_FP_ABST
Abstract
Description
Image display methods and electronic devices Technical Field
[0001] This application relates to the field of electronic technology, specifically to an image display method and an electronic device. Background Technology
[0002] With the increasing power of electronic devices' camera and storage capabilities, users are storing more and more pictures in their photo albums. Therefore, in some scenarios, the sheer number of pictures in an album can be inconvenient when users need to select an image. For example, when changing the lock screen wallpaper, users often need to switch between multiple albums and search through a large number of photos to find a suitable one, which consumes a lot of time and effort and is inefficient.
[0003] Summary of the Invention
[0004] This application provides an image display method and an electronic device that can simplify user operations and improve user experience.
[0005] In a first aspect, this application provides an image display method executed by an electronic device. The method includes: responding to a first operation by a user on a lock screen interface, displaying a first interface, the first interface including a first preview image and a first control, the first preview image being a preview image of the current lock screen wallpaper of the electronic device; responding to a user's selection operation on the first control, displaying a second interface, the second interface including: a second control corresponding to an AI recommendation method and in a selected state, and a first type of image and a second type of image, the first type of image matching the current lock screen wallpaper in a first dimension, and the second type of image matching the current lock screen wallpaper in a second dimension; responding to a user's selection operation on a target image in the second interface, displaying a third interface, the third interface including a second preview image and the first control, the second preview image being a preview image of the electronic device using the target image as the lock screen wallpaper, the target image being one of the first type of image or the second type of image.
[0006] The first operation can be a two-finger pinch operation, or a long press operation, a swipe operation, etc., and this application embodiment does not specifically limit it. The first interface is also the lock screen wallpaper editing interface, such as the lock screen wallpaper editing interface 701 in Figure 7(a).
[0007] The current lock screen wallpaper is the wallpaper currently being used on the electronic device. The first control is the entry point for changing the lock screen image; for example, the "Change Image" control in this specific implementation. The user's selection of the first control is, for example, by clicking on it.
[0008] The second interface is the lock screen image changing interface, such as the lock screen image changing interface 702 in Figure 7(b). The second control is, for example, the "AI Recommendation" label 70211 in the specific embodiment. Optionally, the second control, the first type of image, and the second type of image can be displayed in the image material panel of the second interface. Of course, the first type of image and the second type of image can also be displayed in a card or pop-up window, and this application embodiment does not specifically limit this.
[0009] Both the first and second types of images belong to the AI-recommended images described in the specific implementation method. AI-recommended images are those corresponding to the second control; that is, the first and second types of images are images recommended based on AI recommendation methods.
[0010] The third interface is the interface after changing the lock screen image in the second interface, such as interface 703 in Figure 7(c).
[0011] In other words, when a user performs a two-finger pinch gesture on the lock screen, the electronic device displays the lock screen wallpaper editing interface. This interface includes a preview of the current lock screen wallpaper. Additionally, the lock screen wallpaper editing interface may include a "Change Image" control. Clicking this control displays a lock screen image changing interface. This interface includes the selected "AI Recommendation" tag, a first category of images, and a second category of images. The first category of images can be selected from the electronic device's image library and match the current lock screen wallpaper in the first dimension. The second category of images can be selected from the electronic device's image library and match the current lock screen wallpaper in the second dimension. The first and second dimensions are different.
[0012] The image display method provided in the first aspect of this application displays a first type of image and a second type of image to the user on the interface after the user clicks the "Change Image" control. The first type of image matches the current lock screen wallpaper in the first dimension, and therefore has similarity to the current lock screen wallpaper in the first dimension. The second type of image matches the current lock screen wallpaper in the second dimension, and therefore has similarity to the current lock screen wallpaper in the second dimension. The first and second types of images respectively meet the user's image selection intent in the first and second dimensions, and are likely the images the user needs. Therefore, based on the second interface, the user can quickly and efficiently select the desired image without having to search through a massive number of images stored on the electronic device or switching between too many albums, greatly saving the user's time, simplifying the user's operation, and improving the user experience.
[0013] In one possible implementation, the second interface also includes N third controls that correspond one-to-one with N other recommendation methods, where N is a positive integer; in response to the user's selection of the target control corresponding to the target recommendation method, a fourth interface is displayed, which includes images recommended based on the target recommendation method, and the target control is one of the N third controls.
[0014] The fourth interface is, for example, interface 801 shown in Figure 8(b) of the specific embodiment. Optionally, the N third controls may include one or more of the following: character controls, landscape controls, animal controls, plant controls, food controls, and art controls. Optionally, the N controls may be displayed in the form of labels.
[0015] For example, when a user selects a person control, the electronic device responds to the user's action by displaying a fourth interface, which includes images stored in the electronic device that are based on person recommendations, i.e., person-related images.
[0016] In this implementation, users can access different types of image display interfaces through various third-party controls, thereby enabling them to select lock screen images by category. This eliminates the need to select from a large number of images of various types, simplifying the process of finding lock screen images and improving the user experience.
[0017] In one possible implementation, the second interface includes a first area and a second area, with the first type of image displayed in the first area and the second type of image displayed in the second area.
[0018] Optionally, the first area and the second area can be areas within an image material panel (also known as the first panel), which can be a panel that pops up or is pulled out from the bottom of the screen.
[0019] In this implementation, displaying the first and second categories of images in separate areas allows users to select images by category, making it easier for them to operate and improving the user experience.
[0020] In one possible implementation, the first dimension includes one or more type dimensions; or, the first dimension includes one or more type dimensions and a color dimension, whereby the type dimension is used to indicate the type of the image or lock screen wallpaper.
[0021] In other words, the first type of image can be the "recommended for you" type of image in the specific implementation. The first type of image matches the current lock screen wallpaper at least in terms of type. In this way, the first type of image conforms to the user's intention to select image type and is easily selected by the user. Including the first type of image in the second interface can improve the user experience.
[0022] One possible implementation includes one or more of the following: people, landscapes, animals, plants, food, and art.
[0023] In one possible implementation, the second dimension includes at least the color dimension.
[0024] In other words, the second type of image can be an image of the same color family as in the specific implementation. The second type of image matches the current lock screen wallpaper at least in the color dimension. Thus, the second type of image aligns with the user's color selection intention and is easily chosen by the user. Including the second type of image in the second interface improves the user experience.
[0025] In one possible implementation, the current lock screen wallpaper is obtained by applying a first lock screen wallpaper template, and the first lock screen wallpaper template supports a depth-of-field effect. The first lock screen wallpaper template is used to define the style of the lock screen wallpaper; the first dimension also includes a depth-of-field effect dimension.
[0026] In other words, if the current lock screen wallpaper uses the first lock screen wallpaper template, and the first lock screen wallpaper template supports a depth-of-field effect, the depth-of-field effect dimension is also considered when selecting the first category of images. That is, the first category of images consists of images that support a depth-of-field effect. Thus, when a user changes the lock screen image in the current lock screen wallpaper to an image from the first category, the resulting lock screen wallpaper will have a depth-of-field effect, improving the display quality of the lock screen wallpaper and thus enhancing the user experience.
[0027] In one possible implementation, the current lock screen wallpaper is obtained by applying a first lock screen wallpaper template, and the sample image in the first lock screen wallpaper template has not been replaced; the first type of image matches the first lock screen wallpaper template in the first dimension, and the second type of image matches the first lock screen wallpaper template in the second dimension.
[0028] The sample image in the first lock screen wallpaper template has not been replaced; that is, the lock screen image in the current lock screen wallpaper is the sample image. In this case, matching based on the first lock screen wallpaper template yields first and second category images that are similar to the first lock screen wallpaper template, matching the user's image selection intent, making them easier for the user to choose, and improving the user experience.
[0029] In one possible implementation, the current lock screen wallpaper is obtained by applying a first lock screen wallpaper template and replacing the sample image in the first lock screen wallpaper template with the current lock screen image; a first type of image matches the current lock screen image in the first dimension, a second type of image matches the first lock screen wallpaper template in the second dimension, and the current lock screen image is the image in the current lock screen wallpaper.
[0030] When the current lock screen wallpaper uses the first lock screen wallpaper template, and the sample image in the first lock screen wallpaper template has been replaced with the current lock screen image, matching is performed based on the current lock screen image, that is, based on the image replaced by the user. The image replaced by the user can, to some extent, represent the user's image selection intent. Therefore, the first and second categories of images obtained through matching based on the user's image replacement match the user's image selection intent, are more likely to be selected by the user, and improve the user experience.
[0031] In one possible implementation, the current lock screen wallpaper does not use a lock screen wallpaper template; a first type of image matches the current lock screen image in a first dimension, a second type of image matches the current lock screen image in a second dimension, and the current lock screen image is an image from the current lock screen wallpaper.
[0032] When no lock screen template is applied to the current lock screen wallpaper, the image in the current lock screen wallpaper (i.e., the lock screen picture) can, to some extent, represent the user's image selection intent. Therefore, matching the lock screen picture to obtain the first and second categories of images aligns with the user's image selection intent, making them more likely to be chosen by the user and improving the user experience.
[0033] In one possible implementation, the first dimension also includes a depth-of-field effect dimension.
[0034] In other words, even when the current lock screen wallpaper doesn't use a template, a depth-of-field effect is also considered; that is, the first type of image supports depth-of-field effects. Thus, when a user replaces the current lock screen image with a first-type image, the resulting lock screen wallpaper will have a depth-of-field effect, improving the display quality and ultimately enhancing the user experience.
[0035] In one possible implementation, the second interface also includes a third type of image, which is matched with the current lock screen image in a third dimension, including the dimension of the person.
[0036] The "People" dimension is used to indicate the people contained in the lock screen wallpaper or image. For example, a third-category image matching the current lock screen image in the third dimension would be: "The third-category image contains the same people as the current lock screen image."
[0037] In other words, the third type of image can be a similar facial image as described in the specific implementation. This third type of image aligns with the user's intention to select a person from the image, making it easier for the user to choose. Therefore, displaying the third type of image on the second interface improves the user experience.
[0038] In one possible implementation, the current lock screen wallpaper does not apply a template, or the current lock screen wallpaper applies a first lock screen wallpaper template and replaces the sample image in the first lock screen wallpaper template with the current lock screen image. In both cases, the second interface also includes a third type of image.
[0039] In one possible implementation, the third dimension also includes the depth-of-field effect dimension.
[0040] In this implementation, when matching images of similar faces, a depth-of-field effect is further considered; that is, the third type of image is one that supports depth-of-field effects. Thus, when a user changes the current lock screen image to a third type of image, the resulting lock screen wallpaper has a depth-of-field effect, making the people in the image stand out, improving the display effect of the lock screen wallpaper, and consequently enhancing the user experience.
[0041] In one possible implementation, the aesthetic scores of the first type of image, the second type of image, and the third type of image are all greater than the preset score threshold.
[0042] Aesthetic ratings characterize the image quality and refinement of a picture. In other words, images in categories one, two, and three are all of high quality and refinement. Therefore, these categories better align with users' preferences for image quality and refinement, making them more likely to be selected and improving the user experience.
[0043] In one possible implementation, the second interface also includes a fourth type of image, which includes images stored in the electronic device with an aesthetic score greater than a preset score threshold, and does not include the first and second types of images.
[0044] The fourth category of images is the selected images in the specific implementation method.
[0045] In this implementation, in addition to the first, second, and third types of images, a fourth type of image is further displayed on the second interface. The fourth type of image not only meets the user's selection intentions regarding image quality and refinement, but also has richer types, colors, or includes more people, providing users with more choices and further improving the user experience.
[0046] In one possible implementation, there are no duplicate images in the first and second categories of images.
[0047] Optionally, before displaying the second interface, duplicate images in categories one, two, three, and four can be deduplicated. Optionally, the deduplication priority can be: category one > category three > category two > category four.
[0048] Deduplicating images across different categories prevents the display of identical images to users, thereby improving image presentation and enhancing user experience.
[0049] In one possible implementation, the first type of images are displayed in ascending order of time difference, where the time difference is the time difference between the time the image was acquired and the current time.
[0050] In other words, images are sorted and displayed according to how close they are to the current time. Images acquired more recently are displayed first, while those acquired further back are displayed last. Images acquired more recently are more likely to be set as lock screen images by the user; therefore, displaying them first better aligns with user intent and improves the user experience.
[0051] In one possible implementation, the second interface further includes a fourth control, and the method further includes: displaying a fifth interface in response to the user's selection of the fourth control, the fifth interface including information from the first album; and displaying the second interface in response to the user's selection of information from the first album.
[0052] The fourth control is, for example, the expand control in the specific implementation, such as the expand control 70202 in Figure 9(a). The fourth control is used to control the expansion and collapse of album information. The fifth interface is, for example, the interface 901 shown in Figure 9(b) in the specific implementation.
[0053] The information for the first album may include the album's name, the album cover, and the number of pictures in the album. The first album can be a curated album, as described in a specific implementation.
[0054] In other words, when a user clicks the expand control on the second interface, the electronic device expands information from one or more photo albums. Optionally, the album information can be displayed in list format. One or more albums include a featured photo album. When the user clicks on the featured photo album, the electronic device returns to the second interface (i.e., the lock screen image changing interface).
[0055] In one possible implementation, the third area is used to display information from the album, with information from the first album displayed at the top of the third area.
[0056] The information from the first album is displayed at the beginning of the third area, that is, the information from the first album is displayed in the first position of the third area, such as the top left corner.
[0057] In this implementation, the information of the featured photo album is displayed at the top of the third area, making it convenient for users to enter the featured photo album and select pictures from it as lock screen images, further saving time and effort and improving user experience.
[0058] In one possible implementation, the method further includes: displaying a sixth interface in response to a user's swiping operation on a first interface, the sixth interface including a third preview image and a fifth control, the third preview image being a preview image of the current desktop wallpaper of the electronic device; displaying a seventh interface in response to a user's selection operation on the fifth control, the seventh interface including information from a first album; and displaying an eighth interface in response to a user's selection operation on information from the first album, the eighth interface including a first type of image and a second type of image.
[0059] A sliding operation is, for example, a left swipe. The sixth interface is the desktop wallpaper editing interface, for example, interface 1110 shown in Figure 11(a) of the specific embodiment. The fifth control is, for example, the "Select Wallpaper" control 1111. The seventh interface is, for example, interface 1120 shown in Figure 11(b) of the specific embodiment. The eighth interface is, for example, interface 1130 shown in Figure 11(c).
[0060] In other words, when users are editing their desktop wallpaper, their electronic devices can display both first-class and second-class images. Based on these images, users can quickly and efficiently select the desired picture without having to search through a vast collection of images stored on their devices or switching between numerous photo albums. This significantly saves users time, simplifies their operation, and improves the user experience.
[0061] In one possible implementation, the method further includes: displaying a first interface in response to a user's selection operation on a sixth control in a ninth interface, wherein the ninth interface is a wallpaper settings interface in the settings application; or, displaying a first interface in response to a user's selection operation on a seventh control in a tenth interface, wherein the tenth interface is an image settings interface in the gallery application.
[0062] The ninth interface is, for example, interface 303 shown in Figure 3(c) in the specific implementation, and the sixth control is, for example, the "wallpaper" setting item 3031.
[0063] The tenth interface is, for example, interface 406 shown in Figure 4-2(b) in the specific implementation, and the seventh control is, for example, the "Set as Lock Screen" operation item 4061 or the "Set Simultaneously" operation item 4062.
[0064] In other words, in this implementation, the first interface can also be accessed through the settings app or the gallery app.
[0065] In one possible implementation, displaying a second interface in response to a user's selection of a first control includes: obtaining information about the current lock screen wallpaper in response to the user's selection of the first control; filtering images that match the current lock screen wallpaper in a first dimension based on the current lock screen wallpaper information to obtain a first type of image; filtering images that match the current lock screen wallpaper in a second dimension based on the current lock screen wallpaper information to obtain a second type of image; and displaying the second interface based on the first type of image and the second type of image.
[0066] In one possible implementation, the information of the current lock screen wallpaper includes a template identifier, which indicates whether the current lock screen wallpaper applies a lock screen wallpaper template. The method further includes: determining whether the current lock screen wallpaper applies a lock screen wallpaper template based on the template identifier; filtering images that match the current lock screen wallpaper in a first dimension based on the information of the current lock screen wallpaper to obtain a first type of image, including: if the current lock screen wallpaper does not apply a lock screen wallpaper template, filtering images that match the current lock screen image in a first dimension based on the attribute information of the current lock screen image to obtain a first type of image, wherein the current lock screen image is an image in the current lock screen wallpaper; if the current lock screen wallpaper applies a first lock screen wallpaper template, determining whether the current lock screen image is a sample image in the first lock screen wallpaper template; if the current lock screen image is a sample image, filtering images that match the first lock screen wallpaper template in a first dimension based on the attribute information of the first lock screen wallpaper template to obtain a first type of image; if the current lock screen image is not a sample image, filtering images that match the current lock screen image in a first dimension based on the attribute information of the current lock screen image to obtain a first type of image.
[0067] In one possible implementation, based on the information of the current lock screen wallpaper, images matching the current lock screen wallpaper in the second dimension are filtered to obtain a second type of images. This includes: if the current lock screen wallpaper does not apply a lock screen wallpaper template, then based on the attribute information of the current lock screen image, images matching the current lock screen image in the second dimension are filtered to obtain a second type of images; if the current lock screen wallpaper applies a first lock screen wallpaper template, then it is determined whether the current lock screen image is a sample image in the first lock screen wallpaper template; if the current lock screen image is a sample image, then based on the attribute information of the first lock screen wallpaper template, images matching the first lock screen wallpaper template in the second dimension are filtered to obtain a second type of images; if the current lock screen image is not a sample image, then based on the attribute information of the current lock screen image, images matching the current lock screen image in the second dimension are filtered to obtain a second type of images.
[0068] In one possible implementation, the method further includes: if the current lock screen wallpaper applies a first lock screen wallpaper template and the current lock screen image is not a sample image, or if the current lock screen wallpaper does not apply a lock screen wallpaper template, then based on the attribute information of the current lock screen image, images that match the current lock screen image in the third dimension are filtered to obtain a third type of image, wherein the third dimension includes at least the person dimension.
[0069] The specific beneficial effects of the above embodiments can be found in the corresponding beneficial effects of the interface, and will not be repeated here.
[0070] Secondly, this application provides an apparatus included in an electronic device, which has the function of implementing the behaviors of the electronic device in the first aspect and possible implementations thereof. The function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the above-described functions. For example, a receiving module or unit, a processing module or unit, etc.
[0071] Thirdly, this application provides an electronic device, which includes: one or more processors, and a memory;
[0072] The memory is coupled to one or more processors, and the memory is used to store computer program code, which includes computer instructions. One or more processors invoke the computer instructions to cause the electronic device to perform any of the methods in the first aspect of the technical solution.
[0073] Fourthly, this application provides a chip system applied to an electronic device. The chip system includes one or more processors, which are used to invoke computer instructions to cause the electronic device to perform the methods in the first aspect and any possible implementation thereof.
[0074] Optionally, the chip system may also include memory, which is connected to the processor via circuitry or wires.
[0075] Alternatively, the chip system may also include a communication interface.
[0076] Fifthly, this application provides a computer-readable storage medium including instructions that, when executed on an electronic device, cause the electronic device to perform any one of the methods in the first aspect of the technical solution.
[0077] Sixthly, this application provides a computer program product, which includes computer program code that, when executed on an electronic device, causes the electronic device to perform any one of the methods in the first aspect of the technical solution. Attached Figure Description
[0078] Figure 1 is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;
[0079] Figure 2 is a software structure block diagram of an example electronic device provided in an embodiment of this application;
[0080] Figure 3 is a schematic diagram of the interface changes during the process of changing the lock screen image according to an embodiment of this application;
[0081] Figure 4-1 is another example of the interface changes shown in the embodiment of this application, illustrating the process of changing the lock screen image entry.
[0082] Figure 4-2 is another example of the interface changes shown in the embodiment of this application, illustrating the process of changing the lock screen image entry.
[0083] Figure 5 is a schematic diagram of interface changes in another example of the process of changing the lock screen image entry provided in the embodiments of this application;
[0084] Figure 6-1 is a schematic diagram of interface changes in another example of the process of changing the lock screen image entry provided in the embodiments of this application;
[0085] Figure 6-2 is a schematic diagram of interface changes in another example of the process of changing the lock screen image entry provided in the embodiment of this application;
[0086] Figure 7 is a schematic diagram of interface changes in an example of an image display method provided in an embodiment of this application;
[0087] Figure 8 is a schematic diagram of interface changes in another example of an image display method provided in an embodiment of this application;
[0088] Figure 9 is a schematic diagram of interface changes in another example of an image display method provided in the embodiments of this application;
[0089] Figure 10 is a schematic diagram of interface changes in another example of an image display method provided in the embodiments of this application;
[0090] Figure 11 is a schematic diagram of interface changes in another example of an image display method provided in this application embodiment;
[0091] Figure 12 is a flowchart illustrating an example of an image display method provided in an embodiment of this application;
[0092] Figure 13 is a schematic diagram of an example lock screen wallpaper template provided in an embodiment of this application;
[0093] Figure 14 is a flowchart illustrating another example of an image display method provided in an embodiment of this application;
[0094] Figure 15 is a flowchart illustrating another example of an image display method provided in an embodiment of this application;
[0095] Figure 16 is a flowchart illustrating another example of an image display method provided in an embodiment of this application;
[0096] Figure 17 is a flowchart illustrating another example of an image display method provided in an embodiment of this application;
[0097] Figure 18 is a flowchart illustrating another example of an image display method provided in an embodiment of this application. Detailed Implementation
[0098] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; "and / or" in this text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.
[0099] Hereinafter, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first," "second," or "third" may explicitly or implicitly include one or more of that feature.
[0100] References to "one embodiment" or "some embodiments" as described in this application specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this application specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.
[0101] To better understand the embodiments of this application, the terms or concepts that may be involved in the embodiments are explained below.
[0102] 1. Wallpapers, Wallpaper Images
[0103] Wallpaper can be understood as the background content of an interface. Different wallpapers result in different effects on the interface. Wallpapers can include, but are not limited to, lock screen wallpapers and desktop wallpapers. Lock screen wallpapers are the background of the lock screen, while desktop wallpapers are the background of the desktop.
[0104] Optionally, a wallpaper may consist of only one image, or it may be a combination of an image and other elements. In this embodiment, for ease of explanation, the image contained in the wallpaper is referred to as a wallpaper image, the image contained in the lock screen wallpaper is referred to as a lock screen image, and the image contained in the desktop wallpaper is referred to as a desktop image.
[0105] 2. Lock screen wallpaper styles
[0106] As mentioned above, a lock screen wallpaper can include a lock screen image and other elements. Different display formats and combinations of the lock screen image and other images result in different display effects, meaning different lock screen wallpaper styles. In other words, the style of a lock screen wallpaper is the combination of the elements that make up the wallpaper and the display formats of each element. Elements that make up a lock screen wallpaper include lock screen images, clock widgets, weather widgets, calendar widgets, and text. The display formats of these elements can include display layers, arrangement, color, size, and font.
[0107] 3. Lock screen wallpaper templates
[0108] A lock screen wallpaper template refers to a pre-designed lock screen wallpaper style provided by an electronic device. Lock screen wallpaper templates offer users a unified and standardized lock screen wallpaper style. Users can choose to use a lock screen wallpaper template or not. If a template is used, the user can edit and set the wallpaper based on it to obtain the desired wallpaper. If a template is not used, the user can directly edit and set the wallpaper based on a single image to obtain the desired wallpaper. Editing and setting based on a lock screen wallpaper template can include changing the images in the template; for example, the user can replace the images originally included in the template with other images. For ease of description, in this embodiment, the images originally included in the lock screen wallpaper template are referred to as sample images.
[0109] The application scenarios of the image display method provided in the embodiments of this application will be described below.
[0110] When using electronic devices, selecting images is a frequent task. When the photo album on an electronic device contains a large number of images, selecting photos can take a significant amount of time and effort, impacting user efficiency and consequently affecting the user experience.
[0111] In view of this, this embodiment provides an image display method that, based on the current lock screen wallpaper, filters images stored in the electronic device that match the current lock screen wallpaper in one or more matching dimensions (also referred to as dimensions), and then displays them. This allows users to quickly and efficiently select images, improving the user experience.
[0112] The image display method provided in this application can be applied to various scenarios that require image selection. Several examples are listed below:
[0113] a. Change the scene of the profile picture.
[0114] It is understood that users can register personal information and upload avatars in certain applications (apps), such as social networking apps, instant messaging apps, audio playback apps, video playback apps, etc. When a user changes their avatar, the electronic device responds to the user's action and can display the image using the method provided in the embodiments of this application.
[0115] b. Scenes for copywriting and accompanying images.
[0116] When a user adds images to text using a social media app or instant messaging app (e.g., when posting a picture on WeChat Moments), the electronic device can display the image in response to the user's image selection, using the method provided in the embodiments of this application.
[0117] c. Scenes for changing wallpaper images.
[0118] When a user performs an operation to change the lock screen image or the desktop image, the electronic device responds to the user's operation and can display the image using the method provided in the embodiments of this application.
[0119] It should be noted that the image display method provided in this application embodiment can also be applied in other scenarios, and is not limited to the above-mentioned ones.
[0120] To facilitate understanding, before specifically describing the image display method provided in the embodiments of this application, the structure of the electronic device to which the method provided in the embodiments of this application is applicable will first be described.
[0121] The image display method provided in this application can be applied to electronic devices that can install applications (APPs), such as mobile phones, tablets, wearable devices, in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPCs), netbooks, and personal digital assistants (PDAs). This application does not impose any restrictions on the specific type of electronic device.
[0122] For example, Figure 1 is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of this application. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0123] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0124] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0125] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.
[0126] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0127] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0128] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.
[0129] Optionally, the electronic device 100 can filter and match images through the AP, and display the filtered images in conjunction with the AP, GPU and display screen 194.
[0130] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses the layered architecture Android system as an example to exemplify the software structure of electronic device 100.
[0131] Figure 2 is a software structure block diagram of an electronic device 100 according to an embodiment of this application. The layered architecture divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer. The application layer may include a series of application packages.
[0132] As shown in Figure 2, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, settings, music, and video.
[0133] In addition, in this embodiment, the application layer may further include a lock screen app. The lock screen app is used to implement the image display method provided in this embodiment. Of course, in other embodiments, the image display method may be implemented by other applications or modules in conjunction with the lock screen app. For example, the method may also be implemented by a gallery app and the lock screen app in conjunction, and this application does not limit this.
[0134] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0135] As shown in Figure 2, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
[0136] The Android runtime consists of core libraries and a virtual machine. The Android runtime is responsible for scheduling and managing the Android system.
[0137] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.
[0138] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.
[0139] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.
[0140] The following embodiments of this application will take an electronic device with the structure shown in Figures 1 and 2 as an example, and take the scenario of changing the lock screen image as an example, and in conjunction with the accompanying drawings, specifically describe the image display method provided by the embodiments of this application.
[0141] First, let's explain how to change the lock screen image.
[0142] It is understood that the lock screen wallpapers provided by electronic devices can include various types, including but not limited to template-based lock screen wallpapers, official lock screen wallpapers, and landscape lock screen wallpapers, as shown in the embodiment corresponding to Figure 10 below. For some types of lock screen wallpapers (e.g., lock screen wallpaper templates), the electronic device supports changing the lock screen image. When these types of lock screen wallpapers are selected by the user, the electronic device can provide an entry point for changing the lock screen image, allowing the user to change the image in the selected lock screen wallpaper (i.e., change the lock screen image). For other preset types of lock screen wallpapers, such as official lock screen wallpapers and landscape lock screen wallpapers, the electronic device does not support changing the lock screen image; that is, the images in these preset types of lock screen wallpapers cannot be changed. When these preset types of lock screen wallpapers are selected, the electronic device may not provide an entry point for changing the lock screen image. The following embodiments mainly describe lock screen wallpapers that support changing the lock screen image.
[0143] It should be noted that, in the embodiments of this application, the selection of a lock screen wallpaper can include two situations: 1) the lock screen wallpaper is applied, that is, the lock screen wallpaper currently used by the electronic device (hereinafter referred to as the current lock screen wallpaper) is the lock screen wallpaper; 2) during the process of selecting a lock screen wallpaper, the lock screen wallpaper is selected by the user, but is not applied.
[0144] As one possible implementation, if the selected lock screen wallpaper supports changing the lock screen image, the electronic device can provide an entry point for changing the lock screen image in the lock screen wallpaper editing interface (or lock screen wallpaper settings interface, first interface, etc.). This entry point can be, for example, a "Change Image" control (also known as the first control). When the user performs a selection operation (e.g., click) on the "Change Image" control, they can enter the lock screen image changing scene and display the lock screen image changing interface.
[0145] Optionally, electronic devices can provide multiple entry points to the lock screen wallpaper editing interface. That is, there are various ways to access the lock screen wallpaper editing interface, thus providing an option to change the lock screen image. The following examples illustrate several ways to access the lock screen wallpaper editing interface to more clearly explain how to present the option to change the lock screen image.
[0146] Method 1: Enter the lock screen wallpaper editing interface through the wallpaper settings entry 1 in the settings app, which will then present the entry point for changing the lock screen image.
[0147] Optionally, the electronic device can provide a wallpaper setting entry 1 in the settings app. Through this wallpaper setting entry 1, one can enter the lock screen wallpaper editing interface. If the selected lock screen wallpaper supports changing the lock screen image, the lock screen wallpaper editing interface can include an entry point for changing the lock screen image.
[0148] For example, Figure 3 is a schematic diagram of the interface changes during the process of changing the lock screen image provided in an embodiment of this application. Taking a mobile phone as an example, as shown in Figure 3(a), the desktop 301 of the mobile phone includes an icon 3011 for the settings app. In response to the user's selection operation (e.g., click operation) of the icon 3011 for the settings app, the mobile phone displays the settings interface 302 shown in Figure 3(b). The settings interface 302 includes multiple settings items for the mobile phone, such as Bluetooth, WLAN, personal hotspot, etc. The multiple settings items also include a "Desktop and Personalization" setting item 3021. In response to the user's selection operation (e.g., click operation) of the "Desktop and Personalization" setting item 3021, the mobile phone can display interface 303 (also known as the ninth interface), as shown in Figure 3(c). Interface 303 includes multiple personalization settings items such as a "Wallpaper" setting item 3031 (also known as the sixth control), a "Font" setting item, and an "Icon" setting item. Among them, the "Wallpaper" setting item 3031 is the wallpaper setting entry 1. Optionally, the "Wallpaper" setting 3031 can be presented in the form of cards, which can rotate between preview images of the phone's lock screen and desktop. For example, the "Wallpaper" setting 3031 in interface 303 may currently display a preview image 3032 of the lock screen, which can show the effect of the current lock screen wallpaper. When preview image 3032 is displayed in the "Wallpaper" setting 3031, in response to the user's selection operation (e.g., click operation) on the "Wallpaper" setting 3031, the phone displays the lock screen wallpaper editing interface 304 as shown in Figure 3(d). The lock screen wallpaper editing interface 304 includes a preview image 3041 of the lock screen, which is used to show the effect of the lock screen wallpaper. When the lock screen wallpaper corresponding to preview image 3041 supports changing the lock screen image, preview image 3041 includes a "Change Image" control 3042. The "Change Image" control 3042 is the entry point for changing the lock screen image. Clicking the "Change Image" control 3042 will take you to the lock screen image changing interface, as shown in the embodiment in Figure 7 below.
[0149] Additionally, when the preview image 3032 of the lock screen wallpaper in the "Wallpaper" setting item 3031 in interface 303 reaches the preset display duration, or in response to the user's swiping operation (such as a left swipe) on the "Wallpaper" setting item 3031 in interface 303, the phone can display interface 305, as shown in Figure 3(e). The difference between interface 305 and interface 303 is that the "Wallpaper" setting item 3031 in interface 305 displays a desktop preview image 3051, which can show the effect of the current desktop wallpaper. When the phone displays interface 305, the user can wait for the preset duration, or perform a swiping operation (such as a right swipe) on the "Wallpaper" setting item 3031, causing the phone to display interface 303 again. Then, the user can select the "Wallpaper" setting item 3031 in interface 303 to enter the lock screen wallpaper editing interface 304, and trigger the change of the lock screen image through the "Change Image" control 3042 in the lock screen wallpaper editing interface 304.
[0150] Optionally, users can first enter the desktop wallpaper editing interface (also known as the sixth interface) through the wallpaper settings entry 1, and then switch from the desktop wallpaper editing interface to the lock screen wallpaper editing interface 304, thus presenting the lock screen image change entry. Please refer to Figure 3. When the phone displays interface 305 as shown in Figure 3(e), i.e., the "wallpaper" settings item 3031 displays a desktop preview image 3051 (also known as the third preview interface), in response to the user's selection operation of the "wallpaper" settings item 3031 in interface 305, the phone displays the desktop wallpaper editing interface 306, as shown in Figure 3(f). The user can switch the interface to the lock screen wallpaper editing interface 304 as shown in Figure 3(d) by swiping (e.g., swiping right), thus presenting the "Change Image" control 3042. It should be noted that the arrows in Figure 3(f) are only used to illustrate the direction of the swiping operation and are not part of the interface content.
[0151] Figure 3 above illustrates several ways to access the lock screen image change option from the Settings app. It should be noted that the wallpaper image change option shown in Figure 3 is merely illustrative and not a limitation in practice. For example, the phone can provide a separate lock screen wallpaper setting option in the settings interface, such as interface 302. In response to the user's selection of this option, the phone can directly display the lock screen wallpaper editing interface, where the lock screen image change option is presented.
[0152] Method 2: Access the lock screen wallpaper editing interface through the wallpaper settings entry 2 in the Gallery app, which will then present the entry point for changing the lock screen image.
[0153] Optionally, the electronic device can provide a wallpaper setting entry 2 in the operation items of each picture in the gallery APP. Through this wallpaper setting entry 2, one can enter the lock screen wallpaper editing interface. If the selected lock screen wallpaper supports changing the lock screen image, the lock screen wallpaper editing interface can include an entry for changing the lock screen image.
[0154] For example, Figures 4-1 and 4-2 are schematic diagrams illustrating interface changes during the lock screen image changing process, as provided in another embodiment of this application. As shown in Figure 4-1(a), the phone's desktop 401 includes an icon 4011 for a gallery app. In response to a user's selection operation (e.g., a click operation) of the gallery app icon 4011, the phone displays a photo interface 402 as shown in Figure 4-1(b). The photo interface 402 includes thumbnails of multiple images, such as thumbnail 4021, thumbnail 4022, etc. In response to a user's click operation on thumbnail 4021, the phone can display interface 403, as shown in Figure 4-1(c).
[0155] Interface 403 includes a large image 4031 corresponding to the thumbnail 4021. Interface 403 also includes multiple operation items for the image, such as "Share," "Edit," "Save," "Copy," and "More" operation items 4032. In response to a user's trigger operation (such as a click) on the "More" operation item 4032 in interface 403, the phone can display interface 404, as shown in Figure 4-1 (d). Interface 404 differs from interface 403 in that it also includes operation items that cannot all be displayed in interface 403, such as "Add to Album," "Favorite," and "Set as" operation item 4041.
[0156] In response to the user's selection of the "Set as" operation item 4041, the phone can display interface 405, as shown in Figure 4-2(a). Interface 405 includes the "Wallpaper" operation item 4051, the "Partial Screen Off Display" operation item, and the "Contact Photos" operation item, etc. Among them, the "Wallpaper" operation item 4051 is the wallpaper setting entry 2. In response to the user's selection of the "Wallpaper" operation item 4051, the phone can display interface 406, as shown in Figure 4-2(b). Interface 406 includes the "Set as Lock Screen" operation item 4061 (also known as the seventh control), the "Set as Desktop" operation item, and the "Set Simultaneously" operation item 4062 (also known as the seventh control), etc.
[0157] In response to the user's selection of either the "Set as Lock Screen" operation 4061 or the "Set Simultaneously" operation 4062, the phone can set image 4031 as the phone's lock screen wallpaper. Afterwards, the phone can display interface 407, as shown in Figure 4-2(c). Interface 407 is the lock screen wallpaper editing interface. Interface 407 includes a "Change Image" control 4071, which serves as the entry point for changing the lock screen image. Clicking the "Change Image" control 4071 will take you to the lock screen image changing interface; see the embodiment corresponding to Figure 7 for details.
[0158] It should be noted that the wallpaper settings entry 2 in the gallery application shown in Figures 4-1 and 4-2 above is only an example and is not limited to this in practice.
[0159] Method 3: Enter the lock screen wallpaper editing interface through a preset gesture (also known as the first operation), and then present the entry point for changing the lock screen image.
[0160] Optionally, users can perform preset gestures on the lock screen. The electronic device responds to these gestures by displaying a lock screen wallpaper editing interface. If the selected lock screen wallpaper supports changing the lock screen image, the editing interface can include an entry point for changing the lock screen image. The preset gesture can be a long press, a swipe, a pinch-to-zoom, etc., and this application does not specifically limit its type. The following explanation uses a pinch-to-zoom gesture as an example.
[0161] It is understood that electronic devices can include a screen-off state and a screen-on state, depending on the screen display status. In the screen-on state, the electronic device can display a lock screen interface or the interface corresponding to the currently executed task. For ease of explanation, in this embodiment, the interface corresponding to the currently executed task of the electronic device is referred to as the user interface. The user interface can include the home screen interface (i.e., desktop), application interfaces, notification bar interfaces, etc.
[0162] In addition, users can set a screen lock for their electronic devices, or they can choose not to set one. Screen locks can include password locks, biometric locks, etc. Password locks can include pattern locks or numeric locks. Biometric locks can include face locks (also known as facial recognition locks) or fingerprint locks. If a user sets one or more screen locks, they need to perform at least one unlocking operation on the lock screen before accessing the user interface. For example, if a user sets a password lock, face lock, and fingerprint lock, they need to enter a password, perform face recognition, or perform fingerprint recognition on the lock screen. If the password is correct, or face recognition or fingerprint recognition is successful, the screen lock is unlocked, and the electronic device can then display the user interface. It should be noted that when a user unlocks the screen using face recognition, after successful face recognition, the electronic device can directly access the user interface, or it can remain on the lock screen and require the user to swipe to access the user interface. Users can configure this in the settings application according to their needs.
[0163] In this embodiment, depending on whether the electronic device has a screen lock and the type of screen lock, the lock screen interface is different, and the interface changes during the process of entering the lock screen wallpaper editing interface through preset gestures are also different, which will be described separately below.
[0164] a. Screen lock is not set.
[0165] When an electronic device does not have any screen lock set, users can directly access the lock screen wallpaper editing interface by pinching two fingers together.
[0166] For example, Figure 5 is a schematic diagram of interface changes during the process of changing the lock screen image, as provided in another embodiment of this application. Figure 5(a) shows the lock screen interface 501 when the phone is not locked. In response to a user's two-finger pinch operation on the lock screen interface 501, the phone can display the lock screen wallpaper editing interface 502, as shown in Figure 5(b). The lock screen wallpaper editing interface 502 includes a "Change Image" control 5021, which serves as the entry point for changing the lock screen image. Clicking the "Change Image" control 5021 allows entry into the lock screen image changing interface. It should be noted that the arrows in Figure 5(a) are only used to illustrate the direction of the pinch operation and are not part of the interface content.
[0167] b. A screen lock is set, and the screen lock is not unlocked when performing a two-finger pinch operation.
[0168] When an electronic device has one or more screen locks set, and the user has not unlocked the screen using any unlocking method, if the user performs a two-finger pinch gesture on the lock screen, the electronic device responds to the user's action and displays the unlock screen, which is used by the user to perform the unlocking operation. After the user performs the unlocking operation on the unlock screen, the electronic device enters the lock screen wallpaper editing interface. The following explanation uses a phone that has simultaneously set a numeric password lock, face lock, and fingerprint lock as an example.
[0169] Please refer to Figure 6-1. When the phone screen is off, in response to the user pressing the power button, the phone enters the lock screen interface. After entering the lock screen interface, the phone automatically performs face recognition. If face recognition fails, the lock screen interface 601 shown in Figure 6-1(a) is displayed. The lock screen interface 601 includes a lock screen wallpaper, a face recognition failure message 6011, a lock icon 6012, and a fingerprint icon 6013. In other words, the lock screen interface 601 differs from the lock screen interface 501 in Figure 5 in that it includes the face recognition failure message 6011, the lock icon 6012, and the fingerprint icon 6013. That is, the lock screen interface 601 is the lock screen interface when a screen lock is set.
[0170] If the user has not yet unlocked the device using any of the methods—face recognition, fingerprint unlock, or password unlock—and the electronic device remains locked, the device unlocks in response to the user's two-finger pinch gesture on the lock screen 601, displaying the unlock screen 602, as shown in Figure 6-1(b). Specifically, the phone automatically performs face recognition, and the unlock screen 602 includes a "Recognizing Face" message 6021, a decryption area 6022, and a fingerprint icon 6023.
[0171] If face recognition is successful, the phone displays the lock screen wallpaper editing interface 603, as shown in Figure 6-1(c). The lock screen wallpaper editing interface 603 includes a "Change Picture" control 6031.
[0172] If facial recognition fails, the phone displays the unlock screen 604, as shown in Figure 6-1(d). The unlock screen 604 includes a facial recognition failure message 6041, a decryption area 6042, and a fingerprint icon 6043.
[0173] Optionally, the user can trigger face unlock again from the unlock screen 604 to enter the lock screen wallpaper editing interface. Specifically, in response to the user's double-tap operation, the phone displays interface 602 as shown in Figure 6-1(b). Afterwards, the electronic device performs face recognition again. If face recognition is successful, the lock screen wallpaper editing interface 603 as shown in Figure 6-1(c) is displayed. For details, please refer to the above process, which will not be repeated here.
[0174] Optionally, users can also unlock the screen using a password in the unlock screen 604 to access the lock screen wallpaper editing interface. Specifically, in response to the user entering the correct password in the decryption area 6042, the phone displays the lock screen wallpaper editing interface 603 as shown in Figure 6-1(c).
[0175] Optionally, users can also unlock the phone using their fingerprint on the unlock screen 604 to access the lock screen wallpaper editing interface. In response to the user pressing the correct fingerprint at the fingerprint icon 6043, the phone displays the lock screen wallpaper editing interface 603 as shown in Figure 6-1(c).
[0176] c. A face lock has been set, and the screen lock has been unlocked by face recognition when performing a two-finger pinch operation.
[0177] This scenario includes two situations:
[0178] 1) The electronic device is equipped with one or more screen locks, including face lock, and the user can directly enter the user interface after successful face recognition.
[0179] In this situation, in response to the user pressing the power button, the phone enters the lock screen. Once on the lock screen, the phone automatically performs facial recognition. If facial recognition is successful, the user is directly taken to the user interface.
[0180] 2) The electronic device is equipped with one or more screen locks, including face lock, and the user has set the screen to remain on the lock screen after successful face recognition.
[0181] In this situation, in response to the user pressing the power button, the phone enters the lock screen. Once on the lock screen, the phone automatically performs facial recognition. If facial recognition is successful, it enters the lock screen display. The lock screen display can be understood as the screen after unlocking. When the user performs a two-finger pinch gesture on the lock screen display, the electronic device responds and enters the lock screen wallpaper editing interface. The following explanation continues using an example where the phone has simultaneously set a numeric password lock, facial recognition lock, and fingerprint lock.
[0182] Please refer to Figure 6-2. When the phone screen is off, in response to the user pressing the power button, the phone enters the lock screen interface 605 and automatically performs face recognition. The lock screen interface 605 displays the lock screen wallpaper, a lock icon 6051, and a "Recognizing face" message 6052. If face recognition fails, the phone enters the interface 601 shown in Figure 6-1(a), which will not be described further. If face recognition is successful, the lock screen pause interface 606 shown in Figure 6-2(b) is displayed. The lock screen pause interface 606 includes an unlock icon 6061 and a "Swipe up to enter" message 6062, etc.
[0183] In response to the user performing a two-finger pinch operation on the lock screen stay interface 606, the phone enters the lock screen wallpaper editing interface 607 as shown in Figure 6-2(c).
[0184] In response to the user performing an upward swipe operation on the lock screen interface 606, the phone enters the desktop 608 as shown in Figure 6-2(d).
[0185] In addition, if the user performs a fingerprint unlock operation on the lock screen interface 605 and the fingerprint unlock is successful, the phone will also enter the desktop 608 shown in Figure 6-2(d).
[0186] It should be noted that the above method of presenting the lock screen image change entry is only an example. In actual applications, the lock screen image change entry can also be presented in other interfaces or in other display formats, and there are no limitations on this.
[0187] The above embodiments provide multiple ways to present the lock screen image changing entry, making it easier and more flexible for users to access the lock screen image changing interface and improving user experience.
[0188] The following explains how to display images during the process of changing the lock screen picture.
[0189] For example, Figure 7 is a schematic diagram of interface changes in an image display method provided in an embodiment of this application. Continuing with the example of a mobile phone as an electronic device, as shown in Figure 7(a), the mobile phone screen displays a lock screen wallpaper editing interface 701. The lock screen wallpaper editing interface 701 is similar to the lock screen wallpaper editing interface in the above embodiment, including a preview image 7011 of the current lock screen wallpaper and a "Change Picture" control 7012. The preview image 7011 includes a clock component 70111 and a lock screen image 70112, etc. The lock screen image 70112 includes a person 70113.
[0190] In response to a user's selection (e.g., click) of the "Change Picture" control 7012, the phone can display a lock screen picture changing interface 702 (also known as a second interface), as shown in Figure 7(b). The lock screen picture changing interface 702 includes an image resource panel 7021. Optionally, the image resource panel 7021 can be a view component that pops up from the bottom of the screen and overlays the lock screen wallpaper editing interface 701. The image resource panel 7021 is used to display images, album materials, etc. The images displayed in the image resource panel 7021 can be changed to the lock screen picture.
[0191] As shown in Figure 7(b), in response to the user's selection operation on the "Change Picture" control 7012, the electronic device displays pictures from the Featured Photo Album in the Picture Material Panel 7021 by default. At this time, the Picture Material Panel 7021 displays the title "Featured Photos" 70201, indicating that the currently displayed pictures are from the Featured Photo Album. Optionally, the Featured Photo Album is a collection of pictures that meet preset conditions and are filtered by the electronic device based on the pictures stored in the electronic device. Preset conditions may include: the aesthetic score of the picture is greater than a preset score threshold, the picture contains people, etc. Optionally, the Featured Photo Album can be a virtual album, that is, the Gallery APP does not actually contain the Featured Photo Album, and the pictures in the Featured Photo Album are only used for display in scenarios such as wallpaper editing for users to select.
[0192] Additionally, the image resource panel 7021 may also display an expansion control 70202 (also known as the fourth control). The expansion control 70202 is used to control the expansion and collapse of album information. When the album information is in the expanded state, the image resource panel 7021 can display the information of each album in the gallery app in a list format, as shown in Figure 9 of the subsequent embodiments.
[0193] In this embodiment, after the user clicks the "Change Picture" control 7012, the album information in the image material panel 7021 is in a collapsed state by default, as shown in Figure 7(b). When the album information is in a collapsed state, the image material panel 7021 can display tags corresponding to the types of pictures contained in the featured photo album. For example, if the featured photo album contains six types of pictures: portraits, landscapes, animals, plants, food, and art, the image material panel 7021 will have tags such as "AI Recommendation" 70211, "Portrait" 70212, "Landscape" 70212, "Animal" 70212, "Plant" 70212, "Food" 70212, and "Art" 70212. Each tag corresponds to a type of picture in the featured photo album. For example, the "Portrait" tag 70212 corresponds to portrait pictures, which are pictures that include people; another example is the "Landscape" tag, which corresponds to landscape pictures, which are pictures whose content is scenery.
[0194] When a tag is selected, the image resource panel 7021 displays images of the category corresponding to that tag. For example, when the "Landscape" tag is selected, the image resource panel 7021 displays landscape images, and when the "Animal" tag is selected, the image resource panel 7021 displays animal images.
[0195] Optionally, each label can be displayed stickily at the top of the image panel 7021, meaning its vertical position is fixed. Specifically, the labels' vertical position and visibility remain unchanged regardless of user swiping up or down. This allows users to easily view all labels, facilitating the selection of different image types and improving the user experience.
[0196] The following explanation will primarily use the "AI Recommendation" tag 70211 and the "Portrait" tag 70212 as examples.
[0197] The "AI Recommendation" tag 70211 corresponds to AI-recommended images. AI-recommended images are selected from images stored on electronic devices based on artificial intelligence (AI) technology. These images match the current lock screen wallpaper in one or more matching dimensions. In other words, AI-recommended images are similar to the current lock screen wallpaper; therefore, they align with the user's desired lock screen image and are more likely to be selected. Displaying AI-recommended images in the image material panel 7021 improves the user experience. Optionally, matching dimensions may include aesthetic rating, style, type, included people (referred to as "people dimension"), color, or depth-of-field effect dimensions, etc.
[0198] Optionally, depending on the matching dimensions, matching conditions, etc., the AI-recommended images can include various types, such as: images recommended for you (also known as best-match images or first-class images), images with similar faces (also known as third-class images), images with the same color scheme (also known as second-class images), and selected images (also known as fourth-class images).
[0199] Among them, the images recommended for you meet preset matching conditions with the current lock screen wallpaper in terms of type and other matching dimensions. Images recommended for you can be understood as images that are similar to the current lock screen wallpaper in terms of type, etc. These types of images tend to match users' image selection habits and are more likely to be chosen by users. Therefore, displaying images recommended for you in the image material panel 7021 can improve the user experience.
[0200] Images featuring similar faces to the same people featured in the current lock screen wallpaper are more likely to be selected by users as they better match their preferences for the people in the image. Therefore, displaying images with similar faces in the image resource panel 7021 can improve the user experience.
[0201] Images in the same color family as the current lock screen wallpaper meet preset color family conditions in dimensions such as color. Images in the same color family can be understood as images whose color family is similar to the current lock screen wallpaper. This type of image is more in line with the user's color selection intention and is more likely to be selected by the user. Therefore, displaying images in the same color family in the image material panel 7021 can improve the user experience. It should be noted that in this embodiment, pattern filling is used as an example to represent the color of the image. If two images have the same filling pattern, it means that the two images have the same color.
[0202] Featured images have aesthetic scores higher than a preset score threshold. Aesthetic scores characterize an image's image quality and refinement. Featured images can be understood as images of high quality and refinement; these images align with users' selection criteria regarding image quality and refinement, making them more likely to be chosen. Therefore, displaying featured images in the image resource panel 7021 enhances the user experience.
[0203] Optionally, when displaying AI-recommended images, they can be displayed in different areas according to the above types, as further explained below with reference to the attached diagram.
[0204] Specifically, when the album information is collapsed, and the content displayed in the image material panel 7021 is switched to the Featured Photos album, the "AI Recommendation" label 70211 is selected by default, as shown in Figure 7(b). The "AI Recommendation" label 70211 is highlighted to indicate that it is selected. When the "AI Recommendation" label 70211 is selected, the image material panel 7021 may include the "Recommended for You" image area 7022, the "Similar Faces" image area 7023, the "Same Color Scheme" image area 7024, and the "Featured" image area 7025.
[0205] It should be noted that in some other embodiments, when the content displayed in the image material panel 7021 is switched to the featured photo album, the "AI Recommendation" tag 70211 may not be selected by default, but other tags may be selected by default, such as the "Portrait" tag 70212, etc. This application embodiment does not make specific limitations on this.
[0206] The "Recommended for You" image area 7022 is used to display recommended images. Optionally, the number of recommended images displayed in the "Recommended for You" image area 7022 can be set to a maximum, for example, a maximum of 8 images can be displayed.
[0207] The "Similar Faces" image area 7023 is used to display images of similar faces. Optionally, the number of similar face images displayed in the "Similar Faces" image area 7023 can be set to a maximum, for example, a maximum of 8 images can be displayed.
[0208] The "same color scheme" image area 7024 is used to display images of the same color scheme. Optionally, the number of images of the same color scheme displayed in the "same color scheme" image area 7024 can be set to an upper limit, for example, a maximum of 8 images can be displayed.
[0209] The "Featured" image area 7025 is used for featured images. Optionally, the number of featured images displayed in the "Featured" image area 7025 can be set to a maximum, for example, a maximum of 200 images can be displayed.
[0210] Optionally, in some embodiments, the aesthetic scores of the images displayed in the "Recommended for You" image area 7022, the "Similar Faces" image area 7023, and the "Same Color Scheme" image area 7024 are all greater than the preset score threshold. In this way, higher quality images are provided to the user as candidate lock screen images, thereby improving the user experience.
[0211] Optionally, the images in each image area can be displayed in a preset order. For example, they can be sorted and displayed according to their proximity in time to the current time. The acquisition time refers to the moment the electronic device acquires the image. For images captured by the electronic device, the acquisition time is the time the electronic device generates the image. For images downloaded from the network, the acquisition time is the time the electronic device downloads the image. In a specific embodiment, images whose acquisition time is closer to the current time are displayed first, and images whose acquisition time is farther from the current time are displayed last. Images whose acquisition time is closer to the current time are more likely to be set as lock screen images by the user; therefore, displaying these images first better aligns with user intent and improves user experience.
[0212] Optionally, if the current lock screen wallpaper supports a depth-of-field effect, the sorting method for the featured images in the "Featured" image area 7025 can also be: the first M images displayed are those that support a depth-of-field effect, where M is an integer and is less than the maximum number of featured images, for example, M is 8.
[0213] The lock screen wallpaper supports a depth-of-field effect, meaning the style of the lock screen wallpaper can present a depth-of-field effect. Specifically, the lock screen wallpaper includes a foreground image and a background image. The background image is located below other elements such as the clock component, and the foreground image is located above at least one other element (such as the clock component), creating a prominent display effect for the foreground image. The foreground image can include a subject. The subject can include people, animals, plants, buildings, mountains, etc. For example, the preview image 7011 of the lock screen wallpaper shown in Figure 7(a) includes a clock component 70111 and a lock screen image 70112. The lock screen image 70112 includes a foreground image and a background image. The foreground image includes a person 70113, and the background image can be a white image (not shown in the figure). The background image is displayed below the clock component 70111, and the foreground image containing the person 70113 is displayed above the clock component 70111, thus making the person 70113 stand out. This lock screen wallpaper supports a depth-of-field effect. Images that support depth-of-field effects can be understood as those containing a preset type of subject, whose position within the image meets preset requirements, and which support recomposition (the subject can be cut out). Preset types of subjects include people and animals. When an image supporting depth-of-field effects is set as a lock screen wallpaper that supports depth-of-field effects, the depth-of-field effect will be displayed.
[0214] Optionally, when duplicate images of different types are obtained from multiple dimensions of filtering, deduplication can be performed before displaying the images. In other words, the images displayed in different image areas should not be duplicated. For example, if image 1 is included in both the "Recommended for You" and "Similarity" categories, deduplication can be performed so that image 1 is displayed in only one image area. Optionally, the priority for deduplication can be: "Recommended for You" images > "Similar Faces" images > "Same Color Scheme" images > "Featured" images. That is, when a filtered image is duplicated in multiple categories, it is given priority as a "Recommended for You" image, then as a "Similar Faces" image, then as a "Same Color Scheme" image, and finally as a "Featured" image.
[0215] It's understandable that the number of images of a certain category obtained from filtering based on multiple dimensions may be greater than or equal to the upper limit of the corresponding image area, or it may be less than that upper limit. When the number of images of a certain category is less than the upper limit of the corresponding image area, and there are empty spaces in the corresponding image area, images of other categories can be displayed in turn to fill the empty spaces. For example, as shown in Figure 7(b), the upper limit of the "Recommended for You" image area 7022 is 8 images, and 4 images are displayed in each row of this area. If the number of "Recommended for You" images is 4, the "Recommended for You" images occupy one row in the "Recommended for You" image area 7022, leaving one row empty. Therefore, the "Similar Faces" image area 7023, the "Same Color Scheme" image area 7024, and the "Featured" image area 7025 below are displayed in turn to fill the empty spaces. In other words, the display position and size of the above image areas in the interface are not fixed and can be adjusted according to the number of images.
[0216] Additionally, it's understandable that the number of images that can be displayed on a single page is limited by page height and width. When a page cannot display all photos in all image areas, the electronic device can display multiple images in response to a user's preset action. Preset actions include, for example, swiping up, swiping left, or swiping right.
[0217] As shown in Figure 7(c), the following explanation uses the first image 70221 selected by the user in the "Recommended for You" image area 7022 as an example. In response to the user's selection, the electronic device replaces the current lock screen wallpaper with the selected image 70221, displaying interface 703. Interface 703 includes a preview image 7031 of the changed lock screen wallpaper. Unlike Figure 7(a), the person in the lock screen image in the preview image 7031 has been replaced with a person 70311. Furthermore, it can be seen that the changed lock screen wallpaper still exhibits a depth-of-field effect.
[0218] The specific principles and processes for generating AI-recommended images based on images stored in electronic devices will be explained in subsequent embodiments.
[0219] In this embodiment, when a user needs to change their lock screen image, multiple categories of AI-recommended images are displayed on the interface. These AI-recommended images are selected from the images stored on the electronic device that match the current lock screen wallpaper in one or more matching dimensions. Therefore, the AI-recommended images are similar to the current lock screen wallpaper and align with the user's desired lock screen image selection, making them highly likely to be the images the user needs. This eliminates the need for users to search through a vast number of images stored on their electronic devices or switch between numerous photo albums, significantly saving time, simplifying operations, and improving the user experience.
[0220] The following is an explanation of the "Portrait" tag 70212.
[0221] Please refer to Figure 8. As shown in Figure 8(a), the user can select the "Portrait" label 70212 in interface 702, and the phone displays interface 801 (also known as the fourth interface) as shown in Figure 8(b). In interface 801, the "AI Recommendation" label 70211 is de-highlighted, while the "Portrait" label 70212 is highlighted, indicating that the "Portrait" label 70212 is selected. Interface 801 includes a clustering entry 8011 for "All Portraits" and clustering entries for various types of portraits. The clustering entries for various types of portraits can include a "Father" portrait clustering entry 8012, a "Mother" portrait clustering entry, a "Baby" portrait clustering entry, a "Sister" portrait clustering entry, and other unnamed portrait clustering entries. Each type of portrait clustering entry can display a thumbnail of a portrait corresponding to that type of portrait. For example, the "Father" portrait clustering entry 8012 can display a thumbnail of a father's portrait selected by the electronic device.
[0222] Additionally, each cluster entry can display a corresponding title below it, which may show the name of the person added by the user for that type of portrait. For example, the title below the portrait cluster entry 8012 for "Dad" may display the name "Dad" pre-added by the user 8013. Optionally, for portrait cluster entries where the user has not added a name, the title may display "Add Name" 8014. Users can click "Add Name" 8014 to add a name to that type of portrait. Of course, users can also click on the titles of already added name entries to modify the added name.
[0223] Optionally, the entry points for each portrait cluster and their corresponding titles can be displayed at the top of the image material panel 7021. This allows users to easily view the portrait cluster entry points and their corresponding titles, facilitating the search for portrait images based on clusters and improving the user experience.
[0224] As shown in Figure 8(b), in this embodiment, after the user selects the "Portrait" label 70212, the clustering entry 8011 of "All Portraits" is selected by default, and the clustering entry 8011 of "All Portraits" is highlighted. The interface 801 displays thumbnails of all portrait images that meet preset requirements and are filtered from the images stored in the electronic device. The preset requirements include, for example, an aesthetic score greater than a preset score threshold, and the number of people in the image being 1, etc.
[0225] When a user clicks on a clustering entry, the interface displays images of people in that category that meet preset requirements, selected from the images stored on the electronic device. Taking the "father" image cluster as an example, in response to the user's selection of the "father" image clustering entry 8012, the phone displays interface 802 as shown in Figure 8(c). In interface 802, the "All Images" clustering entry 8011 is de-highlighted, while the "father" image clustering entry 8012 is highlighted. Interface 802 also displays thumbnails of father images selected from the images stored on the electronic device that meet preset requirements. Here, "father images" refers to images containing the person "father."
[0226] In response to the user's selection of a thumbnail in interface 802, such as thumbnail 8021, the phone replaces the lock screen image in the current lock screen wallpaper with the image corresponding to thumbnail 8021, displaying interface 803 as shown in Figure 8(d). Interface 803 includes a preview image 8031 of the replaced lock screen wallpaper. It can be seen that the lock screen image in preview image 8031 has been replaced with image 80311 corresponding to thumbnail 8021.
[0227] In this embodiment, when changing the lock screen image, the user can enter the display interface of different types of images through different tabs, so as to select the lock screen image according to the category, without having to select the lock screen image from a large number of images of various types, simplifying the process of finding the lock screen image and improving the user experience.
[0228] The following describes the interface when the album information is expanded.
[0229] For example, Figure 9 is a schematic diagram of interface changes in another example of the image display method provided in this application embodiment. As shown in Figure 9(a), the mobile phone displays a lock screen image changing interface 702, which includes an expand control 70202. In response to the user's selection operation (such as a click operation) on the expand control 70202, the mobile phone displays interface 901 (also called the fifth interface) as shown in Figure 9(b). In interface 901, the image material panel 7021 presents information about each album in the gallery APP in a list form, such as displaying the cover of each album in the gallery, the name of the album, and the number of pictures contained in the album. At the same time, the expand control 70202 in the lock screen image changing interface 702 is replaced by the collapse control 9011 in interface 901. It can be understood that when the user performs the operation of the collapse control 9011, the mobile phone will collapse the album information and display the lock screen image changing interface 702 as shown in Figure 9(a) again.
[0230] As shown in Figure 9(b), the interface 901 includes information from multiple albums, including information 9012 from the "Featured Photos" album. In response to a user's selection of information 9012 from the "Featured Photos" album, such as selecting the album cover 90121, the electronic device collapses the album information and displays the images from the Featured Photos album (also known as the first album) in the image material panel 7021, thus restoring the interface 702 shown in Figure 9(a).
[0231] Optionally, the information 9012 for the "Featured Photos" album can be placed in the first position (i.e., first) among multiple album information. As mentioned above, the pictures in the Featured Photos album match the user's intent and are easily selected by the user as lock screen pictures. Therefore, displaying the information 9012 for the "Featured Photos" album at the first position makes it convenient for users to enter the Featured Photos album, select pictures from it as lock screen pictures, further saving time and effort and improving the user experience.
[0232] In this embodiment, users can easily view album information by expanding the control, making it convenient to search for pictures from the gallery albums, which facilitates user operation and improves user experience.
[0233] The following explains the process of displaying lock screen wallpaper styles.
[0234] For example, Figure 10 is a schematic diagram of interface changes in another example of an image display method provided in this application embodiment. As shown in Figure 10(a), the mobile phone displays a lock screen wallpaper editing interface 701. The lock screen wallpaper editing interface 701 includes a preview image 7011 and a "lock screen style" control 7013. In response to the user's selection operation on the "lock screen style" control 7013, the mobile phone displays a lock screen style display interface 1010 as shown in Figure 10(b). The lock screen style display interface 1010 includes a style material panel 1011. The style material panel 1011 is used to display the style of the lock screen wallpaper, etc.
[0235] As described in the above embodiments, the electronic device can categorize lock screen wallpapers. Optionally, when displaying lock screen wallpaper styles in the style material panel 1011, the styles can be displayed in separate areas according to the type of lock screen wallpaper. For example, as shown in Figure 10(b), the style material panel 1011 can display a "Magic Lock Screen" style area 1012 and a "Gallery Selection" style area 1013, etc.
[0236] The "Magic Lock Screen" style area 1012 displays lock screen wallpaper templates provided by the phone's system. It should be noted that due to page width limitations, not all lock screen wallpaper templates may be displayed on a single page. Users can view undisplayed lock screen wallpaper templates by performing preset operations within the "Magic Lock Screen" style area 1012, such as swiping left or right. This also applies to other areas in the style material panel 1011, and will not be elaborated further.
[0237] The “Gallery Selection” style area 1013 displays lock screen wallpaper styles generated based on lock screen wallpaper templates and images from the Gallery app. For example, Figure 10(b) shows lock screen wallpaper styles 10131 and 10132 generated based on two portraits from the Gallery app and a lock screen wallpaper template.
[0238] It should be noted that the style panel 1011 can also include more style areas. Referring again to Figure 10, in response to a user performing an up swipe operation on the style panel 1011 shown in Figure 10(b) (as indicated by the arrow in the figure, though the arrow is not actually displayed), the phone can display the interface 1020 shown in Figure 10(c). Interface 1020 also includes the style panel 1011. The style panel 1011 in interface 1020 also includes the "My Lock Screen" style area 1021, the "Official Wallpaper" style area 1022, and the "Natural Beauty" style area 1023, etc. Each style area displays a type of lock screen wallpaper style. Specifically, the "My Lock Screen" style area 1021 displays lock screen wallpaper styles used by the user. The "Official Wallpaper" style area 1022 displays lock screen wallpaper styles recommended by the phone manufacturer, such as the official wallpaper style 10221 in Figure 10(c). The "Natural Beauty" style area 1023 displays landscape lock screen wallpaper styles. Among them, landscape lock screen wallpapers refer to lock screen wallpapers whose lock screen images are landscape images.
[0239] In response to a user's selection of any lock screen wallpaper style in the style material panel 1011, the phone can collapse the style material panel 1011 and replace the lock screen wallpaper in the preview image of the lock screen wallpaper editing interface 701 shown in Figure 10(a) with the selected lock screen wallpaper style. Taking the official wallpaper style 10221 in interface 1020 as an example, in response to a user's selection of the official wallpaper style 10221, the phone can display interface 1030 as shown in Figure 10(d). Interface 1030 is the lock screen wallpaper editing interface. The lock screen wallpaper shown in preview image 1031 in interface 1030 is the lock screen wallpaper corresponding to the official wallpaper style 10221, and no longer the lock screen wallpaper in preview image 7011 in interface 701. It is worth noting that the official lock screen wallpaper does not support changing the lock screen image; therefore, interface 1030 does not include a "Change Image" control.
[0240] In some embodiments, the style material panel 1011 also includes multiple album options for users to select pictures from corresponding albums as lock screen wallpapers. For example, as shown in Figure 10(c), the style material panel 1011 includes a "Gallery" area 1024, which includes a "Featured Photos" album option 10241, a "Camera" album option, an "All Photos" album option, a "Share" album option, etc. When a user selects the "Featured Photos" album option 10241, they enter the featured photos album and display the interface 702 shown in Figure 7(b), which will not be described further here.
[0241] Optionally, the "Featured Photos" album option 10241 can be located in the first position within the "Gallery" area 1024. This makes it convenient for users to access the featured photos album and select pictures from it as lock screen images, further saving time and effort and improving the user experience.
[0242] The above description uses the scenario of changing a lock screen image as an example to illustrate the image display method provided in this application. In other embodiments, during the process of changing the desktop image, a curated photo album can also be displayed, allowing users to select images as their desktop images, saving users time and effort and improving user experience.
[0243] For example, Figure 11 is a schematic diagram of the interface change of another image display method provided in the embodiment of this application. As shown in Figure 11(a), the mobile phone screen displays the desktop wallpaper editing interface 1110 (also known as the sixth interface). The access method of this interface can be referred to the embodiment shown in Figure 3 above, and will not be repeated here. The desktop wallpaper editing interface 1110 includes a "select wallpaper" control 1111 (also known as the fifth control). In response to the user's selection operation on the "select wallpaper" control 1111, the mobile phone displays the interface 1120 (also known as the seventh interface) shown in Figure 11(b). The interface 1120 includes a material panel 1121, which includes a "gallery" area 1122, a "natural" wallpaper area 1123, and an "artistic" wallpaper area 1124, etc. Among them, the "gallery" area 1122 includes a "featured photos" album option 11221, a "camera" album option, an "all photos" album option, a "share" album option, etc.
[0244] In response to the user's selection of the "Featured Photos" album option 11221, the featured photos album is accessed, and the electronic device displays interface 1130 (also known as the eighth interface) as shown in Figure 11(c). Interface 1130 is similar to interface 702 described above, except that interface 1130 displays the material panel 1121 on top of the desktop wallpaper editing interface; therefore, "Desktop" 1131 is displayed at the top of the interface instead of "Lock Screen". The content displayed in the material panel 1121 can be the same as the content displayed in the image material panel 7021 described above, and will not be repeated here. The user can select images in the material panel 1121 to change the desktop picture.
[0245] Similarly, the "Featured Photos" album option 11221 can also be located in the first position within the "Gallery" area 1122. This makes it convenient for users to enter the featured photos album, select pictures from it as desktop wallpapers, further saving time and effort and improving the user experience.
[0246] Next, taking the lock screen image changing scenario as an example, we will explain the process of selecting AI-recommended images in the embodiment shown in Figure 7 above.
[0247] For example, Figure 12 is a flowchart illustrating an image display method provided in an embodiment of this application. The executing entity of this method is an electronic device, specifically a gallery app, a lock screen app, or a combination of both; no limitation is made. Furthermore, the electronic device can filter AI-recommended images from all images stored in the device, or from images stored in a preset path or a preset app. The following embodiments use the example of an electronic device filtering AI-recommended images from a gallery.
[0248] As shown in Figure 7(b) above, when the "AI Recommendation" tab 70211 is selected, the interface displays images for filtering AI recommendations. AI recommended images can include images recommended for you, images with similar faces, images with the same color scheme, and featured images. These images can be displayed sequentially in the "Recommended for You" image area 7022, the "Similar Faces" image area 7023, the "Same Color Scheme" image area 7024, and the "Featured" image area 7025 on the interface.
[0249] In this embodiment, when filtering AI-recommended images, different matching criteria and dimensions can be selected based on the current lock screen wallpaper. Specifically, as shown in Figure 12, the method includes:
[0250] S101. In response to the user's selection operation of the "Change Picture" control, obtain the information of the current lock screen wallpaper. The information of the current lock screen wallpaper includes the template identifier of the current lock screen wallpaper, and also includes at least one of the attribute information of the current template and the attribute information of the current lock screen image.
[0251] The current template refers to the template applied to the current lock screen wallpaper. The current lock screen image refers to the lock screen image included in the current lock screen wallpaper.
[0252] The template identifier indicates whether a template has been applied to the lock screen wallpaper. As explained in the terminology explanation section above, when setting a lock screen wallpaper, users can choose a lock screen wallpaper template and edit and set it based on the template to create the current lock screen wallpaper. Alternatively, users can choose not to choose a lock screen wallpaper template and directly edit and set it based on a single image to create the current lock screen wallpaper. Optionally, the lock screen wallpaper template identifier can be represented by preset fields and corresponding values. For example, a preset template identifier field value of 1 indicates that a template has been applied to the current lock screen wallpaper, while a template identifier field value of 0 indicates that a template has not been applied to the current lock screen wallpaper.
[0253] The information for the current lock screen wallpaper also includes the attribute information of the current template and / or the attribute information of the current lock screen image. These will be explained below.
[0254] a. Template attribute information.
[0255] Optionally, the template's attribute information may include one or more of the following: template name, template type, template depth identifier, template main color, template style, sample image identity information, and template content description.
[0256] Optionally, the template name can be represented by text, numbers, characters, etc., without any limitation.
[0257] Optionally, the template type can be categorized in the same way as the image type in the gallery. For example, template types can include people, landscapes, animals, plants, food, and art. Optionally, the template type can be represented by a type tag. For example, if the template's type tag is "landscape," then the template type is landscape.
[0258] The template's depth-of-field indicator is used to indicate whether the lock screen wallpaper template supports depth-of-field effects. Optionally, the template's depth-of-field indicator can be represented by preset fields and corresponding values. For example, a preset depth-of-field indicator field value of 1 indicates that the template supports depth-of-field effects, while a value of 0 indicates that the template does not support depth-of-field effects.
[0259] The primary color of the template indicates the main color of the lock screen wallpaper template; it can be understood as the color that occupies the largest area in the template. Optionally, the primary color of the template can be represented by a preset field and its corresponding value. For example, if the preset color field has a value of "red", it means that the primary color of the template is red.
[0260] The template style indicates the overall style of the template's presentation. Template styles can include Chinese style, traditional, trendy, elegant, modern, abstract, impressionistic, etc.
[0261] The identity information of a sample image refers to the identity information of the sample images included in the template. In other words, the identity information of a sample image indicates which image in the template is the sample image. Optionally, the identity information of a sample image can be the image's name, its identification (ID), or its serial number, etc.
[0262] The content description of a template refers to the textual description of the content (semantics) presented by the template. For example, Figure 13 shows a lock screen wallpaper template, whose content description could be: a girl doing yoga. It should be understood that, depending on the template structure, the content description may be a description of the content presented by the sample images included in the template, or it may be a description of the content presented by other elements (such as cutouts), and there is no limitation on this.
[0263] It is understandable that when a user selects to apply a certain template, the electronic device can obtain the attribute information of the template from the memory or server and save the attribute information of the template in a preset location. Thus, when executing step S101, the attribute information of the current template can be read from the preset location.
[0264] b. Attribute information of the lock screen image.
[0265] Optionally, the attribute information of the lock screen image may include one or more of the following: the identity information of the lock screen image, the type of the lock screen image, the person information of the lock screen image, the depth indicator of the lock screen image, the main color of the lock screen image, the style of the lock screen image, and the content description of the lock screen image.
[0266] The lock screen image's identification information indicates which image is included in the lock screen wallpaper. Optionally, the lock screen image's identification information can be the image's name, ID, or serial number.
[0267] Lock screen images and templates can be categorized into types such as people, landscapes, animals, plants, food, and art. Optionally, the type of lock screen image can be represented by a type tag.
[0268] The people information in lock screen images is used to indicate the people contained in the lock screen image. Specifically, the electronic device can perform facial recognition on people in multiple images from a gallery and cluster the recognition results to obtain multiple clusters, each corresponding to one person. For example, after facial recognition and clustering, n clusters are obtained, corresponding to person 1, person 2, person 3, ..., person n. Optionally, the user can label the people obtained from the clusters; for example, the user can label person 1 as "father" and person 2 as "mother." Optionally, the electronic device can set person tags for each image containing people based on the clusters and the user's labels to mark the information of the people contained in the image. When an image is set as a lock screen image, the people contained in it can be determined based on the person tags.
[0269] The depth-of-field indicator of a lock screen image is used to indicate whether the image supports a depth-of-field effect. As mentioned above, an image supporting a depth-of-field effect means that the image includes a subject of a preset type, such as a person or animal, and the position of the subject in the image meets preset requirements, and the image supports secondary composition (the subject can be cut out). Optionally, the electronic device can pre-process images containing subjects such as people and animals in the image library to determine whether the position of the subject in the image meets the preset requirements and whether the image supports secondary composition. Optionally, the preset requirements can be: the distance between the top of the subject and the top of the image is greater than a preset distance, which can prevent the subject from completely obscuring elements such as clock components. If the position of the subject in the image meets the preset requirements and the image supports secondary composition, it means that when the image is used as a lock screen image, it can present a depth-of-field effect, that is, the image supports a depth-of-field effect. In this case, the electronic device can set the depth-of-field indicator of the image to preset indicator 1, indicating that the image supports a depth-of-field effect. Otherwise, the electronic device can set the depth-of-field indicator of the image to preset indicator 0, indicating that the image does not support a depth-of-field effect. Optionally, if the images in the gallery support depth-of-field effects, the electronic device can also perform background removal on the images to extract and save the main subject. Then, when the user selects this image as their lock screen and enables the depth-of-field effect, the electronic device will simultaneously set the original image as the lock screen and overlay the cut-out image onto the lock screen image and clock widgets, creating a depth-of-field effect on the lock screen wallpaper.
[0270] The primary color of the lock screen image indicates the main color of the image; it can be understood as the color that occupies the largest area in the lock screen image. Optionally, the primary color of the lock screen image can be represented by a preset color label and its corresponding value. For example, a color label value of "red" indicates that the primary color of the lock screen image is red.
[0271] The style of the lock screen image is similar to that of the template, and can include Chinese style, traditional, trendy, elegant, modern, abstract, impressionistic, etc. Optionally, the electronic device can process each image in the gallery using preset algorithms to identify the image's style. For example, it can perform feature extraction, multi-scale processing analysis, clustering, etc., to identify the image's style.
[0272] The content description of a lock screen image refers to the textual description of the content (semantics) presented by the lock screen image. Optionally, the content description of an image can be obtained by performing image-to-text processing on the image. For example, the image can be input into a pre-trained image-to-text model to obtain the content description of the image.
[0273] The above examples illustrate various attribute information contained in the lock screen wallpaper information. It should be understood that the information of the current lock screen wallpaper obtained in step S101 may include some or all of the aforementioned attribute information, depending on the specific lock screen wallpaper. For example, if the current lock screen wallpaper uses a template, and the lock screen image included in the current lock screen wallpaper is not a sample image but an image changed by the user, then the information of the current lock screen wallpaper obtained according to step S101 may include the template identifier, the template's attribute information, and some or all of the lock screen image's information. As another example, if the current lock screen wallpaper does not use a template, then the information of the current lock screen wallpaper obtained according to step S101 may include the template identifier and some or all of the lock screen image's attribute information, but not the template's attribute information. Yet another example, if the current wallpaper information includes lock screen image information, and the lock screen image is a landscape image, the lock screen image's attribute information may include the lock screen image's identity information, the lock screen image's type, the lock screen image's depth-of-field identifier, the lock screen image's main color, and the lock screen image's content description, but not the lock screen image's character information. Of course, in some other embodiments, all types of attribute information can be obtained in step S101. However, for information types that are not involved in the current lock screen wallpaper, their values can be empty.
[0274] S102. Based on the template identifier of the current lock screen wallpaper, determine whether the current lock screen wallpaper has applied a template; if not, proceed to step S103; if yes, proceed to step S104.
[0275] Specifically, the electronic device can determine whether a template is applied to the current lock screen wallpaper based on the value of the template identifier field. For example, if the value of the template identifier field is 1, it is determined that a template is applied to the current lock screen wallpaper, and step S104 is executed; if the value of the template identifier field is 0, it is determined that a template is not applied to the current lock screen wallpaper, and step S103 is executed.
[0276] S103. Based on the attribute information of the current lock screen image, according to matching dimension 1, filter the images from the image library that match the current lock screen image, including recommended images, similar face images, images with the same color scheme, and featured images.
[0277] In other words, if the current lock screen wallpaper does not have an applied template, the matching criteria will be based on the current lock screen image, and the filtering results will be AI-recommended images of four types: images recommended for you, images with similar faces, images with the same color scheme, and featured images.
[0278] Optionally, matching dimension 1 can include a depth-of-field effect dimension. This ensures that the filtered images support depth-of-field effects, improving the display quality of the lock screen wallpaper and thus enhancing the user experience.
[0279] Step S109 is executed after step S103.
[0280] S104. Based on the attribute information of the current template, determine whether the current lock screen image is a sample image of the current template, and determine whether the current template supports depth-of-field effects.
[0281] This can be understood as determining whether the current lock screen image is the sample image of the current template, that is, determining whether the sample image of the current template has been changed. If the current lock screen image is the sample image of the current template, it means that the sample image of the current template has not been changed; if the current lock screen image is not the sample image of the current template, it means that the sample image of the current template has been changed.
[0282] Specifically, the electronic device can compare the identity information of the current template's sample image with the identity information of the current lock screen image. If they match, the current lock screen image is determined to be the current template's sample image, and the current template's sample image has not been changed. If they do not match, the current lock screen image is determined to be not the current template's sample image, and the current template's sample image has been changed.
[0283] For simplicity, step S104 is simply described in Figure 12 as "determining whether the sample image of the current template has been changed and whether depth of field is supported". The four judgment results are also briefly described accordingly, see Figure 12 for details.
[0284] Electronic devices can determine whether a current template supports depth-of-field effects based on the depth-of-field indicator. For example, if the value of the depth-of-field indicator field is 1, then the current template supports depth-of-field effects; if the value of the depth-of-field indicator field is 0, then the current template does not support depth-of-field effects.
[0285] S105. If the current lock screen image is a sample image of the current template, and the current template supports depth-of-field effects, then based on the attribute information of the current template, according to matching dimension 2, filter the images from the image library that match the current template, including recommended images, images of the same color scheme, and featured images. Matching dimension 2 includes the depth-of-field effect dimension but does not include the people dimension.
[0286] In other words, if the current lock screen wallpaper uses a template and the sample image of the template has not been changed, the matching basis is the current template. The matching dimensions include the person dimension, and the filtering results are AI-recommended images of three types: recommended for you, images with the same color scheme, and featured images. It can be understood that if the template's sample image has not been changed, even if the current lock screen wallpaper contains a person, if that person is not in the user's photo library, there is no need to generate similar face images. Therefore, the matching dimensions do not include the person dimension, meaning similar face images are not filtered, thus saving algorithm steps and improving algorithm efficiency.
[0287] Additionally, if the current template supports depth-of-field effects, then dimension 2 of the matching will include the depth-of-field effect dimension. This ensures that the filtered images support depth-of-field effects, and when used in the current template, they will display the depth-of-field effect, improving the lock screen wallpaper's display quality and thus enhancing the user experience.
[0288] S106. If the current lock screen image is a sample image of the current template, and the current template does not support depth-of-field effects, then based on the attribute information of the current template, according to matching dimension 3, filter the images from the image library that match the current template, including recommended images, images with the same color scheme, and featured images. Among these, matching dimension 3 does not include depth-of-field effect dimension and people dimension.
[0289] This step differs from step S105 in that the current template does not support depth-of-field effects, and the matching dimensions used do not include depth-of-field effects. If the template does not support depth-of-field effects, even if the image does support them, it will not display the depth-of-field effect after being placed in the template. Therefore, excluding depth-of-field effects from the matching dimensions relaxes the matching conditions, not only saving algorithm time but also making the filtered images more compatible with the current template in other dimensions, thus better aligning with the user's selection intent and improving the user experience.
[0290] S107. If the current lock screen image is not a sample image of the current template, and the current template supports depth-of-field effects, then based on the attribute information of the current lock screen image, according to matching dimension 4, filter images from the image library that match the current lock screen image, including recommended images, similar face images, images with the same color scheme, and featured images. Among them, matching dimension 4 includes depth-of-field effect dimension and person dimension.
[0291] In other words, if the current lock screen wallpaper uses a template, and the sample image of the template has been changed, the matching will be based on the current lock screen wallpaper, with the filtering results being four types of AI-recommended images: images recommended for you, images with similar faces, images with the same color scheme, and featured images. First, if the user changes the sample image, the matching will be based on the changed image, which better matches the user's intent and improves the user experience. Second, when the user changes the sample image, the matching dimension includes a people dimension, meaning that the filtering for images with similar faces will be performed. The filtering results will include images with similar faces, making it easier to match the user's intention to choose images featuring people, thus improving the user experience.
[0292] Additionally, if the current template supports depth-of-field effects, the matching dimension used will include the depth-of-field effect dimension. This ensures that the filtered images support depth-of-field effects, and when used in the current template, they will display the depth-of-field effect, improving the lock screen wallpaper's display quality and thus enhancing the user experience.
[0293] S108. If the current lock screen image is not a sample image of the current template, and the current template does not support depth-of-field effects, then based on the attribute information of the current lock screen image, according to matching dimension 5, filter the images from the image library that match the current lock screen image, including recommended images, similar face images, images with the same color scheme, and featured images. Among them, matching dimension 5 includes the people dimension but does not include the depth-of-field effect dimension.
[0294] This step differs from step S107 in that the current template does not support depth-of-field effects, and the depth-of-field effect dimension is not included in the matching dimensions used. The beneficial effects of this step can be found in the description of step S106, and will not be repeated here.
[0295] S109. Display the interface based on the filtering results.
[0296] After filtering through the above process to obtain various AI-recommended images, the electronic device displays these images. It can be understood that the electronic device can display all or only a portion of the filtered images. For example, as mentioned above, the electronic device can select images from the filtered images up to the maximum number allowed for each type of AI-recommended image to display. If the number of images in a particular AI-recommended image category does not reach the maximum limit, then all images in that category will be displayed.
[0297] Optionally, electronic devices can also sort the selected images before displaying them. For example, images can be sorted from latest to earliest based on their acquisition time before being displayed to improve user experience. Another example is when displaying featured images, images that support depth-of-field effects can be prioritized. For instance, out of 200 featured images, the first 8 images supporting depth-of-field effects could be displayed, with subsequent images displayed in chronological order.
[0298] Optionally, the electronic device can also display AI-recommended images in different areas according to their type, forming the interface 702 shown in Figure 7(b) above, which will not be described in detail here.
[0299] In summary, when filtering AI-recommended images, different matching criteria and dimensions can be selected based on the current lock screen wallpaper, resulting in different filtering results. Specifically, as shown in Table 1, the matching criteria (whether the current template or the current lock screen image is used, whether the matching dimensions include people, and whether the filtering results include images of similar faces) can be determined based on whether the current lock screen wallpaper uses a template and whether the sample image has been changed. Furthermore, when the current lock screen wallpaper uses a template, the matching dimensions (whether the depth-of-field effect dimension is included) can be determined based on whether the current template supports depth-of-field effects.
[0300] Table 1
[0301] In summary, the method provided in this embodiment selects different matching criteria and dimensions based on the current lock screen wallpaper and generates different filtering results. This not only enables the AI-recommended images obtained to match the user's intent to the greatest extent and improve the user experience, but also saves algorithm steps and improves algorithm running efficiency.
[0302] The following section further explains the specific process of selecting AI-recommended images in various situations.
[0303] 1. Filtering without applying templates.
[0304] For example, please refer to Figure 14. Step S103 above, based on the attribute information of the current lock screen image, filters images that match the current lock screen image from the image library according to matching dimension 1, obtaining recommended images, similar face images, images with the same color scheme, and featured images, which may include:
[0305] S1031. Based on the type of the current lock screen image, filter out images from the gallery that meet the preset recommendation matching condition 1 to obtain recommended images for you.
[0306] The recommended matching condition 1 includes at least a condition for limiting the image type. In other words, the recommended matching condition 1 includes at least a type dimension condition, thus enabling the filtering of images whose type dimension matches the current lock screen image. Optionally, the recommended matching condition 1 may include a sub-condition ① for the type dimension: the image type is the same as the current lock screen image type. Optionally, if the current lock screen image has two or more types, sub-condition ① may include multiple sub-conditions: each sub-condition ① corresponds to one type of the current lock screen image. For example, if the current lock screen image types include landscape and art, then there can be two sub-conditions ①: the image type is the same as the landscape type; the image type is the same as the art type.
[0307] In some embodiments, the recommendation matching condition 1 may further include a color-dimensional sub-condition ②: the main color of the image belongs to the same color family as the main color of the current lock screen image. This way, the resulting recommended images will better match the user's intent from a color perspective, improving the user experience.
[0308] In other embodiments, the recommendation matching condition 1 may also include a sub-condition ③ of the aesthetic rating dimension: the aesthetic rating of the image is greater than a preset rating threshold. This results in higher quality recommended images for you, leading to a better user experience.
[0309] In some other embodiments, the recommended matching condition 1 may also include a sub-condition ④ of the depth-of-field effect dimension: the image supports depth-of-field effects. Thus, when the user enables the depth-of-field effect function, the lock screen wallpaper displays a depth-of-field effect, improving the user's visual experience.
[0310] It should be noted that the recommended matching condition 1 can include all of the sub-conditions ① to ④ mentioned above, or only some of them. Additionally, the necessity of each sub-condition ① to ④ can be marked as needed, i.e., whether each sub-condition is necessary or not. During the filtering process, the sub-conditions included in the matching conditions can be dynamically adjusted based on the filtering results and the necessity of the sub-conditions, allowing for multiple filtering attempts. Furthermore, different matching dimensions can be pre-set in priority, and the matching conditions can be set according to this priority when dynamically adjusting the matching conditions.
[0311] For example, in one embodiment, sub-conditions ① and ③ are marked as necessary conditions, while sub-conditions ② and ④ are not necessary conditions. The preset priority of the matching dimensions is: aesthetic rating dimension > type dimension > depth of field effect dimension > color dimension. During the filtering process, images that simultaneously satisfy sub-conditions ①, ②, ③, and ④ can be selected from the image library to obtain initial screening image 1. As described in the above embodiment, a maximum number of recommended images can be set when displaying them, for example, 8 images. Based on this, it can be determined whether the number of initial screening image 1 is greater than or equal to 8. If so, initial screening image 1 is used as a recommended image; otherwise, images that simultaneously satisfy sub-conditions ①, ③, and ④ are selected from the remaining image 1 (i.e., sub-condition ② of the color dimension is discarded) to obtain initial screening image 2. The remaining image 1 refers to images in the image library other than initial screening image 1. It is determined whether the sum of the numbers of initial screening image 1 and initial screening image 2 is greater than or equal to 8. If so, initial screening image 1 and initial screening image 2 are used as recommended images. If not, then select images from the remaining images 2 that simultaneously satisfy sub-conditions ① and ③ (i.e., discard sub-condition ② for color dimension and sub-condition ④ for depth of field dimension) to obtain the recommended images for you. The remaining images 2 refer to the images in the image library other than the initial screening images 1 and 2.
[0312] In this embodiment, by dynamically adjusting the sub-conditions and performing multiple screenings, the resulting recommended images meet the necessary conditions as much as possible, while also satisfying the non-essential conditions and quantity requirements, thereby improving the accuracy and reliability of the screening.
[0313] Additionally, when displaying recommended images, if the current lock screen images include two or more types, a pre-set maximum number of images of each type can be set, and this maximum can be dynamically adjusted. For example, if the current lock screen images include people and landscapes, after filtering for recommended images, four images of people and four images of landscapes can be selected for display. If there are fewer than four images of people (e.g., only three), landscape images can be displayed to fill the gaps (i.e., five images will be displayed).
[0314] S1032. Based on the person information of the current lock screen image, filter out images that meet the preset face matching condition 1 from the images in the image library, excluding the images recommended for you, to obtain similar face images.
[0315] Among them, face matching condition 1 includes at least the condition for limiting the people information in the image. In other words, the recommendation matching condition 1 includes at least the people dimension condition, so that images that match the current lock screen image in the people dimension can be filtered out through face matching condition 1, that is, images with similar faces can be filtered out. Optionally, face matching condition 1 may include the sub-condition ① of the people dimension: the people information in the image is the same as the people in the current lock screen image. If the people information in the image is the same as the people in the current lock screen image, it means that the image contains the same people as the people in the current lock screen image, indicating that the image is a similar face image.
[0316] In some embodiments, face matching condition 1 may further include a sub-condition ② of the aesthetic score dimension: the aesthetic score of the image is greater than a preset score threshold. This results in high-quality images of similar faces, leading to a better user experience.
[0317] In other embodiments, face matching condition 1 may also include a sub-condition ③ of the depth-of-field effect dimension: the image supports depth-of-field effects. Thus, when the user enables the depth-of-field effect function, the lock screen wallpaper displays a depth-of-field effect, improving the user's visual experience.
[0318] Similar to the filtering of recommended images, the filtering of similar face images can also be performed by dynamically adjusting the matching conditions based on the necessity of sub-conditions and the priority of matching dimensions, thereby improving the accuracy and reliability of the filtering.
[0319] S1033. Based on the main color of the current lock screen image, filter out images from the gallery that meet the preset color matching condition 1, excluding recommended images and similar face images, to obtain images of the same color scheme.
[0320] Specifically, color matching condition 1 includes at least a condition for limiting the main color of the image. In other words, color matching condition 1 includes at least a color dimension condition, thus enabling the filtering of images whose color dimension matches the current lock screen image. Optionally, color matching condition 1 may include a sub-condition ① for the color dimension: the main color of the image and the main color of the current lock screen image belong to the same color family.
[0321] In other embodiments, color matching condition 1 may further include a sub-condition ② of the aesthetic rating dimension: the image's aesthetic rating is greater than a preset rating threshold. This results in higher quality images of the same color family, leading to a better user experience.
[0322] S1034. Select N images from the image library that have an aesthetic score greater than the preset score threshold, excluding images in the "Recommended for You" category, images in the "Similar Faces" category, and images in the "Same Color Scheme" category, to obtain the featured images.
[0323] Where N is the upper limit of the number of featured images, and N is a positive integer, for example, N can be 200.
[0324] The method provided in this embodiment filters images into categories such as recommended images, similar face images, images with the same color scheme, and featured images. Each category is filtered based on the results of the previous category, thus narrowing the filtering range sequentially. This not only reduces the filtering workload and improves filtering efficiency, but also prevents duplicate images from appearing in each category, thus preventing the same images from being shown to users, improving the image display effect, and enhancing the user experience.
[0325] It should be noted that the order in which images are filtered in this embodiment is only an example. In actual applications, other orders can also be used. For example, one could first filter images for similar faces from the image library, then filter images for "Recommended for You" from the images in the image library excluding images for similar faces. Then, filter images for the same color scheme from the images in the image library excluding images for similar faces and images for "Recommended for You". Finally, filter featured images.
[0326] In another embodiment, various types of images can be filtered simultaneously in the image library, and then the filtered images can be deduplicated.
[0327] In summary, the screening method provided in this application is only an example and is not intended to limit the scope of the application. Subsequent embodiments are similar and will not be described in detail hereafter.
[0328] 2. Filtering when a template is applied, the sample image is not changed, and the template supports depth of field.
[0329] For example, please refer to Figure 15. The step S105 above, "based on the attribute information of the current template, according to matching dimension 2, filter the recommended images, images of the same color scheme, and featured images from the image library that match the current template", may include:
[0330] S1051. Based on the type of the current template, filter out images from the image library that meet the preset recommendation matching condition 2 to obtain recommended images for you.
[0331] Recommended matching condition 2 and recommended matching condition 1 can include similar sub-conditions in terms of dimensions. The difference is that recommended matching condition 2 is based on the current template rather than the current lock screen image. Additionally, the depth-of-field effect sub-condition in recommended matching condition 2 can be a necessary condition.
[0332] Optionally, the recommended matching condition 2 may include one or more of the following sub-conditions:
[0333] Sub-condition of the type dimension ①: The image type is the same as the current template type;
[0334] Sub-condition ② of the color dimension: The main color of the image and the main color of the current template belong to the same color family;
[0335] Sub-condition ③ of the aesthetic rating dimension: The aesthetic rating of the image is greater than the preset rating threshold;
[0336] Sub-condition ④ for depth of field effect: The image supports depth of field effect.
[0337] As one possible implementation, recommendation matching condition 2 can also include sub-conditions ⑤ of the image content dimension and / or style dimension: the similarity between the image's content description and the current template's content description is greater than a preset similarity threshold, and / or, the image's style is the same as the current template's style. In this way, the recommended images will be closer to the current template in style and / or content, more closely aligned with user intent, and more likely to be selected by users, further improving the user experience.
[0338] Similarly, in this step, the matching conditions can be dynamically adjusted based on the necessity of the sub-conditions and the priority of the matching dimensions, and multiple filters can be performed to improve the accuracy and reliability of the filtering. For example, the dimension matching priority in this step can be: aesthetic rating dimension > type dimension > depth of field dimension > color dimension.
[0339] S1052. Based on the main color of the current template, select images from the image library that meet the preset color matching condition 2, excluding the images recommended for you, to obtain images of the same color scheme.
[0340] Color matching condition 2 and color matching condition 1 can have the same dimensions for their sub-conditions. The difference is that color matching condition 2 is based on the current template rather than the current lock screen image.
[0341] Optionally, color matching condition 2 may include one or more of the following sub-conditions:
[0342] Sub-condition ① of the color dimension: The main color of the image and the main color of the current lock screen image belong to the same color family;
[0343] Sub-condition ② of the aesthetic rating dimension: The aesthetic rating of the image is greater than the preset rating threshold.
[0344] S1053. Select N images from the image library that have an aesthetic score greater than the preset score threshold, excluding the recommended images and images of the same color scheme, to obtain the featured images.
[0345] This step is similar to step S1034 above, and will not be described again.
[0346] 3. Filtering when a template is applied, the sample image is not changed, and the template does not support depth of field.
[0347] For example, please refer to Figure 16. The step S106 above, "based on the attribute information of the current template, according to matching dimension 3, filter the recommended images, images of the same color scheme, and featured images from the image library that match the current template", may include:
[0348] S1061. Based on the type of the current template, filter out images from the image library that meet the preset recommendation matching condition 3 to obtain recommended images for you.
[0349] The matching criteria for recommended matching condition 3 and recommended matching condition 2 are the same. The main difference between the two is that recommended matching condition 3 does not include the sub-condition of depth of field effect dimension.
[0350] Optionally, the recommended matching condition 3 may include one or more of the following sub-conditions:
[0351] Sub-condition of the type dimension ①: The image type is the same as the current template type;
[0352] Sub-condition ② of the color dimension: The main color of the image and the main color of the current template belong to the same color family;
[0353] Sub-condition ③ of the aesthetic rating dimension: The aesthetic rating of the image is greater than the preset rating threshold;
[0354] Sub-condition ④ for image content dimension and / or style dimension: The similarity between the image content description and the current template content description is greater than the preset similarity threshold, and / or, the image style is the same as the current template style.
[0355] S1062. Based on the main color of the current template, select images from the image library that meet the preset color matching condition 3, excluding the images recommended for you, to obtain images of the same color scheme.
[0356] Color matching condition 3 and color matching condition 2 can be the same, so I won't go into details.
[0357] S1063. Select N images from the image library that have an aesthetic score greater than the preset score threshold, excluding the recommended images and images of the same color scheme, to obtain the featured images.
[0358] This step is similar to step S1062 above, and will not be repeated here.
[0359] 4. Filtering when a template is applied, the sample image is changed, and the template supports depth of field.
[0360] For example, please refer to Figure 17. The step S107 above, "based on the attribute information of the current template, according to matching dimension 4, filter the images from the image library that match the current template, including recommended images, similar face images, images with the same color scheme, and featured images," may include:
[0361] S1071. Based on the type of the current lock screen image, filter out images from the gallery that meet the preset recommendation matching condition 4 to obtain recommended images for you.
[0362] Recommended matching condition 4 and recommended matching condition 1 have the same matching criteria, and are similar in matching dimensions to recommended matching condition 2. The depth-of-field effect dimension sub-condition in recommended matching condition 4 can be used as a necessary condition.
[0363] Optionally, the recommended matching condition 4 may include one or more of the following sub-conditions:
[0364] Sub-condition of the type dimension ①: The type of the image is the same as the type of the current lock screen image;
[0365] Sub-condition ② of the color dimension: The main color of the image and the main color of the current lock screen image belong to the same color family;
[0366] Sub-condition ③ of the aesthetic rating dimension: The aesthetic rating of the image is greater than the preset rating threshold;
[0367] Sub-condition ④ for depth-of-field effect: The image supports depth-of-field effect;
[0368] Sub-condition ⑤ for the image content dimension: The similarity between the content description of the image and the content description of the current lock screen image is greater than the preset similarity threshold.
[0369] S1072. Based on the person information in the current lock screen image, filter out images from the image library that meet the preset face matching condition 2, excluding the images recommended for you, to obtain similar face images.
[0370] Face matching condition 2 is based on the same criteria as face matching condition 1. The difference is that the sub-condition of the depth effect dimension in face matching condition 2 can be used as a necessary condition.
[0371] Optionally, face matching condition 2 can be one or more of the following sub-conditions:
[0372] Sub-condition ① for the person dimension: The person information in the image is the same as the person in the current lock screen image;
[0373] Sub-condition ② of the aesthetic rating dimension: The aesthetic rating of the image is greater than the preset rating threshold;
[0374] Sub-condition ③ of the depth-of-field effect dimension: The image supports depth-of-field effects.
[0375] S1073. Based on the main color of the current lock screen image, select images from the gallery that meet the preset color matching condition 4, excluding recommended images and similar face images, to obtain images of the same color scheme.
[0376] Color matching condition 4 and color matching condition 1 can be the same, so I won't go into details.
[0377] S1074. Select N images from the image library that have an aesthetic score greater than the preset score threshold, excluding images in the "Recommended for You" category, images in the "Similar Faces" category, and images in the "Same Color Scheme" category, to obtain the featured images.
[0378] 5. Filtering when a template is applied, the sample image is replaced, or the template does not support depth of field.
[0379] For example, please refer to Figure 18. The step S108 above, "based on the attribute information of the current template, according to matching dimension 5, filter the images from the image library that match the current template, including recommended images, similar face images, images with the same color scheme, and featured images," may include:
[0380] S1081. Based on the type of the current lock screen image, filter out images from the gallery that meet the preset recommendation matching condition 5 to obtain recommended images for you.
[0381] Recommended matching condition 5 is similar to recommended matching condition 4, the main difference being that recommended matching condition 5 does not include a sub-condition for the depth of field effect dimension.
[0382] Optionally, the recommended matching condition 5 may include one or more of the following sub-conditions:
[0383] Sub-condition of the type dimension ①: The type of the image is the same as the type of the current lock screen image;
[0384] Sub-condition ② of the color dimension: The main color of the image and the main color of the current lock screen image belong to the same color family;
[0385] Sub-condition ③ of the aesthetic rating dimension: The aesthetic rating of the image is greater than the preset rating threshold;
[0386] Sub-condition ④ for the image content dimension: The similarity between the content description of the image and the content description of the current lock screen image is greater than the preset similarity threshold.
[0387] S1082. Based on the person information of the current lock screen image, filter out images that meet the preset face matching condition 3 from the images in the image library, excluding the images recommended for you, to obtain similar face images.
[0388] Face matching condition 3 uses the same matching criteria as face matching conditions 1 and 2. The difference is that face matching condition 3 does not include the sub-condition of depth of field effect dimension.
[0389] Optionally, face matching condition 3 can be one or more of the following sub-conditions:
[0390] Sub-condition ① for the person dimension: The person information in the image is the same as the person in the current lock screen image;
[0391] Sub-condition ② of the aesthetic rating dimension: The aesthetic rating of the image is greater than the preset rating threshold.
[0392] S1083. Based on the main color of the current lock screen image, select images from the gallery that meet the preset color matching condition 5, excluding recommended images and similar face images, to obtain images of the same color scheme.
[0393] Color matching condition 5 can be the same as color matching condition 1 and color matching condition 4, so I won't go into details.
[0394] S1084. Select N images from the image library that have an aesthetic score greater than the preset score threshold, excluding images in the "Recommended for You" category, images in the "Similar Faces" category, and images in the "Same Color Scheme" category, to obtain the featured images.
[0395] The foregoing has detailed examples of the image display methods provided in the embodiments of this application. It is understood that, in order to achieve the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. Those skilled in the art should readily recognize that, based on the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in conjunction with the embodiments, but such implementation should not be considered beyond the scope of this application.
[0396] This application embodiment can divide the electronic device into functional modules according to the above method example. For example, each function can be divided into a separate functional module, such as a detection unit, a processing unit, a display unit, etc., or two or more functions can be integrated into one module. The integrated module can be implemented in hardware or as a software functional module. It should be noted that the module division in this application embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.
[0397] It should be noted that all relevant content of each step involved in the above method embodiments can be referenced from the functional description of the corresponding functional module, and will not be repeated here.
[0398] The electronic device provided in this embodiment is used to execute the above-described image display method, and therefore can achieve the same effect as the above-described implementation method.
[0399] When using integrated units, the electronic device may further include a processing module, a storage module, and a communication module. The processing module is used to control and manage the operation of the electronic device. The storage module supports the execution of stored program code and data. The communication module supports communication between the electronic device and other devices.
[0400] The processing module can be a processor or a controller. It can implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a digital signal processor (DSP), and a microprocessor, etc. The storage module can be a memory. The communication module can specifically be a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip, or other devices that interact with other electronic devices.
[0401] In one embodiment, when the processing module is a processor and the storage module is a memory, the electronic device involved in this embodiment can be a device having the structure shown in FIG1.
[0402] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, causes the processor to perform the image display method of any of the above embodiments.
[0403] This application also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned steps to implement the image display method described in the above embodiments.
[0404] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component, or module. The apparatus may include a connected processor and a memory; wherein the memory is used to store computer execution instructions, and when the apparatus is running, the processor may execute the computer execution instructions stored in the memory to cause the chip to execute the image display method in the above-described method embodiments.
[0405] In this embodiment, the electronic device, computer-readable storage medium, computer program product or chip are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding methods provided above, and will not be repeated here.
[0406] Through the above description of the embodiments, those skilled in the art will understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0407] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another apparatus, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.
[0408] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0409] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0410] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0411] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A method for displaying an image, the method being performed by an electronic device, characterized in that, The method includes: In response to the user's first operation on the lock screen, a first interface is displayed, the first interface including a first preview image and a first control, the first preview image being a preview image of the current lock screen wallpaper of the electronic device; In response to the user's selection operation on the first control, a second interface is displayed. The second interface includes: a second control that corresponds to the AI recommendation method and is in a selected state, as well as a first type of image and a second type of image. The first type of image matches the current lock screen wallpaper in a first dimension, and the second type of image matches the current lock screen wallpaper in a second dimension. In response to the user's selection of a target image in the second interface, a third interface is displayed. The third interface includes a second preview image and the first control. The second preview image is a preview image of the electronic device using the target image as a lock screen wallpaper. The target image is one of the first type of image or the second type of image.
2. The method according to claim 1, characterized in that, The second interface also includes N third controls that correspond one-to-one with N other recommendation methods, where N is a positive integer. The other recommendation methods include those based on people, scenery, animals, plants, food, or art. In response to the user's selection of a target control corresponding to the target recommendation method, a fourth interface is displayed. The fourth interface includes images recommended based on the target recommendation method, and the target control is one of the N third controls.
3. The method according to claim 1 or 2, characterized in that, The second interface includes a first area and a second area, with the first type of image displayed in the first area and the second type of image displayed in the second area.
4. The method according to any one of claims 1 to 3, characterized in that, The first dimension includes one or more type dimensions; or, the first dimension includes one or more of the type dimensions and a color dimension, wherein the type dimensions are used to indicate the type of the image or lock screen wallpaper, and the type includes people, landscapes, animals, plants, food, or art.
5. The method according to any one of claims 1 to 4, characterized in that, The second dimension includes at least the color dimension.
6. The method according to any one of claims 1 to 5, characterized in that, The current lock screen wallpaper is obtained by applying the first lock screen wallpaper template, and the first lock screen wallpaper template supports depth effect. The first lock screen wallpaper template is used to define the style of the lock screen wallpaper. The first dimension also includes the depth-of-field effect dimension.
7. The method according to any one of claims 1 to 6, characterized in that, The current lock screen wallpaper is obtained by applying the first lock screen wallpaper template, and the sample image in the first lock screen wallpaper template has not been replaced; the first type of image matches the first lock screen wallpaper template in the first dimension, the second type of image matches the first lock screen wallpaper template in the second dimension, and the first lock screen wallpaper template is used to define the style of the lock screen wallpaper; Alternatively, the current lock screen wallpaper is obtained by applying a first lock screen wallpaper template and replacing the sample image in the first lock screen wallpaper template with the current lock screen image; the first type of image matches the current lock screen image in the first dimension, the second type of image matches the first lock screen wallpaper template in the second dimension, and the current lock screen image is an image in the current lock screen wallpaper.
8. The method according to any one of claims 1 to 5, characterized in that, The current lock screen wallpaper does not use a lock screen wallpaper template; The first type of image matches the current lock screen image in the first dimension, and the second type of image matches the current lock screen image in the second dimension. The current lock screen image is an image from the current lock screen wallpaper.
9. The method according to claim 8, characterized in that, The first dimension also includes the depth-of-field effect dimension.
10. The method according to any one of claims 1 to 5, characterized in that, The second interface also includes a third type of image, which is matched with the current lock screen image in a third dimension. The current lock screen image is an image in the current lock screen wallpaper, and the third dimension includes a person dimension.
11. The method according to claim 10, characterized in that, The current lock screen wallpaper does not have a template applied; or, the current lock screen wallpaper is obtained by applying a first lock screen wallpaper template and replacing the sample image in the first lock screen wallpaper template with the current lock screen image, wherein the first lock screen wallpaper template is used to define the style of the lock screen wallpaper.
12. The method according to claim 10 or 11, characterized in that, The aesthetic scores of the first type of image, the second type of image, and the third type of image are all greater than the preset scoring threshold.
13. The method according to any one of claims 1 to 12, characterized in that, The second interface also includes a fourth type of image, which includes images stored in the electronic device with an aesthetic score greater than a preset score threshold, and does not include the first type of image or the second type of image.
14. The method according to any one of claims 1 to 13, characterized in that, There are no duplicate images in the first type of images and the second type of images.
15. The method according to any one of claims 1 to 14, characterized in that, The first type of images are displayed in ascending order of time difference, where the time difference is the time difference between the time the image was acquired and the current time.
16. The method according to any one of claims 1 to 15, characterized in that, The second interface also includes a fourth control, and the method further includes: In response to the user's selection operation on the fourth control, a fifth interface is displayed, which includes information from the first album; In response to the user's selection of information in the first album, the second interface is displayed.
17. The method according to claim 16, characterized in that, The fifth interface includes a third area, which is used to display information from the album, with the information from the first album displayed at the beginning of the third area.
18. The method according to any one of claims 1 to 17, characterized in that, The method further includes: In response to the user's swiping operation on the first interface, a sixth interface is displayed, which includes a third preview image and a fifth control. The third preview image is a preview image of the current desktop wallpaper of the electronic device. In response to the user's selection operation on the fifth control, a seventh interface is displayed, which includes information from the first album; In response to the user's selection of information in the first album, an eighth interface is displayed, which includes the first type of images and the second type of images.
19. The method according to any one of claims 1 to 18, characterized in that, The method further includes: In response to the user's selection operation in the sixth control of the ninth interface, the first interface is displayed. The ninth interface is the settings interface for setting the wallpaper in the application. Alternatively, in response to a user's selection operation on the seventh control in the tenth interface, the first interface is displayed, wherein the tenth interface is the image settings interface in the gallery application.
20. The method according to any one of claims 1 to 19, characterized in that, The step of displaying a second interface in response to a user's selection of the first control includes: In response to the user's selection operation on the first control, the information of the current lock screen wallpaper is obtained; Based on the information of the current lock screen wallpaper, images that match the current lock screen wallpaper in the first dimension are filtered to obtain the first type of images; Based on the information of the current lock screen wallpaper, images that match the current lock screen wallpaper in the second dimension are filtered to obtain the second type of images; The second interface is displayed based on the first type of image and the second type of image.
21. The method according to claim 20, characterized in that, The information of the current lock screen wallpaper includes a template identifier, which indicates whether a lock screen wallpaper template is applied to the current lock screen wallpaper. The method further includes: Based on the template identifier, determine whether the current lock screen wallpaper applies a lock screen wallpaper template; The step of filtering images that match the current lock screen wallpaper in the first dimension based on the information of the current lock screen wallpaper to obtain the first type of images includes: If the current lock screen wallpaper does not apply a lock screen wallpaper template, then based on the attribute information of the current lock screen image, images that match the current lock screen image in the first dimension are filtered to obtain the first type of image, and the current lock screen image is the image in the current lock screen wallpaper; If the current lock screen wallpaper uses the first lock screen wallpaper template, then determine whether the current lock screen image is a sample image in the first lock screen wallpaper template; If the current lock screen image is the sample image, then based on the attribute information of the first lock screen wallpaper template, images that match the first lock screen wallpaper template in the first dimension are filtered to obtain the first type of image; If the current lock screen image is not the sample image, then based on the attribute information of the current lock screen image, images that match the current lock screen image in the first dimension are filtered to obtain the first type of image.
22. The method according to claim 21, characterized in that, The step of filtering images that match the current lock screen wallpaper in the second dimension based on the information of the current lock screen wallpaper to obtain the second type of images includes: If the current lock screen wallpaper does not apply a lock screen wallpaper template, then based on the attribute information of the current lock screen image, images that match the current lock screen image in the second dimension are filtered to obtain the second type of images; If the current lock screen wallpaper uses the first lock screen wallpaper template, then determine whether the current lock screen image is a sample image in the first lock screen wallpaper template; If the current lock screen image is the sample image, then based on the attribute information of the first lock screen wallpaper template, images that match the first lock screen wallpaper template in the second dimension are filtered to obtain the second type of image; If the current lock screen image is not the sample image, then based on the attribute information of the current lock screen image, images that match the current lock screen image in the second dimension are filtered to obtain the second type of image.
23. The method according to claim 21 or 22, characterized in that, The method further includes: If the current lock screen wallpaper uses the first lock screen wallpaper template and the current lock screen image is not the sample image, or if the current lock screen wallpaper does not use a lock screen wallpaper template, then based on the attribute information of the current lock screen image, images that match the current lock screen image in the third dimension are filtered to obtain a third type of image, where the third dimension includes at least the person dimension.
24. An electronic device, characterized in that, The electronic device includes: one or more processors, and memory; The memory is coupled to the one or more processors, and the memory is used to store computer program code, the computer program code including computer instructions, which the one or more processors call to cause... The electronic device performs the method as described in any one of claims 1 to 23.
25. A chip system, characterized in that, The chip system is applied to an electronic device, the chip system including one or more processors, the one or more processors being used to invoke computer instructions to cause the electronic device to perform the method as described in any one of claims 1 to 23.
26. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1 to 23.
Citation Information
Patent Citations
Method and device for replacing screen locking application wallpaper
CN104679379A
Video recommendation method based on multi-dimensional analysis
CN113407824A
Application management method, intelligent terminal and storage medium
CN114090150A
Wallpaper setting method and electronic equipment
CN117278666A
Transition dynamic effect generation method and electronic device
WO2024114257A1