Picture display method, electronic device and computer-readable storage medium

Abstract

Disclosed are a picture display method, an electronic device and a computer-readable storage medium. The method comprises: in response to a target operation for uploading a picture, an electronic device acquiring target information related to interface content of an application program; on the basis of a first number of pictures and the target information, acquiring from a picture set a target candidate picture set of each target element, wherein the target element is determined on the basis of the target information, the target candidate picture set comprises at least one target candidate picture, the total number of target candidate pictures of the target elements is less than or equal to the first number of pictures, and the first number of pictures is the number of pictures that can be displayed in an initial interface of a picture selection interface; and displaying the target candidate pictures of the target elements in the initial interface.

Description

Picture display method, electronic device and computer readable storage medium

[0001] The present application claims priority to the Chinese patent application No. 202410808248.4, filed on June 20, 2024, and entitled "Picture display method, electronic device and computer readable storage medium", the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] The present application relates to the technical field of terminal, and in particular to a picture display method, an electronic device and a computer readable storage medium. BACKGROUND

[0003] With the increasing powerful and rich functions of electronic devices such as mobile phones, there are more and more application programs on the electronic devices that need users to upload pictures.

[0004] When the user needs to upload pictures, the user can select pictures from the picture interface displayed by the electronic device to select the pictures to be uploaded. For example, when the user uses a social application program to publish a social dynamic, if it is needed to insert pictures in the social dynamic, the user needs to select the pictures to be uploaded to the social application program from the mobile phone album.

[0005] However, there are usually a large number of pictures stored on the electronic device. It is difficult to select the pictures to be uploaded from a large number of pictures, and it takes a long time, which is not good for user experience. SUMMARY

[0006] The present application provides a picture display method, an electronic device and a computer readable storage medium, which can enable the user to simply and quickly select the pictures to be uploaded.

[0007] In a first aspect, an embodiment of the present application provides a picture display method, which comprises: an electronic device displays an interface of an application program; in response to a target operation on the interface of the application program, obtaining target information of the application program, the target information being related to the content of the interface of the application program, the target operation being used for uploading pictures; according to a first picture quantity and the target information, obtaining a target candidate picture set of each target element from a picture set, the target element being determined according to the target information, the target candidate picture set including at least one target candidate picture, a total number of the target candidate pictures of each target element being less than or equal to the first picture quantity, the first picture quantity being a number of pictures that can be displayed on a first screen interface of a picture selection interface; and displaying the target candidate pictures of each target element on the first screen interface.

[0008] It can be seen from the above that, by obtaining the target candidate pictures of each target element from the picture set according to the target information related to the interface content of the application program, the picture related to the interface content of the application program is obtained; and the number of pictures of the target candidate pictures of each target element is reasonably determined according to the number of pictures that can be displayed on the first screen interface, so that the total number of the target candidate pictures of all target elements is less than or equal to the first number of pictures, so that the target candidate pictures of all target elements can be displayed on the first screen interface. In this way, the user can obtain the pictures of multiple target elements on the first screen interface, without needing to obtain the pictures of the target elements by paging, and thus the user can more simply and quickly select the pictures to be uploaded, and the user experience is improved.

[0009] The pictures to be uploaded by the user are often related to the interface content of the application program. According to the embodiment of the application, the target candidate pictures of each target element are obtained, and the target candidate pictures of multiple target elements are displayed on the first screen interface, so that the pictures displayed on the first screen interface are very likely to be the pictures to be uploaded by the user.

[0010] In some possible implementation of the first aspect, if the at least two target elements include a first target element and a second target element. In the process of displaying the target candidate pictures of each target element on the first screen interface, the electronic device can display the target candidate pictures of the first target element and the target candidate pictures of the second target element on the first screen interface according to the priority of the first target element and the second target element, the priority of the first target element is higher than the priority of the second target element, and the display position of the target candidate pictures of the first target element is in front of the display position of the target candidate pictures of the second target element.

[0011] In this way, not only can the pictures related to the target element with high priority be presented in priority (i.e., the display interface on the first screen interface is earlier), but also the pictures related to each target element can be aggregated and displayed (i.e., the pictures related to the target element are displayed next to each other), thereby further improving the convenience of the user in selecting pictures.

[0012] In some possible implementation of the first aspect, a first target element in the target elements includes a first sub-element and a second sub-element. At this time, in the process of displaying the target candidate pictures of each target element on the first screen interface, the electronic device can display the picture of the first sub-element and the picture of the second sub-element on the first screen interface according to the priority of the first sub-element and the second sub-element, the priority of the first sub-element is higher than the priority of the second sub-element, the display position of the picture of the first sub-element is in front of the display position of the picture of the second sub-element, and the target candidate pictures of the first target element include the picture of the first sub-element and the picture of the second sub-element.

[0013] In this way, not only can the pictures related to the sub-elements with high priority be presented preferentially, but also the pictures related to each sub-element can be aggregated and displayed, thereby further improving the convenience of the user in selecting the pictures.

[0014] In some possible implementation manners of the first aspect, the electronic device can further display a label page of the target element or a label page of the sub-element in the picture selection interface, the label page of the target element including the target candidate pictures of the target element, and the label page of the sub-element including the pictures of the sub-element. In this way, the user can obtain the pictures related to the target element or the sub-element through the label page, thereby further improving the convenience of the user in selecting the pictures.

[0015] In some possible implementation manners of the first aspect, in the process of obtaining the target candidate picture set of each target element from the picture set according to the first picture quantity and the target information, the electronic device can obtain a candidate picture set of each target element from the picture set according to the target information; and for each target element, select the target candidate picture from the candidate picture set; wherein the number of the selected target candidate pictures is determined according to the first picture quantity, and the number of the selected target candidate pictures is the number of pictures displayed in the first screen interface.

[0016] In this implementation manner, the number of pictures that can be displayed in the first screen interface is used to allocate the number of pictures displayed in the first screen interface for each target element, and a corresponding number of pictures are selected for each target element, so that the pictures of multiple target elements can be displayed in the first screen interface.

[0017] In some possible implementation manners of the first aspect, in the process of selecting the target candidate picture from the candidate picture set, the electronic device can perform similar picture clustering on the candidate picture set to obtain a similar picture set; for each similar picture set, sort each similar picture in the similar picture set, and select a preset number of similar pictures in front as target similar pictures of the similar picture set; and select the target candidate picture from the target similar pictures of each similar picture set and the candidate pictures that are not clustered into the similar picture set.

[0018] In this implementation manner, the similar pictures are clustered, the target similar pictures are selected from the similar pictures according to the sorting of the similar pictures, and the target candidate picture is selected based on the target similar pictures and the pictures that are not clustered, so that the number of similar pictures that are repeated in the selected target candidate pictures is reduced as much as possible, thereby reducing the interference of the similar pictures that are repeated on the user in selecting the pictures, and further improving the convenience of the user in selecting the pictures.

[0019] In some possible implementation manners of the first aspect, in the process of sorting the similar pictures in the similar picture set, the electronic device can score the similar pictures according to at least one of the composition, color, and definition of the similar pictures, to obtain scores of the similar pictures; and sort the similar pictures according to the scores of the similar pictures. In this way, by calculating and scoring the similar pictures in the same cluster according to information such as composition, color, and definition, and sorting the similar pictures according to the scores, a better picture can be selected from the multiple similar pictures, so that the better picture is preferentially presented, and the interference of the similar pictures on the selection of the picture by the user is reduced.

[0020] In some possible implementation manners of the first aspect, in the picture selection interface, the display position of the target similar picture in the similar picture set is in front of the display position of the non-target similar picture in the similar picture set. In this way, the preferred picture (that is, the target similar picture) in the multiple similar pictures is preferentially presented (that is, the display position of the preferred picture is in front), so that the interference of the similar pictures on the selection of the picture by the user is reduced, and the convenience of the selection of the picture by the user is further improved.

[0021] In some possible implementation manners of the first aspect, if the target element includes at least two sub-elements, the electronic device can perform similar picture clustering on the pictures of each sub-element, to obtain a similar picture set of each sub-element, and the candidate picture set includes the pictures of each sub-element.

[0022] In some possible implementation manners of the first aspect, the target information is text information obtained according to the interface content of the application program.

[0023] In some possible implementation manners of the first aspect, the target element is an event described in the target information, an object in the event described in the target information, a keyword in the target information, or a classification of the object described by the keyword in the target information.

[0024] In some possible implementation manners of the first aspect, the target element is an event or an object in the event. In the process of obtaining the candidate picture set of each target element from the picture set according to the target information, the electronic device can extract event information of the event from the target information; and perform picture retrieval in the picture set by using the event information, to obtain the candidate picture set of each event or object in the event.

[0025] In some possible implementation manners of the first aspect, when the target element includes at least two events, the electronic device can further determine the importance of each event; and perform priority sorting on the at least two events according to the importance of each event. In this way, the picture of the event with high importance is preferentially presented, and the convenience of the selection of the picture by the user is improved.

[0026] In some possible implementation manners of the first aspect, if the target element is an event, the electronic device can further, when no picture matching the event information is obtained in the picture retrieval from the picture set according to the event information of the event, retrieve pictures from the picture set again according to the target event information, where the target event information is the event information obtained by removing one or more dimension information in the event information.

[0027] In this implementation manner, when no matching picture is retrieved according to the event information, intelligent fallback can be performed, that is, one or more dimension information is removed and then matching retrieval is performed again to obtain a picture result, thereby avoiding a poor user experience caused by no retrieval result.

[0028] In some possible implementation manners of the first aspect, the target element is a classification of an object described by a keyword; in the process of obtaining the candidate picture set of each target element from the picture set according to the target information, the electronic device can perform picture retrieval according to the keyword in the target information to obtain a retrieval result of the keyword; and perform classification on the retrieval result of the keyword to obtain the target candidate picture set of each classification.

[0029] In the second aspect, the embodiments of the present application provide a picture display method, in which the electronic device displays an interface of an application program; in response to a target operation on the interface of the application program, target information of the application program is obtained, the target information is related to content of the interface of the application program, and the target operation is used for uploading a picture; pictures of each target element are obtained from a picture set according to the target information, the target element is determined according to the target information; a priority of each target element in at least two target elements is determined; and the pictures of each target element are displayed in a picture selection interface according to the priority of the target element; wherein the at least two target elements include a first target element and a second target element, the priority of the first target element is higher than the priority of the second target element, and a display position of the picture of the first target element in the picture selection interface is in front of a display position of the picture of the second target element in the picture selection interface.

[0030] As can be seen from the above, the embodiments of the present application prioritize each target element, and make the display position of the picture related to the target element with high priority in front of the display position of the picture related to the target element with low priority, so that the picture related to the target element with high priority is presented preferentially, thereby improving the convenience of the user in selecting a picture.

[0031] In some possible implementation manners of the second aspect, the first target element of the target elements includes a first sub-element and a second sub-element; the priority of the first sub-element is higher than the priority of the second sub-element, and the display position of the picture of the first sub-element in the picture selection interface is in front of the display position of the picture of the second sub-element in the picture selection interface, and the picture of the target element includes the picture of the first sub-element and the picture of the second sub-element. In this way, the picture related to the sub-element with high priority can be presented preferentially, and the convenience of selecting the picture by the user is further improved.

[0032] In some possible implementation manners of the second aspect, in the process of obtaining the picture of each target element from the picture set according to the target information, the electronic device can obtain a candidate picture set of each target element from the picture set according to the target information; for each target element, the candidate pictures in the candidate picture set of the target element are clustered to obtain at least one similar picture set; for each similar picture set, after each similar picture in the similar picture set is sorted, a preset number of similar pictures are selected, and the preset number of similar pictures are target similar pictures of the similar picture set; and for each target element, the picture of the target element is selected from the target similar pictures of each similar picture set and the candidate pictures that are not clustered into the similar picture set.

[0033] In this implementation manner, the similar pictures are clustered, and the target similar pictures are selected from the similar pictures according to the sorting of the similar pictures, so that the interference of the pictures that are similar to each other on the selection of the picture by the user is reduced, and the convenience of selecting the picture by the user is further improved.

[0034] In some possible implementation manners of the second aspect, the target information is text information obtained according to the interface content of the application program.

[0035] In some possible implementation manners of the second aspect, the target element is an event described in the target information, an object in the event described in the target information, a keyword in the target information, or a classification of an object described by the keyword in the target information.

[0036] In some possible implementation manners of the second aspect, when the target element is an event or an object in the event, the electronic device can extract event information of the event from the target information, and use the event information to filter the picture of each event or the picture of each object in the event from the picture set.

[0037] In some possible implementation manners of the second aspect, when the target element is a classification of an object described by a keyword, the electronic device can use the keyword to filter the picture of the keyword from the picture set, and perform a retrieval result classification on the picture of the keyword to obtain the picture of each classification.

[0038] In some possible implementation ways of the second aspect, when the target element is a keyword, the priority of each keyword is determined according to the incoming order of the keywords. In this case, a keyword that is transmitted earlier has a higher priority than a keyword that is transmitted later.

[0039] In some possible implementation ways of the second aspect, when the target element is an event, the importance of each event is determined according to at least one of the event content completeness, the description complexity, the time and location accuracy, and the distance between the location of the event and the location of the insertion cursor of the event, and the event with higher importance has higher priority.

[0040] In the third aspect, the embodiments of the present application provide a picture display method, which includes: displaying, by an electronic device, an interface of an application; obtaining target information from the application, the target information being information sent by the application in response to a target operation on the interface of the application, the target information being related to the content of the interface of the application, and the target operation being used for uploading a picture; obtaining, according to a first picture quantity and the target information, a target candidate picture set of each target element from a picture set, the target element being determined according to the target information, the target candidate picture set including at least one target candidate picture, and the total quantity of the target candidate pictures of each target element being less than or equal to the first picture quantity, the first picture quantity being the number of pictures that can be displayed on a first screen interface of a picture selection interface; and displaying, on the first screen interface, the target candidate picture of each target element.

[0041] In the fourth aspect, the embodiments of the present application provide a picture display method, in which an electronic device displays an interface of an application; target information from the application is obtained, the target information being information sent by the application in response to a target operation on the interface of the application, the target information being related to the content of the interface of the application, and the target operation being used for uploading a picture; pictures of each target element are obtained from a picture set according to the target information, the target element being determined according to the target information; the priority of each target element in at least two target elements is determined; and the pictures of each target element are displayed on a picture selection interface according to the priority of the target element, wherein the at least two target elements include a first target element and a second target element, the priority of the first target element is higher than the priority of the second target element, and the display position of the picture of the first target element in the picture selection interface is in front of the display position of the picture of the second target element in the picture selection interface.

[0042] In the fifth aspect, the embodiments of the present application provide an electronic device, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor, and the processor implements the method in any one of the above-mentioned first aspect, the second aspect, the third aspect, or the fourth aspect when executing the computer program.

[0043] In a sixth aspect, an embodiment of the present application provides a computer readable storage medium, which stores a computer program. The computer program is executed by a processor to implement the method in any one of the first aspect, the second aspect, the third aspect or the fourth aspect.

[0044] In a seventh aspect, an embodiment of the present application provides a chip system, which includes a processor coupled with a memory. The processor executes a computer program stored in the memory to implement the method in any one of the first aspect, the second aspect, the third aspect or the fourth aspect. The chip system can be a single chip or a chip module composed of multiple chips.

[0045] In an eighth aspect, an embodiment of the present application provides a computer program product, which, when running on an electronic device, causes the electronic device to perform the method in any one of the first aspect, the second aspect, the third aspect or the fourth aspect.

[0046] It can be understood that the beneficial effects of the second aspect to the eighth aspect can be referred to the related description in the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0047] FIG. 1A is a schematic diagram of a picture uploading scenario according to an embodiment of the present application;

[0048] FIG. 1B is another schematic diagram of a picture uploading scenario according to an embodiment of the present application;

[0049] FIG. 2 is a structural schematic diagram of an electronic device 200 according to an embodiment of the present application;

[0050] FIG. 3A is a schematic diagram of picture display based on multiple sub-categories of a single keyword according to an embodiment of the present application;

[0051] FIG. 3B is a schematic diagram of a sub-category tab page according to an embodiment of the present application;

[0052] FIG. 3C is a schematic diagram of a first-screen interface display position sequence according to an embodiment of the present application;

[0053] FIG. 3D is a schematic diagram of non-aggregated display according to an embodiment of the present application;

[0054] FIG. 4 is a schematic diagram of picture display based on multiple sub-categories of a single keyword according to an embodiment of the present application;

[0055] FIG. 5A is a schematic diagram of picture display based on multiple keywords according to an embodiment of the present application;

[0056] FIG. 5B is a schematic diagram of a sub-category tab page of a keyword according to an embodiment of the present application;

[0057] FIG. 6A is a schematic diagram of a picture display of a single event and multiple categories according to an embodiment of the present application;

[0058] FIG. 6B is a schematic diagram of a label page of a cat according to an embodiment of the present application;

[0059] FIG. 7 is a schematic diagram of a picture display of multiple events according to an embodiment of the present application;

[0060] FIG. 8 is a schematic diagram of picture sorting optimization according to an embodiment of the present application;

[0061] FIG. 9 is a schematic diagram of a flow of picture recommendation and display based on a keyword and text content according to an embodiment of the present application;

[0062] FIG. 10A is a schematic diagram of a flow of a picture display method according to an embodiment of the present application;

[0063] FIG. 10B is a schematic diagram of a picture display of a first screen interface according to an embodiment of the present application;

[0064] FIG. 11 is a schematic diagram of a flow of a picture display method according to an embodiment of the present application. DETAILED DESCRIPTION

[0065] In the following description, specific details such as specific system structures, techniques, etc. are presented in order to provide a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the embodiments of the present application can be practiced without these specific details.

[0066] The picture uploading scenario is exemplarily introduced below in combination with FIG. 1A and FIG. 1B. FIG. 1A is a schematic diagram of a picture uploading scenario according to an embodiment of the present application, and FIG. 1B is another schematic diagram of a picture uploading scenario according to an embodiment of the present application.

[0067] As shown in FIG. 1A, the main interface 101 of the mobile phone 100 displays icons of applications 1-9, a gallery 102, a microblog 103, and icons of other application programs, such as a little red book 104. In other embodiments, the gallery 102 can also be referred to as an album. and are third-party social application programs.

[0068] After the user clicks the icon of the little red book 104, the mobile phone 100 starts the little red book 104 in response to the click operation on the gallery 102, and displays an interface of the little red book 104. A personal information interface 105 of the little red book 104 includes a note creation button 106. After the user clicks the note creation button 106, the mobile phone 100 displays a picture-text template interface 107 in response to the click operation.

[0069] The graphic template interface 107 includes a plurality of templates, such as a graphic template 108, a graphic template 109, and a graphic template 110. When the user wants to create a note by using the graphic template 110, the user clicks the graphic template 110. In response to the click operation on the graphic template 110, the mobile phone 100 displays a detail interface 111 of the graphic template 110.

[0070] The detail interface 111 includes an "immediately use" button 112. When the user clicks the "immediately use" button 112, the mobile phone 100 displays a picture selection interface 113 in response to the click operation. The first screen interface of the picture selection interface 113 displays a plurality of pictures. The user can select pictures to be uploaded from the first screen interface and other page interfaces (non-first screen interfaces) of the picture selection interface 113, and inserts the selected pictures into the created note by clicking a "finish" button in the picture selection interface 113, that is, uploads the selected pictures to the Little Red Book 104.

[0071] In a specific application, the Little Red Book 104 can obtain pictures in the gallery 102 by calling a picture selector, and displays the obtained pictures on the picture selection interface 113. The pictures in the picture selection interface 113 are usually displayed in chronological order of the pictures. The closer the picture time is to the current time, the more forward the display position on the picture selection interface 113. For example, the first picture (picture 114) on the first screen interface has the closest picture time to the current time, and has the most forward display position.

[0072] When the user selects pictures to be uploaded on the picture selection interface 113, if the pictures to be uploaded are not displayed on the first screen interface, the user needs to perform a page turning operation on the screen of the mobile phone 100 to turn to other interfaces of the picture selection interface 113, and selects pictures from the pictures displayed on the other interfaces.

[0073] As shown in FIG. 1B, the mobile phone 100 displays a microblog creation interface 115. The microblog creation interface 115 includes a picture insertion button 116. The user can insert pictures into the created microblog by clicking the picture insertion button 116. The user can trigger the mobile phone 100 to start the microblog 103 and display the interface of the microblog 103 by clicking the icon of the microblog 103.

[0074] When the user clicks the picture insertion button 116, the mobile phone 100 displays a picture selection interface 117 in response to the click operation. The first screen interface of the picture selection interface 117 displays a plurality of pictures. The user can select pictures to be uploaded from the first screen interface and other page interfaces of the picture selection interface 117, and inserts the selected pictures into the created microblog by clicking a "finish" button in the picture selection interface 117, that is, uploads the selected pictures to the microblog 103.

[0075] In a specific application, the microblog 103 can acquire the pictures in the gallery 102 by calling the picture selector, and display the acquired pictures on the picture selection interface 117. The pictures in the picture selection interface 117 are usually displayed in the order of picture time.

[0076] It should be understood that the picture selection interfaces of different applications are usually not exactly the same. For example, the picture selection interface 117 of the microblog 103 and the picture selection interface 113 of the Little Red Book 104 are not exactly the same.

[0077] FIG. 1A shows a scenario of inserting pictures in a note created by the Little Red Book 104, and FIG. 1B shows a scenario of inserting pictures in a microblog created by the microblog 103. Both creating a note and creating a microblog can be regarded as creating a script, so FIG. 1A and FIG. 1B can be regarded as scenarios of inserting pictures in a created script when creating a script.

[0078] It should be understood that the picture uploading scenarios mentioned in FIG. 1A and FIG. 1B are only examples and do not limit the picture uploading scenarios. For example, in some file management scenarios or picture editing scenarios, pictures also need to be uploaded to an application.

[0079] Exemplarily, the application of the embodiments of the present application that requires a user to upload pictures can include but is not limited to a social application, an e-commerce application, a file management application, and a picture editing application, etc. The social application can include the Little Red Book 104 and the microblog 103, etc.

[0080] The inventor found in the research process that in the picture uploading scenario, displaying the pictures in the picture selection interface in the order of picture time can make the user need to spend a lot of time to find the picture to be uploaded in a large number of pictures, which is inefficient and has a poor user experience.

[0081] For example, in FIG. 1A and FIG. 1B, when inserting pictures in script creation, the picture selection interface displays the pictures in the order of picture time. At this time, if the picture to be uploaded is a picture saved a month ago or a picture saved a year ago, the picture to be uploaded will not be displayed on the first screen interface but in a relatively late page. In this case, after triggering the mobile phone 100 to display the picture selection interface, the user cannot select the picture to be uploaded from the first screen interface, but needs to slowly slide the picture selection interface to find the picture to be uploaded, which is time-consuming and difficult. In addition, the pictures displayed in the picture selection interface in the order of picture time are usually disordered, which also increases the difficulty and time consumption of the user to find the picture to be uploaded.

[0082] To solve the above-mentioned problems, the embodiment of the present application provides a picture display scheme. When a user performs a picture uploading operation in an interface of an application program requiring picture uploading, target information related to the interface of the application program requiring picture uploading is acquired. Target candidate pictures of multiple target elements are acquired from a picture set according to the number of pictures that can be displayed on a first screen interface of the picture selection interface and the target information, and the total number of the target candidate pictures of the multiple target elements is less than or equal to the number of pictures that can be displayed on the first screen interface. The target elements are determined according to the target information. The target candidate pictures of the multiple target elements are displayed on the first screen interface. In this way, the user can acquire pictures of multiple target elements in the first screen interface, and does not need to find the pictures of the target elements by paging, thereby improving the convenience of the user in selecting pictures.

[0083] The picture display scheme provided by the embodiment of the present application can be applied to electronic devices such as mobile phones, tablet computers, car machine devices and notebook computers. The specific type and specific structure of the electronic device are not limited herein.

[0084] Exemplarily, FIG. 2 shows a structural schematic diagram of an electronic device 200 provided by the embodiment of the present application. The electronic device 200 can include but is not limited to a processor 210, a memory 220 and a display screen 230. Optionally, the electronic device 200 can further include a touch sensor 240. The touch sensor 240 can be arranged on the display screen 230, and the touch sensor 240 and the display screen 230 form a touch screen, also known as a touch screen.

[0085] The structure shown in the embodiment of the present application does not constitute a specific limitation on the electronic device 200. In other embodiments of the present application, the electronic device 200 can include more or fewer components than those shown, or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software or a combination of software and hardware. For example, when the electronic device 200 is specifically a mobile phone, it further includes a universal serial bus (USB) interface, a charging management module, a power management module, a camera, a battery, an antenna, a mobile communication module, a wireless communication module, a loudspeaker, a receiver, an earphone interface, a sensor, a key, a motor, an indicator, and a subscriber identification module (SIM) card interface.

[0086] The processor 210 can include one or more processing units, for example: the processor 210 can include an application processor (AP), a graphics processing unit (GPU), an image signal processor (ISP), a controller, and the like. Among them, different processing units can be independent devices, or can be integrated in one or more processors. The controller can generate operation control signals according to instruction operation codes and timing signals, complete the control of fetching instructions and executing instructions.

[0087] The processor 210 can include one or more interfaces. The interface can include an integrated circuit (I2C) interface, a mobile industry processor interface (MIPI), and a general-purpose input / output (GPIO) interface, and the like.

[0088] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 210 can contain multiple groups of I2C buses. The processor 210 can be coupled to the touch sensor 240 and the like through different I2C bus interfaces respectively. For example: the processor 210 can be coupled to the touch sensor 240 through the I2C interface, so that the processor 210 and the touch sensor 240 communicate through the I2C bus interface, realizing the touch function of the electronic device 200.

[0089] The MIPI interface can be used to connect the processor 210 and the display screen 230 and the like peripheral devices. The MIPI interface includes a display screen serial interface (DSI) and the like. In some embodiments, the processor 210 and the display screen 230 communicate through the DSI interface, realizing the display function of the electronic device 200.

[0090] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal, or can be configured as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 210 and the display screen 230 and the like.

[0091] The interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a limitation on the structure of the electronic device 200. In some other embodiments of the present application, the electronic device 200 can also use different interface connection manners or a combination of multiple interface connection manners in the above embodiments.

[0092] The electronic device 200 implements the display function through the GPU, the display screen 230, and the application processor, etc. The GPU is a microprocessor for image processing, connected to the display screen 230 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 210 can include one or more GPUs that execute program instructions to generate or change display information.

[0093] The display screen 230 is used to display images, videos, etc. The display screen 230 includes a display panel. The display panel can use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diode (QLED), etc. In some embodiments, the electronic device 200 can include 1 or N display screens 230, and N is a positive integer greater than 1.

[0094] The memory 220 can be used to store computer executable program codes, and the executable program codes include instructions. The memory 220 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required by a function (such as an image playing function, etc.), etc. The data storage area can store data created during the use of the electronic device 200. In addition, the memory 220 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 210 executes various function applications and data processing of the electronic device 200 by running the instructions stored in the memory 220 and / or the instructions stored in the memory arranged in the processor.

[0095] Touch sensor 240, also referred to as "touch device". The touch sensor is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the touch event type. Visual output related to the touch operation can be provided through the display screen 230. For example, when uploading pictures, the user can perform a point selection operation on the touch screen of the mobile phone to select pictures, and perform a sliding page turning operation to turn the pages of the pictures.

[0096] The following takes the electronic device 200 as an example to exemplarily introduce the picture display scheme provided by the embodiments of the present application.

[0097] The following describes the processes of picture recommendation and picture display based on keywords and picture recommendation and picture display based on events respectively.

[0098] Picture recommendation and picture display based on keywords:

[0099] After the electronic device 200 displays the interface of the application program on the display screen 230, if it receives a target operation input by the user on the interface of the application program, it acquires target information related to the content of the interface of the application program in response to the target operation. The target information can include one or more keywords. The target operation is an operation for uploading pictures.

[0100] In some embodiments, the target information can include a single keyword, and the keyword includes multiple sub-categories.

[0101] At this time, after the electronic device 200 acquires the keyword, it first filters out the picture set of the keyword from the picture set; then classifies the search results of the picture set of the keyword to obtain the classification result, that is, classifies each picture in the picture set to determine the category to which each picture belongs.

[0102] If the classification result indicates that the picture set of the keyword includes pictures of multiple categories, the keyword includes multiple sub-categories; if the classification result indicates that the picture set of the keyword only includes pictures of one category, the keyword does not include multiple sub-categories.

[0103] For example, the keyword is "pet", the mobile phone 100 performs picture search from the pictures in the gallery 102 to obtain the picture set of "pet"; classifies the search results of the picture set of "pet" to obtain the classification result; if the classification result indicates that the candidate picture set of "pet" includes pictures of "dog" and "cat", "pet" includes two sub-categories of "cat" and "dog". If the classification result indicates that the candidate picture set of "pet" only has pictures of "dog", "pet" only has one category of "dog".

[0104] In the process of screening the picture set of the keyword from the picture set, the electronic device 200 can calculate the matching degree of each picture in the picture set with the keyword; determine whether the matching degree of each picture is greater than or equal to a matching degree threshold set in advance; if the picture is greater than or equal to the matching degree threshold, the picture is selected as the picture of the keyword; if the picture is less than the matching degree threshold, the picture is not selected as the picture of the keyword. The pictures of the keyword can form the picture set of the keyword.

[0105] After obtaining the classification result of the picture set of the keyword, if the picture set of the keyword includes pictures of multiple sub-categories, the electronic device 200 selects pictures displayed on the first screen interface of each sub-category from the pictures of each sub-category.

[0106] In order to enable the pictures of multiple sub-categories to be displayed on the first screen interface, the total number of the pictures displayed on the first screen interface of each sub-category can be less than or equal to the first picture number. The first picture number is the number of pictures that can be displayed on the first screen interface of the picture selection interface.

[0107] The first picture number can be set in advance. For example, it is set that the number of pictures that can be displayed on the first screen interface of the mobile phone 100 is 16, that is, the first screen interface of the mobile phone 100 can display a maximum of 16 pictures.

[0108] The number of pictures displayed on the first screen interface of each sub-category can be the same or different. Moreover, the number of pictures displayed on the first screen interface of all sub-categories is less than or equal to the first picture number. For example, the keyword “pet” includes two sub-categories “cat” and “dog”, that is, the number of sub-categories is 2, and the first picture number is 16; at this time, the number of pictures displayed on the first screen interface of “cat” and “dog” is 8; or the number of pictures displayed on the first screen interface of “cat” is 6, and the number of pictures displayed on the first screen interface of “dog” is 6 or 10.

[0109] When the number of pictures displayed on the first screen interface of each sub-category is determined according to the first picture number and the number of sub-categories, the electronic device 200 can determine the number of pictures displayed on the first screen interface of each sub-category according to the average allocation principle. For example, the first picture number is 16, and the number of sub-categories is 2. According to the average allocation principle, 8 pictures are allocated to each sub-category on average, that is, the number of pictures displayed on the first screen interface of each sub-category is 8.

[0110] Of course, the electronic device 200 can also determine the number of pictures displayed on the first screen interface of each sub-category by other ways, which are not limited herein.

[0111] Exemplarily, the electronic device 200 can also determine the number of pictures of each subcategory to be displayed on the first screen interface according to the number of pictures of each subcategory. The number of pictures of a subcategory is positively correlated with the number of pictures of the subcategory to be displayed on the first screen interface. For example, the first number of pictures is 16, and the keyword "pets" includes two subcategories of "cats" and "dogs". There are 100 pictures of "pets" in total, 60 pictures of "cats", and 40 pictures of "dogs". At this time, the proportion of pictures of "cats" is 0.6, and the proportion of pictures of "dogs" is 0.4. According to the proportion of pictures, the number of pictures of "cats" to be displayed on the first screen interface is determined as: 16 x 0.6 = 9.6, and the number of pictures of "dogs" to be displayed on the first screen interface is determined as: 16 x 0.4 = 6.4. Finally, after rounding off the number of pictures, it can be determined that the number of pictures of "cats" to be displayed on the first screen interface is 10, and the number of pictures of "dogs" to be displayed on the first screen interface is 6.

[0112] For each subcategory, the electronic device 200 can select a corresponding number of pictures from the pictures of the subcategory as the pictures of the subcategory to be displayed on the first screen interface according to the number of pictures of the subcategory to be displayed on the first screen interface. For example, there are 20 pictures of "cats", and the number of pictures of "cats" to be displayed on the first screen interface is 6. After sorting the 20 pictures according to the matching degree from high to low, the top six pictures are selected from the 20 pictures as the pictures of the subcategory of "cats" to be displayed on the first screen interface.

[0113] Of course, in addition to selecting the pictures of each subcategory to be displayed on the first screen interface according to the matching degree of the pictures, the electronic device 200 can also select a corresponding number of pictures from the pictures of each subcategory as the pictures of the subcategory to be displayed on the first screen interface according to other manners according to the number of pictures of each subcategory to be displayed on the first screen interface. For example, the electronic device 200 can randomly select a corresponding number of pictures from the pictures of each subcategory according to the number of pictures of each subcategory to be displayed on the first screen interface; or score each picture of the same subcategory (for example, score according to the definition and composition), and select a corresponding number of pictures from the pictures of the subcategory according to the score of the pictures.

[0114] Compared with the prior art, selecting the pictures of each subcategory to be displayed on the first screen interface according to the matching degree of the pictures or according to the score of the pictures can make the quality of the pictures displayed on the first screen interface better, or more likely to be the pictures that the user needs to upload, thereby further improving the user's experience of selecting pictures.

[0115] The electronic device 200 can also select a corresponding number of pictures from the pictures of each subcategory according to the time of each picture according to the number of pictures of each subcategory to be displayed on the first screen interface.

[0116] In an optional manner, for each sub-category, the electronic device 200 selects a corresponding number of pictures in the order from new to old or from old to new according to the picture time of each picture in the sub-category, as the pictures of the sub-category displayed on the home screen interface. Wherein, the new and old of the picture can refer to the distance of the picture time from the current time, the latest picture refers to the picture whose picture time is closest to the current time, and the oldest picture refers to the picture whose picture time is farthest from the current time.

[0117] It should be noted that the picture time can be the shooting time of the picture, or the creation time (or saving time) of the picture, or the modification time of the picture. Generally, if the picture has a shooting time, the shooting time of the picture is used as the picture time. If the picture does not have a shooting time, the saving time or modification time of the picture can be used as the picture time.

[0118] In another optional manner, for each sub-category, the electronic device 200 first divides a plurality of time periods according to the picture time of each picture in the sub-category. Each time period includes one or more pictures; and then selects a corresponding number of pictures from the pictures in each time period, as the pictures of the sub-category displayed on the home screen interface.

[0119] In a specific application, the pictures selected in each time period can be the same or different. For example, the pictures of the sub-category "dog" have a total of 30 pictures; the picture times of the 30 pictures are divided into two time periods, namely a first time period and a second time period. The first time period is closest to the current time, and the second time period is farthest from the current time. There are 20 pictures whose picture times fall within the first time period, and 10 pictures whose picture times fall within the second time period. The number of pictures displayed on the home screen interface for the sub-category "dog" is 8. At this time, 4 pictures can be selected from the 20 pictures in the first time period, and 4 pictures can be selected from the 10 pictures in the second time period, as the pictures of "dog" displayed on the home screen interface.

[0120] Of course, in addition to uniformly selecting pictures from each time period (i.e., the number of pictures selected in each time period is the same), pictures can also be selected from the pictures in each time period according to the principle that the closer the time period to the current time, the more pictures are extracted. For example, there are 20 pictures in the first time period and 10 pictures in the second time period. Compared with the second time period, the first time period is closer to the current time, so the number of pictures selected from the pictures in the first time period is more than the number of pictures selected from the pictures in the second time period. For example, 6 pictures are selected from the 20 pictures in the first time period, and 2 pictures are selected from the 10 pictures in the second time period, as the pictures of "dog" displayed on the home screen interface.

[0121] When selecting the pictures of the sub-categories to be displayed on the first screen interface, if the number of pictures of a sub-category is less than the number of pictures of the sub-category to be displayed on the first screen interface, all the pictures of the sub-category are selected as the pictures to be displayed on the first screen interface; if the number of pictures of a sub-category is greater than the number of pictures of the sub-category to be displayed on the first screen interface, pictures of the corresponding number are selected as the pictures of the sub-category to be displayed on the first screen interface according to the matching degree of the pictures or other manners. For example, the keyword "pet" includes two sub-categories "cat" and "dog". The number of pictures of "cat" to be displayed on the first screen interface is 8, but the number of pictures of "cat" is only 6, and therefore all the pictures of "cat" are displayed on the first screen interface. The number of pictures of "dog" to be displayed on the first screen interface is 8, but the number of pictures of "dog" is 15, and therefore 8 pictures are selected from the 15 pictures of "dog" as the pictures of the sub-category "dog" to be displayed on the first screen interface.

[0122] After the electronic device 200 obtains the pictures of the sub-categories to be displayed on the first screen interface, the electronic device 200 displays the selected pictures of the sub-categories on the first screen interface.

[0123] Optionally, the electronic device 200 also displays the tab pages of the sub-categories on the picture selection interface. The tab pages of the sub-categories include the pictures of the sub-categories.

[0124] For example, referring to the picture display diagram of the sub-categories based on a single keyword provided by the embodiment of the present application shown in FIG. 3A, based on the scene of FIG. 1A, the mobile phone 100 displays the detail interface 111, and the user clicks the button 112 of "use immediately". The mobile phone 100 obtains the target information of the Little Red Book 104 in response to the clicking operation of the button 112 of "use immediately", and the target information can be related to the interface content of the detail interface 111.

[0125] At this time, the interface content of the detail interface 111 includes the text content of "pet oil painting" and a pet picture with an oil painting effect, and therefore the target information can be the keyword "pet". Generally, the Little Red Book 104 can be pre-set with one or more keywords for each graphic text template, and at this time, the keyword set for the graphic text template corresponding to the detail interface 111 is "pet". Of course, the mobile phone 100 can also identify the interface content on the detail interface 111 to obtain the corresponding keyword.

[0126] After the mobile phone 100 obtains the keyword "pet", the mobile phone 100 screens the pictures in the picture gallery 102 to obtain a picture set of "pet" that matches the keyword "pet". Specifically, the picture set of "pet" can be obtained by the matching degrees of the pictures with the keyword "pet", and the picture set of "pet" is classified to obtain a classification result. At this time, the classification result indicates that the picture set of "pet" includes pictures of "cat" and pictures of "dog", that is, the keyword "pet" includes two sub-categories of "cat" and "dog".

[0127] The mobile phone 100 selects 8 pictures from the pictures of "cat" and "dog" according to the number of pictures that can be displayed on the first screen interface and the matching degrees of the pictures, and displays the 8 pictures as the pictures of the sub-category on the first screen interface.

[0128] After the mobile phone 100 determines the 8 pictures of "cat" and "dog" displayed on the first screen interface, the mobile phone 100 displays the picture selection interface 118 according to the 8 pictures of "cat" displayed on the first screen interface and the 8 pictures of "dog" displayed on the first screen interface. The picture selection interface 118 includes a recommended page button 119. In FIG. 3A, the picture selection interface 118 is under the recommended page.

[0129] The picture selection interface 118 displays 8 pictures of "cat" and 8 pictures of "dog" on the first screen interface. The 8 pictures of "cat" are displayed first, and then the 8 pictures of "dog" are displayed. The display position of the pictures of "cat" is in front of the display position of the pictures of "dog".

[0130] After the mobile phone 100 displays the picture selection interface 118, since the picture selection interface 118 displays the pictures of all sub-categories of the keyword "pet" on the first screen interface, when the user creates a note with the theme of "pet oil painting", the user can simply and quickly select the pet pictures needed to be uploaded to the Little Red Book 104 from the pet pictures displayed on the first screen interface, without flipping the pages to find the pictures of "cat" or "dog", thereby improving the convenience of the user to select the pictures.

[0131] Optionally, the picture selection interface 118 can further include a cat tab button 120 and a dog tab button 121.

[0132] When the user clicks the cat tab button 120, the mobile phone 100 displays the cat tab 122 in FIG. 3B in response to the click operation. The cat tab 122 can include all pictures of "cat" in the picture gallery 102 of the mobile phone 100. FIG. 3B is a schematic diagram of a sub-category tab provided by an embodiment of the present application.

[0133] When the user clicks the dog tab button 121, the mobile phone 100 displays the dog tab 123 in FIG. 3B in response to the click operation. The dog tab 123 can include all the pictures of dogs in the photo gallery 102 of the mobile phone 100.

[0134] It should be noted that, in general, the arrangement order of the tabs of the sub-categories can be the same as the display order of the sub-categories on the home screen. For example, in the home screen in FIG. 3A, the pictures of cats are displayed first and the pictures of dogs are displayed last, and accordingly, the cat tab button 120 is before the dog tab button 121. Of course, the arrangement order of the tabs of the sub-categories can also be different from the display order of the sub-categories on the home screen. In addition, the display order of the pictures in each tab of the sub-categories can be arbitrary, for example, the pictures can be sorted and displayed according to the time, the score or the matching degree of the pictures.

[0135] The mobile phone 100 can further improve the convenience of selecting pictures by displaying the tabs of the sub-categories of the pets. For example, when there is no picture that the user wants to upload in the 8 pictures of cats displayed on the home screen, the user can directly find the picture of the cat that the user wants to upload from the cat tab 122 without being disturbed by the pictures of other categories (for example, dogs), and the time spent in finding the picture of the cat that the user wants to upload is shorter and the efficiency is higher.

[0136] It should be noted that, when displaying the pictures of different sub-categories on the home screen, the electronic device 200 can first determine the priorities of the different sub-categories, and then display the pictures of the sub-categories on the home screen according to the priorities of the sub-categories. The display position of the pictures of a sub-category with a high priority is more forward than the display position of the pictures of a sub-category with a low priority.

[0137] When determining the priorities of the different sub-categories, the priorities of the sub-categories can be determined according to the number of pictures of the sub-categories. If the number of pictures of a sub-category is more than the number of pictures of another sub-category, the priority of the sub-category is higher than the priority of the other sub-category. Of course, the priorities of the sub-categories can also be determined in other ways, which are not limited herein.

[0138] For example, in FIG. 3A, the candidate picture set of “pets” includes 100 pictures of cats and 50 pictures of dogs, and since the number of pictures of cats is more than the number of pictures of dogs, the priority of cats is higher than the priority of dogs. When the mobile phone 100 displays the pictures of cats and dogs on the home screen, the pictures of cats are displayed first and then the pictures of dogs are displayed.

[0139] In some other embodiments, the electronic device 200 can also determine the display order of the different sub-categories on the home screen in a random manner.

[0140] When displaying pictures of the same sub-category on the home screen interface, the electronic device 200 can determine the display order of the pictures of the same sub-category on the home screen interface according to the picture time or the picture score, etc. The closer the picture time is to the current time, or the higher the score of the picture is, the more forward the display position of the picture is. The score of the picture can be obtained by scoring the quality of the picture. For example, the pictures are scored according to the definition, etc.

[0141] For example, in FIG. 3A, the pictures of the 8 cats are displayed in order on the home screen interface according to the picture time.

[0142] Generally, the upper left corner of the home screen interface is the most forward display position, and the lower right corner is the most backward display position. For example, referring to the display position order diagram of the home screen interface provided by the embodiments of the present application shown in FIG. 3C, taking the 8 pictures of the cats and the 8 pictures of the dogs displayed on the home screen interface of FIG. 3A as an example, an xy coordinate system of the home screen interface is established with the upper left corner of the home screen interface as the origin. The display position of the picture 124 is the most forward, and the display position of the picture 127 is the most backward. According to the xy coordinates, the order of the display positions can be determined. For example, the display position of the picture 124 is more forward than that of the picture 125, and the display positions of the pictures 124 and 125 are both more forward than that of the picture 126.

[0143] It should be further noted that in the home screen interface of FIG. 3A, the pictures of the same sub-category are displayed next to each other, or in other words, the pictures of the same sub-category are displayed in an aggregated manner. However, in some other embodiments, the pictures of the same sub-category can not be displayed in an aggregated manner. For example, referring to the non-aggregated display diagram provided by the embodiments of the present application shown in FIG. 3D, based on the scenario shown in FIG. 3A, the 8 pictures of the cats in the home screen interface of FIG. 3D are not displayed in an aggregated manner, and the 8 pictures of the dogs are also not displayed in an aggregated manner. At this time, the display order of the 8 pictures of the cats and the 8 pictures of the dogs on the home screen interface can be random, or can be determined according to the picture time or the picture score, etc., which is not limited herein.

[0144] Compared with non-aggregated display, displaying the pictures of the same sub-category in an aggregated manner can further improve the convenience of the user in selecting pictures.

[0145] It should be understood that the pictures that are not displayed completely on the home screen interface will be displayed on the non-home screen interface. The picture display format of the non-home screen interface can be the same as or different from that of the home screen interface. The picture display format of the non-home screen interface is not limited herein.

[0146] As another example, referring to the picture display diagram based on a single keyword and multiple sub-categories provided by the embodiment of the present application shown in FIG. 4, based on the scenario of FIG. 1A, after the mobile phone 100 displays the graphic template interface 107, the user clicks the graphic template 108. The mobile phone 100 displays the puppy dressing template interface 128 in response to the clicking operation on the graphic template 108. After the user clicks the "use immediately" button in the puppy dressing template interface 128, the mobile phone 100 displays the picture selection interface 129 in response to the clicking operation.

[0147] The picture selection interface 129 includes a recommended page button 130. The first screen interface displays pictures of a dog in multiple states, and the pictures of each state are aggregated and displayed. In FIG. 4, the picture selection interface 129 is under the recommended page.

[0148] At this time, "dog" is a keyword. The keyword "dog" includes multiple sub-categories (i.e., states or dressing). The pictures of dressing 1 (i.e., state 1) are pictures of a puppy wearing sunglasses, the pictures of dressing 2 (i.e., state 2) are pictures of a puppy wearing a hat, the pictures of dressing 3 (i.e., state 3) are pictures of a puppy wearing a scarf, and the pictures of dressing 4 (i.e., state) are pictures of a puppy wearing clothes.

[0149] The pictures of various dressings in the first screen interface of the picture selection interface 129 are aggregated and displayed, i.e., 4 pictures of dressing 1 are displayed in the same row, 4 pictures of dressing 2 are displayed in the same row, 4 pictures of dressing 3 are displayed in the same row, and 4 pictures of dressing 4 are displayed in the same row. Among them, the pictures of dressing 1 are displayed in the most forward position on the first screen interface, and the pictures of dressing 4 are displayed in the most backward position on the first screen interface.

[0150] The specific process in which the mobile phone 100 displays the picture selection interface 129 in response to the user's clicking operation on the "use immediately" button in the puppy dressing template interface 128 can be as follows:

[0151] The mobile phone 100 acquires target information of the Little Red Book 104 in response to the clicking operation on the "use immediately" button in the puppy dressing template interface 128. The target information can be related to the interface content of the puppy dressing template interface 128.

[0152] At this time, the interface content of the puppy dressing template interface 128 includes the text content of "puppy dressing diary" and a picture of a puppy wearing decorations. The target information can include the keyword "dog". Generally, the Little Red Book 104 is pre-set with one or more keywords for each graphic template. It is assumed that the pre-set keywords for the graphic template 108 include "dog" and "dressing", or include "dog". Of course, the mobile phone 100 can also identify the interface content of the puppy dressing template interface 128 to obtain the keyword "dog".

[0153] After the mobile phone 100 obtains the keyword "dog", the mobile phone 100 screens the pictures in the picture gallery 102 to obtain a picture set of "dog" that matches the keyword "dog". Specifically, the picture set of "dog" can be obtained by the matching degrees of the pictures to the keyword "dog", and the picture set of "dog" is classified to obtain a classification result. At this time, the classification result represents that the picture set of "dog" includes the picture of the puppy wearing sunglasses, the picture of the puppy wearing a hat, the picture of the puppy wearing a scarf, and the picture of the puppy wearing clothes. That is, the keyword "dog" includes four subcategories, and at this time, the subcategory can refer to the state or the dressing.

[0154] The mobile phone 100 can determine the number of pictures of each subcategory that can be displayed on the first screen interface according to the number of pictures that can be displayed on the first screen interface and the number of subcategories. Assuming that the number of pictures of each subcategory displayed on the first screen interface is 4, 4 pictures can be selected from the picture of the puppy wearing sunglasses, the picture of the puppy wearing a hat, the picture of the puppy wearing a scarf, and the picture of the puppy wearing clothes according to the matching degrees of the pictures or the picture scores (for example, the pictures are scored according to the picture definition and color, etc.).

[0155] The mobile phone 100 displays the 4 pictures selected from the picture of the puppy wearing sunglasses, the 4 pictures selected from the picture of the puppy wearing a hat, the 4 pictures selected from the picture of the puppy wearing a scarf, and the 4 pictures selected from the picture of the puppy wearing clothes on the first screen interface of the picture selection interface 129.

[0156] After the mobile phone 100 displays the picture selection interface 129, since the pictures of all states (or dressings) of the keyword "dog" are displayed on the first screen interface of the picture selection interface 129, when the user creates a note with the theme of the puppy dressing diary, the user can simply and quickly select the pictures needed to be uploaded to the Little Red Book 104 from the various dressing pictures of the dog displayed on the first screen interface, without flipping the pages to find the various dressing pictures of the dog, thereby improving the convenience of the user to select the pictures.

[0157] Optionally, the picture selection interface 129 can further include a state 1 tab button 131, a state 2 tab button 132, a state 3 tab button 133, and a state 4 tab button 134. The state 3 tab button 133 and the state 4 tab button 134 are displayed on the interface outside the picture selection interface 129, and the user can find the state 3 tab button 133 and the state 4 tab button 134 through a sliding operation.

[0158] The user can click the state tab page button to trigger the mobile phone 100 to display the tab page of the corresponding state. For example, when the user clicks the state 1 tab page button 131, the mobile phone 100 displays the tab page of state 1 in response to the click operation. The tab page of state 1 displays pictures of all the puppies wearing sunglasses. In this way, the mobile phone 100 displays the tab pages of various outfits of the dog, so that the user can quickly and easily obtain the pictures of the corresponding outfit from the tab page, and reduce the interference of other pictures (for example, pictures that are not the same outfit).

[0159] In some other embodiments, the target information can include at least two keywords. At this time, the electronic device 200 first filters the picture set of each keyword from the picture set after obtaining the keywords, and then selects the picture displayed on the first screen interface of each keyword from the picture set of each keyword.

[0160] In this case, for each keyword, the process of filtering the picture set of the keyword from the picture set can be as follows: the electronic device 200 calculates the matching degree of each picture in the picture set and the keyword; it is judged whether the matching degree of each picture is greater than or equal to the pre-set matching degree threshold; if the picture is greater than or equal to the matching degree threshold, the picture is selected as the picture of the keyword; if the picture is less than the matching degree threshold, the picture is not selected as the picture of the keyword. The multiple pictures of the keyword can constitute the picture set of the keyword.

[0161] In order to enable multiple pictures of the keyword to be displayed on the first screen interface, the total number of pictures displayed on the first screen interface of each keyword can be less than or equal to the first picture number. The first picture number is the number of pictures that can be displayed on the first screen interface of the picture selection interface. The number of pictures displayed on the first screen interface of each keyword can be the same or different.

[0162] When determining the number of pictures displayed on the first screen interface of each keyword according to the first picture number, the electronic device 200 can determine the number of pictures displayed on the first screen interface of each keyword according to the average allocation principle. For example, the first picture number is 16, and the number of keywords is 4. According to the average allocation principle, 4 pictures are allocated to each keyword on average, that is, the number of pictures displayed on the first screen interface of each keyword is 4.

[0163] Of course, the electronic device 200 can also determine the number of pictures displayed on the first screen interface of each keyword by other ways, which are not limited herein. For example, the number of pictures displayed on the first screen interface of each keyword can be determined according to the picture proportion of each keyword, and the picture proportion is the ratio between the number of pictures of the keyword and the total number of pictures of all keywords.

[0164] For each keyword, the electronic device 200 can select a corresponding number of pictures from the picture set of the keyword according to the number of pictures displayed on the first screen interface of each keyword, as the pictures displayed on the first screen interface of the keyword. For example, the keyword is "panda", and there are 50 pictures in the picture set of "panda". The number of pictures displayed on the first screen interface of "panda" is 4. After sorting the 50 pictures according to the matching degree from high to low, the top four pictures are selected from the 50 pictures as the pictures displayed on the first screen interface of the keyword "panda". Of course, the electronic device 200 can also select a corresponding number of pictures from the picture set of the keyword according to the number of pictures displayed on the first screen interface of each subcategory in other ways, as the pictures displayed on the first screen interface of the keyword. For example, a corresponding number of pictures can be randomly selected from the pictures of the keyword, or each picture in the picture set of the keyword can be scored (for example, according to the clarity and composition), and a corresponding number of pictures can be selected from the picture set of the keyword according to the picture score.

[0165] Compared with the above, selecting the pictures displayed on the first screen interface of the keyword from the picture set of the keyword according to the picture matching degree or according to the picture score can make the picture quality displayed on the first screen interface better, or more likely to be the picture that the user needs to upload, thereby further improving the user's experience of selecting pictures.

[0166] The electronic device 200 can also select a corresponding number of pictures from the pictures of each keyword according to the number of pictures displayed on the first screen interface of each keyword according to the picture time. Specifically, the electronic device 200 selects a corresponding number of pictures according to the picture time of each picture of the keyword in the order from new to old or from old to new, as the pictures displayed on the first screen interface of the keyword. For details, please refer to the related content of selecting the pictures displayed on the first screen interface of each subcategory above, which will not be repeated here.

[0167] When selecting the pictures of each keyword to be displayed on the first screen interface, if the number of pictures of the keyword is less than the number of pictures of the keyword to be displayed on the first screen interface, all the pictures of the keyword are displayed on the first screen interface; if the number of pictures of the keyword is greater than the number of pictures of the keyword to be displayed on the first screen interface, pictures of the corresponding number are selected according to the matching degree of the pictures or other manners, and the pictures are displayed on the first screen interface as the pictures of the keyword. For example, the keywords include "cat" and "dog". The number of pictures of "cat" to be displayed on the first screen interface is 8, but there are only 6 pictures of "cat", so all the pictures of "cat" are displayed on the first screen interface. The number of pictures of "dog" to be displayed on the first screen interface is 8, but there are 15 pictures of "dog", so 8 pictures of "dog" are selected from the 15 pictures of "dog" as the pictures of the keyword "dog" to be displayed on the first screen interface.

[0168] After the electronic device 200 obtains the pictures of each keyword to be displayed on the first screen interface, the electronic device 200 can display the pictures of the multiple keywords on the first screen interface.

[0169] When displaying the pictures of the multiple keywords on the first screen interface, the priority of the multiple keywords can be determined first. The priority of the keyword is related to the display order of the pictures of the keyword on the first screen interface, and the higher the priority of the keyword, the more front the display position of the pictures of the keyword on the first screen interface.

[0170] Alternatively, the electronic device 200 can determine the priority of the multiple keywords according to the order of obtaining the multiple keywords. For example, the Little Red Book 104 transmits the multiple keywords to the gallery 102 by calling the picture selector, and the transmission order of the multiple keywords is: cat, giant panda. At this time, the priority of the cat is higher than the priority of the giant panda.

[0171] Of course, the electronic device 200 can also determine the priority of the multiple keywords in other manners. For example, the priority of the multiple keywords is determined according to the number of pictures in the picture set of the keyword. At this time, there are 50 pictures in the picture set of the cat, and there are 60 pictures in the picture set of the giant panda, so the priority of the giant panda is higher than the priority of the cat. For another example, the priority of the multiple keywords is determined in a random manner.

[0172] The pictures of the same keyword can be displayed on the first screen interface in an aggregated manner or not in an aggregated manner.

[0173] For example, the pictures of the multiple keywords are displayed on the first screen interface in an aggregated manner. For example, the pictures of the multiple keywords are displayed on the first screen interface in a non-aggregated manner. For example, the pictures of the multiple keywords are displayed on the first screen interface in a non-aggregated manner, and the pictures of the same keyword are displayed in an aggregated manner.

[0174] The mobile phone 100 displays the graduation season template interface 136 of the graphic template 109 in response to a click operation on the graphic template 109. After the user clicks the “use immediately” button in the graduation season template interface 136, the mobile phone 100 acquires target information of the Little Red Book 104 in response to the click operation. The target information can be related to the interface content of the graduation season template interface 136.

[0175] At this time, the interface content of the graduation season template interface 136 includes the text content “graduation season”, the podium picture, the classroom picture, and the playground picture, etc. The podium picture refers to a picture taken on a podium, which usually includes relevant features of the podium (for example, the picture includes a blackboard). The classroom picture refers to a picture taken in a classroom, which usually includes features of the classroom (for example, the picture includes a desk). The playground picture refers to a picture taken on a playground, which usually includes features of the playground (for example, the picture includes the grass of a football field).

[0176] The target information can include four keywords: graduation photo, classroom, podium, and playground. The acquisition order of the four keywords is: graduation photo, podium, classroom, and playground, that is, the “graduation photo” is acquired first, and the “playground” is acquired last.

[0177] After the mobile phone 100 acquires the four keywords: graduation photo, classroom, podium, and playground, it filters out a picture set of the graduation photo, a picture set of the classroom, a picture set of the podium, and a picture set of the playground from the pictures in the gallery 102 according to the matching degree of the pictures and the keywords.

[0178] The mobile phone 100 can select a corresponding number of pictures from the picture sets of the keywords according to the number of pictures that can be displayed on the first screen interface and the matching degree of the pictures, and display the pictures as the pictures of the keywords on the first screen interface. At this time, four pictures are selected from the picture set of the graduation photo, the picture set of the classroom, the picture set of the podium, and the picture set of the playground, respectively, as the pictures displayed on the first screen interface.

[0179] According to the acquisition order of the four keywords: graduation photo, classroom, podium, and playground, the mobile phone 100 determines the priority order of the four keywords as: graduation photo > podium > classroom > playground, so the display order of the pictures of the four keywords on the first screen interface is: graduation photo > podium > classroom > playground. In addition, the mobile phone 100 also aggregates and displays the pictures of the keywords.

[0180] Based on the priority of four keywords—graduation photo, classroom, podium, and playground—mobile phone 100 displays an image selection interface 137. The first row of the image selection interface 137 displays four graduation photos, the second row displays four podium photos, the third row displays four classroom photos, and the fourth row displays four playground photos. Image selection interface 137 includes a recommendation page button 138; at this time, Figure 5A is in the recommendation page.

[0181] After the image selection interface 137 is displayed on the phone, users creating graduation-themed notes can quickly and easily select various graduation-related images from the four keywords displayed on the image selection interface 137: graduation photos, classrooms, podiums, and playgrounds. This eliminates the need to flip through pages searching for graduation-themed outfits, significantly improving the convenience of image selection. Furthermore, the aggregated display of images based on various keywords on the home screen further simplifies image selection.

[0182] Optionally, the image selection interface 137 may also include a graduation photo tab button 139, a podium tab button 140, a classroom tab button 141, and a playground tab button 142. The classroom tab button 141 and the playground tab button 142 are displayed outside of the image selection interface 137, and users can find them by swiping. The order of the tab buttons for each keyword can be consistent with the display order of the keywords on the main screen.

[0183] Users can trigger the display of the corresponding status tab on mobile phone 100 by clicking the status tab button. For example, when a user clicks the classroom tab button 141, mobile phone 100 responds to the click and displays the classroom tab. The classroom tab displays pictures of all classrooms.

[0184] Optionally, when the target information includes at least two keywords, the search results for the image set containing the keywords can be further categorized to determine whether the keywords include subcategories; alternatively, the search results for the image set containing the keywords may not be categorized.

[0185] When categorizing the search results for the image set of keywords, the electronic device 200 determines the subcategories included in the keywords based on the categorization of search results and displays images of multiple subcategories on the first screen.

[0186] For example, in Figure 5A, after obtaining the collection of graduation photos, the individual photos in the collection can be further categorized to determine their respective categories. At this point, by classifying the search results, it is determined that the collection of graduation photos includes 50 photos of people wearing sunglasses and 30 photos of people wearing hats. That is, the keyword "graduation photo" includes two subcategories: wearing sunglasses and wearing hats.

[0187] To ensure that images from multiple subcategories are displayed on the homepage, a reasonable number of images can be selected from each subcategory based on the number of images displayed for the keyword on the homepage. The total number of images from all subcategories displayed on the homepage should be less than or equal to the number of images displayed for the keyword on the homepage. Specifically, the number of images displayed for the "wearing sunglasses" and "wearing hat" subcategories can be determined based on an average distribution principle or the proportion of images of people wearing sunglasses or hats to the total number of graduation photo images.

[0188] Assuming that the keyword "graduation photo" displays 4 images on the homepage, select 2 images from 50 images of people wearing sunglasses to display as images in the "wearing sunglasses" subcategory on the first screen; select 2 images from 30 images of people wearing hats to display as images in the "wearing hats" subcategory on the first screen.

[0189] Furthermore, the priorities of the two subcategories, "wearing sunglasses" and "wearing a hat," can be determined, thus determining their display order on the first screen. Specifically, the priority can be determined by the number of images in each subcategory. Since there are more images of "wearing sunglasses" than "wearing a hat," the "wearing sunglasses" subcategory has a higher priority than the "wearing a hat" subcategory. Therefore, on the first screen of image selection interface 137, the first two images in the first row are of people wearing sunglasses, and the last two are of people wearing hats.

[0190] Furthermore, subcategories of keywords can also be displayed. For example, the graduation photos in Figure 5A include two subcategories: wearing sunglasses and wearing a hat. In this case, a drop-down option can be set on the graduation photo tab button, displaying the labels for wearing sunglasses and wearing a hat. Referring to Figure 5B, which illustrates the subcategories of keywords provided in this embodiment, based on the scenario in Figure 5A, the mobile phone 100, in response to the user clicking the graduation photo tab button 139, displays the graduation photo tab drop-down option interface 143. The graduation photo tab drop-down option interface 143 includes two options: wearing sunglasses and wearing a hat. The user can click the "wear sunglasses" option to trigger the mobile phone 100 to display a tab containing images of all graduation photos with sunglasses; and click the "wear a hat" option to trigger the mobile phone 100 to display a tab containing images of all graduation photos with hats.

[0191] Similarly, the electronic device 200 can further categorize the search results for images within a subcategory to determine the number and types of secondary subcategories included in the subcategory, and display images of multiple secondary subcategories on the first screen. For example, in the scenarios of Figures 3A and 3B, the keyword is "pet," and the subcategories of the keyword "pet" are "dog" and "cat." In this case, the search results for images of "cat" and "dog" can be further categorized. Assuming that the search results for "dog" images are categorized to include 30 images of dogs wearing clothes and 40 images of dogs wearing scarves, then based on the number of images displayed on the first screen for the subcategory "dog," the corresponding number of images are selected from the 30 images of dogs wearing clothes and the 40 images of dogs wearing scarves, respectively, to be displayed on the first screen. Assuming the "dog" subcategory displays 8 images on the homepage, then 4 images will be selected from 30 images of dogs wearing clothes, and 4 images will be selected from 40 images of dogs wearing scarves. Similarly, tabs for the subcategories "wearing scarves" and "wearing clothes" can be created. The specific format is shown in Figure 5B, and will not be elaborated further here.

[0192] In some embodiments, the target information may only include a single keyword, and the candidate image set for the keyword is not further categorized, or the keyword does not include subcategories. In this case, after obtaining the keyword, the electronic device 200 first filters the image set for the keyword based on the matching degree between each image in the image set and the keyword; then, based on the number of images that can be displayed on the first screen, it selects a corresponding number of images from the image set for the keyword based on the matching degree and / or image score (e.g., scoring images based on clarity and composition), and displays the selected images on the first screen. In this way, users can see images with better quality or images that users are more likely to need to upload on the first screen, improving the user experience of selecting images in image upload scenarios. Of course, other methods can also be used (e.g., according to the chronological order of images) to select images to be displayed on the first screen from the image set for the keyword.

[0193] Event-based image recommendation and display:

[0194] After the electronic device 200 displays the application interface on the display screen 230, if it receives a target operation input by the user on the application interface, it retrieves target information related to the application interface content in response to the target operation. The target information may include event information for one or more events. The target operation is an operation for uploading an image.

[0195] In practical applications, after acquiring the target information, the electronic device 200 can parse the target information and extract the event information. The number of events can be obtained based on the number of event information.

[0196] Event information can include, for example, time, location, people, and specific details of the event. Event information can be represented as (4W, when, where, who, what), where when indicates the time the event occurred, where indicates the location the event occurred, who indicates the people, and what indicates the specific object of the event (e.g., animals, plants, and activities), with activities including, for example, running and cycling.

[0197] In some embodiments, if the target information includes only event information of one event, the electronic device 200 extracts the event information from the target information and then filters the event image set from the image set based on the event information.

[0198] The image set for an event may include images of multiple objects or only one object. For example, in the scenario shown in Figure 1B, the target information is the text "On Sunday, my family went to the zoo and saw giant pandas and fierce dogs." The event information extracted from this target information includes Sunday, zoo, giant pandas, and dogs. Based on this event information, images of giant pandas and dogs that simultaneously meet the time (Sunday) and location (zoo) requirements are retrieved from the image set, thus obtaining the image set for the event. In this case, the image set for the event includes images of "dogs" and "giant pandas," that is, images of both "dogs" and "giant pandas."

[0199] If the image set for an event contains only images of a single object, the electronic device 200 can select a corresponding number of images from the image set based on the number of images that can be displayed on the first screen, according to the matching degree of each image and / or the image score (e.g., images can be scored based on clarity and composition), and display the selected images on the first screen. The number of selected images is less than or equal to the number of images that can be displayed on the first screen.

[0200] The electronic device 200 can also select the image to be displayed on the first screen of the event from the image set of the event in other ways. For example, it can select the image to be displayed on the first screen of the event from the image set of the event in chronological order, from newest to oldest or from oldest to newest. Another example is to filter the image set of the event based on the matching degree of each image, selecting images with a matching degree greater than or equal to a matching degree threshold, and then selecting the image to be displayed on the first screen of the event from the images with a matching degree greater than or equal to a matching degree threshold in chronological order, from newest to oldest or from oldest to newest.

[0201] If the image collection for an event includes images of multiple objects, to ensure that the initial screen displays images of all objects, a corresponding number of images can be selected from the images of each object, based on the number of images and categories that can be displayed on the initial screen. The total number of images displayed for all objects on the initial screen should be less than or equal to the number of images that can be displayed on the initial screen.

[0202] For example, the initial screen can display 16 images. An event's image set includes 30 images of "dogs" and 40 images of "pandas." In this case, 8 images are selected from the 30 "dog" images to display as the "dog" object on the initial screen; similarly, 8 images are selected from the 40 "panda" images to display as the "panda" object. Displaying images of multiple objects within an event on the initial screen allows users to easily access images of all objects without having to flip through pages, thus improving the convenience of image selection.

[0203] Optionally, when selecting an image to display on the home screen for a specific object, the selection can be based on the matching degree of each image. For example, based on the matching degree of each image with the word "giant panda," the image to be displayed on the home screen for that object can be selected from images in the "giant panda" category.

[0204] When selecting an image to display on the home screen for a specific object, you can also choose based on the scores of the images. For example, you can score images based on their clarity, content, and composition; and select the image to display on the screen for that object based on its score. Alternatively, you can randomly select an image from a list of images for that object to display on the home screen.

[0205] However, by selecting images for display on the homepage based on their matching accuracy or score, the quality of the images displayed can be better, and they are more likely to be the images the user needs to upload, thus improving the user's image selection experience. Optionally, after selecting images for each object in the event to display on the homepage, the electronic device 200 can first determine the priority of each object, and then display its images on the homepage according to that priority. Objects with higher priority will have their images displayed earlier on the homepage. This prioritizes high-priority images, improving the ease of image selection for the user.

[0206] For example, the electronic device 200 can determine the priority of objects based on the number of images of each object. For instance, when the candidate image set includes 30 images of "dogs" and 40 images of "pandas," the priority of "dogs" is lower than that of "pandas."

[0207] Of course, the electronic device 200 can also determine the priority of objects in other ways. For example, the priority of each object can be determined based on its frequency of occurrence and description complexity in the target information. In this case, assuming the candidate image set for an event includes two objects, "dog" and "panda," and the target information includes a lengthy text description of "panda," then the frequency of occurrence and description complexity of "panda" are considered higher than that of "dog," thus determining that "panda" has a higher priority than "dog." For example, priority can be sorted by the distance between the cursor position of the inserted image and the position of the text of each object. The closer the distance, the higher the priority. The position of the object's text refers to the position of the text describing the object on the interface; the priority of each object is determined based on the distance between this position and the position of the inserted image (i.e., the cursor position). Alternatively, the priority of each object can be determined by at least two of the following: the number of images of the object, the frequency of occurrence and description complexity of the object, and the distance between the object's text position and the cursor position of the inserted image.

[0208] In determining the number of images displayed for each object on the first screen based on the number of images that can be displayed on the first screen (i.e., the number of first images), the electronic device 200 can use an average distribution principle. Alternatively, the electronic device 200 can use other methods. For example, it can determine the number of images displayed for each object based on the proportion of images displayed for each object, with the number of images for an object being positively correlated with the number of images displayed on the first screen. Another example is that it can determine the number of images displayed for each object based on its priority; higher-priority objects have more images displayed on the first screen, meaning the object's priority is positively correlated with the number of images displayed on the first screen.

[0209] Optionally, the electronic device 200 can aggregate and display images of the same object on the main screen. This arranges the images of the same object side-by-side on the main screen, further improving the ease of image selection for the user.

[0210] Optionally, the electronic device 200 can also display tabs for each object. This reduces interference from images of other objects when the user selects an image of a particular object, thus improving the user experience.

[0211] For example, referring to Figure 6A, which illustrates a single-event, multi-category image display diagram provided in this application embodiment, based on the scenarios in Figures 1A and 1B, the mobile phone 100 displays a Weibo creation interface 115. The Weibo creation interface 115 includes the text content entered by the user: "During the National Day holiday, my family went to the Shanghai Wild Animal Park and saw giant pandas, fierce dogs, and beautiful cats." When the user clicks the image insertion button 116 on the Weibo creation interface 115, the mobile phone 100 responds to the click operation and obtains the target information of the Weibo post 103. At this time, the target information is text content information, specifically: "During the National Day holiday, my family went to the Shanghai Wild Animal Park and saw giant pandas, fierce dogs, and beautiful cats."

[0212] Mobile phone 100 extracts event information from the target information. This event information may include multiple keywords such as National Day, Shanghai Wild Animal Park, giant pandas, dogs, and cats. Based on a combined search using these keywords, it filters images from image library 102 that meet both the time requirement (National Day) and the location requirement (Shanghai Wild Animal Park), resulting in an image set for the event. In other words, it selects images of dogs, giant pandas, and cats taken at the Shanghai Wild Animal Park during National Day from the image set. At this point, the target information includes event information for one event.

[0213] After obtaining the image set of the event, the mobile phone 100 determines the number of images of each object to be displayed on the first screen based on the number of images that can be displayed on the first screen. Then, based on the number of images of each object to be displayed on the first screen, it selects the corresponding number of images from the images of dogs, pandas, and cats respectively, and displays the selected images on the first screen.

[0214] For example, suppose the image set for an event includes 10 pictures of dogs, 20 pictures of pandas, and 15 pictures of cats. The initial screen can display 16 images, with each object displaying 4 images on the initial screen. In this case, 4 images are selected from the 10 dog images; 4 images are selected from the 20 panda images; and 4 images are selected from the 15 panda images; these 4 images are displayed as the "dogs" on the initial screen. Alternatively, 5 dog images, 6 panda images, and 5 cat images could be selected and displayed on the initial screen.

[0215] At this point, the phone can select the images for each object to be displayed on the homepage based on their image scores. For example, for 20 images of giant pandas, the phone can score the images based on factors such as image clarity, content, and composition, and then sort the images according to their scores. The top four images with the highest scores will be selected as the images for displaying "Giant Panda" on the homepage.

[0216] The phone can also determine the priorities of cats, dogs, and pandas to determine the display order of their images on the home screen. In this case, let's assume the cat has the highest priority and the panda has the lowest.

[0217] Based on the priority of cats, dogs, and pandas, and the four images of the three selected objects (cats, dogs, and pandas) displayed on the home screen, mobile phone 100 displays image selection interface 144.

[0218] On the initial screen of the image selection interface 144, four cat images are displayed in the first row, four dog images in the second row, and four panda images in the third row. The image selection interface 144 also displays a "Recommendation Page" button 145, which is shown below in Figure 6A.

[0219] Optionally, the phone 100 can also display tabs for three objects: cat, dog, and panda, with the tab buttons arranged in the same order as the order in which these three objects are displayed on the home screen. In this case, the order in which the three objects are displayed on the home screen is: cat, dog, panda. Therefore, the phone 100 displays the cat tab button 146, the dog tab button 147, and the panda tab button 148 on the image selection interface 144. The panda tab button 148 is displayed outside the image selection interface 144, and users can find it by swiping. The cat tab button 146 is closest to the recommendation page button 145, while the panda tab button 148 is furthest from the recommendation page button 145.

[0220] Users can trigger the display of a corresponding tab on mobile phone 100 by clicking a tab button. The tab displays all images of that category. For example, when a user clicks the cat tab button 146, mobile phone 100 responds to the click operation and displays the cat tab page 149 shown in Figure 6B. The cat tab page 149 can display images of all cats on mobile phone 100, instead of just the cat images taken at the Shanghai Zoo during the National Day holiday. Figure 6B is a schematic diagram of the cat tab page provided in an embodiment of this application.

[0221] In Figures 6A and 6B, mobile phone 100 displays images of dogs, cats, and pandas that meet the time and location requirements on the home screen, effectively displaying images of all objects. This allows users to access images of the relevant objects directly from the home screen when creating a Weibo post, eliminating the need to flip through pages. Users can then select the images to upload to Weibo 103 directly from the home screen, thus improving the convenience of image selection. Furthermore, the images of dogs, cats, and pandas are aggregated and prioritized, allowing higher-priority images to be displayed first, making it even easier for users to select the images they need to upload.

[0222] In other embodiments, if the target information includes event information of at least two events, the electronic device 200 extracts the event information from the target information and then filters out the image set of each event from the image set based on the event information of each event.

[0223] To ensure that all event images are displayed on the first screen, the electronic device 200 selects a corresponding number of images from the image set for each event, based on the number of images that can be displayed on the first screen. The total number of images displayed for all events on the first screen is less than or equal to the number of images that can be displayed on the first screen. The number of images displayed for each event on the first screen can be the same or different.

[0224] When determining the number of images to display for each event on the first screen based on the total number of images that can be displayed, an average distribution method can be used. For example, if the first screen can display 16 images and there are 2 events, then each event will display 8 images. Alternatively, other methods can be used, such as considering the importance of each event or its proportion in the image count. Events with higher importance or a larger proportion of images will display more images on the first screen. For example, if the first screen can display 16 images and there are two events, and the first event is more important than the second, then the first event will display 10 images, and the second event will display 6 images.

[0225] For each event, the electronic device 200 can select a corresponding number of images from the event's image set based on the number of images displayed on the first screen of the event. For example, if the event's image set contains 50 images, and 8 images are displayed on the first screen, these 50 images are sorted according to their matching degree, and the top eight matching images are selected as the images displayed on the first screen of the event. The matching degree of the images refers to the degree to which the images match the event information. Of course, the electronic device 200 can also select a corresponding number of images from the event's image set in other ways. For example, it can randomly select a corresponding number of images from the event's images, or it can score each image in the event's image set (e.g., based on clarity and composition), and select a corresponding number of images from the set based on the scores.

[0226] Specifically, when selecting images for an event from the event's image set based on the number of images displayed on the first screen, selection can be based on the degree of matching between each image and an object in the event (i.e., the "what"), the image score, or the chronological order of the images. When the event includes multiple objects (i.e., the "what" includes multiple objects), a corresponding number of images can be selected from each object, ensuring that the total number of images selected from all objects is less than the number of images displayed on the first screen.

[0227] In comparison, selecting images from the event's image set based on matching degree or image score for the first screen can result in higher quality images displayed on the first screen, or at a higher probability that the images are the ones the user needs to upload, thereby further improving the user's image selection experience.

[0228] Optionally, the electronic device 200 can also sort multiple events to determine the priority of each event. The priority of an event is related to the order in which its image is displayed on the first screen. Generally, the higher the priority of an event, the earlier its image is displayed on the first screen.

[0229] For example, an electronic device can calculate the importance of an event based on at least one of the following: the completeness of the event content, its frequency of occurrence and descriptive complexity, the distance between the insertion point and the location of the corresponding text, and time precision and location precision. The device can then rank the events according to their importance (i.e., determine their priority). Events with higher importance have higher priority.

[0230] The completeness of event content refers to the completeness of event information. For example, the completeness of event content can be determined based on the missing 4W information (when, where, who, what). The higher the completeness of event content, the greater the importance of the event.

[0231] Frequency of occurrence and descriptive complexity refer to how often the event appears in the target information and the length of the description of the event. The higher the frequency of occurrence and descriptive complexity, the greater the importance of the event.

[0232] The distance between the insertion point and the corresponding text of the event refers to the distance between the image insertion point and the corresponding text of the event, in the case of inserting an image into text. The smaller the distance, the higher the importance of the event.

[0233] Time precision and location precision refer to the accuracy of time and location information in an event. The higher the precision, the greater the importance of the event. For example, if the first event is in October and the second event is on October 1st, the time precision of the second event is higher than that of the first event.

[0234] When determining event priority based on at least two of the following factors: completeness of event content, frequency of occurrence, complexity of description, distance between the insertion position and the corresponding text position, and time and location precision, a weight can be assigned to each factor. The scores of each factor are then multiplied by their respective weights, and the products are summed to obtain the total score for the event. Based on the total scores of all events, the importance of each event is determined, thus determining its priority.

[0235] In addition, event priority can be determined according to the order in which they occurred. For example, the further back in time an event occurred, the higher its priority. The priority of events can also be determined based on the number of images associated with each event. For example, the more images an event has, the higher its priority.

[0236] After obtaining the images of each event displayed on the main screen and the priority of each event, the electronic device 200 can display images of multiple events on the main screen. Images of the same event can be displayed together on the main screen, or they can be displayed separately.

[0237] Electronic device 200 displays images of multiple events on its home screen, allowing users to access these images directly without having to flip through pages, thus improving image selection convenience. Furthermore, the events are sorted to determine their order of appearance on the home screen, prioritizing images of higher-priority events and further enhancing image selection ease.

[0238] Optionally, if the image set for an event includes images of one or more objects, the electronic device 200 can also display an object tab. For example, if the image set for an event includes images of cats, the electronic device 200 can display a tab that includes images of all cats.

[0239] For each of multiple events, the image set for that event may include images of multiple objects or images of a single object. If the image set for an event includes images of only one object, the electronic device 200 can select a corresponding number of images from the image set for the event based on the number of images displayed on the first screen, according to the matching degree of each image and / or the image score (e.g., scoring images based on clarity and composition), and display the selected images on the first screen. The number of selected images is less than or equal to the number of images displayed on the first screen for the event.

[0240] If the image set for an event includes images of multiple objects, optionally, to ensure that the first screen displays images of multiple objects, a corresponding number of images can be selected from the images of each object, based on the number of images and categories displayed for the event on the first screen, and used as the images for each object displayed on the first screen. The total number of images of all objects displayed on the first screen is less than or equal to the number of images of the event displayed on the first screen.

[0241] For example, the home screen can display 16 images, and a certain event displays 8 images on the home screen. The image set for a certain event includes 30 images of "dogs" and 40 images of "pandas," with each object displaying 4 images on the home screen. In this case, 4 images are selected from the 30 "dog" images to be displayed as the "dog" images on the home screen; and 4 images are selected from the 40 "panda" images to be displayed as the "panda" images on the home screen.

[0242] Displaying images of multiple objects within an event on the first screen allows users to easily access these images without having to flip through pages, thus improving the ease of image selection.

[0243] Optionally, after selecting the images to display on the first screen for each object of the event, the electronic device 200 can first determine the priority of each object, and then display the images of each object on the first screen according to their priority. The higher the priority of an object, the more prominent its image will be on the first screen. This prioritizes displaying high-priority images, improving the user's ability to edit selected images.

[0244] Optionally, the electronic device 200 can aggregate and display images of the same object on the main screen. This arranges the images of the same object side-by-side on the main screen, further improving the ease of image selection for the user.

[0245] Optionally, the electronic device 200 can also display tabs for each object. This reduces interference from images of other objects when the user selects an image of a particular object, thus improving the user experience.

[0246] For example, referring to Figure 7, which shows a schematic diagram of the image display of multiple events provided in an embodiment of this application, based on the scenario in Figure 1A, after the mobile phone 100 launches Weibo 103, it displays the Weibo creation interface 159. The Weibo creation interface 159 includes the text content entered by the user: "On October 1st, my family went to Shanghai Wild Animal Park. On October 2nd, my family went to Haichang Ocean Park and watched the orca show."

[0247] When a user clicks the image insertion button 116 on the Weibo creation interface 159, the mobile phone 100 responds to the click operation and obtains the target information of Weibo 103. At this time, the target information is text content information, specifically: "On October 1st, my family went to the Shanghai Wild Animal Park. On October 2nd, my family went to Haichang Ocean Park and watched the orca show."

[0248] Mobile phone 100 extracts event information from the target information, obtaining event information for Event 1 and Event 2. Event information for Event 1 may include multiple keywords such as October 2nd, Haichang Ocean Park, and orcas. Event information for Event 2 may include multiple keywords such as October 1st and Shanghai Wild Animal Park.

[0249] Mobile Phone 100 performs image retrieval based on event information for each event. Specifically, for Event 1, it performs a combined search using multiple keywords such as October 2nd, Haichang Ocean Park, and orcas, filtering images from Image Library 102 that meet the time (October 2nd) and location (Haichang Ocean Park) requirements to obtain a candidate image set for this event. In other words, it selects images of orcas taken at Haichang Ocean Park on October 2nd from the image set.

[0250] For event 2, a combined search was performed using multiple keywords, including October 1st and Shanghai Wild Animal Park. Images meeting both the time (October 1st) and location (Shanghai Wild Animal Park) criteria were selected from images in image library 102 to obtain a candidate image set for the event. In other words, images taken at Shanghai Wild Animal Park on October 1st were selected from the image set.

[0251] When determining the importance of Event 1 and Event 2, Mobile Phone 100 determined that the completeness of Event 1's event content was higher than that of Event 2 because Event 2's event content did not include "what" information, while Event 1's event content included "what" information (i.e., the orca). Therefore, Event 1 was deemed more important than Event 2.

[0252] In other words, on the first screen, the image for event 1 is displayed earlier than the image for event 2.

[0253] Based on the number of images that can be displayed on the first screen, phone 100 selects images from the image sets of Event 1 and Event 2. Assuming the first screen can display 16 images, and both Event 1 and Event 2 display 8 images on the first screen, phone 100 can select 8 orca images from Event 1's image set and 8 images from Event 2's image set based on image scores and / or matching degrees.

[0254] Based on the images displayed on the home screen for each event and the event priority, the mobile phone 100 displays an image selection interface 151. The image selection interface 151 includes a recommendation page button 151, which is shown in Figure 7. The home screen of the image selection interface 151 displays images for event 1 and event 2, with the eight orca images for event 1 and the eight images for event 2 displayed together.

[0255] In this way, when users create a Weibo post, if they need to insert images, they can obtain the images for Event 1 and Event 2 from the first screen of the image selection interface 151, without having to flip through pages to find the images for Event 1 and Event 2, making it more convenient. In addition, the aggregated display of multiple images for the same event, as well as the priority presentation of images for events with higher priority, can further improve the convenience for users to select images.

[0256] At this time, the phone 100 also displays the Orca tab. That is, the image selection interface 151 also displays the Orca tab button 153. The user can click the Orca tab button 153 to make the phone 100 display the Orca tab.

[0257] In the scenarios shown in Figures 3A, 4, 5A, 6A, and 7, when a user creates text (such as notes and microblogs), if they need to upload images, the mobile phone 100 recommends images based on the acquired text information (such as keywords and the text content entered by the user). The recommended images are then intelligently sorted and displayed on the first screen. This allows the first screen to display images of multiple elements (such as multiple keywords, multiple events, multiple objects within events, and multiple subcategories within keywords), making it easier and more convenient for users to find the images they want to upload directly from the first screen.

[0258] In some embodiments, when the electronic device 200 performs image retrieval based on event information, it may perform the retrieval based on multiple dimensions of information. For example, it may perform a combined retrieval based on dimensions such as the time, location, and object of the event. In this embodiment, if an image retrieval is performed based on event information and no results are found, intelligent backtracking retrieval can be performed to obtain the results.

[0259] Intelligent rollback retrieval refers to removing one or more dimensions of information before performing a search. For example, if event information includes multiple keywords such as October 2nd, Haichang Ocean Park, and orcas, and a search for images based on these keywords yields no matching images (i.e., no search results), then at least one of October 2nd, Haichang Ocean Park, and orcas can be removed before performing the image search again. For instance, after removing the time dimension of October 2nd, a search for images based on the keywords "Haichang Ocean Park" and "orcas" will retrieve images of orcas taken at Haichang Ocean Park.

[0260] In this embodiment of the application, when no results are found in the image search, intelligent rollback can be performed to avoid a poor user experience caused by no search results.

[0261] In the embodiments described above, when selecting images, the electronic device 200 can first perform similarity clustering on the images, and then select one or more preferred images from the same cluster, placing the preferred images from the same cluster at the front of the list of preferred images. This avoids interference from multiple identical images, further improving the convenience and experience of image selection.

[0262] For example, in a scenario involving a single keyword and a single subcategory, the electronic device 200, after selecting an image set for the keyword from an image collection, performs similar image clustering on the keyword's image set to obtain a similar image set. Optionally, the electronic device 200 can aggregate and categorize similar images based on information such as the image content, the time the image was captured, and the location where the image was captured, to generate a similar image set.

[0263] For each set of similar images, the images are sorted, and a predetermined number of images at the top of the sort are selected as preferred images. Optionally, for each similar image in the same set of similar images, the electronic device 200 can score the images based on information such as image composition, image color, and image clarity to obtain a score for each similar image; the images are then sorted according to their scores, and preferred images are selected based on their scores.

[0264] When displaying images that match keywords, the electronic device 200 prioritizes the display of preferred images and prioritizes the display of non-preferred images within the same set of similar images.

[0265] For example, referring to Figure 8, which shows a schematic diagram of similar image sorting optimization provided in an embodiment of this application, after the mobile phone 100 displays the cup template details interface 154 of Xiaohongshu 104, the user clicks the "Use Now" button on the cup template details interface 154, and the mobile phone 100 displays the image selection interface 155.

[0266] After a user clicks the "Use Now" button on the cup template details page 154, mobile phone 100 obtains the target information from Xiaohongshu 104. At this time, the target information includes the keyword "cup".

[0267] Mobile phone 100 filters images matching the cup from image library 102 to obtain a set of cup images. Similar images in the cup image set are then clustered to obtain similar image sets. Assuming images 156, 158, and 159 are in one similar image set, and images 157, 160, and 161 are in another, an aesthetic evaluation is performed on each image in the two similar image sets based on factors such as composition, color, and sharpness, resulting in a score for each image. At this point, within the same similar image set, image 156 has the highest score, which is higher than image 158, and higher than image 159. Image 156 is selected as the preferred image in this similar image set, while images 157 and 158 are considered non-preferred images.

[0268] Similarly, within the same set of similar images, image 157 has the highest score, which is higher than that of image 160, and higher than that of image 160. Therefore, image 157 is selected as the preferred image in this set of similar images, while images 160 and 161 are not preferred images.

[0269] In the image selection interface 155, for the same set of similar images, the image with the highest score 156 is displayed first, and the image with the lowest score 159 is displayed last. Similarly, for the same set of similar images, the image with the highest score 157 is displayed first, and the image with the lowest score 161 is displayed last.

[0270] To better illustrate the solution provided in the embodiments of this application, the following description is provided in conjunction with the flowchart of image recommendation and display based on keywords and text content shown in Figure 9.

[0271] As shown in Figure 9, when obtaining application keywords, the electronic device 200 performs image retrieval based on the keywords. When obtaining application text, the electronic device 200 can extract event information from the text and perform image retrieval based on the event information.

[0272] In practical applications, applications can pass keywords or text content to the gallery app by calling an image picker (such as PhotoPicker). After obtaining the keywords or text, the image picker can then recommend and display images based on them. The image picker can be a component of the gallery app.

[0273] For example, in Figure 3A, after the user clicks the "Use Now" button 112, Xiaohongshu 104 calls PhotoPicker and sends the keyword "pet" to the image library 102. For example, in Figure 6A, after the user clicks the "Insert Image" button 116, Weibo 103 calls PhotoPicker and sends the text "During the National Day holiday, my family went to the Shanghai Wild Animal Park and saw giant pandas, fierce dogs, and beautiful cats" to the image library 102.

[0274] After receiving the text sent by the application, the electronic device 200 intelligently generates event groups, that is, it extracts event information (4Ws, when, where, who, what) by parsing the text content. As shown in Figure 9, event information for event 1, event 2, ..., event n may be extracted. n is a positive integer greater than or equal to 1.

[0275] If event information from multiple events is extracted, intelligent multi-event sorting is performed, that is, the multiple events are sorted. Specifically, the importance of an event can be calculated based on information such as the completeness of the event content, frequency of occurrence and complexity of description, the position of the image insertion location in the text, time precision and location precision, and then the events are prioritized according to their importance.

[0276] Optionally, if the number of events exceeds a threshold, a certain number of target events can be selected based on their importance, and images of these target events can be displayed on the first screen. For example, if the threshold is 3, and the number of events exceeds 3, then the top three most important events will be selected based on their importance, and images of these three events will be displayed on the first screen.

[0277] Optionally, if no results are found when searching for images based on event information, a smart rollback search can be performed. Please refer to the above text for an introduction to smart rollback search; it will not be repeated here.

[0278] If image retrieval is performed based on event information, images for each event can be obtained. As shown in Figure 9, images for event 1, event 2, ..., event n can be retrieved.

[0279] After obtaining the search results from the image search, the search results can be categorized.

[0280] Search result categorization can be based on classifying objects within an event. For example, in the scenario shown in Figure 6A, the event includes three objects: cats, dogs, and pandas. Search results can be further categorized by cat, dog, or panda. Let's assume we categorize the search results for cat images, obtaining a classification result that shows 20 images of cats wearing hats and 30 images of cats wearing scarves. When selecting images of "cat" to display on the first screen, to ensure that both hat-wearing and scarf-wearing states are shown, we can select the appropriate number of images from the 20 hat-wearing images and the 30 scarf-wearing images, respectively, based on the number of images of "cat" displayed on the first screen.

[0281] Search result categorization can also be done by classifying images related to keywords. For example, in the scenario of Figures 5A and 5B, the search results for graduation photos can be further categorized. Please refer to the above for details, which will not be repeated here.

[0282] After categorizing the search results, similar image clustering and aesthetic evaluation can be performed sequentially. These two processes aim to select the best images from multiple similar images, avoiding excessive duplication of similar images that could interfere with the user's selection.

[0283] Similar image clustering refers to aggregating and classifying similar images based on information such as image content, shooting time, and shooting location to generate a set of similar images. Aesthetic evaluation refers to scoring similar images within the same set based on information such as composition, color, and sharpness, and then ranking them according to the scores.

[0284] It can perform similar image clustering and aesthetic evaluation on events, objects in events, keywords, and subcategories of keywords.

[0285] For example, in a multi-keyword scenario, after retrieving image sets for each keyword from the image collection, similar images are clustered for each keyword's image set to obtain similar image sets and images not clustered into similar image sets; for each similar image set, aesthetic evaluation is performed on each similar image, and the preferred image is selected based on the score of each similar image; from the preferred images and images not clustered into similar image sets, the image for that keyword displayed on the first screen is selected.

[0286] It should be noted that the search result classification, similar image clustering, and aesthetic evaluation are optional steps, meaning that these three steps can be omitted.

[0287] In the completeness display calculation step, the electronic device 200 can reasonably select the appropriate number of images from the images of each event, the images of objects in the event, the images of keywords, or the images of subcategories of keywords, based on the number of images that can be displayed on the first screen. This ensures that multiple event images are displayed on the first screen (e.g., the scenario shown in Figure 7), multiple keyword images are displayed on the first screen (e.g., the scenario shown in Figure 5A), multiple object images are displayed on the first screen, or multiple subcategories of images are displayed on the first screen (e.g., the scenarios shown in Figures 3A and 4).

[0288] After calculating the completeness of the display, the images displayed on the first screen are obtained, which is the recommended image list. The recommended image page is then displayed based on this list.

[0289] As can be seen from the above, the embodiments of this application can ensure the richness of the content displayed on the first screen when the user selects images, thereby ensuring that the user can find the core element images on the homepage. Here, richness of content refers to the fact that images of multiple key elements expressed in the target information (such as text or keywords), or elements related to the target information, can be displayed on the first screen (i.e., the first page of the image selection interface), avoiding the need to swipe the screen to flip through pages to find the key element images. This improves the convenience for users to select images.

[0290] Please refer to Figure 10A, which shows a schematic flowchart of an image display method provided in an embodiment of this application. The method may include the following steps:

[0291] Step S1001: Electronic device 200 displays the application interface.

[0292] For example, the application could be Weibo 103 and Xiaohongshu 104 mentioned above. The application interface could be the Weibo creation interface 159 in Figure 7, or the puppy outfit template interface 128 in Figure 4.

[0293] In step S1002, the electronic device 200 responds to the target operation on the application interface by obtaining the target information of the application. The target information is related to the content of the application interface, and the target operation is used to upload an image.

[0294] For example, the target operation could be a click on the "Insert Image" button 116 in the Weibo creation interface 159 in Figure 7, or a click on the "Use Now" button in the puppy outfit template interface 128 in Figure 4.

[0295] The target information can include text content or keywords.

[0296] The target information can be information sent by the application in response to a target action. For example, Xiaohongshu 104 can respond to a click on the "Use Now" button on the puppy outfit template interface 128 in Figure 4 by calling PhotoPicker to send the keyword "dog" to the gallery 102.

[0297] The application's interface content can be the content displayed by the application's interface itself, such as the "Puppy Outfit Template" interface 128 in Figure 4, which displays "Puppy Outfit Diary"; or it can be the content entered by the user on the application's interface, such as the text content entered by the user in the Weibo creation interface 159 in Figure 7.

[0298] Step S1003: The electronic device 200 obtains a set of target candidate images for each target element from the image set based on the first image quantity and target information. The target element is determined based on the target information. The set of target candidate images includes at least one target candidate image. The sum of the total number of target candidate images for each target element is less than or equal to the first image quantity. The first image quantity is the number of images that can be displayed on the first screen of the image selection interface.

[0299] Target elements can be keywords in the target information. For example, in Figure 5A, the target information includes multiple keywords such as graduation photo, podium, classroom, and playground. Graduation photo, podium, classroom, and playground are target elements.

[0300] Target elements can be categories of objects described by keywords in target information. For example, in Figure 3A, the target information includes the keyword "pet." Pets include two categories (or subcategories) of cats and dogs, and cats and dogs are target elements.

[0301] The target element can be the event described in the target information. For example, in Figure 7, the target information is the text content sent on Weibo, which describes event 1 and event 2. Event 1 and event 2 are the target elements.

[0302] Target elements are the objects in the event described by the target information. For example, in Figure 6A, the target information is the text content of a Weibo post, and the event described in the text content includes three objects: cats, dogs, and pandas. Cats, dogs, and pandas are target elements. Typically, the objects in an event are the "what" in the event; "what" can refer to animals, plants, activities, or other things, and is not limited here.

[0303] The total number of candidate images for each target element being less than or equal to the number of images in the first screen means that, in order for the first screen to display the candidate images for each target element, the total number of images displayed for each target element on the first screen is less than or equal to the number of images that can be displayed on the first screen.

[0304] For example, when the target element is a keyword, refer to Figure 5A showing a scenario with multiple keywords. Each keyword displays four images on the first screen. In this case, the target candidate image set for the graduation photo includes four images displayed on the first screen (i.e., target candidate images), the target candidate image set for the podium includes four images displayed on the first screen (i.e., target candidate images), the target candidate image set for the classroom includes four images displayed on the first screen (i.e., target candidate images), and the target candidate image set for the playground includes four images displayed on the first screen (i.e., target candidate images). The specific selection process can be found above and will not be repeated here.

[0305] For example, when the target element is a subcategory of a keyword, see the scenario of multiple sub-states for a single keyword in Figure 4. The number of images displayed on the first screen for each state is 4. The target candidate image set for states 1 to 4 each includes 4 images displayed on the first screen (i.e., target candidate images).

[0306] For example, when the target element is an event, see the multi-event scenario shown in Figure 7, where each event displays 8 images on the first screen. In this case, the target candidate image set for each of events 1 to 2 includes 8 images displayed on the first screen (i.e., target candidate images).

[0307] The target candidate images for a target element are the images displayed on the first screen of the interface. The number of images displayed on the first screen for various target elements can be the same or different; this is not limited here.

[0308] When retrieving candidate images for each target element from the image collection based on the number of images displayed on the first screen, selection can be made according to at least one of the following: image chronological order, image score, and image matching degree. The specific selection process can be found above and will not be repeated here.

[0309] In step S1004, the electronic device 200 displays candidate images of each target element on the first screen interface.

[0310] For example, as shown in Figure 7, mobile phone 100 displays images of event 1 and event 2 on the home screen.

[0311] It should be noted that, normally, all images displayed on the first screen are shown in their entirety, meaning all images are fully displayed within the display area of ​​the first screen. However, in some cases, due to issues such as image layout on the first screen, some images may not be displayed completely; that is, only a portion of an image may be visible on the first screen, and only a part of the image may be displayed.

[0312] For example, referring to the image display diagram of the first screen interface shown in Figure 10B, the first screen interface cannot display images 162 to 165 completely; that is, only portions of images 162 to 165 are visible on the first screen interface. Taking image 162 as an example, image 162 consists of two parts, part 1 and part 2. Part 1 is displayed on the first screen interface, while part 2 is not displayed. In other words, only part 1 of image 162 is visible on the first screen interface, and part 2 is not visible.

[0313] In this embodiment, for an image that is not fully displayed on the first screen, its inclusion on the first screen can be determined by the proportion of the area of ​​the portion of the image displayed on the first screen to the total area of ​​the image. This proportion can be set according to actual needs. For example, it can be set to 50%, meaning that if the area of ​​an image displayed on the first screen exceeds 50% of the total image area, the image is considered to be displayed on the first screen; otherwise, it is considered not to be displayed on the first screen.

[0314] As can be seen from the above, by displaying the target candidate images of each target element on the first screen, users can obtain images of multiple target elements on the first screen without having to flip through pages to obtain images of target elements. This makes it simpler and faster to select the image to be uploaded, thus improving the user experience.

[0315] In some possible implementations, if at least two target elements are included, and these at least two target elements include a first target element and a second target element, during the process of displaying the target candidate images of each target element on the first screen interface, the electronic device 200 can display the target candidate images of the first target element and the second target element on the first screen interface according to their priorities. The first target element has a higher priority than the second target element, and the display position of the target candidate image of the first target element is earlier than that of the target candidate image of the second target element.

[0316] For example, when the target element is an event, the priority of the two target elements can be determined by their relative importance. When the target element is a keyword, the priority can be determined by the order in which the keywords were retrieved. When the target element is an object within an event, the priority of the object can be determined by the number of images of the object. When the target element is a subcategory within a keyword, the priority of the object can be determined by the number of images of the subcategory.

[0317] In some possible implementations, the first target element among the target elements includes a first sub-element and a second sub-element. In this case, during the process of displaying the target candidate images of each target element on the first screen, the electronic device 200 can determine the priority of the first sub-element and the second sub-element; according to the priority, the images of the first sub-element and the second sub-element are displayed on the first screen, with the first sub-element having a higher priority than the second sub-element, and the image of the first sub-element being displayed earlier than the image of the second sub-element. The target candidate images of the target element include the images of the first sub-element and the second sub-element.

[0318] For example, when the target element is an event, the child elements can be objects within the event. The method for determining the priority of objects can be found above and will not be repeated here. When the target element is a keyword, the child elements are subcategories within the keyword. For example, the subcategories of the keyword "graduation photo" are "wearing a hat" and "wearing sunglasses." For example, the priority of a child element can be determined based on the number of images for each child element; the number of images for a child element is directly proportional to its priority.

[0319] In some possible implementations, the electronic device 200 may also display a tab for target elements or a tab for sub-elements on the image selection interface. The tab for target elements includes target candidate images of the target elements, and the tab for sub-elements includes images of the sub-elements. The target elements include sub-elements.

[0320] In some possible implementations, during the process of obtaining a set of candidate images for each target element from the image set based on the first number of images and target information, the electronic device 200 can obtain a set of candidate images for each target element from the image set based on the target information; for each target element, it selects a target candidate image from the candidate image set; wherein the number of selected target candidate images is determined based on the first number of images, and the number of selected target candidate images is the number of images of the target element displayed on the first screen interface. The image set may include images from the image library 102.

[0321] In some possible implementations, during the process of selecting a target candidate image from a set of candidate images, the electronic device 200 can perform similar image clustering on the candidate image set to obtain a set of similar images; for each set of similar images, after sorting each similar image in the set of similar images, select a first preset number of similar images, which are the target similar images of the set of similar images; and select the target candidate image from the target similar images of each set of similar images, as well as the candidate images that have not been clustered into the set of similar images.

[0322] The target similar image can be one of the preferred images mentioned above. It can score images based on aesthetic evaluation and select the preferred image based on the score.

[0323] In some possible implementations, in the image selection interface, the target similar image in the similar image set is displayed earlier than the non-target similar images in the similar image set.

[0324] In some possible implementations, if the target element includes at least two sub-elements, the electronic device can perform similar image clustering on the images of each sub-element to obtain a set of similar images for each sub-element, and the candidate image set includes the images of each sub-element.

[0325] In some possible implementations, the target information is textual information obtained from the application's interface content.

[0326] In some possible implementations, the target element is the event described in the target information, the object in the event described in the target information, the keyword in the target information, or the classification of the object described by the keyword in the target information (e.g., a subcategory of the keyword).

[0327] In some possible implementations, the target element is an event or an object within an event. During the process of obtaining candidate image sets for each target element from an image set based on the target information, the electronic device 200 can extract event information from the target information; use the event information to perform image retrieval in the image set to obtain candidate image sets for each event or each object within an event. When at least two events are included, the electronic device 200 can also determine the importance of each event; based on the importance of each event, it can prioritize the at least two events to determine the order in which the images of each event are displayed on the first screen interface.

[0328] In some possible implementations, the electronic device 200 can also perform a new image search in the image set based on target event information when it fails to find an image matching the event information during image retrieval from the image set based on event information. The target event information is the event information obtained after removing one or more dimensions of the event information. This is known as intelligent backtracking retrieval.

[0329] In some possible implementations, the target element is a category of objects described by keywords; in the process of obtaining candidate image sets for each target element from the image set based on the target information, the electronic device 200 can perform image retrieval based on the keywords in the target information to obtain the keyword retrieval results; the keyword retrieval results are classified to obtain target candidate image sets for each category.

[0330] It should be noted that any similarities or differences between this embodiment and the embodiments described above can be found in the corresponding content above, and will not be repeated here.

[0331] Please refer to Figure 11 for a flowchart illustrating an image display method provided in an embodiment of this application. The method may include the following steps:

[0332] Step S1101: Electronic device 200 displays the application interface.

[0333] In step S1102, the electronic device 200 responds to the target operation on the application interface by obtaining the target information of the application. The target information is related to the content of the application interface, and the target operation is used to upload an image.

[0334] Step S1103: The electronic device 200 obtains images of each target element from the image set based on the target information. The target elements are determined based on the target information.

[0335] Step S1104: Electronic device 200 determines the priority of each target element among at least two target elements.

[0336] The target elements are the events described in the target information, the objects in the events described in the target information, the keywords in the target information, or the classification of the objects described by the keywords in the target information.

[0337] When the target element is an event, extract event information for at least two events from the target information; based on the event information, determine the priority of each event among the at least two events; and use the event information of each event to retrieve the images (or image sets) of each event from the image set.

[0338] When the target element is a keyword, you can use the keyword to search for images in the image collection that have been searched for each keyword.

[0339] When the target element is an object in an event, the event information is extracted from the target information; using the event information of each event, the event images (or image sets) are retrieved from the image set, thereby obtaining the images of each object in the event.

[0340] When the target element is a subcategory of a keyword, you can use the keyword to search for images that have been searched for the keyword in the image collection, and then categorize the search results of the keyword images to obtain images for each subcategory.

[0341] In step S1105, the electronic device 200 displays images of each target element in the image selection interface according to the priority of the target elements; wherein, at least two target elements include a first target element and a second target element, the priority of the first target element is higher than the priority of the second target element, and the image of the first target element is displayed earlier in the image selection interface than the image of the second target element.

[0342] Electronic device 200 can display images with higher priority first, and then display images with lower priority.

[0343] In this way, by prioritizing each target element and displaying the images related to higher-priority target elements earlier than the images related to lower-priority target elements, the images related to higher-priority target elements are presented first, improving the convenience for users to select images.

[0344] In some possible implementations, the first target element in the target element includes a first sub-element and a second sub-element; the first sub-element has a higher priority than the second sub-element, the image of the first sub-element is displayed earlier in the image selection interface than the image of the second sub-element, and the image of the target element includes the images of the first sub-element and the second sub-element.

[0345] In some possible implementations, during the process of obtaining images of various target elements from an image set based on target information, the electronic device 200 can obtain candidate image sets for each target element from the image set based on the target information; for each target element, cluster the candidate images in the candidate image sets to obtain at least one similar image set; for each similar image set, sort the similar images in the similar image set and select a first preset number of similar images, which are the target similar images of the similar image set; for each target element, select the image of the target element from the target similar images of each similar image set and the candidate images not clustered into the similar image set.

[0346] In some possible implementations, when the target element is an event or an object in an event, the electronic device can extract event information from the target information and use the event information to filter images of each event or each object in the event from the image collection.

[0347] In some possible implementations, when the target element is a category of the object described by the keyword, the electronic device can use the keyword to filter images from the image collection, then classify the search results of the keyword images to obtain images for each category.

[0348] In some possible implementations of the second aspect, when the target element is a keyword, the priority of each keyword is determined according to the order in which the keywords are passed in. Specifically, the keyword passed in earlier has a higher priority than the keyword passed in later.

[0349] In some possible implementations, when the target element is an event, the importance of each event is determined based on at least one of the following: the completeness of the event content, the complexity of the description, the precision of the time and location, and the distance between the location of the event and the location of the insertion cursor. Events with higher importance have higher priority.

[0350] It should be noted that any similarities or differences between this embodiment and the embodiments described above can be found in the corresponding content above, and will not be repeated here.

[0351] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0352] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments of this application can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include at least: any entity or device capable of carrying computer program code to a photographing device / terminal device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium. Examples include USB flash drives, portable hard drives, magnetic disks, or optical disks. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electrical carrier signals or telecommunication signals.

[0353] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0354] In the embodiments provided in this application, it should be understood that the disclosed devices, electronic devices, and methods can be implemented in other ways. For example, the device / electronic device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual couplings or direct couplings or communication connections may be through some interfaces; indirect couplings or communication connections between devices or units may be electrical, mechanical, or other forms.

[0355] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0356] The electronic device provided in this application embodiment may include a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the method as described in any of the above method embodiments.

[0357] This application also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps described in the various method embodiments above.

[0358] This application provides a computer program product that, when run on an electronic device, enables the electronic device to perform the steps described in the various method embodiments above.

[0359] This application also provides a chip system, which includes a processor coupled to a memory. The processor executes a computer program stored in the memory to implement the methods described in the above embodiments. The chip system may be a single chip or a chip module composed of multiple chips.

[0360] In the above embodiments, the descriptions of each embodiment have their own emphasis. Parts not detailed or described in a particular embodiment can be referred to in the relevant descriptions of other embodiments. It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application. Furthermore, in the description of this application specification and appended claims, the terms "first," "second," "third," etc., are only used to distinguish descriptions and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, features defined with "first," "second," "third," and "fourth" may explicitly or implicitly include one or more of that feature. Additionally, it should be understood that at least one in the embodiments of this application includes one or more; where "more" means greater than or equal to two. In the embodiments of this application, "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Additionally, the character " / " in this article generally indicates that the objects before and after it are in an "or" relationship.

[0361] References to "one embodiment" or "some embodiments" in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized.

[0362] Finally, it should be noted that the above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A picture display method characterized by, The method comprises: displaying an interface of an application program; in response to a target operation on the interface of the application program, obtaining target information of the application program, the target information being related to content of the interface of the application program, the target operation being used for uploading a picture; according to a first picture quantity and the target information, obtaining a target candidate picture set of each target element from a picture set, the target element being determined according to the target information, the target candidate picture set comprising at least one target candidate picture, a total quantity of the target candidate pictures of each target element being less than or equal to the first picture quantity, the first picture quantity being a quantity of pictures that can be displayed on a first screen interface of a picture selection interface; displaying the target candidate pictures of each target element on the first screen interface.

2. The method of claim 1, wherein, If the target elements comprise at least two target elements, the at least two target elements comprise a first target element and a second target element; the displaying of the target candidate pictures of each target element on the first screen interface comprises: according to a priority of the first target element and a priority of the second target element, displaying the target candidate pictures of the first target element and the target candidate pictures of the second target element on the first screen interface, the priority of the first target element being higher than the priority of the second target element, and a display position of the target candidate pictures of the first target element being in front of a display position of the target candidate pictures of the second target element.

3. The method according to claim 1 or 2, characterized in that, A first target element in the target elements comprises a first sub-element and a second sub-element; the displaying of the target candidate pictures of each target element on the first screen interface comprises: according to a priority of the first sub-element and a priority of the second sub-element, displaying pictures of the first sub-element and pictures of the second sub-element on the first screen interface, the priority of the first sub-element being higher than the priority of the second sub-element, and a display position of the pictures of the first sub-element being in front of a display position of the pictures of the second sub-element, the target candidate pictures of the first target element comprising the pictures of the first sub-element and the pictures of the second sub-element.

4. The method according to any one of claims 1 to 3, characterized in that, The method further comprises: displaying a tab page of the target element or a tab page of a sub-element on the picture selection interface, the tab page of the target element comprising pictures of the target element, and the tab page of the sub-element comprising pictures of the sub-element.

5. The method according to any one of claims 1 to 4, characterized in that, The obtaining of the target candidate picture set of each target element from the picture set according to the first picture quantity and the target information comprises: obtaining a candidate picture set of each target element from the picture set according to the target information; for each target element, selecting the target candidate picture from the candidate picture set; wherein a quantity of the selected target candidate pictures is determined according to the first picture quantity, and the quantity of the selected target candidate pictures is a quantity of pictures of the target element displayed on the first screen interface.

6. The method of claim 5, wherein, The selecting of the target candidate picture from the candidate picture set comprises: performing similar picture clustering on the candidate picture set to obtain a similar picture set; for each similar picture set, sorting each similar picture in the similar picture set, and selecting a preset number of similar pictures in front as target similar pictures of the similar picture set; selecting the target candidate picture from the target similar pictures of each similar picture set and the candidate pictures not clustered into the similar picture set.

7. The method of claim 6, wherein, The sorting of each similar picture in the similar picture set includes: According to the score of each similar picture, the similar picture is sorted, and the score of the similar picture is determined according to at least one of the composition, color and definition of the similar picture.

8. The method of claim 6, wherein, In the picture selection interface, the display position of the target similar picture in the similar picture set is in front of the display position of the non-target similar picture in the similar picture set.

9. The method of claim 6, wherein, If the target element includes at least two sub-elements, the similar picture clustering of the candidate picture set includes: Respectively, the similar picture clustering of each sub-element picture obtains the similar picture set of each sub-element, and the candidate picture set includes each sub-element picture.

10. The method of claim 1, wherein, The target information is text information obtained according to the interface content of the application program.

11. The method according to any one of claims 1 to 10, characterized in that, The target element is an event described in the target information, an object in the event described in the target information, a keyword in the target information, or a classification of an object described by the keyword in the target information.

12. The method of claim 5, wherein, The target element is an event described in the target information or an object in the event described in the target information. According to the target information, the candidate picture set of each target element is obtained from the picture set, including: Extracting event information of an event from the target information; Using the event information to search for pictures in the picture set to obtain the candidate picture set of each event or object in the event.

13. The method of claim 12, wherein, The method further includes: If no picture matching the event information is obtained when searching for pictures in the picture set according to the event information, the picture set is searched again according to target event information, and the target event information is obtained by removing one or more dimensional information in the event information.

14. The method of claim 5, wherein, The target element is a classification of an object described by a keyword in the target information; according to the target information, the candidate picture set of each target element is obtained from the picture set, including: According to the keyword in the target information, the search results of the keyword are obtained by searching for pictures; Classifying the search results of the keyword to obtain the target candidate picture set of each classification.

15. A picture display method characterized by comprising: The method includes: Displaying the interface of an application program; In response to a target operation on the interface of the application program, obtaining target information of the application program, the target information is related to the interface content of the application program, and the target operation is used to upload pictures; According to the target information, pictures of each target element are obtained from a picture set, the target element being determined according to the target information; Priorities of each of the at least two target elements are determined; According to the priorities of the target elements, the pictures of each of the target elements are displayed on a picture selection interface; The at least two target elements include a first target element and a second target element, the priority of the first target element is higher than the priority of the second target element, and the display position of the picture of the first target element in the picture selection interface is in front of the display position of the picture of the second target element in the picture selection interface.

16. The method of claim 15, wherein, The first target element of the target elements includes a first sub-element and a second sub-element; The priority of the first sub-element is higher than the priority of the second sub-element, the display position of the picture of the first sub-element in the picture selection interface is in front of the display position of the picture of the second sub-element in the picture selection interface, and the picture of the target element includes the picture of the first sub-element and the picture of the second sub-element.

17. The method of claim 15, wherein, According to the target information, pictures of each target element are obtained from a picture set, including: According to the target information, a candidate picture set of each of the target elements is obtained from the picture set; For each of the target elements, candidate pictures in the candidate picture set of the target element are clustered to obtain at least one similar picture set; For each of the similar picture sets, after each similar picture in the similar picture set is sorted, a pre-set number of similar pictures are selected, the pre-set number of similar pictures being target similar pictures of the similar picture set; For each of the target elements, the picture of the target element is selected from the target similar pictures of each of the similar picture sets and the candidate pictures not clustered into the similar picture sets.

18. An electronic device, comprising: The computer program is executed by the processor to implement the method of any one of claims 1-14 or 15-17.

19. A computer-readable storage medium, the computer-readable storage medium storing a computer program, characterized in that, The computer program is executed by the processor to implement the method of any one of claims 1-14 or 15-17.

Images