Picture display method, electronic equipment and computer readable storage medium
By obtaining target information related to the application interface content on an electronic device, filtering out target candidate images from the picture collection, and displaying them on the first screen interface, it solves the problem of time-consuming selection of images that need to be uploaded from a large number of pictures, and improves the user experience.
Patent Information
- Application Number
- CN202411632338.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-20
- Publication Date
- 2025-04-01
- Estimated Expiration
- 2044-06-20
AI Technical Summary
When selecting pictures that need to be uploaded from a large number of pictures on an electronic device, it is difficult, time-consuming, and the user experience is not good.
By obtaining target information related to the content of the application interface, obtaining target candidate pictures of each target element from the image collection, and displaying these pictures on the first screen interface, allowing users to select the pictures to be uploaded simply and quickly.
It enables users to obtain pictures of multiple target elements on the first screen interface, reducing page turnover operations, and improving the convenience and experience of users to select pictures.
Smart Images

Figure CN119739882A_ABST
Abstract
Description
[0001] This application is a divisional application. The application number of the original application is 202410808248.4, and the original application date is June 20, 2024. The entire contents of the original application are incorporated into this application by reference. Technical Field
[0002] The present application relates to the field of terminal technology, and in particular to a picture display method, an electronic device, and a computer-readable storage medium. Background Art
[0003] As the functions of electronic devices such as mobile phones become increasingly powerful and rich, there are more and more applications on electronic devices that require users to upload pictures.
[0004] When a user needs to upload a picture, the user can select a picture from the picture interface displayed on the electronic device to select the picture to be uploaded. For example, when a user uses a social application to post a social dynamic, if a picture needs to be inserted into the social dynamic, the user needs to select the picture to be uploaded to the social application from the mobile phone album.
[0005] However, electronic devices usually store a large number of pictures, and it is difficult and time-consuming to select pictures to be uploaded from a large number of pictures, which results in poor user experience. Summary of the invention
[0006] The embodiments of the present application provide a picture display method, an electronic device, and a computer-readable storage medium, which allow users to simply and quickly select pictures to be uploaded.
[0007] In a first aspect, an embodiment of the present application provides a method for displaying an image, the method comprising: an electronic device displays an interface of an application; in response to a target operation on the interface of the application, obtaining target information of the application, the target information is related to the interface content of the application, and the target operation is used to upload an image; based on a first number of images and the target information, obtaining a target candidate image set for each target element from a picture collection, the target element is determined based on the target information, the target candidate image set includes at least one target candidate image, the total number of target candidate images for each target element is less than or equal to the first number of images, the first number of images is the number of images that can be displayed on the first screen of the image selection interface; displaying the target candidate image for each target element on the first screen.
[0008] As can be seen from the above, the embodiment of the present application obtains target candidate images of each target element from the image collection according to the target information related to the interface content of the application, so as to obtain images related to the interface content of the application; and also reasonably determines the number of target candidate images of each target element according to the number of images that can be displayed on the first screen interface, so that the total number of target candidate images of all target elements is less than or equal to the first number of images, so that the target candidate images of all target elements can be displayed on the first screen interface. In this way, the user can obtain images of multiple target elements on the first screen interface without having to turn pages to obtain images of the target elements, and can then more simply and quickly select the images to be uploaded, thereby improving the user experience.
[0009] Among them, the pictures that users need to upload are often related to the interface content of the application. The embodiment of the present application obtains target candidate pictures of each target element and displays the target candidate pictures of multiple target elements on the first screen interface, so that the pictures displayed on the first screen interface are very likely to be the pictures that users need to upload.
[0010] In some possible implementations of the first aspect, if at least two target elements are included, the at least two target elements include a first target element and a second target element. In the process of displaying target candidate images of each target element on the home screen interface, the electronic device may display the target candidate image of the first target element and the target candidate image of the second target element on the home screen interface according to the priority of the first target element and the second target element, the priority of the first target element is higher than the priority of the second target element, and the display position of the target candidate image of the first target element is ahead of the display position of the target candidate image of the second target element.
[0011] In this way, not only can the relevant images of target elements with high priority be presented first (that is, the display interface on the first screen is closer to the front), but the images related to each target element can also be displayed in an aggregated manner (that is, the images related to the target elements are displayed next to each other), thereby further improving the convenience of users in selecting images.
[0012] In some possible implementations of the first aspect, the first target element, the first sub-element and the second sub-element in the target element. At this time, in the process of displaying the target candidate pictures of each target element on the first screen interface, the electronic device can display the picture of the first sub-element and the picture of the second sub-element on the first screen interface according to the priority of the first sub-element and the second sub-element, the priority of the first sub-element is higher than the priority of the second sub-element, the display position of the picture of the first sub-element is ahead of the display position of the picture of the second sub-element, and the target candidate pictures of the first target element include the picture of the first sub-element and the picture of the second sub-element.
[0013] In this way, not only can the related images of the sub-elements with high priority be presented first, but also the related images of each sub-element can be displayed in an aggregated manner, further improving the convenience of user selection of images.
[0014] In some possible implementations of the first aspect, the electronic device may further display a tab page of a target element or a tab page of a sub-element in the picture selection interface, wherein the tab page of the target element includes target candidate pictures of the target element, and the tab page of the sub-element includes pictures of the sub-element. In this way, the user can obtain pictures related to the target element or the sub-element through the tab page, further improving the convenience of the user in selecting pictures.
[0015] In some possible implementations of the first aspect, in the process of obtaining a target candidate picture set for each target element from a picture set based on the first picture number and target information, the electronic device may obtain a candidate picture set for each target element from the picture set based on the target information; for each target element, select a target candidate picture from the candidate picture set; wherein the number of selected target candidate pictures is determined based on the first picture number, and the number of selected target candidate pictures is the number of pictures of the target element displayed in the first screen interface.
[0016] In this implementation, the number of pictures that can be displayed on the home screen is used to allocate the number of pictures to each target element, and a corresponding number of pictures are selected for each target element, so that pictures of multiple target elements can be displayed on the home screen.
[0017] In some possible implementations of the first aspect, in the process of selecting a target candidate picture from a candidate picture set, the electronic device can cluster similar pictures of the candidate picture set to obtain a similar picture set; for each similar picture set, after sorting each similar picture in the similar picture set, select a preset number of similar pictures, and the preset number of similar pictures are the target similar pictures of the similar picture set; select the target candidate picture from the target similar pictures of each similar picture set and the candidate pictures that are not clustered into the similar picture set.
[0018] In this implementation, similar pictures are clustered, and target similar pictures are selected from similar pictures according to the similar picture ranking. Then, target candidate pictures are selected based on the target similar pictures and non-clustered pictures. This minimizes repeated similar pictures in the screened target candidate pictures, thereby reducing the interference of repeated similar pictures on user selection of pictures, and further improving the convenience of user selection of pictures.
[0019] In some possible implementations of the first aspect, in the process of sorting each similar picture in the similar picture set, the electronic device may score each similar picture according to at least one of the composition, color and clarity of each similar picture to obtain the score of each similar picture; and sort each similar picture according to the score of each similar picture. In this way, by calculating and scoring similar pictures of the same cluster based on information such as composition, color and clarity, and sorting them according to the score, it is possible to better select pictures with better quality from multiple similar pictures, so that pictures with better quality are presented first, and the interference caused by repeated similar pictures to the user's selection of pictures is reduced.
[0020] In some possible implementations of the first aspect, in the picture selection interface, the display position of the target similar picture in the similar picture set is ahead of the display position of the non-target similar picture in the similar picture set. In this way, the preferred picture (i.e., the target similar picture) among multiple repeated similar pictures is presented first (i.e., the display position of the preferred picture is ahead), which can reduce the interference of repeated similar pictures on the user's picture selection, and further improve the convenience of the user's picture selection.
[0021] In some possible implementations of the first aspect, if the target element includes at least two sub-elements, the electronic device can cluster similar images of each sub-element respectively to obtain a similar image set of each sub-element, and the candidate image set includes images of each sub-element.
[0022] In some possible implementations of the first aspect, the target information is text information obtained according to interface content of the application program.
[0023] In some possible implementations of the first aspect, the target element is an event described in the target information, an object in the event described in the target information, a keyword in the target information, or a classification of an object described by a keyword in the target information.
[0024] In some possible implementations of the first aspect, the target element is an event or an object in the event. In the process of obtaining a candidate picture set of each target element from a picture set according to the target information, the electronic device may extract event information of the event from the target information; and perform picture retrieval in the picture set using the event information to obtain a candidate picture set of each event or an object in the event.
[0025] In some possible implementations of the first aspect, when at least two events are included, the electronic device may also determine the importance of each event, and prioritize the at least two events according to the importance of each event. In this way, images of events with high importance are presented first, which improves the convenience of user selection of images.
[0026] In some possible implementations of the first aspect, if the target element is an event, the electronic device may also perform image search from a picture collection based on event information of the event. If no picture matching the event information is obtained, the electronic device may perform image search from the picture collection again based on the target event information, where the target event information is event information obtained after removing one or more dimensional information in the event information.
[0027] In this implementation, when no matching images can be retrieved based on event information, intelligent fallback can be performed, that is, one or more dimension information is removed and then the matching search is performed again to obtain the image results, avoiding a bad experience for users due to no search results.
[0028] In some possible implementations of the first aspect, the target element is a classification of an object described by a keyword; in the process of obtaining a candidate picture set of each target element from a picture set according to the target information, the electronic device can perform picture retrieval according to the keyword in the target information to obtain the keyword retrieval results; and classify the keyword retrieval results to obtain target candidate picture sets of each classification.
[0029] In a second aspect, an embodiment of the present application provides a method for displaying an image, in which an electronic device displays an interface of an application; in response to a target operation on the interface of the application, target information of the application is obtained, the target information is related to the interface content of the application, and the target operation is used to upload an image; based on the target information, an image of each target element is obtained from a collection of images, and the target element is determined based on the target information; the priority of each target element among at least two target elements is determined; based on the priority of the target elements, an image of each target element is displayed on an image selection interface; wherein the at least two target elements include a first target element and a second target element, the priority of the first target element is higher than the priority of the second target element, and the display position of the image of the first target element in the image selection interface is ahead of the display position of the image of the second target element in the image selection interface.
[0030] As can be seen from the above, the embodiment of the present application prioritizes each target element and makes the display position of the related pictures of the target elements with high priority be higher than the display position of the related pictures of the target elements with low priority, so that the related pictures of the target elements with high priority are presented first, thereby improving the convenience of users in selecting pictures.
[0031] In some possible implementations of the second aspect, the first target element in the target element includes a first sub-element and a second sub-element; the priority of the first sub-element is higher than the priority of the second sub-element, the display position of the picture of the first sub-element in the picture selection interface is higher than the display position of the picture of the second sub-element in the picture selection interface, and the picture of the target element includes the picture of the first sub-element and the picture of the second sub-element. In this way, the related pictures of the sub-element with a high priority can be presented first, further improving the convenience of the user in selecting pictures.
[0032] In some possible implementations of the second aspect, in the process of obtaining pictures of each target element from a picture set according to target information, the electronic device can obtain a candidate picture set of each target element from the picture set according to the target information; for each target element, cluster the candidate pictures in the candidate picture set of the target element to obtain at least one similar picture set; for each similar picture set, sort each similar picture in the similar picture set, and select a preset number of similar pictures, which are target similar pictures of the similar picture set; for each target element, select the picture of the target element from the target similar pictures of each similar picture set and the candidate pictures that have not been clustered into the similar picture set.
[0033] In this implementation, similar pictures are clustered and target similar pictures are selected from the similar pictures according to their sorting. This reduces the interference of repeated similar pictures on user picture selection and further improves the convenience of user picture selection.
[0034] In some possible implementations of the second aspect, the target information is text information obtained according to interface content of the application program.
[0035] In some possible implementations of the second aspect, the target element is an event described in the target information, an object in the event described in the target information, a keyword in the target information, or a classification of objects described by a keyword in the target information.
[0036] In some possible implementations of the second aspect, when the target element is an event or an object in an event, the electronic device can extract event information of the event from the target information, and use the event information to filter out pictures of each event, or pictures of each object in the event, from a picture collection.
[0037] In some possible implementations of the second aspect, when the target element is a category of an object described by a keyword, the electronic device can use the keyword to filter out pictures of the keyword from a picture collection, and then classify the retrieval results of the keyword pictures to obtain pictures of each category.
[0038] In some possible implementations of the second aspect, when the target element is a keyword, the priority of each keyword is determined according to the order in which the keywords are input, wherein the priority of the keyword input first is higher than that of the keyword input later.
[0039] In some possible implementations of the second aspect, when the target element is an event, the importance of each event is determined based on at least one of the completeness of the event content, the complexity of the description, the accuracy of time and location, and the distance between the location of the event and the location of the insertion cursor. The more important the event is, the higher the priority.
[0040] In a third aspect, an embodiment of the present application provides a method for displaying an image, the method comprising: an electronic device displays an interface of an application; obtaining target information from the application, the target information being information sent by the application in response to a target operation on the interface of the application, the target information being related to the interface content of the application, and the target operation being used to upload an image; obtaining a target candidate image set for each target element from a picture collection based on a first number of images and the target information, the target element being determined based on the target information, the target candidate image set including at least one target candidate image, the total number of target candidate images for each target element being less than or equal to the first number of images, the first number of images being the number of images that can be displayed on the first screen of the image selection interface; and displaying the target candidate images for each target element on the first screen.
[0041] In a fourth aspect, an embodiment of the present application provides a method for displaying an image, in which an electronic device displays an interface of an application; obtains target information from the application, the target information is information sent by the application in response to a target operation on the interface of the application, the target information is related to the interface content of the application, and the target operation is used to upload an image; obtains an image of each target element from a collection of images based on the target information, the target element is determined based on the target information; determines the priority of each target element among at least two target elements; and displays the image of each target element on an image selection interface based on the priority of the target element; wherein the at least two target elements include a first target element and a second target element, the priority of the first target element is higher than the priority of the second target element, and the display position of the image of the first target element in the image selection interface is ahead of the display position of the image of the second target element in the image selection interface.
[0042] In a fifth aspect, an embodiment of the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the method described in any one of the first, second, third, or fourth aspects above is implemented.
[0043] In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements a method as described in any one of the first, second, third or fourth aspects above.
[0044] In a seventh aspect, an embodiment of the present application provides a chip system, the chip system includes a processor, the processor is coupled to a memory, and the processor executes a computer program stored in the memory to implement the method as described in any one of the first aspect, the second aspect, the third aspect, or the fourth aspect. The chip system can be a single chip, or a chip module composed of multiple chips.
[0045] In an eighth aspect, an embodiment of the present application provides a computer program product. When the computer program product runs on an electronic device, the electronic device executes the method described in any one of the first, second, third or fourth aspects above.
[0046] It can be understood that the beneficial effects of the second to eighth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0047] Figure 1A A schematic diagram of a picture uploading scenario provided in an embodiment of the present application;
[0048] Figure 1B Another schematic diagram of a picture uploading scenario provided in an embodiment of the present application;
[0049] Figure 2 A schematic diagram of the structure of an electronic device 200 provided in an embodiment of the present application;
[0050] Figure 3A A schematic diagram of displaying pictures of multiple subcategories based on a single keyword provided in an embodiment of the present application;
[0051] Figure 3B A schematic diagram of a subcategory tab page provided in an embodiment of the present application;
[0052] Figure 3C A schematic diagram of the display sequence of the first screen interface provided in the embodiment of the present application;
[0053] Figure 3D A schematic diagram of non-aggregate display provided in an embodiment of the present application;
[0054] Figure 4 A schematic diagram of displaying pictures of multiple subcategories based on a single keyword provided in an embodiment of the present application;
[0055] Figure 5AA schematic diagram of displaying pictures based on multiple keywords provided in an embodiment of the present application;
[0056] Figure 5B A schematic diagram of a subcategory tab page for keywords provided in an embodiment of the present application;
[0057] Fig. 6A A schematic diagram of displaying multiple categories of images of a single event provided in an embodiment of the present application;
[0058] Figure 6B A schematic diagram of a cat tag page provided in an embodiment of the present application;
[0059] Figure 7 A schematic diagram of a picture display of multiple events provided in an embodiment of the present application;
[0060] Figure 8 A schematic diagram of optimizing the sorting of similar images provided in an embodiment of the present application;
[0061] Fig. 9 A schematic block diagram of the process of recommending and displaying pictures based on keywords and text content provided in an embodiment of the present application;
[0062] Fig. 10A A schematic flow chart of a method for displaying pictures provided in an embodiment of the present application;
[0063] Fig. 10B A schematic diagram of the image display of the home screen interface provided in an embodiment of the present application;
[0064] Fig.11 A schematic block diagram of a process of a picture display method provided in an embodiment of the present application. DETAILED DESCRIPTION
[0065] In the following description, for the purpose of explanation rather than limitation, specific details such as specific system structures and technologies are provided to facilitate a thorough understanding of the embodiments of the present application.
[0066] Combine the following Figure 1A and Figure 1B This section provides an example introduction to the picture upload scenario. Figure 1A This is a schematic diagram of a picture uploading scenario provided in an embodiment of the present application. Figure 1B This is another schematic diagram of the picture uploading scenario provided in the embodiment of the present application.
[0067] like Figure 1A As shown, the main interface 101 of the mobile phone 100 displays applications 1 to 9, a gallery 102, a microblog 103, and 104 and other application icons. In other embodiments, the gallery 102 may also be referred to as an album. 103 and 104 is a third-party social application.
[0068] After the user clicks the icon of Xiaohongshu 104, the mobile phone 100 responds to the click operation on the gallery 102, starts Xiaohongshu 104, and displays the interface of Xiaohongshu 104. The personal information interface 105 of Xiaohongshu 104 includes a note creation button 106. After the user clicks the note creation button 106, the mobile phone 100 responds to the click operation and displays the graphic template interface 107.
[0069] The graphic template interface 107 includes multiple templates such as graphic template 108, graphic template 109 and graphic template 110. If the user wants to create a note using graphic template 110, he clicks graphic template 110. In response to the click operation on graphic template 110, mobile phone 100 displays the detailed interface 111 of graphic template 110.
[0070] The details interface 111 includes a "Use Now" button 112. After the user clicks the "Use Now" button 112, the mobile phone displays a picture selection interface 113 in response to the click operation. A plurality of pictures are displayed on the home screen interface of the picture selection interface 113. The user can select pictures to be uploaded from the home screen interface and other page interfaces (non-home screen interfaces) of the picture selection interface 113, and click the "Finish" button in the picture selection interface 113 to insert the selected pictures into the created notes, that is, upload the selected pictures to Xiaohongshu 104.
[0071] In a specific application, Xiaohongshu 104 can obtain pictures in the gallery 102 by calling the picture selector, and display the obtained pictures on the picture selection interface 113. The pictures in the picture selection interface 113 are usually displayed in the order of picture time. The closer the picture time is to the current time, the closer the display position is on the picture selection interface 113. For example, the picture time of the first picture (i.e., picture 114) on the first screen interface is closest to the current time, and the display position is the closest.
[0072] When the user selects the picture to be uploaded on the picture selection interface 113, if the picture to be uploaded is not displayed on the first screen interface, it is necessary to turn the pages on the screen of the mobile phone 100 to turn to other interfaces of the picture selection interface 113 and select the picture from the pictures displayed on other interfaces.
[0073] like Figure 1BAs shown, the mobile phone 100 displays a microblog creation interface 115. The microblog creation interface 115 includes a picture insertion button 116. The user can insert a picture into the microblog created by clicking the picture insertion button 116. The user can trigger the mobile phone 100 to start the microblog 103 and display the interface of the microblog 103 by clicking the icon of the microblog 103.
[0074] After the user clicks the picture insert button 116, the mobile phone 100 displays the picture selection interface 117 in response to the click operation. A plurality of pictures are displayed on the first screen interface of the picture selection interface 117. The user can select pictures to be uploaded from the first screen interface and other page interfaces of the picture selection interface 117, and click the "Finish" button in the picture selection interface 117 to insert the selected pictures into the created microblog, that is, upload the selected pictures to the microblog 103.
[0075] In a specific application, the microblog 103 can obtain pictures in the picture library 102 by calling the picture selector, and display the obtained pictures on the picture selection interface 117. The pictures in the picture selection interface 117 are usually displayed in the order of the time of the pictures.
[0076] It should be understood that the picture selection interfaces of different applications are usually not exactly the same. For example, the picture selection interface 117 of Weibo 103 and the picture selection interface 113 of Xiaohongshu 104 are not exactly the same.
[0077] Figure 1A The following figure shows a scene of inserting a picture into a note created by Xiaohongshu 104. Figure 1B FIG. 103 shows a scene of inserting a picture into a microblog created by microblog 103. Both the creation notes and the creation microblog can be regarded as copywriting. Figure 1A and Figure 1B It can be seen as a scenario where images are inserted into the text being created during copywriting.
[0078] It should be understood that Figure 1A and Figure 1B The picture uploading scenario mentioned is only an example and does not limit the picture uploading scenario. For example, in some file management scenarios or picture editing scenarios, pictures also need to be uploaded to the application.
[0079] For example, in the embodiment of the present application, the application programs that require users to upload pictures may include, but are not limited to: social applications, e-commerce applications, file management applications, and picture editing applications, etc. Social applications may include, for example, Xiaohongshu 104 and Weibo 103, etc.
[0080] During the research process, the inventor found that in the picture uploading scenario, displaying each picture in the picture selection interface in the order of picture time will require users to spend a lot of time to find the pictures they need to upload among a large number of pictures, which is inefficient and has a poor user experience.
[0081] For example, in Figure 1A and Figure 1B In the case of the picture selection interface, when inserting pictures in the copywriting, the picture selection interface displays each picture in the order of the picture time. At this time, if the picture that the user needs to upload is a picture saved a month ago, or a picture saved a year ago, then the picture that needs to be uploaded will not be displayed on the first screen interface, but will be displayed on a later page. In this case, after the user triggers the mobile phone 100 to display the picture selection interface, he cannot select the picture that needs to be uploaded from the first screen interface, but needs to slowly slide the picture selection interface to find the picture that needs to be uploaded, which is very time-consuming and difficult. In addition, the pictures displayed in the picture selection interface in the order of the picture time will be more confusing, which will also increase the difficulty and time-consuming for users to find the pictures that need to be uploaded.
[0082] In response to the related issues mentioned above, the embodiment of the present application provides a picture display solution, when the user performs a picture upload operation in the interface of the application that needs to upload pictures, the target information related to the interface of the application that needs to upload pictures is obtained; according to the number of pictures that can be displayed on the first screen interface of the picture selection interface and the target information, the target candidate pictures of multiple target elements are obtained from the picture collection, and the total number of target candidate pictures of multiple target elements is less than or equal to the number of pictures that can be displayed on the first screen interface, and the target elements are determined according to the target information; the target candidate pictures of multiple target elements are displayed on the first screen interface. In this way, the user can obtain pictures of multiple target elements in the first screen interface without having to turn pages to find the pictures of the target elements, thereby improving the convenience of user selection of pictures.
[0083] The picture display solution provided in the embodiment of the present application can be applied to electronic devices such as mobile phones, tablet computers, vehicle equipment, and laptop computers, etc. The specific type and specific structure of the electronic device are not limited here.
[0084] For example, Figure 2 The schematic diagram of the structure of the electronic device 200 provided in the embodiment of the present application is shown. The electronic device 200 may include but is not limited to a processor 210, a memory 220 and a display screen 230. Optionally, the electronic device 200 may also include a touch sensor 240. The touch sensor 240 may be arranged on the display screen 230, and the touch sensor 240 and the display screen 230 form a touch screen, also called a "touch screen".
[0085] The structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 200. In other embodiments of the present application, the electronic device 200 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The illustrated components can be implemented in hardware, software, or a combination of software and hardware. For example, when the electronic device 200 is specifically a mobile phone, it also includes a universal serial bus (USB) interface, a charging management module, a power management module, a camera, a battery, an antenna, a mobile communication module, a wireless communication module, a speaker, a receiver, a headphone jack, a sensor, a button, a motor, an indicator, and a subscriber identification module (SIM) card interface, etc.
[0086] The processor 210 may include one or more processing units, for example, the processor 210 may include an application processor (AP), a graphics processing unit (GPU), an image signal processor (ISP), and a controller. Different processing units may be independent devices or integrated into one or more processors. The controller may generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions.
[0087] The processor 210 may include one or more interfaces, such as an inter-integrated circuit (I2C) interface, a mobile industry processor interface (MIPI), and a general-purpose input / output (GPIO) interface.
[0088] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 210 may include multiple groups of I2C buses. The processor 210 may be coupled to the touch sensor 240 and the like through different I2C bus interfaces. For example, the processor 210 may be coupled to the touch sensor 240 through the I2C interface, so that the processor 210 communicates with the touch sensor 240 through the I2C bus interface, thereby realizing the touch function of the electronic device 200.
[0089] The MIPI interface can be used to connect the processor 210 with peripheral devices such as the display screen 230. The MIPI interface includes a display serial interface (DSI), etc. In some embodiments, the processor 210 and the display screen 230 communicate via the DSI interface to implement the display function of the electronic device 200.
[0090] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 210 and the display screen 230, etc.
[0091] The interface connection relationship between the modules illustrated in the embodiment of the present application is only for illustrative purposes and does not constitute a structural limitation on the electronic device 200. In other embodiments of the present application, the electronic device 200 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
[0092] The electronic device 200 implements the display function through a GPU, a display screen 230, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 230 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 210 may include one or more GPUs, which execute program instructions to generate or change display information.
[0093] The display screen 230 is used to display images, videos, etc. The display screen 230 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 200 may include 1 or N display screens 230, where N is a positive integer greater than 1.
[0094] The memory 220 can be used to store computer executable program codes, and the executable program codes include instructions. The memory 220 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 200. In addition, the memory 220 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 210 executes various functional applications and data processing of the electronic device 200 by running instructions stored in the memory 220, and / or instructions stored in a memory provided in the processor.
[0095] The touch sensor 240 is also called a "touch control device". The touch sensor is used to detect a touch operation applied thereto or thereabout. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. The display screen 230 can provide a visual output related to the touch operation. For example, when uploading a picture, the user can perform a point-and-click operation on the touch screen of the mobile phone to select the picture, and perform a slide-and-turn operation to turn the picture page.
[0096] The following takes the electronic device 200 as an example to exemplarily introduce the picture display solution provided in the embodiment of the present application.
[0097] The following describes two situations: a process of recommending and displaying images based on keywords, and a process of recommending and displaying images based on events.
[0098] Recommend and display pictures based on keywords:
[0099] After the electronic device 200 displays the interface of the application on the display screen 230, if a target operation input by the user on the interface of the application is received, the target information related to the interface content of the application is obtained in response to the target operation. The target information may include one or more keywords. The target operation is an operation for uploading a picture.
[0100] In some embodiments, the target information may include a single keyword including multiple subcategories.
[0101] At this time, after obtaining the keyword, the electronic device 200 first filters out the picture set of the keyword from the picture set; then classifies the search results of the picture set of the keyword to obtain the classification results, that is, classifies each picture in the picture set to determine the category to which each picture belongs.
[0102] If the picture set whose classification result represents the keyword includes pictures of multiple categories, the keyword includes multiple subcategories; if the picture set whose classification result represents the keyword includes pictures of only one category, the keyword does not include multiple subcategories.
[0103] For example, the keyword is "pets", the mobile phone 100 searches for images in the image library 102 to obtain a set of "pets" images; the search results of the "pets" image set are classified to obtain classification results; if the classification result indicates that the candidate image set of "pets" includes "dog" images and "cat" images, "pets" includes two subcategories of "cat" and "dog". If the classification result indicates that the candidate image set of "pets" only includes "dog" images, "pets" only has one category of "dog".
[0104] In the process of selecting a picture set of a keyword from a picture set, the electronic device 200 can calculate the matching degree between each picture in the picture set and the keyword; determine whether the matching degree of each picture is greater than or equal to a preset matching degree threshold; if the picture is greater than or equal to the matching degree threshold, select the picture as the picture of the keyword; if the picture is less than the matching degree threshold, do not select the picture as the picture of the keyword. Multiple pictures of a keyword can form a picture set of the keyword.
[0105] After obtaining the classification result of the picture set of the keyword, the electronic device 200 selects pictures of each subcategory to be displayed on the home screen interface from the pictures of each subcategory if the picture set of the keyword includes pictures of multiple subcategories.
[0106] In order to display multiple sub-category images on the home screen, the total number of images of each sub-category displayed on the home screen can be less than or equal to the first number of images. The first number of images is the number of images that can be displayed on the home screen of the image selection interface.
[0107] The first number of pictures may be preset. For example, the number of pictures that can be displayed on the home screen of the mobile phone 100 is set to 16, that is, the home screen of the mobile phone 100 can display a maximum of 16 pictures.
[0108] The number of pictures displayed on the home screen interface for each subcategory may be the same or different. Furthermore, the number of pictures displayed on the home screen interface for all subcategories is less than or equal to the first number of pictures. For example, the keyword "pet" includes two subcategories, "cat" and "dog", that is, the number of subcategories is 2, and the number of first pictures is 16; at this time, the number of pictures displayed on the home screen interface for "cat" and "dog" is 8; or, the number of pictures displayed on the home screen interface for "cat" is 6, and the number of pictures displayed on the home screen interface for "dog" is 6 or 10.
[0109] When determining the number of pictures displayed on the home screen interface for each subcategory based on the number of first pictures and the number of subcategories, the electronic device 200 can determine the number of pictures displayed on the home screen interface for each subcategory based on the principle of average distribution. For example, the number of first pictures is 16, and the number of subcategories is 2. Based on the principle of average distribution, 8 pictures are evenly distributed to each subcategory, that is, the number of pictures that can be displayed on the home screen interface for each subcategory is 8.
[0110] Of course, the electronic device 200 may also determine the number of pictures to be displayed on the home screen interface for each subcategory in other ways, which are not limited here.
[0111] Exemplarily, the electronic device 200 can also determine the number of pictures displayed on the home screen interface of each subcategory according to the number of pictures of each subcategory. Among them, the number of pictures of a subcategory is positively correlated with the number of pictures displayed on the home screen interface of the subcategory. For example, the number of first pictures is 16, and the keyword "pet" includes two subcategories, "cat" and "dog". There are 100 pictures of "pet", 60 pictures of "cat", and 40 pictures of "dog". At this time, the proportion of pictures of "cat" is 0.6, and the proportion of pictures of "dog" is 0.4; according to the proportion of pictures, the number of pictures displayed on the home screen interface of "cat" is determined to be: 16x0.6=9.6, and the number of pictures displayed on the home screen interface of "dog" is: 16x0.4=6.4. Finally, the number of pictures is rounded off, and it can be determined that the number of pictures displayed on the home screen interface of "cat" is 10, and the number of pictures displayed on the home screen interface of "dog" is 6.
[0112] For each subcategory, the electronic device 200 can select a corresponding number of pictures from the pictures of the subcategory according to the number of pictures displayed on the home screen interface of each subcategory, as the pictures of the subcategory displayed on the home screen interface. For example, there are 20 pictures of "cat", and the number of pictures of "cat" displayed on the home screen interface is 6. After sorting these 20 pictures by matching degree, the top six pictures with the highest matching degree are selected from the 20 pictures as the pictures of the subcategory "cat" displayed on the home screen interface.
[0113] Of course, in addition to selecting pictures for display on the home screen interface of each subcategory based on the degree of picture matching, the electronic device 200 can also select a corresponding number of pictures from the pictures of the subcategory according to the number of pictures displayed on the home screen interface of each subcategory in other ways as the pictures of the subcategory displayed on the home screen interface. For example, the electronic device 200 can randomly select a corresponding number of pictures from the pictures of the subcategory according to the number of pictures displayed on the home screen interface of each subcategory; or score each picture of the same subcategory (for example, score it according to clarity and composition, etc.), and select a corresponding number of pictures from the pictures of the subcategory according to the score of the picture.
[0114] In comparison, by selecting pictures of a subcategory to be displayed on the home screen based on the degree of picture matching or the picture score, the pictures displayed on the home screen can have better quality or be more likely to be the pictures that the user needs to upload, thereby further improving the user's experience of selecting pictures.
[0115] The electronic device 200 may also select a corresponding number of pictures from the pictures of each subcategory according to the number of pictures displayed on the home screen of each subcategory and the time of each picture.
[0116] In an optional manner, for each subcategory, the electronic device 200 selects a corresponding number of pictures according to the picture time of each picture of the subcategory, in the order from new to old or from old to new, as the pictures displayed on the home screen interface of the subcategory. The newness of the picture can refer to the distance between the picture time and the current time, the latest picture refers to the picture whose picture time is closest to the current time, and the oldest picture refers to the picture whose picture time is farthest from the current time.
[0117] It should be noted that the picture time can be the time when the picture was taken, the time when the picture was created (or saved), or the time when the picture was modified. Generally, if the picture has a shooting time, the shooting time of the picture is preferably used as the picture time. If the picture has no shooting time, the saving time or modification time of the picture can be used as the picture time.
[0118] In another optional manner, for each subcategory, the electronic device 200 first divides the pictures of each subcategory into multiple time periods according to the picture time of each picture of the subcategory. Each time period includes one or more pictures; and then selects a corresponding number of pictures from the pictures of each time period as the pictures displayed on the home screen interface of the subcategory.
[0119] In specific applications, the pictures selected for each time period can be the same or different. For example, there are 30 pictures in the subcategory of "dog"; the picture time of the 30 pictures is divided into 2 time periods, namely the first time period and the second time period. The first time period is closest to the current time, and the second time period is farthest from the current time. There are 20 pictures whose picture time falls within the first time period, and 10 pictures whose picture time falls within the second time period. The number of pictures displayed on the home screen interface of the subcategory of "dog" is 8. At this time, 4 pictures can be selected from the 20 pictures in the first time period, and 4 pictures can be selected from the 10 pictures in the second time period as the pictures of "dog" displayed on the home screen interface.
[0120] Of course, in addition to evenly selecting pictures from each time period (i.e., the number of pictures selected from each time period is the same), you can also select pictures from the pictures in each time period based on the principle that the closer the time period is to the current time, the more pictures are extracted. For example, there are 20 pictures in the first time period and 10 pictures in the second time period. Compared with the second time period, the first time period is closer to the current time, so the number of pictures selected from the pictures in the first time period is more than the number of pictures selected from the pictures in the second time period. For example, 6 pictures are selected from the 20 pictures in the first time period, and 2 pictures are selected from the 10 pictures in the second time period as the pictures of "dog" displayed on the home screen.
[0121] When selecting pictures to be displayed on the home screen interface of a subcategory, if the number of pictures of a subcategory is less than the number of pictures displayed on the home screen interface of the subcategory, all pictures of the subcategory will be used as pictures displayed on the home screen interface; if the number of pictures of a subcategory is greater than the number of pictures displayed on the home screen interface of the subcategory, a corresponding number of pictures can be selected based on the matching degree of the pictures or other methods as pictures of the subcategory displayed on the home screen interface. For example, the keyword "pet" includes two subcategories, "cat" and "dog". There are 8 pictures of "cat" displayed on the home screen interface, but there are only 6 pictures of "cat", so all pictures of "cat" will be displayed on the home screen interface. There are 8 pictures of "dog" displayed on the home screen interface, and there are only 15 pictures of "dog", so 8 pictures need to be selected from the 15 pictures of dog as pictures of the subcategory "dog" displayed on the home screen interface.
[0122] After obtaining the pictures of each subcategory displayed on the first screen interface, the electronic device 200 can display the selected pictures of each subcategory on the first screen interface.
[0123] Optionally, the electronic device 200 may also display a tab page (Tab page) of each subcategory on the picture selection interface. The tab page of each subcategory includes pictures of the subcategory.
[0124] For example, see Figure 3A The schematic diagram of displaying pictures of multiple subcategories based on a single keyword provided by the embodiment of the present application is shown. Figure 1A In the scenario, after the mobile phone 100 displays the details interface 111, the user clicks the "Use Now" button 112. In response to the click operation on the "Use Now" button 112, the mobile phone 100 obtains the target information of the Little Red Book 104, which may be related to the interface content of the details interface 111.
[0125] At this time, the interface content of the details interface 111 includes the text content of "pet oil painting photo" and a pet picture with an oil painting feel, so the target information can be the keyword "pet". Usually, Xiaohongshu 104 can pre-set one or more keywords for each graphic template. At this time, for the graphic template corresponding to the details interface 111, the keyword set is "pet". Of course, the mobile phone 100 can also obtain the corresponding keyword by identifying the interface content on the details interface 111.
[0126] After the mobile phone 100 obtains the keyword "pet", it selects the pictures matching the keyword "pet" from the pictures in the picture library 102 to obtain a picture set of "pet". Specifically, the picture set of pet can be obtained by the degree of matching between each picture and the keyword "pet"; the picture set of "pet" is then classified by retrieval results to obtain classification results. At this time, the classification result indicates that the picture set of "pet" includes pictures of "cat" and "dog", that is, the keyword "pet" includes two subcategories of "cat" and "dog".
[0127] According to the number of pictures that can be displayed on the first screen interface and the matching degree of each picture, mobile phone 100 selects 8 pictures from the "cat" pictures and 8 pictures from the "dog" pictures, and uses these 8 pictures as the pictures of the subcategory displayed on the first screen interface.
[0128] After determining that the 8 pictures of "cat" and "dog" are displayed on the home screen, the mobile phone 100 displays the picture selection interface 118 according to the 8 pictures of the "cat" subcategory displayed on the home screen and the 8 pictures of the "dog" subcategory displayed on the home screen. The picture selection interface 118 includes a recommended page button 119. Figure 3A In the example, the picture selection interface 118 is located under the recommendation page.
[0129] The first screen of the picture selection interface 118 displays 8 pictures of cats and 8 pictures of dogs. Moreover, the 8 pictures of cats are displayed first, and then the 8 pictures of dogs are displayed. The display position of the pictures of cats is closer to the front than that of the pictures of dogs.
[0130] After the mobile phone 100 displays the picture selection interface 118, since all subcategories of pictures of the keyword "pet" are displayed on the first screen interface of the picture selection interface 118, when the user creates a note with the theme of pet oil painting and photo, the user can simply and quickly select the pet pictures that need to be uploaded to Xiaohongshu 104 from the pet pictures displayed on the first screen interface, without having to turn pages to find pictures of cats or dogs, which improves the convenience of user selection of pictures.
[0131] Optionally, the picture selection interface 118 may further include a cat tab button 120 and a dog tab button 121 .
[0132] When the user clicks the cat tab button 120, the mobile phone 100 responds to the click operation by displaying Figure 3B The cat tab 122 in the mobile phone 100 can include all cat pictures in the gallery 102 of the mobile phone 100. Figure 3B It is a schematic diagram of a subcategory tab page provided in an embodiment of the present application.
[0133] When the user clicks the dog tab button 121, the mobile phone 100 displays the Figure 3B The dog tab 123 in the mobile phone 100 may include pictures of all dogs in the gallery 102 of the mobile phone 100 .
[0134] It should be noted that, usually, the arrangement order of the sub-category tabs can be the same as the display order of the sub-categories on the home screen. For example, Figure 3A In the home screen interface, the cat pictures are displayed in front and the dog pictures are displayed in the back. Accordingly, the cat tab button 120 is before the dog tab button 121. Of course, the arrangement order of the subcategory tabs may also be different from the display order of the subcategories on the home screen interface. In addition, the display order of each picture in the tab of each subcategory can be arbitrary, for example, the pictures can be sorted and displayed according to the time sequence, picture score or matching degree.
[0135] The mobile phone 100 can further improve the convenience of selecting pictures by displaying multiple sub-category labels of pets. For example, when there is no picture of a cat that the user wants to upload among the 8 pictures of cats displayed on the first screen, the user can directly search for the cat picture to be uploaded from the cat tab 122 without being disturbed by pictures of other categories (such as dogs), which shortens the time consumption and increases the efficiency.
[0136] It should be noted that when displaying pictures of different subcategories on the home screen interface, the electronic device 200 can first determine the priorities of different subcategories, and then display the pictures of each subcategory on the home screen interface according to the priorities of each subcategory. The display position of the pictures of the subcategory with a high priority is closer to the front than the display position of the pictures of the subcategory with a low priority.
[0137] When determining the priorities of different subcategories, it can be determined based on the number of pictures in each subcategory. If the number of pictures in a subcategory is greater than the number of pictures in another subcategory, the priority of the subcategory is higher than the priority of the other subcategory. Of course, the priorities of each subcategory can also be determined by other methods, which are not limited here.
[0138] For example, in Figure 3A In the example, the candidate picture set of "pets" includes 100 cat pictures and 50 dog pictures. Since the number of cat pictures is greater than that of dog pictures, the priority of cats is higher than that of dogs. When mobile phone 100 displays cat and dog pictures on the home screen, cat pictures are displayed first, and then dog pictures.
[0139] In some other embodiments, the electronic device 200 may also determine the display order of different subcategories on the home screen interface in a random manner.
[0140] When displaying pictures of the same subcategory on the home screen interface, the electronic device 200 can determine the display order of each picture in the same subcategory on the home screen interface according to the picture time or the picture score. The closer the picture time is to the current time, or the higher the score of the picture is, the closer the picture is displayed. The score of the picture can be obtained by scoring the quality of the picture. For example, the picture is scored according to the clarity of the picture.
[0141] For example, in Figure 3A In the first screen, 8 cat pictures are displayed in order according to the time of the pictures.
[0142] Generally, the upper left corner of the home screen is the most forward display position, and the lower right corner is the most backward display position. Figure 3C The schematic diagram of the display position sequence of the first screen interface provided by the embodiment of the present application is shown in FIG. Figure 3A Take the 8 pictures of cats and 8 pictures of dogs displayed on the home screen as an example, and take the upper left corner of the home screen as the origin to establish the xy coordinate system of the home screen. The picture in the upper left corner of the home screen is displayed the front, and the picture in the lower right corner is displayed the back. That is, the display position of picture 124 is the front, and the display position of picture 127 is the back. According to the xy coordinates, the order of each display position can be determined. For example, the display position of picture 124 is ahead of the display position of picture 125, and the display positions of pictures 124 and 124 are both ahead of the display position of picture 126.
[0143] It should also be noted that Figure 3AIn the home screen interface of , multiple pictures of the same subcategory are displayed next to each other, or in other words, multiple pictures of the same subcategory are displayed in one area or in an aggregated display. However, in other embodiments, multiple pictures of the same subcategory may not be displayed in an aggregated display. For example, see Figure 3D The non-aggregate display schematic diagram provided by the embodiment of the present application is shown, based on Figure 3A The scene shown, Figure 3D The 8 cat pictures in the first screen interface are not aggregated, and the 8 dog pictures are not aggregated. At this time, the display order of the 8 cat pictures and the 8 dog pictures on the first screen interface can be random, or can be determined according to the picture time or picture score, etc., which is not limited here.
[0144] Compared with non-aggregated display, aggregating and displaying pictures of the same subcategory can further improve the convenience of user selection of pictures.
[0145] It should be understood that pictures that cannot be fully displayed on the first screen interface will be displayed on the non-first screen interface. The picture display format of the non-first screen interface can be the same as the picture display format of the first screen interface, or it can be different. The picture display format of the non-first screen interface is not limited here.
[0146] Also illustratively, see Figure 4 The schematic diagram of displaying pictures of multiple subcategories based on a single keyword provided by the embodiment of the present application is shown. Figure 1A In the scenario, after the mobile phone 100 displays the graphic template interface 107, the user clicks the graphic template 108. In response to the click operation on the graphic template 108, the mobile phone 100 displays the puppy outfit template interface 128 of the graphic template 108; after the user clicks the "Use Now" button in the puppy outfit template interface 128, the mobile phone 100 displays the picture selection interface 129 in response to the click operation.
[0147] The picture selection interface 129 includes a recommendation page button 130 , and the first screen interface displays pictures of the dog in multiple states, and the pictures of each state are displayed in an aggregated manner. Figure 4 The picture selection interface 129 is located under the recommendation page.
[0148] At this time, "dog" is the keyword. The keyword "dog" includes multiple subcategories (i.e., states or outfits). The picture of outfit 1 (i.e., state 1) is a picture of a puppy wearing sunglasses, the picture of outfit 2 (i.e., state 2) is a picture of a puppy wearing a hat, the picture of outfit 3 (i.e., state 3) is a picture of a puppy wearing a scarf, and the picture of outfit 4 (i.e., state) is a picture of a puppy wearing clothes.
[0149] The pictures of various outfits in the first screen interface of the picture selection interface 129 are displayed in an aggregated manner, that is, the four pictures of outfit 1 are displayed in the same row, the four pictures of outfit 2 are displayed in the same row, the four pictures of outfit 3 are displayed in the same row, and the four pictures of outfit 4 are displayed in the same row. Among them, the pictures of outfit 1 are displayed in the front position on the first screen interface, and the pictures of outfit 4 are displayed in the back position on the first screen interface.
[0150] In response to the user clicking the "Use Now" button in the puppy outfit template interface 128, the specific process of the mobile phone 100 displaying the picture selection interface 129 may be as follows:
[0151] In response to a click operation on the “Use Now” button in the puppy outfit template interface 128 , the mobile phone 100 obtains target information from the Little Red Book 104 , and the target information may be related to the interface content of the puppy outfit template interface 128 .
[0152] At this time, the interface content of the puppy outfit template interface 128 includes the text content of "Puppy Outfit Diary" and a picture of a puppy wearing decorations, and the target information may include the keyword "dog". Generally, Xiaohongshu 104 pre-sets one or more keywords for each graphic template. It is assumed that the keywords pre-set for the graphic template 108 include "dog" and "outfit", or include "dog". Of course, the mobile phone 100 can also identify the interface content of the puppy outfit template interface 128 to obtain the keyword "dog".
[0153] After the mobile phone 100 obtains the keyword "dog", it selects pictures matching the keyword "dog" from the pictures in the gallery 102 to obtain a picture set of "dog". Specifically, the picture set of "dog" can be obtained by the matching degree of each picture with the keyword "dog"; then the retrieval results of the picture set of "dog" are classified to obtain the classification results. At this time, the classification results indicate that the picture set of "dog" includes pictures of puppies wearing sunglasses, pictures of puppies wearing hats, pictures of puppies wearing scarves, and pictures of puppies wearing clothes. That is, the keyword "dog" includes four subcategories, and the subcategories can refer to status or outfit.
[0154] The mobile phone 100 can determine the number of pictures that can be displayed on the home screen interface for each subcategory according to the number of pictures that can be displayed on the home screen interface and the number of subcategories; assuming that the number of pictures displayed on the home screen interface for each subcategory is 4, then 4 pictures can be selected from the pictures of puppies wearing sunglasses, the pictures of puppies wearing hats, the pictures of puppies wearing scarves, and the pictures of puppies wearing clothes, according to the matching degree of each picture or the picture score (for example, scoring the pictures according to the picture clarity and color, etc.). The 4 pictures selected from the pictures of various outfits are used as the pictures displayed on the home screen interface for the subcategory (i.e., outfit or status) .
[0155] The mobile phone 100 displays 4 pictures selected from the pictures of puppies wearing sunglasses, 4 pictures selected from the pictures of puppies wearing hats, 4 pictures selected from the pictures of puppies wearing scarves, and 4 pictures selected from the pictures of puppies wearing clothes on the first screen interface of the picture selection interface 129.
[0156] After the mobile phone 100 displays the picture selection interface 129, since the first screen interface of the picture selection interface 129 displays pictures of all states (or outfits) of the keyword "dog", when the user creates a note with the theme of puppy outfit diary, the user can simply and quickly select the pictures that need to be uploaded to Xiaohongshu 104 from the various dog outfit pictures displayed on the first screen interface, without having to turn pages to find the various dog outfit pictures, which improves the convenience of user selection of pictures.
[0157] Optionally, the picture selection interface 129 may further include a state 1 tab button 131, a state 2 tab button 132, a state 3 tab button 133, and a state 4 tab button 134. The state 3 tab button 133 and the state 4 tab button 134 are displayed in an interface outside the picture selection interface 129, and the user can find the state 3 tab button 133 and the state 4 tab button 134 by sliding.
[0158] The user can click on the status tab button to trigger the mobile phone 100 to display the tab of the corresponding status. For example, when the user clicks on the status 1 tab button 131, the mobile phone 100 displays the tab of status 1 in response to the click operation. The tab of status 1 displays pictures of all puppies wearing sunglasses. In this way, the mobile phone 100 can enable the user to quickly and easily obtain pictures of the corresponding outfits from the tabs by displaying tabs of various outfits of dogs, reducing the interference of other pictures (e.g., pictures of different outfits).
[0159] In some other embodiments, the target information may include at least two keywords. At this time, after acquiring the keywords, the electronic device 200 first selects a picture set of each keyword from the picture set, and then selects a picture displayed on the home screen interface for each keyword from the picture set of each keyword.
[0160] For each keyword, the process of selecting a picture set of the keyword from the picture set can be as follows: the electronic device 200 calculates the matching degree between each picture in the picture set and the keyword; determines whether the matching degree of each picture is greater than or equal to a preset matching degree threshold; if the picture is greater than or equal to the matching degree threshold, the picture is selected as the picture of the keyword; if the picture is less than the matching degree threshold, the picture is not selected as the picture of the keyword. Multiple pictures of a keyword can form a picture set of the keyword.
[0161] In order to display pictures of multiple keywords on the home screen, the total number of pictures displayed on the home screen for each keyword can be less than or equal to the first number of pictures. The first number of pictures is the number of pictures that can be displayed on the home screen of the picture selection interface. The number of pictures displayed on the home screen for each keyword can be the same or different.
[0162] When determining the number of pictures displayed on the home screen for each keyword based on the number of first pictures, the electronic device 200 can determine the number of pictures displayed on the home screen for each keyword based on the principle of average distribution. For example, the number of first pictures is 16, and the number of keywords is 4. Based on the principle of average distribution, 4 pictures are evenly distributed to each keyword, that is, the number of pictures that can be displayed on the home screen for each keyword is 4.
[0163] Of course, the electronic device 200 may also determine the number of images displayed on the home screen for each keyword in other ways, which are not limited here. For example, the number of images displayed on the home screen for each keyword may be determined based on the image ratio of each keyword, where the image ratio is the ratio between the number of images of the keyword and the total number of images of all keywords.
[0164] For each keyword, the electronic device 200 can select a corresponding number of pictures from the picture set of the keyword according to the number of pictures displayed on the first screen interface of each keyword, as the picture displayed on the first screen interface of the keyword. For example, the keyword is "giant panda", there are 50 pictures in the picture set of "giant panda", and the number of pictures displayed on the first screen interface of "giant panda" is 4. After sorting these 50 pictures according to the degree of matching, select the top four pictures of matching degree from the 50 pictures as the picture displayed on the first screen interface of the keyword "giant panda". Of course, the electronic device 200 can also select a corresponding number of pictures from the picture set of the keyword according to the number of pictures displayed on the first screen interface of each subcategory in other ways, as the picture displayed on the first screen interface of the keyword. For example, a corresponding number of pictures can be randomly selected from the pictures of the keyword, or each picture in the picture set of the keyword can be scored (for example, according to clarity and composition, etc.), and a corresponding number of pictures can be selected from the picture set of the keyword according to the score of the picture.
[0165] In comparison, selecting images to be displayed on the home screen interface based on the degree of image matching or the image score from the image collection of the keyword can make the images displayed on the home screen better in quality, or more likely to be the images that the user needs to upload, thereby further improving the user's experience in selecting images.
[0166] The electronic device 200 can also select a corresponding number of pictures from the pictures of each keyword according to the number of pictures displayed on the home screen interface for each keyword and according to the time of each picture. Specifically, the electronic device 200 selects a corresponding number of pictures according to the time of each picture of the keyword, in the order from new to old or from old to new, as the pictures displayed on the home screen interface for the keyword. For details, please refer to the above content related to selecting pictures displayed on the home screen interface for each subcategory, which will not be repeated here.
[0167] When selecting pictures to be displayed on the home screen for each keyword, if the number of pictures of the keyword is less than the number of pictures displayed on the home screen for the keyword, all pictures of the keyword will be used as pictures displayed on the home screen; if the number of pictures of the keyword is greater than the number of pictures displayed on the home screen for the keyword, a corresponding number of pictures can be selected based on the matching degree of the pictures or other methods as pictures displayed on the home screen for the keyword. For example, the keywords include "cat" and "dog". There are 8 pictures of "cat" displayed on the home screen, but there are only 6 pictures of "cat", so all pictures of "cat" will be displayed on the home screen. There are 8 pictures of "dog" displayed on the home screen, and there are only 15 pictures of "dog", so 8 pictures need to be selected from the 15 pictures of dog as pictures displayed on the home screen for the keyword "dog".
[0168] After obtaining the pictures displayed on the home screen interface for each keyword, the electronic device 200 can display pictures of multiple keywords on the home screen interface.
[0169] When displaying multiple keyword images on the home screen, you can first determine the priorities of the multiple keywords. The priority of a keyword is related to the display order of the keyword images on the home screen. The higher the priority of a keyword, the higher the display position of the keyword image on the home screen.
[0170] Optionally, the electronic device 200 can determine the priority of multiple keywords according to the order in which the multiple keywords are obtained. For example, Xiaohongshu 104 calls the picture selector to transmit multiple keywords to the gallery 102, and the transmission order of the multiple keywords is: cat, giant panda. At this time, the priority of cat is higher than that of giant panda.
[0171] Certainly, electronic device 200 can also determine the priority of multiple keywords by other means.For example, according to the number of pictures in the picture set of keywords, determine the priority of multiple keywords.At this moment, 50 pictures are arranged in the picture set of cat, and 60 pictures are arranged in the picture set of giant panda, then the priority of giant panda is higher than the priority of cat.For another example, determine the priority of multiple keywords by random mode.
[0172] Images with the same keyword can be displayed in a cluster on the home screen, or they can be displayed in a non-cluster.
[0173] For example, see Figure 5A The schematic diagram of the picture display based on multiple keywords provided in the embodiment of the present application is shown. Figure 1AIn the scenario, after the mobile phone 100 displays the graphic template interface 107, the user clicks the graphic template 109. The graphic template 109 is a graphic template with the theme of graduation season, and a note with the theme of graduation season can be created through the graphic template 109.
[0174] In response to a click operation on the graphic template 109 , the mobile phone 100 displays the graduation season template interface 136 of the graphic template 109 ; after the user clicks the “Use Now” button in the graduation season template interface 136 , the mobile phone 100 responds to the click operation and obtains the target information of Xiaohongshu 104 , and the target information may be related to the interface content of the graduation season template interface 136 .
[0175] At this time, the interface content of the graduation season template interface 136 includes the text content of "graduation season", podium pictures, classroom pictures, and playground pictures, etc. Among them, the podium pictures refer to pictures taken at the podium, and the pictures usually include relevant features of the podium (for example, the pictures include blackboards); classroom pictures refer to pictures taken in the classroom, and the pictures usually include features of the classroom (for example, the pictures include desks); playground pictures refer to pictures taken in the playground, and the pictures usually include features of the playground (for example, the pictures include grass on a football field).
[0176] The target information may include four keywords, namely, graduation photo, classroom, podium, and playground. The order of obtaining these four keywords is: graduation photo, podium, classroom, playground, that is, "graduation photo" is obtained first, and "playground" is obtained last.
[0177] After the mobile phone 100 obtains the four keywords of graduation photo, classroom, podium, and playground, it selects a collection of graduation photo pictures, a collection of classroom pictures, a collection of podium pictures, and a collection of playground pictures from the pictures in the gallery 102 according to the matching degree between the pictures and the keywords.
[0178] The mobile phone 100 can select a corresponding number of pictures from the picture collection of each keyword as the pictures displayed on the first screen interface according to the number of pictures that can be displayed on the first screen interface and the matching degree of each picture. In this case, 4 pictures are selected from the picture collection of graduation photos, the picture collection of classrooms, the picture collection of podiums, and the picture collection of playgrounds, respectively, as the pictures displayed on the first screen interface.
[0179] According to the order in which the four keywords, graduation photo, classroom, podium, and playground, are obtained, the mobile phone 100 determines the priority of the four keywords as follows: graduation photo > podium > classroom > playground. Therefore, the order in which the pictures of the four keywords are displayed on the home screen is: graduation photo > podium > classroom > playground. In addition, the mobile phone 100 aggregates and displays the pictures of each keyword.
[0180] The mobile phone 100 displays the picture selection interface 137 according to the priority of the four keywords, namely, graduation photo, classroom, podium, and playground. The first row of the first screen of the picture selection interface 137 displays four pictures of graduation photo, the second row displays four pictures of podium, the third row displays four pictures of classroom, and the fourth row displays four pictures of playground. The picture selection interface 137 includes a recommended page button 138. Figure 5A In the recommendation interface.
[0181] After the mobile phone 100 displays the picture selection interface 137, when the user is creating a note with the theme of graduation season, he can quickly and easily select various pictures related to graduation season from the pictures of the four keywords of graduation photos, classrooms, podiums, and playgrounds displayed on the picture selection interface 137, without having to turn pages to find various outfit pictures for graduation season, which improves the convenience of user selection of pictures. In addition, the aggregated display of pictures of various keywords on the first screen interface also further facilitates the user to select pictures.
[0182] Optionally, the picture selection interface 137 may further include a graduation photo tab button 139, a podium tab button 140, a classroom tab button 141, and a playground tab button 142. The classroom tab button 141 and the playground tab button 142 are displayed in an interface other than the picture selection interface 137, and the user may find the classroom tab button 141 and the playground tab button 142 by sliding. The order of the tab buttons of each keyword may be consistent with the display order of each keyword on the home screen interface.
[0183] The user can click the status tab button to trigger the mobile phone 100 to display the tab of the corresponding status. For example, when the user clicks the classroom tab button 141, the mobile phone 100 responds to the click operation and displays the classroom tab. The classroom tab displays pictures of all classrooms.
[0184] Optionally, when the target information includes at least two keywords, the search result classification may be further performed on the picture set of the keywords to further determine whether the keywords include subcategories; or the search result classification may not be performed on the picture set of the keywords.
[0185] When the search result classification is performed on the picture set of the keyword, the electronic device 200 determines the subcategories included in the keyword according to the search result classification, and displays pictures of multiple subcategories on the home screen interface.
[0186] For example, in Figure 5AIn the example, after obtaining the picture set of graduation photos, each picture in the picture set of graduation photos can be further classified to determine the category of each picture. At this time, through the classification of the search results, it is determined that the picture set of graduation photos includes 50 pictures of people wearing sunglasses and 30 pictures of people wearing hats. That is, the keyword "graduation photo" includes two subcategories: wearing sunglasses and wearing hats.
[0187] In order to allow pictures of multiple subcategories to be displayed on the home screen, a corresponding number of pictures can be reasonably selected from the pictures of each subcategory according to the number of pictures displayed on the home page for the keyword, as the pictures of the subcategory displayed on the home screen. The total number of pictures of multiple subcategories displayed on the home screen is made less than or equal to the number of pictures displayed on the home page for the keyword. Among them, the number of pictures of the two subcategories of wearing sunglasses and wearing hats displayed on the home screen can be determined based on the principle of average distribution, or based on the proportion of pictures wearing sunglasses and wearing hats. The proportion of pictures refers to the ratio between the number of pictures wearing sunglasses or the number of pictures wearing hats and the number of pictures of graduation photos.
[0188] Assuming that the number of pictures displayed on the homepage for the keyword "graduation photo" is 4, select 2 pictures from the 50 pictures of people wearing sunglasses as the pictures displayed on the homepage for the subcategory of wearing sunglasses; select 2 pictures from the 30 pictures of people wearing hats as the pictures displayed on the homepage for the subcategory of wearing hats.
[0189] Furthermore, the priorities of the two subcategories of wearing sunglasses and wearing hats can be determined, and then the display order of the two subcategories on the home screen interface can be determined. Specifically, the priority can be determined by the number of pictures in the subcategory. At this time, since the number of pictures of wearing sunglasses is greater than the number of pictures of wearing hats, the priority of the "wearing sunglasses" subcategory is higher than the priority of the "wearing hat" subcategory. Therefore, in the home screen interface of the picture selection interface 137, the first two pictures in the first row are pictures of wearing sunglasses, and the last two pictures are pictures of wearing hats.
[0190] Furthermore, you can also display tabs of subcategories of keywords. For example, Figure 5A The graduation photo in the includes two subcategories: wearing sunglasses and wearing hats. In this case, you can set a drop-down option in the label page button of the graduation photo to display the labels of wearing sunglasses and wearing hats in the drop-down option. Figure 5B The schematic diagram of the subcategory tab page of the keyword provided in the embodiment of the present application is shown, based on Figure 5AIn the scenario of the graduation photo tab, the mobile phone 100 displays the graduation photo tab drop-down option interface 143 in response to the user clicking the graduation photo tab button 139. The graduation photo tab drop-down option interface 143 includes two options: wearing sunglasses and wearing a hat. The user can click the wearing sunglasses option to trigger the mobile phone 100 to display a tab including all graduation photos wearing sunglasses; and click the wearing hat option to trigger the mobile phone 100 to display a tab including all graduation photos wearing hats.
[0191] By analogy, the electronic device 200 can further classify the search results of the sub-category pictures to determine the number and category of the secondary sub-categories included in the sub-category, and display multiple secondary sub-category pictures on the home screen. Figure 3A and Figure 3B In the scenario, the keyword is "pet", and the subcategories of the keyword "pet" are "dog" and "cat". At this point, the search results of the "cat" and "dog" pictures can be further classified. Assuming that the search results of the "dog" pictures are classified, it is determined that the "dog" pictures include 30 pictures of dogs wearing clothes and 40 pictures of dogs wearing scarves. Then, according to the number of pictures of the "dog" subcategory displayed on the home screen, a corresponding number of pictures are selected from the 30 pictures of dogs wearing clothes and the 40 pictures of dogs wearing scarves as the pictures displayed on the home screen. Assuming that the number of pictures of the "dog" subcategory displayed on the home screen is 8, 4 pictures are selected from the 30 pictures of dogs wearing clothes and displayed on the home screen, and 4 pictures are selected from the 40 pictures of dogs wearing scarves and displayed on the home screen. Similarly, tabs for the two secondary subcategories of "wearing a scarf" and "wearing clothes" can also be set. The specific form can be as follows Figure 5B As shown, no further description is given here.
[0192] In some other embodiments, the target information may only include a single keyword, and the candidate picture set of the keyword is not further classified into search results, or the keyword does not include subcategories. At this time, after obtaining the keyword, the electronic device 200 first selects the picture set of the keyword from the picture set according to the degree of matching between each picture in the picture set and the keyword; then, according to the number of pictures that can be displayed on the first screen interface, according to the degree of matching of the pictures and / or the score of the pictures (for example, scoring the pictures according to the clarity and composition of the pictures), selects a corresponding number of pictures from the picture set of the keyword, and displays the selected pictures on the first screen interface. In this way, the user can see pictures with better picture quality on the first screen interface, or pictures that the user is more likely to need to upload, which improves the user's experience of selecting pictures in the picture upload scenario. Of course, it is also possible to select pictures displayed on the first screen interface from the picture set of the keyword in other ways (for example, according to the order of the time of the pictures, etc.).
[0193] Image recommendation and display based on events:
[0194] After the electronic device 200 displays the interface of the application on the display screen 230, if a target operation input by the user on the interface of the application is received, the target information related to the interface content of the application is obtained in response to the target operation. The target information may include event information of one or more events. The target operation is an operation for uploading a picture.
[0195] In a specific application, after acquiring the target information, the electronic device 200 can parse the target information and extract the event information. The number of events can be obtained according to the number of event information.
[0196] Event information may include time, place, person, and specific circumstances of the event, etc. Event information may be expressed as (4W, when, where, who, what), where when indicates the time when the event occurs, where indicates the place where the event occurs, who indicates the person, and what indicates the specific object of the event (such as animals, plants, and activities, etc.), and activities include running and cycling, etc.
[0197] In some embodiments, if the target information only includes event information of one event, after the electronic device 200 extracts the event information from the target information, it filters out a picture set of the event from the picture set according to the event information of the event.
[0198] The image collection of an event may include images of multiple objects or images of a single object. Figure 1B In the scenario shown, the target information is the text content "On Sunday, my family went to the zoo and saw giant pandas and ferocious dogs". The event information extracted from the target information includes information such as Sunday, zoo, giant pandas and dogs. According to the event information, the pictures of giant pandas and dogs that meet the time requirements (i.e. Sunday) and the location requirements (i.e. zoo) are retrieved from the picture collection, thereby obtaining the picture collection of the event. At this time, the picture collection of the event includes pictures of "dogs" and "giant pandas", that is, pictures of the two objects "dogs" and "giant pandas".
[0199] If the picture set of the event includes only pictures of one object, the electronic device 200 can select a corresponding number of pictures from the picture set of the event based on the number of pictures that can be displayed on the first screen interface, according to the matching degree of each picture and / or the picture score (for example, the pictures can be scored according to clarity and composition, etc.), and display the selected pictures on the first screen interface. The number of selected pictures is less than or equal to the number of pictures that can be displayed on the first screen interface.
[0200] The electronic device 200 can also select pictures to be displayed on the home screen interface of the event from the picture collection of the event in other ways. For example, pictures to be displayed on the home screen interface of the event are selected from the picture collection of the event in the order of the time of the pictures, from new to old or from old to new. For another example, pictures with a matching degree greater than or equal to a matching degree threshold are screened out from the picture collection of the event based on the matching degree of each picture, and then pictures to be displayed on the home screen interface of the event are selected from pictures with a matching degree greater than or equal to a matching degree threshold in the order of the time of the pictures, from new to old or from old to new.
[0201] If the image set of an event includes images of multiple objects, in order to ensure that the first screen interface can display images of multiple objects, a corresponding number of images can be selected from the images of each object according to the number of images and the number of categories that can be displayed on the first screen interface, as the images of each object displayed on the first screen interface. The total number of images of all objects displayed on the first screen interface is less than or equal to the number of images that can be displayed on the first screen interface.
[0202] For example, the number of pictures that can be displayed on the home screen is 16, and the picture collection of a certain event includes 30 pictures of "dog" and 40 pictures of "giant panda". At this time, 8 pictures are selected from the 30 pictures of "dog" as the pictures of the object "dog" displayed on the home screen; 8 pictures are selected from the 40 pictures of "giant panda" as the pictures of the object "giant panda" displayed on the home screen. Displaying pictures of multiple objects in an event on the home screen can make it convenient for users to obtain pictures of multiple objects on the home screen without turning pages to obtain pictures of each object in the event, which improves the convenience of user selection of pictures.
[0203] Optionally, when selecting a picture to be displayed on the home screen of a certain object, the pictures can be selected based on the matching degree of each picture. For example, based on the matching degree between each picture and the word "giant panda", the picture to be displayed on the home screen of the object can be selected from the pictures of the "giant panda" category;
[0204] When selecting a picture to be displayed on the home screen of an object, you can also select according to the scores of each picture. For example, score the pictures according to their clarity, content, and composition, and select the picture to be displayed on the home screen of the object according to the scores. Of course, you can also select the picture to be displayed on the home screen of an object from the pictures of the object by random selection.
[0205] But in comparison, selecting pictures of each category to be displayed on the first screen interface according to the degree of picture matching or the score of the picture can make the picture quality displayed on the first screen interface better, or it is more likely to be the picture that the user needs to upload, which can further improve the user's experience of selecting pictures. Optionally, after the electronic device 200 selects the pictures displayed on the first screen interface for each object in the event, it can first determine the priority of each object, and then display the pictures of each object on the first screen interface according to the priority of each object. Among them, the higher the priority of the object, the closer its picture is displayed on the first screen interface. In this way, pictures with high priority can be presented first, which improves the convenience of user selection of pictures.
[0206] Exemplarily, the electronic device 200 may determine the priority of the object according to the number of pictures of each object. For example, when the candidate picture set includes 30 pictures of "dog" and 40 pictures of "giant panda", the priority of "dog" is lower than that of "giant panda".
[0207] Of course, the electronic device 200 can also determine the priority of the object in other ways. For example, the priority of each object can be determined according to the frequency of occurrence and description complexity of each object in the target information. At this time, assuming that the candidate picture set of a certain event includes two objects, "dog" and "giant panda", and the target information includes a large text description of "giant panda", it is considered that the frequency of occurrence and description complexity of "giant panda" are higher than the frequency of occurrence and description complexity of "dog", and the priority of "giant panda" is determined to be higher than the priority of "dog". For example, priority can be sorted according to the distance between the cursor position of the inserted picture and the position of the text of each object. The closer the distance, the higher the priority. The position of the text of the object refers to the position of the text content describing the object on the interface, and the priority of each object is determined according to the distance between the position and the position of the inserted picture (i.e., the cursor position). For another example, the priority of each object can also be determined by at least two of the number of pictures of the object, the frequency of occurrence and description complexity of the object, and the distance between the text position of the object and the cursor position of the inserted picture.
[0208] Among them, when determining the number of pictures displayed on the first-screen interface for each object in the event according to the number of pictures that can be displayed on the first-screen interface (i.e., the number of first pictures), the electronic device 200 can adopt the principle of average distribution to determine the number of pictures displayed on the first-screen interface for each object. Of course, the electronic device 200 can also use other methods to determine the number of pictures displayed on the first-screen interface for each object. For example, the number of pictures displayed on the first-screen interface for each object can be determined based on the proportion of pictures of each object, and the number of pictures of an object is positively correlated with the number of pictures displayed on the first-screen interface for the object. For another example, the number of pictures displayed on the first-screen interface for each object can be determined based on the priority of each object. Objects with high priority have more pictures displayed on the first-screen interface, that is, the priority of an object is positively correlated with the number of pictures displayed on the first-screen interface for the object.
[0209] Optionally, the electronic device 200 can aggregate and display pictures of the same object on the first screen interface. In this way, pictures of the same object on the first screen interface are displayed side by side, further improving the convenience of the user to select pictures.
[0210] Optionally, the electronic device 200 can also display the tabs of each object, so that when the user selects a picture of a certain object, the interference of pictures of other objects is reduced, thereby improving the user experience.
[0211] For example, see Fig. 6A The schematic diagram of displaying a single event with multiple categories of pictures provided by the embodiment of the present application is shown, based on Figure 1A and Figure 1B In the scenario, the mobile phone 100 displays the microblog creation interface 115. The microblog creation interface 115 includes the text content input by the user "During the National Day, my family went to the Shanghai Wild Animal Park and saw giant pandas, ferocious dogs, and beautiful cats". When the user clicks the picture insertion button 116 on the microblog creation interface 115, the mobile phone 100 responds to the click operation and obtains the target information of the microblog 103. At this time, the target information is the text content information, and the text content information is specifically "During the National Day, my family went to the Shanghai Wild Animal Park and saw giant pandas, ferocious dogs, and beautiful cats".
[0212] Mobile phone 100 extracts event information from target information, and the event information may include multiple words such as National Day, Shanghai Wild Animal Park, giant panda, dog and cat. Combined search is performed based on multiple words such as National Day, Shanghai Wild Animal Park, giant panda, dog and cat, and pictures of dogs, giant pandas and cats that meet the time requirement (i.e. National Day) and the location requirement (i.e. Shanghai Wild Animal Park) are screened out from the pictures in gallery 102 to obtain a picture set of the event. That is, pictures of dogs, giant pandas and cats taken in Shanghai Wild Animal Park on National Day are screened out from the picture set. At this point, the target information includes event information of an event.
[0213] After mobile phone 100 obtains the picture collection of the event, since the picture collection includes pictures of three objects, namely cats, giant pandas and dogs, it determines the number of pictures of each object displayed on the home screen interface based on the number of pictures that can be displayed on the home screen interface, and then selects a corresponding number of pictures from the pictures of dogs, giant pandas and cats according to the number of pictures of each object displayed on the home screen interface, and displays the selected pictures on the home screen interface.
[0214] For example, suppose the picture collection of the event includes 10 pictures of dogs, 20 pictures of giant pandas, and 15 pictures of cats. The number of pictures that can be displayed on the first screen is 16, and the number of pictures of each object displayed on the first screen is 4. At this time, 4 pictures are selected from the 10 pictures of dogs, and these 4 pictures are used as pictures of "dogs" displayed on the first screen; 4 pictures are selected from the 20 pictures of giant pandas, and these 4 pictures are used as pictures of "giant pandas" displayed on the first screen; 4 pictures are selected from the 15 pictures of giant pandas, and these 4 pictures are used as pictures of "cats" displayed on the first screen. Of course, 5 pictures of dogs, 6 pictures of giant pandas, and 5 pictures of cats can also be selected and displayed on the first screen.
[0215] At this time, the mobile phone 100 can select the pictures of each object to be displayed on the homepage from the pictures of each object according to the picture scores. For example, for 20 pictures of giant pandas, the 20 pictures of giant pandas are scored according to picture information such as picture clarity, picture content and composition, and the 20 pictures of giant pandas are sorted according to the picture scores; the top four pictures of giant pandas are selected as the pictures displayed on the homepage interface of "Giant Panda".
[0216] The mobile phone 100 can also determine the priority of cats, dogs and giant pandas to determine the display order of the pictures of these three objects on the home screen interface. At this time, it is assumed that the cat has the highest priority and the giant panda has the lowest priority.
[0217] The mobile phone 100 displays the picture selection interface 144 according to the priorities of cats, dogs and giant pandas and the four pictures of the three objects selected, namely, cats, dogs and giant pandas, displayed on the home screen interface.
[0218] On the home screen of the picture selection interface 144, 4 cat pictures are aggregated and displayed in the first row, 4 dog pictures are aggregated and displayed in the second row, and 4 giant panda pictures are aggregated and displayed in the third row. A recommended page button 145 is displayed on the picture selection interface 144. Fig. 6A Zhongzheng is under the recommended page.
[0219] Optionally, the mobile phone 100 can also display tabs for three objects: cats, dogs, and giant pandas, and the order of the tab buttons is the same as the order in which the three objects are displayed on the home screen interface. At this time, the order in which the three objects: cats, dogs, and giant pandas are displayed on the home screen interface is: cats, dogs, and giant pandas. Therefore, the mobile phone 100 displays a cat tab button 146, a dog tab button 147, and a giant panda tab button 148 on the picture selection interface 144. Among them, the giant panda tab button 148 is displayed in an interface outside the picture selection interface 144, and the user can find the giant panda tab button 148 by sliding. The cat tab button 146 is closest to the recommended page button 145, and the giant panda tab button 148 is farthest from the recommended page button 145.
[0220] The user can click on a tab button to trigger the mobile phone 100 to display a corresponding tab. The tab displays all pictures of the category. For example, when the user clicks on the cat tab button 146, the mobile phone 100 displays the cat tab in response to the click operation. Figure 6B The cat tab page 149 in the mobile phone 100 can display all the cat pictures on the mobile phone 100, rather than only displaying the cat pictures taken at the Shanghai Zoo during the National Day. Figure 6B This is a schematic diagram of the cat label page provided in an embodiment of the present application.
[0221] exist Fig. 6A and Figure 6B In the example, mobile phone 100 displays pictures of dogs, cats and giant pandas that meet the time and location requirements on the home screen, that is, displays pictures of all objects. When users create microblogs, users can obtain pictures of corresponding objects on the home screen, without turning pages to obtain pictures of corresponding objects. Pictures that need to be uploaded to microblog 103 can be selected on the home screen, thereby improving the convenience of user selection of pictures. In addition, pictures of dogs, cats and giant pandas are aggregated and prioritized, so that pictures with high priority can be presented first, allowing users to select pictures to be uploaded more simply and conveniently.
[0222] In other embodiments, if the target information includes event information of at least two events, after the electronic device 200 extracts the event information from the target information, it filters out a picture set of each event from the picture set according to the event information of each event.
[0223] In order to ensure that all images of events are displayed on the home screen, the electronic device 200 selects a corresponding number of images from the image set of each event according to the number of images that can be displayed on the home screen, as images displayed on the home screen for each event. The total number of images displayed on the home screen for each event is less than or equal to the number of images that can be displayed on the home screen. The number of images displayed on the home screen for each event can be the same or different.
[0224] When determining the number of pictures displayed on the first screen interface for each event based on the number of pictures that can be displayed on the first screen interface, the number of pictures displayed on the first screen interface for each event can be determined by an average distribution method. For example, the number of pictures that can be displayed on the first screen interface is 16, and there are 2 events in total, then the number of pictures displayed on the first screen interface for each event is 8. Of course, the number of pictures displayed on the first screen interface for each event can also be determined by other methods, for example, the number of pictures displayed on the first screen interface for each event can be determined based on the importance of each event or the proportion of pictures. Events with higher importance or a larger proportion of pictures have more pictures displayed on the first screen interface. For example, the number of pictures that can be displayed on the first screen interface is 16, and there are a first event and a second event in total. The importance of the first event is higher than that of the second event, then it is determined that the number of pictures displayed on the first screen interface for the first event is 10, and the number of pictures displayed on the first screen interface for the second event is 6.
[0225] For each event, the electronic device 200 can select a corresponding number of pictures from the picture set of the event according to the number of pictures displayed on the first screen interface of the event, as the pictures displayed on the first screen interface of the event. For example, the picture set of the event has 50 pictures, and the number of pictures displayed on the first screen interface of the event is 8. These 50 pictures are sorted according to the degree of matching, and the top eight pictures with the highest matching degree are selected from the 50 pictures as the pictures displayed on the first screen interface of the event. The matching degree of the picture refers to the degree of matching between the picture and the event information. Of course, the electronic device 200 can also select a corresponding number of pictures from the picture set of the event in other ways as the pictures displayed on the first screen interface of the event. For example, a corresponding number of pictures can be randomly selected from the pictures of the event, or each picture in the picture set of the event can be scored (for example, according to clarity and composition, etc.), and a corresponding number of pictures can be selected from the picture set according to the score of the picture.
[0226] Among them, according to the number of pictures displayed on the first screen interface of the event, when selecting the pictures displayed on the first screen interface of the event from the picture collection of the event, the pictures can be selected according to the matching degree between each picture and the object in the event (i.e., what), or according to the picture score, or according to the time sequence of the pictures. When the event includes multiple objects (i.e., what includes multiple objects), a corresponding number of pictures can be selected from each object, so that the total number of pictures selected for each object is less than the number of pictures displayed on the first screen interface of the event.
[0227] In comparison, selecting pictures to be displayed on the home screen interface of an event from the picture collection of the event based on the degree of picture matching or the picture score can make the pictures displayed on the home screen interface better in quality, or more likely to be the pictures that the user needs to upload, thereby further improving the user's experience of selecting pictures.
[0228] Optionally, the electronic device 200 can also sort multiple events to determine the priority of each event. The priority of an event is related to the order in which the image of the event is displayed on the home screen interface. Generally, the higher the priority of an event, the closer the image of the event is displayed on the home screen interface.
[0229] For example, the electronic device can calculate the importance of the event based on the completeness of the event content, the frequency of occurrence and the complexity of the description, the distance between the insertion position and the position of the text corresponding to the event, and at least one of the time accuracy and location accuracy, and sort the events according to their importance (i.e., determine the priority of the events). Events with high importance have high priority.
[0230] The completeness of event content refers to the completeness of event information. For example, the completeness of event content can be determined based on the missing 4W information (i.e. when, where, who, what) of the event. The higher the completeness of event content, the higher the importance of the event.
[0231] The frequency of occurrence and the complexity of description refer to the frequency of occurrence of the event in the target information and the length of the description of the event. The higher the frequency of occurrence and the complexity of description, the more important the event is.
[0232] The distance between the insertion position and the position of the text corresponding to the event content refers to the distance between the image insertion position and the position of the text corresponding to the event for the scenario where the image is inserted into the text. The smaller the distance, the higher the importance of the event.
[0233] Time accuracy and location accuracy refer to the accuracy of the time information and location information in an event. The higher the accuracy, the more important the event is. For example, if the time of the first event is October and the time of the second event is October 1, the time accuracy of the second event is higher than that of the first event.
[0234] When determining the event priority based on the completeness of the event content, the frequency of occurrence and the complexity of the description, the distance between the insertion position and the position of the corresponding text of the event, and at least two of the time accuracy and location accuracy, a weight can be assigned to each item, and then the score and weight of each item are multiplied, and the products are added to obtain the total score of the event. According to the total score of each event, the importance of each event is determined to determine the priority of each event.
[0235] In addition, the priority of events can be determined according to the order in which the events occurred. For example, the farther the event occurred from the current time, the higher the priority of the event. The priority of each event can also be determined according to the number of pictures of each event. For example, the more pictures of an event, the higher the priority of the event.
[0236] After obtaining the pictures displayed on the home screen interface of each event and the priority of each event, the electronic device 200 can display pictures of multiple events on the home screen interface. Pictures of the same event can be displayed in an aggregated manner on the home screen interface, or they can be displayed in an unaggregated manner.
[0237] By displaying pictures of multiple events on the home screen, the electronic device 200 allows the user to obtain pictures of multiple events on the home screen without having to turn pages to find pictures of events, thereby improving the convenience of user selection of pictures. In addition, multiple events are sorted to determine the order of display positions of each event on the home screen, so that pictures of events with high priority are presented first, further improving the convenience of user selection of pictures.
[0238] Optionally, if a picture set of an event includes pictures of one or more objects, the electronic device 200 can also display a tab page of the object. For example, if a picture set of an event includes pictures of cats, the electronic device 200 can display a tab page including all pictures of cats.
[0239] For each of the multiple events, the picture set of the event may include pictures of multiple objects or may include pictures of one object. If the picture set of the event only includes pictures of one object, the electronic device 200 can select a corresponding number of pictures from the picture set of the event based on the number of pictures displayed on the home screen interface of the event, according to the matching degree of each picture and / or the picture score (for example, the pictures can be scored according to clarity and composition, etc.), and display the selected pictures on the home screen interface. The number of selected pictures is less than or equal to the number of pictures displayed on the home screen interface of the event.
[0240] If the image set of an event includes images of multiple objects, optionally, in order to ensure that the first screen interface can display images of multiple objects, a corresponding number of images can be selected from the images of each object according to the number of images and the number of categories displayed on the first screen interface of the event, as the images of each object displayed on the first screen interface. The total number of images of all objects displayed on the first screen interface is less than or equal to the number of images displayed on the first screen interface of the event.
[0241] For example, the number of pictures that can be displayed on the home screen is 16, and the number of pictures displayed on the home screen for a certain event is 8. The picture collection of a certain event includes 30 pictures of "dog" and 40 pictures of "giant panda", and the number of pictures of each object displayed on the home screen is 4. At this time, 4 pictures are selected from the 30 pictures of "dog" as the pictures of "dog" displayed on the home screen; 4 pictures are selected from the 40 pictures of "giant panda" as the pictures of "giant panda" displayed on the home screen.
[0242] Displaying pictures of multiple objects in an event on the home screen interface can facilitate users to obtain pictures of multiple objects on the home screen interface without turning pages to obtain pictures of each object in the event, thereby improving the convenience of user selection of pictures.
[0243] Optionally, after selecting the images of each object of the event to be displayed on the home screen, the electronic device 200 may first determine the priority of each object, and then display the images of each object on the home screen according to the priority of each object. The higher the priority of the object, the closer its image is displayed on the home screen. In this way, images with high priority can be presented first, improving the editing efficiency of the image selected by the user.
[0244] Optionally, the electronic device 200 can aggregate and display pictures of the same object on the first screen interface. In this way, pictures of the same object on the first screen interface are displayed side by side, further improving the convenience of the user to select pictures.
[0245] Optionally, the electronic device 200 can also display the tabs of each object, so that when the user selects a picture of a certain object, the interference of pictures of other objects is reduced, thereby improving the user experience.
[0246] For example, see Figure 7 The schematic diagram of the picture display of multiple events provided by the embodiment of the present application is shown, based on Figure 1A In the scenario, after the mobile phone 100 starts the microblog 103, the microblog creation interface 159 is displayed. The microblog creation interface 159 includes the text content input by the user "On October 1, my family went to Shanghai Wild Animal Park. On October 2, my family went to Haichang Ocean Park and watched the killer whale show."
[0247] When the user clicks the picture insert button 116 on the microblog creation interface 159, the mobile phone 100 responds to the click operation and obtains the target information of the microblog 103. At this time, the target information is text content information, and the text content information is specifically "On October 1, my family went to Shanghai Wild Animal Park. On October 2, my family went to Haichang Ocean Park and watched the killer whale show."
[0248] The mobile phone 100 extracts event information from the target information, and can obtain event information of event 1 and event information of event 2. The event information of event 1 may include multiple words such as October 2, Haichang Ocean Park, and killer whale. The event information of event 2 may include multiple words such as October 1 and Shanghai Wild Animal Park.
[0249] The mobile phone 100 performs image retrieval based on the event information of each event. Specifically, for event 1, a combination search is performed based on multiple words such as October 2, Haichang Ocean Park, and killer whale, and killer whale pictures that meet the time requirement (i.e. October 2) and the location requirement (i.e. Haichang Ocean Park) are selected from the pictures in the picture library 102 to obtain a candidate picture set for the event. That is, pictures of killer whales taken at Haichang Ocean Park on October 2 are selected from the picture set.
[0250] For event 2, a combined search is performed based on multiple words such as October 1 and Shanghai Wild Animal Park, and pictures that meet the time requirement (i.e. October 1) and the location requirement (i.e. Shanghai Wild Animal Park) are selected from the pictures in the picture library 102 to obtain a candidate picture set for the event. That is, pictures taken at Shanghai Wild Animal Park on October 1 are selected from the picture set.
[0251] When mobile phone 100 determines the importance of event 1 and event 2, since the event content of event 2 does not include what information, while the event content of event 1 includes what information (i.e., killer whale), it determines that the event content completeness of event 1 is higher than the event content completeness of event 2, and the importance of event 1 is higher than that of event 2.
[0252] That is to say, on the first screen interface, the display position of the picture of event 1 is ahead of the display position of the picture of event 2.
[0253] The mobile phone 100 selects pictures from the picture collection of event 1 and the picture collection of event 2 according to the number of pictures that can be displayed on the first screen. At this time, assuming that the number of pictures that can be displayed on the first screen is 16, the number of pictures displayed on the first screen of event 1 and event 2 is 8. The mobile phone 100 can select 8 killer whale pictures from the picture collection of event 1 and 8 pictures from the picture collection of event 2 according to the picture scores and / or the degree of picture matching.
[0254] The mobile phone 100 displays the picture selection interface 151 according to the pictures displayed on the home screen of each event and the event priority. The picture selection interface 151 includes a recommended page button 151, Figure 7 The first screen of the picture selection interface 151 displays pictures of event 1 and event 2, and the 8 killer whale pictures of event 1 are displayed in an aggregated manner, and the 8 pictures of event 2 are displayed in an aggregated manner.
[0255] In this way, when a user creates a microblog, if he needs to insert a picture in the microblog, he can obtain the pictures of event 1 and event 2 from the first screen interface of the picture selection interface 151, without turning pages to find the pictures of event 1 and event 2, which is more convenient. In addition, multiple pictures of the same event are displayed in an aggregated manner, and pictures of events with high priority are presented first, which can further improve the convenience of user selection of pictures.
[0256] At this time, the mobile phone 100 also displays the tab page of the killer whale. That is, the picture selection interface 151 also displays the killer whale tab page button 153. The user can trigger the mobile phone 100 to display the tab page of the killer whale by clicking the killer whale tab page button 153.
[0257] exist Figure 3A , Figure 4 , Figure 5A , Fig. 6A and Figure 7 In the scenario shown, when a user creates a text (such as a note or a microblog), if a picture needs to be uploaded, the mobile phone 100 recommends pictures based on the acquired text information (such as keywords and the text content entered by the user), intelligently sorts the recommended pictures, and displays them on the home screen. Displaying pictures of multiple elements (such as multiple keywords, multiple events, multiple objects in an event, and multiple subcategories in a keyword) on the home screen allows the user to obtain the pictures they want to upload on the home screen, which is simpler and more convenient.
[0258] In some embodiments, when the electronic device 200 performs image retrieval based on the event information of the event, it will perform retrieval based on multiple dimensional information. For example, a combined retrieval is performed based on dimensional information such as the time, location, and object of the event. In an embodiment of the present application, if an image retrieval is performed based on the event information and there is no retrieval result, an intelligent fallback retrieval can be performed to obtain the retrieval result.
[0259] Smart fallback retrieval refers to performing a search after removing one or more dimensional information. For example, the event information includes multiple words such as October 2, Haichang Ocean Park, and Killer Whale. When performing an image search based on these multiple words, no matching images are found (i.e., no search results). At this point, at least one of October 2, Haichang Ocean Park, and Killer Whale can be removed before performing an image search. Assuming that the time dimension information of October 2 is removed, an image search is performed based on the two words Haichang Ocean Park and Killer Whale, thereby retrieving images of killer whales taken at Haichang Ocean Park.
[0260] In the embodiment of the present application, when there are no results in the image search, an intelligent fallback search can be performed to avoid a bad experience for the user due to no search results.
[0261] In the above embodiments, when selecting pictures, the electronic device 200 can first cluster the pictures similarly, and then select one or more preferred pictures from the pictures in the same cluster, so that the display position of the preferred pictures in the same cluster is higher than the display position of the non-preferred pictures. In this way, it can avoid the interference of multiple repeated similar pictures on the user's selection of pictures, and further improve the convenience and experience of the user's selection of pictures.
[0262] For example, in a single keyword and single subcategory scenario, the electronic device 200 selects the picture set of the keyword from the picture set, and then clusters similar pictures of the picture set of the keyword to obtain a similar picture set. Optionally, the electronic device 200 can aggregate and classify similar pictures according to information such as the picture content, the shooting time of the picture, and the shooting location of the picture to generate a similar picture set.
[0263] For each similar picture set, each picture is sorted, and a preset number of pictures with the highest sorting are selected as preferred pictures. Optionally, for each similar picture in the same similar picture set, the electronic device 200 can score the picture according to information such as picture composition, picture color, and picture clarity, so as to obtain the score of each similar picture; sort the similar pictures according to the scores, and select the preferred pictures according to the scores of the pictures.
[0264] When the electronic device 200 displays pictures matching a keyword, for pictures in the same similar picture set, the preferred pictures are displayed at a front position, and the non-preferred pictures are displayed at a back position.
[0265] For example, see Figure 8 A schematic diagram of similar image sorting optimization provided by an embodiment of the present application is shown. After the mobile phone 100 displays the cup template details interface 154 of Xiaohongshu 104, the user clicks the "Use Now" button on the cup template details interface 154, and the mobile phone 100 displays the image selection interface 155.
[0266] After the user clicks the "Use Now" button on the cup template details interface 154, the mobile phone 100 obtains the target information from the Little Red Book 104. At this time, the target information includes the keyword "cup".
[0267] The mobile phone 100 selects pictures matching the cup from the pictures in the gallery 102 to obtain a picture set of the cup. The picture set of the cup is clustered with similar pictures to obtain a similar picture set. Assume that pictures 156, 158 and 159 are pictures in the same similar picture set, and pictures 157, 160 and 161 are pictures in the same similar picture set; aesthetic evaluation is performed on each picture in the two similar picture sets based on information such as picture composition, picture color, and picture clarity to obtain the score of each picture. At this time, in the same similar picture set, picture 156 has the highest score, the score of picture 156 is greater than the score of picture 158, and the score of picture 158 is greater than the score of picture 159. Picture 156 is selected as the preferred picture of the similar picture set, and pictures 157 and 158 are non-preferred pictures of the similar picture set.
[0268] Similarly, in the same similar picture set, picture 157 has the highest score, which is greater than the score of picture 160, and the score of picture 160 is greater than the score of picture 161. Picture 157 is selected as the preferred picture of the similar picture set, and pictures 160 and 161 are non-preferred pictures of the similar picture set.
[0269] In the picture selection interface 155, for the same similar picture set, the picture with the highest score 156 is displayed at the front, and the picture with the lowest score 159 is displayed at the back. Similarly, for the same similar picture set, the picture with the highest score 157 is displayed at the front, and the picture with the lowest score 161 is displayed at the back.
[0270] In order to better introduce the solution provided by the embodiment of the present application, Fig. 9 The flowchart of the process of recommending and displaying pictures based on keywords and text content is shown for introduction and explanation.
[0271] like Fig. 9 As shown, when the keywords of the application are obtained, the electronic device 200 performs image retrieval according to the keywords. When the text of the application is obtained, the electronic device 200 can extract event information from the text and perform image retrieval according to the event information.
[0272] In specific applications, the application can call an image selector (such as PhotoPicker) to pass keywords or text content to the gallery application. After the image selector obtains the keyword or text, it can make subsequent image recommendations and display images based on the keyword or text. The image selector can be a component of the gallery application.
[0273] For example, in Figure 3A In , after the user clicks the "Use Now" button 112, Xiaohongshu 104 calls PhotoPicker and passes the keyword "pet" to the gallery 102. Fig. 6A In the example, after the user clicks the insert picture button 116, the microblog 103 calls the PhotoPicker and passes the text "During the National Day, my family went to the Shanghai Wild Animal Park and saw giant pandas, ferocious dogs, and beautiful cats" to the gallery 102.
[0274] After the electronic device 200 obtains the text sent by the application, it intelligently generates an event group, that is, by parsing the text content and extracting event information (4W, when, where, who, what). Fig. 9 As shown, event information of event 1, event 2, ..., event n may be extracted. n is a positive integer greater than or equal to 1.
[0275] If the event information of multiple events is extracted, multi-event intelligent sorting is performed, that is, multiple events are sorted. Specifically, the importance of the event can be calculated based on the completeness of the event content, the frequency of occurrence and the complexity of the description, the position of the image insertion position in the text, the time accuracy and the location accuracy, and then the event is prioritized according to its importance.
[0276] Optionally, if the number of events is greater than a threshold, a certain number of target events can be selected based on their importance, and pictures of the target events can be displayed on the home screen. For example, the threshold is 3, that is, if the number of events is greater than 3, the top three events can be selected based on their importance, and pictures of these three events can be displayed on the home screen.
[0277] Optionally, when searching for images based on event information, if there are no search results, you can also perform intelligent fallback search. Please refer to the above for the introduction of intelligent fallback search, which will not be repeated here.
[0278] If you search for images based on event information, you can get images of each event. Fig. 9 As shown, pictures of event 1, pictures of event 2, ..., pictures of event n can be obtained.
[0279] After performing image retrieval and obtaining search results, the search results can be classified.
[0280] The retrieval result classification can be to classify the objects in the event. Fig. 6A In the scenario, the events include three objects: cats, dogs, and giant pandas. The search results of cats, dogs, or giant pandas can be further classified. At this time, suppose the search results of cat pictures are classified to obtain classification results. The classification results indicate that the cat pictures include 20 pictures of cats wearing hats and 30 pictures of cats wearing scarves. At this time, when selecting pictures of "cat" to be displayed on the home screen interface, in order to ensure that cats wearing scarves and hats are displayed on the home screen interface, the corresponding number of pictures can be selected from the 20 pictures of cats wearing hats and the 30 pictures of cats wearing scarves, respectively, according to the number of pictures of "cat" displayed on the home screen interface, as the pictures displayed on the home screen interface.
[0281] The search result classification can also be to classify the pictures of keywords. For example, Figure 5A and Figure 5B In the scenario of , you can further classify the search results of graduation photos. Please refer to the above for details.
[0282] After the search results are classified, similar pictures can be clustered and aesthetically evaluated in sequence. The purpose of similar picture clustering and aesthetic evaluation is to select the preferred picture from multiple similar pictures to avoid interference in user selection caused by too many repeated similar pictures.
[0283] Similar image clustering refers to the aggregation and classification of similar images based on the image content, shooting time and shooting location, etc., to generate a similar image set. Aesthetic evaluation refers to scoring similar images in the same similar image set based on the image composition, color, clarity and other information, and sorting them according to the scores.
[0284] Among them, similar pictures can be clustered and aesthetically evaluated for events, objects in events, keywords, and subcategories of keywords.
[0285] For example, in a multiple keyword scenario, after retrieving a picture set for each keyword from a picture set, similar pictures are clustered for the picture set for each keyword to obtain similar picture sets and pictures that are not clustered into similar picture sets; for each similar picture set, after aesthetic evaluation is performed on each similar picture, preferred pictures are selected based on the scores of each similar picture; from each preferred picture and pictures that are not clustered into similar picture sets, pictures to be displayed on the home screen interface for the keyword are selected.
[0286] It should be noted that retrieval result classification, similar image clustering and aesthetic evaluation are optional steps, that is, these three steps may not be performed.
[0287] In the completeness display calculation step, the electronic device 200 can reasonably select a corresponding number of pictures from pictures of each event, pictures of objects in the event, pictures of keywords, or pictures of subcategories of keywords according to the number of pictures that can be displayed on the first screen interface, so as to ensure that pictures of multiple events (for example, Figure 7 The scenario shown in the figure shows a picture with multiple keywords on the home screen (for example Figure 5A ), displaying pictures of multiple objects in an event on the home screen, or displaying pictures of multiple subcategories on the home screen (e.g. Figure 3A and Figure 4 Scenario shown).
[0288] After the completeness display calculation, the pictures displayed on the home screen interface can be obtained, that is, the recommended picture list is obtained. The recommended page is displayed according to the recommended picture list.
[0289] As can be seen from the above, the embodiment of the present application can ensure the richness of the content displayed on the first screen when the user selects pictures, thereby ensuring that the user can find the core element pictures on the homepage. The richness of the content can refer to: multiple key elements expressed in the target information (such as text or keywords), or pictures of elements related to the target information can be displayed on the first screen interface (i.e., the first page of the picture selection interface), avoiding the need to slide the screen and turn the page to find the key element pictures. In this way, the convenience of users selecting pictures can be improved.
[0290] See also Fig. 10A A schematic flow chart of a method for displaying an image provided by an embodiment of the present application is shown, and the method may include the following steps:
[0291] Step S1001: The electronic device 200 displays the interface of the application.
[0292] For example, the application may be Weibo 103 and Xiaohongshu 104 mentioned above. The interface of the application may be Figure 7 The microblog creation interface 159 in the Figure 4 Puppy outfit template interface 128.
[0293] Step S1002: The electronic device 200 obtains target information of the application in response to a target operation on the interface of the application, where the target information is related to the interface content of the application, and the target operation is used to upload a picture.
[0294] For example, the target action can be for Figure 7 The click operation of the insert picture button 116 in the microblog creation interface 159 in the microblog creation interface 159, or the click operation of the insert picture button 116 in the microblog creation interface 159 ... Figure 4 Click the "Use Now" button in the puppy outfit template interface 128.
[0295] The target information may include text content and may also include keywords.
[0296] The target information may be information sent by the application in response to the target operation. Figure 4 The click operation of the “Use Now” button of the puppy outfit template interface 128 calls PhotoPicker to send the keyword “dog” to the gallery 102 .
[0297] The interface content of the application can be the display content that comes with the interface of the application, such as Figure 4 The puppy outfit template interface 128 in the application program displays “Puppy outfit diary”; it may also be content input by the user in the application program interface, for example Figure 7 The microblog creation interface 159 includes text content input by the user.
[0298] Step S1003, the electronic device 200 obtains a target candidate picture set for each target element from the picture set based on the first picture number and the target information, the target element is determined based on the target information, the target candidate picture set includes at least one target candidate picture, and the total sum of the target candidate pictures for each target element is less than or equal to the first picture number, which is the number of pictures that can be displayed on the first screen of the picture selection interface.
[0299] The target element can be a keyword in the target information, for example, Figure 5A The target information includes multiple keywords such as graduation photo, podium, classroom and playground. Graduation photo, podium, classroom and playground are target elements.
[0300] The target element can be the classification of the object described by the keyword in the target information. For example, Figure 3A The target information includes the keyword pet. Pets include two categories (or subcategories) of cats and dogs, and cats and dogs are target elements.
[0301] The target element can be the event described in the target information. For example, Figure 7 The target information is the text content sent by the Weibo, and the text content describes event 1 and event 2. Event 1 and event 2 are target elements.
[0302] The target element is the object in the event described by the target information. For example, Fig. 6A In the example, the target information is the text content sent by the microblog. The event described by the text content includes three objects: cat, dog and giant panda. Cat, dog and giant panda are the target elements. Usually, the object in the event is the what in the event. What can refer to animals, plants, activities or other things, which are not limited here.
[0303] The total number of target candidate pictures of each target element is less than or equal to the first number of pictures, which means that in order to allow the first screen interface to display the target candidate pictures of each target element, the total number of pictures displayed on the first screen interface for each target element is less than or equal to the number of pictures that can be displayed on the first screen interface.
[0304] For example, when the target element is a keyword, see Figure 5A In the scenario of multiple keywords shown, the number of pictures displayed on the home screen interface for each keyword is 4. At this time, the target candidate picture set for graduation photos includes 4 pictures displayed on the home screen interface (i.e., target candidate pictures), the target candidate picture set for the podium includes 4 pictures displayed on the home screen interface (i.e., target candidate pictures), the target candidate picture set for the classroom includes 4 pictures displayed on the home screen interface (i.e., target candidate pictures), and the target candidate picture set for the playground includes 4 pictures displayed on the home screen interface (i.e., target candidate pictures). The specific selection process can be found above and will not be repeated here.
[0305] For another example, when the target element is a subcategory of a keyword, see Figure 4 In the scenario of multiple sub-states for a single keyword, the number of pictures displayed on the home screen interface for each state is 4. The target candidate picture sets of states 1 to 4 each include 4 pictures displayed on the home screen interface (ie, target candidate pictures).
[0306] For another example, when the target element is an event, referring to the multi-event scene shown in 7, the number of pictures displayed on the home screen interface for each event is 8. At this time, the target candidate picture sets of event 1 to event 2 each include 8 pictures displayed on the home screen interface (i.e., target candidate pictures).
[0307] The target candidate images of the target element are the images displayed on the home screen interface of the target element. The number of images displayed on the home screen interface of various target elements can be the same or different. This is not limited here.
[0308] When obtaining target candidate images of each target element from the image collection according to the number of images displayed on the home screen interface of each target element, the target candidate images can be selected according to at least one of the time sequence of the images, the image scores, and the image matching degree. The specific selection process can be found above and will not be repeated here.
[0309] Step S1004: the electronic device 200 displays target candidate images of each target element on the first screen interface.
[0310] For example, see Figure 7 In the scenario shown, the mobile phone 100 displays pictures of event 1 and event 2 on the home screen.
[0311] It should be noted that, usually, all images displayed on the home screen are fully displayed, that is, all images are fully displayed in the display area of the home screen. However, in some cases, due to issues such as the layout of images on the home screen, some images displayed on the home screen may not be fully displayed, that is, part of the image is displayed on the home screen, while the other part is not displayed on the home screen. In this case, the full image cannot be seen on the home screen, but only part of it.
[0312] For example, see Fig. 10B The picture display schematic diagram of the home screen interface is shown, and the home screen interface cannot fully display pictures 162 to 165, that is, only parts of pictures 162 to 165 can be seen on the home screen interface. For example, picture 162 includes two parts, part 1 and part 2. Part 1 is displayed on the home screen interface, and part 2 is not displayed on the home screen interface, that is, only part 1 of picture 162 can be seen on the home screen interface, and part 2 cannot be seen.
[0313] In an embodiment of the present application, for a picture that is not fully displayed on the first screen interface, it can be determined whether the picture is displayed on the first screen according to the ratio of the area of the part of the picture displayed on the first screen interface to the area of the entire picture. The ratio can be set according to actual needs. For example, the ratio can be set to 50%, that is, when the area of the part of a picture displayed on the first screen interface exceeds 50% of the area of the entire picture, the picture is considered to be displayed on the first screen, otherwise it is considered not to be displayed on the first screen.
[0314] As can be seen from the above, the embodiment of the present application allows the target candidate images of each target element to be displayed on the first screen interface, so that the user can obtain images of multiple target elements on the first screen interface. There is no need to turn pages to obtain images of the target elements. The images that need to be uploaded can be selected more simply and quickly, thereby improving the user experience.
[0315] In some possible implementations, if at least two target elements are included, the at least two target elements include a first target element and a second target element. In the process of displaying target candidate images of each target element on the first screen interface, the electronic device 200 can display the target candidate image of the first target element and the target candidate image of the second target element on the first screen interface according to the priority of the first target element and the second target element, the priority of the first target element is higher than the priority of the second target element, and the display position of the target candidate image of the first target element is ahead of the display position of the target candidate image of the second target element.
[0316] For example, when the target element is an event, the priority of the two target elements can be determined by the importance of the first target element and the second target element. When the target element is a keyword, the priority of the keyword can be determined according to the order in which the keywords are obtained. When the target element is an object in an event, the priority of the object can be determined according to the number of pictures of the object. When the target element is a subcategory in a keyword, the priority of the object can be determined according to the number of pictures of the subcategory.
[0317] In some possible implementations, the first target element in the target element includes a first sub-element and a second sub-element. At this time, in the process of displaying target candidate images of each target element on the first screen interface, the electronic device 200 can determine the priority of the first sub-element and the second sub-element; according to the priority, the image of the first sub-element and the image of the second sub-element are displayed on the first screen interface, the priority of the first sub-element is higher than the priority of the second sub-element, the display position of the image of the first sub-element is ahead of the display position of the image of the second sub-element, and the target candidate images of the target element include the image of the first sub-element and the image of the second sub-element.
[0318] For example, when the target element is an event, the sub-element can be an object in the event. The method for determining the priority of the object can be found above and will not be repeated here. When the target element is a keyword, the sub-element is a sub-category in the keyword. For example, the sub-categories of the keyword "graduation photo" are wearing a hat and wearing sunglasses. For example, the priority of the sub-element can be determined based on the number of pictures of each sub-element, and the number of pictures of the sub-element is proportional to the priority of the sub-element.
[0319] In some possible implementations, the electronic device 200 may also display a target element tab or a sub-element tab in the picture selection interface, where the target element tab includes target element candidate pictures, the sub-element tab includes sub-element pictures, and the target element includes sub-elements.
[0320] In some possible implementations, in the process of obtaining a target candidate picture set for each target element from a picture set according to the first picture number and the target information, the electronic device 200 may obtain a candidate picture set for each target element from the picture set according to the target information; for each target element, select a target candidate picture from the candidate picture set; wherein the number of selected target candidate pictures is determined according to the first picture number, and the number of selected target candidate pictures is the number of pictures displayed on the home screen interface of the target element. The picture set may include pictures in the gallery 102.
[0321] In some possible implementations, in the process of selecting target candidate pictures from a candidate picture set, the electronic device 200 can cluster similar pictures of the candidate picture set to obtain a similar picture set; for each similar picture set, after sorting each similar picture in the similar picture set, select a preset number of similar pictures, and the preset number of similar pictures are the target similar pictures of the similar picture set; select the target candidate picture from the target similar pictures of each similar picture set and the candidate pictures that have not been clustered into the similar picture set.
[0322] The target similar images can be the preferred images mentioned above. The images can be scored according to aesthetic evaluation, and the preferred images can be selected according to the scores.
[0323] In some possible implementations, in the picture selection interface, the display position of the target similar picture in the similar picture set is ahead of the display position of the non-target similar picture in the similar picture set.
[0324] In some possible implementations, if the target element includes at least two sub-elements, the electronic device may cluster similar images of each sub-element respectively to obtain a similar image set of each sub-element, and the candidate image set includes images of each sub-element.
[0325] In some possible implementations, the target information is text information obtained according to the interface content of the application program.
[0326] In some possible implementations, the target element is an event described in the target information, an object in the event described in the target information, a keyword in the target information, or a classification of objects described by a keyword in the target information (eg, a subcategory of a keyword).
[0327] In some possible implementations, the target element is an event or an object in an event. In the process of obtaining a candidate picture set of each target element from a picture set according to the target information, the electronic device 200 can extract the event information of the event from the target information; use the event information to perform picture retrieval in the picture set to obtain a candidate picture set of each event or each object in the event. When at least two events are included, the electronic device 200 can also determine the importance of each event; according to the importance of each event, prioritize the at least two events to determine the order in which the pictures of each event are displayed on the home screen.
[0328] In some possible implementations, the electronic device 200 may also perform image retrieval from the image collection according to the event information of the event, if no image matching the event information is obtained, based on the target event information, and the target event information is the event information obtained after removing one or more dimension information in the event information, i.e., intelligent fallback retrieval.
[0329] In some possible implementations, the target element is a classification of objects described by a keyword; in the process of obtaining a candidate picture set for each target element from a picture set according to the target information, the electronic device 200 can perform picture retrieval according to the keywords in the target information to obtain keyword retrieval results; classify the keyword retrieval results to obtain target candidate picture sets for each classification.
[0330] It should be noted that the similarities or differences between this embodiment and the above embodiments can be found in the above corresponding contents and will not be repeated here.
[0331] See also Fig.11 A schematic flow chart of a method for displaying an image provided by an embodiment of the present application is shown, and the method may include the following steps:
[0332] Step S1101: The electronic device 200 displays the interface of the application.
[0333] Step S1102: The electronic device 200 obtains target information of the application in response to a target operation on the interface of the application, where the target information is related to the interface content of the application, and the target operation is used to upload a picture.
[0334] Step S1103: The electronic device 200 obtains pictures of each target element from the picture set according to the target information, where the target element is determined according to the target information.
[0335] Step S1104: The electronic device 200 determines the priority of each target element among at least two target elements.
[0336] The target element is an event described in the target information, an object in the event described in the target information, a keyword in the target information, or a classification of an object described by a keyword in the target information.
[0337] When the target element is an event, event information of at least two events is extracted from the target information; the priority of each of the at least two events is determined based on the event information; and the image (or image set) of each event is retrieved from the image set using the event information of each event.
[0338] When the target element is a keyword, the keyword can be used to retrieve pictures with each keyword in the picture collection.
[0339] When the target element is an object in an event, the event information of the event is extracted from the target information; using the event information of each event, the picture (or picture set) of the event is retrieved from the picture set, and then the pictures of each object in the event are obtained.
[0340] When the target element is a subcategory in a keyword, the keyword can be used to search for pictures with the keyword in a picture collection, and then the search results of the keyword pictures are classified to obtain pictures of each subcategory.
[0341] Step S1105: The electronic device 200 displays pictures of each target element in the picture selection interface according to the priority of the target element; wherein, the at least two target elements include a first target element and a second target element, the priority of the first target element is higher than the priority of the second target element, and the display position of the picture of the first target element in the picture selection interface is higher than the display position of the picture of the second target element in the picture selection interface.
[0342] The electronic device 200 may display pictures with a high priority first, and then pictures with a low priority.
[0343] In this way, by prioritizing each target element and allowing the display position of the related pictures of the target element with a high priority to be higher than the display position of the related pictures of the target element with a low priority, the related pictures of the target element with a high priority are presented first, thereby improving the convenience of users in selecting pictures.
[0344] In some possible implementations, the first target element in the target element includes a first sub-element and a second sub-element; the priority of the first sub-element is higher than the priority of the second sub-element, the display position of the picture of the first sub-element in the picture selection interface is higher than the display position of the picture of the second sub-element on the picture selection interface, and the picture of the target element includes the picture of the first sub-element and the picture of the second sub-element.
[0345] In some possible implementations, in the process of obtaining pictures of each target element from a picture set according to the target information, the electronic device 200 may obtain a candidate picture set of each target element from the picture set according to the target information; for each target element, cluster the candidate pictures in the candidate picture set of the target element to obtain at least one similar picture set; for each similar picture set, sort each similar picture in the similar picture set, and select a preset number of similar pictures, which are target similar pictures of the similar picture set; for each target element, select the picture of the target element from the target similar pictures of each similar picture set and the candidate pictures that have not been clustered into the similar picture set.
[0346] In some possible implementations, when the target element is an event or an object in an event, the electronic device can extract event information of the event from the target information, and use the event information to filter out pictures of each event, or pictures of each object in the event, from a picture collection.
[0347] In some possible implementations, when the target element is a category of an object described by a keyword, the electronic device may use the keyword to filter out pictures of the keyword from a picture collection, and then classify the search results of the pictures of the keyword to obtain pictures of each category.
[0348] In some possible implementations of the second aspect, when the target element is a keyword, the priority of each keyword is determined according to the order in which the keywords are input, wherein the priority of the keyword input first is higher than that of the keyword input later.
[0349] In some possible implementations, when the target element is an event, the importance of each event is determined based on at least one of the completeness of the event content, the complexity of the description, the accuracy of time and location, and the distance between the location of the event and the location of the insertion cursor. The more important the event is, the higher the priority.
[0350] It should be noted that the similarities or differences between this embodiment and the above embodiments can be found in the above corresponding contents and will not be repeated here.
[0351] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.
[0352] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium can at least include: any entity or device that can carry the computer program code to the camera / terminal device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, RandomAccess Memory), electric carrier signal, telecommunication signal and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.
[0353] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0354] In the embodiments provided in the present application, it should be understood that the disclosed devices, electronic devices and methods can be implemented in other ways. For example, the device / electronic device embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0355] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0356] The electronic device provided in the embodiments of the present application may include a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, a method as described in any one of the above method embodiments is implemented.
[0357] The embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.
[0358] An embodiment of the present application provides a computer program product. When the computer program product runs on an electronic device, the electronic device can implement the steps in the above-mentioned method embodiments when executing the computer program product.
[0359] The present application also provides a chip system, which includes a processor coupled to a memory, and the processor executes a computer program stored in the memory to implement the methods described in the above method embodiments. The chip system can be a single chip or a chip module composed of multiple chips.
[0360] In the above embodiments, the description of each embodiment has its own emphasis. For the part that is not described or recorded in detail in a certain embodiment, please refer to the relevant description of other embodiments. It should be understood that the size of the sequence number of each step in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. In addition, in the description of the present application specification and the attached claims, the terms "first", "second", "third", etc. are only used to distinguish the description, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first", "second", "third", and "fourth" can explicitly or implicitly include one or more of the features. In addition, it should be understood that at least one of the embodiments of the present application includes one or more; wherein, multiple means greater than or equal to two. In the embodiment of the present application, "and / or" is only a kind of association relationship describing the associated objects, indicating that there can be three relationships, for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character “ / ” in this article generally indicates that the previous and next associated objects are in an “or” relationship.
[0361] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways.
[0362] Finally, it should be noted that the above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A method for displaying an image, characterized in that: The method comprises: Display the application's interface; In response to a target operation on the interface of the application, acquiring target information of the application, the target information being related to the interface content of the application, the target operation being used to upload a picture; According to the target information, obtaining at least one picture from the picture collection; The at least one picture is displayed on the picture selection interface.
2. The method according to claim 1, characterized in that The acquiring at least one picture from the picture set according to the target information includes: acquiring pictures of at least two target elements from the picture set according to the target information, wherein the at least two target elements are determined according to the target information.
3. According to the method of claim 2, displaying the at least one picture on the picture selection interface comprises: Determining a priority of each of the at least two target elements; According to the priority of the target element, display the pictures of each target element on the picture selection interface; Among them, the at least two target elements include a first target element and a second target element, the priority of the first target element is higher than the priority of the second target element, and the display position of the picture of the first target element in the picture selection interface is higher than the display position of the picture of the second target element in the picture selection interface.
4. The method according to claim 3, characterized in that The priority of each target element is determined according to at least one of the following information: The distance between the position of the text of the target element in the target information and the cursor position, wherein the priority is negatively correlated with the distance; The completeness of the event content corresponding to the target element, wherein the priority is positively correlated with the completeness of the event content, and the completeness of the event content is determined by the missing time, place, person, and object of the event; The occurrence frequency of the target element, wherein the priority is positively correlated with the occurrence frequency; The length of the description of the target element, wherein the priority is positively correlated with the length of the description; The time accuracy of the event content corresponding to the target element, wherein the priority is positively correlated with the time accuracy; The location accuracy of the event content corresponding to the target element, wherein the priority is positively correlated with the location accuracy.
5. The method according to claim 3 or 4, characterized in that: The first target element in the target element includes a first sub-element and a second sub-element; The priority of the first sub-element is higher than the priority of the second sub-element, the display position of the picture of the first sub-element in the picture selection interface is higher than the display position of the picture of the second sub-element on the picture selection interface, and the pictures of the target element include the pictures of the first sub-element and the pictures of the second sub-element.
6. The method according to any one of claims 2 to 4, characterized in that: According to the target information, obtaining pictures of at least two target elements from a picture set includes: Acquire a candidate picture set of each target element from the picture set according to the target information; For each of the target elements, clustering the candidate pictures in the candidate picture set of the target element to obtain at least one similar picture set; For each of the similar picture sets, after sorting each of the similar pictures in the similar picture set, a first preset number of similar pictures are selected, and the first preset number of similar pictures are target similar pictures of the similar picture set; For each of the target elements, a picture of the target element is selected from the target similar pictures in each of the similar picture sets and the candidate pictures that are not clustered into the similar picture sets.
7. The method according to any one of claims 2 to 4, characterized in that: The acquiring, according to the target information, pictures of at least two target elements from a picture set comprises: According to the first number of pictures and the target information, a target candidate picture set of each target element is obtained from the picture set, wherein the target candidate picture set includes at least one target candidate picture, and the total number of the target candidate pictures of each target element is less than or equal to the first number of pictures, and the first number of pictures is the number of pictures that can be displayed on the first screen interface of the picture selection interface; The displaying of the at least one picture on the picture selection interface includes: displaying the target candidate pictures of each of the target elements on the first screen interface.
8. The method according to claim 7, characterized in that The at least two target elements include a first target element and a second target element; and displaying the target candidate images of each of the target elements on the first screen interface includes: According to the priorities of the first target element and the second target element, the target candidate picture of the first target element and the target candidate picture of the second target element are displayed on the home screen interface, the priority of the first target element is higher than the priority of the second target element, and the display position of the target candidate picture of the first target element is ahead of the display position of the target candidate picture of the second target element.
9. The method according to claim 7 or 8, characterized in that: The first target element in the target element includes a first sub-element and a second sub-element; Displaying the target candidate pictures of each target element on the first screen interface includes: According to the priority of the first sub-element and the second sub-element, the picture of the first sub-element and the picture of the second sub-element are displayed on the first screen interface, the priority of the first sub-element is higher than the priority of the second sub-element, the display position of the picture of the first sub-element is front than the display position of the picture of the second sub-element, and the target candidate pictures of the first target element include the picture of the first sub-element and the picture of the second sub-element.
10. The method according to any one of claims 7 to 9, characterized in that: The method further comprises: The tab page of the target element is displayed on the picture selection interface, or the tab page of the sub-element is displayed on the picture selection interface, the tab page of the target element includes the picture of the target element, and the tab page of the sub-element includes the picture of the sub-element.
11. The method according to any one of claims 7 to 10, characterized in that: Acquiring a target candidate picture set of each target element from a picture set according to the first picture quantity and the target information, including: Acquire a candidate picture set of each target element from the picture set according to the target information; For each of the target elements, the target candidate picture is selected from the candidate picture set; wherein, the number of the selected target candidate pictures is determined based on the number of the first pictures, and the number of the selected target candidate pictures is the number of pictures of the target element displayed in the first screen interface.
12. The method according to claim 11, characterized in that Selecting the target candidate picture from the candidate picture set includes: Performing similar picture clustering on the candidate picture set to obtain a similar picture set; For each of the similar picture sets, after sorting each of the similar pictures in the similar picture set, a first preset number of similar pictures are selected, and the first preset number of similar pictures are target similar pictures of the similar picture set; The target candidate picture is selected from the target similar pictures in each of the similar picture sets and the candidate pictures that are not clustered into the similar picture sets.
13. The method according to claim 12, characterized in that Sorting each similar picture in the similar picture set includes: The similar pictures are sorted according to the scores of the similar pictures, wherein the scores of the similar pictures are determined according to at least one of the composition, color and clarity of the similar pictures.
14. The method according to claim 12, characterized in that In the picture selection interface, the display position of the target similar picture in the similar picture set is ahead of the display position of the non-target similar picture in the similar picture set.
15. The method according to claim 12, characterized in that If the target element includes at least two sub-elements, clustering similar images on the candidate image set to obtain a similar image set includes: Similar picture clustering is performed on the pictures of each of the sub-elements respectively to obtain a similar picture set of each of the sub-elements, and the candidate picture set includes the pictures of each of the sub-elements.
16. The method according to any one of claims 1 to 15, characterized in that The target information is text information obtained according to the interface content of the application.
17. The method according to any one of claims 1 to 16, characterized in that: The target element is an event described in the target information, an object in the event described in the target information, a keyword in the target information, or a classification of an object described by a keyword in the target information.
18. The method according to any one of claims 6 to 7, 11 to 15, characterized in that: The target element is the event described in the target information or an object in the event described in the target information; Acquiring a candidate picture set of each target element from the picture set according to the target information, including: extracting event information of the event from the target information; Use the event information to perform image retrieval in the image collection to obtain the candidate image set for each of the events or objects in the event.
19. The method according to claim 18, characterized in that The method further comprises: If no picture matching the event information is obtained when searching for pictures from the picture collection according to the event information of the event, then searching for pictures is performed again in the picture collection according to the target event information, where the target event information is the event information obtained after removing one or more dimensional information in the event information.
20. The method according to any one of claims 6 to 7, 11 to 15, characterized in that: The target element is a classification of an object described by a keyword in the target information; Acquiring a candidate picture set of each target element from the picture set according to the target information, including: Performing image retrieval according to the keywords in the target information to obtain retrieval results of the keywords; The search results of the keyword are classified to obtain the target candidate picture sets of each classification.
21. A method for displaying a picture, characterized in that: The method comprises: Display the application's interface; Acquire target information from the application, wherein the target information is information sent by the application in response to a target operation on the interface of the application, wherein the target operation is used to upload a picture; According to the target information, obtaining at least one picture from the picture collection; The at least one picture is displayed on the picture selection interface.
22. The method according to claim 21, characterized in that The acquiring at least one picture from the picture set according to the target information includes: acquiring pictures of at least two target elements from the picture set according to the target information, wherein the at least two target elements are determined according to the target information.
23. The method according to claim 22, wherein displaying the at least one picture on the picture selection interface comprises: Determining a priority of each of the at least two target elements; According to the priority of the target element, display the pictures of each target element on the picture selection interface; Among them, the at least two target elements include a first target element and a second target element, the priority of the first target element is higher than the priority of the second target element, and the display position of the picture of the first target element in the picture selection interface is higher than the display position of the picture of the second target element in the picture selection interface.
24. The method according to claim 23, characterized in that The priority of each target element is determined according to at least one of the following information: The distance between the position of the text of the target element in the target information and the cursor position, wherein the priority is negatively correlated with the distance; The completeness of the event content corresponding to the target element, wherein the priority is positively correlated with the completeness of the event content, and the completeness of the event content is determined by the missing time, place, person, and object of the event; The occurrence frequency of the target element, wherein the priority is positively correlated with the occurrence frequency; The description complexity of the target element, wherein the priority is positively correlated with the description complexity; The time accuracy of the event content corresponding to the target element, wherein the priority is positively correlated with the complexity of the description; The location accuracy of the event content corresponding to the target element, wherein the priority is positively correlated with the complexity of the description.
25. An electronic device, characterized in that: The method comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the method according to any one of claims 1 to 20 or 21 to 24 is implemented.
26. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 20 or 21 to 24 is implemented.
Citation Information
Patent Citations
Photo displaying method and device
CN107239207A
Picture search method and system
CN107895050A
Image displaying method, and computer terminal storage medium
CN108228715A
Picture searching method and device and computer readable storage medium
CN109933681A
Picture screening method and terminal equipment thereof
CN110543276A