Display method and electronic device
By displaying media content in a aggregated manner on electronic devices and responding to user interactions, the problem of low exploratory power and poor interactivity in existing technologies is solved, achieving more efficient and richer media content recommendation.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- HUAWEI TECH CO LTD
- Filing Date
- 2025-11-24
- Publication Date
- 2026-06-04
AI Technical Summary
Existing electronic devices exhibit low exploratory nature and poor interactivity in image recommendation, resulting in poor recommendation performance.
By displaying media content in a set format and responding to user interactions, multi-level recommendations are provided, including a first set, a second set, and a third set. The media content in the third set belongs to the same category, and electronic devices can flexibly recommend relevant content.
It improves the efficiency and effectiveness of media content recommendation, provides a richer recommendation experience, and makes it easy and quick to explore and display media content.
Smart Images

Figure CN2025137156_04062026_PF_FP_ABST
Abstract
Description
A display method and an electronic device
[0001] Cross-reference to related applications
[0002] This application claims priority to Chinese Patent Application No. 202411756747.X, filed on November 29, 2024, entitled "A Display Method and Electronic Device", the entire contents of which are incorporated herein by reference. Technical Field
[0003] This application relates to the field of electronic device technology, and more particularly to a display method and an electronic device. Background Technology
[0004] Currently, some electronic devices, such as mobile phones, can extract images from their saved archives according to pre-defined categories (e.g., by people, objects, locations, or shooting modes) and recommend these images to users as separate albums. Users can click on an icon corresponding to an album displayed on the device to trigger the display of images belonging to that album. However, this approach only allows users to view images within fixed categories, resulting in low exploration potential and poor interactivity, thus leading to ineffective recommendations. Summary of the Invention
[0005] This application provides a display method and an electronic device for improving the recommendation efficiency and effectiveness of media content such as images.
[0006] In a first aspect, embodiments of this application provide a display method applied to an electronic device. The method includes: displaying a first interface; wherein the first interface includes icons of a first set and icons of a second set, the first set and the second set each including at least one type of media content from a plurality of media contents; and displaying a second interface in response to a received first operation; wherein the second interface includes icons of at least one set from the first set and the second set, and an icon of a third set, the media content in the third set being composed of a portion of the media content of each set in the at least one set, and the media content in the third set belonging to the same category. Optionally, the first operation is an operation performed on the icons of the at least one set.
[0007] In this method, media content can be of various types, such as images, GIFs, and videos. Electronic devices can display media content in sets and, in response to user interactions with at least one set, continue to recommend media content related to at least one set, thus providing multi-level recommendations and improving recommendation efficiency. The third set mentioned above can serve as a further set recommended to the user by the electronic device based on at least one set. This provides richer recommended content and improves recommendation effectiveness; it also allows for convenient and quick recommendations based on at least one set, further enhancing recommendation efficiency. Furthermore, this method supports users exploring media content hierarchically based on at least one set or the third set, providing a more refined and diverse media content display and recommendation experience, thereby improving recommendation effectiveness.
[0008] In one possible design, the media content in the third set belonging to the same category specifically includes at least one of the following: the generation time or acquisition time of the media content in the third set belongs to the same time period; the generation location or acquisition location of the media content in the third set is the same location; and the events recorded by the media content in the third set are the same events.
[0009] In this method, the electronic device can make recommendations based on at least one set, and the types of sets it can be varied, which is highly flexible and practical. It is easy to make recommendations based on the specific circumstances of the media content in at least one set, thereby achieving better recommendation results.
[0010] In one possible design, the media content in the first set belongs to a first category, and the media content in the second set belongs to a second category. In one example, the first and second categories correspond to different people. For instance, all media content in the first set contains the same person, and the first category corresponds to that person. All media content in the second set contains the same other person, and the second category corresponds to that other person. Optionally, the same category may be different from both the first and second categories.
[0011] In this method, different sets correspond to different categories, enabling the categorized display of media content in a set-based manner. This facilitates user interaction with media content across different categories and demonstrates high practicality. Since the categories corresponding to the recommended sets are different from those corresponding to at least one set, this method not only categorizes and displays media content of different types but also recommends media content with commonalities across these different categories to the user, thus providing a richer recommendation experience.
[0012] In one possible design, the second interface also includes a marker indicating the association between the third set and the at least one set. This allows users to clearly and intuitively view sets recommended based on at least one set, thus improving recommendation effectiveness.
[0013] In one possible design, the distance between the icon of the third set and the icon of any of the at least one sets is negatively correlated with the relevance between the third set and any of the at least one sets. This approach allows for a simple and clear presentation of the relevance between the recommended sets and the at least one set to the user. While facilitating user viewing, it also improves the simplicity and aesthetics of the interface, thus enhancing the user experience.
[0014] In one possible design, the correlation between the third set and any of the at least one set satisfies at least one of the following: positively correlated with the number of media content belonging to any of the sets included in the third set; negatively correlated with the interval between the average generation time or average acquisition time of the media content belonging to any of the sets included in the third set and the current time; negatively correlated with the interval between the generation time or acquisition time of the target media content in the third set and the current time; wherein the target media content is the media content belonging to any of the sets included in the third set whose generation time or acquisition time is closest to the current time.
[0015] In this method, electronic devices can determine the degree of association between a set recommended based on at least one set and at least one set in multiple ways, which is highly flexible and practical.
[0016] In one possible design, the first interface further includes a first marker indicating the relevance between the first set and the second set. Optionally, the first interface also includes an icon and a second marker for a fourth set; wherein the fourth set includes at least one piece of media content belonging to a third category from the multiple media content items, and the second marker indicates the relevance between the first set and the fourth set. This approach allows for a simple and clear presentation of the relevance between sets of different categories to the user, thereby providing a richer recommendation experience.
[0017] In one possible design, the icon of the first set has a different display format than the icons of other sets displayed on the first interface. Optionally, the display format of the icon of the first set and the icons of the other sets may include at least one of the following: size, shape, and color. This method can highlight the currently focused set, making it easier for users to view and distinguish different sets, thereby improving the display effect and user experience.
[0018] In one possible design, the distance between the icon of the first set and the icons of other sets besides the first set displayed on the first interface is negatively correlated with the degree of association between the first set and the other sets.
[0019] This method can easily and clearly present the correlation between different sets to users, making it convenient for users to view and also helping to improve the simplicity and aesthetics of the related interface, thus enhancing the user experience.
[0020] In one possible design, the correlation between the first set and other sets other than the first set displayed in the first interface is higher than or equal to a set correlation threshold.
[0021] This method allows users to access other related sites that are highly relevant to the first set. It enables filtering when recommending related sets, removing sets with low relevance and displaying key content to users. This improves recommendation effectiveness while avoiding excessive content display.
[0022] In one possible design, before displaying the first interface, the method further includes receiving a second operation, the second operation being used to instruct the display of the first set and at least one set associated with the first set.
[0023] Based on this method, the set that the user is interested in and the related set of that set can be displayed to the user, making it easier for the user to understand the set that is of interest, thereby improving the recommendation effect and user experience.
[0024] In one possible design, after displaying a second interface in response to a received first operation, the method further includes: in response to a third operation received through a first application, acquiring first media content; wherein the first media content is not included in the plurality of media content; in response to a received fourth operation, displaying an animation through a second application to instruct the first media content to be added to the first set and / or the second set; wherein the fourth operation is used to instruct the opening of the second application, which is used to manage media content. Optionally, the time interval between the reception time of the fourth operation and the reception time of the third operation is less than or equal to a set duration. Optionally, the third operation is an operation to instruct the saving of the first media content.
[0025] In the above method, when adding a new image, the electronic device can display relevant animation effects for the new image and highlight the image set related to the new image, which helps to improve the interactive effect.
[0026] In one possible design, in the second interface, the display format of the icons of the third set is different from the display format of the icons of the at least one set, and / or the display format of the icons of the third set is different from the display format of the icons of the at least one set. Optionally, the display format includes at least one of the following: size, shape, and color. Optionally, the display format includes image format and / or text format.
[0027] This method allows users to highlight collections recommended based on at least one set, making it easier for them to view and differentiate collections recommended at different levels, thereby improving recommendation effectiveness and user experience.
[0028] Secondly, embodiments of this application provide a display method applied to an electronic device. The method includes: receiving a first operation; wherein the first operation is used to instruct the display of a first set and at least one set associated with the first set, each set including at least one media content from a plurality of media contents; and responding to the first operation by displaying a first interface; wherein the first interface includes an icon of the first set and icons of the at least one set, and the distance between the icon of the first set and the icons of other sets other than the first set displayed on the first interface is negatively correlated with the degree of association between the first set and the other sets.
[0029] In this method, electronic devices can display sets of interest to the user along with their associated sets, making it easier for the user to understand the sets they are interested in, thereby improving recommendation effectiveness and user experience. Simultaneously, based on the distance between icons of different sets, the correlation between sets of different categories can be presented to the user easily and clearly. This provides a richer recommendation experience and, while facilitating user viewing, also helps improve the simplicity and aesthetics of the related interface, thus improving viewing efficiency and user experience.
[0030] In one possible design, the icons of the first set are displayed in a different format than the icons of the other sets.
[0031] In one possible design, the display format of the icons of the first set and the icons of the other sets includes at least one of the following: size, shape, and color.
[0032] In one possible design, the correlation between the first set and the other sets is higher than or equal to a set correlation threshold.
[0033] In one possible design, the method further includes: in response to a second operation received through a first application, acquiring first media content; wherein the first media content is not included in the plurality of media contents; in response to a received third operation, displaying an animation through a second application for instructing the first media content to be added to one or more sets in the first set and the at least one set; wherein the third operation is for instructing the opening of the second application, the second application being used to manage media content.
[0034] In one possible design, the time interval between the reception time of the third operation and the reception time of the second operation is less than or equal to a set duration. Optionally, the third operation is an operation used to instruct the saving of the first media content.
[0035] In one possible design, the at least one set includes a second set; after displaying the first interface, the method further includes: in response to a received fourth operation, displaying a second interface; wherein the second interface includes icons of the first set and at least one set in the second set, as well as an icon of a third set, wherein the media content in the third set consists of a portion of the media content of each of the at least one set, and the media content in the third set belongs to the same category.
[0036] Thirdly, this application provides an electronic device, the electronic device including a memory and one or more processors; wherein the memory is used to store computer program code, the computer program code including computer instructions; when the computer instructions are executed by the one or more processors, the electronic device causes the electronic device to perform the method described in the first aspect or any possible design of the first aspect, or to perform the method described in the second aspect or any possible design of the second aspect.
[0037] Fourthly, this application provides a computer-readable storage medium storing a computer program that, when run on an electronic device, causes the electronic device to perform the method described in the first aspect or any possible design of the first aspect, or to perform the method described in the second aspect or any possible design of the second aspect.
[0038] Fifthly, this application provides a computer program product comprising a computer program or instructions that, when executed on an electronic device, cause the electronic device to perform the method described in the first aspect or any possible design of the first aspect, or to perform the method described in the second aspect or any possible design of the second aspect.
[0039] Sixthly, this application provides a chip system including a processor and a memory, wherein the memory stores instructions; when the instructions are executed by the processor, they implement the methods described in the first aspect or any possible design of the first aspect, or implement the methods described in the second aspect or any possible design of the second aspect. The chip system may be composed of chips or may include chips and other discrete devices.
[0040] The beneficial effects of the second to sixth aspects mentioned above can be found in the beneficial effects of the first aspect mentioned above, and will not be repeated here. Attached Figure Description
[0041] Figure 1 is a schematic diagram of the hardware architecture of an electronic device provided in an embodiment of this application;
[0042] Figure 2 is a schematic diagram of the software architecture of an electronic device provided in an embodiment of this application;
[0043] Figure 3 is a schematic diagram of a first recommendation interface provided in an embodiment of this application;
[0044] Figure 4 is a schematic diagram of an image display interface provided in an embodiment of this application;
[0045] Figure 5 is a schematic diagram of an image set partitioning map provided in an embodiment of this application;
[0046] Figure 6 is a schematic diagram of a first recommendation interface provided in an embodiment of this application;
[0047] Figure 7 is a schematic diagram of a second recommendation interface provided in an embodiment of this application;
[0048] Figure 8 is a schematic diagram of a second recommendation interface provided in an embodiment of this application;
[0049] Figure 9 is a schematic diagram of a third recommendation interface provided in an embodiment of this application;
[0050] Figure 10 is a schematic diagram of a fourth recommendation interface provided in an embodiment of this application;
[0051] Figure 11 is a schematic diagram of an animation effect for adding a new image to the database according to an embodiment of this application;
[0052] Figure 12 is a schematic diagram of the architecture of a possible display system provided in an embodiment of this application;
[0053] Figure 13 is a schematic diagram of a display method provided in an embodiment of this application;
[0054] Figure 14 is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0055] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the embodiments of this application will be further described in detail below with reference to the accompanying drawings.
[0056] In the description of the embodiments of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined with "first" and "second" may explicitly or implicitly include one or more of that feature.
[0057] It should be understood that in the embodiments of this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be single or multiple.
[0058] To improve the display and recommendation effects of media content such as images and videos, embodiments of this application provide a display method and an electronic device. This method can be applied to electronic devices. In this method, the electronic device can categorize and display different types of media content in a set-like manner, and can continue to recommend media content related to at least one set to the user in a set-like manner in response to user interaction with at least one set. Based on this method, the electronic device can support users in exploring media content based on at least one set, providing users with a more accurate and richer media content display and recommendation experience, thereby improving display and recommendation effects.
[0059] In some embodiments of this application, the electronic device may be a portable device, such as a mobile phone, tablet computer, wearable device with wireless communication capabilities (e.g., smartwatch, smart glasses, etc.), in-vehicle terminal device, augmented reality (AR) / virtual reality (VR) device, laptop computer, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), smart home device (e.g., smart TV, smart speaker, etc.), smart robot, workshop equipment, wireless terminal in self-driving, wireless terminal in remote medical surgery, wireless terminal in smart grid, wireless terminal in transportation safety, wireless terminal in smart city, or wireless terminal in smart home, flying equipment (e.g., smart robot, drone, airplane), etc. Wearable devices are portable devices that users can wear directly on their body or integrate into their clothing or accessories.
[0060] In some embodiments of this application, the electronic device may also be a portable terminal device that includes other functions. Exemplary embodiments of the portable terminal device include, but are not limited to, carrying... Alternatively, it could be a portable terminal device with another operating system. The aforementioned portable terminal device could also be other portable terminal devices, such as a laptop computer with a touch-sensitive surface (e.g., a touch panel). It should also be understood that in some other embodiments of this application, the aforementioned electronic device may not be a portable terminal device, but rather a desktop computer with a touch-sensitive surface (e.g., a touch panel).
[0061] For a description of the performance of electronic devices, please refer to the relevant descriptions below.
[0062] Referring to Figure 1 below, the structure of the electronic device to which the method provided in the embodiments of this application is applicable will be described.
[0063] As shown in Figure 1, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a USB interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a SIM card interface 195, etc.
[0064] The sensor module 180 may include a gyroscope sensor, an accelerometer, a proximity sensor, a fingerprint sensor, a touch sensor, a temperature sensor, a pressure sensor, a distance sensor, a magnetic sensor, an ambient light sensor, a barometric pressure sensor, a bone conduction sensor, etc.
[0065] It is understood that the electronic device 100 shown in Figure 1 is merely an example and does not constitute a limitation on the electronic device. Furthermore, the electronic device may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in Figure 1 can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits (ASICs).
[0066] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, memory, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). Different processing units may be independent devices or integrated into one or more processors. The controller may serve as the central nervous system and command center of the electronic device 100. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution.
[0067] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0068] The execution of the display method provided in this application embodiment can be controlled by the processor 110 or by calling other components. For example, it can call the processing program of this application embodiment stored in the internal memory 121, or call the processing program of this application embodiment stored in a third-party device through the external memory interface 120 to control the wireless communication module 160 to perform data communication with other devices, thereby improving the intelligence and convenience of the electronic device 100 and enhancing the user experience. The processor 110 may include different devices. For example, when integrating a CPU and a GPU, the CPU and GPU can cooperate to execute the display method provided in this application embodiment. For example, some algorithms in the display method can be executed by the CPU, and other algorithms can be executed by the GPU to achieve faster processing efficiency.
[0069] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays screens 194, where N is a positive integer greater than 1. Display screen 194 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces (GUIs). For example, display screen 194 can display various interfaces such as the recommendation interface described in the embodiments of this application.
[0070] In this embodiment of the application, the display screen 194 can be a single flexible display screen, or it can be a splicing display screen composed of two rigid screens and a flexible screen located between the two rigid screens.
[0071] Camera 193 (a front-facing camera or a rear-facing camera, or a single camera that can function as both) is used to capture still images or videos. Typically, camera 193 may include a photosensitive element such as a lens assembly and an image sensor. The lens assembly includes multiple lenses (convex or concave lenses) for collecting light signals reflected from the object being photographed and transmitting these signals to the image sensor. The image sensor generates a raw image of the object being photographed based on the light signals.
[0072] The internal memory 121 can be used to store computer executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. The program storage area can store the operating system, application program code (such as the functions corresponding to the scheme in this application), etc. The data storage area can store data created during the use of the electronic device 100.
[0073] The internal memory 121 may also store one or more computer programs corresponding to the algorithm of this application. The one or more computer programs are stored in the internal memory 121 and configured to be executed by one or more processors 110. The one or more computer programs include instructions that can be used to perform the various steps in the following embodiments.
[0074] In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
[0075] Of course, the algorithm code of the embodiment of this application can also be stored in external memory. In this case, the processor 110 can run the algorithm code of the embodiment of this application stored in external memory through the external memory interface 120.
[0076] A touch sensor, also known as a "touch panel," can be located on the display screen 194. The touch sensor and display screen 194 together form a touch display screen, also called a "touch screen." The touch sensor detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor may also be located on the surface of the electronic device 100, in a different position than the display screen 194.
[0077] For example, the display screen 194 of the electronic device 100 can display a main interface, which includes icons for multiple applications (such as a camera application, a fitness and health application, etc.). For instance, a user can tap the camera application icon on the main interface using a touch sensor, triggering the processor 110 to launch the camera application and open the camera 193. The display screen 194 then displays the camera application's interface, such as the viewfinder.
[0078] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.
[0079] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.
[0080] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device. In this embodiment, the mobile communication module 150 can also be used for information interaction with other devices.
[0081] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.
[0082] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (WiFi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2. In this embodiment, the wireless communication module 160 can be used to establish connections with other electronic devices for data interaction. Alternatively, the wireless communication module 160 can be used to access access point devices, send control commands to other electronic devices, or receive data from other electronic devices.
[0083] In addition, the electronic device 100 can implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, and an application processor, such as music playback and recording. The electronic device 100 can receive input from buttons 190, generating key signal inputs related to user settings and function control. The electronic device 100 can use a motor 191 to generate vibration alerts (such as vibration alerts for incoming calls). The indicator 192 in the electronic device 100 can be an indicator light, used to indicate charging status, battery level changes, messages, missed calls, notifications, etc. The SIM card interface 195 in the electronic device 100 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with the electronic device 100.
[0084] It should be understood that in practical applications, the electronic device 100 may include more or fewer components than those shown in FIG. 1, and the embodiments of this application are not limited thereto. The illustrated electronic device 100 is merely an example, and the electronic device 100 may have more or fewer components than shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.
[0085] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. A layered architecture divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. For example, as shown in Figure 2, this software architecture can be divided into four layers, from top to bottom: the application layer, the application framework layer (framework, FWK), the runtime and system libraries, and the (Linux) kernel layer.
[0086] The application layer is the top layer of the operating system and includes native operating system applications such as camera, gallery, calendar, Bluetooth, music, video, and messaging applications, as well as third-party applications. The applications discussed in this application embodiment are referred to as applications (APPs), which are software programs capable of performing one or more specific functions. Typically, multiple applications can be installed on an electronic device, such as camera applications and email applications. The applications mentioned below can be system applications pre-installed on the electronic device at the factory, or third-party applications downloaded by the user from the network or obtained from other electronic devices during the use of the electronic device.
[0087] Of course, for developers, they can write applications and install them into this layer. In one possible implementation, the application can be developed using the Java language, by calling the application programming interface (API) provided by the application framework layer. Developers can then interact with the underlying operating system (such as the kernel layer) through the application framework to develop their own applications.
[0088] The application framework layer provides the API and programming framework for the application layer. It can include predefined functions. The application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
[0089] The window manager is used to manage window programs. The window manager can obtain the screen size, determine if a status bar is present, lock the screen (or display), and capture the screen, among other things.
[0090] Content providers are used to store and retrieve data, and make that data accessible to applications. This data may include files (e.g., documents, videos, images, audio), text, and other information.
[0091] A view system includes visual controls, such as controls that display text, images, documents, and other content. View systems can be used to build applications. An interface in a display window can consist of one or more views. For example, a display interface including a text message notification icon could include a view that displays text and a view that displays images.
[0092] The phone manager provides communication functionality for electronic devices. The notification manager allows applications to display notification information in the status bar; it can be used to convey informative messages and can disappear automatically after a short pause without user interaction.
[0093] The runtime includes the core libraries and the virtual machine. The runtime is responsible for system scheduling and management.
[0094] The system's core library consists of two parts: one part contains the functionalities that the Java language needs to call, and the other part is the system's core library. The application layer and application framework layer run in a virtual machine. Taking Java as an example, the virtual machine executes the Java files in the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0095] The system library can include multiple functional modules. Examples include: a surface manager, a media library, a 3D graphics processing library (e.g., OpenGL ES), a 2D graphics engine (e.g., SGL), and an image processing library. The surface manager manages the display subsystem and provides fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.564, MP3, AAC, AMR, JPG, and PNG. The 3D graphics processing library implements 3D graphics drawing, image rendering, compositing, and layer processing. The 2D graphics engine is the drawing engine for 2D graphics.
[0096] The kernel layer provides core system services for the operating system, such as security, memory management, process management, network protocol stack, and driver models, all of which are implemented based on the kernel layer. The kernel layer also serves as an abstraction layer between the hardware and software stacks. This layer contains many drivers related to electronic devices, including: display drivers; keyboard drivers as input devices; Flash drivers for memory-based devices; camera drivers; audio drivers; Bluetooth drivers; and WiFi drivers.
[0097] It is important to understand that the functional services described above are just an example. In practical applications, electronic devices may be divided into more or fewer functional services based on other factors, or the functions of each service may be divided in other ways, or they may not be divided into functional services but work as a whole.
[0098] The solution provided in this application will be described in detail below with reference to the accompanying drawings.
[0099] In the solution provided by this application embodiment, the electronic device can display different categories of media content in a collection manner, and can recommend and display related content based on user operations. The media content can be various media types such as images, GIFs, and videos. The following embodiments use images as an example of media content to describe the solution provided by this application embodiment in detail. When the media content is other types of content, the corresponding methods can be implemented with reference to the methods described below, and will not be detailed in this application embodiment.
[0100] I. Image Collection Division and Display
[0101] In one possible solution provided in this application embodiment, the electronic device can display a first recommendation interface in response to a received user operation. The first recommendation interface may include icons for multiple image sets, with each image set icon indicating that image set. Each image set may include images of a category, or each image set may include images of a category and images associated (or related to) images of that category, wherein different image sets correspond to different categories. Optionally, the aforementioned user operation can be used to instruct the electronic device to automatically classify and display images. For ease of description, in this application embodiment, the icon of an image set can also be simply referred to as an icon, and the icons of multiple image sets can also be simply referred to as multiple icons.
[0102] Example 1: In one example, taking a mobile phone as the electronic device, the first recommended interface displayed by the electronic device can be seen in Figure 3. As shown in Figure 3, this interface can include icons for each of the image sets 1-6, i.e., icons 1-6. Each image set in image sets 1-6 can include multiple images, and the images included in different image sets can be completely different or partially different.
[0103] In the above scheme, the icon of the image set in the first recommendation interface may include information indicating the category corresponding to the image set. This information may be presented in the form of an image, text, a combination of images and text, or other forms, and no specific limitations are imposed in this embodiment. For example, in the scenario described in Example 1, different image sets may correspond to different people, and each image set may include images containing the same person as well as other images associated with that person's images. In this scenario, different image sets correspond to different people, and the category corresponding to each image set is the category of images containing the person corresponding to that image set. In this scenario, the image set 1 corresponding to icon 1 shown in Figure 3 may be a set containing images of person 1 and their associated images. Icon 1 may include images of person 1 (e.g., avatars) to indicate the category of image set 1 corresponding to image 1.
[0104] Optionally, the display format (e.g., size, shape, color, etc.) of different icons in the first recommendation interface can be different, and no specific restrictions are imposed in this embodiment.
[0105] The following section provides a detailed explanation of the image set partitioning method described above.
[0106] In the above scheme, each image set may include images belonging to the same category selected from multiple candidate images (e.g., images stored in an electronic device), or each image set may include images belonging to the same category selected from multiple candidate images (e.g., images stored in an electronic device) and images associated with images of that category. The same candidate image may belong to one or more image sets. The process of dividing multiple image sets may include stage 1 as described below, or stage 1 and stage 2 as described below:
[0107] Phase 1: Classification of Images of the Same Type
[0108] In this stage, the electronic device can identify the feature information of multiple candidate images and, based on the feature information, identify the category of each candidate image, grouping candidate images belonging to the same category into the same image set. Specifically, the division of a candidate image into an image set as described in this embodiment can be understood as treating that image set as a set to which the candidate image belongs (but not necessarily meaning that the candidate image belongs only to that image set), or as associating the candidate image with that image set. The above division process (e.g., feature recognition, category recognition, etc.) can be implemented using one or more large models.
[0109] In some embodiments of this application, the feature information of the candidate image may include at least one feature from at least one of the following aspects:
[0110] 1. Visual characteristics
[0111] Visual features can be used to characterize display-related attributes of an image, such as content, structure, and texture. For example, visual features may include semantic features, color features, texture features, and edge (or contour) features, and may also include other related features, which will not be listed in detail in this embodiment. Semantic features describe information about the image, such as the scene depicted, objects within the image, actions of objects, and relationships between objects. Color features indicate color-related characteristics in the image, such as hue and the colors contained within. Texture features reflect homogeneous phenomena in an image, representing the slowly changing or periodically altered surface structure of objects. Edge features indicate the characteristics of curves (i.e., contour lines or edge lines) with consecutive points of the same color or grayscale value in an image.
[0112] 2. Contextual Features
[0113] Contextual features can be used to characterize the overall attributes of an image, as well as its relationship with other images. For example, contextual features may include the image's source, time (e.g., generation time or acquisition time), and location (e.g., generation location or acquisition location). They may also include the degree of correlation between the image and other images. Of course, other relevant features may also be included, which will not be listed in detail in this embodiment.
[0114] 3. Other characteristics
[0115] Optionally, other features may include atmospheric features, objects in the image, and features of the objects in the image. For example, objects in the image may be people, animals, things, or other types of objects; no specific limitations are imposed in this embodiment. Features of objects in the image may include posture (or pose) features, identity features (e.g., when the object in the image is a person, identity features may include the person's facial features), the degree of intimacy between objects (which may be called closeness), or other features; no specific limitations are imposed in this embodiment.
[0116] The methods involved in Phase 1 will be illustrated below with examples 2 to 4.
[0117] Example 2: In one example, the electronic device can divide the image set based on the people contained in the candidate images. Specifically, the electronic device can group candidate images containing the same person into the same image set. For example, in the scenario described in Example 1, image set 1 may include images containing person 1, image set 2 may include images containing person 2, and so on, with image sets 1-6 being the respective image sets containing images of each person from 1 to 6. When a candidate image contains both person 1 and person 2, the candidate image belongs to both image set 1 and image set 2.
[0118] Example 3: In one example, the electronic device can group images into a set based on the animals contained in the candidate images. Optionally, the electronic device can group candidate images containing animals of the same species, animals of the same species and breed, or the same animal into the same image set. For example, multiple candidate images containing cats can be grouped into one image set, and multiple candidate images containing dogs can be grouped into another image set.
[0119] Example 4: In one example, an electronic device can group images into sets based on the things (or objects) contained in the candidate images. Specifically, the electronic device can group candidate images containing the same thing (or object) into the same image set. For example, multiple candidate images containing the sky can be grouped into one image set, and multiple candidate images containing food can be grouped into another image set.
[0120] Examples 2-4 above illustrate the method of partitioning an image set based on a single feature. The method of partitioning an image set based on multiple features is similar to the method of partitioning an image set based on a single feature, and will not be described in detail here.
[0121] Phase 2: Association Image Division Phase
[0122] In this stage, the electronic device can perform the following processing on each image set obtained based on the method described in stage 1 above: based on the features of multiple candidate images, select candidate images associated with images in the image set from among the candidate images outside the image set, and assign the selected candidate images to the image set. During the selection process, when the electronic device determines that a candidate image and an image in the image set belong to the same category, and that the same category is different from the category corresponding to the image set, the two images can be determined to be associated. The above segmentation process (e.g., associated image selection) can be implemented using one or more large models.
[0123] The following example, Example 5, illustrates the methods involved in Phase 2.
[0124] Example 5: In one example, when the category corresponding to the image set is "containing the same person," the aforementioned "same category" can include at least one of the following: the same shooting time, the same shooting location, the same person's pose, or the same event. For example, in the scenario described in Example 2 above, taking the scenario where the image set 1 contains the image of person 1 as image 1 in Figure 4 as an example, the electronic device can select an image from images outside image set 1 that has the same pose as the person in image 1, such as image 2 shown in Figure 4, and add image 2 as an image associated with image 1 to image set 1. Then image set 1 can include image 1 and image 2 associated with image 1. Similarly, the electronic device can perform similar processing on other images in image set 1 obtained in Example 2 to obtain the images in image set 1 shown in Figure 4. Likewise, the electronic device can also perform similar processing on other image sets obtained in Example 2 to image set 2.
[0125] In another example, when the category corresponding to the image collection is "containing the same thing", the above-mentioned "same category" can include at least one of the following: the same shooting time, the same shooting location, the same color, the same color scheme, or the same event.
[0126] The electronic device can display the first recommended interface based on the image sets obtained by the above-described method. The multiple image sets presented in the first recommended interface can be all image sets obtained by the electronic device, or only a portion of those image sets. When the multiple image sets presented in the first recommended interface are only a portion of the image sets obtained by the electronic device, the electronic device can respond to user actions on the first recommended interface (such as swiping or zooming) by displaying icons for the portion or all of the image sets not currently displayed in the first recommended interface. For example, the view of the image sets obtained by the electronic device according to the above method can be seen in Figure 5, where each node represents an image set, and the lines connecting the nodes can be used to mark the relationships between them. The icons presented in the first recommended interface shown in Figure 3 can be icons for a portion of the image sets shown in Figure 5. When the user swipes the first recommended interface shown in Figure 3, the electronic device can switch the displayed icon of the image set based on the user's swipe direction.
[0127] In some embodiments, as an optional implementation, the electronic device can analyze, based on the image feature information, whether there is a correlation between images in different image sets divided by the above method, and the degree of correlation when such a correlation exists. Based on this, it can determine whether there is a correlation between different image sets divided by the above method, and the degree of correlation when such a correlation exists. The degree of correlation can be used to indicate the degree of correlation. As another optional implementation, the electronic device can analyze, based on the image feature information, the subject object corresponding to each image set divided by the above method, and the proximity between different subject objects (i.e., the degree of proximity between different subject objects). The proximity between different subject objects is used as the degree of correlation between image sets corresponding to different subject objects. The subject object corresponding to an image set can be an object contained in all images belonging to the corresponding category of the image set, or it can be an object corresponding to the category of the image set. For example, in the scenario described in Example 2 above, if the image in image set 1 contains a person 1, then the subject object corresponding to image set 1 is person 1. If the image in image set 2 contains a person 2, then the subject object corresponding to image set 2 is person 2. The degree of correlation can be used to indicate the degree of correlation. In this approach, the intimacy between different subject objects is equivalent to the correlation between the image sets corresponding to different subject objects. Therefore, the correlation between different image sets in this scenario can also be understood as the intimacy between different image sets, and the degree of correlation between different image sets can also be understood as the degree of intimacy between different image sets.
[0128] In some embodiments of this application, the distance between icons of different image sets in the first recommendation interface can be negatively correlated with the correlation between different image sets. That is, the higher the correlation between different image sets, the closer the icons of different image sets are; the lower the correlation between different image sets, the farther the icons of different image sets are. Based on this method, before displaying the first recommendation interface, the electronic device can also randomly display icons of multiple image sets, and in response to received relevant user operations, switch to displaying the first recommendation interface, thereby arranging the distance between icons of different image sets based on the correlation between different image sets in the multiple image sets.
[0129] As a first optional implementation, the distance between icons of different image sets in the first recommendation interface can be used to characterize the correlation between different image sets. Specifically, the distance between the icon of any image set and the icon of another image set in the first recommendation interface can be negatively correlated with the correlation between that image set and the other image set. Optionally, the electronic device can respond to a received operation and display an image set (which may be a set selected by the operation) partitioned by the electronic device and at least one image set associated with that image set in this manner.
[0130] As a second optional implementation, the first recommended interface may also include markers indicating the degree of correlation between different image sets within the plurality of image sets. These markers can be in image form, text form, or a combination of both, and are not specifically limited in this embodiment. For example, the degree of correlation between different image sets within the plurality of image sets can be marked by lines connecting the icons of the different image sets. The display format of the lines can represent the degree of correlation, and different display formats can represent different degrees of correlation. Exemplarily, the display format of the lines can include color, solid / darkness, thickness, and length, and is not specifically limited in this embodiment. For example, in the interface shown in Figure 5, lines between different image sets can be used as markers of the degree of correlation between them.
[0131] Example 6: In one example, taking a mobile phone as an electronic device, the first recommended interface displayed by the electronic device can be referred to Figure 6. As shown in Figure 6, this interface can include icons for each of the image sets 1-6, i.e., icons 1-6. Each image set in image sets 1-6 can include multiple images, and the images included in different image sets can be completely different or partially different. In icons 1-6, the length of the lines connecting different icons can be used to indicate the degree of correlation between the image sets indicated by different icons. There is a negative correlation between the length of the lines connecting different icons and the degree of correlation between the image sets corresponding to different icons. For example, if the line connecting icon 1 and icon 2 is shorter than the line connecting icon 1 and icon 3, it can mean that the correlation between image set 1 and image set 2 is higher than the correlation between image set 1 and image set 3.
[0132] As a third optional implementation, the electronic device can display a marker indicating the correlation between different image sets among the plurality of image sets in response to a setting operation performed on the first recommendation interface. The display method of the marker indicating the correlation between different image sets among the plurality of image sets can be referred to the description in the first optional implementation described above, and will not be repeated here. For example, in a scenario where the first recommendation interface displayed by the electronic device is the interface shown in FIG3, the electronic device can switch from displaying the interface shown in FIG3 to the interface shown in FIG6 in response to a setting operation performed by the user on the first recommendation interface.
[0133] As a fourth optional implementation, the electronic device can, in response to a setting operation applied to an icon in the first recommendation interface, display multiple icons, including that icon, and a marker indicating the correlation between the image set indicated by the icon and the image sets indicated by other icons. Optionally, the icon can be displayed in the center. Optionally, the multiple icons can include icons displayed in the first recommendation interface, or icons of other image sets not displayed in the first recommendation interface. Regarding the display method of the marker indicating the correlation between different image sets in the multiple image sets, please refer to the description in the first optional implementation above, which will not be repeated here. The setting operation can be used to select an icon in the first recommendation interface and indicate the correlation between the image set indicated by the icon and other image sets obtained by the electronic device based on the above method. For example, in a scenario where the first recommendation interface displayed by the electronic device is the interface shown in FIG3, the electronic device can, in response to a setting operation performed by the user on icon 1 in the first recommendation interface, switch from displaying the interface shown in FIG3 to the interface shown in FIG7 to present the correlation between image set 1 indicated by icon 1 and other image sets, namely image sets 2 to 6.
[0134] In some embodiments of this application, the electronic device can use a knowledge base containing information such as the image set divided according to the above method (e.g., the image set shown in Figure 5) and the correlation between different image sets within the image set divided according to the above method. Various interfaces are then displayed based on this knowledge base. Optionally, the knowledge base may also include feature information of the images in the electronic device and the relationships between the images.
[0135] Based on the above method, electronic devices can recommend extracted images of different categories and their associated images to users in a discrete set manner, making it easier for users to understand the distribution of images on the electronic device. Images in the same set can include images with the same characteristics (e.g., containing the same person, corresponding to the same location, belonging to the same color family, etc.) and related images, enabling efficient viewing of other images related to certain images within a specific category, thereby improving image viewing efficiency and user experience.
[0136] II. Single-set interaction
[0137] In one possible solution provided in this application embodiment, after the electronic device displays the first recommendation interface based on the method described in the first part above (the method of displaying images in sets), it can perform interactions related to a single image set based on the user's operation on the icon of a single image set in the first recommendation interface. These will be described separately below.
[0138] 1. Display the relationship between an image collection and other image collections.
[0139] In some embodiments of this application, the electronic device can switch from displaying the first recommendation interface to displaying the second recommendation interface in response to a first selection operation on the icon of the first image set in the first recommendation interface. The icon of the first image set can be any icon in the first recommendation interface. The second recommendation interface includes at least the icon of the first image set, at least one icon of the second image set, and a marker indicating the degree of association between the first image set and each second image set. The second image set can be a set whose association with the first image set is not zero (i.e., a set of images in the image set obtained by the electronic device based on the method described in the first part that is associated with the first image set), or it can be a set of images whose association with the first image set is greater than or equal to a set of predetermined thresholds (i.e., a set of images in the image set obtained by the electronic device based on the method described in the first part that has a high degree of association with the first image set). Optionally, the second recommendation interface may further include a marker indicating the degree of association between different second image sets and / or an icon of at least one third image set. The third image set can be a set with zero correlation to the first image set (i.e., a set of images in the image set obtained by the electronic device based on the method described in the first part that has no correlation with the first image set), or it can be a set of images with a correlation of less than a set threshold to the first image set (i.e., a set of images in the image set obtained by the electronic device based on the method described in the first part that has a low correlation with the first image set). Through this method, the electronic device can display to the user the correlation and degree of correlation between the user-selected image set and other image sets, thereby improving the display effect.
[0140] Optionally, in the second recommendation interface, the icon of the first image set can be displayed in a set format that is different from the display format of the icons of other image sets, so as to highlight the first image set selected by the user.
[0141] In the above method, the first selection operation can be an operation applied to an icon of the first image set. The first selection operation can be used to select the first image set (or the icon of the first image set) and indicate the association between the first image set and other image sets obtained by the electronic device based on the method described in the first part. For example, the first selection operation can be a click on the first image set, or it can be other forms of operation. The specific operation method of the first selection operation is not specifically limited in this embodiment.
[0142] Example 7: In one example, in the scenario described in Example 1, the electronic device can switch from displaying the first recommendation interface shown in Figure 3 to displaying the second recommendation interface shown in Figure 7 in response to a user clicking on icon 1 of image set 1. As shown in Figure 7, the second recommendation interface may include icons 1-6 of image sets 1-6 and markers indicating the degree of association between image set 1 and image sets 2-6 (i.e., the dashed lines connecting icon 1 and icon 2-6 shown in Figure 7). In this scenario, image set 1 corresponds to the first image set described above, and image sets 2-6 correspond to at least one of the second image sets described above.
[0143] Example 8: In another example, in the scenario described in Example 1, the electronic device can switch from displaying the first recommendation interface shown in Figure 3 to displaying the second recommendation interface shown in Figure 8 in response to a user clicking icon 6 of image set 6. As shown in Figure 8, the second recommendation interface may include icons 5-9 of image sets 5-9 and markers (i.e., the dashed lines connecting icon 6 to icon 5 and icon 7-9 respectively shown in Figure 8) indicating the degree of association between image set 6 and image sets 5 and 7-9. Image set 7-9 may be an image set determined by the electronic device that is not displayed in the first recommendation interface. In this scenario, image set 6 corresponds to the aforementioned first image set, and image sets 5 and 7-9 correspond to at least one of the aforementioned second image sets.
[0144] 2. Display a subset of images within the image collection.
[0145] In some embodiments of this application, after displaying the first or second recommendation interface, the electronic device can display a third recommendation interface in response to a second selection operation on the icon of the first image set. The first image set can be any one of multiple image sets. The third recommendation interface may include an icon for the first image set, icons for at least one image subset associated with the first image set, and association markers indicating the association between the first image set and each image subset. Each image subset within the at least one image subset belongs to a subset of the first image set, and each image subset may include images from the first image set that conform to the same theme; different image subsets correspond to different themes. The theme corresponding to each image subset can be determined based on the feature information of the images in the first image set. Image subsets can be used to further classify or extract the categories of images in the first image set. Through this method, the electronic device can perform more refined recommendations based on the recommended image sets, while simultaneously reflecting the association between previous and subsequent recommendation sets, thereby improving the recommendation and display effects.
[0146] In some embodiments of this application, the third recommendation interface may further include at least one fourth image set. The fourth image set can be referred to in the aforementioned second or third image set, and will not be detailed here. Optionally, the third recommendation interface may also include a marker indicating the degree of association between the first and fourth image sets.
[0147] In some embodiments of this application, the display format (e.g., color depth, shape, size, etc.) of the icons of the image subset and the icons of the image set may be different, and / or the display form of the icons of the image subset and the icons of the image set may be different, which may include image form, text form, image and text combination form or other forms, so as to facilitate users to distinguish different types of sets.
[0148] In some embodiments of this application, the distance between the icon of each image subset of the first image set and the icon of the first image set can be negatively correlated with the degree of association between the image subset and the first image set. That is, the higher the degree of association between the image subset and the first image set, the closer the distance between the icon of the image subset and the icon of the first image set; the lower the degree of association between the image subset and the first image set, the farther the distance between the icon of the image subset and the icon of the first image set. The degree of association between each image subset and the first image set can meet at least one of the following criteria:
[0149] 1) It is positively correlated with the number of images in the image subset. That is, the more images a subset contains, the higher the correlation between the subset and the first image set; the fewer images a subset contains, the lower the correlation between the subset and the first image set.
[0150] 2) It is negatively correlated with the time interval between the average generation time or average acquisition time of the images in the image subset and the current time. That is, the closer the average generation time or average acquisition time of the images in the image subset is to the current time, the higher the correlation between the image subset and the first image set; the further away the average generation time or average acquisition time of the images in the image subset is from the current time, the lower the correlation between the image subset and the first image set.
[0151] 3) The time interval between the generation time or acquisition time of the target image in the image subset and the current time is negatively correlated with the image itself; where the target image is the image in the image subset whose generation time or acquisition time is closest to the current time. That is, the closer the generation time or acquisition time of the most recently generated or acquired image in the image subset is to the current time, the higher the correlation between the image subset and the first image set; conversely, the further away the generation time or acquisition time of the most recently generated or acquired image in the image subset is from the current time, the lower the correlation between the image subset and the first image set.
[0152] Optionally, in the third recommendation interface, the icon of the first image set can be displayed in a set format that is different from the display format of the icons of the image subsets or other image sets, so as to highlight the first image set selected by the user.
[0153] In the above method, the second selection operation can be an operation applied to the icon of the first image set. The second selection operation can be used to select the first image set (or the icon of the first image set) and indicate recommended images (or videos) from the first image set. For example, when the electronic device displays the first recommendation interface, the second selection operation can be a long press on the icon of the first image set, or it can be other pre-defined operations. When the electronic device displays the second recommendation interface, the second selection operation can be a click on the icon of the first image set, or it can be other pre-defined operations. The specific operation method of the second selection operation is not specifically limited in the embodiments of this application.
[0154] Example 9: In one example, in the scenario described in Example 7, the electronic device can switch from displaying the second recommendation interface shown in Figure 7 to displaying the third recommendation interface shown in Figure 9 in response to a user clicking icon 1 of image set 1. As shown in Figure 9, the third recommendation interface can add icons 11-13 to the second recommendation interface to display images associated with image set 1 (image sets 1-3), as well as association markers (i.e., the lines connecting icon 1 of image set 1 and icons 11-13 of image sets 1-3 as shown in Figure 9) to indicate the association relationship between image set 1 and image sets 1-3. For example, taking image set 1 as the image set corresponding to user 1, the themes of image sets 1-3 can be birthday, travel, and sports, respectively. That is, image set 1 includes birthday-related images contained in image set 1, image set 2 includes travel-related images contained in image set 1, and image set 3 includes sports-related images contained in image set 1. As shown in Figure 9, the third recommendation interface can also include icons 3-4 of image set 3-4 and markers to indicate the association degree between image set 1 and image set 3-4.
[0155] In some embodiments of this application, after displaying the third recommendation interface, the electronic device can also display images included in the image subset in response to an operation performed on any subset of images in the first image set displayed in the third recommendation interface (e.g., clicking the image subset). For example, in the scenario described in Example 9, the electronic device can display images in image subset 1 in response to a user clicking the icon 11 shown in FIG9.
[0156] 3. Display images from the image collection.
[0157] In some embodiments of this application, after displaying a first recommendation interface or a second recommendation interface, the electronic device can switch from the current recommendation interface to displaying a first image display interface in response to an open operation on an icon of a first image set. The first image set can be any one of multiple image sets. The first image display interface includes images from the first image set. The open operation can be used to instruct the display of images from the first image set. The specific operation method of this open operation is not limited in the embodiments of this application; for example, the open operation can be a double-click operation or other pre-defined operations. In this way, the electronic device can support users in viewing images in the image set. For example, in the scenario of Example 1 above, the electronic device can display the interface shown in Figure 4 in response to the user's open operation on icon 1 shown in Figure 3.
[0158] In some embodiments of this application, after displaying the third image recommendation interface, the electronic device can also perform interactions related to a single image subset based on the user's actions on the icons of that single image subset in the third recommendation interface. This method can be implemented with reference to the method described in Part Two above (the method for single-set interaction), and will not be repeated here.
[0159] III. Multi-set Interaction
[0160] In one possible solution provided in this application embodiment, after the electronic device displays the first recommendation interface based on the method described in the first part above (the method for dividing and displaying image sets), or after displaying the second or third recommendation interface based on the method described in the second part above (the single set interaction method), it can perform interactions related to multiple sets (image sets and / or associated subsets) corresponding to multiple icons based on the user's operations on multiple icons in the interface. The following description uses the scenario of the electronic device displaying the second recommendation interface as an example. The method for the electronic device displaying the first or third recommendation interface can be implemented with reference to the following method, and will not be detailed in this application embodiment.
[0161] 1. Display related subsets of multiple image collections.
[0162] In some embodiments of this application, taking the scenario of an electronic device displaying a second recommendation interface as an example, the electronic device can switch from displaying the second recommendation interface to displaying a fourth recommendation interface in response to a third selection operation on the icons of the first image set and the second image set in the second recommendation interface. The icons of the first image set can be any icon in the second recommendation interface, and the icons of the second image set can be any icon in the second recommendation interface other than the icons of the first image set. The fourth recommendation interface includes the icons of the first image set, the icons of the second image set, icons of at least one associated subset associated with both the first and second image sets, and association markers indicating the association relationship between the first and second image sets and each associated subset. Each associated subset can include a portion of images from the first image set and a portion of images from the second image set, and the images in each associated subset belong to the same theme; different associated subsets correspond to different themes. The theme corresponding to each associated subset can be determined based on the feature information of the images in the first and second image sets. The images in the first and second image sets can be further divided or extracted through the associated subsets. Using this method, electronic devices can make more refined recommendations of related sets of images based on multiple recommended image sets, thereby improving the recommendation effect.
[0163] In some embodiments of this application, the fourth recommendation interface may further include at least one fifth image set. The fifth image set can be referenced to the aforementioned second or third image set, and will not be detailed here. Optionally, the fourth recommendation interface may also include a marker indicating the degree of association between the first and fifth image sets.
[0164] In some embodiments of this application, the display format (e.g., color depth, shape, size, etc.) of the icons of the associated subset and the icons of the image set may be different, and / or the display form of the icons of the associated subset and the icons of the image set may be different, which may include image form, text form, image and text combination form or other forms, so as to facilitate users to distinguish different types of sets.
[0165] In some embodiments of this application, similar to the relationship between the image subsets of the first image set and the first image set described in the second part of the method above, in this method, the distance between the icon of each associated subset and the icon of any image set (e.g., the first image set or the second image set) associated with that associated subset can be negatively correlated with the degree of association between the associated subset and that image set. The degree of association between the associated subset and any image set associated with that associated subset can satisfy at least one of the following:
[0166] 1) Positively correlated with the number of images belonging to any image set included in the associated subset.
[0167] 2) It is negatively correlated with the average generation time or average acquisition time of images belonging to any image set included in the associated subset and the interval between the current time and the average generation time.
[0168] 3) Negatively correlated with the time interval between the generation time or acquisition time of the target image in the associated subset and the current time; wherein, the target image is the image in the associated subset that belongs to any image set and whose generation time or acquisition time is closest to the current time.
[0169] Optionally, in the fourth recommendation interface, the icons of the first image set and the second image set can be displayed in a set format that is different from the display format of the icons of the associated subsets or other image sets, so as to highlight the first image set and the second image set selected by the user.
[0170] In the above method, the third selection operation can be an operation applied to the icons of the first image set and / or the icons of the second image set. The third selection operation can be used to select the first image set and the second image set (or the icons of the first image set and the icons of the second image set) and indicate the recommendation of associated images (or videos) from the first image set and the second image set. For example, the third selection operation can be any of the following operations:
[0171] 1) The operation of dragging the icon of the first image set in the direction of the icon of the second image set.
[0172] 2) The operation of dragging the icon of the first image set to touch the icon of the second image set.
[0173] 3) Click the icons of the first image set and the second image set in sequence.
[0174] 4) The operation of pinching the icons of the first image set and the second image set together with two fingers.
[0175] Of course, the third selection operation can also be other pre-defined operations. This application does not impose specific restrictions on the specific operation method of the third selection operation in its embodiments.
[0176] Example 10: In one example, in the scenario described in Example 7, the electronic device can switch from displaying the second recommendation interface shown in Figure 7 to displaying the fourth recommendation interface shown in Figure 10 in response to a user's pinching action of touching icon 1 of image set 1 and icon 2 of image set 2 with two fingers respectively. As shown in Figure 10, the fourth recommendation interface can add icons 11-13 to the second recommendation interface to display associated subsets 1-3 of image set 1 and image set 2, as well as association markers (i.e., the lines connecting icon 1 of image set 1 and icon 11-13 of associated subsets 1-3, and the lines connecting icon 2 of image set 2 and icon 11-13 of associated subsets 1-3, respectively, as shown in Figure 10) to indicate the association relationship between image set 1, image set 2 and associated subsets 1-3. For example, taking image set 1 as the image set corresponding to user 1 and image set 2 as the image set corresponding to user 2, the themes of associated subsets 1-3 can be basketball game, graduation photo, and travel, respectively. That is, associated subset 1 includes basketball game-related images contained in image set 1 and image set 2; associated subset 2 includes graduation photo-related images contained in image set 1 and image set 2; and associated subset 3 includes travel-related images contained in image set 1 and image set 2. Optionally, as shown in Figure 10, the fourth recommendation interface may also include icons for other image sets obtained by the electronic device and markers indicating the degree of association between image set 1 or image set 2 and other image sets obtained by the electronic device.
[0177] 2. Display images from the associated subset.
[0178] In some embodiments of this application, after displaying the fourth recommendation interface, the electronic device can switch from the fourth recommendation interface to displaying the second image display interface in response to an open operation of an icon for any associated subset. The second image display interface includes images from that associated subset. The open operation can be used to instruct the display of images from that associated subset. The specific operation method of this open operation is not limited in the embodiments of this application; for example, the open operation can be a double-click operation or other pre-defined operations. In this way, the electronic device can support users in viewing images from associated subsets of multiple image sets.
[0179] It should be understood that the above method is illustrated using a scenario involving interaction with two sets (i.e., the first image set and the second image set mentioned above), but it does not limit the number of interaction sets to which the solution provided in this application is applicable. Methods for interacting with a larger number of image sets can be implemented with reference to the method for interacting with two image sets described above, and will not be listed in detail in this application embodiment.
[0180] IV. Image Collection Update
[0181] In some embodiments of this application, when a new image to be saved is added to the electronic device, the electronic device can identify the image set to which the image belongs based on the image's feature information, and add the image to that image set. If no image set to which the image belongs is identified, the electronic device can add a new image set to which the image belongs. The electronic device can also update the correlation between different image sets obtained by the method described in the first part based on the updated image set or the newly added image set. That is, the electronic device can update the created knowledge base based on the feature information of the newly added image.
[0182] Within a set time period after a new image is added, if the electronic device receives a pre-defined image display operation, it can respond to the operation by displaying an animation indicating that the new image has been assigned to at least one image set. This at least one image set can be an existing image set or a newly created image set, and the image display operation can be used to instruct the display of the image. For example, the image display operation could be the user opening an application on the electronic device used to display images, or it could be other pre-defined operations; no specific limitations are imposed in this embodiment.
[0183] Example 11: In one example, taking a mobile phone as the electronic device and a gallery application as the application used to display images on the electronic device, within a set time period (e.g., 2 seconds) after the electronic device obtains an image through another application and saves it to the gallery application, when the electronic device receives an operation to open the gallery application, the electronic device can display an animation effect that gradually switches from the interface shown in Figure 11(a) to the interface shown in Figure 11(b). The interface shown in Figure 11(a) can be used to indicate that the image set to which the newly added image belongs is being matched. The interface shown in Figure 11(b) can be used to indicate that the image set to which the newly added image belongs has been matched. This interface can include icons of the image sets to which the newly added image belongs, displayed according to a set format. For example, icons 1-3 shown in Figure 11(b) can respectively indicate image sets 1-3 to which the newly added image belongs.
[0184] Using the methods described above, in scenarios involving newly added images, electronic devices can display relevant animated effects for the new images and highlight the collection of images related to the new images, which helps to improve the interactive experience.
[0185] Figure 12 is a schematic diagram of the architecture of a possible display system to which the method provided in the above embodiments of this application applies. This display system can be deployed in an electronic device. As shown in Figure 12, the display system may include a gallery application, a gallery management service, and a database module. The gallery application can be used to display images; for example, it can display the various interfaces described in the above embodiments. The gallery application can also receive user instructions (e.g., the various user operations described in the above embodiments) and send these instructions to the gallery management service. The gallery management service can determine the interface to be displayed by the gallery application based on the user instructions. The gallery management service can also manage and process images in the gallery, such as performing image set division and image set recommendation processes as described in the above embodiments. The database module can be used to store data, such as images and image set information.
[0186] In one example, as shown in Figure 12, a gallery application may include a gallery display module and an interaction module. The gallery management service may include a gallery monitoring module, an instruction parsing module, an instruction response module, a knowledge base management module, and a gallery update module. Within the gallery application, the gallery display module is used for interface display, and the interaction module is used to receive user instructions and report them to the gallery monitoring module. In the gallery management service, the gallery monitoring module receives instructions from the interaction module (e.g., adding, deleting, modifying, querying images, or instructions for interaction based on a single or multiple image sets) and sends these instructions to the instruction parsing module. The gallery monitoring module can also monitor changes to images in the gallery application (e.g., adding, modifying, or deleting images) and notify the knowledge base management module of these changes so that the knowledge base management module can update the image-related information. The knowledge base management module performs image recognition, image set segmentation, relationship recognition, and other processing on the images in the gallery, as well as manages related information. Upon receiving user instructions from the gallery monitoring module, the instruction parsing module can identify the user instructions to determine the user's intent. Optionally, when the user's intent is to interact with an image collection, the instruction parsing module can send the parsing result to the instruction response module. When the user's intent is to add, delete, or modify images, the instruction parsing module can send the parsing result to the image library update module. The instruction response module can be used to determine the method and / or content of responding to the user's instruction based on the received parsing result and relevant information about the image collection queried from the knowledge base management module, and instruct the image library application to perform corresponding response processing. For example, when the user's instruction is to recommend featured images or videos from a certain image collection, the instruction response module can generate a subset of images recommended based on the information queried from the knowledge base management module, and instruct the image library display module to display them accordingly. As another example, when the user's instruction is to recommend related images from two image collections, the instruction response module can generate a related subset of images recommended based on the relevant information of the two image collections queried from the knowledge base management module, and instruct the image library display module to display them accordingly. The gallery update module can update the images in the gallery based on user intent to add, delete, or modify images, and instruct the gallery display module to display the corresponding interface.
[0187] In one example, as shown in Figure 12, the knowledge base management module may include an image information management module, an image understanding module, a vectorization module, and an image set partitioning module. Optionally, it may also include a knowledge base storage module. The image information management module manages image-related information (e.g., contextual information). The image understanding module extracts features from images (e.g., semantic features). The vectorization module vectorizes the features extracted by the image understanding module. The image set partitioning module partitions images into sets based on the image-related information managed by the image information management module and the vector features processed by the vectorization module. The knowledge base storage module stores the image set information partitioned by the image set partitioning module (e.g., image set identifiers, categories, etc.).
[0188] In one example, the database module may include a basic information database, a vector database, and a relational database. The basic information database can store fundamental information such as images and their contextual information. The vector database can store vector feature data obtained from the vectorization module. The relational database can store information about the relationships between different images and the relationships (i.e., the degree of association) between different sets of images.
[0189] In some embodiments of this application, when the electronic device is implemented using the structure shown in FIG2, the above-mentioned gallery application can be deployed in the application layer shown in FIG2, and the above-mentioned gallery management service and database can be deployed in the application framework layer shown in FIG2.
[0190] It should be understood that the display system architecture described above is merely an example. In practical applications, modules can be added or removed, or modules can be split or merged. This application does not impose specific limitations. The division of functional modules in the display system architecture described above is illustrative and only represents a logical functional division. In actual implementation, there may be other division methods, and the specific functions performed by each functional module may also be divided in other ways. For example, the first electronic device may also be divided into more or fewer functional services according to other factors, or the functions of each service may be divided in other ways, or it may not be divided into functional services but work as a whole. The names of the functional modules described above are merely examples, and the names of the functional modules in the embodiments of this application are not limited.
[0191] It should be noted that the application scenarios provided in the above embodiments are merely illustrative examples of the applicable scenarios of the embodiments of this application, and do not limit the applicable scenarios of the solutions of this application. Some methods or the same technical concepts provided in any of the above embodiments can also be applied in other embodiments or other scenarios, or can be combined with the methods provided in other embodiments. Specifically, they can be applied in combination with specific embodiments or specific scenarios, and will not be listed and described one by one in this application.
[0192] Based on the above embodiments and the same technical concept, this application also provides a display method, as shown in FIG13, which may include:
[0193] S1301: The electronic device displays a first interface; wherein the first interface includes icons of a first set and icons of a second set, and the first set and the second set each include at least one media content among multiple media content.
[0194] The media content can be at least one of the following types: images, GIFs, and videos. The first set and the second set can be any two sets from a plurality of sets. The plurality of sets can be some or all of the sets obtained by the electronic device based on multiple media content categories. The method for dividing sets based on multiple media content by the electronic device can be referred to the image set division method in the first part (Image Set Division and Display) mentioned above, and will not be detailed here.
[0195] As an optional implementation, the media content in the first set can belong to a first category, and the media content in the second set can belong to a second category. The first and second categories can be different categories within the same dimension or different categories within different dimensions; no specific limitations are imposed in this embodiment. In one example, the first and second categories can correspond to different people. For instance, all media content in the first set may contain the same person, and the first category is the category corresponding to that person. Similarly, all media content in the second set may contain the same other person, and the second category is the category corresponding to that other person. In another example, the classification method for the first and second categories can also refer to the methods described in Examples 1, 2, 3, or 4 above, and will not be listed here. The method for electronic devices to divide the sets based on this method can be implemented as described in Stage 1 of the first part above, and will not be detailed here.
[0196] As another optional implementation, the first set may include media content belonging to a first category and media content associated with the media content of the first category, and the second set may include media content belonging to a second category and media content associated with the media content of the second category. The method described in Example 5 above can be referred to for further details. The method by which an electronic device divides the sets based on this approach can be implemented using the methods described in stages 1 and 2 of the first part above, and will not be detailed here.
[0197] Optionally, the first interface can be referred to as the first recommendation interface described in the first part above, and the first set and the second set can be referred to as the multiple image sets described in the first part above, which will not be elaborated here.
[0198] In some embodiments of this application, the first interface may further include a first marker, which is used to indicate the correlation between the first set and the second set. Optionally, the first interface may further include icons of other sets besides the first and second sets, as well as markers for indicating the correlation between the first set and other sets. For example, the first interface may further include an icon of a fourth set and a second marker; wherein the fourth set includes at least one media content belonging to a third category among multiple media content items, and the second marker is used to indicate the correlation between the first set and the fourth set. Optionally, in this method, the display format of the icon of the first set is different from that of the icons of other sets besides the first set displayed in the first interface. The display format may include at least one of the following: size, shape, and color. Optionally, in this method, the distance between the icon of the first set and the icons of other sets besides the first set displayed in the first interface is negatively correlated with the correlation between the first set and other sets. Optionally, in this method, the correlation between the first set and other sets besides the first set displayed in the first interface is higher than or equal to a set correlation threshold. Based on the above method, in some embodiments of this application, the electronic device may receive a second operation before displaying the first interface. The second operation is used to instruct the display of the first set and at least one set associated with the first set. That is, the electronic device may display the first interface in response to the received second operation. For example, the second operation may be an operation in which a user selects a set from multiple set icons randomly displayed by the electronic device, etc. The specific operation method of the second operation is not limited in the embodiments of this application.
[0199] In some embodiments of this application, the specific implementation of step S1301 can be achieved by referring to the method described in the first part above, and will not be described in detail here.
[0200] S1302: The electronic device responds to the received first operation by displaying a second interface; wherein the second interface includes icons of at least one of the first and second sets and an icon of a third set, the media content in the third set consists of a portion of the media content of each of the at least one set, and the media content in the third set belongs to the same category.
[0201] The first operation can be an operation applied to icons in at least one set. Optionally, the media content in the third set can belong to the same theme, which can be a theme corresponding to the same category mentioned above.
[0202] In some embodiments of this application, the same category is different from the first category and the second category. Optionally, the same category and the first category and the second category can be categories of the same dimension or categories of different dimensions. In some embodiments of this application, the media content in the third set belonging to the same category may specifically include at least one of the following: the generation time or acquisition time of the media content in the third set belongs to the same time period; the generation location or acquisition location of the media content in the third set is the same location; the events recorded by the media content in the third set are the same events.
[0203] In one possible approach, taking a scenario where at least one set includes either the first set or the second set as an example, the at least one set, the first operation, the second interface, and the third set can be referred to respectively in the aforementioned Part II (Single Set Interaction) as the first image set, the second selection operation, the third recommendation interface, and any subset of images associated with the first image set, which will not be detailed here. In this scenario, the method for the electronic device to display the second interface can refer to the method for displaying a subset of images under the image set as described in the aforementioned Part II, which will not be detailed here.
[0204] In one example, when the above method is applied to the scenario described in Example 9, the first interface can be the interface shown in Figure 7, the first set can be the image set 1 described in Example 9, and the first operation can be the user clicking on icon 1 shown in Figure 7. The second interface can be the interface shown in Figure 9. The icons in the first set can be icon 1 shown in Figure 9, and the icons in the third set can be icon 11, icon 12, or icon 13 shown in Figure 9.
[0205] In another possible solution, taking a scenario where at least one set includes a first set and a second set as an example, the first set, the second set, the first operation, the second interface, and the third set can be referred to respectively in Part III (Multi-Set Interaction) as the first image set, the second image set, the third selection operation, the fourth recommendation interface, and any associated subset related to both the first and second image sets, which will not be detailed here. In this scenario, the method for the electronic device to display the second interface can refer to the method for displaying associated subsets of multiple image sets described in Part III, which will not be detailed here.
[0206] In one example, when the above method is applied to the scenario described in Example 10, the first interface can be the interface shown in Figure 7. The first set and the second set can be image set 1 and image set 2, respectively. The first operation can be the user pinching the icon 1 of image set 1 and the icon 2 of image set 2 inward with two fingers in the interface shown in Figure 7. The second interface can be the interface shown in Figure 10. The icons of the third set can be icon 11, icon 12, or icon 13 shown in Figure 10.
[0207] In some embodiments of this application, in the two possible solutions described above, in the second interface, the display format of the icons of the third set is different from the display format of the icons of at least one set, and / or, the display format of the icons of the third set is different from the display format of the icons of at least one set. Optionally, the display format may include at least one of the following: size, shape, and color. The display format may include image format and / or text format. For example, in the scenario shown in Figure 9 or Figure 10, the size of the image subset may be different from the size of the image set, the display format of the image subset may include text format, etc., and the display format of the image subset may include image format.
[0208] In some embodiments of this application, the second interface may also include a marker for indicating that a third set is associated with at least one set. For example, in the scenario shown in Figure 9 or Figure 10, the marker may be a line.
[0209] In some embodiments of this application, the distance between the icon of the third set and the icon of any set in at least one set can be negatively correlated with the degree of association between the third set and any set. For example, in the scenario shown in Figure 9, the distance between the icons of different image subsets and the icons of the image set can be different, representing different degrees of association between different image subsets and the image set. The same applies to Figure 10.
[0210] Optionally, in this method, the correlation between the third set and any set in at least one of the sets meets at least one of the following criteria: positively correlated with the number of media content belonging to any set included in the third set; negatively correlated with the interval between the average generation time or average acquisition time of the media content belonging to any set included in the third set and the current time; negatively correlated with the interval between the generation time or acquisition time of the target media content in the third set and the current time; wherein, the target media content is the media content belonging to any set included in the third set whose generation time or acquisition time is closest to the current time.
[0211] In some embodiments of this application, when at least one set includes a first set or a second set, the specific implementation of step S1301 can be achieved by referring to the method described in the aforementioned second part, and will not be described in detail here. In some embodiments of this application, when at least one set includes a first set and a second set, the specific implementation of step S1301 can be achieved by referring to the method described in the aforementioned third part, and will not be described in detail here.
[0212] In some embodiments of this application, the electronic device may also display media content in the third set in response to an operation acting on the third set. Wherein, when at least one set includes the first set or the second set, the method can be implemented with reference to the method for displaying images in the image subset described in the foregoing second part, and will not be detailed here. When at least one set includes the first set and the second set, the method can be implemented with reference to the method for displaying images in the associated subset described in the foregoing third part, and will not be detailed here.
[0213] In some embodiments of this application, after displaying the second interface, the electronic device can also, in response to a third operation received through the first application, acquire the first media content; and in response to a received fourth operation, display an animation through the second application indicating that the first media content be added to the first set and / or the second set; wherein, the first media content is not included in multiple media content sets, the fourth operation is used to indicate that the second application be opened, and the second application is used to manage media content. In this method, the third operation can be an operation indicating that the first media content be saved. Optionally, the time interval between the reception time of the fourth operation and the reception time of the third operation is less than or equal to a set duration. This method can be implemented with reference to the method described in the fourth part above, and will not be described in detail here.
[0214] The specific steps performed by the electronic device in the above method can be found in the relevant descriptions in the foregoing embodiments, and will not be repeated here.
[0215] Based on the above embodiments and the same technical concept, this application also provides an electronic device for implementing the display method provided in this application. As shown in FIG14, the electronic device 1400 may include: a memory 1401, one or more processors 1402, and one or more computer programs (not shown in the figure). The above-mentioned devices can be coupled through one or more communication buses 1403. Optionally, the electronic device 1400 may further include a display screen 1404.
[0216] The memory 1401 stores one or more computer programs (code), and the one or more computer programs include computer instructions; one or more processors 1402 call the computer instructions stored in the memory 1401, causing the electronic device 1400 to execute the display method provided in the above-described embodiments of this application.
[0217] In a specific implementation, memory 1401 may include high-speed random access memory and may also include non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 1401 may store an operating system (hereinafter referred to as the system), such as embedded operating systems like Android, iOS, Windows, or Linux. Memory 1401 can be used to store implementation programs of the embodiments of this application. Memory 1401 may also store network communication programs, which can be used to communicate with one or more additional devices, one or more user devices, or one or more network devices.
[0218] One or more processors 1402 may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of programs according to the present application.
[0219] Display screen 1404 is used to display application interfaces and other related user interfaces.
[0220] It should be noted that Figure 14 is only one implementation of the electronic device 1400 provided in this application embodiment. In actual applications, the electronic device 1400 may include more or fewer components. For details, please refer to the specific structure and description shown in Figure 1. No limitations are imposed here.
[0221] Based on the above embodiments and the same technical concept, this application also provides a computer-readable storage medium storing a computer program that, when run on a computer, causes the computer to perform the method provided in the above embodiments.
[0222] Based on the above embodiments and the same technical concept, this application also provides a computer program product, which includes a computer program or instructions. When the computer program or instructions are run on a computer, the computer performs the method provided in the above embodiments.
[0223] Based on the above embodiments and the same technical concept, this application also provides a computer program product, which includes a computer program or instructions. When the computer program or instructions are run on a computer, the computer performs the method provided in the above embodiments.
[0224] The methods provided in this application can be implemented, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, they can be implemented, in whole or in part, in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of the present invention is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user equipment, or other programmable device. Computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. A computer-readable storage medium can be any available medium that a computer can access, or a data storage device such as a server or data center that integrates one or more available media. Available media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., digital video discs (DVDs), or semiconductor media (e.g., SSDs), etc.
[0225] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.
Claims
1. A display method applied to an electronic device, characterized in that, The method includes: Display a first interface; wherein the first interface includes an icon for a first set and an icon for a second set, and the first set and the second set each include at least one type of media content from a plurality of media content; In response to the received first operation, a second interface is displayed; wherein the second interface includes icons of at least one of the first set and the second set, and an icon of a third set, wherein the media content in the third set consists of a portion of the media content of each of the at least one set, and the media content in the third set belongs to the same category.
2. The method as described in claim 1, characterized in that, The media content in the third set belongs to the same category, specifically including at least one of the following: The media content in the third set was generated or acquired within the same time period; The media content in the third set is generated or acquired at the same location; The events recorded in the media content of the third set are the same events.
3. The method as described in claim 1 or 2, characterized in that, The media content in the first set belongs to the first category, and the media content in the second set belongs to the second category.
4. The method as described in claim 3, characterized in that, The same category is different from the first category and the second category.
5. The method according to any one of claims 1 to 4, characterized in that, The second interface also includes a marker for indicating that the third set is associated with the at least one set.
6. The method as described in claim 5, characterized in that, The distance between the icon of the third set and the icon of any of the at least one set is negatively correlated with the correlation between the third set and any of the sets.
7. The method according to any one of claims 1 to 6, characterized in that, The first interface also includes a first marker, which is used to indicate the degree of association between the first set and the second set.
8. The method as described in claim 7, characterized in that, The first interface also includes an icon for a fourth set and a second marker; wherein the fourth set includes at least one piece of media content belonging to the third category among the multiple media content items, and the second marker is used to indicate the degree of association between the first set and the fourth set.
9. The method as described in claim 7 or 8, characterized in that, The icon of the first set is displayed in a different format than the icons of other sets besides the first set displayed on the first interface.
10. The method as described in claim 8 or 9, characterized in that, The distance between the icon of the first set and the icons of other sets besides the first set displayed in the first interface is negatively correlated with the degree of correlation between the first set and the other sets.
11. The method according to any one of claims 8 to 10, characterized in that, The correlation between the first set and other sets other than the first set displayed in the first interface is higher than or equal to the set correlation threshold.
12. The method according to any one of claims 8 to 11, characterized in that, Before displaying the first interface, the method further includes: Receive a second operation, the second operation being used to instruct the display of the first set and at least one set associated with the first set.
13. The method according to any one of claims 1 to 12, characterized in that, After displaying a second interface in response to the received first operation, the method further includes: In response to a third operation received through a first application, first media content is obtained; wherein the first media content is not included in the plurality of media contents; In response to the received fourth operation, an animation is displayed via a second application to indicate that the first media content is added to the first set and / or the second set; wherein the fourth operation is to indicate that the second application is opened, and the second application is used to manage media content.
14. The method as described in claim 13, characterized in that, The time interval between the receiving time of the fourth operation and the receiving time of the third operation is less than or equal to a set duration.
15. The method according to any one of claims 1 to 14, characterized in that, In the second interface, the display format of the icons of the third set is different from the display format of the icons of the at least one set, and / or the display format of the icons of the third set is different from the display format of the icons of the at least one set.
16. The method as described in claim 15, characterized in that, The display format includes at least one of the following: size, shape, and color.
17. An electronic device, characterized in that, The electronic device includes a memory and one or more processors; The memory is used to store computer program code, which includes computer instructions; when the computer instructions are executed by the one or more processors, the electronic device performs the method as described in any one of claims 1 to 16.
18. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when run on an electronic device, causes the electronic device to perform the method as described in any one of claims 1 to 16.
19. A computer program product, characterized in that, The computer program product includes a computer program or instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1 to 16.