Media file display method and device

Abstract

A media file display method and a device, relating to the technical field of communications. The method can be applied to an electronic device, and can implement display of media files on the basis of person relationships, so as to improve user experience. The method comprises: receiving a first user operation; and, in response to the first user operation, displaying a first page, the first page comprising a person relationship display area and a media file display area, wherein the person relationship display area displays an avatar of a first person and an avatar of a first associated person corresponding to the first person, and an association degree between the first associated person and the first person, the first person, the first associated person and the association degree are determined on the basis of media files stored in the electronic device, the number of first associated persons is at least one, and the media file display area displays media files associated with the first person.

Description

A method and device for displaying media files

[0001] Cross-reference to related applications

[0002] This application claims priority to Chinese Patent Application No. 202510477980.2, filed on April 15, 2025, entitled "A Method and Apparatus for Displaying Media Files", the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application relates to the field of communication technology, and in particular to a method and device for displaying media files. Background Technology

[0004] With the continuous development of technology, terminal devices are storing more and more media files, requiring applications to manage and display these media files. Taking photo-type media files as an example, the "Gallery" application can manage and display media files such as photos taken by users.

[0005] Improving the intelligence of displaying media files such as photos to provide a better user experience is a problem that needs to be solved. Summary of the Invention

[0006] This application provides a media file display method and device to display media files based on interpersonal relationships, thereby improving the intelligence of media file display and enhancing user experience.

[0007] The embodiments of this application can be applied to electronic devices. Specifically, these electronic devices can be non-foldable screen phones, foldable screen phones, wearable devices (such as smartwatches, smart bracelets, etc.), tablet computers, laptops, smart screens, in-vehicle terminals, computers, personal computers (PCs), ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), virtual reality (VR) devices / augmented reality (AR) devices, artificial intelligence (AI) devices, and other terminal devices with display functions.

[0008] In a first aspect, a media file display method is provided, which is applied to an electronic device. The method includes: receiving a first user operation; and responding to the first user operation, displaying a first page, the first page including a character relationship display area and a media file display area, wherein the character relationship display area displays the avatar of a first character and the avatar of a first associated character corresponding to the first character, as well as the degree of association between the first associated character and the first character, wherein the first character, the first associated character, and the degree of association are determined based on media files stored in the electronic device, and the number of the first associated characters is at least one, and the media file display area displays media files associated with the first character.

[0009] In the above implementation method, the relationships between characters can be determined based on the media files in the media file library stored on the electronic device, and the relationships can be displayed on the first page. This allows users to understand the relationships between characters presented in the media files in the media file library, improving the intelligence of media file display and thus enhancing the user experience. On the other hand, it provides convenience for users to browse media files based on these relationships in subsequent interactions.

[0010] In one possible implementation, the method further includes: identifying the person in the selfie as the first person, or identifying the person with the most photos as the first person.

[0011] In one possible implementation, the character display area displays the degree of correlation between the first associated character and the first person, including: the distance between the avatar of the first associated character and the avatar of the first person is positively correlated with the degree of correlation between the first associated character and the first person; and / or, the size of the avatar of the first associated character is positively correlated with the degree of correlation between the first associated character and the first person.

[0012] In this implementation, since the size of the associated person's portrait and / or the distance between the portrait of the associated person and the portrait of the central person (the first person) are positively correlated with the degree of association, users can intuitively understand the degree of association between the associated person and the central person, which facilitates users' subsequent browsing of media files based on the relationship between the persons.

[0013] In one possible implementation, the portraits of the first associated person are arranged in a wraparound manner around the portrait of the first person.

[0014] In this implementation, since the portraits of related characters surround the central character (the first character), the character relationships can be displayed in the form of a "protagonist planet," allowing users to intuitively understand the character relationships.

[0015] One possible implementation further includes: receiving a second user operation, the second user operation being used to replace the first person with a second person, the second person being one of the first associated persons; displaying a second page in response to the second user operation, the second page including a person relationship display area and a media file display area, the person relationship display area displaying the avatar of the second person and the avatar of the second associated person corresponding to the second person, as well as the degree of association between the second associated person and the second person, the second associated person and the degree of association being determined based on media files stored in the electronic device, and the media file display area displaying media files associated with the second person.

[0016] In the above implementation, by changing the central figure, it is possible to select a new central figure based on the relationship between the figures and browse the media files associated with that figure. Compared with the related technology of selecting a figure from a list of figures' avatars to browse the photos associated with that figure, the above implementation provides users with a way to select figures based on the relationship between the figures, thereby improving the user experience.

[0017] In one possible implementation, the second user action is: clicking on the second character's avatar; or dragging the second character's avatar to the area where the first character's avatar is located on the first page.

[0018] One possible implementation further includes: receiving a third user operation applied to the avatar of a second person, the third user operation being used to combine the second person and the first person to obtain a first person combination, the second person being one of the first associated persons; and displaying a third page in response to the third user operation, the third page including a person relationship display area and a media file display area, the person relationship display area displaying the avatars of the first person combination and the avatars of third associated persons associated with the first person combination, as well as the degree of association between the third associated persons and the first person combination, the third associated persons and the degree of association being determined based on media files stored in the electronic device, and the media file display area displaying media files associated with the first person combination.

[0019] In the above implementation, by adding a central figure, a group of figures can be used as the central figure, thereby displaying the media files associated with that group of figures and improving the flexibility of media file browsing.

[0020] In one possible implementation, the avatars of the first person combination are either stacked avatars of the first person and the second person, or a group photo of the first person and the second person.

[0021] In one possible implementation, the media files associated with the first group of people include one or more of the following: a first photo set and a second photo set contain photos of the first person and the second person together; or, photos in the first photo set and the second photo set were taken within the same time period; or, photos in the first photo set and the second photo set were taken at the same location; or, photos in the first photo set and the second photo set belong to the same event. Wherein, the first photo set is the photo set associated with the first person, and the second photo set is the photo set associated with the second person. This implementation can improve the richness of the media files associated with the group of people.

[0022] In one possible implementation, the third user operation is to drag the second person's avatar to the area where the first person's avatar is located.

[0023] One possible implementation further includes: receiving a fourth user action applied to the avatar of a second person, the fourth user action being used to reduce the chance of the second person appearing in the person relationship display area; wherein the second person is one of the first associated persons; in response to the fourth user action, setting the association degree between the second person and the first person to zero or less than a threshold, or reducing the association degree between the second person and the first person, and deleting the avatar of the second person from the person relationship display area.

[0024] The above implementation method can reduce the chances of related characters appearing, thereby meeting users' personalized needs and improving user experience.

[0025] In one possible implementation, the first associated person includes a first group of associated persons and a second group of associated persons, and the degree of association between the second group of associated persons and the first person is no higher than the degree of association between the first group of associated persons and the first person; the person relationship display area includes a first display area and a second display area, the first display area displays the avatar of the first person and the avatar of the first group of associated persons, and the second display area displays the avatar of the second group of associated persons.

[0026] In one possible implementation, the avatars of the second group of associated individuals are of the same size, and / or the avatars of the second group of associated individuals are arranged in rows or columns.

[0027] One possible implementation further includes: receiving a fifth user operation, and in response to the fifth user operation, entering an editing mode; in the editing mode, receiving a sixth user operation, and in response to the sixth user operation, migrating the avatars of the second group of associated characters in the second display area to the first display area, or migrating the avatars of associated characters in the first display area to the second display area.

[0028] By implementing this method, related characters in the first display area and related characters in the second display area can be swapped, thereby meeting users' personalized needs and improving user experience.

[0029] One possible implementation also includes: when a third person is detected looking at the electronic device, displaying the third person's avatar on the first page.

[0030] In the above implementation, when someone is looking at the electronic device, their image can be displayed on the screen of the electronic device, thereby increasing interest and improving the user experience.

[0031] One possible implementation further includes: when the number of photos and / or videos containing a third person increases and the increase is greater than or equal to a threshold, displaying the avatar of the third person on the first page.

[0032] In the above implementation, when the number of photos and / or videos containing a certain person increases significantly, the person's image can be displayed on the screen of the electronic device. On the one hand, this allows users to know the changes in the person in the photos and / or videos in a timely manner, and on the other hand, it can increase the fun and improve the user experience.

[0033] One possible implementation also includes: when it is detected that no more photos containing a third person are added within a first time period, displaying the third person's avatar on the first page.

[0034] In one possible implementation, the third person is one of the first associated persons.

[0035] One possible implementation further includes: receiving a seventh user operation, the seventh user operation being used to merge a first candidate merged person with the first person; responding to the seventh user operation, merging the media file associated with the first candidate merged person with the media file associated with the first person, updating the associated person corresponding to the first person according to the merged media file to obtain a fourth associated person; displaying a fourth page, the fourth page including a person relationship display area and a media file display area, the person relationship display area displaying the avatar of the first person and the avatar of the fourth associated person, as well as the degree of association between the fourth associated person and the first person, and the media file display area displaying the merged media file.

[0036] The above implementation method can merge related persons with candidate persons, thereby correcting person recognition errors and improving the accuracy of person recognition.

[0037] One possible implementation further includes: receiving an eighth user operation, the eighth user operation being used to merge a second candidate merged person with a second person, the second person being one of the first associated persons; responding to the eighth user operation, merging the media file associated with the second candidate merged person with the media file associated with the second person, updating the associated person corresponding to the first person according to the merged media file to obtain a fifth associated person, and updating the person associated with the second person according to the merged media file; displaying a fifth page, the fifth page including a person relationship display area and a media file display area, the person relationship display area displaying the avatar of the first person and the avatar of the fifth associated person, as well as the degree of association between the fifth associated person and the first person, and the media file display area displaying the media file associated with the first person.

[0038] The above implementation method can merge the central person (first person) with the candidate merged persons, thereby correcting the person recognition error and improving the accuracy of person recognition.

[0039] In one possible implementation, the method further includes: receiving a user operation applied to the avatar of the first person or the second person, the user operation being used to set annotation information for the first person, the second person being one of the first associated persons; responding to the user operation, setting annotation information for the first person or the second person, the annotation information including name and / or role; and displaying the annotation information for the first person or the second person.

[0040] In one possible implementation, the media files associated with the first person include: photos and / or videos containing the first person; and include one or more of the following: photos / videos whose shooting time falls within the time period corresponding to the shooting time of the first photo and / or video, wherein the first photo and / or video is a photo and / or video containing the first person; and photos / videos whose shooting location is the same as the shooting location of the first photo and / or video.

[0041] In the above implementation, the media files associated with the central person (first person) can contain not only photos and / or videos of the first person, but also more photos and / or videos based on the similarity of the shooting time and / or shooting location, thereby improving the richness of the media files.

[0042] One possible implementation further includes: setting the correlation degree between the first associated person and the first person based on one or more of the following: the number of photos of the first associated person and the first person together; the annotation information of the first associated person, the annotation information including one or more of name, role and remarks; whether the first associated person is a contact in the first person's address book;

[0043] Whether the first associated person is a social application friend of the first person; the frequency of interaction between the first associated person and the first person, the interaction including calls and / or social application interactions.

[0044] In the above implementation method, the person's labeling information, whether they are a contact in the address book of the first person (central person), whether they are a friend of the first person on social applications, and the frequency of interaction with the first person can be used as references to determine the degree of association between people, thereby improving the accuracy or rationality of the association.

[0045] In one possible implementation, the media file display area includes at least one virtual button, each of the at least one virtual button corresponding to a tag, the tag being obtained by clustering photos and / or videos associated with the first person; the method further includes: when the first virtual button among the at least one virtual button is triggered, displaying photos and / or videos associated with the first person that have the tag corresponding to the first virtual button in the media file display area.

[0046] Through the above implementation, users can browse photos and / or videos associated with the first person based on the category to which the photos and / or videos belong, thereby improving the flexibility of media file browsing and thus enhancing the user experience.

[0047] In one possible implementation, the media file display area further includes a menu button; the method further includes: when the menu button is triggered, displaying menu options, the menu options including at least one option, each of the at least one option being used to indicate the display of media files according to a specified dimension, the different options specifying different dimensions; when one of the at least one options is triggered, according to the dimension corresponding to the triggered option, displaying photos and / or videos associated with the central person in the photo display area.

[0048] Optionally, the at least one option includes one or more of the following: displaying all photos and videos, displaying only photos, displaying only videos, displaying only portraits, displaying by time, displaying by location, displaying by shooting mode, and displaying by object.

[0049] Through the above implementation, users can browse media files associated with the primary person from different dimensions, thereby improving the flexibility of media file browsing and thus enhancing the user experience.

[0050] In one possible implementation, the media file display area includes a second virtual button. The method further includes: when the second virtual button is triggered, displaying a sixth page, the sixth page including a map display area and a media file display area. The map display area displays a map showing the location distribution of the shooting locations of photos and / or videos in the first media file set. The media file display area displays a list of photos and / or videos in the first media file set. The map display area or the media file display area also includes at least one primary virtual button. Each of the at least one primary virtual button corresponds to a tag, which is obtained by clustering the photos and / or videos in the first media file set, which includes photos and / or videos associated with the first person.

[0051] Through the above implementation, on the one hand, the shooting locations can be displayed on a map, allowing users to intuitively understand the geographical distribution of media file shooting locations by referring to the map. On the other hand, virtual buttons corresponding to the tags of media files can also be displayed on the page, so that users can select the corresponding tags to view media files later.

[0052] In one possible implementation, the first virtual button displays the name of a geographic location, which is the location in the first media file set where the most photos and / or videos were taken. This implementation allows users to intuitively understand which shooting location has the most media files.

[0053] One possible implementation further includes: displaying a seventh page when a thumbnail of a photo corresponding to a first geographical location in the map display area is triggered; the seventh page includes a media file display area that displays a list of photos and / or videos in a second media file set, and at least one secondary virtual button; wherein the first geographical location is one of the shooting locations of photos and / or videos associated with the first person, the second media file set includes photos and / or videos associated with the first person whose shooting location is the first geographical location, and each of the at least one secondary virtual button corresponds to a tag, the tag being obtained by clustering the photos and / or videos in the second media file set.

[0054] This implementation allows users to browse photos and / or videos of a specific shooting location within photos and / or videos associated with the main subject (central figure). Virtual buttons corresponding to the tags associated with these photos and / or videos can be displayed, allowing users to further view tagged photos and / or videos of that shooting location using these virtual buttons. This enables users to browse media files based on both geographical location (shooting location) and photo / video tags, thus improving the user experience.

[0055] One possible implementation further includes: displaying an eighth page when the third virtual button among the at least one primary virtual buttons is triggered, the eighth page including a map display area and a media file display area, the map display area displaying a map showing the location distribution of the shooting locations of the photos and / or videos in the third media file set, and the media file display area displaying a list of the photos and / or videos in the third media file set; wherein, the third media file set includes photos and / or videos associated with the first person that have the tag corresponding to the third virtual button.

[0056] Through the above implementation, on the one hand, users can understand the geographical distribution of the shooting locations of photos and / or videos by combining maps; on the other hand, they can also browse photos and / or videos associated with the first person by the dimension of the category to which the photos and / or videos belong, thereby improving the flexibility of media file browsing and thus improving the user experience.

[0057] In one possible implementation, the media file display area includes a fourth virtual button. The method further includes: when the second virtual button is triggered, displaying a ninth page, the ninth page including a map display area and a media file display area. The map display area displays a map showing the location distribution of the shooting locations of photos and / or videos in the first media file set. The media file display area displays a list of photos and / or videos in the first media file set. The map display area or the media file display area also includes at least one primary virtual button. Each of the at least one primary virtual button corresponds to one of the first associated persons, and the first media file set includes photos and / or videos associated with the first person.

[0058] Through the above implementation, on the one hand, the shooting locations can be displayed on a map, allowing users to intuitively understand the geographical distribution of the shooting locations of media files by referring to the map. On the other hand, virtual buttons corresponding to associated persons can also be displayed on the page, so that users can select the corresponding associated person to view the media files containing that associated person.

[0059] In one possible implementation, the fourth virtual button displays the name of a geographic location, which is the location in the first media file set where the most photos and / or videos were taken.

[0060] One possible implementation further includes: displaying a tenth page when a thumbnail of a photo corresponding to a first geographical location in the map display area is triggered. The tenth page includes a map display area and a media file display area. The map display area displays a map showing the location distribution of the shooting locations of photos and / or videos in the first media file set. The media file display area displays a list of photos and / or videos in the second media file set. The map display area or the media file display area also includes at least one secondary virtual button. The first geographical location is one of the shooting locations of photos and / or videos associated with the first person. The second media file set includes photos and / or videos associated with the first person whose shooting location is the first geographical location. Each virtual button in the at least one secondary virtual button corresponds to one of the first associated persons, and the person is one of the people included in the photos and / or videos associated with the first person whose shooting location is the first geographical location.

[0061] This implementation allows users to browse photos and / or videos of a specific shooting location within photos and / or videos associated with the primary (central) person. Users can then use virtual buttons corresponding to the associated persons within these photos and / or videos to further view photos and / or videos of the shooting location containing the corresponding associated persons. This allows users to browse media files based on both geographical location (shooting location) and associated persons, thus improving the user experience.

[0062] One possible implementation further includes: when the fifth virtual button among the at least one primary virtual buttons is triggered, an eleventh page is displayed. The eleventh page includes a map display area and a media file display area. The map display area displays a map showing the location distribution of the shooting locations of the photos and / or videos in the third media file set. The media file display area displays a list of photos and / or videos in the third media file set. The third media file set includes photos and / or videos associated with the first person that contain photos and / or videos of the person corresponding to the fifth virtual button.

[0063] Through the above implementation, on the one hand, users can understand the geographical distribution of the shooting locations of photos and / or videos by combining maps; on the other hand, they can also browse photos and / or videos associated with the first person from the perspective of the associated people contained in the photos and / or videos, thereby improving the flexibility of media file browsing and thus improving the user experience.

[0064] In a second aspect, an electronic device is provided, comprising a unit or module for performing the method as described in any of the first aspects above.

[0065] Thirdly, an electronic device is provided, comprising: one or more processors configured to perform the method as described in any one of the first aspects above.

[0066] Fourthly, a readable storage medium is provided, the readable storage medium storing a program or instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of the first aspects above.

[0067] Fifthly, a chip system or chip is provided, including a processor, for supporting a computer device to implement the method as described in any one of the first aspects above.

[0068] In a sixth aspect, a program product is provided, the program product comprising a program; when the program is run on a computer, the computer performs the method as described in any one of the first aspects above. Attached Figure Description

[0069] Figure 1 is a schematic diagram of the hardware structure of the electronic device in the embodiment of this application;

[0070] Figure 2 is a schematic diagram of the software structure of the electronic device in the embodiment of this application;

[0071] Figure 3 is a schematic diagram of the overall scheme of an embodiment of this application;

[0072] Figure 4 is a flowchart illustrating the background processing operation in an embodiment of this application;

[0073] Figure 5 is a schematic diagram of the "Gallery" application in this application displaying the relationships between characters and the media files associated with the central character through its user interface;

[0074] Figure 6a is a schematic diagram of a "character" main page in an embodiment of this application;

[0075] Figure 6b is a schematic diagram of another "character" main page in an embodiment of this application;

[0076] Figure 7a is a schematic diagram of a method for implementing the functions of refreshing character relationships and editing character relationships based on the settings menu in an embodiment of this application;

[0077] Figure 7b is a schematic diagram of moving a character's avatar from the first display area to the second display area in editing mode according to an embodiment of this application;

[0078] Figure 7c is a schematic diagram of moving a character's avatar from the second display area to the first display area in editing mode according to an embodiment of this application;

[0079] Figure 7d is a schematic diagram of moving the character's head in the second display area forward in editing mode according to an embodiment of this application;

[0080] Figure 7e is a schematic diagram of moving the character's head in the second display area backward in editing mode according to an embodiment of this application;

[0081] Figure 8a is a schematic diagram of a method for setting or editing character information based on a second menu in an embodiment of this application;

[0082] Figure 8b is a schematic diagram of setting a character name in an embodiment of this application;

[0083] Figure 8c is a schematic diagram of setting up a character role in an embodiment of this application;

[0084] Figure 8d is a schematic diagram of setting a person's portrait in an embodiment of this application;

[0085] Figure 8e is a schematic diagram of merging similar figures in an embodiment of this application;

[0086] Figure 8f is a schematic diagram illustrating a method for reducing the chances of related characters appearing in an embodiment of this application;

[0087] Figure 9 is a schematic diagram of a replacement of the central figure in an embodiment of this application;

[0088] Figure 10 is a schematic diagram of adding a central figure in an embodiment of this application;

[0089] Figure 11 is a schematic diagram of browsing media files from different dimensions in an embodiment of this application;

[0090] Figure 12 is a schematic diagram of a media file tab browsing based on media files in an embodiment of this application;

[0091] Figures 13a and 13b are schematic diagrams of a media file display combined with a map in an embodiment of this application;

[0092] Figures 14a and 14b are schematic diagrams of another method of displaying media files in conjunction with a map, as described in this application embodiment.

[0093] Figure 15 is a schematic diagram of the structure of a device provided in an embodiment of this application;

[0094] Figure 16 is a schematic diagram of another device provided in an embodiment of this application. Detailed Implementation

[0095] The following explanations of some terms used in the embodiments of this application are provided to facilitate understanding by those skilled in the art.

[0096] The embodiments of this application involve at least one, including one or more; where "multiple" means two or more. Furthermore, it should be understood that in the description of this specification, terms such as "first" and "second" are used only for descriptive purposes and should not be construed as indicating relative importance or order. For example, the first operation and the second operation do not represent their relative importance or order, but are merely for descriptive distinction. In the embodiments of this application, "and / or" merely describes an association relationship, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. Additionally, the character " / " in this document generally indicates that the preceding and following related objects have an "or" relationship.

[0097] In the description of the embodiments of this application, it should be noted that, unless otherwise explicitly specified and limited, the terms "installation" and "connection" should be interpreted broadly. For example, "connection" can be a detachable connection or a non-detachable connection; it can be a direct connection or an indirect connection through an intermediate medium. The directional terms mentioned in the embodiments of this application, such as "upper," "lower," "left," "right," "inner," and "outer," are only for reference to the directions in the accompanying drawings. Therefore, the directional terms used are for better and clearer explanation and understanding of the embodiments of this application, and are not intended to indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the embodiments of this application.

[0098] References to "one embodiment" or "some embodiments" as used in this specification mean that one or more embodiments of this specification include a particular feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0099] Currently, media applications on electronic devices (such as "Gallery" applications, hereinafter referred to as applications) can manage and display photos, videos, etc. stored on electronic devices from dimensions such as shooting time and location. However, the intelligence of media file display needs to be improved.

[0100] This application provides a media file display method and related devices for implementing the method. In this application, by identifying and analyzing media files (such as photos and / or videos), interpersonal relationships can be obtained. When displaying media files, the interpersonal relationships based on the current central person are shown to the user, and media files associated with that central person are also displayed to the user. This improves the intelligence of media file display and enhances the user experience.

[0101] The method provided in this application can be applied to electronic devices. These electronic devices can enable human-computer interaction. Specifically, the electronic device can be a non-foldable screen phone, a foldable screen phone, a wearable device (such as a smartwatch, smart bracelet, etc.), a tablet computer, a laptop computer, a smart screen, an in-vehicle terminal, a computer, a personal computer (PC), an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a virtual reality (VR) device / augmented reality (AR) device, an artificial intelligence (AI) device, or other terminal devices with display functions. The operating system installed on the aforementioned electronic devices includes, but is not limited to, those that... Alternatively, other operating systems may be used. This application does not limit the specific type of the aforementioned electronic device or the operating system installed on it.

[0102] Referring to Figure 1, this is a possible hardware structure of the electronic device 100 in an embodiment of this application.

[0103] As shown in Figure 1, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0104] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), microcontroller unit (MCU), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. An MCU is a single chip integrating a processor core, memory, input / output interfaces, and other peripheral device interfaces (such as timers, analog-to-digital converters (ADCs), communication interfaces, etc.). Compared to a CPU processor core, the MCU's processor core has a lower frequency and specifications, thus resulting in lower power consumption.

[0105] Different processing units can be independent devices or integrated into one or more processors. The controller can serve as the nerve center and command center of the electronic device 100. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. The processor 110 can also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or is repeatedly using. If the processor 110 needs to reuse the instruction or data, it can directly retrieve it from the memory. This avoids repeated access, reduces the processor 110's waiting time, and thus improves system efficiency. In this embodiment, the execution of the audio playback method can be controlled by the processor 110 or by calling other components, such as calling the processing program of this embodiment stored in the internal memory 121, or calling the processing program of this embodiment stored in a third-party device through the external memory interface 120. This allows the electronic device 100 to automatically switch audio playback modes, solving the problem of low efficiency caused by manual switching of audio playback modes in the prior art. Furthermore, in this embodiment of the application, when the electronic device 100 determines that the user intends to switch audio playback modes (e.g., the electronic device 100 moves closer to or further away from the user's head), it can adaptively adjust the audio playback state or audio playback volume. For example, when switching audio playback modes (e.g., switching from a first audio playback mode to a second audio playback mode), it can pause audio playback, or gradually reduce the volume of the audio when played in the first audio playback mode and gradually reduce the volume of the audio when played in the second audio playback mode. This ensures that the user experience is not affected by sudden changes in audio playback volume when switching audio playback modes, thus adapting to the user's needs.

[0106] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system and software code for at least one application (e.g., iQiyi application, WeChat application, etc.). The data storage area may store data generated during the use of electronic device 100 (e.g., images, videos, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0107] The external memory interface 120 can be used to connect an external memory card, thereby expanding the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to perform data storage functions. For example, images, videos, and other files can be saved on the external memory card.

[0108] In some embodiments, processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a USB interface 130, etc.

[0109] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0110] Electronic device 100 can implement shooting functions through an ISP, camera 193, video codec, GPU, display 194, and application processor or MCU. The ISP processes data fed back from the camera 193. For example, when taking a picture, the shutter is opened, light is transmitted through the lens to the camera's photosensitive element, the light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, converting it into a visible image. The ISP can also perform algorithmic optimization of image noise, brightness, etc. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be integrated into the camera 193.

[0111] Electronic device 100 can implement audio functions such as music playback and recording through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor or MCU.

[0112] The audio module 170 is used to convert digital audio signals into analog audio signals for output, and also to convert analog audio signals into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0113] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls and other external playback scenarios through one or more speakers 170A.

[0114] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. Electronic device 100 may have at least one microphone 170C. In some embodiments, electronic device 100 may have two microphones, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, electronic device 100 may also have three, four, or more microphones, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, etc.

[0115] The 170D headphone jack is used to connect wired headphones. The headphone jack can be a USB interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, or a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.

[0116] It is understood that the components shown in Figure 1 do not constitute a specific limitation on the electronic device. The electronic device in the embodiments of this application may include more or fewer components than those shown in Figure 1. Furthermore, the combination / connection relationships between the components in Figure 1 can also be adjusted and modified.

[0117] Figure 2 illustrates a schematic diagram of the software structure of an electronic device provided in an embodiment of this application. As shown in Figure 2, the software structure of the electronic device can be a layered architecture. For example, the software can be divided into several layers, each with a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into four layers, from top to bottom: the application layer, the application framework layer (framework, FWK), the runtime and system libraries, and the kernel layer.

[0118] The application layer can include a series of application packages. As shown in Figure 2, the application layer can include applications such as the "Gallery" application.

[0119] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer can include some predefined functions. As shown in Figure 2, the application framework layer can include a window manager, a view system, a resource manager, etc.

[0120] The runtime includes the core libraries and the virtual machine. The runtime is responsible for the scheduling and management of the operating system.

[0121] The core library consists of two parts: one part contains the functionalities that the Java language needs to call, and the other part contains the core libraries of the operating system. The application layer and application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0122] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.

[0123] The Surface Manager is used to manage the display subsystem and provides fusion of 2D and three-dimensional (3D) layers for multiple applications.

[0124] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0125] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0126] A 2D graphics engine is a graphics engine for 2D drawing.

[0127] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

[0128] The hardware layer can include various types of sensors, such as accelerometers, gravity sensors, and touch sensors.

[0129] Based on the software structure shown in Figure 2, the "Gallery" application is used to manage and display media files stored in the media library of the electronic device. The "Gallery" application can be a system application or a third-party application. This application can implement the media file display method provided in the embodiments of this application.

[0130] In one possible implementation, new features can be added to the existing "Gallery" application, or existing features can be extended, so that the application can implement the methods provided in the embodiments of this application. In another possible implementation, a new "Gallery" application can be designed, which can access the media library stored on the electronic device to implement the methods provided in the embodiments of this application.

[0131] It should be understood that the application that can implement the methods provided in the embodiments of this application may also be other applications. The embodiments of this application do not limit the type, naming, etc. of the application that can implement the methods provided in the embodiments of this application.

[0132] The following description uses the "Gallery" application as an example to illustrate the media file display method provided in this application embodiment.

[0133] To better understand the embodiments of this application, the overall scheme of the embodiments of this application will be described below with reference to FIG3.

[0134] Referring to Figure 3, which is a schematic diagram of the overall scheme of an embodiment of this application, the implementation process of this embodiment includes two parts: background processing operation 310 and foreground processing operation 320. The "Gallery" application executes background processing operation 310 in background running mode. Background processing operation 310 is generally invisible to the user and can be executed without user intervention or participation. The "Gallery" application executes foreground processing operation 320 in foreground running mode. Foreground processing operation 320 is visible to the user; for example, it can receive user operations through the user interface and respond to user operations by displaying the response results on the user interface. In this embodiment, through background processing operation 310, character-related information and character relationships can be obtained based on media files in the media library. This character-related information and character relationship information is stored in a character database. Through foreground processing operation 320, media files in the media library can be displayed based on character relationships.

[0135] For example, as shown in Figure 4, background processing operation 310 may include the following steps:

[0136] Step 401: The electronic device (or "Gallery" application) identifies photos / videos in the media library to filter out those containing images of people.

[0137] In this step, AI models can be used to filter out photos / videos containing human figures.

[0138] Step 402: The electronic device (or "photo gallery" application) performs facial recognition on photos / videos containing images of people, identifying people with the same or similar facial features as the same person.

[0139] In this step, an AI model can be used to identify people.

[0140] Step 403: The electronic device (or "gallery" application) filters photos / videos associated with the identified person from the media library based on photos / videos containing that person.

[0141] Taking person A as an example, the media file collection formed by photos / videos associated with person A includes: photos / videos containing person A. Optionally, in addition to the above-mentioned photos / videos containing person A, it may also include photos / videos that meet one or more of the following conditions:

[0142] Condition 1-1: The photo / video was taken within the time period corresponding to the time of the photo / video containing person A. In other words, even if person A is not in the photo / video, the fact that the photo / video was taken within the time period corresponding to the time of the photo / video containing person A means that the photo / video may have been taken when person A participated in an activity. Therefore, the photo / video can be considered to be associated with person A, thereby increasing the richness of the media content.

[0143] The time period corresponding to the shooting time can be a time period centered on the shooting time with a duration of one hour. The value of the first duration can be preset. For example, if photo 1 contains person A and was taken at 10:00 AM on January 1, 2024, and photo 2 does not contain person A but was taken at 10:10 AM on January 1, 2024, then since the shooting time of photo 2 falls within the time period corresponding to the shooting time of photo 1, photo 2 can be considered associated with person A.

[0144] Conditions 1-2: Photos / videos taken at the same location as photos / videos containing person A. In other words, even if person A is not in the photo / video, the fact that the photo / video was taken at the same location as a photo / video containing person A means that the photo / video was taken at a place that person A may have been to. Therefore, the photo / video can be considered to be associated with person A, thereby increasing the richness of the media content.

[0145] Condition 1-3: Photos / videos that meet conditions 1-1 and 1-2 above.

[0146] It should be understood that the above are merely examples of several possible implementations for filtering photos / videos associated with person A based on photos / videos containing person A, and this application does not impose any limitations on this.

[0147] Optionally, for a group of people, the associated photos / videos can be identified. A group of people can include two or more people.

[0148] Taking a group of people, A and B, as an example, the media file collection formed by photos / videos associated with this group includes: photos / videos containing photos of A and B together. Optionally, in addition to the above-mentioned photos / videos containing photos of A and B together, it may also include photos / videos that meet one or more of the following conditions:

[0149] Condition 2-1: The photo / video was taken within the time period corresponding to the time of the photo / video containing the group of people. In other words, even if the photo / video does not contain the group of people, the fact that the photo / video was taken within the time period corresponding to the time of the photo / video containing the group of people means that the photo / video may have been taken when the group of people participated in an event. Therefore, the photo / video can be considered to be associated with the group of people, thereby increasing the richness of the media content.

[0150] Condition 2-2: The location of the photo / video is the same as the location of the photo / video containing the group of people. In other words, even if the group of people is not in the photo / video, the fact that the photo / video was taken at the same location as the photo / video containing the group of people means that the photo / video may have been taken at a place that the group of people has been to. Therefore, the photo / video can be considered to be related to the group of people, thereby increasing the richness of the media content.

[0151] Condition 2-3: Photos / videos that meet conditions 21- and 2-2 above.

[0152] It should be understood that the above are merely examples of several possible implementations for filtering photos / videos associated with a group of people, and this application does not limit this.

[0153] Step 404: The electronic device (or "gallery" application) generates information about the person based on the identified person.

[0154] Taking person A as an example, in one possible implementation, person A's information may include: person A's identifier, person A's facial feature information, a list of photos / videos containing person A, and a list of photos / videos associated with person A. Optionally, it may also include person A's annotation information, such as one or more of the following: person A's name, person A's role, person A's notes, etc. Optionally, it may also include a person's avatar. Here, a person's role is relative to another person, and can also be understood as the type of relationship between people. For example, person D's role (or relationship) relative to person A is: person D is person A's friend, colleague, family member, or mother, etc.

[0155] The identifier for Person A can be assigned by an electronic device (or a "photo gallery" application) to uniquely identify the identified person.

[0156] Among them, the facial feature information of person A was obtained by performing facial recognition on the person.

[0157] The person's portrait is generated based on a photo containing that person. For example, the image of the area containing the person's portrait in a photo can be cropped and used as that person's portrait.

[0158] This includes a list of photos / videos containing person A, as well as a list of photos / videos associated with person A. Each list includes unique identifiers for one or more photos / videos, such as their names or filenames. The list of photos / videos associated with person A may be the same as the list containing photos / videos containing person A, or it may contain more photos / videos than the list containing photos / videos containing person A, depending on the algorithm (i.e., the method used to determine the media files associated with a person) and / or the attributes of the photos / videos in the media library (e.g., shooting time, shooting location, etc.).

[0159] Optionally, the information related to the person can be a table, list, file, or other data structure, which is not limited in this application.

[0160] Table 1 shows a tabular format of information about people, also known as a list of people.

[0161] Table 1: List of Characters (Character-Related Information)

[0162] In Table 1, taking Person A as an example, "Person A's ID" represents Person A's identifier; "Face Feature Information 1" can be a 128-dimensional floating-point vector or a 50-dimensional integer vector, depending on the face feature extraction method and / or accuracy requirements; "Avatar A" can be the identifier or name of Person A's avatar, or other information that can uniquely identify a person's avatar, and all avatars of people can be stored in another table or file; "Photo / Video List 1" includes the identifier information of one or more photos / videos containing Person A; "Photo / Video List 2" includes the identifier information of one or more photos / videos associated with Person A, and Photo / Video List 1 may be a subset of Photo / Video List 2.

[0163] The character name and role can be set by the user. The method for setting character names and roles can be found in the relevant content below. Taking character A as an example, after the user sets the name of character A, the electronic device can add the user-set name of character A to Table 1. As another example, after the user sets the role of character A relative to character B, the electronic device can add the role of character A relative to character B to the "Character Role" corresponding to character A in Table 1, and add the role of character B relative to character A to the "Character Role" corresponding to character B in Table 1. A character can have one or more roles. For example, the roles of character A could include: character A is character B's friend, character A is character C's colleague, etc.

[0164] It should be understood that Table 1 can be split into multiple tables, and this application does not limit this.

[0165] In other embodiments, for each combination of characters, the relevant character information corresponding to each combination of characters can be determined.

[0166] Table 2 shows a tabular format of person-related information, used to store the person-related information corresponding to different combinations of people.

[0167] Table 2: List of Character Combinations (Character-Related Information)

[0168] In Table 2, taking a combination of people A and B as an example, "People A, People B" represents a combination of people A and B, including the identifiers of people A and B, or the identifier of the combination of people A and B. "Avatar A+B" can be the identifier or name of the avatar of the combination of people A and B, or other information that can uniquely identify an avatar. All avatars can be stored in another table or file. The avatar can be generated based on a photo containing people A and B, and the avatar can be a group photo of people A and B. "Photo / Video List 10" includes the identifier information of one or more photos / videos containing people A and B. "Photo / Video List 11" includes the identifier information of one or more photos / videos associated with the combination of people A and B. Photo / Video List 11 may be a subset of Photo / Video List 12.

[0169] It should be understood that Table 2 can be split into multiple tables, and this application does not limit this.

[0170] It should be understood that Table 2 and Table 1 can be combined into one table, and this application does not restrict this.

[0171] Step 405: The electronic device (or "Gallery" application) determines the relationships between people based on the people's relevant information.

[0172] Person relationships are used to reflect the connections between identified persons. For example, it can indicate whether there is a connection between person A and person B, and if so, the degree of connection. The degree of connection between persons can be represented by the degree of connection; the higher the degree of connection, the stronger the connection.

[0173] In one possible implementation, taking person A and person B as an example, if there are photos / videos of person A and person B together, or if person A and person B appear in one or more photos or videos at the same time, then it can be determined that person A and person B are related.

[0174] Taking person A and person B as an example, one possible implementation is to determine the degree of correlation between person A and person B based on the number of photos of person A and person B that exist simultaneously, and / or the number of videos of person A and person B that exist simultaneously.

[0175] For example, the correlation between person A and person B can be determined based on the number of photos of person A and person B together, as well as the number of photos of person A with other people. Taking the identified persons as including person A, person B, person C, and person D as an example, if the number of photos of person A and person B together is N1, the number of photos of person A and person C together is N2, and the number of photos of person A and person D together is N3, then the correlation between person A and person B is N1 / (N1+N2+N3), the correlation between person A and person C is N2 / (N1+N2+N3), and the correlation between person A and person D is N3 / (N1+N2+N3).

[0176] In another possible implementation, in addition to using the number of photos / videos featuring multiple individuals as a basis for determining relevance, the labeling information of the individuals can also be used as a basis for determining relevance. Optionally, the labeling information of individuals may include one or more of the following: the individual's name, the individual's role, and remarks. The labeling information of individuals can be set by the user; methods for setting the labeling information can be found in the relevant content below.

[0177] For example, when determining the correlation between other people and person A as the central person, the annotation information of other people can be used as one of the bases for determining the correlation. For instance, if the identified people include person A, person B, person C, and person D, and the number of photos of person A and person B together is N1, the number of photos of person A and person C together is N2, the number of photos of person A and person D together is N3, and person D is set to be a friend of person A or person D has a name set, then the correlation between person A and person B is N1 / (N1+N2+N3), the correlation between person A and person C is N2 / (N1+N2+N3), the correlation between person A and person D is N3 / (N1+N2+N3)+α, or the correlation between person A and person D is β*N3 / (N1+N2+N3). Here, α and β are correlation modifiers. Considering that the correlation coefficient calculated using the above method has a range of values ​​greater than or equal to 0 and less than or equal to 1, the value of α can be greater than 0 and less than 1, and the value of β can be greater than 1. Optionally, the values ​​of α and β can be preset, and this application does not impose any restrictions.

[0178] Optionally, the value of α can be greater than -1 and less than 0, that is, the value of α can be negative. This depends on whether the role of character D relative to character A is negative (or in a negative direction) or positive (or in a positive direction). If it is negative (for example, character D is noted as someone that character A dislikes), then the value of α is negative.

[0179] Optionally, β can also be greater than 0 and less than 1, depending on whether character D's role relative to character A is negative (or in a negative sense) or positive (or in a positive sense). If it is negative, then β is less than 1.

[0180] In one possible implementation, in addition to using the number of photos / videos of multiple people simultaneously as a basis for determining the degree of association, one or more of the following can also be used as criteria for determining the degree of association: whether they are contacts in the address book, whether they are friends on social applications, the frequency of calls, the frequency of interaction on social applications, etc. Taking the determination of the degree of association between person D and person A as an example, if person D is a contact in person A's address book, then the degree of association between person D and person A can be appropriately increased; for example, if person D is a friend of person A on social applications, then the degree of association between person D and person A can be appropriately increased; for example, if person D has a high frequency of calls with person A, then the degree of association between person D and person A can be appropriately increased; for example, if person D has a high frequency of interactions with person A on social applications, then the degree of association between person D and person A can be appropriately increased. The above methods (through the degree of association adjustment) can be used to improve the degree of association, and this application does not impose any restrictions. Understandably, to protect user privacy, the "Gallery" app may, where permitted or authorized by the privacy policy, read a user's contacts, call logs, friend lists from social media apps, or conversation logs from social media apps.

[0181] Optionally, the moderating values ​​for the relevance can be different for different roles. For example, if the relationship represented by role 1 is closer than that of role 2 (e.g., colleague), then the moderating value for role 1 is greater than that for role 2.

[0182] Optionally, after adjusting the correlation degree by the correlation degree adjustment amount, if the adjusted correlation degree is greater than 1, then the correlation degree is set to 1; if the adjusted correlation degree is less than 0, then the correlation degree is set to 0.

[0183] When a user has labeled a person, such as setting person D as a friend of person A, it indicates that the user believes that person D and person A have a close relationship. In this case, appropriately adjusting the association between person A and person D can better meet the user's intentions, satisfy the user's personalized needs, and thus improve the user experience.

[0184] In some embodiments of this application, when calculating the correlation between characters, a central character is selected, and the correlation between the central character and each other character is calculated. For example, in the example above, character A is selected as the central character, and the correlation between character A and character B, the correlation between character A and character C, and the correlation between character A and character D are calculated. In the embodiments of this application, characters that have a correlation relationship with the central character, or whose correlation with the central character is greater than 0, can be referred to as related characters of the central character.

[0185] In other embodiments, there may be multiple central figures, or the central figure may be a group of figures comprising at least two individuals. In this case, the correlation between the group of figures and other figures can be calculated according to the aforementioned correlation calculation principle. For example, the correlation between the group of figures and figure C can be determined based on the number of photos of the group of figures and figure C existing simultaneously, and / or the number of videos of the group of figures and figure C existing simultaneously.

[0186] Taking the identified individuals as including A, B, C, and D, with A and B as the central individuals, if the number of group photos of A, B, and C is M1, and the number of group photos of A, B, and D is M2, then the correlation between the combination of A and B and C is M1 / (M1+M2), and the correlation between the combination of A and B and D is M2 / (M1+M2).

[0187] Optionally, the character's tagging information can be used as a basis to determine the correlation degree. For specific implementation methods, please refer to the relevant content above. For example, if character D is set as a friend of both character A and character B, then the correlation degree between the combination of character A and character B and character D is M2 / (M1+M2)+α, or the correlation degree between the combination of character A and character B and character D is β*M2 / (M1+M2). Here, α and β are correlation degree adjustment parameters.

[0188] Optionally, one or more of the following can be used as criteria for determining relevance: whether they are contacts in the address book, whether they are friends in social applications, the frequency of calls, the frequency of interaction in social applications, etc.

[0189] It should be understood that the above example only uses two central figures as an illustration, and the calculation principle can be applied to cases with a larger number of central figures.

[0190] Considering that users may change the central figure or increase or decrease the number of central figures while using the "Gallery" application, making it possible that the central figure is any one of the identified figures or any combination of figures, in one possible implementation, the electronic device (or "Gallery" application) can determine the correlation between each central figure and other figures, using each figure and each combination of figures as the central figure, so that the relationships between figures can be obtained in a timely manner when the user changes the central figure.

[0191] Electronic devices (or "gallery" applications) can store person relationship information as the degree of association between people, with each person and each combination of people as the central figure. For example, person relationship information can include the identifiers of the central figure and related figures, as well as the degree of association between the central figure and related figures.

[0192] Optionally, the relationship information can be stored in file format, table format, or other data structures; this application does not impose any restrictions. For example, taking the identified persons as including Person A, Person B, Person C, and Person D as an example, the relationship information may include:

[0193] Centered on character A: [<ID A,ID B> [Relevance], [<ID A,ID C> [Relevance], [<ID A,ID D> [Relevance]

[0194] Centered on character B: [<ID B,ID A> [Relevance], [<ID B,ID C> [Relevance], [<ID B,ID D> [Relevance]

[0195] Centered on character C: [<ID C,ID A> [Relevance], [<ID C,ID B> [Relevance], [<ID C,ID D> [Relevance]

[0196] Centered on character D: [<ID D,ID A> [Relevance], [<ID D,ID B> [Relevance], [<ID D,ID C> [Relevance]

[0197] Centered on Person A and Person B: [<(ID A,ID B),ID C>, correlation], [<(ID A,ID B),ID D>, correlation];

[0198] Centered on Person A and Person C: [<(ID A,ID C),ID B>, correlation], [<(ID A,ID C),ID D>, correlation];

[0199] Centered on characters A and D: [<(ID A,ID D),ID B>, correlation], [<(ID A,ID D),ID C>, correlation];

[0200] Centered on characters B and C: [<(ID B,ID C),ID A>, correlation], [<(ID B,ID C),ID D>, correlation];

[0201] Centered on characters B and D: [<(ID B,ID D),ID A>, correlation], [<(ID B,ID D),ID C>, correlation];

[0202] Centered on characters C and D: [<(ID C,ID D),ID A>, correlation], [<(ID C,ID D),ID B>, correlation];

[0203] With person A, person B, and person C as the central figures: [<(ID A,ID B,ID C),ID D>, correlation];

[0204] With characters A, B, and D as the central characters: [<(ID A,ID B,ID D),ID C>, correlation];

[0205] With characters A, C, and D as the central characters: [<(ID A,ID C,ID D),ID B>, correlation];

[0206] Centered on characters B, C, and D: [<(ID B,ID C,ID D),ID A>, correlation].

[0207] Optionally, items with a correlation degree of 0 in the above-mentioned character relationship information can be deleted to reduce storage overhead.

[0208] Background processing operations can be executed according to a set cycle, or when the electronic device is idle (e.g., when the screen is off, or at night), or when a large number of media files such as photos / videos are added or removed; this application does not impose any restrictions. In some other embodiments, the user interface of the "Gallery" application can be set with a virtual button for triggering the execution of the process shown in Figure 4 above. When the virtual button is triggered, the electronic device (or the "Gallery application") can execute the process shown in Figure 4.

[0209] Once the "Gallery" application is launched, it can display the relationships between people and the media files associated with the central person on the application's user interface, based on information about the person and their relationships.

[0210] Figure 5 illustrates an example of opening a "Gallery" application, where the application displays relationships between people and media files associated with a central person through its user interface. As shown, the main page 10 of the electronic device displays icons for multiple applications, including the "Gallery" application icon, which stores a large number of photos, videos, and other media files. When the user clicks the "Gallery" application icon, the electronic device can display the homepage 20 corresponding to the tab named "Discover" (hereinafter referred to as the "Discover" homepage 20).

[0211] It should be understood that when a user clicks the icon of the "Gallery" application, the electronic device may also display the homepage corresponding to the tab named "Photos," the tab named "Albums," or the tab named "Moments," depending on the page presented by the application when the user last exited the application. If the electronic device does not display the "Discover" homepage 20, it can switch to the "Discover" homepage 20 in response to the user clicking the tab named "Discover."

[0212] The "Discover" homepage 20 includes one or more options. For example, Figure 5 shows an option named "People" and an option named "Location." Each option corresponds to a dimension for displaying media files. For instance, the "People" option displays media files based on relationships between people, while the "Location" option displays media files based on the shooting location. The "People" option area can display the avatars of one or more people. These people are identified by the electronic device (or the "Gallery" application) through background processing based on media files in the media library. A possible implementation method can be referred to the process shown in Figure 4.

[0213] Optionally, in the "People" section, the portrait of the central person is displayed first, followed by portraits of related people in descending order of their relevance to the central person. The central person is one of the people identified by the electronic device (or "Gallery" application) based on its media library.

[0214] Optionally, a person can be selected from the identified individuals as the default center person in the following ways:

[0215] Method 1: If a photo containing a person was taken with the front-facing camera, then that person can be identified as the central figure. Since selfies are usually taken with the front-facing camera, and the person in a selfie is generally the user of the electronic device, the central figure identified using this method is likely the user of the electronic device.

[0216] Among the photo's attributes are shooting mode-related attributes, which describe the shooting mode of the photo, such as whether the photo was taken with the front-facing camera, whether it is a video photo, or whether it was taken with a large aperture.

[0217] Method 2: If a photo containing a person is taken with the front-facing camera and the number of such photos exceeds a set threshold, then that person is identified as the central person.

[0218] Method 3: If the number of photos containing a certain person is higher than the number of photos containing other people in the photos taken with the front-facing camera, then the person with the most photos can be identified as the central person.

[0219] Considering that selfies may be solo shots, group photos, or solo selfies of people other than the user of the electronic device, but generally there are more solo selfies of the user of the electronic device, this method can more likely identify the user of the electronic device as the central person.

[0220] Method 4: If the number of photos containing a certain person is higher than the number of photos containing other people, then that person can be identified as the central person.

[0221] It should be understood that the above methods for determining the default central figure are merely possible examples, and this application does not limit them.

[0222] After identifying one of the multiple identified individuals as the default central individual, the associated individuals corresponding to the central individual can be obtained based on the individual relationship information. The avatars of the central individual and the associated individuals can be obtained based on the individual information (e.g., Table 1), and these avatars can be displayed in the "Individuals" option area.

[0223] When a user clicks the "People" option (for example, clicking anywhere within the "People" option area can serve as an example of the first user action), the electronic device displays the "People" main page 30 (which can serve as an example of the first page). The "People" main page 30 displays the person's avatar and relationships, as well as photos / videos associated with the central person.

[0224] It should be understood that the above is merely an illustrative example of one method for displaying the "People" homepage, and this application does not limit this approach. For example, in some other embodiments, when the page tab named "Discover" is clicked, the "People" homepage is displayed; that is, the "People" homepage can serve as the homepage of the "Discover" page. As another example, when the page tab named "Photos" is clicked, the "People" homepage is displayed; that is, the "People" homepage can serve as the homepage of the "Photos" page. Yet another example is that a new page tab, such as a page tab named "People," can be added below the homepage of the "Gallery" application; when this new page tab is clicked, the "People" homepage is displayed. Of course, the "People" homepage can also be opened via voice command.

[0225] The following section provides a detailed explanation of the "Character" main page, referring to Figures 6a and 6b.

[0226] Referring to Figures 6a and 6b, which are schematic diagrams of a "Character" main page according to an embodiment of this application, the "Character" main page shown in Figures 6a and 6b (which can serve as an example of a first page) includes a character relationship display area 610 and a media file display area 620. The "Character" main page shown in Figure 6b may also include a themed photo album display area 630. Photos can be extracted and organized based on dimensions such as shooting time and content to generate an album. This album can be called a themed album, a moment album, or a story collection, etc.

[0227] The character relationship display area 610 displays the avatar of the central character (which can be used as an example of the first character) and the avatars of related characters (which can be used as examples of the first related characters), as well as the degree of relationship between the related characters and the central character.

[0228] In one possible implementation, the character relationship display area 610 may include a first display area 611 and a second display area 612. The first display area 611 displays the portrait of the central character (represented in the diagram as a circle containing the letter A) and the portraits of the first group of related characters (represented in the diagram as circles containing letters such as B). The second display area 612 displays the portraits of the second group of related characters (represented in the diagram as circles containing letters such as G). The first and second groups of related characters are each a subset of the related characters corresponding to the central character, and there is no overlap between the first and second groups of related characters.

[0229] The correlation between related figures in the second display area and the central figure is less than the correlation between related figures in the first display area and the central figure. In other words, the first display area is used to display related figures with a high correlation to the central figure, and the second display area is used to display related figures with a low correlation to the central figure. Due to the size limitation of the first display area, it cannot display too many figures. Therefore, a maximum number of related figures can be predefined in the first display area. If the number of related figures corresponding to the central figure exceeds this maximum, these related figures can be divided into a first group and a second group according to their correlation, from highest to lowest. The number of related figures in the first group does not exceed the maximum number, and the correlation between each figure in the first group and the central figure is no less than the correlation between any figure in the second group and the central figure. The figures of the first group are displayed in the first display area 611, and the figures of the second group are displayed in the second display area 612.

[0230] In the first display area 611, the portrait of the central figure is located in the center, and the portraits of related figures can be distributed around the portrait of the central figure, for example, arranged in a ring around the central figure.

[0231] Optionally, the position and size of the central figure's portrait remain unchanged. The position of a related figure's portrait is related to the degree of correlation between that related figure and the central figure; or the size of a related figure's portrait is related to the degree of correlation between that related figure and the central figure; or the position and size of a related figure's portrait are related to the degree of correlation between that related figure and the central figure. Specifically, within the first display area, the distance between the portraits of the first group of related figures and the portrait of the central figure is positively correlated with the degree of correlation between the first group of related figures and the central figure; or, the size of the portraits of the first group of related figures is positively correlated with the degree of correlation between the first group of related figures and the central figure; or, both the distance between the portraits of the first group of related figures and the portrait of the central figure, and the size of the portraits of the first group of related figures, are positively correlated with the degree of correlation between the first group of related figures and the central figure. For example, the central figure's portrait is the largest, while the portraits of related figures are smaller than the central figure's portrait. The lower the correlation between the related figures and the central figure, the smaller the portraits of the related figures are. Another example is that the central figure's portrait is located in the middle of the first display area, while the portraits of related figures are distributed around the central figure's portrait. The lower the correlation between the related figures and the central figure, the farther away the portraits of the related figures are from the central figure's portrait.

[0232] In other embodiments, the position and size of the central character's portrait remain unchanged, as do the positions and sizes of the associated characters' portraits, but the size of the associated characters' portraits is smaller than that of the central character's portrait. In still other embodiments, the position and size of the central character's portrait remain unchanged, the position of the associated characters' portraits remains unchanged, and the size of the associated characters' portraits is related to the degree of association; for an associated character, the lower its degree of association with the central character, the smaller its portrait size.

[0233] It is understandable that the arrangement of the portraits of the central figure and related figures can also be in other ways, and this application does not restrict that.

[0234] Understandably, other methods can also be used to represent the degree of connection between related individuals and the central individual. For example, the degree of connection can be represented by the transparency of the avatars; the higher the degree of connection, the lower the transparency of the avatars. Alternatively, the degree of connection can be represented by the different colors of the avatars; the higher the degree of connection, the darker the color ring around the avatars. Or, the degree of connection value can be displayed around the avatars of the related individuals.

[0235] Optionally, the first display area 611 may also display annotation information (such as name and / or role) of the central character. Optionally, the annotation information of the central character may be displayed in the central character's portrait display area, or around the central character's portrait. For example, in Figure 6b, the central character's role "I" is displayed below the central character's portrait.

[0236] Optionally, the first display area 611 may also display annotation information for related individuals. Optionally, the annotation information for a related individual may be displayed in the image display area of ​​that related individual, or around the image of that related individual.

[0237] In the second display area 612, the avatars of associated persons can be arranged in rows, for example, in a single row. In other embodiments, the second display area can be located to the left or right of the first display area, and the height of the second display area is greater than its length. Accordingly, the avatars of associated persons in the second display area can be arranged in columns, for example, in a single column.

[0238] Optionally, the portraits of related characters in the second display area 612 are the same size.

[0239] Optionally, in the second display area 612, users can view more related character avatars by swiping left or right.

[0240] Optionally, the second display area 612 can also display annotation information for related individuals. Optionally, the annotation information for a related individual can be displayed in the image display area of ​​that related individual, or around the image of that related individual. The annotation information for the central individual and the annotation information for related individuals can be set by the user; the setting method can be found in the relevant content below.

[0241] Optionally, the portraits of related figures in the second display area 612 can be arranged in descending order of the degree of correlation between the related figures and the central figure.

[0242] In one possible implementation, the avatars of the central character and related characters can be implemented using components (such as controls). These components can respond to user actions and perform corresponding processing operations. For example, the avatars of the central character and related characters could respond to a long-press operation, allowing users to set character annotation information through interaction; another example is that the avatars of related characters could respond to a click operation, allowing users to replace the central character with that related character; yet another example is that the avatars of related characters could respond to a drag operation, allowing users to add a related character as the central character. The implementation methods for these functions can be found in the relevant content below.

[0243] In another possible implementation, the character relationship display area only includes the first display area, that is, only the avatar of the central character and the avatars of related characters who are highly related to the central character. Optionally, the degree of relationship between the related characters and the central character can be reflected by the size of the related characters' avatars and / or the distance between them and the central character's avatar.

[0244] In one possible implementation, the first display area 611 also includes a "followed person" area, which displays the avatar of a temporarily followed person. This person can be one of the related people corresponding to the central person, or another person. That is, the avatar of the person is only displayed in this area when certain conditions are met.

[0245] Optionally, the profile picture of the person being followed will be displayed in the following situations:

[0246] Scenario 1: When a person (which can be an example of a third person) is detected looking at an electronic device, the person's avatar is displayed in the area of ​​interest. This person can be one of the associated persons corresponding to the central person.

[0247] Some electronic devices are equipped with cameras (e.g., TrueDepth cameras) for screen gaze detection. These cameras can detect whether someone is looking at the screen and capture facial images when someone is looking at the screen. In this embodiment, when someone is detected looking at the screen of the electronic device, the electronic device can perform face recognition on the facial image captured by the camera. The extracted facial feature information is compared with the facial feature information of each person in the person-related information (e.g., Table 1). If the extracted facial feature information matches the facial feature information of that person (e.g., one of the people in Table 1), then it is determined whether that person is a related person of the current central person based on the person relationship information. If so, then the person's avatar is displayed in the area of ​​the person being watched.

[0248] Using this method, when the central person is the user of the electronic device, and one of the user's associated persons is looking at the screen of the electronic device, the avatar of that person can be displayed in the area of ​​the person being watched, thereby increasing the fun and improving the user experience.

[0249] Scenario 2: When an increase in photos / videos containing a certain person (which can be an example of a third person) is detected, or when an increase in photos / videos containing that person is detected and the number of increases is greater than or equal to a threshold, the person's avatar will be displayed in the area of ​​the person being monitored.

[0250] For example, when photos and / or videos increase significantly, electronic devices can identify the new photos / videos. If the identified people include a related person of the current central person (e.g., the related person is a third person among the related people of the current central person), and the number of photos / videos containing the related person is greater than or equal to a threshold, then the image of the related person is displayed in the area of ​​people to be followed to attract the user's attention, increase interest, and thus improve the user experience.

[0251] Understandably, this third person may not be a related person to the currently featured person. In other words, if the Gallery app detects a sudden and significant increase in the number of photos containing a third person, it can display that person's avatar in the featured person area.

[0252] Scenario 3: When no new photos containing a certain person (which can be used as an example of a third person) are detected within the second time period, the person's avatar is displayed in the area of ​​people to be followed to attract the user's attention and thus improve the user experience.

[0253] It should be understood that the above are only some of the conditions that should be met for displaying the avatars of related persons in the area of ​​people being followed, and this application does not impose any restrictions on this.

[0254] Optionally, the size of the portrait displayed in the area of ​​the followed person can be predefined and will not be changed.

[0255] Optionally, the location of the area of ​​interest for a particular character can be predefined and will not change.

[0256] Optionally, the character's avatar displayed in the followed area can be implemented using a component (such as a control). If displaying the avatar in the followed area is not feasible, the component will not be displayed or will be invisible.

[0257] In one possible implementation, a virtual button can be set on the "Character" main page to perform one or more settings functions. Optionally, this virtual button can be implemented using a control. When the virtual button is triggered, the corresponding settings function can be performed.

[0258] Optionally, this setting function may include one or more of the following: refresh character relationships, edit character relationship display.

[0259] The "Refresh Character Relationships" function allows for user-driven updates of character-related and relationship information. Specifically, when the "Refresh Character Relationships" function is triggered, the electronic device (or the "Gallery" application) can obtain character-related and relationship information based on media files in the media library (see Figure 4 for the process). The device then updates the previously stored character-related information and relationship information using the newly obtained character-related information and relationship information.

[0260] Optionally, after the above update operations are completed, the "Character" main page can be updated based on the updated character relationship information and character-related information.

[0261] The "Edit Character Relationship Display" function allows users to adjust the character relationships displayed on the "Characters" main page according to their preferences. For example, the avatars of related characters in the first and second display areas can be swapped, or the order of related character avatars in the second display area can be adjusted. Specifically, when the "Edit Character Relationship" function is triggered (as an example of a fifth user action), the page enters edit mode. In edit mode, users can move related character avatars from the second display area to the first display area, or move related character avatars from the first display area to the second display area, or adjust the order of related character avatars in the second display area. Correspondingly, the "Gallery" application can respond to user actions and adjust the character relationships displayed on the "Characters" main page according to the user's preferences. The "Edit Character Relationship Display" operation does not change the character relationship information stored on the electronic device; that is, it does not change the relationship between related characters and the central character.

[0262] In one possible implementation, the electronic device (or "Gallery" application) can cache the content of the first and second display areas after the "Edit Person Relationship Display" operation. While the "Gallery" application is not closed, the content of the first and second display areas can remain unchanged based on this cached content; when the "Gallery" application is closed, the cache is released; when the "Gallery" application is restarted, the "Person" main page will be displayed based on the person relationship information and person-related information stored on the electronic device. Alternatively, the content of the first and second display areas after the "Edit Person Relationship Display" operation can be persistently saved. When the "Gallery" application is closed, this persistently saved information will not be released. Thus, when the "Gallery" application is restarted, the avatars of associated persons can be displayed in the first and second display areas based on this persistently saved information.

[0263] The following description uses the "Character" main page, which has a menu button, as an example to illustrate the specific implementation process of "Refresh Character Relationships" and "Edit Character Relationships".

[0264] Referring to Figure 7a, a "Settings" menu button 640 is located in the upper right corner of the "Character" main page. When the user clicks the "Settings" menu button 640, a first menu 650 is displayed on the screen of the electronic device in response. The first menu 650 includes a "Refresh" menu option and an "Edit" menu option.

[0265] When the user clicks the "Refresh" menu option in the first menu 650, the electronic device (or the "Gallery" application) updates the person-related information and relationship information according to the process shown in Figure 4. Furthermore, the "People" main page can be refreshed based on the updated person-related information and relationship information.

[0266] When a user clicks the "Edit" menu option in the first menu 650 (which can be used as an example of the fifth user operation), the "Character" main page enters edit mode in response. In edit mode, a "Delete" button (represented as a circle containing a minus sign in the image) is displayed at the avatar position of the associated character in the first display area, and an "Add" button (represented as a circle containing a plus sign in the image) is displayed at the avatar position of the associated character in the second display area.

[0267] As shown in Figure 7b, on the "Character" main page based on the editing mode shown in Figure 7a, when the user clicks the "Delete" button (displayed as "—" in the figure) on the avatar of the associated character E in the first display area (which can be used as an example of the sixth user operation), the avatar of the associated character E is moved to the second display area in response. Optionally, since the association between the associated character E and the central character is higher than the association between other associated characters in the second display area and the central character, the associated character E can be arranged in a more prominent position in the second display area, and the original associated character avatars in the second display area can be moved one position to the right.

[0268] As shown in Figure 7c, on the "Character" main page based on the editing mode shown in Figure 7a, when the user clicks the "Add" button (displayed as "+" in the figure) on the avatar of the associated character G in the second display area (which can be used as an example of the sixth user operation), the avatar of the associated character G is moved to the first display area in response. Within the second display area, the avatars of the remaining associated characters can be moved forward one position in sequence.

[0269] Optionally, when the number of related person avatars in the first display area reaches the maximum limit, the "Gallery" application can notify the user that the maximum limit has been reached and no longer allow the avatars of related people in the second display area to be moved to the first display area.

[0270] As shown in Figure 7d, on the "Character" main page based on the editing mode shown in Figure 7a, when the user drags the avatar of character H in the second display area and moves it to a position before the avatar of character G, in response, the avatars of character H and character G swap positions.

[0271] As shown in Figure 7e, on the "Character" main page based on the editing mode shown in Figure 7a, when the user drags the avatar of character H in the second display area and moves it to a position after the avatar of character K, in response, the avatar of character H is displayed after the avatar of character K, and the avatars of character I and character J move forward one position in sequence.

[0272] Optionally, after completing the "edit" operation, users can click the confirmation button 660 to restore the "Character" main page from edit mode to normal display mode.

[0273] In other embodiments, the "Character" main page can enter edit mode in other ways, and the avatars of associated characters in the first and second display areas can be swapped using a tossing operation (which can be used as an example of a sixth user operation). For example, when a user long-presses the avatar of associated character E in the first display area, they can enter edit mode. In edit mode, the positions of associated character avatars do not need to display the "delete" and "add" buttons. In edit mode, the user can "toss" the avatar of associated character E towards the second display area, and in response, the avatar of associated character E is moved to the second display area. As another example, when a user long-presses the avatar of associated character G in the second display area, they can enter edit mode. In edit mode, the user can "toss" the avatar of associated character G towards the first display area, and in response, the avatar of associated character G is moved to the first display area. The "tossing" operation is a relatively fast dragging operation with a short movement distance.

[0274] In some embodiments of this application, users are allowed to set or edit character information for the central character and / or associated characters. This setting or editing function includes, for example, one or more of the following:

[0275] Set the character name;

[0276] Setting up character roles can also be understood as setting up character relationships;

[0277] Set (or change) your character's avatar;

[0278] Merge similar characters;

[0279] Reduce the chances of appearing in the character relationship display area.

[0280] It should be understood that the above are merely examples of several possible setting and editing functions, and this application does not limit them.

[0281] When an electronic device (or "Gallery" application) supports the aforementioned settings and editing functions, a menu can be provided to offer users a variety of settings and editing options for easy selection and operation.

[0282] The following description uses a menu to provide users with several setting and editing functions, such as setting character names, character roles, changing character avatars, merging similar characters, and reducing the chances of characters appearing in the character relationship display area.

[0283] In one possible implementation, as shown in Figure 8a, when a user long-presses the avatar of a related character (as shown in Figure 8a) in either the first or second display area, a second menu 670 can pop up. The second menu 670 includes one or more of the following options: Set Character Name, Set Character Role, Set Character Avatar, Merge Similar Characters, Reduce Appearance Frequency. Optionally, while displaying the second menu 670, the avatar of the related character E in the first display area can remain normally displayed, while other content on the page can be faded or blurred, or its prominence can be enhanced to indicate to the user that settings are currently being applied to character E.

[0284] As shown in Figure 8b, when the user clicks the "Set Character Name" option in the second menu 670, a character name setting window pops up. This window may include controls such as an input box and a confirmation button. The user can enter the character name in the input box of this window and click the confirmation button to complete the character naming operation. The character name can be the character's full name, nickname, or other names used to name the character.

[0285] After setting the person's name, the "Gallery" application can update the name of that person in the People database. For example, it can add the name of the associated person E to the relevant information for person E, such as adding it to the "Person Name" field for person E in Table 1. On the main "People" page, the name of the associated person E can be displayed around the avatar of the associated person E.

[0286] Optionally, if the user has previously set a name for the associated person E, the Gallery application can update the name of the associated person E to the name set by the above naming operation after the above operation is completed.

[0287] As shown in Figure 8c, when the user clicks the "Set Character Role" option in the second menu 670, a character role setting window pops up. This window can include multiple candidate roles and a confirmation button. The user can select one or more candidate roles and click the confirmation button to complete the character role setting operation.

[0288] After completing the character setting, the "Gallery" application can update the character's role in the character database. For example, it can add the role of associated character E to the character information corresponding to character E, such as adding it to the "Character Role" corresponding to character E in the character information (as shown in Table 1). On the "Characters" main page, the role of associated character E can be displayed around the avatar of associated character E.

[0289] Optionally, if the user has previously set a role for associated person E, the Gallery application can update the role of associated person E to the role set through the naming operation after completing the above steps.

[0290] Optionally, since the role of the related person E is relative to the current central person, after setting the role of the related person E, you can also set the role of the current central person relative to the related person E, and add the current central person's role relative to the related person E to the "Person Role" section of the central person's related information (as shown in Table 1). For example, if the role of the related person E is set to "Related person E is a colleague of the current central person" through the above role setting operation, then the current central person's role can be set to "The current central person is a colleague of the related person E." As another example, if the role of the related person E is set to "Related person E is the son of the current central person" through the above role setting operation, then the current central person's role can be set to "The current central person is the father of the related person E."

[0291] It should be understood that the functions of setting character names and setting character roles can be combined into one option (for example, this option is called setting character information), and the functions of setting character names and character roles can be provided through a window.

[0292] As shown in Figure 8d, when the user clicks the "Set Profile Picture" option in the second menu 670, a profile picture setting window pops up. This window displays multiple photos, including the associated person E. Specifically, these photos can be photos from the "Portrait Photo / Video" list corresponding to the associated person E stored in the person database. The user can select one photo from the multiple photos to use the profile picture of the associated person E in that photo as their new profile picture.

[0293] Optionally, after completing the above operations, the Gallery application can store the new avatar of the associated person E in the person's related information.

[0294] As shown in Figure 8e, when the user clicks the "Merge Similar People" option in the second menu 670, a similar people merging settings window pops up. This window can include the avatars of candidate merging people and a confirmation button. There can be one or more candidate merging people. These candidates have a high degree of facial feature similarity to the associated person E, and may be the same person. This could be due to unclear images of people in some photos or videos, or the person being in profile or having their face partially obscured, causing facial recognition errors. Taking candidate merging people including person E1 and person E2 as an example, the facial feature information of person E1 is different from that of associated person E, but the similarity is high (e.g., above a set threshold). Similarly, the facial feature information of person E2 is different from that of associated person E, but the similarity is high. The user can select one or more avatars from the multiple candidate avatars and click the confirmation button to complete the similar people merging operation (this can be used as an example of the eighth user operation).

[0295] Based on the merging of similar people, the "Gallery" application updates the person-related information and relationship information in the people database.

[0296] Taking the example of a user choosing to merge person E1 (which can be an example of a second candidate for merging persons) with person E (which can be an example of a second person), the "Gallery" application can add the media file identifiers contained in the "Portrait Photo / Video List" corresponding to person E1 from the person-related information (e.g., Table 1) to the "Portrait Photo / Video List" corresponding to person E, and add the media file identifiers contained in the "Associated Photo / Video List" corresponding to person E to the "Associated Photo / Video List" corresponding to person E. Then, it deletes all related information corresponding to person E1 (e.g., including person identifier, facial feature information, person name, person role, person avatar, etc.). Regarding person relationship information, the "Gallery" application can, based on the merged person-related information, redetermine and update the correlation between person E and other persons (including the current central person), and redetermine and update the associated persons of the current central person (the updated associated persons can be an example of a fifth associated person) and the correlation with those associated persons.

[0297] If the relevance between related person E and the current central person changes after merging similar people, the Gallery application can update the display of related person E's avatar based on the updated relevance between related person E and the current central person. For example, it can update the distance between related person E and the central person's avatar, and / or update the size of related person E's avatar.

[0298] If the first or second display area contains the portrait of person E1 before the similar person merging is performed, then the portrait of person E1 in the first and second display areas will be deleted after the similar person merging is completed.

[0299] Figure 8e above illustrates the example of selecting a related person of the current central person and merging one or more candidate mergeable persons with that related person. A similar method can also be used to select a central person and merge one or more candidate mergeable persons with that central person. Specifically, the electronic device (or "Gallery" application) responds to a seventh user action (e.g., long-pressing the central person's avatar, selecting the option to merge similar people in the pop-up menu, and selecting the first candidate mergeable person in the pop-up similar people merging settings window), merges the media files associated with the first candidate mergeable person with the media files associated with the central person, updates the related persons corresponding to the central person based on the merged media files, resulting in a fourth related person; the electronic device refreshes the page, and the refreshed page (which can serve as an example of a fourth page) includes a person relationship display area and a media file display area. The person relationship display area shows the avatars of the central person and the fourth related person, as well as the degree of association between the fourth related person and the central person; the media file display area shows the merged media files.

[0300] As shown in Figure 8f, when the user clicks the "Reduce Appearance Chance" option in the second menu 670, a prompt window pops up, asking the user to confirm reducing the appearance chance of associated person E. After the user confirms (which can be used as an example of a fourth user operation), the avatar of associated person E is deleted from the first display area. The "Gallery" application reduces the correlation between associated person E and the current central person, for example, by setting it to zero or below a set threshold, to ensure that the avatar of associated person E will not appear in the first display area before the next update cycle of person relationship information arrives.

[0301] Figures 8a to 8f above illustrate the setting of associated characters as an example. This embodiment also allows users to set a central character. The method for setting a central character is basically the same as the method for setting associated characters, except that the function for setting a central character does not include a function to reduce the chance of its appearance. For example, when long-pressing the central character's avatar, the pop-up menu may include one or more of the following options: set character name, set character role, set character avatar, and merge similar characters.

[0302] In some embodiments of this application, users are also allowed to change the central figure so that they can browse media files associated with the new central figure.

[0303] In one implementation of changing the central figure, the electronic device (or "gallery" application) can refresh the "Figures" homepage in response to a user operation that sets an associated figure in the first display area as the central figure. In the refreshed "Figures" homepage, the avatar of the second figure is displayed in the central figure area of ​​the first display area within the figure relationship display area, the avatars of a group of associated figures (referred to as the first group of associated figures) corresponding to the second figure are displayed in the associated figures area of ​​the first display area, and the media files associated with the second figure are displayed in the media file display area.

[0304] Optionally, if the character relationship display area also includes a second display area, then the second display area displays the avatars of another group of related characters corresponding to the second character (referred to as the second group of related characters), and the degree of association between the second group of related characters and the second character is no higher than the degree of association between the first group of related characters and the second character.

[0305] Optionally, the aforementioned "user operation of setting an associated person in the first display area as the central person" can be clicking on the avatar of the second person, or dragging the avatar of the second person towards the central person area, for example, dragging the avatar of the second person into the central person area. This application does not limit this.

[0306] Referring to Figure 9, taking the change of the central figure from figure A to figure E as an example, the above operation can be implemented as follows: the user clicks on the avatar of figure E in the first display area (which can be used as an example of a second user operation). After receiving the user operation, the electronic device (or "gallery" application) responds by retrieving the associated figures of figure E (which can be used as an example of a second associated figure) and the degree of association between these associated figures and figure E from the person relationship information stored in the person database, based on the identifier of figure E. According to the degree of association, these associated figures are divided into a first group of associated figures and a second group of associated figures. The system retrieves information such as the avatars, names, and roles of the first and second groups of associated individuals from relevant information (e.g., Table 1). Based on the identifier of individual E, it retrieves the media files associated with individual E from the "Associated Photo / Video List". Then, based on the information obtained, it refreshes the "Individual" main page. In the refreshed page (which can serve as an example of the second page), the avatar of individual E is displayed in the central individual area of ​​the first display area, the avatars of the first group of associated individuals are displayed in the associated individuals area, the avatars of the second group of associated individuals are displayed in the second display area, and the media files associated with the second individual are displayed in the media file display area.

[0307] Optionally, character E's name, role, and other information can also be displayed in the position of character E's portrait.

[0308] Optionally, the name, role, and other information of the person can also be displayed in the avatar position of the first group of associated persons and / or the avatar position of the second group of associated persons.

[0309] Optionally, after setting Person E as the center person, Person E is marked as the center person so that when the Gallery application is reopened, Person E is displayed as the center person for the display of person relationships and media files.

[0310] In some embodiments of this application, users are also allowed to add a central character, such that the number of central characters is at least two.

[0311] In one implementation of adding a central figure, the electronic device (or "gallery" application) can respond to a user operation of adding a second figure as the central figure (the added central figure includes the first figure and the second figure), refresh the "Figures" main page, and in the refreshed "Figures" main page, display the avatars of the figure group in the central figure area of ​​the first display area of ​​the figure relationship display area. The figure group includes the first figure and the second figure. In the associated figures area of ​​the first display area, display the avatars of a group of associated figures (referred to as the first group of associated figures) corresponding to the figure group. In the media file display area, display the media files associated with the figure group.

[0312] The avatars of the group of characters can be stacked avatars of the first and second characters, or a group photo of the first and second characters; this application does not impose any restrictions.

[0313] Optionally, if the character relationship display area also includes a second display area, then the second display area displays the avatars of another group of related characters corresponding to the character combination (referred to as the second group of related characters), and the degree of association between the second group of related characters and the character combination is no higher than the degree of association between the first group of related characters and the character combination.

[0314] Optionally, the aforementioned "user operation of adding a second person as the central person" can be an operation of dragging the second person's avatar towards the central person area, such as dragging the second person's avatar into the central person area, which is not limited in this application.

[0315] When both the user operation for changing the central figure and the user operation for adding the central figure involve dragging an avatar, to differentiate them, the following rules can be established: If the avatar of a related figure is completely dragged into the central figure area and held for a period of time until a prompt to merge central figures is given, then lifting the finger to end the drag indicates that the related figure has been added as the central figure. Alternatively, if, during the process of dragging a related figure's avatar towards the central figure area, the finger is lifted to end the drag when a portion of the related figure's avatar enters the central figure area, this indicates that the related figure has been replaced as the central figure; or, if, during the process of dragging a related figure's avatar towards the central figure area, the avatar of the related figure is completely dragged into the central figure area, and the finger is lifted to end the drag before a prompt to merge central figures is given, this indicates that the related figure has been replaced as the central figure.

[0316] Referring to Figure 10, taking adding Person B as the central person as an example, the above operation process can include: the user drags Person B's avatar into the central person area (which can be seen as an example of a third user operation); after receiving this user operation, the electronic device (or "gallery" application) responds by retrieving the associated persons of the person combination (A+B) and the degree of association between these associated persons and the person combination (A+B) from the person relationship information stored in the person database, based on the identifiers of Person B (which can be seen as an example of a second person) and Person A (which can be seen as an example of a first person); and dividing these associated persons into a first group of associated persons and a second group of associated persons in descending order of association degree; and retrieving the associated persons from the person-related information (e.g., from the person-related information (e.g.) Obtain the avatars and other information of the first and second groups of related people from Table 1. Obtain the avatar of the person group (A+B) and the "List of Related Photos / Videos" corresponding to the person group from the relevant information (e.g., Table 2). Obtain the media files associated with the person group (A+B) based on the list. Then, based on the above information, refresh the "People" main page. In the refreshed page (which can be used as an example of the third page), display the avatar of the person group (A+B) in the central person area of ​​the first display area, display the avatars of the first group of related people in the related people area, display the avatars of the second group of related people in the second display area, and display the media files associated with the person group (A+B) in the media file display area.

[0317] It should be understood that more characters can be grouped together in the above manner, and that group can be used as the central character.

[0318] In some embodiments of this application, when the central figure includes multiple figures, the user can also delete one or more figures from the group of figures that serve as the central figure. For example, when a user clicks on the stacked figure avatars, a window pops up, expanding the stacked figure avatars. The user can select one or more avatars and confirm the deletion. In response, the electronic device (or the "Gallery" application) can delete the selected figures from the central figure and refresh the "Figures" main page. The refreshed page displays the updated central figure, the avatars of the associated figures, and the media files associated with the updated central figure.

[0319] The media file display method provided in the embodiments of this application will be described below with reference to the accompanying drawings.

[0320] In this embodiment, the media file display area shows media files (such as photos, videos, etc.) associated with the central character, or a list of media files, which includes thumbnails of photos and / or video frames. When a user clicks on a thumbnail of a photo in the list, the photo can be displayed in a pop-up window based on its actual size for the user to view.

[0321] Optionally, the thumbnails of photos / videos in the media file display area can be displayed in chronological order of their capture time by default.

[0322] Optionally, you can view more photo / video thumbnails by swiping up or down in the media file display area.

[0323] Optionally, media files can also be displayed according to other dimensions specified by the user through user interaction.

[0324] In some embodiments of this application, the "Gallery" application allows users to browse media files from different perspectives, such as viewing all photos or only viewing portrait photos.

[0325] Taking the page shown in Figure 11 as an example, the media file display area of ​​the "People" main page includes a "Filter" button 710. This button is a virtual button and can be implemented through controls. When this button is triggered, a third menu 711 can pop up. The third menu 711 can include one of the following options: Show all selected photos, or Show only people. When the "Show all selected photos" option is triggered, a list of all photos / videos associated with the central person is displayed in the media file display area. Taking the person-related information shown in Table 1 as an example, in this case, the corresponding photo / video list can be displayed according to the "Associated Photo / Video List" corresponding to the central person. When the "Show only people" option is triggered, a list of photos / videos containing portraits is displayed in the media file display area among all photos / videos associated with the central person. Taking the person-related information shown in Table 1 as an example, in this case, the corresponding photo / video list can be displayed according to the "Portrait Photo / Video List" corresponding to the central person.

[0326] Optionally, photos / videos can be displayed in chronological order of being captured.

[0327] It should be understood that the options in the third menu 711 can be replaced by other options, or can include more options, and this application does not limit this. For example, the options in the third menu 711 can be replaced by one or more of the following options, or further include one or more of the following options: display only photos, display only videos, display only portraits, display by time, display by location, display by shooting mode, display by object, etc.

[0328] In other embodiments of this application, the "Gallery" application allows users to browse media files by different content categories, for example, allowing users to browse media files based on the dimension of photo / video tags. The attribute information of photos / videos may include tags that indicate the category to which the content of the photos / videos belong. These tags may be obtained based on clustering or other semantic analysis methods. For example, by clustering photos / videos, one or more of the following tags may be obtained: travel, food, pets, swimming, cycling, etc.

[0329] Figure 12 illustrates a schematic diagram of media file tab browsing based on media files. Referring to Figure 12, the media file display area of ​​the "People" main page includes one or more category label buttons. These category label buttons are virtual buttons and can be implemented using controls. Each category label button corresponds to a label in the media file. Text or icons can be displayed on the category label buttons to indicate the label corresponding to that button. For example, in Figure 12, the media file display area includes a "Label 1" button 720 and a "Label 2" button 730. The "Label 1" button 720 corresponds to the label "Travel," and the "Label 2" button 730 corresponds to the label "Food." These labels are obtained by clustering photos / videos associated with the central person. When the "Label 1" button 720 (which can be used as an example of the first virtual button) is triggered, a list of photos / videos tagged "Travel" associated with the central person can be displayed in the media file display area; when the "Label 2" button 730 (which can be used as an example of the first virtual button) is triggered, a list of photos / videos tagged "Food" associated with the central person can be displayed in the media file display area.

[0330] Optionally, photos / videos can be displayed in chronological order of being captured.

[0331] It should be understood that the above are merely examples illustrating a few possible labels, and this application does not limit them.

[0332] In other embodiments of this application, the "Gallery" application can combine a map to show users the geographical distribution of media files and allow them to browse media files using tags.

[0333] Figures 13a and 13b illustrate a schematic diagram of media file display combined with a map. As shown in Figure 13a, the media file display area on the "Character" main page includes a virtual button 740 (which can be used as an example of a second virtual button), which can be implemented using controls. When the virtual button 740 is triggered, the screen refreshes, displaying a map album page 40 (which can be used as an example of a sixth page). The map album page 40 includes a map display area 41, and optionally, a media file display area 42. The map display area 41 displays a map, and the media file display area 42 displays a list of media files associated with the central character.

[0334] The virtual button 740 can display text or icons to indicate that the virtual button is used to trigger a map display of the geographical distribution of shooting locations for media files. For example, the map button 740 can display the name of the first geographical location, such as the city name ("City A" as shown in the figure), street name, etc. The first geographical location is one of the shooting locations of the photos / videos associated with the central person. Optionally, the number of photos / videos taken at the first geographical location is greater than the number of photos / videos taken at other locations. For example, if there are three shooting locations for the photos / videos associated with the central person, and the number of photos / videos taken at the first geographical location is the largest, then the name of the first geographical location can be displayed on the virtual button 740. In another possible implementation, the virtual button 740 can display text such as "Map" or "Shooting Location Distribution".

[0335] The map displayed in map display area 41 can be roughly centered on the aforementioned first geographical location. Users can use multi-finger pinch, multi-finger zoom, drag and other operations to zoom out, zoom in and out, and move the map in map display area 41 to view the map or the geographical distribution of photos / videos associated with the central person according to their needs.

[0336] On the map in map display area 41, the locations where photos / videos associated with the central figure were taken can be marked to show users the geographical distribution of these locations. For example, at the location of a photo / video associated with the central figure, a thumbnail of the photo can be displayed, showing that the photo was taken at that location. For instance, as shown in Figure 13a, the locations where photos / videos associated with the central figure were taken include cities A, B, and C. On the map, thumbnails of photos are displayed at the locations of these three locations, with one city's thumbnail showing a photo taken in that city.

[0337] The map album page 40 can also display one or more primary virtual buttons, such as the category label buttons named "Label 1", "Label 2", "Label 3", and "Label 4" in Figure 13a. These primary virtual buttons are virtual and can be implemented using controls. Each primary virtual button corresponds to a label of a media file, and these labels are obtained by clustering photos / videos associated with the central figure. For example, the category label button named "Label 1" corresponds to the label "Travel", and the category label button named "Label 2" corresponds to the label "Food". The primary virtual buttons can display the name of the corresponding label or the icon of the corresponding label, which is not limited in this application.

[0338] Optionally, these primary virtual buttons can be displayed in the map display area 41 or in the media file display area 42; this application does not impose any restrictions.

[0339] As shown in Figure 13a, when a user clicks on the location of "City A" or a photo thumbnail at that location on the map displayed in the map display area, the electronic device (or the "Gallery" application) refreshes the screen in response. On the refreshed map album page (which can be used as an example of the seventh page), a list of photos / videos associated with the central figure and taken in "City A" is displayed. One or more secondary virtual buttons can also be displayed, such as the category label buttons named "Label A1," "Label A2," and "Label A3" in Figure 13a. These secondary virtual buttons are virtual buttons and can be implemented using controls. Each secondary virtual button corresponds to a tag in a media file. These tags are obtained by clustering photos / videos associated with the central figure and taken in "City A." For example, the category label button named "Label A1" corresponds to the tag "Food," and the category label button named "Label A2" corresponds to the tag "Swimming." The secondary virtual buttons can display the name or icon of the corresponding tag; this application does not limit this.

[0340] When a secondary virtual button is triggered, the map album page is refreshed. The media file display area on the refreshed map album page shows a list of photos / videos associated with the central person, with the shooting location being "City A" and having the corresponding tags. This allows users to browse photos / videos with a specific tag taken at a certain location, such as browsing food photos / videos taken in City A.

[0341] Referring to Figure 13b, when a user clicks the first-level virtual button named "Label 4" (which can be used as an example of the third virtual button), the electronic device (or the "Gallery" application) refreshes the screen display. On the refreshed map album page (which can be used as an example of the eighth page), the location distribution of photos / videos tagged "Label 4" (e.g., "Food") associated with the central person is displayed in the map display area. For example, as shown in Figure 13b, if the location of photos / videos tagged "Label 4" associated with the central person does not include "City A," then compared to before the refresh, "City A" is no longer marked on the map within the map display area, or the photo thumbnail is not displayed in the location of "City C." In this way, the location distribution of media files (or media files of the same content category) with a certain tag can be displayed on the map based on tags.

[0342] As shown in Figure 13b, on the refreshed map album page, in the media file display area, a list of photos / videos labeled "Label 4" is displayed among the photos / videos associated with the central person.

[0343] In other embodiments of this application, the "Gallery" application can combine a map to show users the geographical distribution of media files, and allow browsing of media files based on the people contained within them.

[0344] Figures 14a and 14b illustrate a schematic diagram of media file display combined with a map. As shown in Figure 14a, the media file display area on the "Character" main page includes a virtual button 740 (which can be used as an example of a fourth virtual button), which can be implemented using controls. When the virtual button 740 is triggered, the screen refreshes, displaying a map album page 50 (which can be used as an example of a ninth page). The map album page 50 includes a map display area 51, and optionally, a media file display area 52. The map display area 51 displays the map, and the media file display area 52 displays a list of media files associated with the central character.

[0345] On the map displayed in map display area 51, the locations where photos / videos associated with the central figure were taken can be marked to show users the geographical distribution of these locations. For example, at the location where a photo / video associated with the central figure was taken, a thumbnail of the photo can be displayed, showing that the photo was taken at that location.

[0346] The map album page 50 can also display one or more first-level virtual buttons, such as the first-level virtual buttons named "Person 1", "Person 2", "Person 3", and "Person 4" in Figure 14a. These first-level virtual buttons are virtual buttons and can be implemented using controls. Each first-level virtual button corresponds to the identifier of an associated person of the central person. For example, the first-level virtual button named "Person 1" corresponds to the identifier of Person 1, and the first-level virtual button named "Person 2" corresponds to the identifier of Person 2. Person 1 and Person 2 are associated persons of the central person. The first-level virtual buttons can display the corresponding person's avatar, name, or role information, which is not limited in this application.

[0347] Optionally, these primary virtual buttons can be displayed in the map display area 51 or in the media file display area 52; this application does not impose any restrictions.

[0348] As shown in Figure 14a, when a user clicks on the location of "City A" or a photo thumbnail at that location on the map displayed in the map display area, the electronic device (or "gallery" application) refreshes the screen in response. On the refreshed map album page (which can be used as an example of the tenth page), a list of photos / videos associated with the central person and taken in "City A" is displayed. One or more secondary virtual buttons can also be displayed. These secondary virtual buttons are virtual buttons and can be implemented using controls. Each secondary virtual button corresponds to an identifier for a person included in the photos / videos associated with the central person and taken in "City A." The person corresponding to the secondary virtual button is a subset of the people corresponding to the primary virtual buttons. The secondary virtual buttons can display the corresponding person's avatar, name, or role information, which is not limited in this application.

[0349] When a secondary virtual button is triggered, the map album page is refreshed. The media file display area on the refreshed map album page shows a list of photos / videos associated with the central person, taken in "City A", and containing the corresponding person. This allows users to browse photos / videos taken at a specific location that contain photos / videos of a specific person.

[0350] Referring to Figure 14b, when the user clicks the first-level virtual button named "Person 4" (which can be used as an example of the fifth virtual button), the electronic device (or the "Gallery" application) refreshes the screen display. On the refreshed map album page (which can be used as an example of the eleventh page), the location distribution of photos / videos containing Person 4 among the photos / videos associated with the central person is displayed in the map display area. For example, as shown in Figure 14b, the location of photos / videos labeled "Person 4" among the photos / videos associated with the central person does not include "City C." Therefore, compared to before the refresh, "City C" is no longer marked on the map within the map display area, or the photo thumbnail is not displayed at the location of "City C." In this way, the location distribution of media files containing a specific person can be displayed on the map based on that person.

[0351] As shown in Figure 14b, on the refreshed map album page, the media file display area shows a list of photos / videos associated with the central person, including photos / videos of person 4.

[0352] It should be understood that the above descriptions are merely exemplary examples of methods for displaying media files from the dimensions of shooting location, tags, and people. This application does not limit these methods. For example, media files can also be displayed from the dimensions of shooting location and shooting time, or media files can be displayed based on a combination of the above multiple dimensions.

[0353] In some embodiments of this application, if the "People" main page contains a themed album display area, then that themed album display area displays the themed albums associated with the central person. This application does not limit the method of generating themed albums.

[0354] Taking the "People" main page shown in Figure 6b as an example, the themed album display area includes the covers of three themed albums named "Themed Album 1", "Themed Album 2", and "Themed Album 3". When a user clicks on the cover of the themed album named "Themed Album 1", the electronic device can display the content of that themed album in response, such as playing the photos contained in that themed album.

[0355] Figures 15 and 16 are schematic diagrams illustrating the possible structures of devices provided in embodiments of this application. These devices can be used to implement the functions of the electronic devices in the above method embodiments, and thus also achieve the beneficial effects of the above method embodiments. In the embodiments of this application, the device can be the electronic device shown in Figure 1 or Figure 2, or it can be a module (such as a chip) applied to an electronic device.

[0356] As shown in Figure 15, device 1500 includes a processing unit 1510 and an interface unit 1520. Device 1500 is used to implement the functions of the electronic device in the above method embodiments.

[0357] Specifically, the interface unit 1520 receives a first user operation; the processing unit 1510 is used to respond to the first user operation and display a first page. The first page includes a character relationship display area and a media file display area. The character relationship display area displays the avatar of the first character and the avatar of the first associated character corresponding to the first character, as well as the degree of association between the first associated character and the first character. The first character, the first associated character, and the degree of association are determined based on the media files stored in the electronic device. The number of the first associated characters is at least one. The media file display area displays the media files associated with the first character.

[0358] A more detailed description of the processing unit 1510 and the interface unit 1520 can be obtained directly from the description in the method embodiment shown in the relevant drawings, and will not be repeated here.

[0359] As shown in FIG16, device 1600 may include: memory 1601, one or more processors 1602, and one or more computer programs (not shown in the figure). The above-mentioned devices may be coupled via one or more communication buses 1603. Optionally, when device 1600 is used to implement the methods performed by the electronic device provided in the embodiments of this application, device 1600 may further include a display screen 1604.

[0360] The memory 1601 stores one or more computer programs (code), and the one or more computer programs include computer instructions; one or more processors 1602 call the computer instructions stored in the memory 1601, causing the device 1600 to execute the method provided in the embodiments of this application. The display screen 1604 is used to display images, videos, application interfaces, and other related user interfaces.

[0361] In a specific implementation, memory 1601 may include high-speed random access memory and may also include non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 1601 may store an operating system (hereinafter referred to as the system), such as embedded operating systems like Android, iOS, Windows, or Linux. Memory 1601 can be used to store implementation programs of the embodiments of this application. Memory 1601 may also store network communication programs, which can be used to communicate with one or more additional devices, one or more user devices, or one or more network devices. One or more processors 1602 may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits used to control the execution of programs in the scheme of this application.

[0362] It should be noted that Figure 16 is only one implementation of the device 1600 provided in the embodiments of this application. In actual applications, the device 1600 may include more or fewer components, which is not limited here.

[0363] Based on the above embodiments and the same concept, this application also provides a computer-readable storage medium storing a computer program that, when run on a computer, causes the computer to perform the method performed by the electronic device in the above embodiments.

[0364] Based on the above embodiments and the same concept, this application also provides a computer program product, which includes a computer program or instructions. When the computer program or instructions are run on a computer, the computer causes the computer to perform the method performed by the electronic device in the above embodiments.

[0365] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0366] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in one or more blocks of the flowchart illustrations and / or one or more blocks of the block diagrams.

[0367] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means that implement the functions specified in one or more flowcharts and / or one or more block diagrams.

[0368] These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, such that the instructions, which execute on the computer or other programmable apparatus, provide steps for implementing the functions specified in one or more flowcharts and / or one or more block diagrams.

[0369] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

1. A method for displaying media files, characterized in that, Applied to electronic devices, including: Receive the first user's operation; In response to the first user operation, a first page is displayed. The first page includes a character relationship display area and a media file display area. The character relationship display area displays the avatar of the first character and the avatar of the first associated character corresponding to the first character, as well as the degree of association between the first associated character and the first character. The first character, the first associated character, and the degree of association are determined based on the media files stored in the electronic device. The number of the first associated characters is at least one. The media file display area displays the media files associated with the first character.

2. The method as described in claim 1, characterized in that, The character display area shows the degree of association between the first associated character and the first character, including: The distance between the profile picture of the first associated person and the profile picture of the first person is positively correlated with the degree of correlation between the first associated person and the first person; and / or, The size of the first associated person's portrait is positively correlated with the degree of association between the first associated person and the first person.

3. The method as described in claim 2, characterized in that, The first associated person's portrait is arranged in a ring around the first person's portrait.

4. The method according to any one of claims 1-3, characterized in that, Also includes: Receive a second user operation, the second user operation being used to replace the first person with a second person, the second person being one of the first associated persons; In response to the second user operation, a second page is displayed. The second page includes a character relationship display area and a media file display area. The character relationship display area displays the avatar of the second character and the avatar of the second associated character corresponding to the second character, as well as the degree of association between the second associated character and the second character. The second associated character and the degree of association are determined based on media files stored on the electronic device. The media file display area displays the media files associated with the second character.

5. The method as described in claim 4, characterized in that, The second user operation is: Click on the second character's avatar; or, Drag the second character's portrait to the area where the first character's portrait is located on the first page.

6. The method according to any one of claims 1-3, characterized in that, Also includes: Receive a third user operation applied to the avatar of the second person, the third user operation being used to combine the second person and the first person to obtain a first person combination, the second person being one of the first associated persons; In response to the third user's operation, a third page is displayed. The third page includes a character relationship display area and a media file display area. The character relationship display area displays the avatars of the first character group and the avatars of the third associated characters associated with the first character group, as well as the degree of association between the third associated characters and the first character group. The third associated characters and the degree of association are determined based on media files stored on the electronic device. The media file display area displays media files associated with the first character group.

7. The method as described in claim 6, characterized in that, The third user operation is as follows: Drag the second character's portrait towards the area where the first character's portrait is located.

8. The method according to any one of claims 1-3, characterized in that, Also includes: A fourth user action is received, which is applied to the avatar of a second person, and the fourth user action is used to reduce the chance of the second person appearing in the person relationship display area; wherein the second person is one of the first associated persons; In response to the fourth user action, the correlation between the second person and the first person is set to zero or less than a threshold, or the correlation between the second person and the first person is reduced, and the avatar of the second person is removed from the person relationship display area.

9. The method according to any one of claims 1-3, characterized in that, The first associated person includes a first group of associated persons and a second group of associated persons, and the degree of association between the second group of associated persons and the first person is no higher than the degree of association between the first group of associated persons and the first person; The character relationship display area includes a first display area and a second display area. The first display area displays the avatar of the first character and the avatars of the first group of related characters, and the second display area displays the avatars of the second group of related characters.

10. The method as described in claim 9, characterized in that, The second group of associated figures have the same avatar size, and / or the avatars of the second group of associated figures are arranged in rows or columns.

11. The method according to any one of claims 9-10, characterized in that, Also includes: Upon receiving a fifth user's operation, and in response to the fifth user's operation, enter edit mode; In the editing mode, a sixth user operation is received, and in response to the sixth user operation, the avatars of the second group of associated characters in the second display area are moved to the first display area, or the avatars of associated characters in the first display area are moved to the second display area.

12. The method according to any one of claims 1-3 and 8-11, characterized in that, Also includes: When a third person is detected looking at the electronic device, the third person's avatar is displayed on the first page.

13. The method according to any one of claims 1-3 and 8-11, characterized in that, Also includes: When the number of photos and / or videos containing a third person increases and the increase is greater than or equal to a threshold, the avatar of the third person is displayed on the first page.

14. The method according to any one of claims 1-3 and 8-11, characterized in that, Also includes: If no new photos containing a third person are detected within the first time period, the third person's avatar is displayed on the first page.

15. The method according to any one of claims 12-14, characterized in that, The third person is one of the first related persons.

16. The method according to any one of claims 1-3 and 8-11, characterized in that, Also includes: Receive a seventh user operation, the seventh user operation being used to merge the first candidate merged person with the first person; In response to the seventh user operation, the media file associated with the first candidate merged person is merged with the media file associated with the first person, and the associated person corresponding to the first person is updated according to the merged media file to obtain the fourth associated person; The fourth page is displayed, which includes a character relationship display area and a media file display area. The character relationship display area displays the avatars of the first character and the fourth associated character, as well as the degree of association between the fourth associated character and the first character. The media file display area displays the merged media files.

17. The method according to any one of claims 1-3 and 8-11, characterized in that, Also includes: Receive an eighth user operation, the eighth user operation being used to merge the second candidate merged person with a second person, the second person being one of the first associated persons; In response to the eighth user operation, the media file associated with the second candidate merged person is merged with the media file associated with the second person, the associated person corresponding to the first person is updated according to the merged media file to obtain the fifth associated person, and the person associated with the second person is updated according to the merged media file. The fifth page is displayed, which includes a character relationship display area and a media file display area. The character relationship display area displays the avatar of the first character and the avatar of the fifth associated character, as well as the degree of association between the fifth associated character and the first character. The media file display area displays the media files associated with the first character.

18. The method according to any one of claims 1-3 and 8-11, characterized in that, The media files associated with the first person include: photos and / or videos containing the first person; and one or more of the following: The photos / videos whose shooting time falls within the time period corresponding to the shooting time of the first photo and / or video, wherein the first photo and / or video is a photo and / or video containing the first person; Photos / videos taken at the same location as the first photo and / or video.

19. The method according to any one of claims 1-3 and 8-11, characterized in that, Also includes: The degree of association between the first associated person and the first person is set according to one or more of the following: The number of photos of the first associated person with the first person; The annotation information of the first associated person includes one or more of the following: name, role, and remarks; Is the first associated person a contact in the first person's address book? Whether the first associated person is a friend of the first person on a social application; The frequency of interaction between the first associated person and the first person, including phone calls and / or social application interactions.

20. The method according to any one of claims 1-19, characterized in that, The media file display area includes at least one virtual button, and each of the at least one virtual button corresponds to a tag. The tag is obtained by clustering photos and / or videos associated with the first person. The method further includes: When the first virtual button among the at least one virtual buttons is triggered, photos and / or videos with tags corresponding to the first virtual button from the photos and / or videos associated with the first person are displayed in the media file display area.

21. The method according to any one of claims 1-3 and 8-11, characterized in that, The media file display area includes a second virtual button, and the method further includes: When the second virtual button is triggered, the sixth page is displayed. The sixth page includes a map display area and a media file display area. The map display area displays a map, on which the location distribution of the shooting locations of the photos and / or videos in the first media file set is displayed. The media file display area displays a list of the photos and / or videos in the first media file set. The map display area or the media file display area also includes at least one primary virtual button. Each virtual button in the at least one primary virtual button corresponds to a tag, which is obtained by clustering photos and / or videos in the first media file set, which includes photos and / or videos associated with the first person.

22. The method as described in claim 21, characterized in that, Also includes: When the thumbnail of the photo corresponding to the first geographical location in the map display area is triggered, a seventh page is displayed. The seventh page includes a media file display area, which displays a list of photos and / or videos in a second media file set, and at least one secondary virtual button. The first geographical location is one of the shooting locations of the photos and / or videos associated with the first person. The second media file set includes photos and / or videos associated with the first person whose shooting location is the first geographical location. Each virtual button in the at least one secondary virtual button corresponds to a tag, which is obtained by clustering the photos and / or videos in the second media file set.

23. The method as described in claim 21, characterized in that, Also includes: When the third virtual button among the at least one primary virtual buttons is triggered, an eighth page is displayed. The eighth page includes a map display area and a media file display area. The map display area displays a map showing the location distribution of the shooting locations of the photos and / or videos in the third media file set. The media file display area displays a list of the photos and / or videos in the third media file set. The third media file set includes photos and / or videos associated with the first person that have the tag corresponding to the third virtual button.

24. The method according to any one of claims 1-3 and 8-11, characterized in that, The media file display area includes a fourth virtual button, and the method further includes: When the second virtual button is triggered, the ninth page is displayed. The ninth page includes a map display area and a media file display area. The map display area displays a map, on which the location distribution of the shooting locations of the photos and / or videos in the first media file set is displayed. The media file display area displays a list of the photos and / or videos in the first media file set. The map display area or the media file display area also includes at least one primary virtual button. Wherein, each virtual button in the at least one primary virtual button corresponds to one of the first associated persons, and the first media file set includes photos and / or videos associated with the first person.

25. The method as described in claim 24, characterized in that, Also includes: When the photo thumbnail corresponding to the first geographical location in the map display area is triggered, the tenth page is displayed. The tenth page includes a map display area and a media file display area. The map display area displays a map, and the location distribution of the shooting locations of the photos and / or videos in the first media file set is displayed on the map. The media file display area displays a list of photos and / or videos in the second media file set. The map display area or the media file display area also includes at least one secondary virtual button. Wherein, the first geographical location is one of the shooting locations of the photos and / or videos associated with the first person, the second media file set includes photos and / or videos associated with the first person whose shooting location is the first geographical location, each virtual button in the at least one secondary virtual button corresponds to one of the first associated persons, and the person is a person included in the photos and / or videos associated with the first person whose shooting location is the first geographical location.

26. The method as described in claim 24, characterized in that, Also includes: When the fifth virtual button among the at least one primary virtual buttons is triggered, an eleventh page is displayed. The eleventh page includes a map display area and a media file display area. The map display area displays a map showing the location distribution of the shooting locations of the photos and / or videos in the third media file set. The media file display area displays a list of photos and / or videos in the third media file set. The third media file set includes photos and / or videos of the person corresponding to the fifth virtual button, which are associated with the first person.

27. An electronic device, characterized in that, Includes units or modules for performing the method as described in any one of claims 1-26.

28. An electronic device, characterized in that, include: One or more processors are configured to perform the method as described in any one of claims 1-26.

29. A readable storage medium, characterized in that, The readable storage medium stores a program or instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1-26.

30. A chip system, characterized in that, Includes a processor for enabling a computer device to implement the method as described in any one of claims 1-26.

Images