Media file display method and equipment

Abstract

The invention discloses a media file display method and equipment, and relates to the technical field of communication. The method can be applied to the electronic equipment, can display the media file based on the character relationship, and is used for improving the user experience. The method comprises the following steps: receiving first user operation; in response to the first user operation, a first page is displayed, the first page comprises a character relationship display area and a media file display area, and the character relationship display area displays a head portrait of a first character and a head portrait of a first associated character corresponding to the first character, the method comprises the steps of obtaining at least one first associated person and the association degree between the first associated persons, determining the first persons, the first associated persons and the association degree on the basis of a media file stored in the electronic equipment, and determining the association degree between the first persons according to the first associated persons. The media file display area displays the media file associated with the first character.

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to a method and device for displaying media files. Background Art

[0002] With the continuous development of technology, terminal devices store more and more media files, which need to be managed and displayed through applications. Taking photo-type media files as an example, the "Gallery" application can manage and display media files such as photos taken by users.

[0003] How to improve the intelligence of the display of media files such as photos to provide a better user experience is a problem that needs to be solved at present. Summary of the Invention

[0004] The embodiments of the present application provide a method and device for displaying media files, which are used to display media files based on character relationships, thereby improving the intelligence of media file display and further enhancing user experience.

[0005] The embodiments of the present application can be applied to electronic devices. Specifically, the electronic device can be a non-folding screen mobile phone, a folding screen mobile phone, a wearable device (such as a smart watch, a smart bracelet, etc.), a tablet computer, a laptop computer, a smart screen, a vehicle terminal, a computer, a personal computer (PC), an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a virtual reality (VR) device / augmented reality (AR) device, an artificial intelligence (AI) device, or other terminal device with a display function.

[0006] In a first aspect, a media file display method is provided, which is applied to an electronic device, and the method includes: receiving a first user operation; in response to the first user operation, displaying a first page, the first page including a character relationship display area and a media file display area, the character relationship display area displays an avatar of a first character and an avatar of a first associated character corresponding to the first character, as well as a degree of association between the first associated character and the first character, the first character, the first associated character and the degree of association are determined based on media files stored in the electronic device, the number of the first associated characters is at least one, and the media file display area displays media files associated with the first character.

[0007] In the above implementation method, character relationships can be determined based on the media files in the media file library stored in the electronic device, and the character relationships can be displayed on the first page. On the one hand, this can enable users to understand the character relationships presented by the media files in the media file library, improve the intelligence of media file display, and thus improve user experience. On the other hand, it provides convenience for subsequent users to browse media files based on the character relationships.

[0008] In a possible implementation, the method further includes: determining a person in the selfie photo as the first person, or determining a person with the largest number of photos as the first person.

[0009] In one possible implementation, the character display area displays the degree of association between the first associated character and the first character, including: the distance between the avatar of the first associated character and the avatar of the first character is positively correlated with the degree of association between the first associated character and the first character; and / or, the size of the avatar of the first associated character is positively correlated with the degree of association between the first associated character and the first character.

[0010] In this implementation, since the size of the associated character's avatar and / or the distance between it and the avatar of the central character (the first character) is positively correlated with the degree of association, the user can intuitively understand the degree of association between the associated character and the central character, which provides convenience for subsequent users to browse media files based on character relationships.

[0011] In a possible implementation, the avatars of the first associated person are arranged around the avatar of the first person in a surrounding manner.

[0012] In this implementation, since the avatars of the related characters surround the central character (the first character), the character relationships can be displayed in the form of a "protagonist planet", allowing users to intuitively understand the character relationships.

[0013] A possible implementation method also includes: receiving a second user operation, the second user operation is used to replace the first character with a second character, the second character is one of the first associated characters; in response to the second user operation, a second page is displayed, the second page includes a character relationship display area and a media file display area, the character relationship display area displays the avatar of the second character and the avatar of the second associated character corresponding to the second character, as well as the degree of association between the second associated character and the second character, the second associated character and the degree of association are determined based on the media files stored in the electronic device, and the media file display area displays the media files associated with the second character.

[0014] In the above implementation method, by changing the central character, it is possible to select a new central character based on character relationships and browse the media files associated with the character. Compared with the related art of selecting a character from a character avatar list to browse the photos associated with the character, the above implementation method provides users with a way to select characters based on character relationships, thereby improving the user experience.

[0015] In a possible implementation, the second user operation is: clicking on the second person's avatar; or dragging the second person's avatar to the area where the first person's avatar is located on the first page.

[0016] A possible implementation method also includes: receiving a third user operation acting on the avatar of a second character, the third user operation being used to combine the second character and the first character to obtain a first character combination, the second character being one of the first associated characters; displaying a third page in response to the third user operation, the third page including a character relationship display area and a media file display area, the character relationship display area displaying the avatar of the first character combination and the avatar of the third associated character associated with the first character combination, as well as the degree of association between the third associated character and the first character combination, the third associated character and the degree of association being determined based on media files stored in the electronic device, and the media file display area displaying media files associated with the first character combination.

[0017] In the above implementation, by adding a central character, a character combination can be used as the central character, so that media files associated with the character combination can be displayed, thereby improving the flexibility of media file browsing.

[0018] In a possible implementation, the avatar of the first person combination is: a stacked display of the avatar of the first person and the avatar of the second person, or a group photo of the first person and the second person.

[0019] In one possible implementation, the media files associated with the first person combination include one or more of the following: photos of the first person and the second person taken together in the first photo collection and the second photo collection; or photos taken in the same time period in the first photo collection and the second photo collection; or photos taken in the same location in the first photo collection and the second photo collection; or photos belonging to the same event in the first photo collection and the second photo collection. The first photo collection is a photo collection associated with the first person, and the second photo collection is a photo collection associated with the second person. This implementation can improve the richness of the media files associated with the person combination.

[0020] In a possible implementation, the third user operation is: dragging the second person's avatar to the area where the first person's avatar is located.

[0021] A possible implementation method also includes: receiving a fourth user operation acting on the avatar of a second character, the fourth user operation being used to reduce the chance of the second character appearing in the character relationship display area; wherein the second character is one of the first associated characters; in response to the fourth user operation, setting the association degree between the second character and the first character to zero or to less than a threshold, or reducing the association degree between the second character and the first character, and deleting the avatar of the second character from the character relationship display area.

[0022] The above implementation method can reduce the chances of related characters appearing, thereby meeting the personalized needs of users and further improving the user experience.

[0023] In one possible implementation, the first associated person includes a first group of associated persons and a second group of associated persons, and the degree of association between the second group of associated persons and the first person is not higher than the degree of association between the first group of associated persons and the first person; the character relationship display area includes a first display area and a second display area, the first display area displays the avatar of the first person and the avatar of the first group of associated persons, and the second display area displays the avatar of the second group of associated persons.

[0024] In a possible implementation, the avatars of the second group of associated persons have the same size, and / or the avatars of the second group of associated persons are arranged in rows or columns.

[0025] A possible implementation method also includes: receiving a fifth user operation, and entering an editing mode in response to the fifth user operation; in the editing mode, receiving a sixth user operation, and in response to the sixth user operation, migrating the avatars of the second group of associated characters in the second display area to the first display area, or migrating the avatars of the associated characters in the first display area to the second display area.

[0026] Through the implementation method, the related characters in the first display area and the related characters in the second display area can be exchanged, thereby meeting the personalized needs of users and improving user experience.

[0027] A possible implementation further includes: when a third person is detected looking at the electronic device, displaying the avatar of the third person on the first page.

[0028] In the above implementation, when a person looks at the electronic device, the head portrait of the person can be displayed on the screen of the electronic device, thereby increasing the fun and improving the user experience.

[0029] A possible implementation further includes: when it is detected that the number of photos and / or videos containing a third person increases and the number of increases is greater than or equal to a threshold, displaying the avatar of the third person on the first page.

[0030] In the above implementation, when the number of photos and / or videos containing a certain person increases significantly, the head portrait of the person can be displayed on the screen of the electronic device. On the one hand, the user can be informed of the changes of the person in the photos and / or videos in a timely manner. On the other hand, it can increase the fun and improve the user experience.

[0031] A possible implementation further includes: when it is detected that the photos containing the third person have not been added within the first time period, displaying the avatar of the third person on the first page.

[0032] In a possible implementation, the third person is one of the first associated persons.

[0033] A possible implementation method also includes: receiving a seventh user operation, wherein the seventh user operation is used to merge the first candidate merged character with the first character; in response to the seventh user operation, merging the media files associated with the first candidate merged character with the media files associated with the first character, and updating the associated characters corresponding to the first character according to the merged media files to obtain a fourth associated character; displaying a fourth page, wherein the fourth page includes a character relationship display area and a media file display area, wherein the character relationship display area displays the avatar of the first character and the avatar of the fourth associated character, as well as the degree of association between the fourth associated character and the first character, and the media file display area displays the merged media files.

[0034] The above implementation method can merge the associated person with the candidate merged person, thereby correcting the person recognition error to improve the accuracy of person recognition.

[0035] A possible implementation method also includes: receiving an eighth user operation, the eighth user operation is used to merge the second candidate merged character with the second character, the second character is one of the first associated characters; in response to the eighth user operation, merging the media files associated with the second candidate merged character with the media files associated with the second character, updating the associated characters corresponding to the first character according to the merged media files to obtain a fifth associated character, and updating the characters associated with the second character according to the merged media files; displaying a fifth page, the fifth page includes a character relationship display area and a media file display area, the character relationship display area displays the avatar of the first character and the avatar of the fifth associated character, as well as the degree of association between the fifth associated character and the first character, and the media file display area displays the media files associated with the first character.

[0036] The above implementation method can merge the central person (the first person) with the candidate merged person, thereby correcting the person recognition error to improve the accuracy of person recognition.

[0037] In one possible implementation, the method also includes: receiving a user operation acting on the avatar of the first person or the second person, the user operation being used to set annotation information for the first person, the second person being one of the first associated persons; in response to the user operation, setting annotation information for the first person or the second person, the annotation information including name and / or role; and displaying the annotation information for the first person or the second person.

[0038] In one possible implementation, the media files associated with the first person include: photos and / or videos containing the first person; and one or more of the following: photos / videos whose shooting time falls within the time period corresponding to the shooting time of the first photos and / or videos, and the first photos and / or videos are photos and / or videos containing the first person; photos / videos whose shooting location is the same as the shooting location of the first photos and / or videos.

[0039] In the above implementation, since the media files associated with the central person (first person) include, in addition to photos and / or videos of the first person, more photos and / or videos based on the similarity of shooting time and / or shooting location, the richness of the media files can be improved.

[0040] In one possible implementation, the method further includes: setting a correlation between the first associated person and the first person based on one or more of the following: the number of photos of the first associated person and the first person; annotation information of the first associated person, the annotation information including one or more of name, role, and remarks; whether the first associated person is a contact in the first person's address book;

[0041] Whether the first associated person is a social application friend of the first person; and the frequency of interaction between the first associated person and the first person, where the interaction includes phone calls and / or social application interactions.

[0042] In the above implementation method, the character's annotation information, whether he is a contact in the address book of the first character (central character), whether he is a social application friend of the first character, the frequency of interaction with the first character, etc. can be used as a reference for determining the correlation between characters, thereby improving the accuracy or rationality of the correlation.

[0043] In one possible implementation, the media file display area includes at least one virtual key, each of the at least one virtual key corresponds to a label, and the label is obtained by clustering photos and / or videos associated with the first person; the method also includes: when a first virtual key of the at least one virtual key is triggered, displaying photos and / or videos associated with the first person and having the label corresponding to the first virtual key in the media file display area.

[0044] Through the above implementation, the user can browse the photos and / or videos associated with the first person from the dimension of the category to which the photos and / or videos belong, thereby improving the flexibility of media file browsing and further improving the user experience.

[0045] In one possible implementation, the media file display area also includes a menu key; the method also includes: when the menu key is triggered, menu options are displayed, the menu options include at least one option, each option in the at least one option is used to indicate the display of media files according to a specified dimension, and different options specify different dimensions; when one of the at least one option is triggered, the photos and / or videos associated with the central person are displayed in the photo display area according to the dimension corresponding to the triggered option.

[0046] Optionally, the at least one option includes one or more of the following: displaying all photos and videos, displaying only photos, displaying only videos, displaying only portraits, displaying by time, displaying by location, displaying by shooting mode, and displaying by objects.

[0047] Through the above implementation, the user can browse the media files associated with the first person from different dimensions, thereby improving the flexibility of media file browsing and further improving the user experience.

[0048] In one possible implementation, the media file display area includes a second virtual button, and the method further includes: when the second virtual button is triggered, displaying a sixth page, the sixth page including a map display area and a media file display area, the map display area displays a map, the map displays the location distribution of the shooting locations of the photos and / or videos in the first media file collection, the media file display area displays a list of photos and / or videos in the first media file collection, the map display area or the media file display area also includes at least one first-level virtual button; wherein each virtual key in the at least one first-level virtual button corresponds to a label, and the label is obtained by clustering the photos and / or videos in the first media file collection, and the first media file collection includes photos and / or videos associated with the first person.

[0049] Through the above implementation method, on the one hand, the distribution of shooting locations can be displayed on a map, so that users can intuitively understand the geographical distribution of the shooting locations of media files by combining the map; on the other hand, virtual buttons corresponding to the tags of media files can also be displayed on the page, so that subsequent users can select the corresponding tags to view the media files.

[0050] In one possible implementation, the first virtual button displays a name of a geographical location, where the largest number of photos and / or videos in the first media file collection are taken. This implementation allows the user to intuitively understand which shooting location has the largest number of media files.

[0051] A possible implementation method also includes: when the photo thumbnail corresponding to the first geographic location in the map display area is triggered, the seventh page is displayed, and the seventh page includes a media file display area, and the media file display area displays a list of photos and / or videos in the second media file collection, and at least one secondary virtual button; wherein, the first geographic location is one of the shooting locations of the photos and / or videos associated with the first person, and the second media file collection includes photos and / or videos associated with the first person, whose shooting location is the first geographic location, and each virtual key in the at least one secondary virtual button corresponds to a label, and the label is obtained by clustering the photos and / or videos in the second media file collection.

[0052] Through this implementation method, users can browse photos and / or videos of a certain shooting location among photos and / or videos associated with the first person (central person), and virtual keys corresponding to the tags to which these photos and / or videos belong can be displayed, so that users can further view photos and / or videos with tags among photos and / or videos of the shooting location through the virtual keys, thereby browsing media files based on the dimensions of geographic location (shooting location) and the dimensions of photo / video tags, which can improve user experience.

[0053] A possible implementation method also includes: when the third virtual key among the at least one first-level virtual key is triggered, an eighth page is displayed, and the eighth page includes a map display area and a media file display area, the map display area displays a map, and the map displays the location distribution of the shooting locations of the photos and / or videos in the third media file collection, and the media file display area displays a list of photos and / or videos in the third media file collection; wherein, the third media file collection includes photos and / or videos associated with the first person, which have the label corresponding to the third virtual key.

[0054] Through the above implementation method, on the one hand, users can use the map to understand the geographical distribution of the shooting locations of photos and / or videos. On the other hand, they can also browse the photos and / or videos associated with the first person from the dimension of the category to which the photos and / or videos belong, thereby improving the flexibility of media file browsing and further improving the user experience.

[0055] In one possible implementation, the media file display area includes a fourth virtual button, and the method further includes: when the second virtual button is triggered, displaying a ninth page, the ninth page including a map display area and a media file display area, the map display area displays a map, the map displays the location distribution of the shooting locations of the photos and / or videos in the first media file collection, the media file display area displays a list of photos and / or videos in the first media file collection, the map display area or the media file display area also includes at least one first-level virtual button; wherein each virtual key in the at least one first-level virtual button corresponds to one of the first associated characters, and the first media file collection includes photos and / or videos associated with the first character.

[0056] Through the above implementation method, on the one hand, the distribution of shooting locations can be displayed on a map, so that users can intuitively understand the geographical distribution of the shooting locations of media files with the help of the map. On the other hand, virtual buttons corresponding to associated persons can also be displayed on the page to facilitate subsequent users to select the corresponding associated persons to view the media files containing the associated persons.

[0057] In a possible implementation, the fourth virtual button displays the name of a geographical location, where the geographical location is a shooting location with the largest number of photos and / or videos in the first media file collection.

[0058] A possible implementation method also includes: when the photo thumbnail corresponding to the first geographic location in the map display area is triggered, the tenth page is displayed, and the tenth page includes a map display area and a media file display area, the map display area displays a map, and the map displays the location distribution of the shooting locations of the photos and / or videos in the first media file collection, and the media file display area displays a list of photos and / or videos in the second media file collection, and the map display area or the media file display area also includes at least one secondary virtual button; wherein, the first geographic location is one of the shooting locations of the photos and / or videos associated with the first person, and the second media file collection includes photos and / or videos associated with the first person, whose shooting location is the first geographic location, and each virtual button in the at least one secondary virtual button corresponds to one of the first associated persons, and the person is a person included in the photos and / or videos associated with the first person, whose shooting location is the first geographic location.

[0059] Through this implementation method, users can browse photos and / or videos of a certain shooting location in photos and / or videos associated with the first person (central person), and can use virtual keys corresponding to the associated persons contained in these photos and / or videos, so that users can further view photos and / or videos of the shooting location that contain corresponding associated persons through the virtual keys, thereby browsing media files based on the dimensions of geographic location (shooting location) and the dimensions of associated persons, which can improve user experience.

[0060] A possible implementation method also includes: when the fifth virtual key among the at least one first-level virtual key is triggered, the eleventh page is displayed, and the eleventh page includes a map display area and a media file display area, the map display area displays a map, and the map displays the location distribution of the shooting locations of the photos and / or videos in the third media file collection, and the media file display area displays a list of photos and / or videos in the third media file collection; wherein, the third media file collection includes photos and / or videos associated with the first person, including photos and / or videos of the person corresponding to the fifth virtual key.

[0061] Through the above implementation method, on the one hand, users can use the map to understand the geographical distribution of the shooting locations of photos and / or videos. On the other hand, they can also browse the photos and / or videos associated with the first person from the dimension of the associated people contained in the photos and / or videos, thereby improving the flexibility of media file browsing and further improving the user experience.

[0062] In a second aspect, an electronic device is provided, comprising a unit or module for executing the method as described in any one of the above-mentioned first aspects.

[0063] According to a third aspect, an electronic device is provided, comprising: one or more processors configured to execute the method as described in any one of the above-mentioned first aspects.

[0064] In a fourth aspect, a readable storage medium is provided, wherein the readable storage medium stores a program or instruction, and when the program or instruction is run on an electronic device, the electronic device executes the method as described in any one of the above-mentioned first aspects.

[0065] In a fifth aspect, a chip system or chip is provided, comprising a processor for supporting a computer device to implement a method as described in any one of the above-mentioned first aspects.

[0066] In a sixth aspect, a program product is provided, comprising a program; when the program is run on a computer, the computer is caused to execute the method as described in any one of the above-mentioned first aspects. BRIEF DESCRIPTION OF THE DRAWINGS

[0067] Figure 1 Schematic diagram of the hardware structure of the electronic device in the embodiment of the present application;

[0068] Figure 2 A schematic diagram of the software structure of the electronic device in the embodiment of the present application;

[0069] Figure 3 A schematic diagram of the overall solution of an embodiment of the present application;

[0070] Figure 4 This is a flowchart of the background processing operation in the embodiment of the present application;

[0071] Figure 5 A schematic diagram of a "Gallery" application in an embodiment of the present application displaying character relationships and media files associated with a central character through its user interface;

[0072] Figure 6a This is a schematic diagram of a "Character" main page in an embodiment of the present application;

[0073] Figure 6b This is a schematic diagram of another "Character" main page in an embodiment of the present application;

[0074] Figure 7a This is a schematic diagram of a function of refreshing character relationships and editing character relationships based on a settings menu in an embodiment of the present application;

[0075] Figure 7b This is a schematic diagram of moving a character portrait from a first display area to a second display area in an editing mode in an embodiment of the present application;

[0076] Figure 7c This is a schematic diagram of moving a character portrait from the second display area to the first display area in an editing mode in an embodiment of the present application;

[0077] Figure 7d This is a schematic diagram of moving the portrait of a person in the second display area forward in the editing mode in an embodiment of the present application;

[0078] Figure 7e This is a schematic diagram of moving the portrait of a person in the second display area backward in the editing mode in an embodiment of the present application;

[0079] Figure 8a This is a schematic diagram of a function for setting or editing character information based on a second menu in an embodiment of the present application;

[0080] Figure 8b This is a schematic diagram of setting a character name in an embodiment of the present application;

[0081] Figure 8c This is a schematic diagram of setting a character in an embodiment of the present application;

[0082] Figure 8d This is a schematic diagram of setting a character portrait in an embodiment of the present application;

[0083] Figure 8e This is a schematic diagram of merging similar characters in an embodiment of the present application;

[0084] Figure 8f This is a schematic diagram of reducing the chance of related characters appearing in an embodiment of the present application;

[0085] Figure 9 This is a schematic diagram of replacing a central figure in an embodiment of the present application;

[0086] Figure 10 This is a schematic diagram of adding a central figure in an embodiment of the present application;

[0087] Figure 11 This is a schematic diagram of browsing media files in different dimensions according to an embodiment of the present application;

[0088] Figure 12 This is a schematic diagram of browsing media files based on media file tags in an embodiment of the present application;

[0089] Figure 13a 、 Figure 13b They are respectively schematic diagrams of displaying media files in combination with maps in an embodiment of the present application;

[0090] Figure 14a 、 Figure 14b They are respectively schematic diagrams of another method of displaying media files in combination with a map in an embodiment of the present application;

[0091] Figure 15 A schematic diagram of the structure of a device provided in an embodiment of the present application;

[0092] Figure 16 A schematic diagram of the structure of another device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0093] Below, some terms used in the embodiments of the present application are explained to facilitate understanding by those skilled in the art.

[0094] The at least one involved in the embodiments of the present application includes one or more; wherein, more than one means greater than or equal to two. In addition, it should be understood that, in the description of this specification, words such as "first" and "second" are only used for the purpose of distinguishing the description, and cannot be understood as expressing or implying relative importance, nor can they be understood as expressing or implying order. For example, the first operation and the second operation do not represent the importance of the two or the order of the two, but are only for distinguishing the description. In the embodiments of the present application, "and / or" is only a description of the association relationship, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the objects related to each other are in an "or" relationship.

[0095] In the description of the embodiments of the present application, it should be noted that, unless otherwise clearly specified and limited, the terms "installation" and "connection" should be understood in a broad sense. For example, "connection" can be a detachable connection or a non-detachable connection; it can be a direct connection or an indirect connection through an intermediate medium. The directional terms mentioned in the embodiments of the present application, such as "up", "down", "left", "right", "inside", "outside", etc., are only reference to the directions of the accompanying drawings. Therefore, the directional terms used are for better and clearer explanation and understanding of the embodiments of the present application, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the embodiments of the present application.

[0096] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in connection with that embodiment is included in one or more embodiments of the specification. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in yet other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0097] Currently, media applications in electronic devices (such as the "Gallery" application, hereinafter referred to as the application) can manage and display photos, videos, etc. stored in the electronic devices based on dimensions such as shooting time and location. However, the intelligence of media file display needs to be improved.

[0098] The present invention provides a method for displaying media files and related devices that can implement the method. In the present invention, character relationships can be obtained by identifying and analyzing media files (such as photos and / or videos). When displaying media files, the character relationships based on the current central character are displayed to the user, and the media files associated with the central character are displayed to the user based on the central character, thereby improving the intelligence of media file display and thus improving the user experience.

[0099] The method provided in the embodiment of the present application can be applied to electronic devices. The electronic device can realize human-computer interaction. For example, the electronic device can specifically be a non-folding screen mobile phone, a folding screen mobile phone, a wearable device (such as a smart watch, a smart bracelet, etc.), a tablet computer, a laptop computer, a smart screen, a car terminal, a computer, a computer, a personal computer (personal computer, PC), an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook, a personal digital assistant (personal digital assistant, PDA), a virtual reality (virtual reality, VR) device / augmented reality (augmented reality, AR) device, an artificial intelligence (artificial intelligence, AI) device, and other terminal devices with display functions. The operating systems installed on the above electronic devices include but are not limited to This application does not limit the specific type of the above electronic equipment or the installed operating system.

[0100] See also Figure 1 , which is a possible hardware structure of the electronic device 100 in an embodiment of the present application.

[0101] like Figure 1 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, an earpiece 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0102] The processor 110 may include one or more processing units, for example, an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a microcontroller unit (MCU), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). An MCU is a single chip that integrates a processor core, memory, input / output interfaces, and other peripheral device interfaces (such as timers, analog-to-digital converters (ADCs), communication interfaces, etc.). Compared to a CPU's processor core, the MCU's processor core has a lower frequency and specifications, and therefore has lower power consumption.

[0103] The different processing units may be independent devices or integrated into one or more processors. The controller may be the nerve center and command center of the electronic device 100. The controller may generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory may store instructions or data that have just been used or are recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it may directly access it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves system efficiency. The execution of the audio playback method in the embodiments of the present application may be controlled by the processor 110 or performed by calling other components, such as calling a processing program in the embodiments of the present application stored in the internal memory 121, or calling a processing program in a third-party device through the external memory interface 120. This allows the electronic device 100 to automatically switch audio playback modes, solving the problem of low efficiency caused by the need to manually switch audio playback modes in the prior art. In addition, in an embodiment of the present application, the electronic device 100 can adaptively adjust the audio playback status or audio playback volume when it determines that the user has the intention to switch the audio playback mode (for example, the electronic device 100 is close to or away from the user's head). For example, when switching the audio playback mode (for example, switching from a first audio playback mode to a second audio playback mode), the audio playback can be paused, or the volume of the audio when playing in the first audio playback mode and the volume of the audio when playing in the second audio playback mode can be gradually reduced, so that the user experience is not affected by the sudden change in the audio playback volume when switching the audio playback mode, thereby adapting to the user's needs.

[0104] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, and software code of at least one application (such as iQiyi application, WeChat application, etc.). The data storage area can store data (such as images, videos, etc.) generated during the use of the electronic device 100. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0105] The external memory interface 120 can be used to connect an external memory card to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement data storage functions. For example, files such as pictures and videos can be stored in the external memory card.

[0106] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a USB interface 130, among others.

[0107] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0108] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor or MCU. The ISP is used to process data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then transmitted to the ISP for processing and converted into an image visible to the naked eye. The ISP can also perform algorithmic optimization on image noise, brightness, etc. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0109] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the earpiece 170B, the microphone 170C, the headphone jack 170D, and the application processor or MCU.

[0110] The audio module 170 is used to convert digital audio signals into analog audio signals for output, and is also used to convert analog audio signals into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.

[0111] The speaker 170A, also called a "speaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to external speaker scenarios such as hands-free calls through one or more speakers 170A.

[0112] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones to realize sound signal collection, noise reduction, and identification of sound sources, and realize directional recording function, etc.

[0113] The headphone jack 170D is used to connect a wired headphone. The headphone jack can be a USB interface, or a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0114] It is understandable that Figure 1 The components shown do not constitute a specific limitation on the electronic device. The electronic device in the embodiment of the present application may include Figure 1 More or fewer components in . In addition, Figure 1 The combination / connection relationship between the components can also be adjusted and modified.

[0115] Figure 2 FIG. 1 shows a schematic diagram of the software structure of the electronic device provided in the embodiment of the present application. Figure 2As shown, the software structure of the electronic device can be a layered architecture. For example, the software can be divided into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into four layers: from top to bottom, the application layer, the application framework layer (framework, FWK), the runtime (runtime) and system library, and the kernel layer.

[0116] The application layer can include a series of application packages. Figure 2 As shown, the application layer may include a "Gallery" application, etc.

[0117] The application framework layer provides application programming interface (API) and programming framework for the application layer. The application framework layer may include some predefined functions. Figure 2 As shown, the application framework layer may include a window manager, a view system, a resource manager, etc.

[0118] The runtime includes the core library and the virtual machine. The runtime is responsible for the scheduling and management of the operating system.

[0119] The core library consists of two parts: one containing the Java language's callable functions and the other containing the operating system's core libraries. The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0120] The system library can include multiple functional modules, such as a surface manager, media libraries, a 3D graphics processing library (e.g., OpenGL ES), and a 2D graphics engine (e.g., SGL).

[0121] The surface manager is used to manage the display subsystem and provide fusion of 2D and three-dimensional (3D) layers for multiple applications.

[0122] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0123] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0124] A 2D graphics engine is a drawing engine for 2D drawings.

[0125] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0126] The hardware layer can include various sensors, such as accelerometers, gravity sensors, touch sensors, etc.

[0127] based on Figure 2 In the software structure shown, the "Gallery" application is used to manage and display media files stored in the media library of the electronic device. The "Gallery" application can be a system application or a third-party application. This application can implement the media file display method provided in the embodiments of the present application.

[0128] In one possible implementation, new functions can be added to the current "Gallery" application, or the original functions can be expanded so that the application can implement the method provided in the embodiments of the present application. In another possible implementation, a new "Gallery" application can be designed that can access the media library stored in the electronic device to implement the method provided in the embodiments of the present application.

[0129] It should be understood that the application that can implement the method provided in the embodiments of the present application may also be other applications. The embodiments of the present application do not limit the type, naming, etc. of the application that can implement the method provided in the embodiments of the present application.

[0130] The following describes the media file display method provided in the embodiment of the present application by taking the "Gallery" application as an example.

[0131] In order to understand the embodiments of the present application more clearly, Figure 3 The overall scheme of the embodiment of the present application is described.

[0132] See also Figure 3, is a schematic diagram of the overall scheme of the embodiment of the present application. As shown in the figure, the implementation process of the embodiment of the present application includes two parts: background processing operation 310 and foreground processing operation 320. Among them, the "Gallery" application performs background processing operation 310 in the background running mode. The background processing operation 310 is usually invisible to the user and can be performed without user intervention or participation. The "Gallery" application performs foreground processing operation 320 in the foreground running mode. The foreground processing operation 320 is visible to the user. For example, the user's operation can be received through the user interface, and the response result can be displayed on the user interface in response to the user's operation. In the embodiment of the present application, through the background processing operation 310, character-related information and character relationships can be obtained based on the media files in the media library. The character-related information and character relationship information are stored in the character database. Through the foreground processing operation 320, the media files in the media library can be displayed based on the character relationship.

[0133] For example, if Figure 4 As shown, the background processing operation 310 may include the following steps:

[0134] Step 401: The electronic device (or the "Gallery" application) identifies the photos / videos in the media library to filter out the photos / videos containing human images.

[0135] In this step, you can use the AI ​​model to filter out photos / videos that contain human images.

[0136] Step 402: The electronic device (or the "Gallery" application) performs face recognition on photos / videos containing human images, and determines that people with the same or similar facial features are the same person.

[0137] In this step, AI models can be used to identify people.

[0138] Step 403: The electronic device (or the "Gallery" application) selects photos / videos associated with the identified person from the media library based on the photos / videos containing the person.

[0139] Taking person A as an example, the media file set formed by the photos / videos associated with person A includes: photos / videos containing person A.

[0140] Optionally, in addition to the above-mentioned photos / videos containing person A, photos / videos meeting one or more of the following conditions may also be included:

[0141] Condition 1-1: The photo / video whose shooting time falls within the time period corresponding to the shooting time of the photo / video containing person A. That is to say, even if person A is not in the photo / video, since the shooting time of the photo / video is within the time period corresponding to the shooting time of the photo / video containing person A, it means that the photo / video may have been taken when person A participated in a certain event. Therefore, the photo / video can be considered to be associated with person A, thereby increasing the richness of the media content.

[0142] The time period corresponding to the shooting time may be a time period centered at the shooting time and having a first duration. The value of the first duration may be pre-set. For example, if the time period corresponding to the shooting time is a one-hour time period centered at the shooting time, for example, if Photo 1 includes Person A and was shot at 10:00 AM on January 1, 2024, and Photo 2 does not include Person A and was shot at 10:10 AM on January 1, 2024, then Photo 2 can be considered associated with Person A because the shooting time of Photo 2 falls within the time period corresponding to the shooting time of Photo 1.

[0143] Condition 1-2: The photo / video is taken at the same location as the photo / video containing person A. That is, even if person A is not in the photo / video, since the photo / video is taken at the same location as the photo / video containing person A, it means that the photo / video may be taken at a place that person A has been to. Therefore, the photo / video can be considered to be associated with person A, thereby increasing the richness of the media content.

[0144] Conditions 1-3: Photos / videos that meet conditions 1-1 and 1-2 above.

[0145] It should be understood that the above merely exemplifies several possible implementations of screening photos / videos associated with person A based on photos / videos containing person A, and this application does not impose any limitation thereto.

[0146] Optionally, for a character combination, photos / videos associated with the character combination may be determined. A character combination may include two or more characters.

[0147] Taking the character combination of person A and person B as an example, the media file collection formed by the photos / videos associated with the character combination includes: photos / videos containing photos of person A and person B together. Optionally, in addition to the photos / videos containing photos of person A and person B together, photos / videos that meet one or more of the following conditions may also be included:

[0148] Condition 2-1: The photo / video whose shooting time falls within the time period corresponding to the shooting time of the photo / video containing the person group. That is to say, even if the person group is not in the photo / video, since the shooting time of the photo / video is within the time period corresponding to the shooting time of the photo / video containing the person group, it means that the photo / video may have been taken when the person group participated in a certain event. Therefore, it can be considered that the photo / video is associated with the person group, thereby increasing the richness of the media content.

[0149] Condition 2-2: Photos / videos that are taken at the same location as photos / videos containing the character group. That is, even if the character group is not in the photo / video, since the photo / video is taken at the same location as the photo / video containing the character group, it means that the photo / video may be taken at a place that the character group has been to. Therefore, the photo / video can be considered to be associated with the character group, thereby increasing the richness of the media content.

[0150] Condition 2-3: Photos / videos that meet the above conditions 21- and 2-2.

[0151] It should be understood that the above merely exemplifies several possible implementations of screening photos / videos associated with a person combination based on photos / videos containing a person combination, and the present application does not impose any limitation thereto.

[0152] Step 404: The electronic device (or the "Gallery" application) generates person-related information based on the identified person.

[0153] Taking character A as an example, in one possible implementation, character-related information of character A may include: character A's identification, character A's facial feature information, a list of photos / videos containing character A, and a list of photos / videos associated with character A. Optionally, it may also include character A's annotation information, such as one or more of the following annotation information: character A's name, character A's role, character A's remarks, etc. Optionally, it may also include a character portrait. The role of a character is relative to another character, and can also be understood as the type of relationship between characters. For example, the role (or relationship) of character D relative to character A is: character D is character A's friend, colleague, family member, mother, etc.

[0154] The identification of person A may be assigned by the electronic device (or the "Gallery" application) to uniquely identify the identified person.

[0155] The facial feature information of person A is obtained by performing facial recognition on the person.

[0156] The head portrait of the person is generated based on a photo containing the person. For example, an image of the area where the head portrait of the person is located in the photo can be captured as the head portrait of the person.

[0157] The photo / video list containing person A and the photo / video list associated with person A include identification information such as one or more photo / video identifiers or file names for uniquely distinguishing the photos / videos. The photo / video list associated with person A may be the same as the photo / video list containing person A, or may contain more photos / videos than the photo / video list containing person A, depending on the algorithm (i.e., the method for determining the media files associated with a person) and / or the attributes of the photos / videos in the media library (e.g., shooting time, shooting location, etc.).

[0158] Optionally, the person-related information may be a table, a list, a file, or another data structure, which is not limited in this application.

[0159] Table 1 shows character-related information in a tabular form, which may also be called a character list.

[0160] Table 1: Character list (character related information)

[0161]

[0162] In Table 1, taking person A as an example, "ID of person A" represents the identification of person A; "Facial feature information 1" can be a 128-dimensional floating-point vector, or a 50-dimensional integer vector, etc., depending on the facial feature extraction method and / or accuracy requirements; "Avatar A" can be the identification or name of person A's avatar, etc., which can uniquely identify a person's avatar. All person avatars can be stored in another table or file; "Photo / Video List 1" includes identification information of one or more photos / videos, which contain person A; "Photo / Video List 2" includes identification information of one or more photos / videos, which are associated with person A. Photo / Video List 1 may be a subset of Photo / Video List 2.

[0163] Among them, the character name and character role can be set by the user, and the setting method of the character name and character role can refer to the relevant content below. Taking character A as an example, after the user has completed setting the name of character A, the electronic device can add the name of character A set by the user to Table 1. As another example, after the user has completed setting the role of character A relative to character B, the electronic device can add the role of character A relative to character B to the "character role" corresponding to character A in Table 1, and add the role of character B relative to character A to the "character role" corresponding to character B in Table 1. A character can have one or more roles. For example, the roles of character A can include: character A is a friend of character B, character A is a colleague of character C, etc.

[0164] It should be understood that Table 1 can be split into multiple tables, which is not limited in this application.

[0165] In other embodiments, for each character combination, character-related information corresponding to each character combination may be determined.

[0166] Table 2 shows character-related information in a tabular format, which is used to store character-related information corresponding to different character combinations.

[0167] Table 2: Character combination list (character related information)

[0168]

[0169] In Table 2, taking the character combination formed by characters A and B as an example, "character A, character B" represents the combination of characters A and B, including the identifier of character A and the identifier of character B, or the identifier of the character combination formed by characters A and B. "Avatar A+B" can be information that can uniquely identify an avatar, such as the identifier or name of the avatar of the character combination formed by characters A and B. All avatars can be stored in another table or file. The avatar can be generated based on a photo containing characters A and B, or the avatar can be a photo of characters A and B together. "Photo / Video List 10" includes the identification information of one or more photos / videos containing characters A and B. "Photo / Video List 11" includes the identification information of one or more photos / videos associated with the character combination formed by characters A and B. Photo / Video List 11 may be a subset of Photo / Video List 12.

[0170] It should be understood that Table 2 can be split into multiple tables, which is not limited in this application.

[0171] It should be understood that Table 2 and Table 1 can be combined into one table, and this application is not limited thereto.

[0172] Step 405: The electronic device (or the "Gallery" application) determines the relationship between the characters based on the character-related information.

[0173] Character relationships reflect the relationships between identified characters. For example, they can indicate whether character A and character B are related, and if so, the degree of that relationship. The degree of relationship between characters can be expressed as a correlation degree; a higher correlation degree indicates a higher degree of relationship.

[0174] In one possible implementation, taking person A and person B as an example, if there is a photo / video of person A and person B together, or in other words, person A and person B appear in one or more photos at the same time, or appear in one or more videos at the same time, then it can be determined that person A and person B are associated.

[0175] Still taking person A and person B as an example, in one possible implementation, the degree of association between person A and person B can be determined based on the number of photos of person A and person B existing at the same time, and / or the number of videos of person A and person B existing at the same time.

[0176] For example, the association between person A and person B can be determined based on the number of group photos of person A and person B, as well as the number of group photos of person A with other people. For example, if the identified people include person A, person B, person C, and person D, and the number of group photos of person A and person B is N1, the number of group photos of person A and person C is N2, and the number of group photos of person A and person D is N3, then the association between person A and person B is N1 / (N1+N2+N3), the association between person A and person C is N2 / (N1+N2+N3), and the association between person A and person D is N3 / (N1+N2+N3).

[0177] In another possible implementation, in addition to determining the degree of association based on the number of photos / videos containing multiple people, the person's annotation information can also be used as a basis for determining the degree of association. Optionally, the person's annotation information can include one or more of the following: the person's name, the person's role, and remarks. The person's annotation information can be set by the user. For instructions on how to set person annotation information, please refer to the relevant content below.

[0178] For example, when determining the degree of association between other characters and the central character with character A as the central character, the annotation information of the other characters can be used as one of the bases for determining the degree of association. For example, taking the identified characters including character A, character B, character C, and character D as an example, if the number of group photos of character A and character B is N1, the number of group photos of character A and character C is N2, the number of group photos of character A and character D is N3, and character D is set as a friend of character A or character D is set with a name, then the degree of association between character A and character B is N1 / (N1+N2+N3), the degree of association between character A and character C is N2 / (N1+N2+N3), the degree of association between character A and character D is N3 / (N1+N2+N3)+α, or the degree of association between character A and character D is β*N3 / (N1+N2+N3). Among them, α and β are the degree of association adjustment. Considering that the value range of the correlation calculated according to the above method is greater than or equal to 0 and less than or equal to 1, the value range of α can be greater than 0 and less than 1, and the value range of β can be greater than 1. Optionally, the values ​​of α and β can be preset, and this application does not limit them.

[0179] Optionally, the value of α can also be greater than -1 and less than 0, that is, the value of α can be a negative number, which depends on whether the role of character D relative to character A is negative (or negative) or positive (or positive). If it is negative (for example, character D is noted as someone that character A dislikes), then the value of α is a negative number.

[0180] Optionally, the value of β may be greater than 0 and less than 1, depending on whether the role of character D relative to character A is negative (or negative) or positive (or positive). If it is negative, the value of β is less than 1.

[0181] In one possible implementation, in addition to using the number of photos / videos of multiple characters at the same time as a basis for determining the relevance, one or more of the following may also be used as a basis for determining the relevance: whether the characters are contacts in the address book, whether the characters are friends in a social application, the frequency of calls, the frequency of interactions in a social application, etc. Taking the determination of the relevance between character D and character A as an example, if character D is a contact in character A's address book, then the relevance between character D and character A may be appropriately increased; for another example, if character D is a friend of character A in a social application, then the relevance between character D and character A may be appropriately increased; for another example, if character D is a person A's frequent caller, then the relevance between character D and character A may be appropriately increased; for another example, if character D is a person A's frequent user of a social application, then the relevance between character D and character A may be appropriately increased. The above method (through the relevance adjustment amount) may be used to increase the relevance, and this application is not limited thereto. It is understandable that in order to protect user privacy, the "Gallery" application can read the user's address book, call logs, friend list of social applications, or conversation history of social applications if permitted or authorized by the privacy terms.

[0182] Optionally, the association adjustment values ​​corresponding to different roles may be different. For example, if role 1 (e.g., a friend) represents a closer relationship than role 2 (e.g., a colleague), then the association adjustment value corresponding to role 1 is greater than the association adjustment value corresponding to role 2.

[0183] Optionally, after the correlation degree is adjusted using the correlation degree adjustment amount, if the adjusted correlation degree is greater than 1, the correlation degree is set to 1; if the adjusted correlation degree is less than 0, the correlation degree is set to 0.

[0184] When a user labels a character, for example, setting character D as a friend of character A, it indicates that the user believes that character D has a close relationship with character A. In this case, appropriately adjusting the association between character A and character D can better meet the user's intentions, satisfy the user's personalized needs, and thus improve the user experience.

[0185] In some embodiments of the present application, when calculating the correlation between characters, one character is used as the central character, and the correlation between the central character and other characters is calculated respectively. For example, in the above example, with character A as the central character, the correlation between character A and character B is calculated, the correlation between character A and character C is calculated, and the correlation between character A and character D is calculated. In the embodiments of the present application, characters that have an association relationship with the central character, or that have a correlation with the central character greater than 0, can be referred to as the central character's associated characters.

[0186] In other embodiments, there may be multiple central characters, or the central character may be a character combination comprising at least two characters. In this case, the degree of association between the character combination and other characters may be calculated according to the aforementioned principle for calculating the degree of association. For example, the degree of association between the character combination and character C may be determined based on the number of photos containing both the character combination and character C, and / or the number of videos containing both the character combination and character C.

[0187] Taking the example where the identified characters include character A, character B, character C and character D, and the central characters include character A and character B, if the number of group photos of character A, character B and character C is M1, and the number of group photos of character A, character B and character D is M2, then the correlation between the combination of character A and character B and character C is M1 / (M1+M2), and the correlation between the combination of character A and character B and character D is M2 / (M1+M2).

[0188] Optionally, the character's annotation information can also be used as a basis for determining the degree of association. For specific implementation methods, please refer to the relevant content above. For example, if character D is set as a friend of character A and a friend of character B, then the degree of association between the combination of characters A and B and character D is M2 / (M1+M2)+α, or the degree of association between the combination of characters A and B and character D is β*M2 / (M1+M2). Where α and β are association adjustment factors.

[0189] Optionally, one or more of the following may be used as a basis for determining the relevance: whether the contact is in the address book, whether the contact is a friend in a social application, the frequency of calls, the frequency of interactions in a social application, etc.

[0190] It should be understood that the above example is only based on the number of central figures being two, and the calculation principle can be applied to the case of a larger number of central figures.

[0191] Taking into account that the user may change the central character, or increase or decrease the number of central characters when using the "Gallery" application, the central character may be any identified character, or any combination of characters. Therefore, in one possible implementation method, the electronic device (or the "Gallery" application) can use each character and each combination of characters as the central character, and determine the correlation between the central character and other characters, so that when the user changes the central character, the character relationship can be obtained in time.

[0192] The electronic device (or the "gallery" application) can store the degree of association between characters with each character and each character combination as the central character as character relationship information. For example, the character relationship information may include the identifiers of the central character and the associated characters, as well as the degree of association between the central character and the associated characters.

[0193] Optionally, the character relationship information can be stored in a file format, a table format, or other data structure, which is not limited in this application. For example, taking the identified characters including character A, character B, character C, and character D as an example, the character relationship information may include:

[0194] With character A as the central character:<ID A,ID B> , correlation],[<ID A,ID C> , correlation],[<ID A,IDD> ,correlation];

[0195] With character B as the central character:<ID B,ID A> , correlation],[<ID B,ID C> , correlation],[<ID B,IDD> ,correlation];

[0196] With character C as the central character:<ID C,ID A> , correlation],[<ID C,ID B> , correlation],[<ID C,IDD> ,correlation];

[0197] With character D as the central character:<ID D,ID A> , correlation],[<ID D,ID B> , correlation],[<ID D,IDC> ,correlation];

[0198] With character A and character B as the central characters: [<(ID A,ID B),ID C>, correlation], [<(ID A,ID B),ID D>, correlation];

[0199] With characters A and C as the central characters: [<(ID A,ID C),ID B>, correlation], [<(ID A,ID C),ID D>, correlation];

[0200] With characters A and D as the central characters: [<(ID A, ID D), ID B>, correlation], [<(ID A, ID D), IDC>, correlation];

[0201] With characters B and C as the central characters: [<(ID B,ID C),ID A>, correlation], [<(ID B,ID C),ID D>, correlation];

[0202] With characters B and D as the central characters: [<(ID B,ID D),ID A>, correlation], [<(ID B,ID D),IDC>, correlation];

[0203] With characters C and D as the central characters: [<(ID C,ID D),ID A>, correlation], [<(ID C,ID D),ID B>, correlation];

[0204] With characters A, B, and C as the central characters: [<(ID A, ID B, ID C), ID D>, correlation];

[0205] With characters A, B, and D as the central characters: [<(ID A, ID B, ID D), ID C>, correlation];

[0206] With characters A, C, and D as the central characters: [<(ID A, ID C, ID D), ID B>, correlation];

[0207] With characters B, C, and D as the central characters: [<(ID B, ID C, ID D), ID A>, correlation].

[0208] Optionally, in the above-mentioned character relationship information, items with a correlation degree equal to 0 can be deleted to reduce storage overhead.

[0209] Background processing operations can be executed according to a set cycle, or when the electronic device is idle (for example, when the screen is off, or at night), or when a large number of media files such as photos / videos are added or reduced, which is not limited by this application. In some other embodiments, the user interface of the "Gallery" application can be set to trigger the execution of the above Figure 4 When the virtual key is triggered, the electronic device (or the "gallery application") can execute the following steps: Figure 4 The process shown.

[0210] When the "Gallery" application is started, the application can display character relationships and media files associated with the central character on the user interface of the application based on character-related information and character relationship information.

[0211] Figure 5The following is an exemplary diagram showing a method of opening a "Gallery" application, where the application displays character relationships and media files associated with the central character through its user interface. As shown in the figure, the home page 10 of the electronic device displays icons of multiple applications, including an icon for the "Gallery" application, which stores a large number of media files such as photos and videos. When a user clicks the icon of the "Gallery" application, the electronic device can display the home page 20 corresponding to the page note named "Discover" (hereinafter referred to as the "Discover" home page 20).

[0212] It should be understood that when a user clicks on the icon of the "Gallery" application, the electronic device may also display the home page corresponding to the page label named "Photos" or the home page corresponding to the page label named "Album" or the home page corresponding to the page label named "Moments", depending on the page presented by the application when the user last exited the application. If the electronic device does not display the "Discover" home page 20, it can switch to the "Discover" home page 20 in response to the user clicking on the page label named "Discover".

[0213] The "Discover" homepage 20 includes one or more options, such as, Figure 5 The options named "People" and "Places" are shown in the figure. Each option corresponds to a dimension for displaying media files. For example, the "People" option corresponds to displaying media files based on the relationship between people, and the "Places" option corresponds to displaying media files based on the shooting location. The "People" option area can display one or more person's avatars. These people are identified by the electronic device (or the "Gallery" application) through background processing operations based on the media files in the media library. For possible implementation methods, please refer to Figure 4 The process shown.

[0214] Optionally, in the "People" option area, the central person's portrait is arranged first, and then the portraits of the related persons corresponding to the central person can be displayed in order of decreasing relevance to the central person. The central person is one of the persons recognized by the electronic device (or the "Gallery" application) based on the media library.

[0215] Optionally, you can select a person from the identified people as the default central person by:

[0216] Method 1: If a photo containing a person was taken with the front-facing camera, that person can be identified as the central person. Since selfies are typically taken with the front-facing camera, and the person in a selfie is typically the user of the electronic device, the central person identified using this method is likely to be the user of the electronic device.

[0217] Among them, the attributes of the photo include attributes related to the shooting mode, which are used to describe the shooting mode of the photo, for example, whether the photo is taken by the front camera, whether it is a dynamic photo, whether it is a photo taken with a large aperture, etc.

[0218] Method 2: If the photo containing a certain person is taken by the front camera and the number of such photos exceeds a set threshold, then the person is determined as the central person.

[0219] Method 3: In the photos taken with the front camera, if the number of photos containing a certain person is higher than the number of photos containing other people, then the person with the largest number of photos can be determined as the central person.

[0220] Considering that a selfie may be a photo of a single person, a group photo of multiple people, or a single selfie of someone other than the user of the electronic device, but generally speaking, the number of single selfies of the user of the electronic device is larger, so using this method to determine the central person can make it more likely that the user of the electronic device is determined as the central person.

[0221] Method 4: If the number of photos containing a certain person is higher than the number of photos containing other people, then the person can be determined as the central person.

[0222] It should be understood that the above methods for determining the default central person are merely possible examples, and this application does not limit them.

[0223] After one of the multiple identified characters is determined as the default central character, the associated characters corresponding to the central character can be obtained based on the character relationship information, and the avatars of the central character and the associated characters can be obtained based on the character-related information (such as Table 1), so that these character avatars can be displayed in the "Character" option area.

[0224] When the user clicks the "Character" option (e.g., clicking anywhere in the area where the "Character" option is located, which can be used as an example of a first user operation), the electronic device displays the "Character" main page 30 (which can be used as an example of a first page). The "Character" main page 30 displays the character portraits and character relationships, as well as photos / videos associated with the central character.

[0225] It should be understood that the above is only an example of a method for displaying the "People" main page, and this application does not limit this. For example, in some other embodiments, when the page label named "Discover" is clicked, the "People" main page is displayed, that is, the "People" main page can be used as the home page of the "Discover" page. For another example, when the page label named "Photos" is clicked, the "People" main page is displayed, that is, the "People" main page can be used as the home page of the "Photos" page. For another example, a new page label can be added below the home page of the "Gallery" application, such as a page label named "People". When the new page label is clicked, the "People" main page is displayed. Of course, the "People" main page can also be opened by voice commands.

[0226] The following combination Figure 6a and Figure 6b , a detailed description of the "People" main page.

[0227] See also Figure 6a and Figure 6b , which are schematic diagrams of a “Character” main page in an embodiment of the present application. Figure 6a and Figure 6b The “Character” main page shown (which can be used as an example of the first page) includes a character relationship display area 610 and a media file display area 620 . Figure 6b The "People" main page shown may also include a theme album display area 630. Photos may be extracted and organized based on dimensions such as shooting time and shooting content to create an album. The album may be called a theme album, a moment album, or a story collection.

[0228] The character relationship display area 610 displays the avatar of the central character (which can be used as an example of the first character) and the avatars of the associated characters (which can be used as examples of the first associated characters), as well as the degree of association between the associated characters and the central character.

[0229] In one possible implementation, the character relationship display area 610 may include a first display area 611 and a second display area 612. The first display area 611 displays the central character's avatar (represented in the figure as a circle containing the letter A) and the avatars of the first group of associated characters (represented in the figure as circles containing letters such as B), and the second display area 612 displays the avatars of the second group of associated characters (represented in the figure as circles containing letters such as G). The first group of associated characters and the second group of associated characters are each a portion of the associated characters corresponding to the central character, and there is no overlap between the first group of associated characters and the second group of associated characters.

[0230] The degree of association between the associated characters in the second display area and the central character is less than the degree of association between the associated characters in the first display area and the central character. In other words, the first display area is used to display associated characters with a high degree of association with the central character, and the second display area is used to display associated characters with a low degree of association with the central character. Due to the size of the first display area, the first display area cannot display a large number of character portraits. Therefore, the maximum number of associated characters displayed in the first display area can be pre-defined. If the associated characters corresponding to the central character exceed this maximum number, then these associated characters can be divided into a first group of associated characters and a second group of associated characters according to the degree of association from high to low. The number of associated characters in the first group does not exceed the maximum number, and the degree of association between each person in the first group of associated characters and the central character is not less than the degree of association between any associated person in the second group of associated characters and the central character. The portraits of the first group of associated characters are displayed in the first display area 611, and the portraits of the second group of associated characters are displayed in the second display area 612.

[0231] In the first display area 611 , the portrait of the central character is located in the middle, and the portraits of the associated characters may be distributed around the portrait of the central character, for example, arranged around the central character in a surrounding manner.

[0232] Optionally, the central character's avatar position and avatar size remain unchanged, and the avatar position of an associated character is related to the degree of association between the associated character and the central character, or the avatar size of an associated character is related to the degree of association between the associated character and the central character, or the avatar position and avatar size of an associated character are related to the degree of association between the associated character and the central character. Specifically, within the first display area, the distance between the avatars of the first group of associated characters and the avatar of the central character is positively correlated with the degree of association between the first group of associated characters and the central character; or the size of the avatars of the first group of associated characters is positively correlated with the degree of association between the first group of associated characters and the central character; or the distance between the avatars of the first group of associated characters and the avatar of the central character and the size of the avatars of the first group of associated characters are positively correlated with the degree of association between the first group of associated characters and the central character. For example, the central character's avatar is the largest, the avatars of the associated characters are smaller than the central character's avatar, and the lower the correlation between the associated characters and the central character, the smaller the avatar size of the associated characters; for another example, the central character's avatar is located in the middle of the first display area, and the avatars of the associated characters are distributed around the central character's avatar, and the lower the correlation between the associated characters and the central character, the farther the avatars of the associated characters are from the central character's avatar.

[0233] In other embodiments, the central character's head portrait position and size remain unchanged, and the associated characters' head portrait positions and sizes also remain unchanged, but the associated characters' head portrait sizes are smaller than the central character's. In other embodiments, the central character's head portrait position and size remain unchanged, and the associated characters' head portrait positions remain unchanged, and the associated characters' head portrait sizes are related to the degree of association; for a related character, the smaller the degree of association with the central character, the smaller the associated character's head portrait size.

[0234] It is understandable that the arrangement of the portraits of the central character and the related characters may also be other ways, and this application does not limit it.

[0235] It is understood that other methods can also be used to indicate the degree of association between the related characters and the central character. For example, the degree of association can be indicated by the transparency of the avatar, with the higher the degree of association, the lower the transparency of the avatar. Another example is that the degree of association can be indicated by the color of the avatar, with the higher the degree of association, the darker the color of the circle around the avatar. Another example is that the numerical value of the association can be displayed around the avatar of the related character.

[0236] Optionally, the first display area 611 may also display the central character's annotation information (such as name and / or role). Optionally, the central character's annotation information may be displayed in the central character's avatar display area, or around the central character's avatar. For example, Figure 6b In the video, the central character's role "I" is displayed below the central character's portrait.

[0237] Optionally, the annotation information of the associated person may also be displayed in the first display area 611. Optionally, the annotation information of an associated person may be displayed in the avatar display area of ​​the associated person, or around the avatar of the associated person.

[0238] In the second display area 612, the portraits of the associated persons can be arranged in rows, for example, in a row. In other embodiments, the second display area can be located to the left or right of the first display area, and the height of the second display area is greater than its length. Accordingly, the portraits of the associated persons in the second display area can be arranged in columns, for example, in a single column.

[0239] Optionally, the avatars of the associated persons in the second display area 612 have the same size.

[0240] Optionally, in the second display area 612, more avatars of related persons can be viewed by sliding left or right.

[0241] Optionally, the second display area 612 may also display annotated information for related characters. Alternatively, the annotated information for a related character may be displayed in the area displaying the related character's portrait, or around the related character's portrait. The annotated information for the central character and related characters may be user-configured. For more information on how to configure the information, refer to the following related content.

[0242] Optionally, the avatars of the associated persons in the second display area 612 may be arranged in descending order according to the degree of association between the associated persons and the central person.

[0243] In one possible implementation, the avatar of the central character and the avatar of the associated characters can be implemented through a component (such as a control), which can respond to user operations and perform corresponding processing operations. For example, the avatar of the central character and the avatar of the associated characters can respond to a long press operation and implement the setting of character annotation information through interaction with the user; for another example, the avatar of the associated character can respond to a click operation to implement the function of replacing the central character with the associated character; for another example, the avatar of the associated character can respond to a drag operation to implement the function of adding the associated character as the central character. The implementation methods of the above functions can refer to the relevant content below.

[0244] In another possible implementation, the character relationship display area includes only the first display area, that is, only the portrait of the central character and the portraits of related characters with a high degree of association with the central character are displayed. Optionally, the size of the related characters' portraits and / or the distance from the central character's portrait can be used to reflect the degree of association between the related characters and the central character.

[0245] In one possible implementation, the first display area 611 also includes a focused person area, which is used to display the avatar of the temporarily focused person. The person can be one of the associated persons corresponding to the central person, or other persons. In other words, the avatar of the person is displayed in this area only when certain conditions are met.

[0246] Optionally, the person's avatar is displayed in the followed person area in the following situations:

[0247] Case 1: When a person (which can be used as an example of a third person) is detected looking at the electronic device, the head portrait of the person is displayed in the focused person area. The person can be one of the associated persons corresponding to the central person.

[0248] Some electronic devices are equipped with a camera for screen gaze perception (such as a true depth camera), which can detect whether someone is looking at the screen and capture a facial image when someone is looking at the screen. In an embodiment of the present application, when it is detected that someone is looking at the screen of the electronic device, the electronic device can perform face recognition on the facial image captured by the camera, and compare the extracted facial feature information with the facial feature information of each person in the person-related information (such as Table 1). If the extracted facial feature information matches the facial feature information of the person (such as a person in Table 1), then it is determined based on the person relationship information whether the person is an associated person of the current central person. If so, the head portrait of the person is displayed in the area of ​​the focused person.

[0249] By adopting this method, when the central character is the user of the electronic device and a related character of the user is looking at the screen of the electronic device, the avatar of the character can be displayed in the area of ​​the focused character, thereby increasing the fun and improving the user experience.

[0250] Case 2: When an increase in photos / videos containing a certain person (which can be used as an example of a third person) is detected, or when an increase in photos / videos containing the person is detected and the number of increases is greater than or equal to a threshold, the person's avatar is displayed in the area of ​​the person of interest.

[0251] For example, when a large number of photos and / or videos are added, the electronic device can identify the added photos / videos. If the identified characters include a related person of the current central person (for example, the related person is the third person among the related persons of the current central person), and the number of photos / videos containing the related person is greater than or equal to the threshold, in this case, the avatar of the related person will be displayed in the area of ​​concerned persons to attract the user's attention, increase interest, and thus improve the user experience.

[0252] It is understandable that the third person may not be an associated person of the current central person. That is, as long as the "Gallery" application detects a sudden increase in the number of photos containing the third person, the head portrait of the person can be displayed in the focused person area.

[0253] Case 3: When it is detected that no photos containing a certain person (which can be used as an example of a third person) are added within the second time period, the head portrait of the person is displayed in the focused person area to attract the user's attention, thereby improving the user experience.

[0254] It should be understood that the above only provides a few conditions that should be met in order to display the avatar of the related person in the concerned person area, and this application does not limit this.

[0255] Optionally, the size of the person's avatar displayed in the focused person area can be predefined and will not change.

[0256] Optionally, the location of the focused person area may be predefined and will not change.

[0257] Optionally, the character portrait displayed in the focused area can be implemented using a component (such as a control). If the character portrait is not displayed in the focused area, the component is not displayed or is invisible.

[0258] In one possible implementation, a virtual button for implementing one or more setting functions may be set on the "Character" main page. Optionally, the virtual button may be implemented using a control. When the virtual button is triggered, the corresponding setting function may be implemented.

[0259] Optionally, the setting function may include one or more of the following: refreshing character relationships, and editing character relationship display.

[0260] Specifically, when the "refresh character relationship" function is triggered, the electronic device (or the "gallery" application) can obtain the character related information and character relationship information based on the media files in the media library (for details, please refer to Figure 4 The process shown in FIG3 is used), and the character-related information obtained in this processing is used to update the originally stored character-related information, and the character-relationship information obtained in this processing is used to update the originally stored character-relationship information.

[0261] Optionally, after the above-mentioned update operation is completed, the “Character” main page may be updated based on the updated character relationship information and character-related information.

[0262] Among them, through the "Edit Character Relationship Display" operation, the character relationships displayed in the "Character" main page can be adjusted according to the user's wishes. For example, the avatars of the associated characters in the first display area and the second display area can be swapped, or the arrangement order of the avatars of the associated characters in the second display area can be adjusted. Specifically, when the "Edit Character Relationship" function is triggered (which can be used as an example of the fifth user operation), the page can enter the editing mode. In the editing mode, the user is allowed to migrate the avatars of the associated characters in the second display area to the first display area, or the user is allowed to migrate the avatars of the associated characters in the first display area to the second display area, or the user is allowed to adjust the arrangement order of the avatars of the associated characters in the second display area. Correspondingly, the "Gallery" application can adjust the character relationships displayed in the "Character" main page according to the user's wishes in response to the user operation. The above-mentioned "Edit Character Relationship Display" operation does not change the character relationship information stored in the electronic device, that is, it does not change the degree of association between the associated characters and the central character.

[0263] In one possible implementation, the electronic device (or the "Gallery" application) can cache the contents of the first display area and the second display area after the "Edit Character Relationship Display" operation. When the "Gallery" application is not closed, the contents of the first display area and the second display area can be kept unchanged based on the cached content; when the "Gallery" application is closed, the cache is released; when the "Gallery" application is restarted, the "Character" main page will be displayed based on the character relationship information and character-related information stored in the electronic device. Of course, the contents of the first display area and the second display area after the "Edit Character Relationship Display" operation can also be persistently saved. When the "Gallery" application is closed, the persistently saved information will not be released. In this way, when the "Gallery" application is restarted, the avatars of the associated characters can be displayed in the first display area and the second display area based on the persistently saved information.

[0264] The following describes the specific implementation process of "Refresh Character Relationship" and "Edit Character Relationship" by taking the menu key set on the "Character" main page as an example.

[0265] See also Figure 7a , a "settings" menu button 640 is included in the upper right corner of the "character" main page. When the user clicks the "settings" menu button 640, in response, a first menu 650 is displayed on the screen of the electronic device. The first menu 650 includes a "refresh" menu option and an "edit" menu option.

[0266] When the user clicks the "Refresh" menu option in the first menu 650, in response, the electronic device (or the "Gallery" application) Figure 4The process shown updates the character-related information and character relationship information. Further, the "Character" main page can be refreshed based on the updated character-related information and character relationship information.

[0267] When the user clicks the "Edit" menu option in the first menu 650 (which can be used as an example of the fifth user operation), the "Character" main page enters the edit mode in response. In the edit mode, a "Delete" button (represented as a circle containing a minus sign in the figure) is displayed in the position of the associated character's portrait in the first display area, and an "Add" button (represented as a circle containing a plus sign in the figure) is displayed in the position of the associated character's portrait in the second display area.

[0268] like Figure 7b As shown, based on Figure 7a In the "Character" main page in the edit mode shown, when a user clicks the "Delete" button (shown as "-") on the avatar position of the associated person E in the first display area (which can be used as an example of a sixth user operation), in response, the avatar of the associated person E is moved to the second display area. Optionally, because the degree of association between the associated person E and the central person is higher than the degree of association between the other associated persons and the central person in the second display area, the associated person E can be arranged in a front position in the second display area, and the avatars of the original associated persons in the second display area can be moved back one position in turn.

[0269] like Figure 7c As shown, based on Figure 7a On the "Characters" main page in edit mode shown in the figure, when a user clicks the "Add" button (shown as "+") on the avatar position of the associated person G in the second display area (which can be used as an example of the sixth user operation), in response, the avatar of the associated person G is moved to the first display area. In the second display area, the avatars of the remaining associated people can be moved forward one position in turn.

[0270] Optionally, when the number of avatars of associated persons in the first display area reaches a maximum limit, the "Gallery" application can prompt the user that the maximum number has been reached and no longer allows the avatars of associated persons in the second display area to be moved to the first display area.

[0271] like Figure 7d As shown, based on Figure 7a In the "Character" main page of the editing mode shown, when the user drags the avatar of character H in the second display area and moves it to the position before the avatar of character G, in response, the avatar of character H and the avatar of character G exchange positions.

[0272] like Figure 7e As shown, based on Figure 7aIn the "Character" main page of the editing mode shown, when the user drags the avatar of character H in the second display area and moves it to a position after the avatar of character K, in response, the avatar of character H is displayed after the avatar of character K, and the avatars of characters I and J move forward one position respectively.

[0273] Optionally, after completing the “edit” operation, the user can restore the “character” main page from the edit mode to the normal display mode by clicking the confirmation key 660 .

[0274] In other embodiments, the "Character" main page can enter the editing mode through other methods, and the avatars of the associated characters in the first display area and the second display area can be swapped through a throwing operation (which can be used as an example of the sixth user operation) in the editing mode. For example, when the user long presses the avatar of the associated character E in the first display area, the editing mode can be entered. In the editing mode, the position of the avatar of the associated character may not need to display the "Delete" key and the "Add" key. In the editing mode, the user can "throw" the avatar of the associated character E in the direction of the second display area, and in response, the avatar of the associated character E is moved to the second display area. For another example, when the user long presses the avatar of the associated character G in the second display area, the editing mode can be entered. In the editing mode, the user can "throw" the avatar of the associated character G in the direction of the first display area, and in response, the avatar of the associated character G is moved to the first display area. Among them, the "throwing" operation is a drag operation with a relatively fast speed and a short moving distance.

[0275] In some embodiments of the present application, the user is allowed to set or edit character information for the central character and / or associated characters. The setting or editing function may include one or more of the following:

[0276] -Set character name;

[0277] - Setting character roles, which can also be understood as setting character relationships;

[0278] -Set (or change) the character's avatar;

[0279] -Merge similar characters;

[0280] -Reduce the chance of appearing in the character relationship display area.

[0281] It should be understood that the above are only exemplary examples of several possible setting functions and editing functions, and this application does not limit them.

[0282] When the electronic device (or the "Gallery" application) supports the above-mentioned multiple settings and editing functions, in order to facilitate user operation, multiple settings and editing function options can be provided to the user through a menu for the user to select and operate.

[0283] The following describes an example of providing users with several setting and editing functions such as character name setting, character role setting, character avatar replacement, merging similar characters, and reducing the chance of appearance in the character relationship display area through a menu.

[0284] In one possible implementation, Figure 8a As shown, in the first display area or the second display area, when the user long presses the avatar of an associated person (such as the avatar of associated person E in the figure), a second menu 670 may pop up. The second menu 670 includes one or more of the following options: set person name, set person role, set person avatar, merge similar persons, reduce appearance chance. Optionally, while the second menu 670 is displayed, the avatar of associated person E in the first display area may be kept normally displayed, and other content on the page may be faded or blurred, or the avatar of associated person E may be displayed more prominently than the avatars of other characters in other ways to remind the user that the settings for person E are currently being made.

[0285] like Figure 8b As shown, when the user clicks the "Set Character Name" option in the second menu 670, a character name setting window pops up, which may include controls such as an input box and a confirmation button. The user enters a character name in the input box of this window and clicks the confirmation button to complete the character naming operation. The character name can be the character's full name, nickname, or other name used to name the character.

[0286] After completing the character name setting operation, the "Gallery" application can update the name of the character in the character database, for example, adding the name of the associated person E to the character-related information corresponding to person E, such as adding it to the "Character Name" corresponding to person E in Table 1. On the "Character" main page, the name of the associated person E can be displayed around the avatar of the associated person E.

[0287] Optionally, if the user has previously set a name for the associated person E, then after completing the above operation, the "Gallery" application may update the name of the associated person E to the name set by the above naming operation.

[0288] like Figure 8cAs shown, when the user clicks the "Set Character" option in the second menu 670, a character setting window pops up, which may include multiple candidate characters and a confirmation button. The user can select one or more from the multiple candidate characters and click the confirmation button to complete the character setting operation.

[0289] After completing the character role setting operation, the "Gallery" application can update the character role of the character in the character database, for example, adding the role of the associated person E to the character related information corresponding to person E, such as adding it to the "Character Role" corresponding to person E in the character related information (such as Table 1). On the "Character" main page, the role of the associated person E can be displayed around the avatar of the associated person E.

[0290] Optionally, if the user has previously set a role for the associated person E, then after completing the above operation, the "Gallery" application may update the role of the associated person E to the role set by the above naming operation.

[0291] Optionally, since the role of the associated person E is relative to the current central person, after completing the role setting of the associated person E, the role of the current central person relative to the associated person E can also be set, and the role of the current central person relative to the associated person E can be added to the "character role" corresponding to the central person in the character-related information (such as Table 1). For example, if the role of the associated person E is set to: the associated person E is a colleague of the current central person through the above-mentioned role setting operation, then correspondingly, the role of the current central person can be set to: the current central person is a colleague of the associated person E. For another example, if the role of the associated person E is set to: the associated person E is the son of the current central person through the above-mentioned role setting operation, then correspondingly, the role of the current central person can be set to: the current central person is the father of the associated person E.

[0292] It should be understood that the functions of setting the character name and setting the character role can be combined into one option (for example, the option is called setting character information), and the setting functions of the character name and character role can be provided through one window.

[0293] like Figure 8d As shown, when the user clicks the "Set Person Avatar" option in the second menu 670, a person avatar setting window pops up. The window can display multiple photos, including the associated person E. Specifically, the multiple photos can be photos in the "Portrait Photos / Videos" list corresponding to the associated person E stored in the person database. The user can select a photo from the multiple photos and use the portrait of the associated person E in the photo as the new portrait.

[0294] Optionally, after completing the above operations, the "Gallery" application may store the new avatar of the associated person E in the person-related information corresponding to the person.

[0295] like Figure 8e As shown, when the user clicks the "Merge Similar People" option in the second menu 670, a similar person merging setting window pops up, which may include the avatars of the candidate merging people and a confirmation button. Among them, there can be one or more candidate merging people. The facial features of these candidate people are highly similar to the associated person E, and they may be the same person. This may be due to the fact that the image of the person in some photos or videos is not clear or the person's side or face is partially blocked, resulting in facial recognition errors. Taking the candidate merging people including people E1 and people E2 as an example, the facial feature information of person E1 is different from the facial feature information of the associated person E, but the similarity is high (for example, higher than a set threshold). Similarly, the facial feature information of person E2 is different from the facial feature information of the associated person E, but the similarity is high. The user can select one or more from the avatars of multiple candidate people and click the confirmation button to complete the merging operation of similar people (which can be used as an example of the eighth user operation).

[0296] Based on the merging operation of similar persons, the "Gallery" application updates the person-related information and person-relationship information in the person database.

[0297] Taking the example of a user choosing to merge character E1 (which can be used as an example of the second candidate merged character) with character E (which can be used as an example of the second character), the "Gallery" application can add the media file identifiers contained in the "portrait photo / video list" corresponding to character E1 in the character-related information (such as Table 1) to the "portrait photo / video list" corresponding to character E, and add the media file identifiers contained in the "associated photo / video list" corresponding to character E1 to the "associated photo / video list" corresponding to character E, and then delete all relevant information corresponding to character E1 (such as character identifier, facial feature information, character name, character role, character portrait, etc.). Regarding character relationship information. The "Gallery" application can redetermine and update the degree of association between character E and other characters (including the current central character) based on the character-related information after the characters are merged, and redetermine and update the associated characters of the current central character (the updated associated characters can be used as an example of the fifth associated character) and the degree of association with the associated characters.

[0298] If the degree of association between the associated person E and the current central person changes after similar persons are merged, the "Gallery" application can update the display of the avatar of the associated person E based on the updated degree of association between the associated person E and the current central person, such as updating the distance between the associated person E and the avatar of the central person, and / or updating the size of the avatar of the associated person E.

[0299] If the first display area or the second display area includes the head portrait of the person E1 before the similar persons are merged, the head portrait of the person E1 in the first display area and the second display area will be deleted after the similar persons are merged.

[0300] above Figure 8e The description is based on the example of selecting an associated person of the current central person and merging one or more candidate merged persons with the associated person. Using a similar method, a central person can also be selected and one or more candidate merged persons can be merged with the central person. Specifically, the electronic device (or the "Gallery" application) responds to the seventh user operation (for example, long pressing the central person's avatar, and selecting the option to merge similar persons in the pop-up menu, and selecting the first candidate merged person in the pop-up similar person merging setting window), merges the media files associated with the first candidate merged person with the media files associated with the central person, updates the associated persons corresponding to the central person according to the merged media files, and obtains a fourth associated person; the electronic device refreshes the page, and the refreshed page (which can be used as an example of the fourth page) includes a character relationship display area and a media file display area, the character relationship display area displays the avatar of the central person and the avatar of the fourth associated person, as well as the degree of association between the fourth associated person and the central person, and the media file display area displays the merged media files.

[0301] like Figure 8f As shown, when the user clicks the "Reduce Appearance Chance" option in the second menu 670, a prompt window pops up to prompt the user whether to confirm reducing the appearance chance of the associated person E. After the user confirms (which can be used as an example of a fourth user operation), the avatar of the associated person E is deleted from the first display area. The "Gallery" application reduces the association degree between the associated person E and the current central person, for example, to zero or to less than a set threshold, to ensure that the avatar of the associated person E does not appear in the first display area before the next update cycle of the character relationship information arrives.

[0302] above Figures 8a to 8fTaking the example of setting related characters, this embodiment of the application also allows users to set a central character. The method for setting a central character is basically the same as the method for setting related characters, except that the function for setting a central character does not include the function of reducing the chance of appearance. For example, when long pressing the central character's portrait, the pop-up menu may include one or more of the following options: set the character's name, set the character's role, set the character's portrait, and merge similar characters.

[0303] In some embodiments of the present application, the user is further allowed to change the central character so that the user can browse the media files associated with the new central character.

[0304] In an implementation method for replacing the central character, the electronic device (or the "Gallery" application) can refresh the "Character" main page in response to a user operation of setting an associated character in the first display area as the central character. In the refreshed "Character" main page, the avatar of the second character is displayed in the central character area of ​​the first display area in the character relationship display area, the avatars of a group of associated characters (called the first group of associated characters) corresponding to the second character are displayed in the associated character area in the first display area, and the media files associated with the second character are displayed in the media file display area.

[0305] Optionally, if the character relationship display area also includes a second display area, then the avatars of another group of associated characters (called the second group of associated characters) corresponding to the second character are displayed in the second display area, and the degree of association between the second group of associated characters and the second person is not higher than the degree of association between the first group of associated characters and the second character.

[0306] Optionally, the above-mentioned "user operation of setting a related character in the first display area as the central character" can be clicking on the second character's avatar, or dragging the second character's avatar toward the central character area, for example, dragging the second character's avatar into the central character area, which is not limited in this application.

[0307] See also Figure 9Taking the example of changing the central character from character A to character E, the implementation process of the above operation may include: the user clicks on the avatar of character E in the first display area (which can be used as an example of the second user operation), and after receiving the user operation, the electronic device (or the "gallery" application) obtains the associated characters of character E (which can be used as an example of the second associated characters) and the correlation between these associated characters and character E from the character relationship information stored in the character database in response, according to the identifier of character E, and divides these associated characters into a first group of associated characters and a second group of associated characters in descending order of correlation; The avatars, names, roles and other information of the first group of associated persons and the second group of associated persons are obtained from the information (for example, Table 1), and the media files associated with person E are obtained from the "associated photo / video list" corresponding to person E according to the identification of person E; then, based on the above information obtained, the "person" main page is refreshed, and in the refreshed page (which can be used as an example of the second page), the avatar of person E is displayed in the central person area of ​​the first display area, the avatars of the first group of associated persons are displayed in the associated person area, the avatars of the second group of associated persons are displayed in the second display area, and the media files associated with the second person are displayed in the media file display area.

[0308] Optionally, the name, role and other information of the person E may also be displayed in the position of the person E's portrait.

[0309] Optionally, the names, roles and other information of the characters may be displayed at the positions of the avatars of the first group of associated characters and / or the positions of the avatars of the second group of associated characters.

[0310] Optionally, after setting character E as the central character, character E is marked as the central character, so that when the "Gallery" application is opened again, character relationships and media files are displayed with character E as the central character.

[0311] In some embodiments of the present application, the user is further allowed to add central characters, so that the number of central characters is at least two.

[0312] In one implementation method of adding a central character, an electronic device (or a "Gallery" application) can refresh the "Character" main page in response to a user operation of adding a second character as the central character (the central character after addition includes the first character and the second character). In the refreshed "Character" main page, the avatar of the character combination is displayed in the central character area of ​​the first display area in the character relationship display area, and the character combination includes the first character and the second character. The avatars of a group of associated characters (called the first group of associated characters) corresponding to the character combination are displayed in the associated character area of ​​the first display area, and the media files associated with the character combination are displayed in the media file display area.

[0313] Among them, the avatar of the character combination can be the avatar of the first character and the avatar of the second character displayed in a stacked manner, or it can be a group photo avatar of the first character and the second character, which is not limited in this application.

[0314] Optionally, if the character relationship display area also includes a second display area, then the avatars of another group of associated characters (called the second group of associated characters) corresponding to the character combination are displayed in the second display area, and the degree of association between the second group of associated characters and the character combination is not higher than the degree of association between the first group of associated characters and the character combination.

[0315] Optionally, the above-mentioned "user operation of adding the second person as the central person" can be an operation of dragging the second person's avatar to the central person area, for example, dragging the second person's avatar into the central person area, which is not limited in this application.

[0316] In the case where both the user operation for replacing the central person and the user operation for adding the central person are avatar dragging operations, in order to distinguish them, it can be stipulated that: when the avatar of the associated person is completely dragged into the central person area and hovers for a period of time until a prompt to merge the central person appears, and the finger is lifted to end the dragging, this user operation indicates that the associated person is added as the central person. In the process of dragging the avatar of the associated person into the central person area, when a part of the avatar of the associated person enters the central person area, the finger is lifted to end the dragging, and this user operation indicates that the central person is replaced with the associated person; or, in the process of dragging the avatar of the associated person into the central person area, when the avatar of the associated person is completely dragged into the central person area and the finger is lifted to end the dragging before a prompt to merge the central person appears, this user operation indicates that the central person is replaced with the associated person.

[0317] See also Figure 10Taking the example of adding character B as the central character, the implementation process of the above operation may include: the user drags the avatar of character B into the central character area (which can be used as an example of a third user operation), and after receiving the user operation, the electronic device (or the "Gallery" application) obtains the associated characters of the character combination (A+B) and the correlation between these associated characters and the character combination (A+B) from the character relationship information stored in the character database in response to the identifier of character B (which can be used as an example of the second character) and the identifier of character A (which can be used as an example of the first character), and divides these associated characters into a first group of associated characters and a second group of associated characters in descending order of correlation; and from the character related information (such as Table 1) Obtain information such as the avatars of the first group of associated characters and the second group of associated characters, obtain the avatars of the character combination (A+B) from the relevant information corresponding to the character combination (for example, Table 2), and the "associated photo / video list" corresponding to the character combination, and obtain the media files associated with the character combination (A+B) according to the list; then, based on the above information obtained, refresh the "Character" main page, and on the refreshed page (which can be used as an example of the third page), display the avatars of the character combination (A+B) in the central character area of ​​the first display area, display the avatars of the first group of associated characters in the associated character area, display the avatars of the second group of associated characters in the second display area, and display the media files associated with the character combination (A+B) in the media file display area.

[0318] It should be understood that more characters can be formed into a character combination in the above manner, and the character combination can be used as the central character.

[0319] In some embodiments of the present application, when the central character includes multiple characters, the user may be allowed to delete one or more characters in the character combination that serves as the central character. For example, when the user clicks on the stacked character portraits, a window may pop up, in which the stacked character portraits are expanded and displayed, and the user may select one or more of the character portraits and select the confirmation deletion key. In response, the electronic device (or the "Gallery" application) may delete the character selected by the user from the central character and refresh the "Character" main page, displaying the updated central character and the portraits of the associated characters corresponding to the central character, as well as the media files associated with the updated central character in the refreshed page.

[0320] The following describes the media file display method provided by the embodiment of the present application with reference to the accompanying drawings.

[0321] In an embodiment of the present application, the media file display area displays media files (such as photos, videos, etc.) associated with the central person, or displays a list of media files, which includes thumbnails of photos and / or video frames. When a user clicks on a thumbnail of a photo in the list, the photo can be displayed in a pop-up window based on its actual size for the user to view.

[0322] Optionally, the thumbnails of the photos / videos in the media file display area may be displayed in the order of their shooting time by default.

[0323] Optionally, you can view more photo / video thumbnails by swiping up or down in the media file display area.

[0324] Optionally, the media file may be displayed according to other dimensions specified by the user through user interaction.

[0325] In some embodiments of the present application, the "Gallery" application allows users to browse media files from different dimensions, such as viewing all photos, or viewing only portrait photos.

[0326] Figure 11 Take the page shown as an example, see Figure 11 The media file display area of ​​the "People" main page includes a "Filter" button 710, which is a virtual button and can be implemented through a control. When the button is triggered, a third menu 711 may pop up, and the third menu 711 may include one of the following options: display all selected photos, display only people. When the "Show all selected photos" option is triggered, a list of all photos / videos associated with the central person is displayed in the media file display area. Taking the person-related information shown in Table 1 as an example, in this case, the corresponding photo / video list can be displayed according to the "Associated photo / video list" corresponding to the central person; when the "Show only people" option is triggered, a list of photos / videos containing portraits among all photos / videos associated with the central person is displayed in the media file display area. Taking the person-related information shown in Table 1 as an example, in this case, the corresponding photo / video list can be displayed according to the "Portrait photo / video list" corresponding to the central person.

[0327] Optionally, the photos / videos may be displayed in the order of their shooting time by default.

[0328] It should be understood that the options in the third menu 711 may be replaced by other options, or may include more options, and this application is not limited thereto. For example, the options in the third menu 711 may be replaced by one or more of the following options, or may further include one or more of the following options: display only photos, display only videos, display only portraits, display by time, display by location, display by shooting mode, display by object, etc.

[0329] In other embodiments of the present application, the "Gallery" application allows users to browse media files by different content categories, for example, allowing users to browse media files based on the dimension of photo / video tags. The attribute information of a photo / video may include a tag, which may indicate the category to which the content of the photo / video belongs. The tag may be obtained based on clustering or other semantic analysis methods. For example, by clustering the photos / videos, one or more of the following tags may be obtained: travel, food, pets, swimming, cycling, etc.

[0330] Figure 12 A schematic diagram showing a method of browsing media files based on their tags is shown. Figure 12 The media file display area on the "People" main page includes one or more category label buttons. The category label buttons are virtual buttons that can be implemented through controls. Each category label button corresponds to a label of a media file. Text or icons can be displayed on the category label button to indicate the label corresponding to the category label button. For example, Figure 12 In the example, the media file display area includes a "Tag 1" button 720 and a "Tag 2" 730. The tag corresponding to the "Tag 1" button 720 is "travel," and the tag corresponding to the "Tag 2" button 730 is "food." These tags are obtained by clustering the photos / videos associated with the central person. When the "Tag 1" button 720 (which can be used as an example of a first virtual button) is triggered, a list of photos / videos tagged with "travel" among the photos / videos associated with the central person can be displayed in the media file display area; when the "Tag 2" button 730 (which can be used as an example of a first virtual button) is triggered, a list of photos / videos tagged with "food" among the photos / videos associated with the central person can be displayed in the media file display area.

[0331] Optionally, the photos / videos may be displayed in the order of their shooting time by default.

[0332] It should be understood that the above only illustrates several possible tags by way of example, and the present application does not impose any limitation thereto.

[0333] In other embodiments of the present application, the "Gallery" application can display the geographical distribution of media files to users in combination with a map, and can browse media files in combination with tags of media files.

[0334] Figure 13a and Figure 13b A schematic diagram of displaying media files in combination with a map is shown. Figure 13aAs shown, the media file display area on the "People" main page includes a virtual button 740 (which can be used as an example of a second virtual button), which can be implemented using a control. When virtual button 740 is triggered, the screen display is refreshed, and the refreshed screen displays map album page 40 (which can be used as an example of a sixth page). Map album page 40 includes a map display area 41 and, optionally, a media file display area 42. Map display area 41 displays a map, and media file display area 42 displays a list of media files associated with the central person.

[0335] Text or an icon may be displayed on the virtual button 740 to indicate that the virtual button is used to trigger the display of the geographical distribution of the shooting locations of the media files in combination with the map. For example, the name of the first geographical location, such as the city name ("City A" as shown in the figure), the name of a block, etc. may be displayed on the map button 740. The first geographical location is one of the shooting locations of the photos / videos associated with the central character. Optionally, the number of photos / videos shot at the first geographical location is greater than the number of photos / videos shot at other locations. For example, if there are three shooting locations for the photos / videos associated with the central character, and the number of photos / videos shot at the first geographical location is the largest, the name of the first geographical location may be displayed on the virtual button 740. In another possible implementation, the following text may be displayed on the virtual button 740: "Map" or "Shooting Location Distribution", etc.

[0336] The map displayed in the map display area 41 may be roughly centered on the first geographic location. The user may zoom in, zoom out, or move the map in the map display area 41 by performing operations such as multi-finger pinching, multi-finger pinching, and dragging to view the map as desired or to view the geographic distribution of photos / videos associated with the central person.

[0337] On the map in the map display area 41, the shooting locations of the photos / videos associated with the central person can be marked to show the user the geographical distribution of the shooting locations of the photos / videos associated with the central person. For example, at the shooting location of the photo / video associated with the central person, a thumbnail of a photo can be displayed, which is a photo of the central person's photos shot at that location. Figure 13a As shown, the shooting locations of the photos / videos associated with the central person include City A, City B and City C. On the map, photo thumbnails are displayed at the locations of the three locations, and the thumbnail displayed at one city location is a thumbnail of the photo shot in that city.

[0338] One or more primary virtual buttons may also be displayed on the map album page 40, for example Figure 13aThe category label button named "Label 1", the category label button named "Label 2", the category label button named "Label 3", and the category label button named "Label 4" are virtual buttons that can be implemented through controls. Each first-level virtual button corresponds to a label of a media file, and these labels are obtained by clustering the photos / videos associated with the central character. For example, the label corresponding to the category label button named "Label 1" is travel, and the label corresponding to the category label button named "Label 2" is food. The name of the corresponding label or the icon of the corresponding label can be displayed on the first-level virtual button, and this application is not limited.

[0339] Optionally, these first-level virtual buttons can be displayed in the map display area 41 or in the media file display area 42, and this application does not impose any restrictions.

[0340] like Figure 13a As shown, when the user clicks on the location of "City A" or a thumbnail of a photo at that location on the map displayed in the map display area, the electronic device (or the "Gallery" application) refreshes the screen display in response, and on the refreshed map album page (which can be used as an example of the seventh page), a list of photos / videos associated with the central person and shot at "City A" is displayed, and one or more secondary virtual buttons, such as Figure 13a The category label button named "Label A1", the category label button named "Label A2", and the category label button named "Label A3" are virtual buttons that can be implemented through controls. Each secondary virtual button corresponds to a label of a media file, and these labels are obtained by clustering the photos / videos associated with the central character whose shooting location is "City A". For example, the label corresponding to the category label button named "Label A1" is food, and the label corresponding to the category label button named "Label A2" is swimming. The name of the corresponding label or the icon of the corresponding label can be displayed on the secondary virtual button, which is not limited in this application.

[0341] When a secondary virtual button is triggered, the map album page is refreshed. The media file display area in the refreshed map album page displays a list of photos / videos with corresponding tags in the photos / videos associated with the central person and shot in "City A", allowing users to browse photos / videos with a certain tag in photos / videos shot at a certain location, such as browsing food photos / videos shot in City A.

[0342] See also Figure 13bWhen the user clicks the first-level virtual button named "Tag 4" (which can be used as an example of the third virtual button), in response, the electronic device (or the "Gallery" application) refreshes the screen display. On the refreshed map album page (which can be used as an example of the eighth page), the location distribution of the shooting locations of the photos / videos with the tag "Tag 4" (such as "Food") in the photos / videos associated with the central person is displayed in the map display area. For example, Figure 13b As shown, among the photos / videos associated with the central person, the photo / video tagged "Tag 4" does not have a shooting location that includes "City A." Therefore, compared to before the refresh, the map within the map display area no longer identifies "City A" or displays the photo thumbnail at the location of "City C." In this way, the location distribution of shooting locations for media files with a certain tag (or media files of the same content category) can be displayed on a map based on tags.

[0343] like Figure 13b As shown, on the refreshed map album page, a list of photos / videos tagged with "Tag 4" among the photos / videos associated with the central person is displayed in the media file display area.

[0344] In other embodiments of the present application, the "Gallery" application can display the geographical distribution of media files to users in combination with a map, and can browse media files in combination with the characters contained in the media files.

[0345] Figure 14a and Figure 14b A schematic diagram of displaying media files in combination with a map is shown. Figure 14a As shown, the media file display area in the "Character" main page includes a virtual button 740 (which can be used as an example of the fourth virtual button), which can be implemented through a control. When virtual button 740 is triggered, the screen display is refreshed, and the refreshed screen displays the map album page 50 (which can be used as an example of the ninth page). The map album page 50 includes a map display area 51 and can optionally include a media file display area 52. The map display area 51 displays a map, and the media file display area 52 displays a list of media files associated with the central character.

[0346] The shooting locations of the photos / videos associated with the central person can be marked on the map in the map display area 51 to show the user the geographical distribution of the shooting locations of the photos / videos associated with the central person. For example, a thumbnail of a photo associated with the central person that was shot at that location can be displayed at the shooting location of the photo / video associated with the central person. The thumbnail is a photo of the central person that was shot at that location.

[0347] One or more primary virtual buttons may also be displayed on the map album page 50, for example Figure 14a The first-level virtual button named "Character 1", the first-level virtual button named "Character 2", the first-level virtual button named "Character 3", and the first-level virtual button named "Character 4" are virtual buttons that can be implemented through controls. Each first-level virtual button corresponds to the identifier of an associated character of the central character. For example, the first-level virtual button named "Character 1" corresponds to the identifier of Character 1, and the first-level virtual button named "Character 2" corresponds to the identifier of Character 2. Character 1 and Character 2 are associated characters of the central character. The first-level virtual button can display information such as the corresponding character's avatar, name or role, which is not limited in this application.

[0348] Optionally, these first-level virtual buttons can be displayed in the map display area 51 or in the media file display area 52, and this application does not impose any restrictions.

[0349] like Figure 14a As shown, when the user clicks on the location of "City A" or the thumbnail of the photo at that location on the map displayed in the map display area, the electronic device (or the "Gallery" application) refreshes the screen display in response, and on the refreshed map album page (which can be used as an example of the tenth page), a list of photos / videos with the shooting location of "City A" in the photos / videos associated with the central character is displayed, and one or more secondary virtual buttons can also be displayed. The secondary virtual buttons are virtual buttons and can be implemented through controls. Each secondary virtual button corresponds to the identification of a character, and the character is a character included in the photos / videos with the shooting location of "City A" in the photos / videos associated with the central character. The character corresponding to the secondary virtual button is a subset of the character corresponding to the primary virtual button. The secondary virtual button can display information such as the corresponding marked character's avatar, name or role, which is not limited by this application.

[0350] When a secondary virtual button is triggered, the map album page is refreshed. The media file display area in the refreshed map album page displays the photos / videos associated with the central person, the shooting location of which is "City A", and a list of photos / videos containing the corresponding person, allowing users to browse the photos / videos taken at a certain location that contain photos / videos of a specified person.

[0351] See also Figure 14bWhen the user clicks the first-level virtual button named "Person 4" (which can be used as an example of the fifth virtual button), in response, the electronic device (or the "Gallery" application) refreshes the screen display, and on the refreshed map album page (which can be used as an example of the eleventh page), the location distribution of the shooting locations of the photos / videos of Person 4 in the photos / videos associated with the central person is displayed in the map display area. For example, Figure 14b As shown, among the photos / videos associated with the central person, the photo / video tagged "Person 4" does not have a shooting location that includes "City C." Therefore, compared to before the refresh, the map within the map display area no longer has "City C" marked on it, or the photo thumbnail is no longer displayed at the location of "City C." In this way, the location distribution of the shooting locations of media files containing a certain person can be displayed on the map based on the person.

[0352] like Figure 14b As shown, on the refreshed map album page, the photos / videos associated with the central person displayed in the media file display area include a list of photos / videos of person 4.

[0353] It should be understood that the above only exemplifies the method of displaying media files from the dimensions of shooting location, tags and people, and this application does not limit this. For example, media files can also be displayed from the dimensions of shooting location and shooting time, or media files can be displayed based on a combination of the above multiple dimensions.

[0354] In some embodiments of the present application, if the "Character" main page includes a theme album display area, then the theme album display area displays theme albums associated with the central character. The present application embodiment does not limit the method for generating theme albums.

[0355] by Figure 6b Taking the "People" homepage shown as an example, the theme album display area includes three theme album covers named "Theme Album 1," "Theme Album 2," and "Theme Album 3." When a user clicks the theme album cover named "Theme Album 1," the electronic device can respond by displaying the content of the theme album, for example, playing the photos contained in the theme album.

[0356] Figure 15 and Figure 16 Schematic diagram of the structure of possible devices provided by the embodiments of the present application. These devices can be used to implement the functions of the electronic devices in the above method embodiments, and thus can also achieve the beneficial effects of the above method embodiments. In the embodiments of the present application, the device can be Figure 1 or Figure 2 The electronic device shown may also be a module (such as a chip) applied to an electronic device.

[0357] like Figure 15 As shown, the device 1500 includes a processing unit 1510 and an interface unit 1520. The device 1500 is used to implement the functions of the electronic device in the above method embodiment.

[0358] Specifically, the interface unit 1520 receives a first user operation; the processing unit 1510 is used to display a first page in response to the first user operation, wherein the first page includes a character relationship display area and a media file display area, wherein the character relationship display area displays the avatar of the first character and the avatar of the first associated character corresponding to the first character, as well as the degree of association between the first associated character and the first character, wherein the first character, the first associated character and the degree of association are determined based on the media files stored in the electronic device, and the number of the first associated characters is at least one, and the media file display area displays the media files associated with the first character.

[0359] A more detailed description of the processing unit 1510 and the interface unit 1520 can be directly obtained by referring to the relevant description in the method embodiment shown in the relevant drawings, and will not be repeated here.

[0360] like Figure 16 As shown, device 1600 may include: a memory 1601, one or more processors 1602, and one or more computer programs (not shown). The above components may be coupled via one or more communication buses 1603. Optionally, when device 1600 is used to implement the method performed by the electronic device provided in the embodiments of the present application, device 1600 may also include a display screen 1604.

[0361] Memory 1601 stores one or more computer programs (codes), each of which includes computer instructions. Processors 1602 invoke the computer instructions stored in memory 1601 to cause device 1600 to execute the methods provided in the embodiments of this application. Display screen 1604 is used to display images, videos, application interfaces, and other related user interfaces.

[0362] In a specific implementation, the memory 1601 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more disk storage devices, flash memory devices or other non-volatile solid-state storage devices. The memory 1601 can store an operating system (hereinafter referred to as system), such as ANDROID, IOS, WINDOWS, or embedded operating systems such as LINUX. The memory 1601 can be used to store the implementation program of the embodiment of the present application. The memory 1601 can also store a network communication program, which can be used to communicate with one or more additional devices, one or more user devices, or one or more network devices. The one or more processors 1602 can be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the present application.

[0363] It should be noted that Figure 16 This is only one implementation of the device 1600 provided in the embodiment of the present application. In actual applications, the device 1600 may also include more or fewer components, which is not limited here.

[0364] Based on the above embodiments and the same concept, an embodiment of the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a computer, the computer executes the method performed by the electronic device in the method provided in the above embodiment.

[0365] Based on the above embodiments and the same concept, an embodiment of the present application also provides a computer program product, which includes a computer program or instructions. When the computer program or instructions are run on a computer, the computer executes the method performed by the electronic device in the method provided in the above embodiments.

[0366] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0367] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0368] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0369] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 The steps for the function specified in one or more boxes.

[0370] Obviously, those skilled in the art may make various changes and modifications to this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.

Claims

1. A method for displaying a media file, characterized in that: Used in electronic equipment, including: receiving a first user operation; In response to the first user operation, a first page is displayed, the first page including a character relationship display area and a media file display area, the character relationship display area displays the avatar of the first character and the avatar of the first associated character corresponding to the first character, as well as the degree of association between the first associated character and the first character, the first character, the first associated character and the degree of association are determined based on the media files stored in the electronic device, the number of the first associated characters is at least one, and the media file display area displays the media files associated with the first character.

2. The method according to claim 1, wherein The character display area displays the degree of association between the first associated character and the first character, including: The distance between the portrait of the first associated person and the portrait of the first person is positively correlated with the degree of association between the first associated person and the first person; and / or, The size of the avatar of the first associated person is positively correlated with the degree of association between the first associated person and the first person.

3. The method according to claim 2, wherein The avatars of the first associated person are arranged around the avatar of the first person in a surrounding manner.

4. The method according to any one of claims 1 to 3, wherein Also includes: receiving a second user operation for replacing the first character with a second character, where the second character is one of the first associated characters; In response to the second user operation, a second page is displayed, and the second page includes a character relationship display area and a media file display area. The character relationship display area displays the avatar of the second character and the avatar of the second associated character corresponding to the second character, as well as the degree of association between the second associated character and the second character. The second associated character and the degree of association are determined based on the media files stored in the electronic device, and the media file display area displays the media files associated with the second character.

5. The method according to claim 4, wherein The second user operation is: Click on the second person's profile picture; or, Drag the second person's avatar to the area where the first person's avatar is located on the first page.

6. The method according to any one of claims 1 to 3, wherein: Also includes: receiving a third user operation on an avatar of a second person, the third user operation being used to combine the second person and the first person to obtain a first person combination, wherein the second person is one of the first associated persons; In response to the third user operation, a third page is displayed, and the third page includes a character relationship display area and a media file display area. The character relationship display area displays the avatar of the first character combination and the avatar of the third associated character associated with the first character combination, as well as the degree of association between the third associated character and the first character combination. The third associated character and the degree of association are determined based on the media files stored in the electronic device. The media file display area displays the media files associated with the first character combination.

7. The method according to claim 6, wherein The third user operation is: Drag the second person's avatar to the area where the first person's avatar is located.

8. The method according to any one of claims 1 to 3, wherein: Also includes: receiving a fourth user operation on an avatar of a second person, the fourth user operation being used to reduce a chance of the second person appearing in the person relationship display area; wherein the second person is one of the first associated persons; In response to the fourth user operation, the association degree between the second character and the first character is set to zero or set to be less than a threshold, or the association degree between the second character and the first character is reduced, and the avatar of the second character is deleted from the character relationship display area.

9. The method according to any one of claims 1 to 3, wherein: The first associated person includes a first group of associated persons and a second group of associated persons, and the degree of association between the second group of associated persons and the first person is not higher than the degree of association between the first group of associated persons and the first person; The character relationship display area includes a first display area and a second display area, the first display area displays the avatar of the first character and the avatars of the first group of associated characters, and the second display area displays the avatars of the second group of associated characters.

10. The method according to claim 9, wherein The avatars of the second group of associated persons have the same size, and / or the avatars of the second group of associated persons are arranged in rows or columns.

11. The method according to any one of claims 9 to 10, wherein: Also includes: receiving a fifth user operation, and entering an edit mode in response to the fifth user operation; In the editing mode, a sixth user operation is received, and in response to the sixth user operation, the avatars of the second group of associated characters in the second display area are moved to the first display area, or the avatars of the associated characters in the first display area are moved to the second display area.

12. The method according to any one of claims 1-3, 8-11, characterized in that Also includes: When it is detected that a third person is looking at the electronic device, the portrait of the third person is displayed on the first page.

13. The method according to any one of claims 1 to 3 and 8 to 11, wherein: Also includes: When it is detected that the number of photos and / or videos containing a third person increases and the number of increases is greater than or equal to a threshold, the avatar of the third person is displayed on the first page.

14. The method according to any one of claims 1 to 3 and 8 to 11, wherein: Also includes: When it is detected that the photos containing the third person have not been added within the first time period, the head portrait of the third person is displayed on the first page.

15. The method according to any one of claims 12 to 14, wherein: The third person is one of the first related persons.

16. The method according to any one of claims 1-3, 8-11, characterized in that Also includes: receiving a seventh user operation, wherein the seventh user operation is used to merge the first candidate merged character with the first character; In response to the seventh user operation, merging the media files associated with the first candidate merged persona with the media files associated with the first persona, and updating the associated person corresponding to the first persona based on the merged media files to obtain a fourth associated persona; The fourth page is displayed, and the fourth page includes a character relationship display area and a media file display area. The character relationship display area displays the avatar of the first character and the avatar of the fourth associated character, as well as the degree of association between the fourth associated character and the first character. The media file display area displays the merged media files.

17. The method according to any one of claims 1 to 3 and 8 to 11, wherein: Also includes: receiving an eighth user operation for merging the second candidate merged persona with a second persona, where the second persona is one of the first associated persons; In response to the eighth user operation, merging the media file associated with the second candidate merged persona with the media file associated with the second persona, updating the associated person corresponding to the first persona based on the merged media file to obtain a fifth associated persona, and updating the person associated with the second persona based on the merged media file. The fifth page is displayed, and the fifth page includes a character relationship display area and a media file display area. The character relationship display area displays the avatar of the first character and the avatar of the fifth associated character, as well as the degree of association between the fifth associated character and the first character. The media file display area displays media files associated with the first character.

18. The method according to any one of claims 1 to 3 and 8 to 11, wherein: The media files associated with the first person include: photos and / or videos of the first person; and one or more of the following: Photos / videos whose shooting time falls within the time period corresponding to the shooting time of the first photo and / or video, where the first photo and / or video is a photo and / or video including the first person; Photos / videos taken at the same location as the first photo and / or video.

19. The method according to any one of claims 1-3, 8-11, characterized in that Also includes: The degree of association between the first associated person and the first person is set according to one or more of the following: the number of photos of the first associated person and the first person; Annotation information of the first associated person, the annotation information including one or more of name, role, and remarks; whether the first associated person is a contact in the first person's address book; whether the first associated person is a social application friend of the first person; The frequency of interaction between the first associated person and the first person, where the interaction includes phone calls and / or social application interactions.

20. The method according to any one of claims 1 to 19, wherein The media file display area includes at least one virtual button, each of the at least one virtual button corresponds to a label, and the label is obtained by clustering photos and / or videos associated with the first person; The method further comprises: When a first virtual key among the at least one virtual key is triggered, photos and / or videos associated with the first person and having a tag corresponding to the first virtual key are displayed in the media file display area.

21. The method according to any one of claims 1 to 3 and 8 to 11, wherein: The media file display area includes a second virtual key, and the method further includes: When the second virtual button is triggered, a sixth page is displayed, the sixth page including a map display area and a media file display area, the map display area displays a map showing the location distribution of the shooting locations of the photos and / or videos in the first media file collection, the media file display area displays a list of the photos and / or videos in the first media file collection, and the map display area or the media file display area further includes at least one primary virtual button; Among them, each virtual key in the at least one first-level virtual key corresponds to a label, and the label is obtained by clustering photos and / or videos in the first media file collection, and the first media file collection includes photos and / or videos associated with the first person.

22. The method according to claim 21, wherein Also includes: When the photo thumbnail corresponding to the first geographic location in the map display area is triggered, the seventh page is displayed, and the seventh page includes a media file display area, and the media file display area displays a list of photos and / or videos in the second media file collection, and at least one secondary virtual button; wherein, the first geographic location is one of the shooting locations of the photos and / or videos associated with the first person, and the second media file collection includes photos and / or videos associated with the first person, whose shooting location is the first geographic location, and each virtual key in the at least one secondary virtual button corresponds to a label, and the label is obtained by clustering the photos and / or videos in the second media file collection.

23. The method according to claim 21, wherein Also includes: When the third virtual key among the at least one first-level virtual key is triggered, an eighth page is displayed, and the eighth page includes a map display area and a media file display area, the map display area displays a map, and the map shows the location distribution of the shooting locations of the photos and / or videos in the third media file collection, and the media file display area displays a list of photos and / or videos in the third media file collection; wherein, the third media file collection includes photos and / or videos associated with the first person and having the label corresponding to the third virtual key.

24. The method according to any one of claims 1 to 3 and 8 to 11, wherein: The media file display area includes a fourth virtual key, and the method further includes: When the second virtual button is triggered, a ninth page is displayed, the ninth page including a map display area and a media file display area, the map display area displays a map showing the location distribution of the shooting locations of the photos and / or videos in the first media file collection, the media file display area displays a list of the photos and / or videos in the first media file collection, and the map display area or the media file display area further includes at least one primary virtual button; Each virtual key in the at least one first-level virtual key corresponds to one of the first associated characters, and the first media file set includes photos and / or videos associated with the first character.

25. The method of claim 24, wherein: Also includes: When the photo thumbnail image corresponding to the first geographic location in the map display area is triggered, a tenth page is displayed, the tenth page including a map display area and a media file display area, the map display area displays a map showing the location distribution of the shooting locations of the photos and / or videos in the first media file collection, the media file display area displays a list of photos and / or videos in the second media file collection, and the map display area or the media file display area further includes at least one secondary virtual button; In which, the first geographic location is one of the shooting locations of the photos and / or videos associated with the first person, the second media file collection includes photos and / or videos associated with the first person, the shooting location of which is the first geographic location, each virtual key in the at least one secondary virtual key corresponds to one of the first associated persons, and the person is a person included in the photos and / or videos associated with the first person, the shooting location of which is the first geographic location.

26. The method of claim 24, wherein: Also includes: When the fifth virtual key among the at least one first-level virtual key is triggered, the eleventh page is displayed, and the eleventh page includes a map display area and a media file display area, the map display area displays a map, and the map displays the location distribution of the shooting locations of the photos and / or videos in the third media file collection, and the media file display area displays a list of photos and / or videos in the third media file collection; wherein, the third media file collection includes photos and / or videos associated with the first person, and includes photos and / or videos of the person corresponding to the fifth virtual key.

27. An electronic device, characterized in that: The method comprises a unit or module for executing the method according to any one of claims 1 to 26.

28. An electronic device, characterized in that: include: The one or more processors are configured to perform the method of any one of claims 1-26.

29. A readable storage medium, characterized in that The readable storage medium stores a program or instruction, and when the program or instruction is executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 26.

30. A chip system, characterized in that: The device comprises a processor for supporting a computer device to implement the method according to any one of claims 1 to 26.

Images