Method and apparatus for generating memory video, and electronic device

Abstract

The present application relates to the field of picture processing, and provides a method and apparatus for generating a memory video, and an electronic device. By means of a first operation of a user on a first picture, an electronic device displays a second display interface comprising a memory entry area; and by means of a second operation of the user on the memory entry area, the electronic device searches for pictures matching at least one person of the first picture, so as to finally generate a first memory video specific to the at least one person. In this way, a condition of actively triggering a memory function is friendly provided for a user by means of the first display interface and the first operation, and a condition for generating the memory function is friendly provided for the user by means of the second display interface and the second operation, so that the user can, on the basis of its own requirements, execute an operation on pictures of a person whom the user is interested in, to generate a memory video, thereby satisfying actual requirements of the user, and well improving user experience.

Description

Method, device and electronic device for generating memory video

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on June 30, 2023, with application number 202310809761.0 and application name “A method, device and electronic device for generating memory videos”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of image processing, and more specifically, to a method, device, and electronic device for generating a memory video in the field of image processing. Background Art

[0003] Currently, in smart electronic devices such as mobile phones and tablets, applications such as the electronic devices' gallery will automatically filter pictures of the same related theme according to filtering conditions such as time, place, environment, people, and groups, and generate a collection of pictures or videos of exclusive themes. The collection of pictures or videos of exclusive themes includes multiple pictures, allowing users to view pictures of specific time periods, specific people, specific environments, and specific groups.

[0004] However, the above-mentioned solution for generating a collection of pictures or videos of exclusive themes does not take into account the actual needs of users, resulting in a poor sense of control for users. Users are unable to view the collection of pictures or videos of their favorite characters, resulting in a poor user experience.

[0005] Summary of the Invention

[0006] The embodiment of the present application provides a method for generating a memory video, which allows users to generate a memory video by performing operations on pictures of people they are interested in based on their needs, thereby meeting the actual needs of users and greatly improving the user experience.

[0007] In a first aspect, a method for generating a recall video is provided, comprising:

[0008] Displaying a first display interface, wherein the first display interface includes a first picture, and the first picture includes a plurality of characters;

[0009] In response to a first operation of the user on the first picture, displaying a second display interface, wherein the second display interface includes a memory entrance area;

[0010] In response to a second operation of the user on the memory entrance area, extracting features of at least one of the multiple characters to obtain a feature result;

[0011] Performing an image search based on the feature result to obtain a first image collection, wherein each image in the first image collection includes a person that matches the at least one person;

[0012] generating a first recollection video according to the first picture collection, wherein the first recollection video includes at least part of the pictures in the first picture collection;

[0013] A third display interface is displayed, and the first recollection video is played on the third display interface.

[0014] In a method for generating a memory video provided by an embodiment of the present application, a user performs a first operation on a first image, causing the electronic device to display a second display interface including a memory entry area. The user performs a second operation on the memory entry area, causing the electronic device to search for images matching at least one person in the first image, ultimately generating a first memory video dedicated to the at least one person. That is, each image in the first memory video includes a person matching the at least one person. In this way, the user can reminisce about the past through the first memory video, solving the problem of memory interruption when browsing images. Most importantly, the first display interface and the electronic device recognize a first operation, providing user-friendly conditions for actively triggering the memory function. The second display interface and the electronic device recognize a second operation, providing user-friendly conditions for generating the memory function. This allows the user to perform an operation on images of a person of interest based on their needs to generate a memory video, thereby meeting the user's actual needs and significantly improving the user experience. Furthermore, since the user can perform the first operation on an image generated at any time to actively trigger the memory function, the real-time nature of triggering the memory function is improved, further enhancing the user experience. Furthermore, viewing multiple images through memory video playback avoids the user having to click on multiple images one by one, saving user operations and further improving the user experience.

[0015] In addition, it is understandable that the most common scenario for users to want to find pictures of related people is that when browsing a certain picture (for example, the first picture), the user thinks of certain people or things, so he wants to recall the past. Therefore, actively triggering the recall function by performing the first operation on the first picture that the user is browsing is more in line with the user's behavioral habits and provides a better user experience.

[0016] In summary, the method for generating a memory video provided in the embodiment of the present application considers user needs from various angles in a friendly manner and greatly improves the user experience.

[0017] Optionally, in response to the user's second operation on the memory entry area, extracting features of at least one of the multiple characters to obtain feature results includes:

[0018] In response to the second operation, displaying a fourth display interface, wherein the fourth display interface includes the recognized pictures of the multiple characters;

[0019] In response to a user selecting a character picture of at least one character among the multiple characters, feature extraction is performed on the at least one character to obtain the feature result.

[0020] The method for generating a memory video provided in an embodiment of the present application is that, for the first picture currently being browsed, the user actively triggers the memory function. Since the user can select any person in the picture based on his or her preferences (at least one person selected), the electronic device can filter out pictures that match the arbitrary person, providing the user with a more flexible selection space, allowing the user to more flexibly select a person based on his or her preferences. By including a memory video of any person, the user can recall the historical moments related to the arbitrary person, which can better meet the user's actual needs and better improve the user experience.

[0021] Optionally, displaying a second display interface in response to a first operation performed by a user on the first image includes:

[0022] In response to the first operation, if the first image has been analyzed to include a person and the first image exists in an existing memory video, the second display interface is displayed, the memory entry area of ​​the second display interface includes a first memory entry and a second memory entry, the first memory entry is used to display the existing memory video according to the user operation, and the second memory entry is used to generate a new memory video; and

[0023] In response to the second operation, displaying a fourth display interface, wherein the fourth display interface includes the recognized pictures of the multiple characters, including:

[0024] In response to a user operation on the second memory entrance, the fourth display interface is displayed.

[0025] In the method for generating a memory video provided in an embodiment of the present application, for an embodiment in which an electronic device generates a memory video of an arbitrary person based on an arbitrary person selected by a user, although the first picture already exists in the existing memory video, the user can display the existing memory video through the first memory entrance of the second display interface. However, for the same picture (first picture), the person selected by the user at different times may be different. Therefore, the second memory entrance provides the user with the possibility of generating a new memory video again, provides a more flexible selection space, and provides a better user experience.

[0026] Optionally, in response to the user's second operation on the memory entry area, extracting features of at least one of the multiple characters to obtain feature results includes:

[0027] In response to the second operation, feature extraction is performed on all the characters in the plurality of characters to obtain the feature results.

[0028] In the method for generating a memory video provided in an embodiment of the present application, after detecting the second operation, the electronic device directly extracts features of all the characters in the first picture to perform an image search. Compared with the embodiment in which the user can select any character, although the flexibility of the user in selecting the character is weakened, due to the lack of some human-computer interaction, it is not only convenient to implement but also saves processing time.

[0029] Optionally, in response to the user's second operation on the memory entry area, extracting features of at least one of the multiple characters to obtain feature results includes:

[0030] In response to the second operation, when the number of people in the first picture is less than or equal to a first number threshold N1, feature extraction is performed on at least one of the multiple people to obtain the feature result, where N1 is an integer greater than 1.

[0031] The method for generating a memory video provided in an embodiment of the present application takes into account the processing capabilities of current electronic devices. If the number of people that need to be matched is too large, the electronic device may not be able to perform feature matching on the excessive number of people, thereby affecting the generation of the memory video. Therefore, when the number of people in the first picture is less than or equal to the first number threshold N1, features of at least one person are extracted, and then matching pictures are found to generate a memory video.

[0032] Optionally, in response to the user's second operation on the memory entry area, extracting features of at least one of the multiple characters to obtain feature results includes:

[0033] In response to the second operation, if the number of characters in the first picture is greater than a first number threshold N1, displaying a fifth display interface, the fifth display interface including pictures of N1 characters among the plurality of characters, where N1 is an integer greater than 1;

[0034] In response to a user selecting a character picture of at least one character among the N1 characters, feature extraction is performed on the at least one character to obtain the feature result.

[0035] The method for generating a memory video provided in an embodiment of the present application takes into account the processing capabilities of current electronic devices. If the number of characters that need to be matched is too large, the electronic device may not be able to perform feature matching on the excessive number of characters, thereby affecting the generation of the memory video. Therefore, when the number of characters in the first picture is greater than the first number threshold N1, the electronic device recommends the largest number of N1 characters to the user, allowing the user to select any at least one character from the N1 characters. In this way, the electronic device can extract features of at least one character, and then search for matching pictures to generate a memory video.

[0036] Optionally, in response to the second operation, when the number of people in the first picture is greater than a first number threshold N1, displaying a fifth display interface includes:

[0037] In response to the second operation, when the number of people in the first picture is greater than a first number threshold N1,

[0038] Determine the top N1 figures in terms of facial area proportion according to the order of facial area proportion of the multiple figures from largest to smallest;

[0039] The fifth display interface is displayed.

[0040] In the method for generating a memory video provided by the embodiment of the present application, when there are a large number of people in the picture, it is inevitable that the faces of some people occupy a small area of ​​the entire picture, and the faces of some people cannot even be seen, which affects the feature extraction of the people and further affects the search for pictures of related people. Therefore, N1 people with a larger face area ratio are recommended to the user based on the face area ratio, so that the features of the people can be extracted as well as possible to find pictures of related people without affecting the user experience.

[0041] Optionally, generating a first memory video based on the first picture collection includes:

[0042] If the number of pictures in the first picture collection is less than or equal to a second number threshold N2, all pictures in the first picture collection are determined as pictures of the first recollection video, where N2 is an integer greater than 1;

[0043] If the number of pictures in the first picture collection is greater than N2, determining a second picture collection based on the first picture collection;

[0044] Generate the first memory video based on the second picture collection.

[0045] The method for generating a memory video provided in an embodiment of the present application, if the number of pictures in the memory video is too large, will consume the user's time and cause problems such as aesthetic fatigue, and the user's experience of enjoying the memory video will not be very good. Therefore, by setting the second number threshold N2, the number of pictures in the generated memory video can be made as appropriate as possible, so that the user can better experience the wonderful process of video playback. In this way, when the number of pictures in the first picture collection is greater than N2, the electronic device further filters pictures from the first picture collection, and generates a first memory video based on the filtered second picture collection, so that the user can have a relatively wonderful experience when enjoying the pictures in the memory video.

[0046] Optionally, determining the second picture collection according to the first picture collection includes:

[0047] The second picture collection is determined from the first picture collection according to generation time of all pictures in the first picture collection.

[0048] Optionally, determining the second picture collection according to the first picture collection includes:

[0049] When the number M of time periods in which the generation time of all images in the first image collection is distributed is greater than or equal to N2, one image is filtered from the first image collection in each of the M time periods to obtain the second image collection, where the second image collection includes M images, where M is an integer greater than or equal to 1.

[0050] The method for generating a memory video provided in an embodiment of the present application takes into account that the time range of the generation time distribution of all pictures in the first picture collection is relatively long. When screening pictures, one picture is selected within each time period as much as possible. This helps the user to recall events with relatively uniform time intervals through related pictures of at least one person in the first picture, which can reduce the user's memory gaps to a certain extent.

[0051] Optionally, generating the first recollection video based on the second picture collection includes:

[0052] Select N2 pictures from the second picture collection;

[0053] The N2 pictures are determined as pictures of the first recollection video.

[0054] Optionally, screening N2 pictures from the second picture collection includes:

[0055] In descending order of aesthetic scores, the top N2 pictures in aesthetic scores are filtered from the second picture collection to obtain the N2 pictures.

[0056] The method for generating a memory video provided in an embodiment of the present application selects pictures with higher aesthetic scores from the second picture collection. In this way, the quality of the pictures in the first memory video is better, which can better improve the user's visual experience.

[0057] Optionally, determining the second picture collection according to the first picture collection includes:

[0058] When the number M of time periods in the M time periods in which the generation times of all images in the first image collection are distributed is greater than or equal to N2, from the first image collection, one image is selected in each of the N2 time periods that are earlier in the M time periods in time order from far to near to obtain the second image collection, where the second image collection includes N2 images, and M is an integer greater than or equal to 1.

[0059] The method for generating a memory video provided in an embodiment of the present application is based on actual conditions. If it is necessary to control the number of pictures in the second picture collection to be less than or equal to N2, and the number M of time periods in the M time periods in which the generation times of all pictures in the first picture collection are distributed is greater than or equal to N2, since the user's memory of events that occurred more recently is relatively vague, screening out a picture from each of the first N2 time periods that are more recently can enable the user to better recall events that occurred more recently through pictures, thereby improving the user experience.

[0060] Optionally, determining the second picture collection according to the first picture collection includes:

[0061] When the number M of time periods in which the generation time of all pictures in the first picture collection is distributed is less than N2, at least one picture is screened from the first picture collection in each of the M time periods to obtain the second picture set, and the second picture collection includes N2 pictures, where M is an integer greater than or equal to 1.

[0062] The method for generating a memory video provided in an embodiment of the present application selects at least one image within each time period when the time span of the generation times of all images in the first image collection is not very long, but the number of images is large. This allows for the selection of a relatively large number of images. Secondly, since each time period corresponds to at least one image, this helps the user recall events with relatively uniform time intervals through images related to at least one person in the first image, thereby reducing memory gaps to a certain extent. Overall, the user experience is considered in terms of both the number of images to be recalled and the time interval between recalls, balancing different factors to better meet the user experience.

[0063] Optionally, the M time periods include a first part of the time period and a second part of the time period, the time of the second part of the time period being earlier than the time of the first part of the time period, wherein each time period in the first part of the time period corresponds to a picture in the second picture collection, and each time period in the second part of the time period corresponds to multiple pictures in the second picture collection.

[0064] The method for generating a memory video provided in an embodiment of the present application is based on the fact that users' memories of events that happened a long time ago are relatively vague. Therefore, multiple pictures are screened out in each time period of the second part of the time period that is relatively far away. This can enable users to better recall events that happened a long time ago through pictures, thereby improving user experience.

[0065] Optionally, generating the first recollection video based on the second picture collection includes:

[0066] Determine N2 pictures in the second picture collection as pictures in the first recollection video.

[0067] Optionally, displaying a second display interface in response to a first operation performed by a user on the first image includes:

[0068] In response to the first operation, if the first picture has not been analyzed, analyzing the first picture to obtain an analysis result, where the analysis result indicates that the first picture includes a person;

[0069] In response to the analysis result, the second display interface is displayed.

[0070] The method for generating a recall video provided in an embodiment of the present application determines whether the first image has been analyzed, and immediately analyzes the unanalyzed images. For the images that have been analyzed, in fact, the electronic device does not need to repeatedly analyze the first image, thereby reducing the process of analyzing the images and thus reducing the processing time.

[0071] Optionally, displaying a second display interface in response to a first operation performed by a user on the first image includes:

[0072] In response to the first operation, when the first picture has been analyzed to include a person and the first picture does not exist in the existing recollection video, the second display interface is displayed.

[0073] Optionally, the second display interface includes pictures of the multiple recognized characters.

[0074] In the method for generating a memory video provided in an embodiment of the present application, since the first picture has been analyzed, the second display interface can directly display the pictures of the multiple characters that have been identified, thereby improving the user's visual experience.

[0075] Optionally, the method further includes:

[0076] A third picture collection is obtained based on the second picture, wherein the second picture includes the at least one person, each picture in the third picture collection includes a person that matches the at least one person, and generation time of all pictures in the third picture collection is distributed in a first time period, and the first time period is later than the generation time of the first recall video;

[0077] The first recollection video is updated according to the third picture collection.

[0078] The method for generating a memory video provided in an embodiment of the present application updates the memory videos with the same person. The electronic device does not need to generate a new memory video, but integrates the pictures of the same person into one memory video, which not only makes it easier for users to search in a centralized manner, but also makes it easier for the device to manage pictures.

[0079] Optionally, updating the first recollection video according to the third picture collection includes:

[0080] When the sum of the number N3 of pictures in the third picture collection and the number N4 of pictures in the first recollection video is less than or equal to the second number threshold N2, all pictures in the third picture collection are added to the first recollection video to obtain an updated first recollection video.

[0081] Optionally, updating the first recollection video according to the third picture collection includes:

[0082] When the sum of the number N3 of pictures in the third picture collection and the number N4 of pictures in the first recollection video is greater than the second quantity threshold N2, N5 pictures are deleted from the first recollection video, and N3 pictures in the third picture collection are added to the first recollection video to obtain an updated first recollection video, and the updated first recollection video includes N2 pictures, where N5 = N3 + N4 - N2.

[0083] The method for generating a memory video provided in an embodiment of the present application prioritizes ensuring that all pictures in the third picture collection are added to the first memory video when the sum of the number N3 of pictures in the third picture collection and the number N4 of pictures in the first memory video is greater than N2, and deleting pictures that exceed the number from the first memory video. This allows users to recall things associated with the new pictures in a timely manner, thereby improving user experience.

[0084] Optionally, the updated first recollection video includes the second picture.

[0085] In the method for generating a memory video provided in an embodiment of the present application, the user operates the second picture to recall related people while browsing the second picture, which means that the user prefers the second picture or the second picture can evoke the user's memories more strongly. Therefore, adding the second picture to the updated memory video can meet user needs and improve user experience.

[0086] Optionally, the cover image of the first recollection video is the first image.

[0087] Optionally, the first operation is a swipe up operation.

[0088] Optionally, the first display interface is an interface of a gallery application.

[0089] In a second aspect, a method for generating a recall video is provided, the method comprising:

[0090] Displaying a first display interface, wherein the first display interface includes a memory entrance;

[0091] In response to a user's operation on the memory entrance, displaying a second display interface, the second display interface including character pictures of a plurality of characters;

[0092] In response to a user selecting a picture of at least one of the multiple characters, performing a picture search to obtain a first picture collection, wherein each picture in the first picture collection includes a character that matches the at least one character;

[0093] generating a first recollection video according to the first picture collection, wherein the first recollection video includes at least part of the pictures in the first picture collection;

[0094] A third display interface is displayed, and the first recollection video is played on the third display interface.

[0095] In an embodiment of the present application, a method for generating a memory video is provided. A user triggers the memory function through a memory entry. The electronic device immediately displays multiple images of people previously identified by the electronic device through image analysis. The user can select at least one of the multiple people of interest. Upon detecting the user's selection of the at least one person's image, the electronic device can directly perform an image search to generate a first memory video. Since there is no need to analyze or extract features from the images, the electronic device directly utilizes the image of the person already identified by the electronic device for the user's selection, reducing the response time of the electronic device and improving the user experience from a time-saving perspective. Furthermore, the user's operation on the memory entry in the first display interface, which can be identified by the electronic device, provides a user-friendly condition for actively triggering the memory function. This allows the user to perform operations on the images of the person of interest based on their needs to generate a memory video, meeting the user's actual needs and significantly improving the user experience. In addition, viewing multiple images through the memory video playback method avoids the user having to click on multiple images one by one, saving user operations and further improving the user experience.

[0096] Optionally, the first display interface is an interface in a gallery application for displaying recall videos.

[0097] In a third aspect, an electronic device is provided, wherein the electronic device is configured to execute the method provided in the first or second aspect. Specifically, the electronic device may include a module configured to execute any possible implementation of the first or second aspect.

[0098] In a fourth aspect, an electronic device is provided, comprising a processor. The processor is coupled to a memory and configured to execute instructions in the memory to implement the method of any possible implementation of the first or second aspect. Optionally, the electronic device further comprises a memory. Optionally, the device further comprises a communication interface, the processor being coupled to the communication interface.

[0099] In a fifth aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a device, the device implements the method in any possible implementation of the first aspect or the second aspect mentioned above.

[0100] In a sixth aspect, a computer program product comprising instructions is provided, wherein when the instructions are executed by a computer, the device implements the method in any possible implementation of the first aspect or the second aspect.

[0101] In the seventh aspect, a chip is provided, comprising: an input interface, an output interface, a processor and a memory, wherein the input interface, the output interface, the processor and the memory are connected through an internal connection path, and the processor is used to execute the code in the memory. When the code is executed, the processor is used to execute the method in any possible implementation of the first aspect or the second aspect above. BRIEF DESCRIPTION OF THE DRAWINGS

[0102] FIG1 is a schematic structural diagram of an electronic device provided in an embodiment of the present application.

[0103] FIG2 is a schematic diagram of a software system of an electronic device provided in an embodiment of the present application.

[0104] FIG3 is a schematic diagram of a set of graphical user interfaces (GUIs) provided in an embodiment of the present application.

[0105] 4 to 10 are another set of GUIs provided by an embodiment of the present application.

[0106] FIG11 is a schematic flowchart of a method for generating a memory video provided in an embodiment of the present application.

[0107] Figure 12 is a schematic flowchart of the process of an electronic device provided in an embodiment of the present application determining picture collection 2 based on picture collection 1, and determining a recall video based on picture collection 2.

[0108] FIG13 is another schematic flowchart of the method for generating a memory video provided in an embodiment of the present application.

[0109] Figure 14 is a schematic flowchart of the process of an electronic device generating a picture collection and a recall video when the number of people in the picture is greater than the number threshold N1, provided by an embodiment of the present application.

[0110] FIG15 is a schematic diagram of the fourth interface provided in an embodiment of the present application.

[0111] FIG16 is another schematic flow chart of the method for generating a memory video provided in an embodiment of the present application.

[0112] FIG17 is another set of GUIs provided by an embodiment of the present application.

[0113] FIG18 is another schematic flow chart of the method for generating a memory video provided in an embodiment of the present application.

[0114] FIG19 is another set of GUIs provided by an embodiment of the present application.

[0115] FIG20 is another schematic flow chart of the method for generating a memory video provided in an embodiment of the present application.

[0116] FIG21 is another set of GUIs provided in an embodiment of the present application.

[0117] FIG22 is an exemplary block diagram of an apparatus for generating a recall video provided in an embodiment of the present application.

[0118] Figure 23 is a schematic structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0119] The technical solution in this application will be described below with reference to the accompanying drawings.

[0120] The method for generating a memory video provided in the embodiment of the present application can be applied to various electronic devices capable of taking pictures, such as mobile phones, tablet computers, wearable devices, laptops, netbooks, personal digital assistants (PDAs), cameras, etc. The embodiment of the present application does not impose any restrictions on the specific type of electronic device.

[0121] Figure 1 is a schematic structural diagram of an electronic device 100 provided in an embodiment of the present application. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0122] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0123] In an embodiment of the present application, the processor 110 is used to control the display screen to display various interfaces, and can trigger the recall function through user operations, display pictures and videos of related people, etc., and is used to extract features of related people, find pictures that match the related people, and generate a picture collection and recall video exclusive to the related people.

[0124] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0125] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0126] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0127] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0128] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C bus lines. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, and the like via different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K via the I2C interface, enabling communication between the processor 110 and the touch sensor 180K via the I2C bus interface, thereby implementing the touch function of the electronic device 100.

[0129] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface, enabling the function of answering calls through a Bluetooth headset.

[0130] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0131] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface, enabling the function of playing music through Bluetooth headphones.

[0132] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 194 and the camera 193. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the camera function of the electronic device 100. The processor 110 and the display 194 communicate via the DSI interface to implement the display function of the electronic device 100.

[0133] The GPIO interface can be configured via software. The GPIO interface can be configured as either a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, display 194, wireless communication module 160, audio module 170, sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0134] The USB interface 130 is an interface that complies with USB standards and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect other electronic devices, such as augmented reality devices.

[0135] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0136] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also provide power to the electronic device via the power management module 141.

[0137] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0138] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0139] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0140] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0141] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0142] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0143] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0144] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0145] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0146] In an embodiment of the present application, the display screen 194 is used to display various interfaces, for example, displaying pictures for users to operate to trigger the recall function, and displaying an interface including a recall entrance for users to operate to generate picture collections and recall videos.

[0147] The electronic device 100 can implement the shooting function through the ISP, camera 193, video codec, GPU, display screen 194 and application processor, and implement the technical solution of tracking objects in the embodiment of the present application during the shooting process.

[0148] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.

[0149] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0150] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0151] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0152] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.

[0153] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0154] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0155] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0156] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.

[0157] The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls through the speaker 170A.

[0158] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or a voice message, the user can place the receiver 170B close to the ear to hear the voice.

[0159] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the source of sound, realize directional recording function, etc.

[0160] The headphone jack 170D is used to connect a wired headphone and can be the USB interface 130 or a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0161] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be located on display screen 194. There are many types of pressure sensors 180A, such as resistive, inductive, and capacitive. A capacitive pressure sensor can include at least two parallel plates made of conductive material. When force acts on pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the intensity of the pressure based on this change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the touch intensity based on pressure sensor 180A. Electronic device 100 can also calculate the touch location based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch location but with different touch intensities can correspond to different operation instructions. For example, when a touch operation with an intensity less than a first pressure threshold is applied to a short message application icon, a command to view short messages is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to a short message application icon, a command to create a new short message is executed.

[0162] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.

[0163] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude using the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation.

[0164] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover based on the magnetic sensor 180D. Based on the detected opening and closing status of the case or flip cover, features such as automatic unlocking of the flip cover can be configured.

[0165] Accelerometer 180E can detect the magnitude of acceleration of electronic device 100 in all directions (generally three axes). It can also detect the magnitude and direction of gravity when electronic device 100 is stationary. It can also be used to identify the electronic device's posture, enabling applications such as switching between landscape and portrait modes and pedometers.

[0166] The distance sensor 180F is used to measure distance. The electronic device 100 can measure distance using infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure distance to achieve fast focusing.

[0167] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user is holding the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0168] Ambient light sensor 180L is used to sense ambient light brightness. Electronic device 100 can adaptively adjust the brightness of display screen 194 based on the perceived ambient light. Ambient light sensor 180L can also be used to automatically adjust white balance when taking photos. Ambient light sensor 180L can also work with proximity light sensor 180G to detect whether electronic device 100 is in a pocket to prevent accidental touches.

[0169] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0170] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the performance of the processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to prevent the electronic device 100 from shutting down abnormally due to low temperature. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 boosts the output voltage of the battery 142 to prevent abnormal shutdown due to low temperature.

[0171] The touch sensor 180K is also called a "touch panel." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, in a location different from that of the display screen 194.

[0172] The bone conduction sensor 180M can obtain vibration signals. In some embodiments, the bone conduction sensor 180M can obtain vibration signals from the vibrating bones of the human body. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure pulse signals. In some embodiments, the bone conduction sensor 180M can also be set in headphones to form bone conduction headphones. The audio module 170 can parse out voice signals based on the vibration signals of the vibrating bones of the human body obtained by the bone conduction sensor 180M to implement voice functions. The application processor can parse heart rate information based on the blood pressure pulse signals obtained by the bone conduction sensor 180M to implement heart rate detection functions.

[0173] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100.

[0174] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0175] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.

[0176] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to or disconnected from the electronic device 100 by inserting it into or removing it from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0177] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present application, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.

[0178] Figure 2 is a software structure diagram of the electronic device 100 according to an embodiment of the present application. The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: the application layer, the application framework layer, the system library of the Android runtime, and the kernel layer. The application layer may include a series of application packages.

[0179] As shown in FIG2 , the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.

[0180] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0181] As shown in FIG2 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

[0182] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0183] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0184] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0185] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).

[0186] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0187] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0188] The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for scheduling and management of the Android system.

[0189] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0190] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0191] The system library can include multiple functional modules, such as a surface manager, media libraries, a 3D graphics processing library (such as OpenGL ES), and a 2D graphics engine (such as SGL).

[0192] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0193] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0194] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0195] A 2D graphics engine is a drawing engine for 2D drawings.

[0196] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0197] It should be understood that the technical solutions in the embodiments of the present application can be used in Android, IOS, Hongmeng and other systems.

[0198] As described in the background, existing technologies fail to consider users' actual needs, resulting in a poor sense of control. This prevents users from viewing photo collections of their favorite people or groups, leading to a poor user experience. For example, a user might want to view a collection of photos taken with friends 1 and 2, but the electronic device only displays photos of the user and friend 1.

[0199] Based on this, an embodiment of the present application provides a method for generating a memory video. Users can manipulate images based on their needs. Based on the user's manipulation of the images, the electronic device searches the image library for a collection of images of the person the user wants to view, thereby improving the user experience. Furthermore, the electronic device generates a wonderful memory video based on the image collection and can play the images in the memory video, eliminating the need for users to manually manipulate the image collection to view images of the person, further improving the user experience.

[0200] Hereinafter, first, taking a mobile phone as an example, the embodiments of the present application are introduced through a graphical user interface (GUI).

[0201] Figure 3 is a schematic diagram of a set of GUIs provided in an embodiment of the present application, which illustrates a GUI for searching for pictures in the gallery that include all the characters in the picture, generating a picture collection, and generating a memory video based on the user's operation on the picture that the user is currently browsing and has not been analyzed.

[0202] It should be understood that all the characters in the picture can be one person or multiple people. This embodiment of the application does not impose any limitation and the number of characters included in the picture shall prevail.

[0203] Referring to the GUI in Figure 3 (a), this GUI is the mobile phone's desktop. The GUI includes multiple application icons. To view an image (or photo), the user clicks the Gallery icon. Upon detecting the user's click on the Gallery icon on the desktop, the Gallery application opens, displaying the GUI shown in Figure 3 (b).

[0204] Referring to the GUI in (b) of Figure 3 , the electronic device displays the main interface of the gallery application. This main interface includes interface 31 and interface 32. Interface 32 includes icons for multiple category options. Interface 31 displays images displayed by a certain category option. For example, interface 31 displays images displayed by the category option "Pictures." Continuing with Figure 3 (b), the user wants to view picture P1 and clicks on picture P1. In response to the user's click on picture P1, the phone displays the GUI shown in (c) of Figure 3 .

[0205] It should be noted that the "picture" in the embodiments of the present application can also be called a photo or an image. The three expressions can be described interchangeably and will not be elaborated later.

[0206] Refer to the GUI in Figure 3 (c). This GUI displays a magnified image P1, which includes three characters: the user herself, "Xiaomei," and her friends, "Xiaoli" and "Xiaohong." While browsing image P1, the user reminisces about the time they spent together and wants to browse related photos of the three of them in their gallery. Therefore, the user swipes up on image P1, or performs an upward swipe operation on image P1. Upon detecting the upward swipe operation on image P1, the phone displays the GUI shown in Figure 3 (d).

[0207] In one example, after the mobile phone detects a user swiping up on image P1, if it determines that image P1 has not been analyzed, it analyzes image P1. If it determines that image P1 includes a person, it displays the GUI shown in (d) of Figure 3. In other words, after the mobile phone detects a user swiping up on image P1, it determines whether image P1 has been analyzed. If it determines that it has not been analyzed, the electronic device analyzes whether image P1 includes a person. If it determines that image P1 includes a person, the electronic device displays the GUI shown in (d) of Figure 3.

[0208] It should be understood that the "whether an image has been analyzed" described in the embodiments of this application refers to analyzing whether an image includes a person. If the image has already been analyzed, it means that the mobile phone has already analyzed the image and found that it includes a person. The explanation of image analysis below is the same as here and will not be repeated later. For image P1, if it is determined that image P1 has already been analyzed, it means that image P1 includes a person.

[0209] In other examples, when the mobile phone determines that the picture P1 has been analyzed, it may display a GUI different from that shown in (d) in FIG. 3 , and the difference is explained below.

[0210] It should be understood that the method in which the user performs an upward swipe operation on the image P1 to trigger the generation of a memory entry is merely illustrative and is not limited in any way by the present embodiment. Any method that can trigger the device to generate a memory entry is within the scope of protection of the present embodiment. For example, the user performs a long press operation, a horizontal swipe (left or right swipe operation), a downward swipe operation, etc. on the image P1.

[0211] Referring to the GUI in (d) in Figure 3 , the GUI includes a picture P1 and a memory entry area 33. After the user swipes up on the picture P1, the picture P1 is slid to the top of the interface, and the memory entry area 33 is displayed below the picture P1. The memory entry area 33 is used for the user to trigger the function of generating a memory video. Exemplarily, the memory entry area 33 includes the prompt text "Based on the current picture, quickly analyze and generate related memory videos to relive good memories" and a memory entry 331. Exemplarily, the memory entry 331 can be a control that displays the text "Generate Memories". When the user clicks on the memory entry 331 of the control such as "Generate Memories", and the mobile phone detects the user operation, it means that the user has triggered the function of generating a memory video. Based on the three characters in the identified picture P1, the mobile phone screens out a collection of pictures that meet the conditions and include group photos of the three characters from the gallery through feature matching, and generates a memory video based on the picture collection.

[0212] The mobile phone selects a collection of pictures from the gallery that meets the conditions and includes a group photo of the three people. In the process of generating a memory video based on the picture collection, not all pictures in the picture collection are necessarily played. In other words, the pictures in the memory video are not necessarily all pictures in the picture collection. The pictures in the memory video can be some or all pictures in the picture collection. For example, when the number of pictures in the picture collection is large, in order to allow the user to better experience the wonderful process of video playback as much as possible, some pictures can be selected from the picture collection to generate the memory video. For another example, when the number of pictures in the picture collection is small, all pictures in the picture collection can be used as pictures in the memory video.

[0213] Exemplarily, the GUI of (d) in Figure 3 may also include other information related to the picture P1. For example, the GUI includes an address area 34, the address area 34 includes a map 341 and text, the map 341 is marked with the address at which the picture P1 was taken (or generated), and the text indicates the address at which the picture P1 was taken (or generated) (for example, Linkai International Building, Keji Road, Yanta District, Xi'an).

[0214] In order to facilitate the user to view the progress of generating the reminiscence video and improve the user's visual experience, a GUI as shown in (e) in FIG. 3 may be displayed.

[0215] Referring to the GUI in FIG3(e), the GUI includes an image P1 and a progress box 35, which is used to display the progress of generating the reminiscence video, for example, when the progress reaches 40%. When the progress reaches 100%, a collection of images including the group photo of the three characters and a reminiscence video are generated, and the GUI shown in FIG3(f) is displayed.

[0216] Referring to the GUI in (f) of Figure 3 , the GUI displays a reminiscence video with the theme of "Old Friends Gathering" that is generated in real time, and the reminiscence video includes multiple pictures of three people. After the reminiscence video is generated, the mobile phone can automatically play each frame of the picture in the reminiscence video.

[0217] Exemplarily, the recollection video includes a picture P1 that is operated by the user or used to trigger the generation of the recollection video.

[0218] For example, the picture P1 operated by the user or used to trigger the generation of the memory video can be used as the cover picture of the memory video.

[0219] For example, when playing a memory video, each frame of the picture can be played according to the timeline, so that the user can recall the past according to the time when the event occurred, deepening the memory. For example, the pictures can be played in order from the most recent to the most recent timeline, that is, the pictures with the most recent timeline are played first, and then the pictures with the most recent timeline are played.

[0220] In the above embodiment, the user performs an operation on the picture currently being browsed, actively triggering the recall function, so that the mobile phone can select a picture collection of all the people in the picture currently being browsed from the gallery and generate a recall video, which meets the actual needs of the user and greatly improves the user experience; and compared with the method of users searching for pictures on a large scale in the gallery, it can better shorten the search time and solve the problem of memory interruption when users browse pictures; in addition, the most common scenario for users to want to find a picture collection of related people is that users think of certain people or certain things when browsing a certain picture, so they want to recall the past. Therefore, actively triggering the recall function by performing an operation on the picture that the user is browsing is more in line with the user's behavioral habits and provides a higher user experience.

[0221] In the prior art, mobile phones can trigger image analysis by charging. That is, when the phone is in charging mode, the images can be automatically categorized into collections of images of different themes by analyzing the images. However, if the phone is not charged within a short period of time, the images cannot be analyzed immediately, which affects the user experience. In the embodiments of the present application, as long as the image is an existing one, the user can perform an operation to actively trigger the recall function while browsing any image. The instantly generated image can be actively analyzed to generate a recall video, which improves the real-time analysis of the image and further enhances the user experience.

[0222] FIG4 is another set of GUIs provided in an embodiment of the present application, which illustrates that after a memory video is generated, the GUI of the memory video is displayed in an interface of the “memories” category.

[0223] After a memory video is generated, the "Memory" category interface in the gallery is opened, and a GUI such as that shown in FIG4(a) is displayed. The GUI displays a portion of all the memory videos stored in the phone. The user can perform an operation such as swiping up on the display interface. In response to the user operation, the display interface can scroll to display another portion of the memory videos that have not been displayed.

[0224] For a newly generated memory video with the theme "Getting Together with Old Friends," it is displayed at the front of the "Memories" interface. Since it's a newly generated memory video, it's more likely to be viewed by users. Therefore, placing it first on the interface eliminates the need to scroll through the video, making it much easier for users to view it. In practice, the phone inserts the newly generated memory video before all other memory videos, and moves the remaining memory videos back in their order.

[0225] The user clicks on the newly generated memory video with the theme of "getting together with old friends", and the GUI shown in (b) of FIG4 is displayed. Referring to the GUI in (b) of FIG4, the GUI includes a video area 41 and a picture area 42.

[0226] Image area 42 is used to display images from a collection themed "Old Friends Gathering." This collection includes multiple images, each of which is a group photo of three people, obtained by matching features between images in the gallery and image P1. Due to the limited size of image area 42, when the collection contains a large number of images, image area 42 displays only a portion of the collection. The user can perform an operation, such as swiping up, on image area 42. In response to the user operation, image area 42 can scroll to display another portion of the undisplayed images.

[0227] The video area 41 is used to play each frame of the memory video. It should be noted that the pictures in the memory video with the theme of "Old Friends Gathering" are part or all of the pictures in the picture collection with the theme of "Old Friends Gathering" displayed in the picture area 42.

[0228] As previously mentioned, for example, when the image collection contains a large number of images, in order to maximize the user's experience of the exciting video playback process, some images can be selected from the image collection to generate a memory video. Because the memory video includes some images from the image collection, the user cannot view all images when playing the memory video. Therefore, the user can view all images in the image area 42. This not only maximizes the user's experience of the video playback process, but also allows all images that meet the requirements to be retained for the user to view, effectively improving the user experience.

[0229] FIG5 is another set of GUIs provided in an embodiment of the present application.

[0230] When a memory video is generated, as shown in FIG. 5( a ) (which may correspond to the GUI of FIG. 3( f )), the user clicks on the memory video, and a GUI as shown in FIG. 5( b ) may be displayed.

[0231] Referring to the GUI in FIG5(b), the GUI includes a return control 51 in the upper left corner and an image area 52 located below the reminiscence video. Image area 52 displays each frame of the reminiscence video by, for example, shifting leftward. Image area 52 can accommodate a limited number of images. Each time a frame is played, the phone shifts the image in image area 52 to the left by one frame to allow the next frame to enter image area 52. Thus, each frame of the reminiscence video is displayed in image area 52. When the user clicks return control 51, the GUI shown in FIG5(c) is displayed.

[0232] Referring to the GUI in (c) in Figure 5, this GUI is similar to the GUI in (d) in Figure 3, including a picture P1, a memory entry area 54 and an address area 55. The difference from the GUI in (d) in Figure 3 is that this GUI includes a character area 53, and the memory entry 541 of the memory entry area 54 is changed to a control displaying the picture P1.

[0233] Because image P1 has already been analyzed, the GUI can directly display character area 53, which includes the character image obtained after analyzing image P1. This can improve the user's visual experience. In addition, in some embodiments, because image P1 is the cover image of the memory video, in memory entry area 54, memory entry 541 becomes a control that displays image P1 as the cover image.

[0234] In this way, for the case where the picture P1 has been analyzed and the memory video includes the picture P1, when the user subsequently browses the picture P1 and wants to browse the picture collection related to the picture P1, the GUI shown in (c) in Figure 5 will be displayed after sliding up the picture P1. The user clicks the control 541 displaying the picture P1, and the mobile phone can instantly play the memory video generated before. Since there is no need to regenerate the memory video based on the analyzed picture, the response speed can be effectively improved.

[0235] FIG6 is another set of GUIs provided in an embodiment of the present application, illustrating a GUI for a process in which a user operates again on an image that has been analyzed and is included in a recall video to trigger a recall function.

[0236] Referring to the GUI in Figure 6 (a), when a user is browsing image P1 again, they want to view related photos of a group of three people in their gallery. Therefore, the user swipes up on image P1, or the user swipes up on image P1. After the phone detects the user's swipe up on image P1, it determines that the user has previously analyzed image P1 and that the recall video includes image P1, and displays the GUI shown in Figure 6 (b).

[0237] 6(b), the GUI is the same as that of FIG5(b), including a picture P1, a person area 61, a memory entry area 62, and an address area 63. When the user clicks on the memory entry 621, the GUI shown in FIG6(c) is displayed.

[0238] Referring to the GUI in (c) of FIG6 , the GUI displays a previously generated memory video with the theme of “getting together with old friends”, and can automatically play each picture in the memory video.

[0239] It should be noted that the picture in (a) of Figure 6 that the user operates on can be the picture P1 that the user has previously actively triggered the recall function, or it can be any picture selected by the mobile phone from the gallery based on picture P1 and added to the recall video. No limitation is made here. It can be understood that in the latter case, although the user has not previously performed an operation on pictures other than picture P1 in the recall video to trigger the recall function, when the user subsequently performs an operation on any picture other than picture P1 in the recall video (recorded as picture A1) to trigger the recall function, it means that the user wants to see picture A1 in the recall video. Therefore, when picture A1 is a picture in the recall video, the recall video can play and display picture A1. Therefore, picture A1 can also be any picture in the recall video except picture P1.

[0240] Figure 7 is another set of GUIs provided in an embodiment of the present application. The difference from Figure 3 is that Figure 7 illustrates a GUI of the process of searching the gallery for pictures that include all the characters in the picture, generating a picture collection and generating a recall video based on the user's operation on the picture when the picture has been analyzed but not in the recall video.

[0241] Referring to the GUI in (a) of FIG. 7 , based on the operations in (a) and (b) of FIG. 3 above, for example, the GUI in (a) of FIG. 7 is obtained. This GUI displays an enlarged image P1, which includes three characters: the user "Xiaomei" and the user's friends "Xiaoli" and "Xiaohong." While browsing image P1, the user reminisces about the time they spent together and wants to browse related photos of the three of them in their gallery. Therefore, the user swipes up on image P1, or the user performs an up swipe operation on image P1. After the phone detects the user's up swipe operation on image P1, it displays the GUI shown in (d) of FIG. 7 .

[0242] For example, after the mobile phone detects the user's swiping up operation on picture P1, it determines that picture P1 has been analyzed, that is, it determines that picture P1 includes a person and picture P1 does not exist in any memory video, so the GUI shown in (b) in Figure 7 is displayed.

[0243] Referring to the GUI in FIG. 7( b ), the GUI includes a picture P1 , a character area 71 , and a memory entry area 72 .

[0244] Since the picture P1 has been analyzed, the GUI can directly display the character area 71. The character area 71 includes the character image of the character obtained after analyzing the picture P1. In this way, the user's visual experience can be improved.

[0245] Memory entry area 72 includes a memory entry 721. For example, memory entry 721 may be a control that displays "Generate Memory." When a user clicks on memory entry 721, for example, the "Generate Memory" control, the phone detects the user action and, based on the three people identified in image P1, performs feature matching to select a collection of images from the image library that meet the criteria and includes a group photo of the three people. The phone then generates a memory video based on the collection of images.

[0246] Exemplarily, the GUI of (b) in Figure 7 may also include other information related to the picture P1. For example, the GUI includes an address area 73, the address area 73 includes a map 731 and text, the map 731 is marked with the address at which the picture P1 was taken, and the text indicates the address at which the picture P1 was taken (for example, Linkai International Building, Keji Road, Yanta District, Xi'an).

[0247] To facilitate user monitoring of the progress of the memory video generation process and enhance the user's visual experience, a GUI (see Figure 7(c)) may be displayed. This GUI includes an image P1 and a progress bar 74, which displays the progress of the memory video generation process. When the progress reaches 100%, a collection of images including the group photo of the three characters and a memory video are generated, and the GUI (see Figure 7(d)) ​​is displayed.

[0248] 7 (d), the GUI displays a reminiscence video with the theme of "Old Friends Gathering" generated in real time, which includes multiple pictures of three people. After the reminiscence video is generated, the mobile phone can automatically play each frame of the picture in the reminiscence video.

[0249] In the embodiment shown in FIG7 , the mobile phone can analyze the picture P1 in advance in the following manner, so that after detecting an operation of the user on the picture P1 , such as a swipe up operation, the picture P1 no longer needs to be analyzed, and the character area 71 of the GUI as shown in (b) in FIG7 is directly displayed.

[0250] In one example, before detecting a user operation such as a swipe up operation on picture P1, when the mobile phone is in charging mode, the mobile phone can actively analyze all pictures in the gallery to classify the pictures, wherein, during the analysis of the pictures, it is analyzed that picture P1 includes a person.

[0251] In another example, before detecting the user's operation such as swiping up on picture P1, the user performs an operation such as swiping up on another picture to actively trigger the recall function, and the mobile phone analyzes the pictures in the gallery and extracts features, etc., to select pictures that match the characters in the other picture, generate a picture collection and generate a recall video. In the above-mentioned process of analyzing pictures, the analysis of picture P1 is completed. However, although picture P1 has been analyzed, it has not been added to the recall video, or in other words, picture P1 is not included in the recall video. It can be understood that when picture P1 has been analyzed and picture P1 is included in the recall video, a recall entry 621 as shown in (b) in Figure 6 can be displayed.

[0252] Figure 8 is another set of GUIs provided by an embodiment of the present application, which illustrates a GUI of a process in which, for a picture that the user is currently browsing and has not been analyzed, the user selects any person in the picture, and the mobile phone searches for pictures in the gallery that include the arbitrary person based on the arbitrary person in the picture selected by the user, generates a picture collection, and generates a recall video.

[0253] It should be understood that any person in the picture selected by the user can be part of the people in the picture or all the people in the picture. This embodiment of the application does not impose any restrictions and is subject to user needs. The number of people selected by the user can be one or more, which is also not limited in this embodiment of the application.

[0254] Referring to the GUI in (a) of FIG8 , the GUI in (a) of FIG8 is obtained based on, for example, (a) and (b) of FIG3 above. The GUI displays an enlarged picture P1, which includes three characters: the user herself, "Xiaomei," and the user's friends, "Xiaoli," and "Xiaohong." When browsing picture P1, the user misses the time spent with her friend "Xiaoli" and wants to browse related pictures of herself and "Xiaoli" in the gallery. Therefore, the user swipes up on picture P1, or the user performs an up-swipe operation on picture P1. After the mobile phone detects the user's up-swipe operation on picture P1, it displays the GUI shown in (b) of FIG8 .

[0255] In one example, after the mobile phone detects a user swiping up on picture P1, if it determines that picture P1 has not been analyzed, it analyzes picture P1. If it determines that picture P1 includes a person, it displays the GUI shown in Figure 8 (b). In other words, after the mobile phone detects a user swiping up on picture P1, it determines whether picture P1 has been analyzed. If it determines that picture P1 has not been analyzed, the mobile phone analyzes whether picture P1 includes a person. If it determines that picture P1 includes a person, the mobile phone displays the GUI shown in Figure 8 (b).

[0256] Referring to the GUI in (b) of Figure 8 , the GUI includes a picture P1 and a memory entry area 81. After the user swipes up on the picture P1, the picture P1 is slid to the top of the interface, and the memory entry area 81 is displayed below the picture P1. The memory entry area 81 is used for the user to trigger the function of generating a memory video. Exemplarily, the memory entry area 81 includes the prompt text "Based on the current picture, quickly analyze and generate related memory videos to relive good memories" and a memory entry 811. Exemplarily, the memory entry 811 can be a control that displays "Generate Memories". When the user clicks on the memory entry 811 of the control such as "Generate Memories", and the mobile phone detects the user operation, it means that the user has triggered the function of generating a memory video. The mobile phone recognizes the three characters in the picture P1 and displays the GUI shown in (c) of Figure 8 .

[0257] Referring to the GUI of (c) in FIG8 , the GUI includes a picture P1 and a character area 83. The character area 83 includes character pictures of all characters (e.g., Xiao Li, Xiao Mei, and Xiao Hong) identified from the picture P1. The user selects pictures of characters of interest from all character pictures based on his or her preferences. For example, the user selects pictures of “Xiao Li” and “Xiao Mei”. After selecting the pictures of the characters of interest, click on a confirmation control such as “√”. The mobile phone detects the user’s click on the confirmation control and confirms that the user wants to find pictures of “Xiao Li” and “Xiao Mei”. Therefore, the mobile phone uses feature matching to filter out a collection of pictures that meet the conditions and include pictures of the two characters selected by the user from the gallery, and generates a memory video based on the picture collection.

[0258] It should be understood that each image in the photo collection and reminiscence video includes not only the user's selected person of interest, but also other people, depending on the content of the image itself. However, since the user selected any person in the image, the resulting photo collection and reminiscence video images will at least include the user's selected person. For example, although the user selected "Xiao Li" and "Xiao Mei" in photo P1, as a photo in the photo collection and reminiscence video, photo P1 itself also includes "Xiao Hong."

[0259] In order to facilitate the user to view the progress and improve the user's visual experience, a GUI as shown in (d) in FIG8 is displayed.

[0260] Referring to the GUI in FIG8(d), the GUI includes an image P1 and a progress box 84, which is used to display the progress of generating the memory video, for example, when the progress reaches 40%. When the progress reaches 100%, a collection of images including a group photo of two people selected by the user and a memory video are generated, and the GUI shown in FIG8(e) is displayed.

[0261] 8 (e), the GUI displays a reminiscence video with the theme of "old friends gathering" generated in real time, which includes multiple pictures of two people. After the reminiscence video is generated, the mobile phone can automatically play each frame of the reminiscence video.

[0262] For example, the recollection video includes picture P1. It should be understood that picture P1 is a picture of the recollection video, and picture P1 itself is a picture of three people, including two people of interest selected by the user.

[0263] For example, the picture P1 operated by the user or used to trigger the generation of the memory video can be used as the cover picture of the memory video.

[0264] For example, when playing a memory video, each frame of the picture can be played according to the timeline, so that the user can recall the past according to the time when the event occurred, deepening the memory. For example, the pictures can be played in order from the most recent to the most recent timeline, that is, the pictures with the most recent timeline are played first, and then the pictures with the most recent timeline are played.

[0265] In the above embodiment, for the picture currently being browsed, the user actively triggers the recall function. Since the user can select any person in the picture based on his or her preferences, the mobile phone can filter out a collection of pictures including any person selected by the user from the gallery and generate a recall video, which provides the user with a more flexible selection space, allowing the user to more flexibly select characters based on his or her preferences, and recall historical moments related to any person through a recall video including any person, which can better meet the user's actual needs and better improve the user experience.

[0266] FIG9 is another set of GUIs provided in an embodiment of the present application, illustrating a portion of the GUI of the process of triggering the recall function by the user operating the image again for an image that has been analyzed and includes the image in the recall video.

[0267] The user previously triggered the active recall function using picture P1, generating a recall video (as shown in Figure 8 (e)) that includes a photo of themselves, "Xiao Mei," and their friend, "Xiao Li." That is, the pictures in this recall video all include themselves, "Xiao Mei," and their friend, "Xiao Li," and picture P1 is the cover image of the recall video. Subsequently, when the user views picture P1 again, the video appears as shown in Figure 9 (a).

[0268] Referring to the GUI in Figure 9 (a), when a user is browsing picture P1 again, they want to view photos in their gallery that are photos of people related to picture P1. Therefore, the user swipes up on picture P1, or the user swipes up on picture P1. After the phone detects the user's swipe up on picture P1, it determines that the user has previously analyzed picture P1 and that the recall video includes picture P1, and displays the GUI shown in Figure 9 (b).

[0269] 9( b ), the GUI includes a picture P1 , a character area 91 , and a memory entry area 92 . Exemplarily, the GUI may further include an address area 93 .

[0270] Since the picture P1 has been analyzed, the GUI can directly display the character area 91. The character area 91 includes the character image of the character obtained after analyzing the picture P1. In this way, the user's visual experience can be improved.

[0271] In some embodiments, since image P1 is the cover image of the memory video, in the memory entry area 92, the memory entry 921 becomes a control displaying image P1. If the user wants to continue viewing the characters in the existing memory video, the user can play the existing memory video through the memory entry 921. For example, if the user wants to continue viewing the photo of themselves "Xiao Mei" and their friend "Xiao Li", since a memory video of themselves "Xiao Mei" and their friend "Xiao Li" has already been generated, the user clicks on the memory entry 921. The mobile phone detects the user operation and may display the GUI shown in (d) of Figure 9, that is, the mobile phone displays the interface for playing the memory video.

[0272] Exemplarily, the memory entry area 92 may further include a memory entry 922 for updating memories. Exemplarily, the memory entry 922 may be a control that displays "Update Memories." If the user wants to view pictures of other characters than those in the existing memory video, the user can regenerate a memory video that includes the other characters through the memory entry 922. For example, if the user does not want to view the memory video of themselves "Xiaomei" and their friend "Xiaoli," but instead wants to view pictures of themselves "Xiaomei" and their friend "Xiaohong," the user can click on the memory entry 922. The phone detects the user operation and displays the GUI shown in (c) of FIG9 .

[0273] Referring to the GUI in (c) of Figure 9 , the user selects pictures of himself "Xiaomei" and his friend "Xiaohong" in the character area 94. The mobile phone detects the user's operation of selecting characters, and through feature matching, filters out a new picture collection that meets the conditions and includes a photo of the two characters selected by the user from the gallery. A new memory video is generated based on the new picture collection. During this process, the GUI as shown in (d) of Figure 8 can be displayed. After the new memory video is generated, the GUI as shown in (e) of Figure 8 can be displayed. Each picture in the new picture collection and the new memory video includes at least "Xiaomei" and "Xiaohong".

[0274] FIG10 is another set of GUIs provided in an embodiment of the present application, illustrating a portion of the GUI of a process in which a user operates on a picture to trigger a recall function when the picture has been analyzed but not in a recall video.

[0275] Referring to the GUI in (a) of FIG10 , based on the operations in (a) and (b) of FIG3 above, for example, the GUI in (a) of FIG10 is obtained. The GUI displays an enlarged picture P1, which includes three characters, namely the user "Xiaomei", the user's friends "Xiaoli" and "Xiaohong". When the user browses picture P1, he misses the time he spent with his friend "Xiaoli" and wants to browse related pictures of himself and "Xiaoli" in the gallery. Therefore, the user swipes up on picture P1, or the user performs a swipe up operation on picture P1. After the mobile phone detects the user's swipe up operation on picture P1, it displays the GUI shown in (b) of FIG10 .

[0276] For example, after the mobile phone detects the user's swiping up operation on picture P1, it determines that picture P1 has been analyzed, that is, it determines that picture P1 includes a person and picture P1 does not exist in any memory video, so the GUI shown in (b) in Figure 10 is displayed.

[0277] 10( b ), the GUI includes a picture P1, a character area 101, and a memory entry area 102. Exemplarily, the GUI may further include other information related to the picture P1, for example, the GUI includes an address area 73.

[0278] Since the picture P1 has been analyzed, the GUI can directly display the character area 101. The character area 101 includes the character image of the character obtained after analyzing the picture P1. In this way, the user's visual experience can be improved.

[0279] The memory entry area 102 includes a memory entry 1021. For example, the memory entry 1021 may be a control displaying "Generate Memory." When a user clicks on the memory entry 1021, such as the control displaying "Generate Memory," the phone detects the user operation and may display a GUI as shown in FIG. 10(c).

[0280] Referring to the GUI in FIG10(c), a user selects pictures of themselves, "Xiao Mei," and their friend, "Xiao Li," in the character area 104. The phone detects the user's character selection and, through feature matching, selects a collection of pictures from the image library that meet the criteria and includes a photo of the two characters selected by the user. A memory video is generated based on this collection of pictures. During this process, the GUI shown in FIG8(d) may be displayed. After the memory video is generated, the GUI shown in FIG8(e) may be displayed. Each picture in this collection of pictures and the memory video includes at least "Xiao Mei" and "Xiao Li."

[0281] Below, based on the GUIs of Figures 3 to 10, combined with Figures 11 to 14, taking an electronic device as an example, the internal implementation process of the method for generating a memory video according to an embodiment of the present application is described in detail.

[0282] Figure 11 is a schematic flowchart of a method 1100 for generating a memory video provided in an embodiment of the present application, which mainly describes the process of fully matching all the characters in the picture, searching for pictures including all the characters in the picture from the gallery, generating a picture collection and a memory video, which can be combined with the GUI descriptions of Figures 3 to 7.

[0283] In step S1101 , the electronic device detects a user's operation on picture 1 .

[0284] Picture 1 may be any picture already in the electronic device, and may be a previously stored picture, or a picture taken instantly or obtained through other means, for example, a picture transmitted via Bluetooth from another electronic device, or a picture downloaded from a social application.

[0285] Among them, the user's operation on picture 1 is any operation that can trigger the recall function, and the embodiment of the present application does not make any limitation. Based on this operation, the electronic device continues to perform subsequent steps to generate a picture collection and a recall video, thereby realizing the recall function of the electronic device.

[0286] In one example, the user's operation on picture 1 may be a sliding operation on picture 1, and the sliding operation may be a sliding operation in any direction. For example, the sliding operation may be an upward sliding operation as shown in (c) of FIG3 . For another example, the sliding operation may also be a downward sliding operation, a horizontal sliding operation, etc.

[0287] In other examples, the user's operation on the picture 1 may also be, for example, a long press operation, a double click operation, a single click operation, a two-finger press operation, etc.

[0288] In one example, Picture 1 may be a picture displayed in the gallery display interface after the user performs an operation on the gallery application. For example, through the GUI shown in (a) and (b) of Figure 3 , based on a user clicking on Picture P1 (i.e., Picture 1), an enlarged Picture P1 is displayed in (c) of Figure 3 , and the user performs an upward swipe operation on Picture P1, and the electronic device detects the upward swipe operation on Picture P1.

[0289] In other examples, picture 1 may also be a picture that the user applies to other pictures (for example, The embodiment of the present application does not impose any limitation on the picture displayed in the display interface of the other picture application after the operation is performed by the picture application (such as the picture application).

[0290] In step S1102 , after detecting the user's operation on the picture 1 , the electronic device determines whether the picture 1 has been analyzed.

[0291] As previously mentioned, whether an image has been analyzed in this embodiment of the present application refers to whether the image contains a person. If image 1 has been analyzed, it indicates that image 1 contains a person, and the electronic device optionally executes step S1106. If image 1 has not been analyzed, the electronic device executes step S1103.

[0292] It can be understood that by determining whether the picture 1 has been analyzed, the electronic device may not need to repeatedly analyze the picture 1 that has been analyzed, thereby reducing the process of analyzing the picture and thus reducing the processing time.

[0293] Below, first, a specific description is given of the relevant steps (steps S1103 to S1115) performed by the electronic device when Picture 1 has not been analyzed (recorded as Case 1), and then a specific description is given of the relevant steps performed by the electronic device when Picture 1 has been analyzed (recorded as Case 2).

[0294] Case 1: Image 1 has not been analyzed

[0295] In step S1103 , if the picture 1 has not been analyzed, the electronic device analyzes the picture 1 to determine whether the picture 1 includes a person.

[0296] If it is determined that the picture 1 includes a person, the electronic device executes step S1104. If it is determined that the picture 1 does not include a person, the electronic device ends the process.

[0297] In step S1104, the electronic device displays a first interface, which includes a first memory entry area.

[0298] In case 1, when it is determined that picture 1 includes a person, the electronic device displays a first interface.

[0299] It should be understood that the first memory entry area can provide users with an interface for generating memory functions. Users can generate picture collections and memory videos by performing operations in the first memory entry area.

[0300] Exemplarily, referring to the GUI in (d) in Figure 3, the first interface can be the GUI, which includes a memory entry area 33 (corresponding to the first memory entry area), and the memory entry area 33 includes a memory entry 331. The memory entry 331 can be a control displaying the text "Generate Memory", and the user clicks the memory entry 331.

[0301] For example, the first interface may further include Picture 1. For example, the first interface may further include other information related to Picture P1, for example, the first interface may include an address area for displaying the address where Picture 1 was generated. For example, Picture P1 and address area 34 are shown in (d) of FIG. 3 .

[0302] In step S1105 , the electronic device detects the user's operation in the first memory entry area.

[0303] Exemplarily, referring to the GUI in (d) of FIG3 , the user clicks on the memory entry 331 of the memory entry area 33 (corresponding to the first memory entry area), and the electronic device detects the user's click operation on the memory entry 331 .

[0304] In step S1110 , the electronic device determines whether the number of people in picture 1 is greater than a number threshold N1 , where N1 is an integer greater than 1.

[0305] Considering the current processing capability of electronic devices, if the number of people to be matched is too large, the electronic device may not be able to perform feature matching on too many people. Therefore, a quantity threshold N1 may be set based on the processing capability of the electronic device.

[0306] If it is determined that the number of people in the picture 1 is less than or equal to the number threshold N1, the electronic device executes step S1111.

[0307] When it is determined that the number of people in picture 1 is greater than the number threshold N1, there are two processing methods. One processing method is that the electronic device ends the process (as shown by the arrow of Y1), and the other processing method is that the electronic device executes the steps of method 1400 below (as shown by the arrow of Y2), which will not be repeated here.

[0308] The quantity threshold N1 is determined according to the capabilities of different electronic devices. For example, the quantity threshold N1 may be 3, or any value greater than 3, for example, the quantity threshold N1 may be 10.

[0309] It should be understood that if the capability of the electronic device is good enough, this step can be omitted. After executing step S1105, the electronic device executes step S1111 without executing step S1110.

[0310] In step S1111 , the electronic device searches for pictures including persons that match all persons in picture 1 from the picture library to obtain picture collection 1 .

[0311] The picture collection 1 includes at least one picture, the at least one picture includes picture 1, and each picture includes a person that matches all the people in picture 1. It can be understood that when a picture includes a person that matches all the people in picture 1, it means that the picture includes all the people in picture 1.

[0312] It should be noted that when picture collection 1 includes multiple pictures, and there are pictures in picture collection 1 other than picture 1 in which the number of characters is greater than the number of characters in picture 1, these pictures include not only characters that match all the characters in picture 1, but also other characters.

[0313] It should be understood that the description of "each picture includes a character that matches all the characters in Picture 1" here means that each picture includes a character that matches every character in all the characters in Picture 1. The matching here means that the similarity between the two characters is high. When the similarity between the two characters is high, it means that the two characters are the same character.

[0314] In some embodiments, the electronic device searches for pictures including characters that match all characters in Picture 1 from the picture library, and determines all pictures in the picture library including characters that match all characters in Picture 1 as Picture Collection 1.

[0315] In some other embodiments, the electronic device searches for pictures including persons matching all persons in picture 1 from a picture library, and determines all pictures in the picture library including persons matching all persons in picture 1 as the initial picture collection;

[0316] The electronic device processes the pictures in the initial picture collection to obtain picture collection 1, which includes at least part of the pictures in the initial picture collection.

[0317] Exemplarily, the processing of the images in the initial image collection by the electronic device may include deduplication processing, deblurring processing, aesthetic score determination processing, etc.

[0318] The deduplication process of images means that, when there are at least two images with high repetition, the electronic device retains one image and deletes the remaining images from the initial image collection. The retained image may be the image with the highest aesthetic score among the at least two images with high repetition. For any two images with high repetition, illustratively, the high repetition of the two images may be at least one of the following situations: the characters in the two images are the same and the body movements such as the expressions and / or postures of the same character are similar, the characters in the two images are the same and the backgrounds are similar, the characters in the two images are the same and the time to generate the images is very short (a time threshold can be used for determination in implementation). It should be understood that the above-mentioned example of the high repetition of any two images is only for illustrative purposes.

[0319] Deblurring an image means that if the image has a high degree of blur, the image can be deblurred to obtain an image with a low degree of blur. The resolution of the image after deblurring is higher than that of the image before deblurring.

[0320] The process of determining an image's aesthetic score involves analyzing the image to determine its aesthetic score. If the image's aesthetic score satisfies a condition, the image is retained, i.e., the image is included in image collection 1. If the image's aesthetic score does not meet the condition, the image is deleted from the initial image collection. In implementation, an aesthetic score threshold (denoted as aesthetic score threshold 1) can be set. If the image's aesthetic score is greater than or equal to aesthetic score threshold 1, the image is retained; if the image's aesthetic score is less than aesthetic score threshold 1, the image is deleted.

[0321] It should be understood that the above-mentioned example of processing the pictures in the initial picture collection is only for illustrative purposes, and any processing of the pictures is acceptable, and the embodiments of the present application do not impose any limitation thereto.

[0322] Regarding step S1111, the electronic device searches for pictures including persons matching all persons in picture 1 from the picture library through feature extraction to obtain picture collection 1.

[0323] In some embodiments, the electronic device extracts features of all persons in picture 1 to obtain feature results of picture 1; based on the feature results of picture 1, the electronic device searches the gallery for pictures that include persons that match all persons in picture 1 to obtain picture collection 1.

[0324] The feature result of picture 1 is used to characterize all characters in picture 1, including feature information of multiple characters, and the feature information of each character includes multiple feature points used to characterize the character.

[0325] Regarding the step in which the electronic device searches for pictures that include characters that match all the characters in Picture 1 from a picture library based on the feature results of Picture 1 to obtain Picture Collection 1, in one example, Picture Collection 1 can be obtained by matching the feature results of Picture 1 with character data sets of multiple characters recorded in a database, where each character data set records relevant information about the character, and the relevant information can be, for example, the feature information of the character, mapping information between the character and multiple pictures including the character, etc. In implementation, the electronic device matches the feature information of all the characters in Figure 1 with the character data sets of multiple characters in the database, finds character data sets of some characters that match all the characters in Figure 1, and finds pictures in the picture library that include all the characters in Figure 1 based on the mapping information between each character in the character data set of these characters and multiple pictures.

[0326] Regarding the step in which the electronic device searches for pictures including characters that match all characters in Picture 1 from the picture library based on the feature results of Picture 1 to obtain Picture Collection 1, in another example, the electronic device determines character pictures from the picture library, performs feature extraction on all characters in each character picture, and obtains feature results for each character picture, wherein the feature results for each character picture include character feature information of each character in the character picture, and compares the feature results for each character picture with the feature results of Picture 1, and according to the matching results, obtains a picture including characters that match all characters in Figure 1, that is, the obtained picture includes all characters in Picture 1.

[0327] Exemplarily, when the electronic device performs feature extraction on a person in a picture, it can obtain a feature result by extracting the facial features of the person in the picture. In the process of the electronic device performing feature extraction on all the people in picture 1, the electronic device performs feature extraction on the face of each person in picture 1 to obtain feature information of each person, and the feature information of each person includes multiple feature points of the face of each person, thereby obtaining the feature result of picture 1. Similarly, in the process of the electronic device performing feature extraction on the person-type pictures in the gallery, the electronic device performs feature extraction on the face of each person in each person-type picture to obtain feature information of each person, and the feature information of each person includes multiple feature points of the face of each person, thereby obtaining the feature result of each person-type picture.

[0328] In the embodiments of the present application, there is no limitation on the method for extracting features of a person, as long as feature matching can be performed using the extracted feature points of the person. For example, the method for feature extraction can be scale-invariant feature transform (SIFT), or speeded up robust features (SURF), or oriented features from accelerated segment test (Oriented FAST) and rotated binary robust independent elementary features (Rotated BRIEF) (Oriented FAST and Rotated BRIEF, ORB), etc.

[0329] In step S1112, the electronic device determines whether the number of pictures in picture collection 1 is greater than a number threshold N2, where N2 is an integer greater than 1.

[0330] Taking into account the user's playback experience of the memory video, if the number of pictures in the memory video is too large, it will consume the user's time and cause aesthetic fatigue and other problems, and the user's experience of enjoying the memory video will not be very good. Therefore, a quantity threshold N2 can be set to make the number of pictures in the generated memory video as appropriate as possible, so that the user can better experience the wonderful process of video playback.

[0331] The quantity threshold N2 may be any possible value, for example, the quantity threshold N2 may be 20, 30, 40, 50 or 60, etc.

[0332] When the number of pictures in picture collection 1 is greater than the number threshold N2, the electronic device executes step S1113; when the number of pictures in picture collection 1 is less than or equal to the number threshold N2, the electronic device executes step S1115.

[0333] In step S1113 , when the number of pictures in picture collection 1 is greater than the number threshold N2 , the electronic device determines picture collection 2 based on picture collection 1 .

[0334] It should be understood that the number of pictures in picture collection 2 is less than or equal to the number of pictures in picture collection 1.

[0335] In some embodiments, the electronic device may filter pictures from picture collection 1 according to a timeline of the generation time of all pictures in picture collection 1 to obtain picture collection 2.

[0336] Figure 12 is a schematic flowchart of the process of an electronic device provided in an embodiment of the present application determining picture collection 2 based on picture collection 1, and determining a recall video based on picture collection 2.

[0337] 12 , illustratively, in step S31 , the electronic device determines whether the number M of time periods among the M time periods in which the generation times of all pictures in the picture collection 1 are distributed is less than N2 .

[0338] When the number M of time periods in which the generation times of all pictures are distributed is not less than (ie, greater than or equal to) N2, the electronic device can determine picture collection 2 through method 1 and method 2.

[0339] When the number M of time periods in the M time periods in which the generation times of all pictures are distributed is less than N2, the electronic device can obtain the picture collection 2 through method 3.

[0340] The following describes the process of obtaining the image collection 2 through the above three methods.

[0341] Method 1 (M is greater than or equal to N2)

[0342] In step S32, when the number M of time periods in which the generation time of all pictures in picture collection 1 is distributed is greater than or equal to N2, the electronic device filters out a picture from picture collection 1 in each of the M time periods to obtain picture collection 2, which includes M pictures.

[0343] It should be understood that picture collection 2 includes a picture in each of M time periods. Therefore, picture collection 2 includes M pictures, the M pictures correspond one to one to M time periods, and the generation time of a picture is distributed in one time period.

[0344] During implementation, the electronic device determines that the generation time of all pictures is distributed within M time periods based on the generation time of all pictures, compares M with N2, and if M is greater than or equal to N2, selects one picture from picture collection 1 in each of the M time periods to obtain a second picture set.

[0345] Here, the duration of a time period may be any duration, for example, the duration of a time period may be one day, one week, half a month, one month or more months.

[0346] The M time periods in which the generation times of all images are distributed means that the generation times of all images are distributed within the M time periods, and each time period of the M time periods corresponds to at least one image, or in other words, at least one image is generated within each time period of the M time periods. For example, taking M as 10 and the length of the time period as one month, assuming that image collection 1 includes 12 images, and the generation times of the 12 images are: January, January, February, April, April, May, June, August, September, October, November, and December, and January and April each correspond to 2 images. Therefore, the generation times of the 12 images are distributed in 10 months, of which 8 months correspond to one image, and the remaining 2 months (January and April) correspond to 2 images.

[0347] If each of the partial time periods in the M time periods corresponds to multiple pictures, the electronic device can arbitrarily select one picture in each time period of the partial time period, or it can select the picture with the highest aesthetic score in each time period of the partial time period. The embodiment of the present application does not impose any restrictions.

[0348] Considering that all images in Image Collection 1 are generated over a relatively long timeframe, when filtering images, we try to select one image from each timeframe. This helps users recall events with relatively even time intervals by using images related to all the people in Image Collection 1, which can reduce memory gaps to a certain extent. Overall, the user experience is considered in both the number of images recalled and the time intervals between recalls, balancing different factors to better meet user needs.

[0349] Method 2 (M is greater than or equal to N2)

[0350] In step S33, when the number M of time periods in which the generation time of all pictures in picture collection 1 is distributed is greater than or equal to N2, the electronic device selects a picture from picture collection 1 in each of the N2 time periods that are earlier in the M time periods in chronological order from far to near, to obtain picture collection 2, which includes N2 pictures.

[0351] In this embodiment, since picture collection 2 includes a picture in each of the N2 time periods that are earlier than the M time periods, the number of pictures in picture collection 2 is N2, that is, picture collection 2 includes N2 pictures.

[0352] Here, the N2 time periods that come first among the M time periods can be understood as sorting the M time periods from earliest to latest, with the N2 time periods that come first among the sorted M time periods being earlier than the M-N2 time periods. For example, if M is 10 and N2 is 8, and the M time periods are 10 months, namely January, February, April, May, June, August, September, October, November, and December, the eight time periods that come first among the 10 months are: January, February, April, May, June, August, September, and October.

[0353] During implementation, the electronic device determines, based on the generation time of all images, that the generation time of all images in image collection 1 is distributed within M time periods, sorts the M time periods in chronological order from most recent to most recent, and selects one image from each of the first N2 time periods of the sorted M time periods to obtain image collection 2. It should be understood that when M equals N2, the first N2 time periods of the M time periods constitute the M time period.

[0354] If each time period of some of the first N2 time periods corresponds to multiple pictures, the electronic device can arbitrarily select one picture in each time period of the part of the time period, or it can select the picture with the highest aesthetic score in each time period of the part of the time period. The embodiment of this application does not impose any restrictions.

[0355] It can be understood that based on actual conditions, if it is necessary to control the number of pictures in picture collection 2 to be less than or equal to N2, and the number M of time periods in the M time periods in which the generation time of all pictures in picture collection 1 is distributed is greater than or equal to N2, since the user's memory of events that happened a long time ago is relatively vague, therefore, selecting a picture from each time period of the first N2 time periods that are farther away can enable the user to better recall events that happened a long time ago through pictures, thereby improving the user experience.

[0356] Method 3 (M is less than N2)

[0357] In step S34, when the number M of time periods in which the generation time of all pictures in picture collection 1 is distributed is less than N2, the electronic device filters out at least one picture from picture collection 1 in each of the M time periods to obtain picture collection 2, which includes N2 pictures.

[0358] In this embodiment, because M is less than N2, each time period in a portion of the M time periods (referred to as the first portion of the time periods) can correspond to one image, and each time period in the other portion of the time periods (referred to as the second portion of the time periods) can correspond to multiple images. In other words, the electronic device selects one image in each time period of the first portion of the time periods and multiple images in each time period of the second portion of the time periods, ultimately obtaining N2 images.

[0359] For example, when the electronic device filters pictures in the picture collection 1, it can filter out at least one picture with a high aesthetic score in each time period in order of aesthetic scores from high to low, or it can filter out at least one arbitrary picture in each time period. The embodiment of the present application does not impose any limitations.

[0360] In some embodiments, the second portion of the time period is earlier than the first portion of the time period.

[0361] That is, when filtering images in image collection 1, the electronic device filters more images for more distant time periods. Because users' memories of distant events are relatively vague, filtering multiple images for each time period in the second, more distant time period allows users to better recall distant events through images, improving the user experience.

[0362] For example, M is 10, N2 is 12, and M time periods are 10 months, namely January, February, April, May, June, August, September, October, November, and December. The second time period can be January and February, and the electronic device selects 2 pictures from each of these 2 months. The first time period can be April, May, June, August, September, October, November, and December, and the electronic device selects 1 picture from each of these 8 months, and finally obtains 12 pictures.

[0363] During implementation, the electronic device can filter out one picture in each of the M time periods to obtain M pictures, and then filter out one picture in each of the N2-M time periods that are earlier in the M time periods in chronological order from far to near to obtain N2-M pictures. The M pictures and the N2-M pictures are added together to obtain the picture collection 2 including N2 pictures.

[0364] In other embodiments, without considering the number M of time periods in the M time periods in which the generation times of all images are distributed, the electronic device can analyze all images to obtain aesthetic scores of all images, and filter out the top N2 images in aesthetic score order from all images to obtain an image collection 2 including N2 images.

[0365] In step S1114 , the electronic device generates a memory video based on the picture collection 2 .

[0366] In some embodiments, the electronic device may use all pictures in picture collection 2 as pictures of the recollection video, that is, the recollection video includes all pictures in picture collection 2.

[0367] In other embodiments, as previously described, to maximize the user experience of the video playback process, the number of images in the recollection video should not be excessive. Therefore, based on a preset threshold N2, the number of images in the resulting recollection video is minimized to not exceed N2. Therefore, based on the number of images in image collection 2, the process of generating a recollection video by the electronic device can be divided into the following two cases for illustration.

[0368] Case A: The number of images in image collection 2 is greater than N2

[0369] This situation A corresponds to the situation in step S1113 where picture collection 2 is generated based on method 1. The generation time of all pictures in picture collection 2 is distributed within M time periods, each time period corresponds to a picture, and the number of pictures in picture collection 2 is M, where M is greater than N2.

[0370] 12 , for scenario A, in step S41, the electronic device selects N2 pictures from picture collection 2 to generate a memory video. Exemplarily, the electronic device selects N2 pictures from picture collection 2 and determines the N2 pictures as pictures for the memory video, wherein the memory video includes the N2 pictures.

[0371] In one example, when the number of pictures in picture collection 2 is greater than N2, the electronic device filters the pictures with the top N2 aesthetic scores from picture collection 2 in descending order of aesthetic scores, and determines the obtained N2 pictures as pictures of the recall video.

[0372] For example, the number of pictures in picture collection 2 is 60, N2 is 50, and the top 50 pictures with the highest aesthetic scores are selected from the 60 pictures, and these 50 pictures are used as the pictures of the recall video.

[0373] In another example, when the number of pictures in picture collection 2 is greater than N2, within the M time periods of the generation time distribution of all pictures in picture collection 2, the electronic device determines, in chronological order from far to near, the N2 pictures corresponding to the earlier N2 time periods in the M time periods as pictures of the recall video.

[0374] For example, the number M of pictures in picture collection 2 is 60, N2 is 50, and M time periods are 60 months. 50 pictures corresponding to the first 50 months of the 60 months are determined as pictures of the recall video.

[0375] Case B: The number of pictures in picture collection 2 is equal to N2

[0376] This situation B corresponds to the situation in step S1113 where picture collection 2 is generated based on method 2 or method 3, and picture collection 2 includes N2 pictures, that is, the number of pictures in picture collection 2 is equal to N2.

[0377] 12 , for case B, exemplarily, in step S42 , the electronic device may determine all pictures in picture collection 2 as pictures of a memory video, and the memory video finally obtained includes N2 pictures.

[0378] In step S1115 , when the number of pictures in picture collection 1 is less than or equal to the number threshold N2 , the electronic device generates a recollection video based on picture collection 1 .

[0379] Since the number of pictures in picture collection 1 is less than or equal to the number threshold N2, all pictures in picture collection 1 can be determined as pictures of a memory video, and a memory video can be generated, which can satisfy the user's wonderful experience of watching videos.

[0380] The above specifically describes the process of generating a recall video by the electronic device when picture 1 has not been analyzed (case 1) through steps S1103 and S1115. The following specifically describes the relevant steps performed by the electronic device when picture 1 has been analyzed (case 2).

[0381] Case 2: Image 1 has already been analyzed

[0382] For situation 2 where the picture 1 has already been analyzed, the electronic device may analyze the picture 1 in advance in the following manner, so that after detecting the user's operation 1 on the picture 1 , there is no need to analyze the picture 1 anymore.

[0383] In one example, before detecting a user's operation on picture 1, when the electronic device is in charging mode, the electronic device can actively analyze all pictures in the electronic device to classify the pictures, wherein, during the process of analyzing the pictures, it is analyzed that picture 1 includes a person.

[0384] In another example, before detecting the user's action on picture 1, the user performs an action on another picture to actively trigger the recall function. The electronic device analyzes the pictures in the electronic device and extracts features, etc., selects pictures that match the person in the other picture, generates a picture collection, and generates a recall video. During the above picture analysis process, the analysis of picture 1 is completed. However, although picture 1 has been analyzed, it has not been added to the recall video, or in other words, picture 1 is not included in the existing recall video.

[0385] In another example, before detecting the user's action on Picture 1, the user has already triggered the recall function through Picture 1 or another picture, generating a picture collection and a recall video, and the generated recall video includes Picture 1. Regarding the method in which the user triggers the recall function through another picture, it can be understood that the other picture and Picture 1 have the same person, and the other picture is the picture that meets the matching requirements selected by the electronic device by matching Picture 1 with other pictures in the gallery through features.

[0386] In implementation, for the first two methods of analyzing picture 1, since the existing recall video does not include picture 1, the electronic device can proceed to step S1104 after determining in step S1106. For the last method of analyzing picture 1, since the existing recall video includes picture 1, the electronic device can proceed to step S1107 after determining in step S1106.

[0387] In step S1106 , when picture 1 has been analyzed, the electronic device determines whether the existing recollection video includes picture 1 .

[0388] When the user performs an operation on the currently browsed picture 1, it not only means that the user wants to view other pictures related to the person in picture 1, but also means that the user wants to see picture 1 in the wonderfully played memory video. Therefore, in the case where the existing memory video includes picture 1 (recorded as case 2.1), the electronic device does not need to regenerate the memory video, and executes steps S1107 to S1109 to play the existing memory video through simple human-computer interaction.

[0389] In the case where the existing recall video does not include picture 1 (denoted as case 2.2), the electronic device executes step S1104 and subsequent steps.

[0390] It should be understood that the existing recollection video may be generated through the above-mentioned exemplary embodiments.

[0391] Situation 2.1

[0392] In step S1107 , when the existing memory video includes picture 1 , the electronic device displays a second interface including a second memory entry area.

[0393] It should be understood that the second memory entry area can provide the user with an interface for triggering the memory function. When the user performs an operation in the second memory entry area, the electronic device can display and play the existing memory video.

[0394] For example, referring to the GUI in (b) of FIG6 , the second interface may be the GUI, which includes a memory entry area 62 (i.e., a second memory entry area), and the memory entry area 62 includes a memory entry 621. The memory entry 621 may be a control that displays a cover image of a memory video, and the user clicks the memory entry 621. As previously described, when the memory entry 621 displays a cover image, it means that the image currently being operated by the user already exists in the existing memory video.

[0395] For example, the second interface may further include Picture 1. For example, the second interface may further include other information related to Picture P1, for example, the second interface may include an address area for displaying the address at which Picture 1 was generated. For example, Picture P1 and address area 63 are shown in FIG6( b ).

[0396] In step S1108, the electronic device detects the user's operation in the second memory entry area.

[0397] For example, referring to the GUI in (b) of FIG6 , the user clicks on the memory entry 621 of the memory entry area 62 , and the electronic device detects the user's click operation on the memory entry 621 .

[0398] In step S1109 , the electronic device displays the reminiscent video.

[0399] That is, after detecting the user's operation in the second memory entry area, the electronic device directly displays the existing memory video to the user and automatically plays each picture in the memory video. For example, referring to the GUI shown in (c) of Figure 6, after the user clicks the memory entry 621 in the memory entry area 62, the electronic device displays the existing memory video and automatically plays each picture in the memory video.

[0400] Case 2.2

[0401] In step S1104 , when the existing memory video does not include picture 1 , the electronic device displays a first interface including a first memory entry area.

[0402] In some embodiments, the first interface displayed by the electronic device in situation 2.2 may be the same as the first interface displayed in situation 1. For a specific description, please refer to the specific description of step S1104 in situation 1 above, which will not be repeated here.

[0403] In other embodiments, since the image P1 has been analyzed, the first interface displayed by the electronic device in situation 2.2 may be different from the first interface displayed in situation 1. For example, referring to the GUI in (b) of FIG7 , the first interface may be this GUI, which includes not only a memory entry area 72 (corresponding to the first memory entry area) but also a character area 71. The character area 71 includes a character image of a character obtained after analyzing the image P1, thereby improving the user's visual experience.

[0404] Subsequently, the electronic device executes step S1105 and subsequent steps. For detailed descriptions, please refer to the relevant descriptions of the same steps in situation 1, which will not be repeated here.

[0405] The method 1100 has been described in detail above. It should be understood that the various steps in the above example are merely illustrative and should not constitute a limitation on the embodiments of the present application. The implementation process may include more or fewer steps.

[0406] For example, step S1102 is an optional step. After the electronic device completes step S1101, it does not need to determine whether picture 1 has been analyzed. Regardless of whether picture 1 has been analyzed, the electronic device directly executes step S1103 to analyze picture 1. It should be understood that if the electronic device does not execute step S1102, it naturally does not execute steps S1106 to S1109.

[0407] For another example, the electronic device executes step S1102, but step S1106 can be an optional step. The electronic device may not need to execute step S1106, and naturally, it does not need to execute steps S1107 to S1109.

[0408] For another example, step S1110 is an optional step. For an electronic device with good processing capability, the electronic device directly executes step S1111 after executing step S1105.

[0409] For another example, step S1112 is an optional step. After the electronic device executes step S1111, it can directly use all the pictures in picture collection 1 as the pictures for the recall video without considering whether the number of pictures in picture collection 1 is too large. This processing is simple and easy, saving processing time. It should be understood that if the electronic device does not execute step S1112, it naturally does not need to execute steps S1113 and S1114.

[0410] FIG13 is a schematic flow chart of a method 1300 for generating a recall video according to an embodiment of the present application. The method primarily describes a process in which a user can select any person in an image, an electronic device matches the selected person, searches a gallery for images containing the selected person, and generates a collection of images and a recall video. This process can be described in conjunction with the GUIs of FIG8 through FIG10.

[0411] In terms of implementation steps, there are two main differences between method 1300 and method 1100. First, the process of obtaining picture collection 1 based on user operation is different. In method 1300, the electronic device obtains picture collection 1 through steps S1311a to S1311c, and in method 1100, the electronic device obtains picture collection 1 through step S1111. Second, in case 2.1 where picture 1 has been analyzed, when it is determined that the existing memory video includes picture 1, based on the different operations of the user in the second memory entry area, the electronic device can perform different steps to display or regenerate the memory video. In method 1300, the electronic device can not only perform steps S1308a and S1308b based on the user's operation 1 to display the existing memory video, but can also perform step S1308b based on the user's operation 2 to generate a new memory video.

[0412] In step S1301 , the electronic device detects a user's operation on picture 1 .

[0413] In step S1302 , after detecting the user's operation on the picture 1 , the electronic device determines whether the picture 1 has been analyzed.

[0414] If the picture 1 has been analyzed, it means that the picture 1 includes a person, and optionally, the electronic device executes step S1306. If the picture 1 has not been analyzed, the electronic device executes step S1303.

[0415] For the detailed description of step S1301 and step S1302, please refer to the relevant description of step S1101 and step S1102 in method 1100, which will not be repeated here.

[0416] Below, first, the relevant steps (steps S1303 to S1315) performed by the electronic device in case 1 when picture 1 has not been analyzed are described in detail, and then the relevant steps performed by the electronic device in case 2 when picture 1 has been analyzed are described in detail.

[0417] Case 1: Image 1 has not been analyzed

[0418] For detailed descriptions of steps S1303 to S1310, reference may be made to the relevant descriptions of steps S1103 to S1110 in method 1100, which will not be repeated here.

[0419] In step S1311a, when the number of people in picture 1 is less than or equal to the number threshold N1, the electronic device displays a third interface including pictures of all people in picture 1.

[0420] In this step, the electronic device recognizes all people in picture 1 and displays a third interface including the images of all the recognized people in picture 1. The user can select an image of a person of interest from among all the images based on their preferences, causing the electronic device to search the image library for images matching the person selected by the user.

[0421] For example, referring to the GUI in (c) of FIG8 , the GUI may be a third interface, including a character area 83. The character area 83 includes pictures of all characters (e.g., Xiao Li, Xiao Mei, and Xiao Hong) recognized by the electronic device from picture P1 (i.e., picture 1). The user selects pictures of characters of interest from all the pictures of characters based on their preferences. For example, the user selects pictures of “Xiao Li” and “Xiao Mei.” After selecting the pictures of the characters of interest, the user clicks a confirmation control, such as “√.”

[0422] In step S1311b, the electronic device detects an operation of the user selecting a picture of at least one person.

[0423] Based on his / her own preferences, the user selects a picture of at least one character that he / she is interested in from all the pictures of characters. In response to the user operation, the electronic device detects the user's operation of selecting the picture of at least one character.

[0424] For example, referring to (c) in Figure 8, the user selects the character pictures of "Xiao Li" and "Xiao Mei" and clicks a confirmation control such as "√". The mobile phone detects the user's operation of selecting the character pictures of "Xiao Li" and "Xiao Mei" and clicking the confirmation control.

[0425] In step S1311c, the electronic device searches for pictures including a person matching at least one person selected by the user from the picture library to obtain picture collection 1.

[0426] The only difference between this step and step S1111 is that step S1111 searches for pictures including characters that match all characters in picture 1, while in step S1311c, the electronic device searches for pictures including characters that match at least one character in picture 1. When performing feature extraction on picture 1, feature extraction can be performed only on at least one character selected by the user to obtain a feature result for picture 1, which includes feature information of at least one character.

[0427] Therefore, for the specific description of step S1311c, please refer to the relevant description of step S1111 in method 1100, and no further details will be given. All characters in step S1111 can be replaced with at least one character here.

[0428] After the electronic device completes step S1311c, it executes step S1312 and, based on the number of images in image collection 1, executes steps S1313 and S1314, or executes step S1315. For a detailed description of steps S1312 to S1315, reference can be made to the description of steps S1112 to S1115 in method 1100, and these descriptions are omitted.

[0429] Case 2: Image 1 has already been analyzed

[0430] In step S1306 , when picture 1 has been analyzed, the electronic device determines whether the existing recollection video includes picture 1 .

[0431] In case 2.1 that the existing recollection video includes picture 1, the electronic device executes step S1307; in case 2.2 that the existing recollection video does not include picture 1, the electronic device executes step S1304 and subsequent steps.

[0432] Situation 2.1

[0433] In step S1307, when the existing memory video includes picture 1, the electronic device displays a second interface including a second memory entry area.

[0434] In this step, the second memory entry area can provide the user with an interface for triggering the memory function. The user can perform different operations in the second memory entry area to display existing memory videos or generate new memory videos.

[0435] In some embodiments, the second memory entry area includes a first memory entry and a second memory entry, the first memory entry is used to display an existing memory video, and the second memory entry is used to generate a new memory video.

[0436] It can be understood that since method 1300 generates a picture collection and a memory video of any character selected by the user, even if the existing memory video includes Picture 1, for the same picture (Picture 1), the characters selected by the user at different times may be different. Therefore, the second memory entrance in the second memory entrance area provides the user with a more flexible selection space and a good user experience.

[0437] For example, referring to the GUI in (b) of FIG9 , the second interface may be the GUI, which includes a memory entry area 92 (i.e., a second memory entry area), and the memory entry area 92 includes a memory entry 921 (i.e., a first memory entry) and a memory entry 922 (i.e., a second memory entry). The user can use the memory entry 921 to display the existing memory video on the mobile phone, and the user can use the memory entry 922 to reselect any character to generate a new memory video.

[0438] In step S1308a, the electronic device detects the user's operation 1 in the second memory entry area.

[0439] In step S1309 , the electronic device displays the reminiscent video.

[0440] It should be understood that Operation 1 is an operation for displaying a memory video. For example, Operation 1 can be a user's operation on the first memory entry in the second memory entry area. In response to the user's operation on the first memory entry, the electronic device detects Operation 1 and displays the memory video. For example, referring to the GUI in Figure 9 (b), in response to the user clicking on the memory entry 921, the mobile phone detects the operation and displays the GUI in Figure 9 (d), that is, displaying the existing memory video.

[0441] In step S1308b, the electronic device detects the user's operation 2 in the second memory entry area.

[0442] It should be understood that Operation 2 is an operation for generating a new memory video. For example, Operation 2 may be a user's operation on a second memory entry in the second memory entry area. In response to the user's operation on the second memory entry, the electronic device detects Operation 2. For example, referring to the GUI in Figure 9 (b), in response to a user clicking on a memory entry 922, the mobile phone detects this operation and displays the GUI in Figure 9 (c).

[0443] After the electronic device detects the user's operation 2 at the second memory entrance, step S1311a and subsequent steps are executed to generate a new memory video. Please refer to the relevant description above and will not repeat them here.

[0444] It should be understood that the second interface of the above example is only for illustrative purposes and should not be construed as limiting. In other embodiments, the second memory entry area of ​​the second interface may include either the first memory entry or the second memory entry. In the case where the second memory entry area may include the first memory entry but not the second memory entry, step S1308b and subsequent steps do not need to be performed. In the case where the second memory entry area may include the second memory entry but not the first memory entry, steps S1308a and S1309 do not need to be performed.

[0445] Case 2.2

[0446] In step S1304, when the existing memory video does not include picture 1, the electronic device displays a first interface including a first memory entry area.

[0447] In some embodiments, the first interface displayed by the electronic device in situation 2.2 may be the same as the first interface displayed in situation 1. For a specific description, please refer to the specific description of step S1304 in situation 1 above, which will not be repeated here.

[0448] In other embodiments, since the image P1 has been analyzed, the first interface displayed by the electronic device in situation 2.2 may be different from the first interface displayed in situation 1. For example, referring to the GUI in (b) of FIG10 , the first interface may be this GUI, which includes not only a memory entry area 102 (i.e., a first memory entry area) but also a character area 101. The character area 101 includes a character image of a character obtained after analyzing the image P1, thereby improving the user's visual experience.

[0449] Subsequently, the electronic device executes step S1305 and subsequent steps. For detailed descriptions, please refer to the relevant descriptions of the same steps in case 1 in method 1300, which will not be repeated here.

[0450] The method 1300 has been described in detail above. It should be understood that the various steps in the above example are merely illustrative and should not constitute a limitation on the embodiments of the present application. The implementation process may include more or fewer steps.

[0451] Figure 14 is a schematic flowchart of the process of an electronic device generating a picture collection and a recall video when the number of people in the picture is greater than the number threshold N1, provided by an embodiment of the present application.

[0452] It should be understood that before executing step S1411a, for picture 1, the electronic device displays the first interface through method 1100 or method 1300. After the electronic device detects the user's operation in the first memory entrance area of ​​the first interface, it executes step S1411a when it determines that the number of characters in picture 1 is greater than the number threshold N1.

[0453] In step S1411a, when the number of people in picture 1 is greater than the number threshold N1, the electronic device displays a fourth interface including pictures of N1 people among all the people in picture 1.

[0454] Taking into account the processing capabilities of current electronic devices, if the number of characters that need to be matched is too large, the electronic device may not be able to perform feature matching on too many characters. Therefore, after the electronic device identifies all the characters in picture 1, it determines N1 characters from all the characters and recommends them to the user. The character pictures of the N1 characters are displayed through the fourth interface for the user to choose. The user can select a character picture of at least one character from the character pictures of the N1 characters, so that the electronic device can search the gallery for a picture that matches the at least one character selected by the user.

[0455] Figure 15 is a schematic diagram of the fourth interface provided by an embodiment of the present application. Referring to Figure 15 , the fourth interface includes picture 1 and a person area 151. Picture 1 includes five people, N1 = 4. Since the number of people in picture 1 is greater than 4, only four people's pictures are displayed in person area 151. The user selects all four people and clicks a confirmation control, such as a "√" button.

[0456] In this step, the N1 characters in the picture 1 may be any N1 characters among all the characters in the picture 1, or may be N1 characters determined by the electronic device based on a rule, and no limitation is made here.

[0457] In an embodiment in which an electronic device determines N1 characters based on rules, in some embodiments, the electronic device may determine the characters with the largest N1 facial area proportions as the N1 characters for recommendation to the user in the order of facial area proportions of all characters in picture 1 from largest to smallest.

[0458] That is, the face area ratio of the N1 person is greater than the face area ratio of all the people in picture 1 except the N1 person. It should be noted that the face area ratio here refers to the size of the face area of ​​a person that occupies the entire area of ​​the picture.

[0459] It is understandable that when there are a large number of people in a picture, it is inevitable that the faces of some people occupy a smaller area of ​​the entire picture, and the faces of some people cannot even be seen, which affects the feature extraction of the people and further affects the search for pictures of related people. Therefore, based on the face area ratio, N1 people with a larger face area ratio are recommended to the user, so that the features of the people can be extracted as well as possible to find pictures of related people without affecting the user experience.

[0460] In other embodiments, the electronic device may also determine the N1 characters based on other rules. For example, the electronic device may determine the N1 characters with richer expressions among all the characters in the picture 1 as the N1 characters to be recommended to the user.

[0461] In step S1411b, the electronic device detects an operation of the user selecting a picture of at least one person among the N1 people.

[0462] Based on his / her own preferences, the user selects a picture of at least one character from N1 characters recommended by the electronic device. In response to the user operation, the electronic device detects the user's operation of selecting the picture of at least one character from the N1 characters.

[0463] For example, referring to FIG15 , the user selects the character pictures of all the four recommended characters and clicks a confirmation control such as “√”. The mobile phone detects the user's operation of selecting the character pictures of the four characters and clicking the confirmation control.

[0464] In step S1411c, the electronic device searches the gallery for pictures including a person matching at least one person selected by the user to obtain picture collection 1.

[0465] For a detailed description of this step, please refer to the description of step S1111, which will not be repeated here. The only difference is that method S1111 searches for pictures that include people that match all people in picture 1, while in step S1411c, the electronic device searches for pictures that include people that match at least one of the N1 people in picture 1. When extracting features from picture 1, feature extraction is performed only on at least one of the N1 people selected by the user.

[0466] After the electronic device completes step S1411c, it executes step S1412 and, based on the number of images in image collection 1, executes steps S1413 and S1414, or executes step S1415. For a detailed description of steps S1412 to S1415, reference can be made to the description of steps S1112 to S1115 in method 1100, which will not be repeated here.

[0467] For a previously generated memory video, after a period of time, multiple new pictures are generated in the electronic device. The user can update the picture collection and update the memory video with any new picture. The following describes the process of updating the picture collection and updating the memory video in detail.

[0468] FIG16 is a schematic flowchart of a method 1600 for generating a memory video provided in an embodiment of the present application, which mainly describes a process in which an electronic device updates a picture collection and updates a memory video based on new pictures.

[0469] For ease of description, the previously generated picture collection for directly generating a memory video is referred to as the old picture collection, and the previously generated memory video is referred to as the old memory video. Here, the old picture collection can be the picture collection 1 or picture collection 2 directly used for generating a memory video obtained by method 1100, method 1300, or method 1400 above. It should be understood that when the old picture collection is the picture collection 1 above, picture collection 1 is a picture collection in which the number of pictures is less than or equal to N2.

[0470] Assume that the electronic device generates an old picture collection and an old memory video through the user's operation on picture 1 at time 1 (for example, 14:00 on March 15, 2023), and the pictures in the old picture collection and the old memory video are all pictures obtained before time 1 of the electronic device; in time period 1 (for example, 14:00 on March 15, 2023-12:00 on June 15, 2023) between time 1 and time 2 (for example, 12:00 on June 15, 2023), the electronic device obtains multiple new pictures through various methods such as shooting or downloading, and updates the old picture collection and the old memory video through any new picture (recorded as picture 2). Time 2 can be understood as the time for updating the old picture collection and the old memory video.

[0471] In step S1610 , the electronic device obtains picture collection 3 based on picture 2 .

[0472] In this step, the user performs an operation on the picture 2, and finally obtains the picture collection 3 through the above-mentioned method 1100, 1300 or 1400.

[0473] It should be noted that picture collection 3 is directly used to update the memory video. For example, in the case where picture collection 3 is obtained through method 1100, picture collection 3 can be the picture collection used to generate the memory video in step S1114 (picture collection 3 is analogous to picture collection 2 in step S1114), or picture collection 3 can be the picture collection used to generate the memory video in step S1115 (picture collection 3 is analogous to picture collection 1 in step S1115). The explanation of obtaining picture collection 3 through method S1300 and method 1400 is the same as that of method 1100 and will not be repeated here.

[0474] It should be understood that for old picture collections and old memory videos, in the process of obtaining picture collection 3 based on picture 2, the electronic device searches for pictures of the same person based on user operations. That is to say, picture collection 3 and the old picture collection (or old memory video) are associated with the same person, or in other words, picture collection 3 and the old picture collection (or old memory video) both include the same person. For example, in the old picture collection and the old memory video, the electronic device searches for pictures of person 1, person 2, and person 3 in the gallery based on user operations. Then, in the process of obtaining picture collection 3 based on picture 2, the electronic device also searches for pictures of person 1, person 2, and person 3 in the gallery based on user operations. Picture collection 3 and the old picture collection (or old memory video) both include person 1, person 2, and person 3.

[0475] In some embodiments, in the process of obtaining picture collection 3 based on picture 2, the electronic device searches the picture library for pictures including the same person obtained by the electronic device in time period 1 between time 1 and time 2, to obtain picture collection 3. In implementation, illustratively, the electronic device determines the generation time of the old picture collection (or old memory video) as time 1 through the recorded time data of the old picture collection (or old memory video), determines the current time (i.e., time 2), and when searching for pictures, filters out pictures including the same person obtained by the electronic device in time period 1 between time 1 and time 2 from the picture library, and finally obtains picture collection 3.

[0476] In other embodiments, in the process of obtaining picture collection 3 based on picture 2, the electronic device may also search the gallery for pictures including the same person obtained by the electronic device during time period 2 between time 1 and the shooting of picture 2 (recorded as time 3) to obtain picture collection 3. In implementation, illustratively, the electronic device determines the generation time of the old picture collection (or old memory video) as time 1 and the shooting time of picture 2 as time 3 through the recorded time data of the old picture collection (or old memory video). When searching for pictures, the electronic device filters out the pictures including the same person obtained by the electronic device during time period 3 between time 1 and time 3 from the gallery, and finally obtains picture collection 3.

[0477] In step S1620 , the electronic device updates the old picture collection based on picture collection 3 .

[0478] Add all the pictures in picture collection 3 to the old picture collection, update the old picture collection, and obtain an updated picture collection. The updated picture collection includes the pictures in the old picture collection and the pictures in picture collection 3.

[0479] In step S1630 , the electronic device updates the old memory video based on the picture collection 3 .

[0480] For the sake of convenience of description, the number of pictures in picture collection 3 is recorded as N3, that is, picture collection 3 includes N3 pictures, and the number of pictures in the old memory video is recorded as N4, that is, the old memory video includes N4 pictures.

[0481] In some embodiments, the electronic device adds N3 pictures in picture collection 3 to the old memory video to obtain an updated memory video.

[0482] In other embodiments, considering that the number of pictures in the memory video is too large and affects the user experience, the number of pictures in the updated memory video is made less than or equal to N1 as much as possible.

[0483] Exemplarily, the electronic device updates the old memory video according to the sum of the number N3 of pictures in the picture collection 3 and the number N4 of pictures in the old memory video.

[0484] When the sum of N3+N4 is less than or equal to N2, the electronic device adds all pictures in picture collection 3 to the old memory video to obtain an updated memory video, wherein the number of pictures in the updated memory video is less than or equal to N1.

[0485] For example, N2=50, N3=20, N4=25, N3+N4=45<50, therefore, all 20 pictures in picture collection 3 are added to the old memory video, and the number of pictures in the updated memory video is equal to 45, which is less than 50.

[0486] If the sum of N3 + N4 is greater than N2, the electronic device adds N3 pictures from picture collection 3 to the old memory video and deletes N5 pictures from the memory video, resulting in an updated memory video where N5 = N3 + N4 - N2. The number of pictures in the updated memory video is equal to N2, meaning the updated memory video includes N2 pictures.

[0487] For example, N2=50, N3=20, N4=50, then N5=N3+N4-N2=20, where N3+N4=70>50. Therefore, the electronic device adds 20 pictures in picture collection 3 to the old memory video and deletes 20 pictures from the memory video. In this way, the number of pictures in the updated memory video is equal to 50.

[0488] When deleting N5 pictures in a memory video, for example, the N5 pictures with the worst aesthetic scores among the N4 pictures in the old memory video can be deleted, and the pictures other than the N5 pictures among the N4 pictures are retained, wherein the aesthetic scores of the pictures other than the N5 pictures among the N4 pictures are higher than those of the N5 pictures.

[0489] In some embodiments, the updated recollection video includes Picture 2 .

[0490] It can be understood that the user operates on Picture 2 while browsing Picture 2 to recall related people, which means that the user likes Picture 2 or Picture 2 can evoke the user's memories more strongly. Therefore, adding Picture 2 to the updated memory video can meet user needs and improve user experience.

[0491] In other embodiments, in the embodiment where the updated memory video includes Picture 2, the cover picture of the updated memory video can be Picture 2 or the cover picture of the old memory video (for example, Picture 1), without any limitation.

[0492] In one example, the electronic device may use the picture with the higher aesthetic score as the cover picture of the updated memory video based on the aesthetic scores of Picture 2 and the cover picture of the old memory video (eg, Picture 1).

[0493] In another example, the electronic device replaces the cover picture of the updated memory video with picture 2.

[0494] In another example, the electronic device does not change the cover image of the memory video, and still uses the cover image of the old memory video as the cover image of the updated memory video.

[0495] Figure 17 shows another set of GUIs provided by an embodiment of the present application, illustrating the GUI before and after updating an old memory video. Figure 17 (a) illustrates the GUI before updating an old memory video, and Figure 17 (b) illustrates the GUI after updating an old memory video.

[0496] Referring to the GUI in (a) of FIG17 , this GUI is a GUI for displaying memory videos in the “Memories” category interface. The GUI displays a portion of all the memory videos already in the phone. The user performs an operation such as swiping up on the display interface. In response to the user operation, the display interface can scroll to display another portion of the memory videos that are not displayed. The old memory video is a memory video with the theme of “Old Friends Gathering”, which is located at the bottom of the display interface. The cover picture is Picture 1, which includes the user himself (Xiao Mei), his friends “Xiao Li” and “Xiao Hong”.

[0497] Referring to the GUI in (a) of Figure 17, for the instantly updated memory video with the theme of "getting together with old friends", the memory video with this theme is displayed at the front position of the interface in the "Memories" category. Since it is an instantly updated memory video, the probability of users viewing it will be higher. Therefore, placing the instantly updated memory video in the first position of the interface can avoid searching for the newly generated memory video through operations such as sliding operations, which is very convenient for users to view. In implementation, for the instantly updated memory video, the mobile phone inserts the instantly updated memory video in front of all the memory videos, and moves the remaining memory videos back in sequence according to the existing order. In addition, the cover picture in the updated memory video is also changed from the original picture 1 to picture 2.

[0498] 18 is a schematic flow chart of a method 1800 for generating a memory video according to an embodiment of the present application. The method 1800 is described in conjunction with the above methods 1100, 1300, and 1400.

[0499] In step S1810, the electronic device displays a first display interface, where the first display interface includes a first picture, and the first picture includes a plurality of characters.

[0500] Exemplarily, the first display interface is an interface of a gallery application.

[0501] Exemplarily, the first picture is any picture already in the electronic device, which may be a previously stored picture, or a picture taken instantly or obtained through other means, for example, a picture obtained by Bluetooth transmission with other electronic devices, or a picture downloaded from a social application.

[0502] Exemplarily, referring to (a) and (b) in Figure 3, the mobile phone opens the gallery application and displays the main interface of the gallery application. The user wants to view picture P1 (corresponding to the first picture) and clicks on picture P1. In response to the user's operation of clicking on picture P1, the mobile phone displays the GUI shown in (c) in Figure 3. The GUI (corresponding to the first display interface) displays an enlarged picture P1, which includes 3 characters.

[0503] In step S1820, the electronic device displays a second display interface in response to the user's first operation on the first picture, where the second display interface includes a memory entrance area.

[0504] In implementation, a user performs a first operation on a first picture, the electronic device detects the first operation, and displays a second display interface in response to the first operation.

[0505] Exemplarily, the user's operation on the first picture is any operation that can trigger the recall function, and the present application embodiment does not impose any limitation thereto. Based on the operation, the electronic device continues to perform subsequent steps to generate a picture collection and a recall video, thereby realizing the recall function of the electronic device.

[0506] In one example, the first operation may be a sliding operation on the first image, and the sliding operation may be a sliding operation in any direction. For example, the sliding operation may be an upward sliding operation as shown in (c) of FIG3 . For another example, the sliding operation may be a downward sliding operation, a horizontal sliding operation, etc.

[0507] In other examples, the first operation may also be, for example, a long press operation, a double-click operation, a single-click operation, a two-finger press operation, etc.

[0508] The second display interface includes a memory entrance area, which can provide users with an interface for generating memory functions. Users can generate picture collections and memory videos by performing operations in the memory entrance area.

[0509] As mentioned above, the electronic device may analyze the first picture in various situations. If the first picture has been analyzed, the electronic device may not need to repeatedly analyze the first picture, reducing the process of analyzing the picture and thus reducing the processing time; if the first picture has not been analyzed, the first picture is analyzed immediately in response to the first operation.

[0510] For step S1820, in some embodiments, the electronic device responds to the first operation and, when the first image has not been analyzed, analyzes the first image to obtain an analysis result, where the analysis result is used to indicate that the first image includes a person; the electronic device responds to the analysis result by displaying the second display interface.

[0511] During implementation, the electronic device may first determine whether the first picture has been analyzed in response to the first operation, analyze the first picture if it is determined that the first picture has not been analyzed, and display the second display interface if it is determined that the first picture includes a person.

[0512] The implementation process of this embodiment may correspond to the process of executing step S1104 through step S1103 in method 1100. For the specific description of this embodiment, please refer to the relevant description above and will not be repeated here. The second display interface here may correspond to the first interface above, and the memory entrance area corresponds to the first memory entrance area in the first interface.

[0513] Regarding step S1820, in other embodiments, the electronic device displays the second display interface in response to the first operation when the first image has been analyzed to include a person and the first image does not exist in the existing memory video.

[0514] Exemplarily, the second display interface includes pictures of the multiple recognized characters.

[0515] In implementation, the electronic device can, in response to the first operation, first determine whether the first picture has been analyzed. If it is determined that the first picture has been analyzed and includes a person, determine whether the first picture exists in an existing memory video. If it is determined that the first picture does not exist in the existing memory video, display the second display interface.

[0516] The implementation process of this embodiment may correspond to the process of method 1100 executing step S1104 through step S1102 and step S1106. For the specific description of this embodiment, please refer to the relevant description above and will not be repeated here. The second display interface here may correspond to the first interface above, and the memory entrance area here corresponds to the first memory entrance area in the first interface.

[0517] In step S1830, the electronic device extracts features of at least one of the multiple characters in response to the user's second operation on the memory entrance area to obtain a feature result.

[0518] In implementation, a user performs a second operation on the memory entry area of ​​the second display interface. The electronic device detects the second operation and, in response to the second operation, extracts features of at least one person from the plurality of people in the first image to obtain a feature result. The feature result is used to represent the at least one person and includes feature information of the at least one person.

[0519] For example, the second operation may be an operation in which the user clicks on the memory entry area. In conjunction with the above, the second operation may correspond to the operation of the user on the first memory entry of the first interface in step S1105 above.

[0520] In an embodiment of the present application, after detecting the second operation, the electronic device can extract features of all characters in the first picture, or can further extract features of any character in the first picture based on the user's selection of the character, without any limitation.

[0521] Regarding step S1830, in some embodiments, the electronic device extracts features from all of the multiple characters in response to the second operation to obtain the feature results.

[0522] That is, after detecting the second operation, the electronic device does not need to perform any additional analysis on the first image or any other human-computer interaction operations, and the electronic device directly extracts features of all people in the first image. In implementation, after detecting the second operation, the electronic device performs feature extraction on all people in the first image by default.

[0523] The implementation process of this embodiment may correspond to the relevant process of step S1111 of method 1100. For the specific description of this embodiment, please refer to the relevant description above and will not be repeated here.

[0524] For step S1830, in other embodiments, the electronic device displays a fourth display interface in response to the second operation, and the fourth display interface includes the identified pictures of the multiple characters; the electronic device extracts features of the at least one character in response to the user selecting the picture of the at least one character among the multiple characters to obtain the feature result.

[0525] During implementation, the electronic device responds to the second operation and displays a fourth display interface for the user to select character pictures of multiple characters in the fourth display interface. The user selects a character picture of at least one character from the multiple characters. The electronic device detects the user operation and determines that the user wants to recall memories related to the at least one character. Therefore, feature extraction is performed on the at least one character to obtain feature results.

[0526] The implementation process of this embodiment may correspond to the process of extracting features in steps S1311a, S1311b, and S1311c of method 1300. For a detailed description of this embodiment, please refer to the above related description and will not be repeated here. The fourth display interface here may correspond to the third interface above.

[0527] For step S1830, in other embodiments, in step S1820 before step S1830, the electronic device displays the second display interface in response to the first operation, when the first picture has been analyzed to include a person and the first picture exists in an existing memory video, and the memory entry area of ​​the second display interface includes a first memory entry and a second memory entry, the first memory entry is used to display the existing memory video according to the user operation, and the second memory entry is used to generate a new memory video; and, in step S1830, the electronic device displays the fourth display interface in response to the user operation of the second memory entry.

[0528] This embodiment may correspond to the process of extracting features by executing steps S1307, S1308b, S1311a, S1311b, and S1311c in method 1300 through steps S1302 and S1306. For the specific description of this embodiment, please refer to the relevant description above and will not be repeated here. The second display interface here corresponds to the second interface above, the first memory entry area and the second memory entry area here correspond to the first memory entry and the second memory entry of the second interface above, respectively, and the fourth display interface here corresponds to the third interface above.

[0529] In addition, in the embodiment of the present application, considering the processing capability of the electronic device, if the number of people that need to be matched is too large, the electronic device may not be able to perform feature matching on too many people. Therefore, a quantity threshold N1 can be set based on the processing capability of the electronic device, so that the number of people matched by the electronic device is at most N1.

[0530] For step S1830, in some embodiments, in response to the second operation, when the number of people in the first picture is less than or equal to the first number threshold N1, the electronic device performs feature extraction on at least one of the multiple people to obtain the feature result, where N1 is an integer greater than 1.

[0531] That is to say, after detecting the user's second operation, the electronic device can first determine whether the number of people in the first picture is greater than N1. If it is less than or equal to N1, feature extraction is performed on at least one person. Corresponding to method 1100, feature extraction is performed on all multiple people in the first picture, and corresponding to method 1300, feature extraction is performed on at least one person selected by the user in the first picture.

[0532] For step S1830, in other embodiments, in response to the second operation, when the number of characters in the first picture is greater than the first number threshold N1, the electronic device displays a fifth display interface, and the fifth display interface includes character pictures of N1 characters among the multiple characters, where N1 is an integer greater than 1; in response to the user's operation of selecting the character picture of at least one character among the N1 characters, the electronic device performs feature extraction on the at least one character to obtain the feature result.

[0533] That is to say, after detecting the user's second operation, the electronic device can first determine whether the number of characters in the first picture is greater than N1. If it is greater than N1, the fifth display interface is displayed. The fifth display interface includes character pictures of N1 characters among the multiple identified characters. The user selects a character picture of at least one character from the N1 characters. The electronic device detects the user's operation of selecting a character picture of at least one character, and in response to the operation, performs feature extraction on the at least one character selected by the user.

[0534] In the step of the electronic device displaying the fifth display interface when the number of people in the first picture is greater than N1, exemplarily, the electronic device determines the top N1 people in terms of facial area proportion in the order of the facial area proportions of the multiple people from large to small; and displays the fifth display interface.

[0535] This embodiment corresponds to the process of extracting features in steps S1411a, S1411b, and S1411c of method 1400. For detailed description, please refer to the above related description and will not be repeated here. The fifth display interface here corresponds to the fourth interface in method 1400.

[0536] In step S1840, the electronic device performs an image search based on the feature result to obtain a first image collection, where each image in the first image collection includes a person that matches the at least one person.

[0537] During implementation, the electronic device searches for pictures including persons that match at least one person in the first picture based on the feature results to obtain a first picture collection. In this way, each picture in the first picture collection includes persons that match the at least one person.

[0538] When the at least one person is all the people in the first picture by default of the electronic device, this step may correspond to step S1111 in method 1100 above. When the at least one person is a person selected from multiple people in the first picture based on user operation, this step may correspond to step S1311c in method 1300 above, or to step S1411c in method 1400 above. For specific descriptions, please refer to the relevant descriptions above and will not be repeated here. The first picture collection here corresponds to picture collection 1 above.

[0539] In step S1850, the electronic device generates a first recollection video based on the first picture collection, where the first recollection video includes at least some of the pictures in the first picture collection.

[0540] Exemplarily, the cover picture of the first reminiscence video is the first picture.

[0541] In the embodiment of the present application, taking into account the user's playback experience of the memory video, if the number of pictures in the memory video is too large, it will consume the user's time and cause problems such as aesthetic fatigue, and the user's experience of enjoying the memory video will not be very good. Therefore, a second quantity threshold N2 can be set to make the number of pictures in the generated memory video as appropriate as possible, so that the user can better experience the wonderful process of video playback.

[0542] For step S1850, when the number of pictures in the first picture collection is less than or equal to the second number threshold N2, the electronic device determines all pictures in the first picture collection as pictures of the first recollection video, where N2 is an integer greater than 1.

[0543] That is, in the case where the number of pictures in the first picture collection is less than or equal to the second number threshold N2, the pictures in the first recollection video are all the pictures in the first picture collection.

[0544] For a detailed description of this situation, please refer to the relevant description of step S1115, which will not be repeated here.

[0545] For step S1850, when the number of pictures in the first picture collection is greater than N2, the electronic device determines a second picture collection based on the first picture collection; and the electronic device generates the first recollection video based on the second picture collection.

[0546] This situation may correspond to step S1113 and step S1114 in method 1100 , and reference may be made to the relevant description above.

[0547] Regarding the process of determining the second picture collection based on the first picture collection, in some embodiments, the electronic device determines the second picture collection from the first picture collection based on the generation time of all pictures in the first picture collection.

[0548] In one example, when the number M of time periods in which the generation times of all pictures in the first picture collection are distributed is greater than or equal to N2, the electronic device selects a picture from the first picture collection in each of the M time periods to obtain the second picture collection, and the second picture collection includes M pictures, where M is an integer greater than or equal to 1.

[0549] This embodiment may correspond to the implementation process of method 1 (ie, step S32) in step S1113 above. For a specific description, reference may be made to the relevant description above and will not be repeated here.

[0550] In conjunction with the above embodiment, since the second image collection includes M images, where M is greater than or equal to 1, in the step of generating the first recollection video based on the second image collection, the electronic device illustratively selects N2 images from the second image collection. Exemplarily, the electronic device selects the top N2 images in the second image collection in descending order of aesthetic scores to obtain the N2 images. The electronic device then determines the N2 images as images for the first recollection video. In this way, the first recollection video includes N2 images, satisfying the user experience.

[0551] This embodiment may correspond to the implementation process of step S41 in the above situation A. For the specific description, please refer to the relevant description above and will not be repeated here.

[0552] In another example, when the number M of time periods in the M time periods in which the generation times of all pictures in the first picture collection are distributed is greater than or equal to N2, the electronic device filters a picture from the first picture collection in each of the N2 time periods that are earlier in the M time periods in chronological order from far to near, to obtain the second picture collection, which includes N2 pictures, and M is an integer greater than or equal to 1.

[0553] This embodiment may correspond to the implementation process of method 2 (ie, step S33) in step S1113 above. For a specific description, reference may be made to the relevant description above and will not be repeated here.

[0554] In combination with this embodiment, since the second picture collection includes N2 pictures, the electronic device determines the N2 pictures in the second picture collection as pictures in the first recollection video.

[0555] In another example, when the number M of time periods in which the generation times of all pictures in the first picture collection are distributed is less than N2, the electronic device filters at least one picture in each of the M time periods from the first picture collection to obtain the second picture set, and the second picture collection includes N2 pictures, where M is an integer greater than or equal to 1.

[0556] Exemplarily, the M time periods include a first part of the time period and a second part of the time period, the time of the second part of the time period being earlier than the time of the first part of the time period, wherein each time period in the first part of the time period corresponds to a picture in the second picture collection, and each time period in the second part of the time period corresponds to multiple pictures in the second picture collection.

[0557] This embodiment may correspond to the implementation process of method 3 (ie, step S34) in step S1113 above. For a specific description, reference may be made to the relevant description above and will not be repeated here.

[0558] In combination with this embodiment, since the second picture collection includes N2 pictures, the electronic device determines the N2 pictures in the second picture collection as pictures in the first recollection video.

[0559] In an embodiment in which the electronic device determines the second picture collection from the first picture collection based on the generation time of all pictures in the first picture collection, in other embodiments, for example, the electronic device may also filter a picture from each time period within the M time periods in which the generation time of all pictures in the first picture collection is distributed to obtain the second picture collection, and use the pictures in the second picture collection as pictures of the recall video.

[0560] In step S1860, the electronic device displays a third display interface, and plays the first recollection video on the third display interface.

[0561] For example, when playing the first memory video, each frame of the picture can be played according to the timeline, so that the user can recall the past according to the time when the event occurred, deepening the memory. For example, the pictures can be played in order from the most recent to the most recent timeline, that is, the pictures with the most recent timeline are played first, and then the pictures with the most recent timeline are played.

[0562] In method 1800 , when the first recollection video is generated based on method 1800 , method 1800 provides an embodiment of updating the first recollection video.

[0563] In some embodiments, method 1800 also includes: the electronic device obtains a third picture collection based on the second picture, the second picture includes the at least one person, each picture in the third picture collection includes a person that matches the at least one person, and the generation time of all pictures in the third picture collection is distributed in a first time period, and the first time period is later than the generation time of the first recall video; the electronic device updates the first recall video based on the third picture collection.

[0564] It should be understood that the third image collection and the first recollection video are both memories associated with the same person, and the images in both the third image collection and the first recollection video include at least one person, which is a common person in the first and second images. Furthermore, all images in the third image collection are new images obtained by the electronic device within a first time period, which is later than the last time the first recollection video was generated.

[0565] In the step of updating the first recall video based on the third picture collection, in one example, when the sum of the number N3 of pictures in the third picture collection and the number N4 of pictures in the first recall video is less than or equal to the second number threshold N2, the electronic device adds all pictures in the third picture collection to the first recall video to obtain the updated first recall video.

[0566] In another example, when the sum of the number N3 of pictures in the third picture collection and the number N4 of pictures in the first recollection video is greater than the second quantity threshold N2, the electronic device deletes N5 pictures from the first recollection video and adds N3 pictures in the third picture collection to the first recollection video to obtain the updated first recollection video, and the updated first recollection video includes N2 pictures, where N5=N3+N4-N2.

[0567] Exemplarily, the updated first recollection video includes the second picture.

[0568] The above-mentioned embodiment of updating the first memory video may correspond to the implementation process of updating the memory video in method 1600. For the specific description, please refer to the relevant description above and will not be repeated here. The third picture collection here may correspond to the above picture collection 3, and the first memory video here may correspond to the above old memory video.

[0569] In the above embodiments, the GUI involved in the examples all illustrate the process of a user triggering a recall function by, for example, swiping up on the currently viewed picture, that is, by swiping up on the picture, the electronic device displays an interface with a recall entry area, and a recall video is generated through the recall entry area.

[0570] Figure 19 is another set of GUIs provided in an embodiment of the present application. The main difference from the GUI shown above is that the interface used to trigger the recall function in Figure 19 is different. The recall function is triggered from the "Recall" display interface through human-computer interaction.

[0571] Figure 19 is another set of GUIs provided in an embodiment of the present application, which illustrates that the recall function is triggered from the "Recall" display interface, the mobile phone enters the display interface for the user to select a person of interest, generates a picture collection including pictures of the person selected by the user, and generates a GUI of the process of recalling the video.

[0572] The user opens the "Gallery" app and enters the "Memories" display interface, which displays the GUI shown in Figure 19 (a). Referring to the GUI shown in Figure 19 (a), which includes multiple existing memory videos, the user clicks the "+" control 191 in the upper right corner, displaying the GUI shown in Figure 19 (b).

[0573] Referring to the GUI shown in FIG19( b ), the GUI includes a text box 192 and a person area 193. Text box 192 includes the text "You can select a person in the picture to generate a related memory," prompting the user to select a person. Person area 193 includes multiple pictures of people that the phone has recognized, each of which includes a person's head portrait.

[0574] For example, when the mobile phone is in charging mode, the mobile phone can automatically analyze the pictures in the gallery, identify the people in the pictures, and generate multiple pictures of the people. When the user enters the interface for selecting the person pictures, the generated person pictures are displayed.

[0575] In the GUI of (b) in FIG19 , the user selects three pictures of people in the third row. The mobile phone detects the user's operation of selecting the three pictures of people and displays the GUI shown in (c) in FIG19 .

[0576] Referring to the GUI in FIG. 19 (c), the GUI includes a character area 193, which includes multiple character images. A "√" sign is displayed in the lower right corner of the character image selected by the user to indicate that the character image has been selected. After the user selects the character image, they click the "√" control 194 in the upper right corner. The mobile phone detects the user operation and displays the GUI shown in FIG. 19 (d).

[0577] Referring to the GUI in FIG. 19( d ), the GUI includes a character area 193 and a progress bar 195 . Progress bar 195 is used to display the progress of generating the reminiscence video. When the progress reaches 100%, a photo collection including a group photo of the three characters and the reminiscence video are generated, and the GUI shown in FIG. 19( e ) is displayed.

[0578] 19 (e), the GUI shows a memory video generated in real time, which includes multiple pictures with a group photo of 3 people. After the memory video is generated, the mobile phone can automatically play each picture in the memory video.

[0579] FIG20 is a schematic flowchart of a method 2000 for generating a recall video provided in an embodiment of the present application.

[0580] In step S2010, the electronic device displays a first display interface, where the first display interface includes a memory entrance.

[0581] Exemplarily, the first display interface is an interface for displaying recall videos in a gallery application.

[0582] Referring to the GUI shown in (a) of FIG. 19 , the GUI may correspond to a first display interface, including a plurality of existing memory videos, and the upper right corner of the GUI includes a memory entrance, for example, the memory entrance is an add control 191 .

[0583] In step S2020, in response to the user's operation on the memory entrance, the electronic device displays a second display interface, which includes pictures of multiple characters.

[0584] The user performs an operation on the memory entrance, the electronic device detects the user operation, and in response to the user operation, displays a second display surface, which includes character pictures of multiple characters that the electronic device has recognized, each character picture corresponds to a character, including a character's avatar.

[0585] For example, referring to the GUI shown in FIG. 19( b ), which may correspond to the second display interface, the GUI includes a text box 192 and a person area 193. Text box 192 includes the text "You can select a person appearing in the picture to generate a related memory," prompting the user to select a person. Person area 193 includes multiple person pictures that the phone has recognized, each of which includes a person's head portrait.

[0586] In step S2030, in response to the user selecting a picture of at least one of the multiple characters, the electronic device performs a picture search to obtain a first picture collection, each picture in the first picture collection includes characters that match the at least one character.

[0587] Among the pictures of multiple characters displayed on the second display interface, the user selects a picture of at least one character. After the electronic device detects the user's operation of selecting a picture of at least one character, it performs a picture search to find pictures of characters that match the at least one character, and obtains a first picture collection.

[0588] The process of the electronic device performing image search in this step is similar to the implementation process of step S1840 in method 1800. Please refer to the relevant description above and will not be repeated here.

[0589] In step S2040, the electronic device generates a first recollection video based on the first picture collection, where the first recollection video includes at least some of the pictures in the first picture collection.

[0590] For the detailed description of this step, please refer to the relevant description of step 1850 in method 1800, which will not be repeated here.

[0591] In step S2050, the electronic device displays a third display interface, and plays the first recollection video on the third display interface.

[0592] Figure 21 is another set of GUIs provided in an embodiment of the present application. The difference from Figure 19 is that for pictures that have not been analyzed by the mobile phone, a function of timely analyzing pictures is provided so that users can select the characters in the pictures analyzed in time, which provides better flexibility and user experience.

[0593] The user opens the "Gallery" app and enters the "Memories" display interface, which displays the GUI shown in Figure 21 (a). Referring to the GUI shown in Figure 21 (a), which includes multiple existing memory videos, the user clicks the "+" control 211 in the upper right corner, displaying the GUI shown in Figure 21 (b).

[0594] Referring to the GUI shown in (b) of FIG21 , the GUI includes a text box 212, a character area 213, and an add control 214 for adding pictures. The text box 212 includes the text "You can select the characters appearing in the picture to generate related memories" to prompt the user to perform a selection operation on the character. The character area 213 includes multiple character pictures that the mobile phone has recognized, and each character picture includes a head portrait of a character. The user can select any character in the character area 213. The mobile phone detects the user's operation of selecting a character and generates a picture collection including the character selected by the user and a memory video. For example, through human-computer interaction, the GUI shown in (b), (c), and (d) of FIG19 is displayed.

[0595] Since the person area 213 only displays the person pictures that the mobile phone has recognized, when the user wants to select a person picture that is not in the person area 213 (in fact, the mobile phone has not analyzed the relevant pictures in time), he can click the add control 214 to display the GUI shown in (c) in Figure 21.

[0596] Referring to the GUI in (c) of FIG. 21 , the GUI includes a selection box for “Select Picture” and a selection box for “Cancel”. When the user clicks the control for “Select Picture”, the GUI shown in (d) of FIG. 21 is displayed.

[0597] Referring to the GUI in Figure 21 (d), the GUI displays a portion of the gallery. Swiping up or down scrolls through all the gallery images. The user can select any image. The phone detects the user's action, analyzes the selected image, and displays the identified person images in the person area 213 for the user to select. For example, if the user selects an image containing three people, the phone analyzes the image and identifies the three people, displaying the GUI shown in Figure 21 (e).

[0598] Referring to the GUI in (e) of FIG. 21 , the GUI includes a person area 213 and an add control 214 for adding pictures. Newly added person pictures that were not previously identified in a timely manner are added to person area 213, for example, the three person pictures in the last row of person area 213. When the user selects a newly added person picture, a "√" sign is displayed in the lower right corner of the selected person picture to indicate that the person picture has been selected. After the user selects a person picture, they click the "√" control 215 in the upper right corner. The phone detects the user's action and displays the GUI shown in (f) of FIG. 21 .

[0599] Referring to the GUI in FIG. 21( f ), the GUI includes a character area 213 and a progress bar 216. Progress bar 216 is used to display the progress of generating the reminiscence video. When the progress reaches 100%, a photo collection including a group photo of the three characters and the reminiscence video are generated, and the GUI shown in FIG. 21( g ) is displayed.

[0600] 21 (g), the GUI shows a memory video generated in real time, which includes multiple pictures with a group photo of 3 people. After the memory video is generated, the mobile phone can automatically play each picture in the memory video.

[0601] Above, in combination with Figures 1 to 21, the method for generating a memory video provided by an embodiment of the present application is described in detail. Below, in combination with Figures 22 to 23, the device and electronic device for generating a memory video provided according to an embodiment of the present application will be described in detail.

[0602] 22 is an exemplary block diagram of an apparatus 2200 for generating a memory video according to an embodiment of the present application. The apparatus 2200 is an electronic device or a chip in an electronic device, and includes a processing unit 2210 .

[0603] In some implementations, the apparatus 2200 is configured to execute the corresponding processes and steps of the electronic device in the above method 1800. The processing unit 2210 is configured to execute the following steps:

[0604] Controlling the display screen to display a first display interface, wherein the first display interface includes a first picture, and the first picture includes a plurality of characters;

[0605] In response to a first operation of the user on the first picture, controlling the display screen to display a second display interface, wherein the second display interface includes a memory entrance area;

[0606] In response to a second operation of the user on the memory entrance area, extracting features of at least one of the multiple characters to obtain a feature result;

[0607] Performing an image search based on the feature result to obtain a first image collection, wherein each image in the first image collection includes a person that matches the at least one person;

[0608] generating a first recollection video according to the first picture collection, wherein the first recollection video includes at least part of the pictures in the first picture collection;

[0609] The control display screen displays a third display interface, and plays the first recollection video on the third display interface.

[0610] It should be understood that the processing unit 2210 can be used to execute each step performed by the electronic device in method 1800. For specific descriptions, please refer to the relevant descriptions above and will not be repeated here.

[0611] In other implementations, the apparatus 2200 is configured to execute the processes and steps corresponding to the electronic device in the method 2000. The processing unit 2210 is configured to execute the following steps:

[0612] Controlling the display screen to display a first display interface, wherein the first display interface includes a memory entrance;

[0613] In response to a user's operation on the memory entrance, controlling the display screen to display a second display interface, the second display interface including character pictures of a plurality of characters;

[0614] In response to a user selecting a picture of at least one of the multiple characters, performing a picture search to obtain a first picture collection, wherein each picture in the first picture collection includes a character that matches the at least one character;

[0615] generating a first recollection video according to the first picture collection, wherein the first recollection video includes at least part of the pictures in the first picture collection;

[0616] The control display screen displays a third display interface, and plays the first recollection video on the third display interface.

[0617] In an embodiment of the present application, the device in FIG. 22 may also be a chip or a chip system, such as a system on chip (SoC).

[0618] Figure 23 is a schematic structural diagram of an electronic device 2300 provided in an embodiment of the present application. The electronic device 2300 is used to execute the corresponding steps and / or processes in the above method embodiment.

[0619] Electronic device 2300 includes a processor 2310, a transceiver 2320, and a memory 2330. The processor 2310, transceiver 2320, and memory 2330 communicate with each other via internal connection paths, and the processor 2310 can implement the functions of the processor 2310 in various possible implementations of the electronic device 2300. The memory 2330 is used to store instructions, and the processor 2310 is used to execute the instructions stored in the memory 2330. In other words, the processor 2310 can call these stored instructions to implement the functions of the processor 2310 in the electronic device 2300.

[0620] Optionally, the memory 2330 may include a read-only memory and a random access memory, and provide instructions and data to the processor. A portion of the memory may also include a non-volatile random access memory. For example, the memory may also store device type information. The processor 2310 may be configured to execute instructions stored in the memory, and when the processor 2310 executes the instructions stored in the memory, the processor 2310 is configured to perform the various steps and / or processes of the aforementioned method embodiments corresponding to the network device or terminal device.

[0621] In some implementations, the electronic device 2300 is configured to execute the corresponding processes and steps of the electronic device in the above method 1800. The processor 2310 is configured to execute the following steps:

[0622] Controlling the display screen to display a first display interface, wherein the first display interface includes a first picture, and the first picture includes a plurality of characters;

[0623] In response to a first operation of the user on the first picture, controlling the display screen to display a second display interface, wherein the second display interface includes a memory entrance area;

[0624] In response to a second operation of the user on the memory entrance area, extracting features of at least one of the multiple characters to obtain a feature result;

[0625] Performing an image search based on the feature result to obtain a first image collection, wherein each image in the first image collection includes a person that matches the at least one person;

[0626] generating a first recollection video according to the first picture collection, wherein the first recollection video includes at least part of the pictures in the first picture collection;

[0627] The control display screen displays a third display interface, and plays the first recollection video on the third display interface.

[0628] In some other implementations, the electronic device 2300 is configured to execute the corresponding processes and steps of the electronic device in the above method 2000. The processor 2310 is configured to execute the following steps:

[0629] Controlling the display screen to display a first display interface, wherein the first display interface includes a memory entrance;

[0630] In response to a user's operation on the memory entrance, controlling the display screen to display a second display interface, the second display interface including character pictures of a plurality of characters;

[0631] In response to a user selecting a picture of at least one of the multiple characters, performing a picture search to obtain a first picture collection, wherein each picture in the first picture collection includes a character that matches the at least one character;

[0632] generating a first recollection video according to the first picture collection, wherein the first recollection video includes at least part of the pictures in the first picture collection;

[0633] The control display screen displays a third display interface, and plays the first recollection video on the third display interface.

[0634] It should be understood that the specific process of each device executing the corresponding steps in the above methods has been described in detail in the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0635] It should be understood that in the embodiments of the present application, the processor of the above-mentioned device may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc.

[0636] During implementation, each step of the above method can be completed by an integrated logic circuit of hardware in a processor or by instructions in the form of software. The steps of the method disclosed in conjunction with the embodiments of the present application can be directly embodied as being executed by a hardware processor, or can be executed by a combination of hardware and software units in the processor. The software unit can be located in a storage medium mature in the art, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor executes the instructions in the memory, and in combination with its hardware, completes the steps of the above method. To avoid repetition, a detailed description is not given here.

[0637] The present application provides a computer program product that, when executed on a terminal device, enables the terminal device to execute the technical solution in the above embodiment. The implementation principle and technical effects are similar to those of the above method-related embodiments and will not be described in detail here.

[0638] The embodiment of the present application provides a readable storage medium, which contains instructions. When the instructions are executed on a terminal device, the terminal device executes the technical solution of the above embodiment. The implementation principle and technical effect are similar and will not be repeated here.

[0639] The present application provides a chip for executing instructions. When the chip is running, the technical solution of the above embodiment is executed. The implementation principle and technical effect are similar and will not be described here.

[0640] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated therein. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a high-density digital video disc (DVD)), or a semiconductor medium (eg, a solid state disk (SSD)).

[0641] It should be understood that the “embodiment” mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, the various embodiments in the entire specification do not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in the various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application.

[0642] It should also be understood that in this application, "when", "if" and "if" all mean that the UE or base station will take corresponding measures under certain objective circumstances. It does not limit the time, and does not require the UE or base station to take judgment actions when implementing it, nor does it mean that there are other limitations.

[0643] Those skilled in the art will understand that the various numerical numbers such as first and second involved in this application are only for the convenience of description and are not used to limit the scope of the embodiments of this application, and also indicate the order of precedence.

[0644] In this application, elements expressed in the singular are intended to mean "one or more" rather than "one and only one" unless otherwise specified. In this application, unless otherwise specified, "at least one" is intended to mean "one or more" and "a plurality" is intended to mean "two or more."

[0645] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. A can be singular or plural, and B can be singular or plural.

[0646] In this document, the term "at least one of..." or "at least one of..." means all or any combination of the listed items. For example, "at least one of A, B and C" may mean: A exists alone, B exists alone, C exists alone, A and B exist at the same time, B and C exist at the same time, and A, B and C exist at the same time. A may be singular or plural, B may be singular or plural, and C may be singular or plural.

[0647] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0648] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0649] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0650] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0651] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0652] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0653] The same or similar parts between the various embodiments in this application can refer to each other. In the various embodiments in this application, and the various implementation methods / implementation methods / implementation methods in each embodiment, if there is no special explanation and logical conflict, the terms and / or descriptions between different embodiments and the various implementation methods / implementation methods / implementation methods in each embodiment are consistent and can be referenced to each other. The technical features in different embodiments and the various implementation methods / implementation methods / implementation methods in each embodiment can be combined to form new embodiments, implementation methods, implementation methods, or implementation methods according to their inherent logical relationships. The above-described implementation methods of this application do not constitute a limitation on the scope of protection of this application.

[0654] The above is only a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or replacements within the technical scope disclosed in the present application, which should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims. In short, the above is only a preferred embodiment of the technical solution of the present application, and is not used to limit the scope of protection of the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application should be included in the scope of protection of the present application.

Claims

1. A method for generating a memory video, characterized in that: include: Display a first display interface, wherein the first display interface includes a first picture, and the first picture includes a plurality of characters; In response to a first operation of the user on the first picture, displaying a second display interface, wherein the second display interface includes a memory entrance area; In response to a second operation of the user on the memory entrance area, extracting features of at least one of the multiple characters to obtain a feature result; Performing image search according to the feature result to obtain a first image collection, wherein each image in the first image collection includes a person that matches the at least one person; generating a first recollection video according to the first picture collection, wherein the first recollection video includes at least part of the pictures in the first picture collection; The third display interface is displayed, and the first recollection video is played on the third display interface.

2. The method according to claim 1, characterized in that In response to the second operation of the user on the memory entrance area, extracting features of at least one of the multiple characters to obtain feature results includes: In response to the second operation, displaying a fourth display interface, wherein the fourth display interface includes the recognized character pictures of the plurality of characters; In response to a user selecting a character picture of at least one character among the multiple characters, feature extraction is performed on the at least one character to obtain the feature result.

3. The method according to claim 2, characterized in that The displaying of a second display interface in response to a first operation of the user on the first picture includes: In response to the first operation, when the first picture has been analyzed to include a person and the first picture exists in an existing memory video, the second display interface is displayed, the memory entry area of ​​the second display interface includes a first memory entry and a second memory entry, the first memory entry is used to display the existing memory video according to the user operation, and the second memory entry is used to generate a new memory video; and, The displaying a fourth display interface in response to the second operation includes: In response to the user's operation on the second memory entrance, the fourth display interface is displayed.

4. The method according to claim 1, characterized in that: In response to the second operation of the user on the memory entrance area, extracting features of at least one of the multiple characters to obtain feature results includes: In response to the second operation, feature extraction is performed on all the characters among the multiple characters to obtain the feature results.

5. The method according to any one of claims 1 to 4, characterized in that In response to the second operation of the user on the memory entrance area, extracting features of at least one of the multiple characters to obtain feature results includes: In response to the second operation, when the number of people in the first picture is less than or equal to a first number threshold N1, feature extraction is performed on at least one of the multiple people to obtain the feature result, where N1 is an integer greater than 1.

6. The method according to claim 1, characterized in that In response to the second operation of the user on the memory entrance area, extracting features of at least one of the multiple characters to obtain feature results includes: In response to the second operation, when the number of people in the first picture is greater than a first number threshold N1, Displaying a fifth display interface, wherein the fifth display interface includes character pictures of N1 characters among the multiple characters, where N1 is an integer greater than 1; In response to a user selecting a character picture of at least one character among the N1 characters, feature extraction is performed on the at least one character to obtain the feature result.

7. The method according to claim 6, characterized in that In response to the second operation, when the number of people in the first picture is greater than a first number threshold N1, displaying a fifth display interface includes: In response to the second operation, when the number of people in the first picture is greater than a first number threshold N1, determine the people with the top N1 facial area ratios in the order of the facial area ratios of the multiple people from large to small; The fifth display interface is displayed.

8. The method according to any one of claims 1 to 7, characterized in that Generating a first recall video according to the first picture collection includes: When the number of pictures in the first picture collection is less than or equal to a second number threshold N2, all pictures in the first picture collection are determined as pictures of the first recollection video, where N2 is an integer greater than 1; When the number of pictures in the first picture collection is greater than N2, determining a second picture collection according to the first picture collection; Generate the first recollection video based on the second picture collection.

9. The method according to claim 8, characterized in that The determining the second picture collection according to the first picture collection includes: The second picture collection is determined from the first picture collection according to the generation time of all pictures in the first picture collection.

10. The method according to claim 9, characterized in that The determining the second picture collection according to the first picture collection includes: When the number M of time periods in which the generation time of all pictures in the first picture collection is distributed is greater than or equal to N2, one picture is selected from the first picture collection in each of the M time periods to obtain the second picture collection, wherein the second picture collection includes M pictures, where M is an integer greater than or equal to 1.

11. The method according to claim 10, characterized in that Generating the first recollection video according to the second picture collection includes: Select N2 pictures from the second picture collection; The N2 pictures are determined as pictures of the first recollection video.

12. The method according to claim 11, characterized in that The selecting N2 pictures from the second picture collection includes: In descending order of aesthetic scores, the pictures with top N2 aesthetic scores are selected from the second picture collection to obtain the N2 pictures.

13. The method according to claim 9, characterized in that The determining the second picture collection according to the first picture collection includes: When the number M of time periods of the M time periods in which the generation times of all the pictures in the first picture collection are distributed is greater than or equal to N2, a picture is selected from the first picture collection in each of the N2 time periods that are earlier in the M time periods in the order of time from far to near, to obtain the first picture collection. Second picture collection, the second picture collection includes N2 pictures, and M is an integer greater than or equal to 1.

14. The method according to claim 9, characterized in that The determining the second picture collection according to the first picture collection includes: When the number M of time periods in which the generation time of all pictures in the first picture collection is distributed is less than N2, at least one picture is selected from the first picture collection in each of the M time periods to obtain the second picture collection, wherein the second picture collection includes N2 pictures, and M is an integer greater than or equal to 1.

15. The method according to claim 14, characterized in that The M time periods include a first time period and a second time period, wherein the time of the second time period is earlier than the time of the first time period, wherein each time period in the first time period corresponds to a picture in the second picture collection, and each time period in the second time period corresponds to multiple pictures in the second picture collection.

16. The method according to any one of claims 13 to 15, characterized in that Generating the first recollection video according to the second picture collection includes: Determine N2 pictures in the second picture collection as pictures in the first recall video.

17. The method according to any one of claims 1 to 16, characterized in that The displaying of a second display interface in response to a first operation of the user on the first picture includes: In response to the first operation, if the first picture has not been analyzed, analyzing the first picture to obtain an analysis result, where the analysis result is used to indicate that the first picture includes a person; In response to the analysis result, the second display interface is displayed.

18. The method according to any one of claims 1 to 16, characterized in that The displaying of a second display interface in response to a first operation of the user on the first picture includes: In response to the first operation, when the first picture has been analyzed to include a person and the first picture does not exist in the existing recall video, the second display interface is displayed.

19. The method according to claim 18, characterized in that The second display interface includes the recognized pictures of the multiple characters.

20. The method according to any one of claims 1 to 19, characterized in that The method further comprises: A third picture collection is obtained according to the second picture, wherein the second picture includes the at least one person, each picture in the third picture collection includes a person that matches the at least one person, and generation time of all pictures in the third picture collection is distributed in a first time period, and the first time period is later than generation time of the first recall video; The first recollection video is updated according to the third picture collection.

21. The method according to claim 20, characterized in that The updating of the first recollection video according to the third picture collection includes: When the sum of the number N3 of pictures in the third picture collection and the number N4 of pictures in the first recollection video is less than or equal to the second number threshold N2, all pictures in the third picture collection are added to the first recollection video to obtain an updated first recollection video.

22. The method according to claim 20, characterized in that The updating of the first recollection video according to the third picture collection includes: When the sum of the number N3 of pictures in the third picture collection and the number N4 of pictures in the first recollection video is greater than the second number threshold N2, N5 pictures are deleted from the first recollection video, and the third picture collection is The N3 pictures in the collection are added to the first recollection video to obtain an updated first recollection video, and the updated first recollection video includes N2 pictures, where N5=N3+N4-N2.

23. The method according to any one of claims 20 to 22, characterized in that The updated first recollection video includes the second picture.

24. The method according to any one of claims 1 to 23, characterized in that The cover image of the first memory video is the first image.

25. The method according to any one of claims 1 to 24, characterized in that The first operation is a swiping up operation.

26. The method according to any one of claims 1 to 25, characterized in that The first display interface is the interface of the gallery application.

27. A method for generating a memory video, characterized in that: The method comprises: Displaying a first display interface, wherein the first display interface includes a memory entrance; In response to the user's operation on the memory entrance, displaying a second display interface, the second display interface including character pictures of a plurality of characters; In response to a user selecting a character picture of at least one character among the multiple characters, performing a picture search to obtain a first picture collection, wherein each picture in the first picture collection includes characters that match the at least one character; generating a first recollection video according to the first picture collection, wherein the first recollection video includes at least part of the pictures in the first picture collection; A third display interface is displayed, and the first recollection video is played on the third display interface.

28. The method according to claim 27, characterized in that The first display interface is an interface in the gallery application for displaying memory videos.

29. An electronic device, characterized in that: include: Memory, for storing computer instructions; A processor, configured to call computer instructions stored in the memory to control the electronic device to execute the method described in any one of claims 1 to 26, or to execute the method described in claim 27 or 28.

30. A computer-readable storage medium, characterized in that: Used to store computer instructions, wherein the computer instructions are used to implement the method as described in any one of claims 1 to 26, or, used to implement the method as described in 27 or 28.

31. A chip, characterized in that: The chip comprises: Memory: used to store instructions; A processor, configured to call and execute the instructions from the memory, so that an electronic device equipped with the chip executes a method as described in any one of claims 1 to 26, or executes a method as described in claim 27 or 28.

Images