Method and device for generating memory video and electronic equipment

Abstract

The invention relates to the field of picture processing, and provides a method and device for generating a memory video and electronic equipment. And the electronic equipment displays a second display interface comprising a recall entrance area through a first operation of the user on the first picture, searches a picture matched with at least one character of the first picture through a second operation of the user on the recall entrance area, and finally generates a first recall video exclusive to the at least one character. Therefore, a condition for actively triggering the memory function is friendly to a user through the first display interface and the first operation, and a condition for generating the memory function is friendly to the user through the second display interface and the second operation; according to the embodiment of the invention, the user can execute the operation on the picture of the interested figure based on the own demand to generate the memory video, the actual demand of the user is met, and the user experience is better improved.

Description

Technical Field

[0001] The present application relates to the field of image processing, and more specifically, to a method, device and electronic device for generating a recall video in the field of image processing. Background Art

[0002] Currently, in smart electronic devices such as mobile phones and tablets, applications such as the gallery of the electronic devices will automatically filter pictures of the same related theme according to filtering conditions such as time, place, environment, person, group, etc., and generate a collection of pictures or videos of exclusive themes. The collection of pictures or videos of exclusive themes includes multiple pictures, allowing users to view pictures of specific time periods, specific people, specific environments and specific groups.

[0003] However, the above-mentioned solution for generating a collection of pictures or videos of a dedicated theme does not take into account the actual needs of users, resulting in a poor sense of control for users, so that users cannot view the collection of pictures or videos of their favorite characters, resulting in a poor user experience. Summary of the invention

[0004] The embodiment of the present application provides a method for generating a memory video, which allows the user to generate a memory video by performing operations on the pictures of the characters that interest him or her based on his or her needs, thereby meeting the actual needs of the user and greatly improving the user experience.

[0005] In a first aspect, a method for generating a recall video is provided, comprising:

[0006] Display a first display interface, wherein the first display interface includes a first picture, and the first picture includes a plurality of characters;

[0007] In response to a first operation of the user on the first picture, displaying a second display interface, wherein the second display interface includes a memory entrance area;

[0008] In response to a second operation of the user on the memory entrance area, extracting features of at least one of the multiple characters to obtain a feature result;

[0009] Performing image search according to the feature result to obtain a first image collection, wherein each image in the first image collection includes a person that matches the at least one person;

[0010] generating a first recollection video according to the first picture collection, wherein the first recollection video includes at least part of the pictures in the first picture collection;

[0011] A third display interface is displayed, and the first recollection video is played on the third display interface.

[0012] The method for generating a memory video provided by the embodiment of the present application is that through the first operation of the user on the first picture, the electronic device displays a second display interface including a memory entrance area, and through the second operation of the user on the memory entrance area, the electronic device searches for pictures matching at least one person in the first picture, and finally generates a first memory video exclusive to the at least one person, that is, each picture in the first memory video includes a person matching the at least one person, so that the user can recall the past through the first memory video, solving the problem of memory interruption caused by the user browsing pictures. Most importantly, the first display interface and the first operation that can be recognized by the electronic device provide the user with a friendly condition for actively triggering the memory function, and the second display interface and the second operation that can be recognized by the electronic device provide the user with a friendly condition for generating the memory function, so that the user can generate a memory video by performing an operation on the picture of the person he is interested in based on his own needs, which meets the actual needs of the user and improves the user experience well; and because the user can perform the first operation on the picture generated at any time to actively trigger the memory function, the real-time nature of triggering the memory function is improved, further improving the user experience; in addition, by viewing multiple pictures in the form of memory video playback, it is avoided that the user clicks on multiple pictures one by one, saving user operations and further improving the user experience.

[0013] In addition, it is understandable that the most common scenario for users to want to find pictures of related people is that when browsing a certain picture (for example, the first picture), the user thinks of certain people or things, so he wants to recall the past. Therefore, actively triggering the recall function by performing the first operation on the first picture that the user is browsing is more in line with the user's behavioral habits and provides a better user experience.

[0014] In summary, the method for generating a recall video provided in the embodiments of the present application considers user needs in a friendly manner from various angles and greatly improves the user experience.

[0015] Optionally, in response to the user's second operation on the memory entrance area, extracting features of at least one of the multiple characters to obtain feature results includes:

[0016] In response to the second operation, displaying a fourth display interface, wherein the fourth display interface includes the recognized character pictures of the plurality of characters;

[0017] In response to a user selecting a character picture of at least one character among the multiple characters, feature extraction is performed on the at least one character to obtain the feature result.

[0018] The method for generating a memory video provided in an embodiment of the present application is that for the first picture currently being browsed, the user actively triggers the memory function. Since the user can select any character in the picture based on his or her preferences (at least one selected character), so that the electronic device can filter out pictures that match the arbitrary character, a more flexible selection space is provided for the user, so that the user can more flexibly select characters based on his or her preferences. By including a memory video of any character, the historical moments related to the arbitrary character can be recalled, which can better meet the actual needs of the user and better improve the user experience.

[0019] Optionally, in response to a first operation of the user on the first picture, displaying a second display interface includes:

[0020] In response to the first operation, when the first picture has been analyzed to include a person and the first picture exists in an existing memory video, the second display interface is displayed, the memory entry area of ​​the second display interface includes a first memory entry and a second memory entry, the first memory entry is used to display the existing memory video according to the user operation, and the second memory entry is used to generate a new memory video; and,

[0021] In response to the second operation, displaying a fourth display interface, wherein the fourth display interface includes the recognized character pictures of the plurality of characters, including:

[0022] In response to the user's operation on the second memory entrance, the fourth display interface is displayed.

[0023] In the method for generating a memory video provided in an embodiment of the present application, for an electronic device to generate a memory video of an arbitrary character based on an arbitrary character selected by a user, although the first picture already exists in the existing memory video, the user can display the existing memory video through the first memory entrance of the second display interface. However, for the same picture (first picture), the characters selected by the user at different times may be different. Therefore, the second memory entrance is used to provide the user with the possibility of generating a new memory video again, thereby providing a more flexible selection space and a better user experience.

[0024] Optionally, in response to the user's second operation on the memory entrance area, extracting features of at least one of the multiple characters to obtain feature results includes:

[0025] In response to the second operation, feature extraction is performed on all the characters among the multiple characters to obtain the feature results.

[0026] In the method for generating a recall video provided in an embodiment of the present application, after detecting the second operation, the electronic device directly extracts features of all the characters in the first picture to perform a picture search. Compared with the embodiment in which the user can select any character, although the flexibility of the user in selecting the character is weakened, due to the lack of some human-computer interaction, it is not only convenient to implement, but also can save processing time.

[0027] Optionally, in response to the user's second operation on the memory entrance area, extracting features of at least one of the multiple characters to obtain feature results includes:

[0028] In response to the second operation, when the number of people in the first picture is less than or equal to a first number threshold N1, feature extraction is performed on at least one of the multiple people to obtain the feature result, where N1 is an integer greater than 1.

[0029] The method for generating a memory video provided in an embodiment of the present application takes into account the processing capabilities of current electronic devices. If the number of characters that need to be matched is too large, the electronic device may not be able to perform feature matching on too many characters, thereby affecting the generation of the memory video. Therefore, when the number of characters in the first picture is less than or equal to the first number threshold N1, features of at least one character are extracted, and then matching pictures are searched to generate a memory video.

[0030] Optionally, in response to the user's second operation on the memory entrance area, extracting features of at least one of the multiple characters to obtain feature results includes:

[0031] In response to the second operation, when the number of characters in the first picture is greater than a first number threshold N1, a fifth display interface is displayed, wherein the fifth display interface includes character pictures of N1 characters among the plurality of characters, where N1 is an integer greater than 1;

[0032] In response to a user selecting a character picture of at least one character among the N1 characters, feature extraction is performed on the at least one character to obtain the feature result.

[0033] The method for generating a memory video provided in an embodiment of the present application takes into account the processing capabilities of current electronic devices. If the number of characters that need to be matched is too large, the electronic device may not be able to perform feature matching on too many characters, thereby affecting the generation of the memory video. Therefore, when the number of characters in the first picture is greater than the first number threshold N1, the electronic device recommends the largest number of N1 characters to the user, allowing the user to select any at least one character from the N1 characters. In this way, the electronic device can extract features of at least one character, and then search for matching pictures to generate a memory video.

[0034] Optionally, in response to the second operation, when the number of people in the first picture is greater than a first number threshold N1, displaying a fifth display interface includes:

[0035] In response to the second operation, when the number of people in the first picture is greater than a first number threshold N1, determine the people with the top N1 facial area ratios in the order of the facial area ratios of the multiple people from large to small;

[0036] The fifth display interface is displayed.

[0037] In the method for generating a memory video provided in an embodiment of the present application, when there are a large number of characters in a picture, it is inevitable that the faces of some characters occupy a smaller area of ​​the entire picture, and the faces of some characters cannot even be seen, which affects the feature extraction of the characters and further affects the search for pictures of related characters. Therefore, N1 characters with a larger face area ratio are recommended to the user based on the face area ratio, so that the features of the characters can be extracted as well as possible to find pictures of related characters without affecting the user experience.

[0038] Optionally, generating a first recollection video according to the first picture collection includes:

[0039] When the number of pictures in the first picture collection is less than or equal to a second number threshold N2, all pictures in the first picture collection are determined as pictures of the first recollection video, where N2 is an integer greater than 1;

[0040] When the number of pictures in the first picture collection is greater than N2, determining a second picture collection according to the first picture collection;

[0041] Generate the first recollection video based on the second picture collection.

[0042] The method for generating a memory video provided in an embodiment of the present application, if the number of pictures in the memory video is too large, will waste the user's time and cause problems such as aesthetic fatigue, and the user's experience of enjoying the memory video will not be very good. Therefore, by setting the second number threshold N2, the number of pictures in the generated memory video can be made as appropriate as possible, so that the user can better experience the wonderful process of video playback. In this way, when the number of pictures in the first picture collection is greater than N2, the electronic device further filters pictures from the first picture collection, and generates a first memory video based on the filtered second picture collection, so that the user can have a relatively wonderful experience when enjoying the pictures in the memory video.

[0043] Optionally, determining the second picture collection according to the first picture collection includes:

[0044] The second picture collection is determined from the first picture collection according to the generation time of all pictures in the first picture collection.

[0045] Optionally, determining the second picture collection according to the first picture collection includes:

[0046] When the number M of time periods in which the generation time of all pictures in the first picture collection is distributed is greater than or equal to N2, one picture is selected from the first picture collection in each of the M time periods to obtain the second picture collection, wherein the second picture collection includes M pictures, where M is an integer greater than or equal to 1.

[0047] The method for generating a memory video provided in the embodiment of the present application takes into account that the time range of the generation time distribution of all pictures in the first picture collection is relatively long. When screening pictures, one picture is selected in each time period as much as possible. This helps the user to recall events with relatively uniform time intervals through the related pictures of at least one person in the first picture, which can reduce the user's memory gaps to a certain extent.

[0048] Optionally, generating the first recollection video according to the second picture collection includes:

[0049] Select N2 pictures from the second picture collection;

[0050] The N2 pictures are determined as pictures of the first recollection video.

[0051] Optionally, the selecting N2 pictures from the second picture collection includes:

[0052] In descending order of aesthetic scores, the pictures with top N2 aesthetic scores are selected from the second picture collection to obtain the N2 pictures.

[0053] The method for generating a memory video provided in an embodiment of the present application selects pictures with higher aesthetic scores from the second picture collection. In this way, the quality of the pictures in the first memory video is better, which can better improve the user's visual experience.

[0054] Optionally, determining the second picture collection according to the first picture collection includes:

[0055] When the number M of time periods in which the generation time of all pictures in the first picture collection is distributed is greater than or equal to N2, from the first picture collection, one picture is selected in each of the N2 time periods that are earlier in the M time periods in time order from far to near, to obtain the second picture collection, wherein the second picture collection includes N2 pictures, and M is an integer greater than or equal to 1.

[0056] The method for generating a memory video provided in an embodiment of the present application is based on actual conditions. If it is necessary to control the number of pictures in the second picture collection to be less than or equal to N2, and the number M of time periods in the M time periods in which the generation times of all pictures in the first picture collection are distributed is greater than or equal to N2, since the user's memory of events that are far away in time is relatively vague, therefore, selecting a picture from each time period of the first N2 time periods that are far away in time can enable the user to better recall events that are far away through pictures, thereby improving the user experience.

[0057] Optionally, determining the second picture collection according to the first picture collection includes:

[0058] When the number M of time periods in which the generation time of all pictures in the first picture collection is distributed is less than N2, at least one picture is selected from the first picture collection in each of the M time periods to obtain the second picture set, and the second picture collection includes N2 pictures, where M is an integer greater than or equal to 1.

[0059] The method for generating a memory video provided by the embodiment of the present application selects at least one picture in each time period when the time region in which the generation time of all pictures in the first picture collection is distributed is not very long but the number of pictures is large. First, relatively more pictures can be selected. Second, since each time period corresponds to at least one picture, this helps the user to recall events with relatively uniform time intervals through the relevant pictures of at least one person in the first picture, which can reduce the user's memory gap to a certain extent. In general, the user experience is considered from the number of pictures to be recalled and the time interval of the recall, and different factors are balanced to better meet the user experience.

[0060] Optionally, the M time periods include a first part of the time period and a second part of the time period, the time of the second part of the time period being earlier than the time of the first part of the time period, wherein each time period in the first part of the time period corresponds to a picture in the second picture collection, and each time period in the second part of the time period corresponds to multiple pictures in the second picture collection.

[0061] The method for generating a recall video provided in the embodiment of the present application, since the user's memory of events that happened a long time ago is relatively vague, therefore, multiple pictures are screened out in each time period of the second part of the time period that is relatively long ago, so that the user can better recall the events that happened a long time ago through the pictures, thereby improving the user experience.

[0062] Optionally, generating the first recollection video according to the second picture collection includes:

[0063] Determine N2 pictures in the second picture collection as pictures in the first recall video.

[0064] Optionally, in response to a first operation of the user on the first picture, displaying a second display interface includes:

[0065] In response to the first operation, if the first picture has not been analyzed, analyzing the first picture to obtain an analysis result, where the analysis result is used to indicate that the first picture includes a person;

[0066] In response to the analysis result, the second display interface is displayed.

[0067] The method for generating a recall video provided in an embodiment of the present application determines whether the first image has been analyzed, and immediately analyzes the unanalyzed image. For the image that has been analyzed, in fact, it can make the electronic device not need to repeatedly analyze the first image, thereby reducing the process of analyzing the image and thus reducing the processing time.

[0068] Optionally, in response to a first operation of the user on the first picture, displaying a second display interface includes:

[0069] In response to the first operation, when the first picture has been analyzed to include a person and the first picture does not exist in the existing recall video, the second display interface is displayed.

[0070] Optionally, the second display interface includes pictures of the multiple recognized characters.

[0071] In the method for generating a recall video provided in the embodiment of the present application, since the first image has been analyzed, the second display interface can directly display the images of the multiple characters that have been identified, thereby improving the user's visual experience.

[0072] Optionally, the method further comprises:

[0073] A third picture collection is obtained according to the second picture, wherein the second picture includes the at least one person, each picture in the third picture collection includes a person that matches the at least one person, and generation time of all pictures in the third picture collection is distributed in a first time period, and the first time period is later than generation time of the first recall video;

[0074] The first recollection video is updated according to the third picture collection.

[0075] The method for generating a memory video provided in an embodiment of the present application can update the memory videos with the same person so that the electronic device does not need to generate a new memory video. The pictures of the same person can be integrated into one memory video, which is not only convenient for users to search in a centralized manner, but also convenient for the device to manage pictures.

[0076] Optionally, updating the first recollection video according to the third picture collection includes:

[0077] When the sum of the number N3 of pictures in the third picture collection and the number N4 of pictures in the first recollection video is less than or equal to the second number threshold N2, all pictures in the third picture collection are added to the first recollection video to obtain an updated first recollection video.

[0078] Optionally, updating the first recollection video according to the third picture collection includes:

[0079] When the sum of the number N3 of pictures in the third picture collection and the number N4 of pictures in the first recollection video is greater than the second quantity threshold N2, N5 pictures are deleted from the first recollection video, and N3 pictures in the third picture collection are added to the first recollection video to obtain an updated first recollection video, and the updated first recollection video includes N2 pictures, where N5=N3+N4-N2.

[0080] The method for generating a recall video provided in an embodiment of the present application, when the sum of the number N3 of pictures in the third picture collection and the number N4 of pictures in the first recall video is greater than N2, prioritizes ensuring that all pictures in the third picture collection are added to the first recall video, and deletes pictures that exceed the number from the first recall video. This allows users to recall things associated with new pictures in a timely manner, thereby improving user experience.

[0081] Optionally, the updated first recollection video includes the second picture.

[0082] In the method for generating a memory video provided in an embodiment of the present application, the user operates the second picture to recall the relevant person while browsing the second picture, which means that the user likes the second picture more or the second picture can evoke the user's memories more strongly. Therefore, adding the second picture to the updated memory video can meet the user's needs and improve the user experience.

[0083] Optionally, the cover picture of the first recollection video is the first picture.

[0084] Optionally, the first operation is a swipe up operation.

[0085] Optionally, the first display interface is an interface of a gallery application.

[0086] In a second aspect, a method for generating a recall video is provided, the method comprising:

[0087] Displaying a first display interface, wherein the first display interface includes a memory entrance;

[0088] In response to the user's operation on the memory entrance, displaying a second display interface, the second display interface including character pictures of a plurality of characters;

[0089] In response to a user selecting a character picture of at least one character among the multiple characters, performing a picture search to obtain a first picture collection, wherein each picture in the first picture collection includes characters that match the at least one character;

[0090] generating a first recollection video according to the first picture collection, wherein the first recollection video includes at least part of the pictures in the first picture collection;

[0091] A third display interface is displayed, and the first recollection video is played on the third display interface.

[0092] In the method for generating a memory video provided by the embodiment of the present application, the user triggers the memory function through the memory entrance, and the electronic device immediately displays the character pictures of multiple characters previously identified by the electronic device through image analysis. The user can select at least one of the multiple characters of interest to him. When the user selects the character picture of at least one character, the electronic device can directly search for the picture to generate the first memory video. Since there is no need to analyze the picture and extract features, the character pictures of the characters that the electronic device has identified are directly used for the user to select, which reduces the response time of the electronic device and improves the user experience from the perspective of saving time; moreover, the user's operation on the memory entrance in the first display interface that can be identified by the first display interface and the electronic device provides the user with a friendly condition for actively triggering the memory function, so that the user can generate a memory video by performing operations on the pictures of the characters of interest to him based on his own needs, which meets the actual needs of the user and improves the user experience well. In addition, by viewing multiple pictures in the way of playing the memory video, it is avoided that the user clicks on multiple pictures one by one, which saves the user operation and further improves the user experience.

[0093] Optionally, the first display interface is an interface in a gallery application for displaying recall videos.

[0094] In a third aspect, an electronic device is provided, and the electronic device is used to execute the method provided in the first aspect or the second aspect. Specifically, the electronic device may include a module for executing any possible implementation of the first aspect or the second aspect.

[0095] In a fourth aspect, an electronic device is provided, comprising a processor. The processor is coupled to a memory and can be used to execute instructions in the memory to implement the method in any possible implementation of the first aspect or the second aspect. Optionally, the electronic device also includes a memory. Optionally, the device also includes a communication interface, and the processor is coupled to the communication interface.

[0096] In a fifth aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a device, the device implements the method in any possible implementation manner of the first aspect or the second aspect mentioned above.

[0097] In a sixth aspect, a computer program product comprising instructions is provided, wherein when the instructions are executed by a computer, the device implements the method in any possible implementation manner of the first aspect or the second aspect mentioned above.

[0098] In the seventh aspect, a chip is provided, comprising: an input interface, an output interface, a processor and a memory, wherein the input interface, the output interface, the processor and the memory are connected via an internal connection path, and the processor is used to execute the code in the memory. When the code is executed, the processor is used to execute the method in any possible implementation of the first aspect or the second aspect mentioned above. BRIEF DESCRIPTION OF THE DRAWINGS

[0099] Figure 1 It is a schematic structural diagram of an electronic device provided in an embodiment of the present application.

[0100] Figure 2 It is a schematic diagram of a software system of an electronic device provided in an embodiment of the present application.

[0101] Figure 3 It is a schematic diagram of a set of graphical user interfaces (GUIs) provided in an embodiment of the present application.

[0102] Figures 4 to 10 This is another set of GUIs provided by an embodiment of the present application.

[0103] Fig.11 It is a schematic flowchart of the method for generating a recall video provided in an embodiment of the present application.

[0104] Fig.12 It is a schematic flowchart of a process in which an electronic device provided in an embodiment of the present application determines picture collection 2 based on picture collection 1, and a process in which a recall video is determined based on picture collection 2.

[0105] Fig.13 It is another schematic flowchart of the method for generating a recall video provided in an embodiment of the present application.

[0106] Fig.14 It is a schematic flowchart of a process provided by an embodiment of the present application for an electronic device to generate a picture collection and a recall video when the number of people in the picture is greater than a number threshold N1.

[0107] Fig.15 It is a schematic diagram of the fourth interface provided in an embodiment of the present application.

[0108] Fig.16 This is another schematic process of the method for generating a recall video provided in an embodiment of the present application.

[0109] Fig.17 This is another set of GUIs provided by an embodiment of the present application.

[0110] Fig.18 This is another schematic process of the method for generating a recall video provided in an embodiment of the present application.

[0111] Fig.19 This is another set of GUIs provided by an embodiment of the present application.

[0112] Fig. 20 This is another schematic process of the method for generating a recall video provided in an embodiment of the present application.

[0113] Fig.21 This is another set of GUIs provided by the embodiments of the present application.

[0114] Fig. 22 It is an exemplary block diagram of an apparatus for generating a recall video provided in an embodiment of the present application.

[0115] Fig.23 It is a schematic structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0116] The technical solution in this application will be described below in conjunction with the accompanying drawings.

[0117] The method for generating a memory video provided in the embodiment of the present application can be applied to various electronic devices capable of taking pictures, such as mobile phones, tablet computers, wearable devices, laptop computers, netbooks, personal digital assistants (PDAs), cameras, etc. The embodiment of the present application does not impose any restrictions on the specific type of electronic device.

[0118] Figure 1 1 is a schematic structural diagram of an electronic device 100 provided in an embodiment of the present application. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0119] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0120] In an embodiment of the present application, the processor 110 is used to control the display screen to display various interfaces, and can trigger the recall function through user operations, display pictures and videos of related persons, etc., and is used to extract features of related persons, search for pictures matching the related persons, and generate a picture collection and recall video exclusive to the related persons.

[0121] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0122] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0123] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0124] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0125] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface, thereby realizing the touch function of the electronic device 100.

[0126] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.

[0127] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to realize the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0128] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.

[0129] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the electronic device 100.

[0130] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0131] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0132] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0133] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.

[0134] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0135] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0136] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0137] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0138] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0139] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0140] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0141] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0142] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0143] In the embodiment of the present application, the display screen 194 is used to display various interfaces, for example, displaying pictures for the user to operate to trigger the recall function, and displaying an interface including a recall entrance for the user to operate to generate picture collections and recall videos.

[0144] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor, and implement the technical solution of tracking objects in the embodiment of the present application during the shooting process.

[0145] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0146] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0147] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0148] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0149] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0150] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0151] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0152] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0153] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0154] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0155] The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the human ear.

[0156] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to microphone 170C to input the sound signal into microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.

[0157] The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0158] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

[0159] The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.

[0160] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

[0161] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover can be automatically unlocked.

[0162] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0163] The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.

[0164] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0165] The ambient light sensor 180L is used to sense the ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

[0166] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0167] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the performance of a processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 due to low temperature. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 performs a boost on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

[0168] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0169] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of the vocal part of the human body. The bone conduction sensor 180M can also contact the human pulse to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 180M can also be set in an earphone and combined into a bone conduction earphone. The audio module 170 can parse out a voice signal based on the vibration signal of the vibrating bone block of the vocal part obtained by the bone conduction sensor 180M to realize a voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M to realize a heart rate detection function.

[0170] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.

[0171] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0172] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power changes, messages, missed calls, notifications, etc.

[0173] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0174] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 100.

[0175] Figure 2 1 is a software structure diagram of the electronic device 100 of the embodiment of the present application. The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the system library of the Android runtime (Android runtime), and the kernel layer. The application layer can include a series of application packages.

[0176] like Figure 2As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

[0177] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0178] like Figure 2 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0179] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0180] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0181] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0182] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0183] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0184] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0185] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0186] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0187] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0188] The system library may include multiple functional modules, such as surface manager, media libraries, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0189] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0190] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0191] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0192] A 2D graphics engine is a drawing engine for 2D drawings.

[0193] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0194] It should be understood that the technical solutions in the embodiments of the present application can be used in Android, IOS, Hongmeng and other systems.

[0195] As described in the background technology, in the prior art, because the actual needs of users are not taken into consideration, the user's sense of control is poor, so that the user cannot view the picture collection of the person or group he likes, and the user experience is not good. For example, the user wants to view the picture collection of himself, friend 1 and friend 2, but the electronic device only generates the picture collection of himself and friend 1.

[0196] Based on this, the embodiment of the present application provides a method for generating a memory video, where the user can operate on the picture based on his or her own needs, and the electronic device searches for a collection of pictures of related people that the user wants to view from the picture library based on the user's operation on the picture, so as to improve the user experience. In addition, the electronic device also generates a wonderful memory video based on the picture collection, and can play the pictures in the memory video, avoiding the user from manually operating to view the pictures of related people in the picture collection, further improving the user experience.

[0197] Below, first, taking a mobile phone as an example, the embodiment of the present application is introduced through a graphical user interface (GUI).

[0198] Figure 3 It is a schematic diagram of a set of GUIs provided in an embodiment of the present application, which illustrates a GUI of the process of searching the gallery for pictures that include all the characters in the picture, generating a picture collection, and generating a recall video based on the user's operation on the picture that is currently being browsed by the user and has not been analyzed.

[0199] It should be understood that all the characters in the picture can be one person or multiple people. The embodiment of the present application does not impose any limitation on the number of characters included in the picture.

[0200] refer to Figure 3 The GUI in (a) is the desktop of the mobile phone. The GUI includes multiple application icons. When the user wants to view pictures (or photos), he clicks the icon representing the gallery. When the mobile phone detects that the user clicks the icon representing the gallery on the desktop, the gallery application can be opened and the following display can be displayed: Figure 3 GUI shown in (b) in .

[0201] refer to Figure 3 In the GUI in (b), the electronic device displays the main interface of the gallery application, the main interface includes interface 31 and interface 32, interface 32 includes icons of multiple category options, and interface 31 displays pictures displayed through a certain category option. For example, interface 31 displays pictures displayed through the category option "Pictures". Figure 3 In (b), the user wants to view the picture P1, clicks on the picture P1, and the mobile phone responds to the user's operation of clicking on the picture P1 and displays the following Figure 3 GUI shown in (c) in FIG.

[0202] It should be noted that the "picture" in the embodiments of the present application can also be called a photo or an image. The three expressions can be described interchangeably and will not be elaborated later.

[0203] refer to Figure 3The GUI in (c) in the figure shows an enlarged picture P1. Picture P1 includes three characters, namely the user "Xiao Mei" and the user's friends "Xiao Li" and "Xiao Hong". When the user browses picture P1, he misses the time when the three of them were together and wants to browse related pictures of the three of them in his own gallery. Therefore, the user swipes up on picture P1, or the user performs a swipe up operation on picture P1. After the mobile phone detects the user's swipe up operation on picture P1, it displays the following Figure 3 GUI shown in (d).

[0204] In one example, after the mobile phone detects that the user has swiped up on the picture P1, if it is determined that the picture P1 does not contain a person, the mobile phone analyzes the picture P1, and if it is determined that the picture P1 contains a person, the mobile phone displays the following information: Figure 3 That is, after the mobile phone detects the user's swiping operation on the picture P1, it determines whether the picture P1 has been analyzed. If it is determined that the picture P1 has not been analyzed, the electronic device analyzes whether the picture P1 includes a person. If it is determined that the picture P1 includes a person, the electronic device displays the following Figure 3 GUI shown in (d).

[0205] It should be understood that the "whether the picture is analyzed" described in the embodiment of the present application means analyzing whether the picture includes a person. If the picture has been analyzed, it means that the mobile phone has analyzed that the picture includes a person. The explanation of the analysis of the picture below is the same as here, and will not be repeated later. For picture P1, it is determined that picture P1 has been analyzed, which means that picture P1 includes a person.

[0206] In other examples, when the mobile phone determines that the image P1 has been analyzed, it can display a different Figure 3 The GUI shown in (d) is explained below.

[0207] It should be understood that the way in which the user performs a swiping operation on the picture P1 to trigger the generation of a memory entry is only an illustrative description, and the present application embodiment does not make any limitation thereto, and any way that can trigger the device to generate a memory entry is within the protection scope of the present application embodiment. For example, the user performs a long press operation, a horizontal swiping operation (swiping left or right), a swiping operation, etc. on the picture P1.

[0208] refer to Figure 3The GUI in (d) in the figure includes a picture P1 and a memory entry area 33. After the user slides up the picture P1, the picture P1 is slid to the top of the interface, and the memory entry area 33 is displayed below the picture P1. The memory entry area 33 is used for the user to trigger the function of generating a memory video. Exemplarily, the memory entry area 33 includes the prompt text "Based on the current picture, quickly analyze and generate related memory videos to relive good memories" and a memory entry 331. Exemplarily, the memory entry 331 can be a control that displays the text "Generate Memories". When the user clicks on the memory entry 331 of the control such as "Generate Memories", the mobile phone detects the user operation, which means that the user has triggered the function of generating a memory video. Based on the three characters in the identified picture P1, the mobile phone selects a collection of pictures that meet the conditions and include group photos of the three characters from the gallery through feature matching, and generates a memory video based on the collection of pictures.

[0209] The mobile phone selects a collection of pictures that meet the conditions and includes the group photo of the three characters from the gallery. In the process of generating a memory video based on the picture collection, not all pictures in the picture collection are necessarily played. In other words, the pictures in the memory video are not necessarily all pictures in the picture collection. The pictures in the memory video can be part or all of the pictures in the picture collection. For example, when the number of pictures in the picture collection is large, in order to allow users to better experience the wonderful process of video playback as much as possible, some pictures can be selected from the picture collection to generate a memory video. For another example, when the number of pictures in the picture collection is small, all pictures in the picture collection can be used as pictures for the memory video.

[0210] For example, Figure 3 The GUI of (d) may also include other information related to the picture P1. For example, the GUI includes an address area 34. The address area 34 includes a map 341 and text. The map 341 is marked with the address at which the picture P1 was taken (or generated), and the text indicates the address at which the picture P1 was taken (or generated) (for example, Linkai International Building, Keji Road, Yanta District, Xi'an).

[0211] In order to facilitate users to view the progress of generating the memory video and improve the user's visual experience, the following Figure 3 GUI shown in (e) in .

[0212] refer to Figure 3 The GUI in (e) includes a picture P1 and a progress box 35, and the progress box 35 is used to display the progress of generating the memory video, for example, when the progress reaches 40%. When the progress reaches 100%, a picture set including the group photo of the three characters and a memory video are generated, and the display Figure 3 GUI shown in (f) in .

[0213] refer to Figure 3 The GUI in (f) of FIG. 1 shows a reminiscence video with the theme of "old friends gathering" generated in real time, and the reminiscence video includes multiple pictures of three people. After the reminiscence video is generated, the mobile phone can automatically play each frame of the picture in the reminiscence video.

[0214] Exemplarily, the recollection video includes a picture P1 that is operated by the user or used to trigger the generation of the recollection video.

[0215] Exemplarily, the picture P1 operated by the user or used to trigger the generation of a memory video can be used as the cover picture of the memory video.

[0216] For example, when playing a memory video, each frame of the picture can be played according to the timeline, so that the user can recall the past according to the time when the event occurred and deepen the memory. For example, the pictures can be played in order from far to near, that is, the pictures with a farther timeline are played first, and then the pictures with a closer timeline are played.

[0217] In the above embodiment, the user performs an operation on the picture currently being browsed, actively triggering the recall function, so that the mobile phone can select a picture collection of all the people in the picture currently being browsed from the gallery and generate a recall video, which meets the actual needs of the user and greatly improves the user experience; and compared with the method in which the user searches for pictures on a large scale in the gallery, it can greatly shorten the search time and solve the problem of memory interruption when the user browses pictures; in addition, the most common scenario for users to want to find a picture collection of related people is that when browsing a certain picture, the user thinks of certain people or certain things, so he wants to recall the past. Therefore, actively triggering the recall function by performing operations on the picture that the user is browsing is more in line with the user's behavioral habits and provides a higher user experience.

[0218] In the prior art, a mobile phone can trigger the analysis function of pictures by charging, that is, when the mobile phone is in charging mode, the pictures can be automatically classified into picture collections of different themes by analyzing the pictures. However, for pictures generated instantly, if the mobile phone is not charged in a short period of time, the pictures cannot be analyzed instantly, which affects the user experience. In the embodiment of the present application, as long as it is an existing picture, the user can perform an operation when browsing any picture to actively trigger the recall function, and can actively analyze the instantly generated pictures to generate a recall video, which improves the real-time analysis of pictures and further improves the user experience.

[0219] Figure 4 This is another set of GUIs provided in an embodiment of the present application, which illustrates that after a memory video is generated, the GUI of the memory video is displayed in an interface of the "memories" category.

[0220] When the memory video is generated, open the "Memory" category interface in the gallery and it will be displayed as follows Figure 4 The GUI in (a) of FIG. The GUI displays a portion of all the memory videos already in the mobile phone. The user performs an operation such as swiping up on the display interface. In response to the user operation, the display interface can scroll to display another portion of the memory videos that are not displayed.

[0221] For the instantly generated memory video with the theme of "Old Friends Gathering", the memory video with this theme is displayed at the front position in the "Memories" category interface. Since it is a newly generated memory video, the probability of users viewing it will be higher. Therefore, placing the newly generated memory video in the first position of the interface can avoid searching for the newly generated memory video through operations such as sliding operations, which is very convenient for users to view. In implementation, for the newly generated memory video, the mobile phone inserts the newly generated memory video in front of all memory videos, and moves the remaining memory videos back in sequence according to the existing order.

[0222] The user clicks on the newly generated memory video with the theme of "Old Friends Gathering" and the following is displayed: Figure 4 The GUI shown in (b) in the reference Figure 4 The GUI in (b) includes a video area 41 and a picture area 42.

[0223] The picture area 42 is used to display pictures in a picture collection with the theme of "Old Friends Gathering". The picture collection includes multiple pictures, each of which is a picture of three people, and is obtained by matching the pictures in the picture library with the picture P1. Since the size of the picture area 42 is limited, when the number of pictures in the picture collection is large, the picture area 42 displays a part of the pictures in the picture collection. The user can perform operations such as sliding up on the picture area 42. In response to the user operation, the picture area 42 can scroll to display another part of the pictures that are not displayed.

[0224] The video area 41 is used to play each frame of the memory video. It should be noted that the pictures in the memory video with the theme of "old friends gathering" are part or all of the pictures in the picture collection with the theme of "old friends gathering" that the picture area 42 is used to display.

[0225] As mentioned above, for example, when the number of pictures in the picture collection is large, in order to allow the user to experience the wonderful process of video playback as much as possible, some pictures can be selected from the picture collection to generate a memory video. Since the memory video includes some pictures in the picture collection, the user cannot view all pictures when playing the memory video, so the user can view all pictures in the picture area 42. In this way, not only the wonderful experience of the user during the video playback process is improved as much as possible, but also all pictures that meet the conditions can be retained for the user to view, which effectively improves the user experience.

[0226] Figure 5 This is another set of GUIs provided by an embodiment of the present application.

[0227] When generating a memory video, Figure 5 As shown in (a) (corresponding to Figure 3 In the GUI of (f) in FIG. 1 , the user clicks on the recall video to display the following Figure 5 GUI shown in (b) in .

[0228] refer to Figure 5 The GUI in (b) of FIG. 1 includes a return control 51 in the upper left corner and a picture area 52 located below the memory video. The picture area 52 displays each frame of the picture played in the memory video by, for example, moving to the left. The number of pictures contained in the picture area 52 is limited. Each time a frame of the picture is played, the mobile phone moves the picture in the picture area 52 to the left by one frame so that the next frame of the picture enters the picture area 52, thereby displaying each frame of the memory video in the picture area 52. The user clicks the return control 51 to display the following. Figure 5 GUI shown in (c) in FIG.

[0229] refer to Figure 5 The GUI in (c) is Figure 3 The GUI of (d) in FIG. 1 is similar to that of FIG. 1 , including the picture P1, the memory entry area 54 and the address area 55. Figure 3 The difference between the GUI of (d) in FIG. 1 and FIG. 2 is that the GUI includes a character area 53 and a memory entrance 541 of the memory entrance area 54 is changed into a control showing the picture P1.

[0230] Since the image P1 has been analyzed, the GUI can directly display the character area 53, which includes the character image of the character obtained after analyzing the image P1, so that the user's visual experience can be improved. In addition, in some embodiments, since the image P1 is the cover image of the memory video, in the memory entrance area 54, the memory entrance 541 becomes a control that displays the image P1 as the cover image.

[0231] Thus, for the analyzed picture P1 and the recall video including the picture P1, when the user subsequently browses the picture P1 and wants to browse the picture collection related to the picture P1, the following picture collection will be displayed after sliding up the picture P1. Figure 5 In the GUI shown in (c), when the user clicks on the control 541 displaying the image P1, the mobile phone can instantly play the previously generated memory video. Since there is no need to regenerate the memory video based on the analyzed image, the response speed can be effectively improved.

[0232] Figure 6This is another set of GUIs provided in an embodiment of the present application, which illustrates a GUI for a process in which, for a picture that has been analyzed and included in a recall video, the user operates the picture again to trigger the recall function.

[0233] refer to Figure 6 In the GUI of (a), when the user browses the picture P1 again, he wants to browse the related pictures of the group photo of three people in his own gallery, so the user swipes up the picture P1, or the user performs an upward swipe operation on the picture P1. After the mobile phone detects the user's upward swipe operation on the picture P1, it detects that the user has analyzed the picture P1 before and the recall video includes the picture P1, and displays the following Figure 6 GUI shown in (b) in .

[0234] refer to Figure 6 The GUI of (b) in FIG. Figure 5 The GUI of (b) is the same as that of FIG. 1 , including the picture P1, the character area 61, the memory entry area 62, and the address area 63. The user clicks the memory entry 621, and the following is displayed: Figure 6 GUI shown in (c) in FIG.

[0235] refer to Figure 6 The GUI in (c) displays a previously generated memory video with the theme of "old friends gathering", and can automatically play each picture in the memory video.

[0236] It should be noted that Figure 6 The picture operated by the user in (a) can be the picture P1 that the user has previously actively triggered the recall function, or it can be any picture selected by the mobile phone from the gallery based on the picture P1 and added to the recall video. No limitation is made here. It can be understood that in the latter case, although the user has not previously performed an operation on pictures other than the picture P1 in the recall video to trigger the recall function, when the user subsequently performs an operation on any picture other than the picture P1 in the recall video (recorded as the picture A1) to trigger the recall function, it means that the user wants to see the picture A1 in the recall video. Therefore, when the picture A1 is a picture in the recall video, the recall video can play and display the picture A1. Therefore, the picture A1 can also be any picture in the recall video except the picture P1.

[0237] Figure 7 is another set of GUIs provided in the embodiment of the present application, and Figure 3 The difference is that Figure 7 It shows a GUI of the process of searching the gallery for pictures that include all the characters in the picture, generating a picture collection and generating a recall video based on the user's operation on the picture when the picture has been analyzed but not in the recall video.

[0238] refer to Figure 7 The GUI of (a) in the above text is based on Figure 3 By performing operations (a) and (b) in Figure 7 The GUI of (a) in FIG. 1 shows an enlarged picture P1, which includes three characters, namely the user "Xiao Mei", the user's friends "Xiao Li" and "Xiao Hong". When the user browses the picture P1, he misses the time when the three of them were together, and wants to browse related pictures of the three of them in his own gallery. Therefore, the user swipes up the picture P1, or the user performs a swipe up operation on the picture P1. After the mobile phone detects the user's swipe up operation on the picture P1, it displays the following Figure 7 GUI shown in (d).

[0239] For example, after the mobile phone detects that the user swipes up on the picture P1, it determines that the picture P1 has been analyzed, and it is determined that the picture P1 includes a person, and the picture P1 does not exist in any of the memory videos. Therefore, the display is as follows: Figure 7 GUI shown in (b) in .

[0240] refer to Figure 7 The GUI in (b) includes a picture P1, a character area 71 and a memory entrance area 72.

[0241] Since the picture P1 has been analyzed, the GUI can directly display the character area 71, which includes the character image of the character obtained after analyzing the picture P1, so that the user's visual experience can be improved.

[0242] The memory entry area 72 includes a memory entry 721. For example, the memory entry 721 may be a control that displays "Generate Memory". When the user clicks on the memory entry 721 of the control "Generate Memory", the mobile phone detects the user operation and, based on the three characters in the identified picture P1, selects a collection of pictures that meet the conditions and include group photos of the three characters from the picture library through feature matching, and generates a memory video based on the collection of pictures.

[0243] For example, Figure 7 The GUI of (b) may also include other information related to the picture P1. For example, the GUI includes an address area 73. The address area 73 includes a map 731 and text. The map 731 is marked with the address at which the picture P1 was taken, and the text indicates the address at which the picture P1 was taken (for example, Linkai International Building, Keji Road, Yanta District, Xi'an).

[0244] In order to facilitate users to view the progress of generating the memory video and improve the user's visual experience, the following Figure 7The GUI shown in (c) in FIG. 1 includes a picture P1 and a progress box 74, which is used to display the progress of generating the memory video. When the progress reaches 100%, a picture set including the group photo of the three characters and a memory video are generated, and the display Figure 7 GUI shown in (d).

[0245] refer to Figure 7 The GUI in (d) of FIG. 1 shows a reminiscence video with the theme of "old friends gathering" generated in real time, and the reminiscence video includes multiple pictures of three people. After the reminiscence video is generated, the mobile phone can automatically play each frame of the picture in the reminiscence video.

[0246] exist Figure 7 In the embodiment shown, the mobile phone can analyze the picture P1 in advance in the following manner, so that after detecting the user's operation on the picture P1, such as sliding up, the picture P1 does not need to be analyzed again, and is directly displayed as follows: Figure 7 Figure 71 of the GUI in (b).

[0247] In one example, before detecting a user operation such as a swiping up operation on picture P1, when the mobile phone is in charging mode, the mobile phone can actively analyze all pictures in the gallery to classify the pictures, wherein during the process of analyzing the pictures, it is analyzed that picture P1 includes a person.

[0248] In another example, before detecting an operation such as a swiping up operation on picture P1, the user performs an operation such as a swiping up operation on another picture to actively trigger the recall function, and the mobile phone analyzes the pictures in the gallery and extracts features to select pictures that match the characters in the other picture, generate a picture collection, and generate a recall video. In the above process of analyzing pictures, the analysis of picture P1 is completed. However, although picture P1 has been analyzed, it has not been added to the recall video, or in other words, picture P1 is not included in the recall video. It can be understood that in the case where picture P1 has been analyzed and picture P1 is included in the recall video, it can be displayed as follows. Figure 6 The memory entrance 621 of (b) in FIG.

[0249] Figure 8 It is another set of GUIs provided by an embodiment of the present application, which illustrates a GUI of a process in which, for a picture that a user is currently browsing and has not yet analyzed, the user selects any person in the picture, and the mobile phone searches for pictures in the gallery that include the arbitrary person based on the arbitrary person in the picture selected by the user, generates a picture collection, and generates a recall video.

[0250] It should be understood that any person in the picture selected by the user may be part of the people in the picture or all the people in the picture, and this embodiment of the application does not make any limitation, and is subject to user needs. The number of people selected by the user may be one or more, and this embodiment of the application does not make any limitation.

[0251] refer to Figure 8 The GUI of (a) in the above text is based on Figure 3 (a) and (b) in , we get Figure 8 The GUI of (a) in the figure. The GUI displays an enlarged picture P1, which includes three characters, namely the user "Xiao Mei", the user's friends "Xiao Li" and "Xiao Hong". When the user browses the picture P1, he misses the time he spent with his friend "Xiao Li" and wants to browse related pictures of himself and "Xiao Li" in the gallery. Therefore, the user swipes up the picture P1, or the user performs a swipe up operation on the picture P1. After the mobile phone detects the user's swipe up operation on the picture P1, it displays the following Figure 8 GUI shown in (b) in .

[0252] In one example, after the mobile phone detects that the user has swiped up on the picture P1, if it is determined that the picture P1 has not been analyzed, it analyzes the picture P1, and if it is determined that the picture P1 includes a person, it displays the following Figure 8 That is, after the mobile phone detects the user's swiping operation on the picture P1, it determines whether the picture P1 has been analyzed. If it is determined that it has not been analyzed, the mobile phone analyzes whether the picture P1 includes a person. If it is determined that the picture P1 includes a person, the mobile phone displays the following Figure 8 GUI shown in (b) in .

[0253] refer to Figure 8 The GUI of (b) in the figure includes a picture P1 and a memory entry area 81. After the user swipes up on the picture P1, the picture P1 is slid to the top of the interface, and the memory entry area 81 is displayed below the picture P1. The memory entry area 81 is used for the user to trigger the function of generating a memory video. Exemplarily, the memory entry area 81 includes the prompt text "Based on the current picture, quickly analyze and generate related memory videos to relive good memories" and a memory entry 811. Exemplarily, the memory entry 811 can be a control that displays "Generate Memories". When the user clicks on the memory entry 811 of the control such as "Generate Memories", the mobile phone detects the user operation, which means that the user has triggered the function of generating a memory video. The mobile phone recognizes the three characters in the picture P1 and displays the following: Figure 8 GUI shown in (c) in FIG.

[0254] refer to Figure 8The GUI of (c) in the figure includes a picture P1 and a character area 83, and the character area 83 includes character pictures of all characters (e.g., Xiao Li, Xiao Mei, and Xiao Hong) identified from the picture P1. The user selects the pictures of the characters that he is interested in from all the character pictures based on his own preferences. For example, the user selects the pictures of "Xiao Li" and "Xiao Mei". After selecting the pictures of the characters that he is interested in, click on a confirmation control such as "√". The mobile phone detects the user's operation of clicking the confirmation control, and can confirm that the user wants to find a picture including a group photo of "Xiao Li" and "Xiao Mei". Therefore, the mobile phone selects a picture collection that meets the conditions including the group photo of the two characters selected by the user from the gallery through feature matching, and generates a memory video based on the picture collection.

[0255] It should be understood that each picture in the picture collection and the memory video includes not only any person of interest selected by the user, but also other people, depending on the content of the picture itself. However, since the user selected any person in the picture, the pictures in the final generated picture collection and the memory video at least include any person selected by the user. Taking picture P1 as an example, although the user selected "Xiao Li" and "Xiao Mei" in picture P1, as a picture in the picture collection and the memory video, picture P1 itself also includes "Xiao Hong".

[0256] In order to facilitate users to check the progress and improve the user's visual experience, the following is displayed: Figure 8 GUI shown in (d).

[0257] refer to Figure 8 The GUI of (d) in FIG. 1 includes a picture P1 and a progress box 84, and the progress box 84 is used to display the progress of generating the memory video, for example, when the progress reaches 40%. When the progress reaches 100%, a picture set including a group photo of two characters selected by the user and a memory video are generated, and the display Figure 8 GUI shown in (e) in .

[0258] refer to Figure 8 The GUI of (e) in FIG. 1 shows a memory video with the theme of "old friends gathering" generated in real time, and the memory video includes multiple pictures of two people. After the memory video is generated, the mobile phone can automatically play each frame of the memory video.

[0259] Exemplarily, the recollection video includes picture P1. It should be understood that picture P1 is a picture of the recollection video, and picture P1 itself is a picture of three people, including two people of interest selected by the user.

[0260] Exemplarily, the picture P1 operated by the user or used to trigger the generation of a memory video can be used as the cover picture of the memory video.

[0261] For example, when playing a memory video, each frame of the picture can be played according to the timeline, so that the user can recall the past according to the time when the event occurred and deepen the memory. For example, the pictures can be played in order from far to near, that is, the pictures with a farther timeline are played first, and then the pictures with a closer timeline are played.

[0262] In the above embodiment, for the picture currently being browsed, the user actively triggers the recall function. Since the user can select any person in the picture based on his or her preferences, the mobile phone can filter out a collection of pictures including any person selected by the user from the gallery and generate a recall video, which provides the user with a more flexible selection space, allowing the user to more flexibly select characters based on his or her preferences, and recall historical moments related to any person through a recall video including any person, which can better meet the user's actual needs and better improve the user experience.

[0263] Fig. 9 It is another set of GUIs provided in an embodiment of the present application, which illustrates a part of the GUI of the process of triggering the recall function by the user operating the picture again for a picture that has been analyzed and the recall video includes the picture.

[0264] The user previously triggered the active recall function through the picture P1, generating Figure 8 The memory video shown in (e) in FIG. 1 includes a photo of the user "Xiao Mei" and the friend "Xiao Li". That is, the photos in the memory video all include the user "Xiao Mei" and the friend "Xiao Li", and the photo P1 is the cover photo of the memory video. Later, when the user browses the photo P1 again, Fig. 9 As shown in (a) in .

[0265] refer to Fig. 9 In the GUI of (a), when the user browses the picture P1 again, he wants to browse the pictures in his own gallery that are taken with the person in the picture P1. Therefore, the user swipes up the picture P1, or the user performs a swipe up operation on the picture P1. After the mobile phone detects the user's swipe up operation on the picture P1, it detects that the user has analyzed the picture P1 before and the recall video includes the picture P1, and displays the following Fig. 9 GUI shown in (b) in .

[0266] refer to Fig. 9 The GUI of (b) in FIG. 1 includes a picture P1, a character area 91, and a memory entry area 92. By way of example, the GUI may further include an address area 93.

[0267] Since the picture P1 has been analyzed, the GUI can directly display the character area 91, which includes the character image of the character obtained after analyzing the picture P1, so that the user's visual experience can be improved.

[0268] In some embodiments, since the image P1 is the cover image of the memory video, in the memory entry area 92, the memory entry 921 becomes a control showing the image P1. If the user wants to continue viewing the characters in the existing memory video, the user can play the existing memory video through the memory entry 921. For example, if the user wants to continue viewing the photo of himself "Xiao Mei" and his friend "Xiao Li", since the memory video of himself "Xiao Mei" and his friend "Xiao Li" has been generated before, the user clicks on the memory entry 921, and the mobile phone detects the user operation and can display the following Fig. 9 The GUI shown in (d) is the interface displayed by the mobile phone for playing the memory video.

[0269] Exemplarily, the memory entry area 92 may also include a memory entry 922 for updating memories. Exemplarily, the memory entry 922 may be a control that displays "Update Memories". If the user wants to view pictures of other characters different from the characters in the existing memory video, the user can regenerate the memory video including the other characters through the memory entry 922. For example, the user does not want to view the memory video of himself "Xiao Mei" and his friend "Xiao Li", but wants to view the pictures of himself "Xiao Mei" and his friend "Xiao Hong". The user can click on the memory entry 922, and the mobile phone detects the user operation and displays the following information: Fig. 9 GUI shown in (c) in FIG.

[0270] refer to Fig. 9 In the GUI of (c), the user selects pictures of himself "Xiao Mei" and his friend "Xiao Hong" in the character area 94. The mobile phone detects the user's operation of selecting characters, and through feature matching, selects a new picture collection that meets the conditions and includes the group photo of the two characters selected by the user from the gallery, and generates a new memory video based on the new picture collection. In this process, the following can be displayed: Figure 8 The GUI shown in (d) in FIG. 1 can display the following after a new memory video is generated: Figure 8 In the GUI shown in (e), each picture in the new picture collection and the new memory video includes at least "Xiao Mei" and "Xiao Hong".

[0271] Fig.10 This is another set of GUIs provided in an embodiment of the present application, which illustrates a portion of the GUI of a process in which a user operates on a picture to trigger a recall function when the picture has been analyzed but not in a recall video.

[0272] refer to Fig.10The GUI of (a) in the above text is based on Figure 3 By performing operations (a) and (b) in Fig.10 The GUI of (a) in the figure. The GUI displays an enlarged picture P1, which includes three characters, namely the user "Xiao Mei", the user's friends "Xiao Li" and "Xiao Hong". When the user browses the picture P1, he misses the time he spent with his friend "Xiao Li" and wants to browse related pictures of himself and "Xiao Li" in the gallery. Therefore, the user swipes up the picture P1, or the user performs a swipe up operation on the picture P1. After the mobile phone detects the user's swipe up operation on the picture P1, it displays the following Fig.10 GUI shown in (b) in .

[0273] For example, after the mobile phone detects that the user swipes up on the picture P1, it determines that the picture P1 has been analyzed, and it is determined that the picture P1 includes a person, and the picture P1 does not exist in any of the memory videos. Therefore, the display is as follows: Fig.10 GUI shown in (b) in .

[0274] refer to Fig.10 The GUI in (b) includes a picture P1, a character area 101, and a memory entrance area 102. Exemplarily, the GUI may also include other information related to the picture P1, for example, the GUI includes an address area 73.

[0275] Since the picture P1 has been analyzed, the GUI can directly display the character area 101, which includes the character image of the character obtained after analyzing the picture P1, so that the user's visual experience can be improved.

[0276] The memory entry area 102 includes a memory entry 1021. For example, the memory entry 1021 may be a control that displays "Generate Memory". When a user clicks on the memory entry 1021 of the control that displays "Generate Memory", the mobile phone may display the following after detecting the user operation: Fig.10 GUI shown in (c) in FIG.

[0277] refer to Fig.10 In the GUI (c) in FIG. 1 , the user selects pictures of himself “Xiao Mei” and his friend “Xiao Li” in the character area 104. The mobile phone detects the user’s operation of selecting characters, and through feature matching, selects a collection of pictures that meet the conditions and includes group photos of the two characters selected by the user from the picture library, and generates a memory video based on the picture collection. In this process, the following can be displayed: Figure 8 The GUI shown in (d) in FIG. 1 can display the following after the recall video is generated: Figure 8 GUI shown in (e) in FIG. Each picture in the picture collection and the memory video includes at least “Xiao Mei” and “Xiao Li”.

[0278] Below, in Figures 3 to 10 Based on the GUI, combined with Figures 11 to 14 , taking an electronic device as an example, the internal implementation process of the method for generating a recall video in an embodiment of the present application is described in detail.

[0279] Fig.11 is a schematic flow chart of a method 1100 for generating a memory video provided by an embodiment of the present application, which mainly describes the process of performing a full match on all characters in a picture, searching for pictures including all characters in the picture from a picture library, generating a picture collection and a memory video, which can be combined with Figures 3 to 7 GUI description.

[0280] In step S1101 , the electronic device detects the user's operation on picture 1 .

[0281] Picture 1 may be any picture already in the electronic device, and may be a previously stored picture, or a picture taken instantly or obtained through other means, for example, a picture obtained by Bluetooth transmission with other electronic devices, or a picture downloaded from a social application.

[0282] The user's operation on the picture 1 is any operation that can trigger the recall function, and the present embodiment does not impose any limitation thereon. Based on the operation, the electronic device continues to perform subsequent steps to generate a picture collection and a recall video, thereby realizing the recall function of the electronic device.

[0283] In one example, the user's operation on picture 1 may be a sliding operation on picture 1, and the sliding operation may be a sliding operation in any direction. For example, the sliding operation may be as follows: Figure 3 The sliding operation may be a downward sliding operation, a horizontal sliding operation, or the like.

[0284] In other examples, the user's operation on the picture 1 may also be, for example, a long press operation, a double click operation, a single click operation, a two-finger press operation, etc.

[0285] In one example, picture 1 may be a picture displayed in the display interface of the gallery after the user performs an operation on the gallery application. Figure 3 In the GUI of (a) and (b), based on the user's click operation on the picture P1 (i.e., picture 1), Figure 3 In (c), an enlarged picture P1 is displayed, and the user slides up on the picture P1, and the electronic device detects the user's sliding up operation on the picture P1.

[0286] In other examples, picture 1 may also be a picture that a user applies to other pictures (for example, The picture displayed in the display interface of the other picture application after the operation is performed by the other picture application is not limited in any way in the embodiment of the present application.

[0287] In step S1102, after detecting the user's operation on the picture 1, the electronic device determines whether the picture 1 has been analyzed.

[0288] As mentioned above, whether the picture is analyzed in the embodiment of the present application means whether the picture includes a person. If the picture 1 has been analyzed, it means that the picture 1 includes a person, and optionally, the electronic device executes step S1106. If the picture 1 has not been analyzed, the electronic device executes step S1103.

[0289] It can be understood that by determining whether the picture 1 has been analyzed, the electronic device may not need to repeatedly analyze the picture 1 that has been analyzed, thereby reducing the process of analyzing the picture and thus reducing the processing time.

[0290] Below, first, a specific description is given of the relevant steps (steps S1103 to S1115) performed by the electronic device when picture 1 has not been analyzed (recorded as case 1), and then a specific description is given of the relevant steps performed by the electronic device when picture 1 has been analyzed (recorded as case 2).

[0291] Case 1: Image 1 has not been analyzed

[0292] In step S1103 , when picture 1 has not been analyzed, the electronic device analyzes picture 1 to determine whether picture 1 includes a person.

[0293] If it is determined that the picture 1 includes a person, the electronic device executes step S1104. If it is determined that there is no person in the picture 1, the electronic device ends the process.

[0294] In step S1104, the electronic device displays a first interface, which includes a first memory entry area.

[0295] In case 1, when it is determined that picture 1 includes a person, the electronic device displays a first interface.

[0296] It should be understood that the first memory entrance area can provide users with an interface for generating memory functions, and users can generate picture collections and memory videos by performing operations in the first memory entrance area.

[0297] For example, reference Figure 3The GUI in (d) in the figure, the first interface may be the GUI, the GUI includes a memory entry area 33 (corresponding to the first memory entry area), the memory entry area 33 includes a memory entry 331, the memory entry 331 may be a control displaying the text "Generate Memory", and the user clicks the memory entry 331.

[0298] Exemplarily, the first interface may also include picture 1. Exemplarily, the first interface may also include other information related to picture P1, for example, the first interface includes an address area, the address area is used to display the address of generating picture 1. Figure 3 The picture P1 and the address area 34 shown in (d) in FIG.

[0299] In step S1105, the electronic device detects the user's operation in the first memory entry area.

[0300] For example, reference Figure 3 In the GUI in (d), the user clicks on the memory entrance 331 of the memory entrance area 33 (corresponding to the first memory entrance area), and the electronic device detects the user's click operation on the memory entrance 331.

[0301] In step S1110 , the electronic device determines whether the number of people in picture 1 is greater than a number threshold N1 , where N1 is an integer greater than 1.

[0302] Considering the processing capability of current electronic devices, if there are too many persons to be matched, the electronic device may not be able to perform feature matching on too many persons. Therefore, a quantity threshold N1 may be set based on the processing capability of the electronic device.

[0303] When it is determined that the number of people in the picture 1 is less than or equal to the number threshold N1, the electronic device executes step S1111.

[0304] When it is determined that the number of people in picture 1 is greater than the number threshold N1, there are two processing methods. One processing method is that the electronic device ends the process (as shown by the arrow of Y1), and the other processing method is that the electronic device executes the steps of method 1400 below (as shown by the arrow of Y2), which will not be repeated here.

[0305] The quantity threshold N1 is determined according to the capabilities of different types of electronic devices. For example, the quantity threshold N1 may be 3, or any value greater than 3, for example, the quantity threshold N1 may be 10.

[0306] It should be understood that if the capability of the electronic device is good enough, this step can be omitted. After the electronic device executes step S1105, it executes step S1111 without executing step S1110.

[0307] In step S1111, the electronic device searches the gallery for pictures including characters that match all characters in picture 1 to obtain picture collection 1.

[0308] The picture collection 1 includes at least one picture, the at least one picture includes picture 1, and each picture includes characters that match all characters in picture 1. It can be understood that when a picture includes characters that match all characters in picture 1, it means that the picture includes all characters in picture 1.

[0309] It should be noted that when picture collection 1 includes multiple pictures, and there are pictures in picture collection 1 other than picture 1 in which the number of characters is greater than the number of characters in picture 1, these pictures include not only characters that match all the characters in picture 1, but also other characters.

[0310] It should be understood that the description of "each picture includes a character that matches all the characters in Picture 1" here means that each picture includes a character that matches every character in all the characters in Picture 1. The matching here means that the similarity between the two characters is high. When the similarity between the two characters is high, it means that the two characters are the same character.

[0311] In some embodiments, the electronic device searches for pictures including characters that match all characters in Picture 1 from a picture library, and determines all pictures in the picture library including characters that match all characters in Picture 1 as picture collection 1.

[0312] In some other embodiments, the electronic device searches for pictures including characters matching all characters in picture 1 from the picture library, and determines all pictures in the picture library including characters matching all characters in picture 1 as the initial picture collection;

[0313] The electronic device processes the pictures in the initial picture collection to obtain picture collection 1, which includes at least part of the pictures in the initial picture collection.

[0314] Exemplarily, the processing of the images in the initial image collection by the electronic device may include deduplication processing, deblurring processing, aesthetic score determination processing, etc.

[0315] The deduplication process of images means that, when there are at least two images with high repetition, the electronic device retains one image and deletes the remaining images from the initial image collection. The retained image may be the image with the highest aesthetic score among the at least two images with high repetition. For any two images with high repetition, illustratively, the high repetition of the two images may be at least one of the following situations: the characters in the two images are the same and the body movements of the same person, such as expressions and / or postures, are similar; the characters in the two images are the same and the backgrounds are similar; the characters in the two images are the same and the time to generate the images is very short (a time threshold may be used for determination in implementation). It should be understood that the above-mentioned example of the high repetition of any two images is only for illustrative purposes.

[0316] Deblurring an image means that if the blurriness of an image is high, the image can be deblurred to obtain an image with low blurriness, and the resolution of the image after deblurring is higher than that of the image before deblurring.

[0317] The judgment processing of the aesthetic score of the image means that the image is analyzed to obtain the aesthetic score of the image. If the aesthetic score of the image meets the conditions, the image is retained, that is, the image is a picture in the image collection 1. If the aesthetic score of the image does not meet the conditions, the image is deleted from the initial image collection. In implementation, an aesthetic score threshold (referred to as aesthetic score threshold 1) can be set. If the aesthetic score of the image is greater than or equal to the aesthetic score threshold 1, the image is retained. If the aesthetic score of the image is less than the aesthetic score threshold 1, the image is deleted.

[0318] It should be understood that the above-mentioned example of processing the pictures in the initial picture collection is only for illustrative purposes, and any processing of the pictures is acceptable, and the embodiments of the present application do not impose any limitation thereto.

[0319] Regarding step S1111, the electronic device searches for pictures including characters matching all the characters in picture 1 from the picture library by means of feature extraction, and obtains picture collection 1.

[0320] In some embodiments, the electronic device extracts features of all persons in picture 1 to obtain feature results of picture 1; based on the feature results of picture 1, the electronic device searches the gallery for pictures that include persons that match all persons in picture 1 to obtain picture collection 1.

[0321] The feature result of picture 1 is used to characterize all characters in picture 1, including feature information of multiple characters, and the feature information of each character includes multiple feature points used to characterize the character.

[0322] In the step of the electronic device searching for pictures including characters matching all characters in picture 1 from the picture library according to the feature result of picture 1 to obtain picture collection 1, in one example, the feature result of picture 1 can be matched with a character data set of multiple characters recorded in a database to obtain picture collection 1, each character data set records relevant information of the character, and the relevant information can be, for example, the feature information of the character, the mapping information between the character and multiple pictures including the character, etc. In implementation, the electronic device Figure 1 The characteristic information of all characters is matched with the character data set of multiple characters in the database, and the corresponding Figure 1 According to the mapping information between each character in the character data set of each character in the character data set and multiple pictures, find the image library including Figure 1 Pictures of all the characters in the game.

[0323] In another example, the electronic device searches for pictures including characters matching all characters in picture 1 from a picture library based on the feature result of picture 1 to obtain picture collection 1. In another example, the electronic device determines character pictures from the picture library, extracts features of all characters in each character picture to obtain feature results for each character picture, wherein the feature results for each character picture include character feature information of each character in the character picture, compares the feature results for each character picture with the feature results for picture 1, and obtains the character pictures including characters matching all characters in picture 1 based on the matching results. Figure 1 A picture of a person that matches all the characters in picture 1, that is, the obtained picture includes all the characters in picture 1.

[0324] Exemplarily, when the electronic device performs feature extraction on a person in a picture, the feature result can be obtained by extracting the facial features of the person in the picture. In the process of the electronic device performing feature extraction on all the people in picture 1, the electronic device performs feature extraction on the face of each person in picture 1 to obtain feature information of each person, and the feature information of each person includes multiple feature points of the face of each person, thereby obtaining the feature result of picture 1. Similarly, in the process of the electronic device performing feature extraction on person-type pictures in the gallery, the electronic device performs feature extraction on the face of each person in each person-type picture to obtain feature information of each person, and the feature information of each person includes multiple feature points of the face of each person, thereby obtaining the feature result of each person-type picture.

[0325] In the embodiments of the present application, there is no limitation on the method of extracting features of characters, as long as feature matching can be performed through the extracted feature points of the characters. For example, the method of feature extraction can be scale-invariant feature transform (SIFT), or speeded up robust features (SURF), or oriented features from accelerated segment test (Oriented FAST) and rotated binary robust independent elementary features (Rotated BRIEF) (Oriented FAST and Rotated BRIEF, ORB), etc.

[0326] In step S1112, the electronic device determines whether the number of pictures in picture collection 1 is greater than a number threshold N2, where N2 is an integer greater than 1.

[0327] Taking into account the user's playback experience of the memory video, if the number of pictures in the memory video is too large, it will waste the user's time and cause problems such as aesthetic fatigue, and the user's experience of enjoying the memory video will not be very good. Therefore, a quantity threshold N2 can be set to make the number of pictures in the generated memory video as appropriate as possible, so that the user can better experience the wonderful process of video playback.

[0328] The quantity threshold N2 may be any possible value, for example, the quantity threshold N2 may be 20, 30, 40, 50 or 60, etc.

[0329] When the number of pictures in picture collection 1 is greater than the number threshold N2, the electronic device executes step S1113; when the number of pictures in picture collection 1 is less than or equal to the number threshold N2, the electronic device executes step S1115.

[0330] In step S1113 , when the number of pictures in picture collection 1 is greater than the number threshold N2 , the electronic device determines picture collection 2 based on picture collection 1 .

[0331] It should be understood that the number of pictures in picture collection 2 is less than or equal to the number of pictures in picture collection 1.

[0332] In some embodiments, the electronic device may filter pictures from picture collection 1 according to a timeline of the generation time of all pictures in picture collection 1 to obtain picture collection 2.

[0333] Fig.12 It is a schematic flowchart of a process in which an electronic device provided in an embodiment of the present application determines picture collection 2 based on picture collection 1, and a process in which a recall video is determined based on picture collection 2.

[0334] refer to Fig.12 , exemplarily, in step S31, the electronic device determines whether the number M of time periods of the M time periods in which the generation time of all pictures in the picture collection 1 is distributed is less than N2.

[0335] When the number M of time periods in which the generation times of all pictures are distributed is not less than (ie, greater than or equal to) N2, the electronic device can determine picture collection 2 by method 1 and method 2.

[0336] When the number M of time periods in the M time periods in which the generation times of all pictures are distributed is less than N2, the electronic device can obtain the picture collection 2 through method 3.

[0337] The following describes the process of obtaining the image collection 2 through the above three methods respectively.

[0338] Method 1 (M is greater than or equal to N2)

[0339] In step S32, when the number M of time periods in which the generation time of all pictures in picture collection 1 is distributed is greater than or equal to N2, the electronic device selects a picture from picture collection 1 in each of the M time periods to obtain picture collection 2, which includes M pictures.

[0340] It should be understood that picture collection 2 includes a picture in each of M time periods. Therefore, picture collection 2 includes M pictures, the M pictures correspond one to one to the M time periods, and the generation time of a picture is distributed in one time period.

[0341] In the implementation, the electronic device determines that the generation time of all pictures is distributed within M time periods based on the generation time of all pictures, compares M with N2, and if M is greater than or equal to N2, then selects one picture from picture collection 1 in each of the M time periods to obtain a second picture set.

[0342] Here, the duration of a time period may be any duration, for example, the duration of a time period may be one day, one week, half a month, one month or more months.

[0343] The M time periods in which the generation time of all pictures is distributed means that the generation time of all pictures is distributed in M ​​time periods, and each time period of the M time periods corresponds to at least one picture, or in other words, at least one picture is generated in each time period of the M time periods. For example, taking M as 10 and the length of the time period as one month, assuming that picture collection 1 includes 12 pictures, and the generation time of the 12 pictures is respectively: January, January, February, April, April, May, June, August, September, October, November, December, and January and April each correspond to 2 pictures. Therefore, the generation time of the 12 pictures is distributed in 10 months, 8 of which correspond to one picture, and the remaining 2 months (January and April) correspond to 2 pictures.

[0344] If each time period of some of the M time periods corresponds to multiple pictures, the electronic device can arbitrarily select one picture in each time period of the partial time period, or select the picture with the highest aesthetic score in each time period of the partial time period. The embodiment of the present application does not impose any limitation on this.

[0345] Considering that the time distribution of all the pictures in picture collection 1 is relatively long, when screening pictures, try to select one picture in each time period. This will help users recall events with relatively uniform time intervals through the relevant pictures of all the people in picture 1, which can reduce the user's memory gap to a certain extent. Overall, the user experience is considered in terms of the number of pictures to be recalled and the time interval to be recalled, balancing different factors to better meet the user experience.

[0346] Method 2 (M is greater than or equal to N2)

[0347] In step S33, when the number M of time periods in which the generation time of all pictures in picture collection 1 is distributed is greater than or equal to N2, the electronic device selects a picture from picture collection 1 in each of the N2 time periods that are earlier in the M time periods in chronological order from far to near, to obtain picture collection 2, which includes N2 pictures.

[0348] In this embodiment, since picture collection 2 includes a picture in each of the N2 time periods that are earlier than the M time periods, the number of pictures in picture collection 2 is N2, that is, picture collection 2 includes N2 pictures.

[0349] Here, the N2 time periods that are closer in time among the M time periods can be understood as sorting the M time periods from far to near, and the N2 time periods that are closer in time among the sorted M time periods are earlier than the M-N2 time periods. For example, M is 10, N2 is 8, and the M time periods are 10 months, namely January, February, April, May, June, August, September, October, November and December. The 8 time periods that are closer in time among the 10 months are: January, February, April, May, June, August, September and October.

[0350] In implementation, the electronic device determines that the generation time of all the pictures in picture collection 1 is distributed within M time periods according to the generation time of all the pictures, sorts the M time periods in time order from far to near, and selects a picture in each time period of the first N2 time periods in the sorted M time periods to obtain picture collection 2. It should be understood that when M is equal to N2, the first N2 time periods of the M time periods are the M time periods.

[0351] If each time period of some of the first N2 time periods corresponds to multiple pictures, the electronic device can arbitrarily select one picture in each time period of the partial time period, or select the picture with the highest aesthetic score in each time period of the partial time period. The embodiment of the present application does not impose any limitation on this.

[0352] It can be understood that based on actual conditions, if it is necessary to control the number of pictures in picture collection 2 to be less than or equal to N2, and the number of time periods M in the M time periods in which the generation time of all pictures in picture collection 1 is distributed is greater than or equal to N2, since the user's memory of events that happened a long time ago is relatively vague, therefore, selecting a picture from each time period of the first N2 time periods that are far away can enable the user to better recall events that happened a long time ago through pictures, thereby improving the user experience.

[0353] Method 3 (M is less than N2)

[0354] In step S34, when the number M of time periods in which the generation time of all pictures in picture collection 1 is distributed is less than N2, the electronic device selects at least one picture from picture collection 1 in each of the M time periods to obtain picture collection 2, and picture collection 2 includes N2 pictures.

[0355] In this embodiment, since M is less than N2, each time period in a part of the time periods (recorded as the first part of the time periods) within the M time periods may correspond to one picture, and each time period in another part of the time periods (recorded as the second part of the time periods) may correspond to multiple pictures. That is, the electronic device selects one picture in each time period of the first part of the time periods, and selects multiple pictures in each time period of the second part of the time periods, and finally obtains N2 pictures.

[0356] Exemplarily, when the electronic device screens pictures in picture collection 1, it may screen out at least one picture with a high aesthetic score in each time period in order of aesthetic scores from high to low, or it may screen out at least one arbitrary picture in each time period, and the embodiments of the present application do not impose any limitation thereto.

[0357] In some embodiments, the second portion of the time period is earlier than the first portion of the time period.

[0358] That is, when filtering pictures in picture collection 1, the electronic device filters more pictures in a more distant time period. Since the user's memory of events that happened a long time ago is relatively vague, filtering out multiple pictures in each time period in the second part of the more distant time period can enable the user to better recall the events that happened a long time ago through pictures, thereby improving the user experience.

[0359] For example, M is 10, N2 is 12, and M time periods are 10 months, namely January, February, April, May, June, August, September, October, November, and December. The second time period can be January and February, and the electronic device selects 2 pictures from each of these 2 months. The first time period can be April, May, June, August, September, October, November, and December, and the electronic device selects 1 picture from each of these 8 months, and finally gets 12 pictures.

[0360] In implementation, the electronic device can select one picture in each of the M time periods to obtain M pictures, and then select one picture in each of the N2-M time periods that are earlier in the M time periods in chronological order from far to near to obtain N2-M pictures. The M pictures plus the N2-M pictures are added together to obtain the picture collection 2 including N2 pictures.

[0361] In other embodiments, without considering the number M of time periods in the M time periods in which the generation time of all pictures is distributed, the electronic device can analyze all pictures to obtain aesthetic scores of all pictures, and filter out pictures with the top N2 aesthetic scores from all pictures in order of aesthetic scores from high to low, to obtain a picture collection 2 including N2 pictures.

[0362] In step S1114, the electronic device generates a recall video based on the picture collection 2.

[0363] In some embodiments, the electronic device may use all pictures in picture collection 2 as pictures of the recall video, that is, the recall video includes all pictures in picture collection 2.

[0364] In other embodiments, as described above, in order to allow the user to experience the wonderful process of video playback as much as possible, the number of pictures in the memory video should not be too many, so based on the preset number threshold N2, the number of pictures in the final memory video is made to not exceed N2. Therefore, based on the number of pictures in the picture collection 2, the process of the electronic device generating the memory video can be divided into the following two cases for explanation.

[0365] Case A: The number of images in image collection 2 is greater than N2

[0366] This situation A corresponds to the situation in step S1113 where picture collection 2 is generated based on method 1. The generation time of all pictures in picture collection 2 is distributed within M time periods, each time period corresponds to a picture, and the number of pictures in picture collection 2 is M, where M is greater than N2.

[0367] refer to Fig.12 For case A, in step S41, the electronic device selects N2 pictures from picture collection 2 to generate a memory video. Exemplarily, the electronic device selects N2 pictures from picture collection 2 and determines the N2 pictures as pictures of the memory video, wherein the memory video includes the N2 pictures.

[0368] In one example, when the number of pictures in picture collection 2 is greater than N2, the electronic device selects pictures with the top N2 aesthetic scores from picture collection 2 in order of aesthetic scores from high to low, and determines the obtained N2 pictures as pictures of the recall video.

[0369] For example, the number of pictures in picture collection 2 is 60, N2 is 50, and the top 50 pictures with aesthetic scores are selected from the 60 pictures, and the 50 pictures are used as the pictures of the recall video.

[0370] In another example, when the number of pictures in picture collection 2 is greater than N2, within the M time periods of the generation time distribution of all pictures in picture collection 2, the electronic device determines, in chronological order from far to near, N2 pictures corresponding to the earlier N2 time periods among the M time periods as pictures of the recall video.

[0371] For example, the number of pictures M in picture collection 2 is 60, N2 is 50, and M time periods are 60 months. 50 pictures corresponding to the first 50 months of the 60 months are determined as pictures of the recall video.

[0372] Case B: The number of images in image collection 2 is equal to N2

[0373] This situation B corresponds to the situation in step S1113 where picture collection 2 is generated based on method 2 or method 3, and picture collection 2 includes N2 pictures, that is, the number of pictures in picture collection 2 is equal to N2.

[0374] refer to Fig.12 For case B, illustratively, in step S42, the electronic device may determine all pictures in picture collection 2 as pictures of the memory video, and the memory video finally obtained includes N2 pictures.

[0375] In step S1115 , when the number of pictures in picture collection 1 is less than or equal to the number threshold N2 , the electronic device generates a recall video based on picture collection 1 .

[0376] Since the number of pictures in picture collection 1 is less than or equal to the number threshold N2, all pictures in picture collection 1 can be determined as pictures of a memory video, and a memory video is generated, which can satisfy the user's wonderful experience of watching videos.

[0377] In the above, through step S1103 and step S1115, the process of generating a recall video by the electronic device when the picture 1 has not been analyzed (case 1) is described in detail. In the following, the relevant steps performed by the electronic device when the picture 1 has been analyzed (case 2) are described in detail.

[0378] Case 2: Image 1 has been analyzed

[0379] For situation 2 where picture 1 has been analyzed, the electronic device may analyze picture 1 in advance in the following manner, so that after detecting operation 1 of the user on picture 1, there is no need to analyze picture 1 any more.

[0380] In one example, before detecting a user's operation on picture 1, when the electronic device is in charging mode, the electronic device can actively analyze all pictures in the electronic device to classify the pictures, wherein during the process of analyzing the pictures, it is analyzed that picture 1 includes a person.

[0381] In another example, before detecting the user's operation on picture 1, the user performs an operation on another picture to actively trigger the recall function, and the electronic device analyzes the pictures in the electronic device and extracts features, etc., selects pictures that match the person in the other picture, generates a picture collection, and generates a recall video. In the above process of analyzing pictures, the analysis of picture 1 is completed, but although picture 1 has been analyzed, it has not been added to the recall video, or in other words, the existing recall video does not include picture 1.

[0382] In another example, before the user's operation on picture 1 is detected, the user has triggered the recall function through picture 1 or another picture, and a picture collection and a recall video have been generated, and the generated recall video includes picture 1. As for the way in which the user triggers the recall function through another picture, it can be understood that the other picture has the same person as picture 1, and the other picture is a picture that meets the matching requirements selected by the electronic device by matching picture 1 with other pictures in the gallery through features.

[0383] In the implementation, for the first two ways of analyzing picture 1, since the existing recall video does not include picture 1, the electronic device can execute step S1104 after judging step S1106. For the last way of analyzing picture 1, since the existing recall video includes picture 1, the electronic device can execute step S1107 after judging step S1106.

[0384] In step S1106 , when picture 1 has been analyzed, the electronic device determines whether the existing recollection video includes picture 1 .

[0385] When a user performs an operation on the currently browsed picture 1, it not only means that the user wants to view other pictures related to the person in picture 1, but also means that the user wants to see picture 1 in the wonderfully played memory video. Therefore, in the case where picture 1 is included in the existing memory video (recorded as case 2.1), the electronic device does not need to regenerate the memory video, but executes steps S1107 to S1109 to play the existing memory video through simple human-computer interaction.

[0386] In the case where the existing recall video does not include picture 1 (referred to as case 2.2), the electronic device executes step S1104 and subsequent steps.

[0387] It should be understood that the existing recollection video may be generated through the above-mentioned exemplary embodiments.

[0388] Case 2.1

[0389] In step S1107, when the existing memory video includes picture 1, the electronic device displays a second interface including a second memory entry area.

[0390] It should be understood that the second memory entry area can provide the user with an interface for triggering the memory function. When the user performs an operation in the second memory entry area, the electronic device can display and play the existing memory video.

[0391] For example, reference Figure 6 The second interface may be the GUI in (b), the second interface includes a memory entrance area 62 (i.e., a second memory entrance area), the memory entrance area 62 includes a memory entrance 621, and the memory entrance 621 may be a control that displays a cover image of a memory video, and the user clicks the memory entrance 621. As described above, when the memory entrance 621 displays a cover image, it means that the image currently operated by the user already exists in the existing memory video.

[0392] Exemplarily, the second interface may also include picture 1. Exemplarily, the second interface may also include other information related to picture P1, for example, the second interface includes an address area, the address area is used to display the address of generating picture 1. Figure 6 The picture P1 and the address area 63 shown in (b) in FIG.

[0393] In step S1108, the electronic device detects the user's operation in the second memory entry area.

[0394] For example, reference Figure 6 In the GUI in (b), the user clicks on the memory entrance 621 of the memory entrance area 62, and the electronic device detects the user's click operation on the memory entrance 621.

[0395] In step S1109, the electronic device displays the recollection video.

[0396] That is, after detecting the user's operation in the second memory entry area, the electronic device directly displays the existing memory video to the user and can automatically play each picture in the memory video. Figure 6 In the GUI shown in (c), after the user clicks the memory entrance 621 in the memory entrance area 62, the electronic device displays the existing memory video and automatically plays each picture in the memory video.

[0397] Case 2.2

[0398] In step S1104, when the existing memory video does not include picture 1, the electronic device displays a first interface including a first memory entry area.

[0399] In some embodiments, the first interface displayed by the electronic device in situation 2.2 may be the same as the first interface displayed in situation 1. For a specific description, reference may be made to the specific description of step S1104 in situation 1 above, which will not be repeated here.

[0400] In some other embodiments, since the image P1 has been analyzed, the first interface displayed by the electronic device in situation 2.2 may be different from the first interface displayed in situation 1. Figure 7 The GUI in (b) in the figure, the first interface can be this GUI, which not only includes the memory entrance area 72 (corresponding to the first memory entrance area), but also includes the character area 71. The character area 71 includes the character picture of the character obtained after analyzing the picture P1. In this way, the user's visual experience can be improved.

[0401] Subsequently, the electronic device executes step S1105 and subsequent steps. For specific descriptions, please refer to the related descriptions of the same steps in situation 1, which will not be repeated here.

[0402] The method 1100 is described in detail above. It should be understood that the various steps in the above example are only for illustrative purposes and should not be construed as limiting the embodiments of the present application. The implementation process may include more or fewer steps.

[0403] For example, step S1102 is an optional step. After the electronic device executes step S1101, it does not need to determine whether picture 1 is analyzed. Regardless of whether picture 1 has been analyzed, the electronic device directly executes step S1103 to analyze picture 1. It should be understood that when the electronic device does not execute step S1102, naturally, the electronic device does not execute steps S1106 to S1109.

[0404] For another example, the electronic device executes step S1102, but step S1106 may be an optional step, and the electronic device may not need to execute step S1106, and naturally, does not need to execute steps S1107 to S1109.

[0405] For another example, step S1110 is an optional step. For an electronic device with good processing capability, the electronic device directly executes step S1111 after executing step S1105.

[0406] For another example, step S1112 is an optional step. After the electronic device executes step S1111, it does not need to consider whether the number of pictures in picture collection 1 is too large. The electronic device directly uses all pictures in picture collection 1 as pictures of the recall video. Such a processing process is simple and easy, and saves processing time. It should be understood that when the electronic device does not execute step S1112, naturally, the electronic device does not need to execute steps S1113 and S1114.

[0407] Fig.13 1300 is a schematic flow chart of a method 1300 for generating a memory video provided by an embodiment of the present application. It mainly describes that a user can select any person in a picture, an electronic device matches the user's selected person, searches for pictures including the person in a picture library, generates a picture collection and a memory video, and can be combined with Figures 8 to 10 GUI description.

[0408] In terms of implementation steps, there are two main differences between method 1300 and method 1100. First, the process of obtaining picture collection 1 based on user operation is different. In method 1300, the electronic device obtains picture collection 1 through steps S1311a to S1311c, and in method 1100, the electronic device obtains picture collection 1 through step S1111. Second, in case 2.1 where picture 1 has been analyzed, when it is determined that the existing memory video includes picture 1, based on different operations of the user in the second memory entrance area, the electronic device can perform different steps to display or regenerate the memory video. In method 1300, the electronic device can not only perform steps S1308a and S1308b based on user operation 1 to display the existing memory video, but also perform step S1308b based on user operation 2 to generate a new memory video.

[0409] In step S1301 , the electronic device detects the user's operation on picture 1 .

[0410] In step S1302, after detecting the user's operation on the picture 1, the electronic device determines whether the picture 1 has been analyzed.

[0411] If the picture 1 has been analyzed, it means that the picture 1 includes a person, and optionally, the electronic device executes step S1306. If the picture 1 has not been analyzed, the electronic device executes step S1303.

[0412] For the specific description of step S1301 and step S1302, please refer to the relevant description of step S1101 and step S1102 in method 1100, which will not be repeated here.

[0413] Below, first, the relevant steps (steps S1303 to S1315) executed by the electronic device in case 1 when picture 1 has not been analyzed are described in detail, and then the relevant steps executed by the electronic device in case 2 when picture 1 has been analyzed are described in detail.

[0414] Case 1: Image 1 has not been analyzed

[0415] For the detailed description of step S1303 to step S1310, please refer to the relevant description of step S1103 to step S1110 in method 1100, which will not be repeated here.

[0416] In step S1311a, when the number of people in picture 1 is less than or equal to the number threshold N1, the electronic device displays a third interface including the person pictures of all the people in picture 1.

[0417] In this step, the electronic device recognizes all the characters in the picture 1 and displays the third interface, which includes the character pictures of all the characters in the recognized picture 1. The user can select the character picture of the character he is interested in from all the character pictures based on his own preferences, so that the electronic device searches the picture library for a picture matching the character selected by the user.

[0418] For example, reference Figure 8 The GUI in (c) may be a third interface, and the GUI includes a character area 83, which includes character pictures of all characters (e.g., Xiao Li, Xiao Mei, and Xiao Hong) recognized by the electronic device from the picture P1 (i.e., picture 1). The user selects the character picture of the character that he is interested in from the character pictures of all characters based on his own preferences. For example, the user selects the pictures of "Xiao Li" and "Xiao Mei". After selecting the character picture of the character that he is interested in, click a confirmation control such as "√".

[0419] In step S1311b, the electronic device detects an operation of the user selecting a picture of at least one person.

[0420] Based on his / her own preferences, the user selects a picture of at least one character that he / she is interested in from all the pictures of characters. In response to the user operation, the electronic device detects the user's operation of selecting the picture of at least one character.

[0421] For example, reference Figure 8 In (c), the user selects the character pictures of "Xiao Li" and "Xiao Mei" and clicks a confirmation control such as "√". The mobile phone detects the user's operation of selecting the character pictures of "Xiao Li" and "Xiao Mei" and clicking the confirmation control.

[0422] In step S1311c, the electronic device searches the gallery for pictures including characters matching at least one character selected by the user to obtain picture collection 1.

[0423] The only difference between this step and step S1111 is that step S1111 searches for pictures including characters that match all the characters in picture 1, while in step S1311c, the electronic device searches for pictures including characters that match at least one character in picture 1. When extracting features from picture 1, feature extraction may be performed only on at least one character selected by the user to obtain a feature result for picture 1, which includes feature information of at least one character.

[0424] Therefore, for the specific description of step S1311c, please refer to the relevant description of step S1111 in method 1100, and no further details will be given. All characters in step S1111 can be replaced by at least one character here.

[0425] After the electronic device completes step S1311c, the electronic device executes step S1312, and based on the number of pictures in picture collection 1, executes steps S1313 and S1314, or executes step S1315. For the specific description of steps S1312 to S1315, reference may be made to the relevant description of steps S1112 to S1115 in method 1100, which will not be repeated here.

[0426] Case 2: Image 1 has been analyzed

[0427] In step S1306 , when picture 1 has been analyzed, the electronic device determines whether the existing recollection video includes picture 1 .

[0428] In case 2.1, when the existing recall video includes picture 1, the electronic device executes step S1307; in case 2.2, when the existing recall video does not include picture 1, the electronic device executes step S1304 and subsequent steps.

[0429] Case 2.1

[0430] In step S1307, when the existing memory video includes picture 1, the electronic device displays a second interface including a second memory entry area.

[0431] In this step, the second memory entry area can provide the user with an interface for triggering the memory function, and the user can perform different operations in the second memory entry area to display existing memory videos or generate new memory videos.

[0432] In some embodiments, the second memory portal area includes a first memory portal and a second memory portal, the first memory portal is used to display an existing memory video, and the second memory portal is used to generate a new memory video.

[0433] It can be understood that since method 1300 generates a picture collection and a memory video of an arbitrary character based on the arbitrary character selected by the user, even if the existing memory video includes Picture 1, for the same picture (Picture 1), the characters selected by the user at different times may be different. Therefore, the second memory entrance in the second memory entrance area provides the user with a more flexible selection space and a good user experience.

[0434] For example, reference Fig. 9 The second interface may be the GUI of (b) in the figure, and the second interface includes a memory entry area 92 (i.e., a second memory entry area), and the memory entry area 92 includes a memory entry 921 (i.e., a first memory entry) and a memory entry 922 (i.e., a second memory entry). The user can make the mobile phone display an existing memory video through the memory entry 921, and the user can reselect any character to generate a new memory video through the memory entry 922.

[0435] In step S1308a, the electronic device detects the user's operation 1 in the second memory entry area.

[0436] In step S1309, the electronic device displays the recollection video.

[0437] It should be understood that the operation 1 is an operation for displaying a memory video. For example, the operation 1 may be an operation of the user on the first memory entrance of the second memory entrance area. In response to the user's operation on the first memory entrance, the electronic device detects the operation 1 and displays the memory video. Fig. 9 In the GUI of (b), in response to the user clicking on the memory entry 921, the mobile phone detects the operation and displays the following Fig. 9 The GUI in (d) above, i.e., displays the existing memory videos.

[0438] In step S1308b, the electronic device detects the user's operation 2 in the second memory entry area.

[0439] It should be understood that the operation 2 is an operation for generating a new memory video. For example, the operation 2 may be an operation of the user on the second memory entry of the second memory entry area. In response to the user's operation on the second memory entry, the electronic device detects the operation 2. Fig. 9 In the GUI of (b), in response to the user clicking on the memory entry 922, the mobile phone detects the operation and displays the following Fig. 9 GUI in (c).

[0440] After the electronic device detects the user's operation 2 at the second memory entrance, step S1311a and subsequent steps are executed to generate a new memory video. Please refer to the relevant description above and will not be repeated here.

[0441] It should be understood that the second interface of the above example is only for illustrative purposes and should not be construed as limiting. In other embodiments, the second memory entrance area of ​​the second interface may include one of the first memory entrance and the second memory entrance. In the case where the second memory entrance area may include the first memory entrance but not the second memory entrance, step S1308b and subsequent steps do not need to be performed. In the case where the second memory entrance area may include the second memory entrance but not the first memory entrance, steps S1308a and S1309 do not need to be performed.

[0442] Case 2.2

[0443] In step S1304, when the existing memory video does not include picture 1, the electronic device displays a first interface including a first memory entry area.

[0444] In some embodiments, the first interface displayed by the electronic device in situation 2.2 may be the same as the first interface displayed in situation 1. For a specific description, reference may be made to the specific description of step S1304 in situation 1 above, which will not be repeated here.

[0445] In some other embodiments, since the image P1 has been analyzed, the first interface displayed by the electronic device in situation 2.2 may be different from the first interface displayed in situation 1. Fig.10 The GUI in (b) in the figure, the first interface may be the GUI, which includes not only a memory entrance area 102 (i.e., a first memory entrance area), but also a character area 101. The character area 101 includes a character picture of a character obtained after analyzing the picture P1. In this way, the user's visual experience may be improved.

[0446] Subsequently, the electronic device executes step S1305 and subsequent steps. For specific descriptions, please refer to the related descriptions of the same steps in situation 1 in method 1300, which will not be repeated here.

[0447] The method 1300 is described in detail above. It should be understood that the various steps in the above example are only for illustrative purposes and should not be construed as limiting the embodiments of the present application. The implementation process may include more or fewer steps.

[0448] Fig.14 It is a schematic flowchart of a process provided by an embodiment of the present application for an electronic device to generate a picture collection and a recall video when the number of people in the picture is greater than a number threshold N1.

[0449] It should be understood that before executing step S1411a, for picture 1, the electronic device displays the first interface through method 1100 or method 1300, and after the electronic device detects the user's operation in the first memory entrance area of ​​the first interface, if it is determined that the number of characters in picture 1 is greater than the number threshold N1, step S1411a is executed.

[0450] In step S1411a, when the number of people in picture 1 is greater than the number threshold N1, the electronic device displays a fourth interface including pictures of N1 people among all the people in picture 1.

[0451] Taking into account the processing capabilities of current electronic devices, if the number of characters that need to be matched is too large, the electronic device may not be able to perform feature matching on too many characters. Therefore, after the electronic device identifies all the characters in picture 1, it determines N1 characters from all the characters to recommend to the user, and displays the characters' pictures of the N1 characters through the fourth interface for the user to choose. The user can select a picture of at least one character from the pictures of the N1 characters, so that the electronic device can search the gallery for a picture that matches the at least one character selected by the user.

[0452] Fig.15 is a schematic diagram of the fourth interface provided in the embodiment of the present application. Fig.15 The fourth interface includes picture 1 and character area 151. Picture 1 includes 5 characters, N1=4. Since the number of characters 5 in picture 1 is greater than 4, only the character pictures of 4 characters are displayed in character area 151. The user selects all 4 characters and clicks a confirmation control such as "√".

[0453] In this step, the N1 characters in the picture 1 may be any N1 characters among all the characters in the picture 1, or may be N1 characters determined by the electronic device based on a rule, and no limitation is made here.

[0454] In an embodiment in which the electronic device determines N1 characters based on rules, in some embodiments, the electronic device may determine the characters with the largest N1 facial area proportions as the N1 characters for recommendation to the user in the order of facial area proportions of all characters in picture 1 from large to small.

[0455] That is, the face area ratio of the N1 person is greater than the face area ratio of all the persons in the picture 1 except the N1 person. It should be noted that the face area ratio here means the size of the face area of ​​a person occupying the entire area of ​​the picture.

[0456] It is understandable that when there are a large number of people in a picture, it is inevitable that the faces of some people occupy a smaller area of ​​the entire picture, and the faces of some people cannot even be seen, which affects the feature extraction of the characters and further affects the search for pictures of related characters. Therefore, N1 characters with a larger face area ratio are recommended to users based on the face area ratio, so that the features of the characters can be extracted as well as possible to find pictures of related characters without affecting the user experience.

[0457] In other embodiments, the electronic device may also determine the N1 characters based on other rules. For example, the electronic device determines the N1 characters with richer expressions among all the characters in the picture 1 as the N1 characters to be recommended to the user.

[0458] In step S1411b, the electronic device detects an operation of the user selecting a picture of at least one person among the N1 persons.

[0459] Based on his / her own preferences, the user selects a picture of at least one character from N1 characters recommended by the electronic device. In response to the user operation, the electronic device detects the user's operation of selecting the picture of at least one character from the N1 characters.

[0460] For example, reference Fig.15 The user selects the character pictures of all the four recommended characters and clicks a confirmation control such as “√”. The mobile phone detects the user's operation of selecting the character pictures of the four characters and clicking the confirmation control.

[0461] In step S1411c, the electronic device searches the gallery for pictures including characters matching at least one character selected by the user to obtain picture collection 1.

[0462] For a detailed description of this step, please refer to the relevant description of step S1111, which will not be repeated here. The only difference is that method S1111 searches for pictures that include characters that match all characters in picture 1, while in step S1411c, the electronic device searches for pictures that include characters that match at least one of the N1 characters in picture 1, and when extracting features from picture 1, only extracting features from at least one of the N1 characters selected by the user.

[0463] After the electronic device completes step S1411c, the electronic device executes step S1412, and based on the number of pictures in picture collection 1, executes steps S1413 and S1414, or executes step S1415. For the specific description of steps S1412 to S1415, reference may be made to the relevant description of steps S1112 to S1115 in method 1100, which will not be repeated here.

[0464] For the previously generated memory video, after a period of time, multiple new pictures are generated in the electronic device, and the user can update the picture collection and update the memory video through any new picture. The following is a detailed description of the process of updating the picture collection and updating the memory video.

[0465] Fig.16 It is a schematic flowchart of a method 1600 for generating a memory video provided in an embodiment of the present application, which mainly describes a process in which an electronic device updates a picture collection and updates a memory video based on new pictures.

[0466] For ease of description, the previously generated picture collection for directly generating a memory video is referred to as the old picture collection, and the previously generated memory video is referred to as the old memory video. Here, the old picture collection can be the picture collection 1 or picture collection 2 directly used to generate a memory video obtained by method 1100, method 1300, or method 1400 above. It should be understood that when the old picture collection is the picture collection 1 above, the picture collection 1 is a picture collection in which the number of pictures is less than or equal to N2.

[0467] Assume that the electronic device generates an old picture collection and an old memory video through the user's operation on picture 1 at time 1 (for example, March 15, 2023 14:00), and the pictures in the old picture collection and the old memory video are all pictures obtained before time 1 of the electronic device; in time period 1 (for example, March 15, 2023 14:00-June 15, 2023 12:00) between time 1 and time 2 (for example, June 15, 2023 12:00), the electronic device obtains multiple new pictures through various methods such as shooting or downloading, and updates the old picture collection and the old memory video through any new picture (recorded as picture 2), and time 2 can be understood as the time for updating the old picture collection and the old memory video.

[0468] In step S1610 , the electronic device obtains picture collection 3 based on picture 2 .

[0469] In this step, the user performs an operation on the picture 2, and finally obtains the picture collection 3 through the above-mentioned method 1100, 1300 or 1400.

[0470] It should be noted that picture collection 3 is a picture directly used to update the memory video. For example, in the case where picture collection 3 is obtained by method 1100, picture collection 3 can be a picture collection used to generate the memory video in step S1114 (picture collection 3 is analogous to picture collection 2 in step S1114), or picture collection 3 can be a picture collection used to generate the memory video in step S1115 (picture collection 3 is analogous to picture collection 1 in step S1115). The explanation of obtaining picture collection 3 by method S1300 and method 1400 is the same as that of method 1100 and will not be repeated.

[0471] It should be understood that for old picture collections and old memory videos, in the process of obtaining picture collection 3 based on picture 2, the electronic device searches for pictures of the same person based on user operations. That is to say, picture collection 3 and the old picture collection (or old memory video) are associated with the same person, or in other words, picture collection 3 and the old picture collection (or old memory video) both include the same person. For example, in the old picture collection and the old memory video, the electronic device searches for pictures including person 1, person 2, and person 3 in the gallery based on user operations. Then, in the process of obtaining picture collection 3 based on picture 2, the electronic device also searches for pictures including person 1, person 2, and person 3 in the gallery based on user operations. Picture collection 3 and the old picture collection (or old memory video) both include person 1, person 2, and person 3.

[0472] In some embodiments, in the process of obtaining picture collection 3 according to picture 2, the electronic device searches the picture library for pictures including the same person obtained by the electronic device in time period 1 between time 1 and time 2 to obtain picture collection 3. In implementation, exemplarily, the electronic device determines the generation time of the old picture collection (or old memory video) as time 1 through the time data of the recorded old picture collection (or old memory video), determines the current time (i.e., time 2), and when searching for pictures, filters out the pictures including the same person obtained by the electronic device in time period 1 between time 1 and time 2 from the picture library, and finally obtains picture collection 3.

[0473] In other embodiments, in the process of obtaining picture collection 3 according to picture 2, the electronic device may also search the picture library for pictures including the same person obtained by the electronic device in time period 2 between time 1 and the shooting of picture 2 (recorded as time 3) to obtain picture collection 3. In implementation, exemplarily, the electronic device determines the generation time of the old picture collection (or old memory video) as time 1 and the shooting time of picture 2 as time 3 through the time data of the recorded old picture collection (or old memory video). When searching for pictures, the pictures including the same person obtained by the electronic device in time period 3 between time 1 and time 3 are screened from the picture library, and finally picture collection 3 is obtained.

[0474] In step S1620, the electronic device updates the old picture collection according to picture collection 3.

[0475] Add all the pictures in picture collection 3 to the old picture collection, update the old picture collection, and obtain an updated picture collection, which includes the pictures in the old picture collection and the pictures in picture collection 3.

[0476] In step S1630 , the electronic device updates the old memory video according to the picture collection 3 .

[0477] For the sake of convenience of description, the number of pictures in picture collection 3 is recorded as N3, that is, picture collection 3 includes N3 pictures, and the number of pictures in the old memory video is recorded as N4, that is, the old memory video includes N4 pictures.

[0478] In some embodiments, the electronic device adds N3 pictures in picture collection 3 to the old memory video to obtain an updated memory video.

[0479] In other embodiments, considering that the number of pictures in the memory video is too large and affects the user experience, the number of pictures in the updated memory video is made less than or equal to N1 as much as possible.

[0480] Exemplarily, the electronic device updates the old memory video according to the sum of the number N3 of pictures in the picture collection 3 and the number N4 of pictures in the old memory video.

[0481] When the sum of N3+N4 is less than or equal to N2, the electronic device adds all pictures in picture collection 3 to the old memory video to obtain an updated memory video, wherein the number of pictures in the updated memory video is less than or equal to N1.

[0482] For example, N2=50, N3=20, N4=25, N3+N4=45<50, therefore, all 20 pictures in picture collection 3 are added to the old memory video, and the number of pictures in the updated memory video is equal to 45, which is less than 50.

[0483] When the sum of N3+N4 is greater than N2, the electronic device adds N3 pictures in picture collection 3 to the old memory video, and deletes N5 pictures from the memory video to obtain an updated memory video, N5=N3+N4-N2. The number of pictures in the updated memory video is equal to N2, that is, the updated memory video includes N2 pictures.

[0484] For example, N2=50, N3=20, N4=50, then N5=N3+N4-N2=20, where N3+N4=70>50. Therefore, the electronic device adds 20 pictures in picture collection 3 to the old memory video and deletes 20 pictures from the memory video. In this way, the number of pictures in the updated memory video is equal to 50.

[0485] When deleting N5 pictures in a memory video, for example, the N5 pictures with the worst aesthetic scores among the N4 pictures in the old memory video can be deleted, and pictures other than the N5 pictures among the N4 pictures are retained, wherein the aesthetic scores of the pictures other than the N5 pictures among the N4 pictures are higher than those of the N5 pictures.

[0486] In some embodiments, the updated recollection video includes picture 2.

[0487] It can be understood that the user operates Picture 2 to recall related people while browsing Picture 2, which means that the user likes Picture 2 more or Picture 2 can evoke the user's memories more strongly. Therefore, adding Picture 2 to the updated memory video can meet user needs and improve user experience.

[0488] In other embodiments, in the embodiment where the updated memory video includes Picture 2, the cover picture of the updated memory video can be Picture 2, or it can be the cover picture of the old memory video (for example, Picture 1), without any limitation.

[0489] In one example, the electronic device may use the picture with a higher aesthetic score as the cover picture of the updated memory video based on the aesthetic scores of Picture 2 and the cover picture of the old memory video (eg, Picture 1).

[0490] In another example, the electronic device replaces the cover picture of the updated memory video with Picture 2.

[0491] In another example, the electronic device does not change the cover image of the memory video, and still uses the cover image of the old memory video as the cover image of the updated memory video.

[0492] Fig.17 It is another set of GUIs provided in an embodiment of the present application, illustrating the GUI before updating the old memory video and the GUI after updating the old memory video. Fig.17 (a) shows the GUI before updating the old memory video. Fig.17 (b) in the figure shows the GUI after updating the old memory video.

[0493] refer to Fig.17 The GUI in (a) in the figure is a GUI for displaying memory videos in the interface of the "Memories" category. The GUI displays a portion of all the memory videos already in the mobile phone. The user performs an operation such as sliding up on the display interface. In response to the user operation, the display interface can scroll to display another portion of the memory videos that are not displayed. The old memory video is a memory video with the theme of "Old Friends Gathering", which is located at the bottom of the display interface. The cover picture is picture 1, including the user himself (Xiao Mei), friends "Xiao Li" and "Xiao Hong".

[0494] refer to Fig.17 In the GUI in (a), for the instantly updated memory video with the theme of "getting together with old friends", the memory video with this theme is displayed at the front position in the interface of the "Memories" category. Since it is an instantly updated memory video, the probability of users viewing it will be higher. Therefore, placing the instantly updated memory video in the first position of the interface can avoid searching for the newly generated memory video through operations such as sliding operations, which is very convenient for users to view. In implementation, for the instantly updated memory video, the mobile phone inserts the instantly updated memory video in front of all the memory videos, and moves the remaining memory videos back in sequence according to the existing order. In addition, the cover image in the updated memory video is also changed from the original image 1 to image 2.

[0495] Fig.18 1 is a schematic flow chart of a method 1800 for generating a memory video provided in an embodiment of the present application. The method 1800 is described in combination with the above methods 1100, 1300 and 1400.

[0496] In step S1810, the electronic device displays a first display interface, where the first display interface includes a first picture, and the first picture includes a plurality of characters.

[0497] Exemplarily, the first display interface is an interface of a gallery application.

[0498] Exemplarily, the first picture is any picture already in the electronic device, which may be a previously stored picture, or a picture taken instantly or obtained through other means, for example, a picture obtained by Bluetooth transmission with other electronic devices, or a picture downloaded from a social application.

[0499] For example, reference Figure 3 In (a) and (b), the mobile phone opens the gallery application and displays the main interface of the gallery application. The user wants to view the picture P1 (corresponding to the first picture) and clicks the picture P1. In response to the user's operation of clicking the picture P1, the mobile phone displays the following Figure 3 The GUI shown in (c) in FIG. 1 (corresponding to the first display interface) displays an enlarged picture P1, which includes three characters.

[0500] In step S1820, the electronic device displays a second display interface in response to the user's first operation on the first picture, where the second display interface includes a memory entrance area.

[0501] In the implementation, the user performs a first operation on the first picture, the electronic device detects the first operation, and displays the second display interface in response to the first operation.

[0502] Exemplarily, the user's operation on the first picture is any operation that can trigger the recall function, and the present application embodiment does not impose any limitation thereon. Based on the operation, the electronic device continues to perform subsequent steps to generate a picture collection and a recall video, thereby realizing the recall function of the electronic device.

[0503] In one example, the first operation may be a sliding operation on the first picture, and the sliding operation may be a sliding operation in any direction. For example, the sliding operation may be as follows: Figure 3 The sliding operation may be a downward sliding operation, a horizontal sliding operation, or the like.

[0504] In other examples, the first operation may also be, for example, a long press operation, a double click operation, a single click operation, a two-finger press operation, etc.

[0505] The second display interface includes a memory entrance area, which can provide users with an interface for generating memory functions. Users can generate picture collections and memory videos by performing operations in the memory entrance area.

[0506] As mentioned above, the electronic device may analyze the first image in various situations. If the first image has been analyzed, the electronic device may not need to repeatedly analyze the first image, thereby reducing the process of analyzing the image and thus reducing the processing time. If the first image has not been analyzed, the first image is analyzed instantly in response to the first operation.

[0507] For step S1820, in some embodiments, the electronic device responds to the first operation by analyzing the first image when the first image has not been analyzed, and obtains an analysis result, wherein the analysis result is used to indicate that the first image includes a person; the electronic device responds to the analysis result by displaying the second display interface.

[0508] In implementation, the electronic device may first determine whether the first picture has been analyzed in response to the first operation, analyze the first picture if it is determined that the first picture has not been analyzed, and display the second display interface if it is determined that the first picture includes a person.

[0509] The implementation process of this embodiment may correspond to the process of executing step S1104 through step S1103 in method 1100. For the specific description of this embodiment, please refer to the relevant description above and will not be repeated here. The second display interface here may correspond to the first interface above, and the memory entrance area corresponds to the first memory entrance area in the first interface.

[0510] Regarding step S1820, in some other embodiments, the electronic device displays the second display interface in response to the first operation when the first image has been analyzed to include a person and the first image does not exist in the existing recall video.

[0511] Exemplarily, the second display interface includes pictures of the multiple recognized characters.

[0512] In implementation, the electronic device may, in response to the first operation, first determine whether the first picture has been analyzed; if it is determined that the first picture has been analyzed and includes a person, determine whether the first picture exists in an existing memory video; if it is determined that the first picture does not exist in the existing memory video, display the second display interface.

[0513] The implementation process of this embodiment may correspond to the process of method 1100 executing step S1104 through step S1102 and step S1106. For the specific description of this embodiment, please refer to the relevant description above and will not be repeated here. The second display interface here may correspond to the first interface above, and the memory entrance area here corresponds to the first memory entrance area in the first interface.

[0514] In step S1830, the electronic device extracts features of at least one of the multiple characters in response to the user's second operation on the memory entrance area to obtain a feature result.

[0515] In the implementation, the user performs a second operation on the memory entrance area of ​​the second display interface, and the electronic device detects the second operation, and in response to the second operation, extracts features of at least one person among the multiple people in the first picture to obtain a feature result. The feature result is used to represent the at least one person, including feature information of the at least one person.

[0516] For example, the second operation may be an operation in which the user clicks on the memory entry area. In combination with the above, the second operation may correspond to the operation of the user on the first memory entry of the first interface in step S1105 above.

[0517] In an embodiment of the present application, after detecting the second operation, the electronic device may perform feature extraction on all characters in the first picture, or may further perform feature extraction on any character in the first picture based on the user's selection of the character, without any limitation.

[0518] For step S1830, in some embodiments, the electronic device extracts features from all the multiple characters in response to the second operation to obtain the feature results.

[0519] That is, after detecting the second operation, the electronic device does not need to perform any additional analysis on the first image or any other human-computer interaction operations, and the electronic device directly extracts features of all the people in the first image. In implementation, after detecting the second operation, the electronic device extracts features of all the people in the first image by default.

[0520] The implementation process of this embodiment may correspond to the relevant process of step S1111 of method 1100. For the specific description of this embodiment, please refer to the relevant description above and will not be repeated here.

[0521] For step S1830, in some other embodiments, the electronic device displays a fourth display interface in response to the second operation, and the fourth display interface includes the pictures of the multiple characters identified; the electronic device extracts features of the at least one character in response to the user selecting the picture of the at least one character among the multiple characters to obtain the feature result.

[0522] During implementation, the electronic device responds to the second operation and displays a fourth display interface for the user to select character pictures of multiple characters in the fourth display interface. The user selects a character picture of at least one character from the multiple characters. The electronic device detects the user operation and determines that the user wants to recall memories related to the at least one character. Therefore, feature extraction is performed on the at least one character to obtain feature results.

[0523] The implementation process of this embodiment may correspond to the process of extracting features in steps S1311a, S1311b and S1311c of method 1300. For the specific description of this embodiment, reference may be made to the above related description, which will not be repeated here. The fourth display interface here may correspond to the third interface above.

[0524] For step S1830, in some other embodiments, in step S1820 before step S1830, the electronic device displays the second display interface in response to the first operation, when the first picture has been analyzed to include a person and the first picture exists in an existing memory video, and the memory entry area of ​​the second display interface includes a first memory entry and a second memory entry, the first memory entry is used to display the existing memory video according to the user operation, and the second memory entry is used to generate a new memory video; and, in step S1830, the electronic device displays the fourth display interface in response to the user's operation on the second memory entry.

[0525] This embodiment may correspond to the process of extracting features by executing steps S1307, S1308b, S1311a, S1311b and S1311c through steps S1302 and S1306 in method 1300. For the specific description of this embodiment, please refer to the relevant description above and will not be repeated here. The second display interface here corresponds to the second interface above, the first memory entrance area and the second memory entrance area here correspond to the first memory entrance and the second memory entrance of the second interface above, respectively, and the fourth display interface here corresponds to the third interface above.

[0526] In addition, in the embodiment of the present application, considering the processing power of the electronic device, if the number of characters that need to be matched is too large, the electronic device may not be able to perform feature matching for too many characters. Therefore, a quantity threshold N1 can be set based on the processing power of the electronic device so that the number of characters matched by the electronic device is at most N1.

[0527] For step S1830, in some embodiments, in response to the second operation, when the number of people in the first picture is less than or equal to the first number threshold N1, the electronic device performs feature extraction on at least one of the multiple people to obtain the feature result, where N1 is an integer greater than 1.

[0528] That is to say, after detecting the user's second operation, the electronic device can first determine whether the number of characters in the first picture is greater than N1, and when it is less than or equal to N1, perform feature extraction on at least one character, wherein, corresponding to method 1100, feature extraction is performed on all of the multiple characters in the first picture, and corresponding to method 1300, feature extraction is performed on at least one character selected by the user in the first picture.

[0529] For step S1830, in some other embodiments, in response to the second operation, when the number of characters in the first picture is greater than the first number threshold N1, the electronic device displays a fifth display interface, and the fifth display interface includes character pictures of N1 characters among the multiple characters, where N1 is an integer greater than 1; in response to the user's operation of selecting the character picture of at least one character among the N1 characters, the electronic device performs feature extraction on the at least one character to obtain the feature result.

[0530] That is to say, after detecting the user's second operation, the electronic device can first determine whether the number of characters in the first picture is greater than N1. If it is greater than N1, the fifth display interface is displayed, and the fifth display interface includes character pictures of N1 characters among the multiple identified characters. The user selects a character picture of at least one character from the N1 characters. The electronic device detects the user's operation of selecting the character picture of at least one character, and in response to the operation, performs feature extraction on the at least one character selected by the user.

[0531] In the step of the electronic device displaying the fifth display interface when the number of people in the first picture is greater than N1, exemplarily, the electronic device determines the top N1 people in terms of facial area proportion in the order of the facial area proportions of the multiple people from large to small; and displays the fifth display interface.

[0532] This embodiment may correspond to the process of extracting features in steps S1411a, S1411b and S1411c in method 1400. For a detailed description, reference may be made to the above related descriptions, which will not be repeated here. The fifth display interface here corresponds to the fourth interface in method 1400.

[0533] In step S1840, the electronic device performs an image search based on the feature result to obtain a first image collection, wherein each image in the first image collection includes a person that matches the at least one person.

[0534] During implementation, the electronic device searches for pictures including characters that match at least one character in the first picture based on the feature results to obtain a first picture collection, so that each picture in the first picture collection includes characters that match the at least one character.

[0535] When the at least one character is all the characters in the first picture by default of the electronic device, this step may correspond to step S1111 in the above method 1100, and when the at least one character is a character selected from multiple characters in the first picture based on user operation, this step may correspond to step S1311c in the above method 1300, or, to step S1411c in the above method 1400. For specific description, please refer to the relevant description above, which will not be repeated here. The first picture collection here corresponds to the picture collection 1 above.

[0536] In step S1850, the electronic device generates a first recollection video based on the first picture collection, and the first recollection video includes at least part of the pictures in the first picture collection.

[0537] Exemplarily, the cover picture of the first recollection video is the first picture.

[0538] In the embodiment of the present application, taking into account the user's experience of playing the memory video, if the number of pictures in the memory video is too large, it will consume the user's time and cause problems such as aesthetic fatigue, and the user's experience of enjoying the memory video will not be very good. Therefore, a second quantity threshold N2 can be set to make the number of pictures in the generated memory video as appropriate as possible, so that the user can better experience the wonderful process of video playback.

[0539] For step S1850, when the number of pictures in the first picture collection is less than or equal to the second number threshold N2, the electronic device determines all pictures in the first picture collection as pictures of the first recall video, where N2 is an integer greater than 1.

[0540] That is to say, in the case where the number of pictures in the first picture collection is less than or equal to the second number threshold N2, the pictures in the first recollection video are all the pictures in the first picture collection.

[0541] For a detailed description of this situation, please refer to the relevant description of step S1115, which will not be repeated here.

[0542] For step S1850, when the number of pictures in the first picture collection is greater than N2, the electronic device determines a second picture collection based on the first picture collection; and the electronic device generates the first recall video based on the second picture collection.

[0543] This situation may correspond to step S1113 and step S1114 in method 1100, and reference may be made to the relevant description above.

[0544] Regarding the process of determining the second picture collection based on the first picture collection, in some embodiments, the electronic device determines the second picture collection from the first picture collection based on the generation time of all pictures in the first picture collection.

[0545] In one example, when the number M of time periods in which the generation time of all pictures in the first picture collection is distributed is greater than or equal to N2, the electronic device selects a picture from the first picture collection in each of the M time periods to obtain the second picture collection, and the second picture collection includes M pictures, where M is an integer greater than or equal to 1.

[0546] This embodiment may correspond to the implementation process of method 1 (ie, step S32) in step S1113 above. For the specific description, reference may be made to the relevant description above and will not be repeated here.

[0547] In combination with the above embodiment, since the second picture collection includes M pictures, M is greater than or equal to 1, therefore, in the step of generating the first memory video according to the second picture collection, the electronic device exemplarily selects N2 pictures from the second picture collection, and exemplarily, the electronic device selects the pictures with the top N2 aesthetic scores from the second picture collection in the order of high to low aesthetic scores to obtain the N2 pictures; the electronic device determines the N2 pictures as the pictures of the first memory video. In this way, the first memory video includes N2 pictures, which satisfies the user experience.

[0548] This embodiment may correspond to the implementation process of step S41 in the above situation A. For the specific description, please refer to the relevant description above and will not be repeated here.

[0549] In another example, when the number M of time periods in which the generation time of all pictures in the first picture collection is distributed is greater than or equal to N2, the electronic device selects a picture from the first picture collection in each of the N2 time periods that are earlier in the M time periods in chronological order from far to near, to obtain the second picture collection, wherein the second picture collection includes N2 pictures, and M is an integer greater than or equal to 1.

[0550] This embodiment may correspond to the implementation process of method 2 (ie, step S33) in step S1113 above. For the specific description, reference may be made to the relevant description above and will not be repeated here.

[0551] In combination with this embodiment, since the second picture collection includes N2 pictures, the electronic device determines the N2 pictures in the second picture collection as pictures in the first recollection video.

[0552] In another example, when the number M of time periods in which the generation time of all pictures in the first picture collection is distributed is less than N2, the electronic device selects at least one picture in each of the M time periods from the first picture collection to obtain the second picture collection, and the second picture collection includes N2 pictures, where M is an integer greater than or equal to 1.

[0553] Exemplarily, the M time periods include a first part of the time period and a second part of the time period, the time of the second part of the time period is earlier than the time of the first part of the time period, wherein each time period in the first part of the time period corresponds to a picture in the second picture collection, and each time period in the second part of the time period corresponds to multiple pictures in the second picture collection.

[0554] This embodiment may correspond to the implementation process of method 3 (ie, step S34) in step S1113 above. For the specific description, reference may be made to the relevant description above and will not be repeated here.

[0555] In combination with this embodiment, since the second picture collection includes N2 pictures, the electronic device determines the N2 pictures in the second picture collection as pictures in the first recollection video.

[0556] In an embodiment in which the electronic device determines the second picture collection from the first picture collection based on the generation time of all pictures in the first picture collection, in other embodiments, for example, the electronic device may also select a picture from each time period within the M time periods in which the generation time of all pictures in the first picture collection is distributed to obtain the second picture collection, and use the pictures in the second picture collection as pictures of the recall video.

[0557] In step S1860, the electronic device displays a third display interface, and plays the first recall video on the third display interface.

[0558] For example, when playing the first memory video, each frame of the picture can be played according to the timeline, so that the user can recall the past according to the time when the event occurred and deepen the memory. For example, the pictures can be played in the order from far to near in time, that is, the pictures with a farther timeline are played first, and then the pictures with a closer timeline are played.

[0559] In method 1800 , in the case where the first recollection video is generated based on method 1800 , method 1800 provides an embodiment of updating the first recollection video.

[0560] In some embodiments, method 1800 also includes: the electronic device obtains a third picture collection based on the second picture, the second picture includes the at least one character, each picture in the third picture collection includes a character that matches the at least one character, and the generation time of all pictures in the third picture collection is distributed in a first time period, and the first time period is later than the generation time of the first recall video; the electronic device updates the first recall video based on the third picture collection.

[0561] It should be understood that the third picture collection and the first memory video are memories associated with the same person, and the pictures in the third picture collection and the first memory video include at least one person, and the at least one person is a common person in the first picture and the second picture. Moreover, all pictures in the third picture collection are new pictures obtained by the electronic device within the first time period, and the first time period is later than the generation time of the last generation of the first memory video.

[0562] In the step of updating the first recall video according to the third picture collection, in one example, when the sum of the number N3 of pictures in the third picture collection and the number N4 of pictures in the first recall video is less than or equal to the second number threshold N2, the electronic device adds all pictures in the third picture collection to the first recall video to obtain the updated first recall video.

[0563] In another example, when the sum of the number N3 of pictures in the third picture collection and the number N4 of pictures in the first recall video is greater than the second quantity threshold N2, the electronic device deletes N5 pictures from the first recall video, and adds N3 pictures in the third picture collection to the first recall video to obtain an updated first recall video, and the updated first recall video includes N2 pictures, wherein N5=N3+N4-N2.

[0564] Exemplarily, the updated first recollection video includes the second picture.

[0565] The above-mentioned embodiment of updating the first memory video may correspond to the implementation process of updating the memory video in method 1600. For the specific description, please refer to the relevant description above and will not be repeated here. The third picture collection here may correspond to the picture collection 3 above, and the first memory video here may correspond to the old memory video above.

[0566] In the above embodiments, the GUI involved all exemplifies the process of a user triggering a recall function by, for example, swiping up on a currently browsed picture, that is, by swiping up on a picture, the electronic device displays an interface with a recall entry area, and a recall video is generated through the recall entry area.

[0567] Fig.19 is another set of GUIs provided in the embodiment of the present application, which is mainly different from the GUI shown above in that: Fig.19 The interface used to trigger the recall function is different. Through human-computer interaction, the recall function is triggered from the "recall" display interface.

[0568] Fig.19 It is another set of GUIs provided by an embodiment of the present application, which illustrates that the recall function is triggered from the "Recall" display interface, the mobile phone enters a display interface for the user to select a person of interest, a picture collection including pictures of the person selected by the user, and a GUI of the process of generating a recall video.

[0569] The user opens the "Gallery" application and enters the "Memories" display interface, which is displayed as follows Fig.19 The GUI shown in (a) in the reference Fig.19The GUI shown in (a) includes multiple existing memory videos. The user clicks the "+" control 191 in the upper right corner to display the following Fig.19 GUI shown in (b) in .

[0570] refer to Fig.19 The GUI shown in (b) in FIG. 1 includes a text box 192 and a character area 193. The text box 192 includes the text "You can select the character appearing in the picture to generate related memories" to prompt the user to select the character. The character area 193 includes multiple character pictures that the mobile phone has recognized, and each character picture includes a head portrait of a character.

[0571] Exemplarily, when the mobile phone is in charging mode, the mobile phone can automatically analyze the pictures in the gallery, identify the people in the pictures, and generate multiple pictures of the people. When the user enters the interface for selecting pictures of the people, the generated pictures of the people are displayed.

[0572] exist Fig.19 In the GUI of (b), the user selects three pictures of people in the third row. The mobile phone detects the user's selection of the three pictures of people and displays the following Fig.19 GUI shown in (c) in FIG.

[0573] refer to Fig.19 The GUI of (c) in FIG. 1 includes a character area 193, which includes multiple character pictures. A "√" is displayed in the lower right corner of the character picture selected by the user to indicate that the character picture has been selected. After the user selects the character picture, he clicks the "√" control 194 in the upper right corner. The mobile phone detects the user operation and displays the following Fig.19 GUI shown in (d).

[0574] refer to Fig.19 The GUI in (d) includes a character area 193 and a progress box 195. The progress box 195 is used to display the progress of generating the memory video. When the progress reaches 100%, a group of pictures including the three characters and the memory video are generated, and the display Fig.19 GUI shown in (e) in .

[0575] refer to Fig.19 The GUI in (e) of FIG. 1 shows a memory video generated in real time, and the memory video includes a plurality of pictures of three persons. After the memory video is generated, the mobile phone can automatically play each picture in the memory video.

[0576] Fig. 20 It is a schematic flowchart of a method 2000 for generating a recall video provided in an embodiment of the present application.

[0577] In step 2010, the electronic device displays a first display interface, where the first display interface includes a memory entrance.

[0578] Exemplarily, the first display interface is an interface in a gallery application for displaying recall videos.

[0579] refer to Fig.19 The GUI shown in (a) may correspond to the first display interface, including multiple existing memory videos, and the upper right corner of the GUI includes a memory entrance, for example, the memory entrance is an add control 191.

[0580] In step 2020, in response to the user's operation on the memory entrance, the electronic device displays a second display interface, and the second display interface includes character pictures of multiple characters.

[0581] The user performs an operation on the memory entrance, the electronic device detects the user operation, and displays a second display surface in response to the user operation. The second display interface includes character pictures of multiple characters that the electronic device has recognized, each character picture corresponds to a character, including a character's avatar.

[0582] For example, reference Fig.19 The GUI shown in (b) in the figure may correspond to the second display interface, and the GUI includes a text box 192 and a character area 193. The text box 192 includes the text "You can select the character appearing in the picture to generate related memories" to prompt the user to select the character. The character area 193 includes multiple character pictures that the mobile phone has recognized, and each character picture includes a head portrait of a character.

[0583] In step 2030, in response to the user selecting a picture of at least one of the multiple characters, the electronic device performs a picture search to obtain a first picture collection, each picture in the first picture collection includes characters that match the at least one character.

[0584] The user selects a picture of at least one character among the pictures of multiple characters displayed on the second display interface. After the electronic device detects the user's selection of the picture of at least one character, it performs a picture search to find pictures of characters that match the at least one character, thereby obtaining a first picture collection.

[0585] The process of the electronic device performing image search in this step is similar to the implementation process of step S1840 in method 1800, and reference may be made to the relevant description above, which will not be repeated here.

[0586] In step 2040, the electronic device generates a first recollection video based on the first picture collection, and the first recollection video includes at least part of the pictures in the first picture collection.

[0587] For the specific description of this step, please refer to the relevant description of step 1850 in method 1800, which will not be repeated here.

[0588] In step 2050, the electronic device displays a third display interface, and plays the first recall video on the third display interface.

[0589] Fig.21 is another set of GUIs provided in the embodiment of the present application, and Fig.19 The difference is that for pictures that have not been analyzed by the mobile phone, a function of timely analyzing pictures is provided, so that users can select the characters in the pictures for timely analysis, which has better flexibility and user experience.

[0590] The user opens the "Gallery" application and enters the "Memories" display interface, which is displayed as follows Fig.21 The GUI shown in (a) in the reference Fig.21 The GUI shown in (a) includes multiple existing memory videos. The user clicks the "+" control 211 in the upper right corner to display the following Fig.21 GUI shown in (b) in .

[0591] refer to Fig.21 The GUI shown in (b) in the figure includes a text box 212, a character area 213, and an add control 214 for adding pictures. The text box 212 includes the text "You can select the characters appearing in the picture to generate related memories" to prompt the user to perform a selection operation on the character. The character area 213 includes multiple character pictures that the mobile phone has recognized, each character picture includes a head portrait of a character, and the user can select any character in the character area 213. The mobile phone detects the user's operation of selecting a character and generates a picture collection including the character selected by the user and a memory video, for example, through human-computer interaction, displaying, for example Fig.19 The GUIs shown in (b), (c) and (d) in FIG.

[0592] Since the character area 213 only displays the character pictures of the characters that the mobile phone has recognized, when the user wants to select a character picture that is not in the character area 213 (in fact, the mobile phone has not analyzed the relevant pictures in time), the user can click the add control 214 to display the following. Fig.21 GUI shown in (c) in FIG.

[0593] refer to Fig.21 The GUI in (c) includes a "select picture" selection box and a "cancel" selection box. When the user clicks the "select picture" control, the following is displayed: Fig.21 GUI shown in (d).

[0594] refer to Fig.21The GUI in (d) in the figure shows some pictures in the gallery. All pictures in the gallery can be scrolled up and down by swiping up or down. The user can select any picture in the gallery. The mobile phone detects the user's operation, analyzes the picture selected by the user, and displays the recognized person picture in the person area 213 for the user to select. For example, the user selects one of the pictures, which includes three people. After the mobile phone analyzes the picture and recognizes the three people, it displays the following picture: Fig.21 GUI shown in (e) in .

[0595] refer to Fig.21 The GUI in (e) includes a person area 213 and an add control 214 for adding pictures. New person pictures that were not previously recognized in time are added to the person area 213, for example, the three person pictures in the last row of the person area 213. The user selects the newly added person picture, and a "√" is displayed in the lower right corner of the person picture selected by the user to indicate that the person picture has been selected. After the user selects the person picture, he clicks the "√" control 215 in the upper right corner. The mobile phone detects the user operation and can display the following Fig.21 GUI shown in (f) in .

[0596] refer to Fig.21 The GUI in (f) includes a character area 213 and a progress box 216. The progress box 216 is used to display the progress of generating the memory video. When the progress reaches 100%, a group of pictures including the three characters and the memory video are generated, and the display Fig.21 GUI shown in (g).

[0597] refer to Fig.21 The GUI in (g) of FIG. 1 shows a memory video generated in real time, and the memory video includes a plurality of pictures of three persons. After the memory video is generated, the mobile phone can automatically play each picture in the memory video.

[0598] Above, combined Figures 1 to 21 , the method for generating a memory video provided by the embodiment of the present application is described in detail, and the following will be combined with Figure 22 to Figure 23 , describe in detail the device and electronic device for generating recall videos provided according to the embodiments of the present application.

[0599] Fig. 22 2 is an exemplary block diagram of an apparatus 2200 for generating a memory video provided in an embodiment of the present application. The apparatus 2200 is an electronic device, or a chip in an electronic device, and the apparatus 2200 includes: a processing unit 2210.

[0600] In some implementations, the apparatus 2200 is used to execute the processes and steps corresponding to the electronic device in the above method 1800. The processing unit 2210 is used to execute the following steps:

[0601] Controlling the display screen to display a first display interface, wherein the first display interface includes a first picture, and the first picture includes a plurality of characters;

[0602] In response to a first operation of the user on the first picture, controlling the display screen to display a second display interface, wherein the second display interface includes a memory entrance area;

[0603] In response to a second operation of the user on the memory entrance area, extracting features of at least one of the multiple characters to obtain a feature result;

[0604] Performing image search according to the feature result to obtain a first image collection, wherein each image in the first image collection includes a person that matches the at least one person;

[0605] generating a first recollection video according to the first picture collection, wherein the first recollection video includes at least part of the pictures in the first picture collection;

[0606] The display screen is controlled to display a third display interface, and the first recollection video is played on the third display interface.

[0607] It should be understood that the processing unit 2210 can be used to execute each step performed by the electronic device in method 1800. For specific descriptions, please refer to the relevant descriptions above and will not be repeated here.

[0608] In some other implementations, the apparatus 2200 is used to execute the processes and steps corresponding to the electronic device in the above method 2000. The processing unit 2210 is used to execute the following steps:

[0609] Controlling the display screen to display a first display interface, wherein the first display interface includes a memory entrance;

[0610] In response to the user's operation on the memory entrance, controlling the display screen to display a second display interface, the second display interface including character pictures of a plurality of characters;

[0611] In response to a user selecting a character picture of at least one character among the multiple characters, performing a picture search to obtain a first picture collection, wherein each picture in the first picture collection includes characters that match the at least one character;

[0612] generating a first recollection video according to the first picture collection, wherein the first recollection video includes at least part of the pictures in the first picture collection;

[0613] The display screen is controlled to display a third display interface, and the first recollection video is played on the third display interface.

[0614] In the embodiments of the present application, Fig. 22 The device may also be a chip or a chip system, such as a system on chip (SoC).

[0615] Fig.23 2 is a schematic structural diagram of an electronic device 2300 provided in an embodiment of the present application. The electronic device 2300 is used to execute the corresponding steps and / or processes in the above method embodiment.

[0616] The electronic device 2300 includes a processor 2310, a transceiver 2320, and a memory 2330. The processor 2310, the transceiver 2320, and the memory 2330 communicate with each other through an internal connection path, and the processor 2310 can implement the functions of the processor 2310 in various possible implementations of the electronic device 2300. The memory 2330 is used to store instructions, and the processor 2310 is used to execute the instructions stored in the memory 2330, or in other words, the processor 2310 can call these stored instructions to implement the functions of the processor 2310 in the electronic device 2300.

[0617] Optionally, the memory 2330 may include a read-only memory and a random access memory, and provide instructions and data to the processor. A portion of the memory may also include a non-volatile random access memory. For example, the memory may also store information about the device type. The processor 2310 may be used to execute instructions stored in the memory, and when the processor 2310 executes instructions stored in the memory, the processor 2310 is used to execute the various steps and / or processes of the above-mentioned method embodiment corresponding to the network device or the terminal device.

[0618] In some implementations, the electronic device 2300 is used to execute the processes and steps corresponding to the electronic device in the above method 1800. The processor 2310 is used to execute the following steps:

[0619] Controlling the display screen to display a first display interface, wherein the first display interface includes a first picture, and the first picture includes a plurality of characters;

[0620] In response to a first operation of the user on the first picture, controlling the display screen to display a second display interface, wherein the second display interface includes a memory entrance area;

[0621] In response to a second operation of the user on the memory entrance area, extracting features of at least one of the multiple characters to obtain a feature result;

[0622] Performing image search according to the feature result to obtain a first image collection, wherein each image in the first image collection includes a person that matches the at least one person;

[0623] generating a first recollection video according to the first picture collection, wherein the first recollection video includes at least part of the pictures in the first picture collection;

[0624] The display screen is controlled to display a third display interface, and the first recollection video is played on the third display interface.

[0625] In some other implementations, the electronic device 2300 is used to execute the processes and steps corresponding to the electronic device in the above method 2000. The processor 2310 is used to execute the following steps:

[0626] Controlling the display screen to display a first display interface, wherein the first display interface includes a memory entrance;

[0627] In response to the user's operation on the memory entrance, controlling the display screen to display a second display interface, the second display interface including character pictures of a plurality of characters;

[0628] In response to a user selecting a character picture of at least one character among the multiple characters, performing a picture search to obtain a first picture collection, wherein each picture in the first picture collection includes characters that match the at least one character;

[0629] generating a first recollection video according to the first picture collection, wherein the first recollection video includes at least part of the pictures in the first picture collection;

[0630] The display screen is controlled to display a third display interface, and the first recollection video is played on the third display interface.

[0631] It should be understood that the specific process of each device executing the corresponding steps in the above methods has been described in detail in the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0632] It should be understood that in the embodiments of the present application, the processor of the above-mentioned device may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0633] In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in a processor or an instruction in the form of software. The steps of the method disclosed in conjunction with the embodiment of the present application can be directly embodied as a hardware processor for execution, or a combination of hardware and software units in a processor for execution. The software unit can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor executes the instructions in the memory, and completes the steps of the above method in conjunction with its hardware. To avoid repetition, it is not described in detail here.

[0634] The embodiment of the present application provides a computer program product, when the computer program product is run on a terminal device, the terminal device executes the technical solution in the above embodiment. Its implementation principle and technical effect are similar to those of the above method-related embodiments, and will not be repeated here.

[0635] The embodiment of the present application provides a readable storage medium, the readable storage medium contains instructions, when the instructions are executed in a terminal device, the terminal device executes the technical solution of the above embodiment. The implementation principle and technical effect are similar, and will not be repeated here.

[0636] The embodiment of the present application provides a chip, the chip is used to execute instructions, when the chip is running, the technical solution in the above embodiment is executed. The implementation principle and technical effect are similar, and will not be repeated here.

[0637] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a high-density digital video disc (DVD)), or a semiconductor medium (eg, a solid state disk (SSD)).

[0638] It should be understood that the "embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, the various embodiments in the entire specification do not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application.

[0639] It should also be understood that in the present application, "when", "if" and "if" all mean that the UE or base station will take corresponding actions under certain objective circumstances. It is not a time limit, and it does not require the UE or base station to make judgments when implementing it, nor does it mean that there are other limitations.

[0640] A person skilled in the art may understand that the various numerical numbers such as first and second involved in the present application are only used for the convenience of description and are not used to limit the scope of the embodiments of the present application, and also indicate the order of precedence.

[0641] In this application, elements expressed in the singular are intended to mean "one or more" rather than "one and only one", unless otherwise specified. In this application, "at least one" is intended to mean "one or more", and "more than one" is intended to mean "two or more", unless otherwise specified.

[0642] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that there may be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. A can be singular or plural, and B can be singular or plural.

[0643] In this document, the term "at least one of..." or "at least one of..." means all or any combination of the listed items. For example, "at least one of A, B, and C" may mean: A exists alone, B exists alone, C exists alone, A and B exist at the same time, B and C exist at the same time, and A, B, and C exist at the same time, where A may be singular or plural, B may be singular or plural, and C may be singular or plural.

[0644] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0645] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0646] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0647] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0648] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0649] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: various media that can store program codes, such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks or optical disks.

[0650] The same or similar parts between the various embodiments in this application can refer to each other. In the various embodiments in this application, and the various implementation methods / implementation methods / implementation methods in each embodiment, if there is no special explanation and logical conflict, the terms and / or descriptions between different embodiments and the various implementation methods / implementation methods / implementation methods in each embodiment are consistent and can be referenced to each other. The technical features in different embodiments and the various implementation methods / implementation methods / implementation methods in each embodiment can be combined to form new embodiments, implementation methods, implementation methods, or implementation methods according to their inherent logical relationships. The above-described implementation methods of this application do not constitute a limitation on the scope of protection of this application.

[0651] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims. In short, the above is only a preferred embodiment of the technical solution of the present application, and is not used to limit the protection scope of the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. A method for generating a memory video, characterized in that: include: Display a first display interface, wherein the first display interface includes a first picture, and the first picture includes a plurality of characters; In response to a first operation of the user on the first picture, displaying a second display interface, wherein the second display interface includes a memory entrance area; In response to a second operation of the user on the memory entrance area, extracting features of at least one of the multiple characters to obtain a feature result; Performing image search according to the feature result to obtain a first image collection, wherein each image in the first image collection includes a person that matches the at least one person; generating a first recollection video according to the first picture collection, wherein the first recollection video includes at least part of the pictures in the first picture collection; A third display interface is displayed, and the first recollection video is played on the third display interface.

2. The method according to claim 1, characterized in that: In response to the second operation of the user on the memory entrance area, extracting features of at least one of the multiple characters to obtain feature results includes: In response to the second operation, displaying a fourth display interface, wherein the fourth display interface includes the recognized character pictures of the plurality of characters; In response to a user selecting a character picture of at least one character among the multiple characters, feature extraction is performed on the at least one character to obtain the feature result.

3. The method according to claim 2, characterized in that The displaying of a second display interface in response to a first operation of the user on the first picture includes: In response to the first operation, when the first picture has been analyzed to include a person and the first picture exists in an existing memory video, the second display interface is displayed, the memory entry area of ​​the second display interface includes a first memory entry and a second memory entry, the first memory entry is used to display the existing memory video according to the user operation, and the second memory entry is used to generate a new memory video; and, The displaying a fourth display interface in response to the second operation includes: In response to the user's operation on the second memory entrance, the fourth display interface is displayed.

4. The method according to claim 1, characterized in that In response to the user's second operation on the memory entrance area, extracting features of at least one of the multiple characters to obtain feature results includes: In response to the second operation, feature extraction is performed on all the characters among the multiple characters to obtain the feature results.

5. The method according to any one of claims 1 to 4, characterized in that In response to the second operation of the user on the memory entrance area, extracting features of at least one of the multiple characters to obtain feature results includes: In response to the second operation, when the number of people in the first picture is less than or equal to a first number threshold N1, feature extraction is performed on at least one of the multiple people to obtain the feature result, where N1 is an integer greater than 1.

6. The method according to claim 1, characterized in that In response to the user's second operation on the memory entrance area, extracting features of at least one of the multiple characters to obtain feature results includes: In response to the second operation, when the number of characters in the first picture is greater than a first number threshold N1, a fifth display interface is displayed, wherein the fifth display interface includes character pictures of N1 characters among the plurality of characters, where N1 is an integer greater than 1; In response to a user selecting a character picture of at least one character among the N1 characters, feature extraction is performed on the at least one character to obtain the feature result.

7. The method according to claim 6, characterized in that In response to the second operation, when the number of people in the first picture is greater than a first number threshold N1, displaying a fifth display interface includes: In response to the second operation, when the number of people in the first picture is greater than a first number threshold N1, According to the order of the facial area ratios of the multiple characters from largest to smallest, determining the characters with the top N1 facial area ratios; The fifth display interface is displayed.

8. The method according to any one of claims 1 to 7, characterized in that Generating a first recall video according to the first picture collection includes: When the number of pictures in the first picture collection is less than or equal to a second number threshold N2, all pictures in the first picture collection are determined as pictures of the first recollection video, where N2 is an integer greater than 1; When the number of pictures in the first picture collection is greater than N2, determining a second picture collection according to the first picture collection; Generate the first recollection video based on the second picture collection.

9. The method according to claim 8, characterized in that The determining the second picture collection according to the first picture collection includes: The second picture collection is determined from the first picture collection according to the generation time of all pictures in the first picture collection.

10. The method according to claim 9, characterized in that The determining the second picture collection according to the first picture collection includes: When the number M of time periods in which the generation time of all pictures in the first picture collection is distributed is greater than or equal to N2, one picture is selected from the first picture collection in each of the M time periods to obtain the second picture collection, wherein the second picture collection includes M pictures, where M is an integer greater than or equal to 1.

11. The method according to claim 10, characterized in that Generating the first recollection video according to the second picture collection includes: Select N2 pictures from the second picture collection; The N2 pictures are determined as pictures of the first recollection video.

12. The method according to claim 11, characterized in that The selecting N2 pictures from the second picture collection includes: In descending order of aesthetic scores, the pictures with top N2 aesthetic scores are selected from the second picture collection to obtain the N2 pictures.

13. The method according to claim 9, characterized in that The determining the second picture collection according to the first picture collection includes: When the number M of time periods in which the generation time of all pictures in the first picture collection is distributed is greater than or equal to N2, from the first picture collection, one picture is selected in each of the N2 time periods that are earlier in the M time periods in time order from far to near, to obtain the second picture collection, wherein the second picture collection includes N2 pictures, and M is an integer greater than or equal to 1.

14. The method according to claim 9, characterized in that The determining the second picture collection according to the first picture collection includes: When the number M of time periods in which the generation time of all pictures in the first picture collection is distributed is less than N2, at least one picture is selected from the first picture collection in each of the M time periods to obtain the second picture collection, wherein the second picture collection includes N2 pictures, and M is an integer greater than or equal to 1.

15. The method according to claim 14, characterized in that The M time periods include a first time period and a second time period, wherein the time of the second time period is earlier than the time of the first time period, wherein each time period in the first time period corresponds to a picture in the second picture collection, and each time period in the second time period corresponds to multiple pictures in the second picture collection.

16. The method according to any one of claims 13 to 15, characterized in that Generating the first recollection video according to the second picture collection includes: Determine N2 pictures in the second picture collection as pictures in the first recall video.

17. The method according to any one of claims 1 to 16, characterized in that The displaying of a second display interface in response to a first operation of the user on the first picture includes: In response to the first operation, if the first picture has not been analyzed, analyzing the first picture to obtain an analysis result, where the analysis result is used to indicate that the first picture includes a person; In response to the analysis result, the second display interface is displayed.

18. The method according to any one of claims 1 to 16, characterized in that The displaying of a second display interface in response to a first operation of the user on the first picture includes: In response to the first operation, when the first picture has been analyzed to include a person and the first picture does not exist in the existing recall video, the second display interface is displayed.

19. The method according to claim 18, characterized in that The second display interface includes the recognized pictures of the multiple characters.

20. The method according to any one of claims 1 to 19, characterized in that The method further comprises: A third picture collection is obtained according to the second picture, wherein the second picture includes the at least one person, each picture in the third picture collection includes a person that matches the at least one person, and generation time of all pictures in the third picture collection is distributed in a first time period, and the first time period is later than generation time of the first recall video; The first recollection video is updated according to the third picture collection.

21. The method according to claim 20, characterized in that The updating of the first recollection video according to the third picture collection includes: When the sum of the number N3 of pictures in the third picture collection and the number N4 of pictures in the first recollection video is less than or equal to the second number threshold N2, all pictures in the third picture collection are added to the first recollection video to obtain an updated first recollection video.

22. The method according to claim 20, characterized in that The updating of the first recollection video according to the third picture collection includes: When the sum of the number N3 of pictures in the third picture collection and the number N4 of pictures in the first recollection video is greater than the second quantity threshold N2, N5 pictures are deleted from the first recollection video, and N3 pictures in the third picture collection are added to the first recollection video to obtain an updated first recollection video, and the updated first recollection video includes N2 pictures, where N5=N3+N4-N2.

23. The method according to any one of claims 20 to 22, characterized in that The updated first recollection video includes the second picture.

24. The method according to any one of claims 1 to 23, characterized in that The cover image of the first memory video is the first image.

25. The method according to any one of claims 1 to 24, characterized in that The first operation is a swiping operation.

26. The method according to any one of claims 1 to 25, characterized in that The first display interface is the interface of the gallery application.

27. A method for generating a memory video, characterized in that: The method comprises: Displaying a first display interface, wherein the first display interface includes a memory entrance; In response to the user's operation on the memory entrance, displaying a second display interface, the second display interface including character pictures of a plurality of characters; In response to a user selecting a character picture of at least one character among the multiple characters, performing a picture search to obtain a first picture collection, wherein each picture in the first picture collection includes characters that match the at least one character; generating a first recollection video according to the first picture collection, wherein the first recollection video includes at least part of the pictures in the first picture collection; The third display interface is displayed, and the first recollection video is played on the third display interface.

28. The method according to claim 27, characterized in that The first display interface is an interface in the gallery application for displaying memory videos.

29. An electronic device, characterized in that: include: Memory, for storing computer instructions; A processor, configured to call computer instructions stored in the memory to control the electronic device to execute the method described in any one of claims 1 to 26, or to execute the method described in claim 27 or 28.

30. A computer-readable storage medium, characterized in that: Used to store computer instructions, wherein the computer instructions are used to implement the method as described in any one of claims 1 to 26, or, used to implement the method as described in 27 or 28.

31. A chip, characterized in that: The chip comprises: Memory: used to store instructions; A processor, configured to call and execute the instructions from the memory, so that an electronic device equipped with the chip executes a method as described in any one of claims 1 to 26, or executes a method as described in 27 or 28.

Images