Video processing method and electronic equipment

Abstract

The invention provides a video processing method and electronic equipment, and is applied to the technical field of terminals. According to the embodiment of the invention, a function entrance for generating the portrait moment video through voice is provided, that is, the electronic equipment can actively generate the moment video related to the portrait specified by the user for the user through the function entrance in response to the voice instruction of the user, so that the demand that the user expects to view the picture related to the portrait is met; and the user experience is greatly improved.

Description

Technical Field

[0001] The present application relates to the field of electronic devices, and more specifically, to a video processing method and an electronic device. Background Art

[0002] With the continuous development of smart terminals, the shooting functions of smart terminals are becoming increasingly powerful. Users can take photos through smart terminals to record the good times of the past. The needs and experience of users when browsing photos are also constantly enhanced.

[0003] In some scenarios, when a user browses a photo that contains a person, the user will expect to view the historical memories of the person. However, in current smart terminals, when a user browses a photo containing a person, he or she may need to click on the person tag to view photos related to the person, but cannot actively generate videos related to the person or view photos related to the person, resulting in a poor user experience. Summary of the invention

[0004] In view of this, the present application provides a video processing method, an electronic device, a computer-readable storage medium, and a computer program product, which can actively generate a memory video related to a user-specified object through voice commands, greatly improving the user experience.

[0005] In a first aspect, a video processing method is provided, comprising:

[0006] In response to a first operation of the user, displaying a first interface, wherein the first interface includes a thumbnail of a first photo, and the first photo includes a first portrait;

[0007] In response to a user clicking on a thumbnail of the first photo, displaying a second interface for displaying a browsing page of the first photo;

[0008] In response to the user's operation of waking up the voice assistant function based on the first wake-up method, displaying a third interface, the third interface including a first window, the first window including a first entry, the first entry being used to represent a video of the moment when the first portrait was generated;

[0009] In response to the user's operation based on the first entry, a playback interface of a first video is displayed, wherein the first video includes the first photo and a second photo, and the second photo includes the first portrait.

[0010] The above method can be executed by an electronic device or a chip in an electronic device. The electronic device supports a voice assistant function. Based on the above technical solution, after receiving a voice command from a user, the electronic device (or a chip in an electronic device) can quickly generate a memory video of a portrait specified by the user, and automatically jump to the playback page of the memory video. Compared to a user flipping through multiple photos of a portrait through a portrait tag, the embodiment of the present application sets an entrance to the "Generate Moment" function, through which the electronic device responds to a voice command and actively generates a memory video related to the object specified by the user to meet the user's desire to view photos related to the portrait. The method of the embodiment of the present application will be faster and smarter, greatly improving the user experience.

[0011] Optionally, the operation of the user waking up the voice assistant function based on the first wake-up method includes any one of the following: inputting a wake-up command to wake up the voice assistant function; pressing a shortcut key for starting the voice assistant function to wake up the voice assistant function.

[0012] In some social occasions, such as parties, users will share past photos of family or friends by browsing photos. The method of generating a portrait memory video based on voice commands can provide users with topic appeals and help users quickly find common memories.

[0013] In some possible implementations, before displaying the playback interface of the first video, the method further includes:

[0014] In response to a first voice instruction input by a user, an eighth interface is displayed, the eighth interface including a fourth window, the fourth window displays text content corresponding to the first voice instruction, and the first voice instruction is input based on the first entry.

[0015] Therefore, in a scenario where a user is browsing photos in large images, in response to a first voice command input by the user based on a recommended first term, the electronic device can quickly generate a moment video of the user browsing the portraits in the photos based on the first voice command, thereby greatly improving the user experience.

[0016] In some possible implementations, when the first portrait is named as the first name, the first entry is an entry for the moment video of generating the first name. That is, if the first portrait has a corresponding name (such as the first name), then the entry for the moment video of generating the first name can be recommended to the user to guide the user to execute the moment video of generating the first name.

[0017] In some possible implementations, in response to the user's operation based on the first term, displaying a playback interface of the first video includes:

[0018] In response to the user clicking on the first entry, a playback interface of the first video is displayed.

[0019] Therefore, in a scenario where a user browses large images of photos, in response to the user clicking on the first entry, the mobile phone can quickly generate a first video.

[0020] Alternatively, in some possible implementations, when the name of the first portrait is not obtained, the first entry is an entry of the video at the moment when the portrait is generated.

[0021] In some possible implementations, after displaying the second interface, the method further includes:

[0022] In response to the user's operation of waking up the voice assistant function based on the second wake-up method, displaying a fourth interface, the fourth interface including a second window, the second window being used to display the content of the voice instruction corresponding to the second wake-up method;

[0023] Based on the voice command corresponding to the second wake-up method, the playback interface of the first video is displayed.

[0024] Therefore, when the voice assistant function is invoked through the second wake-up method, the content of the corresponding voice command can be directly displayed, and the voice command can be executed to generate the first video, thereby generating the first video more quickly.

[0025] In some possible implementations, before displaying the playback interface of the first video, the method further includes:

[0026] A fifth interface is displayed, wherein the fifth interface includes a progress bar control, and the progress bar control is used to display the progress of generating the first video.

[0027] That is to say, when generating a moment video of a portrait, if the number of photos including the first portrait is large or is affected by computing power, the process of generating the first video requires a certain waiting time. While waiting for the first video to load, a dynamic icon can be displayed to the user to indicate that the video is currently loading.

[0028] In some possible implementations, the first interface further includes a thumbnail of a second photo, and the second photo does not include a portrait; and the method further includes:

[0029] In response to a user clicking on a thumbnail of the second photo, displaying a sixth interface for displaying a browsing page of the second photo;

[0030] In response to the user's operation of waking up the voice assistant function based on the first wake-up method, the seventh interface is displayed, and the seventh interface includes a third window, and the third window is used to display the entries recommended by the voice assistant function. The third window does not include entries for generating portrait moment videos.

[0031] If the user is viewing photos that do not include portraits (for example, landscape photos, pet photos, etc.), when the voice assistant function is invoked through the first wake-up method, the voice interaction interface will not recommend entries for generating moment videos to the user.

[0032] For non-gallery application scenarios (for example, users are using desktop applications), the present application embodiment also provides an entry for generating moment videos based on the voice assistant function. Of course, for non-gallery application scenarios, the voice assistant function can also be aroused through the first wake-up method or the second wake-up method.

[0033] In some possible implementations, the method further includes:

[0034] In response to the user's operation, displaying a ninth interface, wherein the ninth interface is not used to display a photo browsing page in the gallery application;

[0035] In response to the user's operation of waking up the voice assistant function based on the second wake-up method, a tenth interface is displayed, wherein the tenth interface includes a fifth window, and the fifth window is used to display text content corresponding to the second voice instruction, the second voice instruction is an instruction to wake up the voice assistant function through the second wake-up method, and the second voice instruction is used to instruct the generation of a moment video of the second portrait;

[0036] Based on the second voice command, a playback interface of a second video is displayed, wherein the second video includes a third photo and a fourth photo, and both the third photo and the fourth photo include the second portrait.

[0037] For example, the ninth interface may be an interface of a desktop application. In response to the user waking up the voice assistant function through the second wake-up method (for example, the second voice command is an instruction for generating a moment video of the second portrait), the mobile phone may directly execute the content of the second voice command to generate a second video.

[0038] In some possible implementations, the method further includes:

[0039] In response to the user's operation, displaying an eleventh interface, wherein the eleventh interface is not used to display a photo browsing page in the gallery application;

[0040] In response to the user's operation of waking up the voice assistant function based on the first wake-up method, displaying a twelfth interface, the twelfth interface including a sixth window, the sixth window being used to display entries recommended by the voice assistant function, and the sixth window not including entries for generating a moment video;

[0041] In response to a third voice command input by a user, a thirteenth interface is displayed, the thirteenth interface includes a seventh window, the seventh window is used to display text content corresponding to the third voice command, and the third voice command is used to instruct the moment video of generating the third portrait;

[0042] Based on the third voice command, a playback interface of a third video is displayed, wherein the third video includes a fifth photo and a sixth photo, and both the fifth photo and the sixth photo include the third portrait.

[0043] For example, the eleventh interface may be an interface of a desktop application. In response to the user's operation of waking up the voice assistant function through the first wake-up method, the voice assistant interface is first displayed, and at this time, the interface does not have a recommended entry for generating a moment video. In response to the third voice command input by the user, the mobile phone executes the content of the third voice command and generates a third video.

[0044] In some possible implementations, the method further includes:

[0045] In response to a fourth voice command input by a user, a fourteenth interface is displayed, the fourteenth interface includes a seventh window, the seventh window includes a first control, a text entry corresponding to the fourth voice command, and a second entry, the fourth instruction is used to instruct the generation of a moment video of a fourth person portrait, and the second entry indicates that there is no album of the fourth person portrait;

[0046] In response to the user clicking the first control, a fifteenth interface is displayed, the fifteenth interface is used to display multiple portrait data in the gallery application, the fifteenth interface includes an eighth window, and the eighth window is used to prompt the user to select an album for naming;

[0047] In response to the user's operation on the portrait data of the fourth portrait, displaying a sixteenth interface, the sixteenth interface including a ninth window, the ninth window being used to input a name for the portrait;

[0048] In response to the user completing the operation of naming the portrait data of the fourth portrait, a seventeenth interface is displayed, wherein the seventeenth interface includes a ninth window, and the ninth window is used to prompt the user that the naming of the portrait data of the fourth portrait has been completed.

[0049] Therefore, when there is no album for the portrait in the gallery, you can reply to the user that no album for the portrait is found, and guide the user to go to the gallery application to generate an album for the portrait. For example, name a portrait album in the gallery application, generate an album for the portrait, and prepare for the subsequent generation of a moment video of the portrait.

[0050] In some possible implementations, before displaying the seventeenth interface, the method further includes:

[0051] Displaying an eighteenth interface, wherein the eighteenth interface includes a tenth window, wherein the tenth window includes a plurality of character relationship options and a second control;

[0052] Wherein, the display of the seventeenth interface includes:

[0053] In response to the user clicking the second control, the seventeenth interface is displayed.

[0054] Therefore, while naming the portrait album in response to the user's naming operation, the mobile phone can also provide character relationship options for the user to define their character relationships, making the portrait data richer.

[0055] In some possible implementations, the user's operation of waking up the voice assistant function based on the second wake-up method includes: waking up the voice assistant function through a breath wake-up method.

[0056] For the breath wake-up method, the electronic device can detect the user's action of lifting the phone through a motion sensor, and recognize the input voice operation through a microphone, and determine whether the user wants to use the voice assistant function based on the recognition results.

[0057] Therefore, by awakening the voice assistant function through breath awakening, after receiving the voice command, the electronic device awakens the voice assistant function based on the voice command and directly executes the content of the voice command, which can more quickly generate a moment video of the target portrait specified by the user, greatly improving the user experience.

[0058] In a second aspect, an electronic device is provided, comprising a unit for executing the method in any one of the implementations of the first aspect. The electronic device may be a terminal device or a chip in the terminal device. The electronic device comprises an input unit, a display unit, and a processing unit.

[0059] When the electronic device is a terminal device, the processing unit may be a processor, the input unit may be a communication interface, and the display unit may be a graphics processing module and a screen; the terminal device may also include a memory for storing computer program code, and when the processor executes the computer program code stored in the memory, the terminal device executes any one of the methods in the first aspect.

[0060] When the electronic device is a chip in a terminal device, the processing unit may be a logic processing unit inside the chip, the input unit may be an input interface, a pin or a circuit, etc., and the display unit may be a graphics processing unit inside the chip; the chip may also include a memory, which may be a memory inside the chip (for example, a register, a cache, etc.) or a memory located outside the chip (for example, a read-only memory, a random access memory, etc.); the memory is used to store computer program code, and when the processor executes the computer program code stored in the memory, the chip executes any one of the methods of the first aspect.

[0061] According to a third aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program code. When the computer program code is executed by an electronic device, the electronic device executes any one of the methods according to the first aspect.

[0062] According to a fourth aspect, a computer program product is provided, the computer program product comprising: a computer program code, when the computer program code is executed by an electronic device, the electronic device executes any one of the methods according to the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] Figure 1 is a schematic diagram of a hardware system of an electronic device applicable to the present application;

[0064] Figure 2 This is a schematic diagram of an interface for entering a gallery application provided by this application;

[0065] Figure 3 This is a schematic diagram of an interface for a voice assistant to execute a voice command provided by the present application;

[0066] Figure 4A This is a schematic diagram of an interface for generating a moment video based on a voice assistant provided by this application;

[0067] Figure 4B This is another example provided by the present application of generating a moment video based on a voice assistant interface schematic diagram;

[0068] Figure 4C This is a schematic diagram of an interface of a card showing a moment video on a moment page provided by the present application;

[0069] Figure 5 This is another example provided by the present application of generating a moment video based on a voice assistant interface schematic diagram;

[0070] Figure 6 This is a schematic diagram of an interface provided by the present application when a voice assistant does not recommend generating a moment video entry;

[0071] Figure 7 This is another example provided by the present application of generating a moment video based on a voice assistant interface schematic diagram;

[0072] Fig. 8A This is another example provided by the present application of generating a moment video based on a voice assistant interface diagram;

[0073] Figure 8B This is another example provided by the present application of generating a moment video based on a voice assistant interface diagram;

[0074] Fig. 9 This is a schematic diagram of an interface for naming a portrait album based on a voice assistant provided by the present application;

[0075] Fig.10 This is another example of an interface diagram for naming a portrait album provided by the present application;

[0076] Fig.11 This is an example flow chart of the method for generating a moment video provided by the present application;

[0077] Fig.12 is a schematic diagram of a software system of an electronic device suitable for the present application. DETAILED DESCRIPTION

[0078] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0079] In the embodiments of the present application, unless otherwise specified, “plurality” may mean two or more than two.

[0080] The embodiments of the present application can be applied to electronic devices. The electronic device has a gallery application installed and the electronic device supports an intelligent voice assistant function (for example, a voice assistant application is installed). The intelligent voice assistant function refers to: through voice interaction with the user, recognizing and responding to the user's voice command to execute the corresponding function.

[0081] It is understandable that the intelligent voice assistant function can also have other names, such as voice assistant, smart voice, smart assistant, voice assistant, etc.

[0082] In some embodiments of the present application, the electronic device may be a mobile phone, a smart screen, a tablet computer, a wearable electronic device, an in-vehicle electronic device, an augmented reality (AR) device, a virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a projector, and the like.

[0083] The following uses a mobile phone as an example. Figure 1 A schematic structural diagram of an electronic device 100 provided in an embodiment of the present application is shown. Figure 1 A hardware system of an electronic device suitable for the present application is shown.

[0084] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0085] It should be noted that Figure 1 The structure shown does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include Figure 1 More or fewer components than those shown, or the electronic device 100 may include Figure 1 A combination of some of the components shown, or the electronic device 100 may include Figure 1 Subassemblies of some of the components shown. Figure 1 The components shown may be implemented in hardware, software, or a combination of software and hardware.

[0086] The processor 110 may include one or more processing units. For example, the processor 110 may include at least one of the following processing units: an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and a neural-network processing unit (NPU). Different processing units may be independent devices or integrated devices.

[0087] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0088] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0089] In some embodiments, the processor 110 may include one or more interfaces. For example, the processor 110 may include at least one of the following interfaces: an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a SIM interface, and a USB interface.

[0090] In some embodiments, the processor 110 is used to call the display screen 194 to display a first interface in response to a first operation of the user, wherein the first interface includes a thumbnail of a first photo, and the first photo includes a first portrait; it is also used to call the display screen 194 to display a second interface in response to the user clicking on the thumbnail of the first photo, and the second interface is used to display a browsing page of the first photo; it is also used to call the display screen 194 to display a third interface in response to the user's operation of invoking the voice assistant function based on the first wake-up method, and the third interface includes a first window, and the first window includes a first entry, and the first entry is used to indicate a video at the moment when the first portrait is generated; it is also used to call the display screen 194 to display a playback interface of a first video in response to the user's operation based on the first entry, and the first video includes the first photo and the second photo, and the second photo includes the first portrait.

[0091] Optionally, in some embodiments, the processor 110 is also used to respond to the user's operation of invoking the voice assistant function based on the second wake-up method, call the display screen 194 to display a fourth interface, the fourth interface including a second window, and the second window is used to display the content of the voice instruction corresponding to the second wake-up method; based on the voice instruction corresponding to the second wake-up method, display the playback interface of the first video.

[0092] Figure 1 The connection relationship between the modules shown is only a schematic illustration and does not constitute a limitation on the connection relationship between the modules of the electronic device 100. Optionally, the modules of the electronic device 100 may also adopt a combination of multiple connection modes in the above embodiments.

[0093] The electronic device 100 can realize the display function through the GPU, the display screen 194 and the application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0094] The display screen 194 can be used to display images or videos. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini light-emitting diode (Mini LED), a micro light-emitting diode (Micro LED), a micro OLED (Micro OLED) or a quantum dot light emitting diode (QLED). In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0095] The electronic device 100 can realize the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194 and the application processor.

[0096] The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can perform algorithm optimization on the noise, brightness and color of the image. The ISP can also optimize the exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0097] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard red green blue (RGB), YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0098] Digital signal processors are used to process digital signals. In addition to processing digital image signals, they can also process other digital signals.

[0099] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0100] NPU is a processor that draws on the structure of biological neural networks, such as the transmission mode between neurons in the human brain to quickly process input information, and can also continuously self-learn. Through NPU, the electronic device 100 can realize intelligent cognition and other functions, such as image recognition, face recognition, voice recognition and text understanding.

[0101] The external memory interface 120 may be used to connect an external memory card, such as a secure digital (SD) card, to expand the storage capacity of the electronic device 100 .

[0102] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, and at least one application required for a function (for example, a sound playback function and an image playback function). The data storage area may store data created during the use of the electronic device 100 (for example, audio data and a phone book). In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as: at least one disk storage device, a flash memory device, and a universal flash storage (UFS). The processor 110 executes various processing methods of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0103] The electronic device 100 can implement audio functions, such as music playing and recording, through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor.

[0104] The touch sensor 180K is also called a touch control device. The touch sensor 180K can be set on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, which is also called a touch control screen. The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor 180K can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100 and set at a different position from the display screen 194.

[0105] The key 190 includes a power key and a volume key. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive a key input signal and implement a function related to the key input signal.

[0106] The technical solutions involved in the following embodiments can all be implemented in the electronic device 100 having the above hardware architecture.

[0107] For ease of understanding, the following embodiments of the present application will be described in detail with Figure 1 Taking the electronic device with the structure shown as an example, the video recording method provided in the embodiment of the present application is specifically described in combination with the figure and application scenarios.

[0108] This application will take the electronic device as a mobile phone, in which a camera application and a gallery application are installed as an example, and will introduce in detail the video processing method provided by this application.

[0109] The following combination Figure 2 Describe the application scenarios of the embodiments of the present application. Figure 2 , Figure 2 It is a schematic diagram of a graphical user interface (GUI) provided in an embodiment of the present application.

[0110] For example, Figure 2 As shown in (1), the screen display system of the mobile phone displays the current output interface content, and the interface content displays multiple applications (applications, Apps). The user can click the "Gallery" application icon 201 on the mobile phone desktop to instruct the mobile phone to open the gallery application, and the mobile phone displays as shown in Figure 2 The interface shown in (2).

[0111] For another example, the user can also input voice commands through voice control to open the gallery application, and the phone can also display Figure 2 The interface shown in (2).

[0112] For another example, when the mobile phone is running other applications, the user can also enter the gallery application through the multitasking interface. The embodiment of the present application does not specifically limit the method of entering the gallery application.

[0113] like Figure 2 As shown in (2), the gallery application interface includes different types of tabs, namely: photo page, album page, moment page and creation page (or named discovery page). The gallery application interface displays the photo page by default. The photo page is used to display all photos taken or saved by the user. The album page is used to display the albums corresponding to the classified and saved photos. The moment page is used to display the generated moment video. The creation page is used to freely create or puzzle based on the photos selected by the user.

[0114] Figure 2 (2) shows the interface of the photo page, which includes thumbnails of multiple photos. For example, the thumbnail of photo 202 (the portrait included is named "baby"), the thumbnail of photo 203 (the portrait included is not named), and the thumbnail of photo 204 (a landscape photo, not including a portrait). For any photo thumbnail in the interface, in response to the user clicking on the photo thumbnail, the mobile phone displays a large picture of the photo.

[0115] When the user clicks Figure 2 In response to the user clicking on the photo 202, the mobile phone interface displays the following: Figure 2 As shown in (3) in FIG. 202, the photo 202 includes a portrait of a person named "baby". Figure 2The interface shown in (3) includes options such as share, favorite, edit, delete, and more. If the user clicks on share, the phone will respond to the user clicking on delete by displaying the interface related to sharing photo 202; if the user clicks on favorite, the photo 202 can be added to the favorites folder; if the user clicks on edit, the photo 202 can be edited; if the user clicks on delete, the phone will respond to the user clicking on delete and delete the photo 202; if the user clicks on more, other operations on the photo 202 (such as moving, copying, adding notes, hiding, renaming, etc.) can be accessed. Figure 2 The interface shown in (3) also includes time information and a return control. The time information is used to display the shooting time of the photo 202. If the user clicks the return control, it will return to Figure 2 The interface shown in (2).

[0116] It should be understood that this is only Figure 2 The description is made by taking the example that the photo shown in (3) contains one portrait, but the embodiment of the present application is not limited thereto. In fact, the photo may contain two or more portraits.

[0117] When a user browses a photo containing a person's portrait (e.g., photo 202), the user wants to view historical photos related to the person's portrait. However, in the related art, the user cannot view the historical photos, or needs to return to the main interface of the gallery application, enter the album page or other pages, find the person's tag information, find the related person from the person's tag, and then view the photos related to the person, which is inconvenient.

[0118] In order to recommend a moment video related to the portrait to the user, the embodiment of the present application sets an entry for the "generate moment" function based on the intelligent voice assistant function. Based on this entry, by receiving a voice command issued by the user, the voice command is used to instruct the generation of a moment video of the target portrait, and the electronic device can actively generate a moment video of the target portrait for the user, which is more convenient and quick to operate.

[0119] In an embodiment of the present application, based on the intelligent voice assistant function (referred to as the voice assistant function), a function entrance of "generating moments" can be provided to users in different scenarios.

[0120] Before introducing the function entrance of providing "Generate Moments" in different scenarios through the voice assistant function, we will first briefly introduce how to enable the voice assistant function.

[0121] The embodiment of the present application does not specifically limit the method for enabling the voice assistant function.

[0122] In some embodiments, in response to a first operation or a first instruction from a user, a voice assistant function is turned on.

[0123] The first operation or the first instruction is used to trigger the voice assistant function of the electronic device. In other words, the first operation or the first instruction is used to trigger the voice assistant function to be awakened.

[0124] The first operation is a user pressing a shortcut key to wake up (or start) the voice assistant function, or the first operation is a user clicking on the screen of the mobile phone to start the voice assistant function.

[0125] For example, if the user has set in advance in the electronic device that the voice assistant function can be activated by long pressing the power button, then the mobile phone can respond to the user's long pressing of the power button to wake up the voice assistant function. It can be understood that the description here is based on the example of setting the power button as a shortcut key to invoke the voice assistant function, and the embodiments of the present application are not limited to this. In fact, the user can also invoke the voice assistant function through other physical keys. For example, the user can also invoke the voice assistant function by pressing the line control key of the headset connected to the electronic device.

[0126] In some embodiments, if a voice assistant application (e.g., smart voice, smart assistant, etc.) is installed in the electronic device, the mobile phone invokes the voice assistant function in response to the user's operation in the voice assistant application.

[0127] The specific content of the first instruction is not limited in the embodiment of the present application. The first instruction may be a wake-up word or a password word for waking up the voice assistant function. In some embodiments, if the electronic device pre-stores a wake-up word or a password word input by the user (for example, the wake-up word is "Hello, YOYO"), the mobile phone can respond to the voice password input by the user to wake up the voice assistant function. In other embodiments, if the electronic device supports breath wake-up, the user does not need to say the wake-up word, and directly says the voice interaction instruction to activate the voice assistant function and execute the content indicated by the voice interaction instruction. For example, the user's mouth close to the bottom of the mobile phone and says "Open Gallery" to wake up the voice assistant function and open the gallery application. The mobile phone can detect the action of the user lifting the mobile phone through the motion sensor, and recognize the operation of the input voice through the microphone, and determine whether the user wants to use the voice assistant function in combination with the recognition result. For example, assuming that the recognition result is: the distance at which the user lifts the mobile phone exceeds a certain distance threshold, and the voice instruction input by the user is received; at this time, based on the recognized result, it can be determined that the user needs to use the voice assistant function, that is, the voice assistant function can be aroused by the voice instruction input by the user, and the content of the voice instruction can be executed.

[0128] Figure 3 An example of an interface for executing a voice command is shown. In response to recognizing the voice command "Open Gallery" input by the user, the mobile phone interface displays the following Figure 3As shown in (1), the interface includes a window 301. Window 301 is used to display the content of the voice command recognized by the user, such as opening the gallery. It can be understood that in the case where the mobile phone supports the voice assistant awakening by breath, "open gallery" can be an instruction for waking up the voice assistant function.

[0129] Optionally, after the mobile phone recognizes the voice command of "open gallery", while opening the gallery application, it can also display the reply content to the user on the voice interaction interface. For example, in response to the voice command of "open gallery", the mobile phone interface displays the following Figure 3 The interface shown in (2). Figure 3 The interface shown in (2) includes a window 302, and the content in the window 302 is "OK." The window 302 is used to indicate that the voice command "open gallery" input by the user has been received, and the corresponding execution operation is being performed based on the voice command. It can be understood that after a preset time, the window 302 can automatically disappear, and the mobile phone displays the following Figure 3 The interface shown in (3).

[0130] Figure 3 The interface shown in (3) is similar to Figure 2 The interface shown in (2) is the same interface. For related descriptions, please refer to Figure 2 For the sake of brevity, the description of (2) is not repeated here. For example, in response to the user clicking on the photo 202, the mobile phone displays the following Figure 3 The interface shown in (4). Figure 3 The interface shown in (4) is similar to Figure 2 The interface is the same as that shown in (3). For related descriptions, please refer to Figure 2 The description of (3) is omitted here for the sake of brevity. It should be understood that Figure 3 The figure only shows an example of a wake-up voice instruction, and the embodiments of the present application are not limited to this.

[0131] In the embodiment of the present application, when the voice assistant function is turned on or awakened, in response to detecting the user's voice command, the mobile phone automatically generates a corresponding moment video. For example, the user can speak the name of the person for whom the moment video is to be generated into the mobile phone, and the mobile phone can automatically generate a corresponding memory video and present it to the user.

[0132] In some implementations, when the voice assistant function is turned on or awakened, if the current scene is recognized as a scene in which the user is browsing photos in large images in a gallery application, and the photos currently browsed by the user also include portraits, the mobile phone will recommend the entry of generating a portrait moment in the voice interaction interface (or the window of the voice assistant function that pops up) to prompt the user to generate a moment video of the current portrait.

[0133] Figure 4AAn example diagram of a GUI for generating moment videos according to an embodiment of the present application is shown. Figure 4A The interface shown in (1) is an example of an interface for waking up the voice assistant function when the user browses the photo 202. Figure 4A As shown in (1), the interface displays a large picture of photo 202. In addition, the voice assistant function of the mobile phone has been awakened (awakened by the first awakening method), that is, the interface also includes window 402. Window 402 can be understood as a voice interaction interface, which is used to display recommended entries to the user. Window 402 includes entry 401. The content of entry 401 is "Moment of generating baby".

[0134] The first wake-up method includes waking up the voice assistant function by a wake-up command (e.g., hello YOYO), or waking up the voice assistant function by pressing a button (e.g., long pressing the power button for 1 second). It should be noted that the content of entry 401 is generated based on the name of the portrait in the currently browsed photo 202 (or the name, title, name, etc., which can be added by the user). For example, Figure 4A The portrait in the photo shown in (1) is named "baby" in the gallery, so the content displayed in entry 401 is "the moment when baby was generated".

[0135] It is understandable that the names of the portraits in the photos may be pre-added by the user. For portraits without names, when recommending entries, the portraits without names may be generally referred to as "this person" or other general descriptions.

[0136] It is also understandable that if the name of the portrait included in the photo is recognized as other names, the entry content can also be adaptively adjusted, for example, according to the format of "the moment of generating...", the corresponding entry can be recommended to the user.

[0137] It can also be understood that, in addition to the entry 401, the window 402 may also include other recommended entries, such as tomorrow's weather, countdown, etc., which is not limited in the embodiment of the present application.

[0138] Based on entry 401 , the mobile phone can generate a moment video in response to a user manually clicking on entry 401 ; it can also generate a moment video in response to a user inputting a corresponding voice command based on the content of entry 401 .

[0139] In some embodiments, when a voice command of "generate baby's moment" input by a user is detected, in response to the voice command of "generate baby's moment" input by the user, the mobile phone can display the recognized voice in text form in the interface, for example, Figure 4AIn the interface shown in (2), the entry 403 is a text display of the voice command input by the user. After recognizing the voice command, the gallery application starts to analyze the photo data, searches for multiple baby photos, and generates a moment video using the multiple baby photos.

[0140] Optionally, in some embodiments, during the process of generating the moment video, the loading progress may be displayed to the user in real time, for example, Figure 4A The interface shown in (3) is the real-time progress of the baby's moment of generation. Figure 4A As shown in (3), the window 404 in the interface includes a loading progress bar, and the current progress is 48%. It can be understood that Figure 4A The progress bar shown in (3) is only an example description, and the embodiments of the present application are not limited thereto. In fact, other loading styles can also be displayed to the user.

[0141] Or, in some embodiments, if the user manually clicks Figure 4A In the entry 401 shown in (1), the mobile phone responds to the user clicking on the entry 401 and displays the interface Figure 4A The interface shown in (3) or Figure 4A The interface shown in (4).

[0142] Figure 4A (4) shows the playback page of the moment video related to the aforementioned portrait "baby". Figure 4A As shown in (4), the generated baby moment video, or moment play page, can be displayed in an immersive manner. Immersive display refers to a display method in which the picture fills the mobile phone screen.

[0143] The cover of the generated moment video contains text information and time information. The text information can be generated based on the photo. For example, the text of the photo can be the name corresponding to the portrait, or the name of the shooting location, etc. Or, optionally, the text information is text that is intelligently matched or intelligently generated based on the photo content (or picture information). Time information refers to the time when the moment is generated. The text information and time information are only displayed in the first frame. When the "Baby Moment Video" is played dynamically, other frames will no longer display the text information and the time information. The dynamic playback of "Baby Moment Video" can be understood as playing the photos used to generate the video in chronological order (for example, from the oldest to the most recent).

[0144] It should be noted that Figure 4A (4) shows the display of the first frame of the generated baby moment video, and it will not stay on this interface. In addition, in the subsequent playback process, other frames will not display the text information and the time information.

[0145] Optionally, the generated moment video may also include music information, which may be music automatically matched based on the content in the photo.

[0146] It should be noted that Figure 4A The figure shows an example of the interface for generating a moment video when the voice assistant function is awakened by the first awakening method. However, for the second awakening method, that is, the breath awakening method (for example, the user raises the phone and speaks a voice command to the bottom of the screen), the phone will directly display the content of the voice command entered by the user. For example, Figure 4B Shown in the figure is an example interface diagram for generating a moment video when the voice assistant function is awakened by the second awakening method.

[0147] Figure 4B (1) shows an example of an interface for waking up the voice assistant function through the second wake-up method. Figure 4B As shown in (1), a large picture of photo 202 is displayed in the interface. In addition, the voice assistant function of the mobile phone has been awakened (awakened by the second awakening method), that is, the interface also includes entry 405. Entry 405 is the content of the voice instruction input by the recognized user. The content of entry 405 is "The moment to generate the baby". It should be noted that when the voice assistant function is awakened by the breath awakening method, the voice instruction corresponding to entry 405 not only represents the content of the voice instruction itself input by the user, but also has the function of waking up the voice assistant function of the mobile phone.

[0148] Optionally, after receiving the voice command input by the user, the mobile phone can play the reply command to the user and display the content of the reply command on the interface at the same time. Figure 4B The interface shown in (2) includes an entry 406, and the content of the entry 406 is "OK". Figure 4B (3) shows the loading interface of the generated moment video, which includes a progress bar 407. Figure 4B (4) shows the playback interface of the generated moment video. It can be understood that Figure 4B For the description of the interface shown in (3), please refer to Figure 4A Description of (3); Figure 4B For the description of the interface shown in (4), please refer to Figure 4A The description of (4) is not repeated here for the sake of brevity.

[0149] In the embodiment of the present application, the card corresponding to the generated moment video can be displayed on the moment page of the gallery application for the user to view. Figure 4C The card describing the generated moment video is displayed in the moment page. For example, by clicking Figure 4CIn (1), the "Moment" control switches from the photo page to the moment page, and displays the following Figure 4C The interface shown in (2) is shown in the figure. Figure 4C The interface shown in (2) includes a first display area, a second display area, and a search bar. The first display area is used to display the card of the latest moment video generated, for example, card 408 is a moment video generated on February 14, 2022; the second display area is used to display the card of the moment video generated at another time (for example, a time later than February 14, 2022). Card 408 can be Figure 4A or Figure 4B The "Baby's Childhood" moment video generated in.

[0150] The card of the moment video generated by the embodiment of the present application can be displayed in the first display area or the second display area, and the specific display area depends on the time when the moment video is generated; if it is the latest generated moment video, it can be displayed in the first display area; if it is not the latest generated moment video, it is not displayed in the first display area. The search bar is used for the user to enter the search content (including but not limited to photos, people, places, etc.) to find the desired photo or video based on the search content.

[0151] Above Figure 4A or Figure 4B In the following, the portraits in the photos are described as having corresponding names. In some scenarios, some portraits do not have names in the gallery (or the user has not added names to the portraits). Figure 5 Give a description.

[0152] Figure 5 (1) shows thumbnails of multiple photos in the gallery application. In response to the user clicking on photo 203, the mobile phone displays the following Figure 5 The person in the photo 203 does not have a name (or title). Figure 5 The interface shown in (2) shows a large image of photo 203.

[0153] Similarly, in response to the user's operation of waking up the voice assistant function, the mobile phone displays the following Figure 5 The interface shown in (3) is shown in the figure. Figure 5 As shown in (3), since the portrait does not have a corresponding name in the gallery, the entry 501 included in the window 504 is different from the previous entry 401. For example, the content of the entry 501 is "the moment this person was created". That is to say, if the portrait does not have a corresponding name, or the user has not added a name to the portrait, the voice assistant function cannot obtain the name of the portrait, so it will refer to "this person" in general and display the entry "the moment this person was created" to the user.

[0154] It is understood that the description of other terms included in window 504 can be found in the previous text. Figure 4A The description of window 402 at (1) is not repeated here for the sake of brevity.

[0155] Figure 5 (4) shows the interface when the content of the voice instruction input by the user is recognized as "generate the moment of this person", that is, the recognized content "generate the moment of this person" 502 is displayed in the interface.

[0156] Alternatively, if Figure 5 As shown in (5), during the process of generating the moment, the progress of loading the generated moment video is displayed to the user through the progress bar in the window 503. Figure 5 As shown in (6), after the moment is generated, jump to the playback interface of the moment video. Figure 5 As shown in (4) Figure 5 The interface shown in (6) is similar to Figure 4A Middle (2) to Figure 4A The interface shown in (4) is similar. For related descriptions, please refer to the previous text. For the sake of brevity, it will not be repeated here.

[0157] As you can see, Figure 4A , Figure 4B or Figure 5 In the above, the case is when the photo contains a portrait. If the photo does not contain a portrait, the phone does not recommend the user the recommended terms related to the creation time in the voice assistant interface. Figure 6 Provide explanation.

[0158] Figure 6 The interface shown in (1) shows thumbnails of multiple photos. In response to the user clicking on photo 204, the mobile phone interface displays the following Figure 6 As shown in (2) in the figure. Photo 204 is a landscape photo, which does not contain a portrait. In response to the user's operation of waking up the voice assistant function, the mobile phone displays the following Figure 6 The interface shown in (3) is shown in Figure 6 In the window 610 shown in (3), the recommended entries do not include the entry "Generate the moment of..." It can be seen that the regular entries recommended by the voice assistant function displayed in the window 610, such as tomorrow's weather, taking a photo, countdown, etc.

[0159] Of course, for Figure 6 In the situation shown in the figure, after the voice assistant function is awakened, further, if a voice command of "generate the moment of a certain portrait" is received from the user, the mobile phone generates a moment video of the corresponding portrait in response to the voice command of "generate the moment of a certain portrait" input by the user.

[0160] Understandably, Figure 6 The recommended terms in window 610 shown in (3) are merely exemplary descriptions, and the present application is not limited thereto. For example, window 610 may also include terms frequently used by the user, and the like.

[0161] Optionally, in some embodiments, when the photo is identified to contain scenery (e.g., a tourist attraction, a mountain, or the sea, etc.) but not a portrait, the mobile phone can recommend to the user in the interface of the voice assistant function a recommended entry for generating a scenery moment video. In response to the user clicking on the recommended entry for generating a scenery moment video, the mobile phone generates a scenery moment video. For example, Figure 6 The window 610 shown in (3) may also include a recommended entry of "Moments to Create Scenery".

[0162] Optionally, in some embodiments, when a photo is identified to include a pet (e.g., a cat or dog, etc.) but not a human portrait, the mobile phone may recommend to the user in the interface of the voice assistant function a recommended entry for generating a pet moment video. In response to the user clicking on the recommended entry for generating a pet moment video, the mobile phone generates a pet moment video.

[0163] In some embodiments, for the term "Generate the moment of..." recommended to the user in the voice assistant function interface, the user can trigger the generation of the corresponding moment video based on the recommended term, or can make input without based on the recommended term, for example, input a voice command to generate the moment of other portraits.

[0164] Figure 7 The interface shown in (1) is similar to Figure 4A In response to receiving the user's voice command "generate the time of A and B", the mobile phone displays the following Figure 7 The interface shown in (2) is shown in the figure. Figure 7 In the interface shown in (2), entry 601 is the content of the recognized voice command input by the user. Figure 7 In the interface shown in (2), the content of entry 601 is "the time when A and B are generated", that is, the voice assistant recognizes that the content of the voice instruction input by the user is "the time when A and B are generated", not Figure 7 The content displayed in the recommended entry 401 in (1) is “Generate baby’s moment”. In this case, the mobile phone generates the moment video of portrait A and portrait B based on the recognized user’s current voice command through the voice assistant function. Similarly, in the process of generating the moment video of portrait A and portrait B, a generation progress bar can also be presented to the user, for example, Figure 7In the interface shown in (3), window 404 includes a progress bar for generating the moment. After the moment video of portrait A and portrait B is generated, the interface displays as follows Figure 7 The interface shown in (4).

[0165] The above descriptions are all about the relevant embodiments of generating moment videos based on the voice assistant function in the scenario of the gallery application (specifically, the scenario of browsing photos in large images in the gallery application). In other scenarios, moment videos can also be generated based on the voice assistant function.

[0166] In some embodiments, in response to a voice command input by a user, the mobile phone generates a moment video of the first person portrait. For example, the content of the voice command is "generate the moment of the first person portrait".

[0167] It should be understood that no matter what the scenario is, when the voice assistant function is awakened, the user can input a voice command to generate a corresponding portrait moment video. Fig. 8A and Figure 8B Describe the example interface diagrams of the moment video is generated when the user inputs a voice command. Fig. 8A and Figure 8B The difference is that Fig. 8A The example shown is an interface for waking up the voice assistant function through the second wake-up method. Figure 8B What is shown is an example of an interface for waking up the voice assistant function through the first wake-up method. The relevant descriptions of the first wake-up method and the second wake-up method have been described above, and for the sake of brevity, they will not be repeated here.

[0168] Fig. 8A (1) shows an example of the interface of the mobile phone desktop home page when the voice assistant function is awakened by the second awakening method. Fig. 8A As shown in (1), the interface includes window 701 and multiple application icons (e.g., the application icon of the gallery, and the application icons of application 1 to application 7). Window 701 displays the content of the voice command input by the user when the voice assistant function is awakened. For example, window 701 displays "Generate the moment of A and B". When the moment video of "A and B" can be generated, after the mobile phone generates the moment video of A and B, the interface displays as follows Fig. 8A The interface shown in (2) is shown in the figure. Fig. 8A As shown in (2), the interface shows the playback page of the video at the moment of "A and B".

[0169] Figure 8B (1) shows an example of the interface of the mobile phone desktop home page when the voice assistant function is awakened by the first awakening method. Figure 8BAs shown in (1), the window 702 shown in the interface is the interface of the voice assistant function. The recommended terms in the window 702 may be commonly used terms or terms recommended in combination with the current application scenario. Figure 8B (2) shows that after the voice assistant function is awakened by the first awakening method, the content of the voice command input by the user is recognized. For example, window 703 shows that the content of the voice command input by the user is recognized as "the moment of generating A and B". Figure 8B The interface shown in (3) is the content of the mobile phone replying to the user. For example, the content of the reply to the user displayed in window 704 is "OK." In the case where the moment video of "A and B" can be generated, after the mobile phone generates the moment video of A and B, the interface is displayed as follows Figure 8B The interface shown in (4) is shown in the figure. Figure 8B As shown in (4), the interface shows the playback page of the video at the moment of “A and B”.

[0170] In some embodiments, after receiving the user's voice command to generate a moment video of the target portrait, if the portrait data in the gallery does not include an album named after the target portrait, the mobile phone can guide the user to first determine the album of the target portrait, or name the target portrait, so that the album can be used to generate a moment video of the target portrait later.

[0171] Fig. 9 The example diagram of the interface when the target portrait is not found is shown in FIG. Fig. 9 As shown in (1), the interface includes window 801 and multiple application icons (e.g., application icon of gallery, application icons of application 1 to application 7). Window 801 is the interface of the voice assistant. Window 801 can be used to display the voice interaction content between the voice assistant and the user, as well as the controls corresponding to the recommended terms. Window 801 can include the text display corresponding to the voice command input by the user, and the text display of the voice content replied by the mobile phone to the user.

[0172] For example, in response to the user's voice command "Generate the moment of A and C", the mobile phone interface displays window 801, which includes entry 802, entry 803 and control 804; entry 802 displays "Generate the moment of A and C"; entry 803 displays "No moment of C found". In addition, the mobile phone prompts the user to "go to gallery-portrait album" through control 804, or guides the user to "go to gallery-portrait album".

[0173] In response to the user clicking on the control 804, the mobile phone displays the following interface: Fig. 9 As shown in (2). Fig. 9As shown in (2), the interface displays the data of all portraits analyzed by the gallery application. The data of each portrait includes the number of photos corresponding to the portrait. For portraits to which the user has added a name, the portrait data also includes the name or title corresponding to the portrait; for portraits to which the user has not added a name, the portrait data does not include the name or title, but a prompt text "Add name" can be displayed in the portrait card to guide the user to name the portrait. Taking portrait A as an example, portrait A includes: portrait name (A), the number of photos related to portrait A (90). Photos related to A can be understood as: photos in which portrait A appears, such as photos of portrait A with others, personal photos of portrait A, etc.

[0174] Fig. 9 The interface shown in (2) includes a window 806. The window 806 is used to prompt the user to select an album named "Portrait C" to guide the user to select an album. For example, portrait 805 does not have a corresponding name, and the content "Add a name" is displayed at portrait 805 to prompt the user to name it.

[0175] Alternatively, if Fig. 9 The multiple portrait data shown in (2) can be sorted in descending order according to the number. Alternatively, the multiple portrait data can also be sorted based on other factors, such as the close relationship with the owner, the frequency of appearance, etc., which is not specifically limited.

[0176] When the user clicks on the portrait data 805, the mobile phone responds to the user's operation of clicking on the portrait data 805 and the interface displays Fig. 9 As shown in (3). Fig. 9 As shown in (3), the interface includes a window 807. Window 807 is used by the user to input the name of the portrait data 805. For example, the user inputs "portrait C". After the input is completed, the user clicks the OK option in window 807. In response to the user clicking the OK option in window 807, the mobile phone displays the interface as shown below. Fig. 9 As shown in (4). Fig. 9 In the interface shown in (4), the name of the portrait data 805 has been updated to "Portrait C".

[0177] Optionally, the relationship between the “portrait C” and the camera owner may be further determined, for example, by Fig. 9 In the window 808 in the interface shown in (4), the character relationship can be selected. Fig. 9 In the interface shown in (5), after the user selects the relationship as "classmate" and "friend", he clicks the selection completion icon 809. In response to the user clicking the completion icon 809, the mobile phone displays the interface as shown in FIG. Fig. 9 As shown in (6). Fig. 9As shown in (6), the interface includes a window 810. The window 810 is used to indicate a named album. Optionally, the window 810 can automatically disappear after a preset time.

[0178] Of course, after naming the portrait data, you can also determine the character relationship, or skip the character relationship selection interface. Fig. 9 In the interface shown in (5), if the user clicks the "skip" option in window 808, the mobile phone responds to the user clicking the "skip" option in window 808 and the interface displays Fig. 9 The interface shown in (6).

[0179] After obtaining the "portrait C album", after subsequently recognizing the user input instruction to generate the moment video of portrait C, the mobile phone can generate the corresponding portrait moment video based on the portrait C album in response to the user input instruction. Alternatively, the mobile phone can also directly generate the moments of A and C based on the images in the gallery according to the previous instruction "generate the moments of A and C". In other words, the user does not need to input the voice instruction of "generate the moments of A and C" again. The mobile phone can generate the moment video of A and C based on the voice instruction of "generate the moments of A and C" received before creating the "portrait C album" and combined with the latest portrait data in the gallery.

[0180] In some embodiments, the portrait may be named in other ways. Figure 2 When you are on the creation page of the gallery application shown in (2), the interface displays Fig.10 The creation page of the gallery application shown in (1). Fig.10 As shown in (1), the interface includes area 901 and area 902. Area 901 is used to display data of portrait photos. For example, thumbnails of multiple portraits are displayed in area 901. Area 902 is used to display classified photo data of non-portraits. For example, thumbnails of document photos, thumbnails of food photos, thumbnails of landscape photos, and thumbnails of sports photos are displayed in area 902.

[0181] Understandably, Fig.10 The creation page shown in (1) may also include other content, such as a search bar, a micro-film creation card, a petal clipping card, a puzzle creation card, etc.

[0182] When the user clicks on a portrait in area 901, the mobile phone displays a detailed page of the portrait in response to the user's operation of clicking on the portrait, for example, Fig.10The details page of the portrait shown in (2) is used to display the statistics of the portrait (e.g., the total number of photos) and the photos taken at different times (which can be displayed in a list). For example, the details page of the portrait includes option 903 for adding a name. When the user clicks option 903, the mobile phone responds to the user's operation of clicking option 903 and displays the following interface: Fig.10 As shown in (3). Fig.10 As shown in (3), the interface includes window 904. Window 904 is used to add a name to the portrait and define its character relationship. Window 904 includes related items for character naming (e.g., adding a name input bar), selecting multiple options for the relationship with the camera owner (e.g., myself, baby, wife, husband, father, mother, classmate, colleague, friend, bestie, boyfriend, girlfriend, grandmother, grandfather, relative, other, etc.), canceling the control, and confirming the control. The user can enter the name of the portrait in the adding name input bar, and can select the corresponding option for the relationship between the portrait and the camera owner.

[0183] Understandably, Fig.10 The options for character relationships shown in (3) are merely exemplary descriptions, and the present application is not limited thereto.

[0184] When generating a moment video based on a portrait photo, in some cases, the moment video may not be generated. The failure to generate a moment video may be due to the following reasons: the number of photos in the gallery is limited, the number of relevant portrait photos is small or even non-existent, or the number of portraits in the currently viewed photos exceeds the preset threshold, which exceeds the analysis capability of the gallery application. Regardless of the reason, a prompt message can be sent to the user.

[0185] In some embodiments, if the photo browsed by the user contains too many portraits, which exceeds the analysis capability of the gallery application, after the user clicks the Generate Moment function, the gallery application cannot generate a moment video containing more than the preset number of portraits, and a prompt message will be displayed to the user at this time. For example, the photo browsed by the user is a group photo, that is, there are multiple portraits in the group photo.

[0186] Understandably, Figures 2 to 10 The examples are only for the convenience of understanding of those skilled in the art and do not limit the protection scope of the embodiments of the present application.

[0187] Please refer to Fig.11 , is a schematic flow chart of a video processing method provided in an embodiment of the present application. Fig.11 As shown, the method includes:

[0188] Step 1001: In response to a first operation of a user, a first interface is displayed, wherein the first interface includes a thumbnail of a first photo, and the first photo includes a first portrait.

[0189] The first operation is an operation for opening the gallery application. For example, the first operation is Figure 2 The operation of clicking the gallery application icon 201 shown in (1) is shown in FIG. The first interface may be Figure 2 The first photo can be Figure 2 Photo 202 shown in (2).

[0190] It is understandable that the user can also enter the first interface in other ways, such as, Figure 3 For the interface shown in , please refer to the previous text for related descriptions. I will not go into details here.

[0191] Step 1002: In response to a user clicking on a thumbnail of the first photo, a second interface is displayed, where the second interface is used to display a browsing page of the first photo.

[0192] For example, the user clicks on the thumbnail of the first photo, Figure 2 The operation of clicking the photo 202 shown in (2) above, correspondingly, the second interface is Figure 2 The interface shown in (3).

[0193] Step 1003, in response to the user's operation of awakening the voice assistant function based on the first wake-up method, displaying a third interface, the third interface includes a first window, the first window includes a first entry, and the first entry is used to represent the moment video of generating the first portrait.

[0194] The electronic device supports a voice assistant function. The voice assistant function of the electronic device can be awakened through a first wake-up method or a second wake-up method. For the relevant description of the first wake-up method or the second wake-up method, please refer to the previous text, and for the sake of brevity, it will not be repeated here.

[0195] For example, the third interface is Figure 4A In the interface shown in (1), the first window is Figure 4A In the window 402 shown in (1), the first entry is Figure 4A The entry 401 shown in (1).

[0196] Optionally, in some embodiments, when the first portrait is named as the first name, the first entry is an entry for the moment video of generating the first name. For example, the first portrait is named as "baby", and the first entry is "moment of generating baby". That is, if the first portrait has a corresponding name (such as the first name), then the entry for the moment of generating the first name can be recommended to the user to guide the user to execute the moment video of generating the first name.

[0197] Alternatively, in some embodiments, when the name of the first portrait is not obtained, the first entry is the entry of the video at the moment when the portrait is generated. Figure 5 The entry 501 shown in (1) is "the time when this person was created".

[0198] Step 1004: In response to the user's operation based on the first entry, a playback interface of a first video is displayed, wherein the first video includes the first photo and a second photo, and the second photo includes the first portrait.

[0199] Based on the entry recommended by the voice assistant function (i.e., the first entry in the first window), the user can trigger the electronic device to generate the first video in different ways.

[0200] Method 1

[0201] Optionally, in some embodiments, before displaying the playback interface of the first video, the method further includes:

[0202] In response to a first voice instruction input by a user, an eighth interface is displayed, the eighth interface including a fourth window, the fourth window displays text content corresponding to the first voice instruction, and the first voice instruction is input based on the first entry.

[0203] The first voice command may be a command input by the user through the voice assistant function, and the first voice command is input based on the first term. For example, the first term is "generate a moment video of the first person portrait", and the content of the first voice command is also "generate a moment video of the first person portrait".

[0204] Optionally, the first voice command may specifically be a command to generate a moment video of the first name (name corresponding to the first portrait), where the first name is the name or name of the first portrait in the gallery application. It is understandable that the user may pre-name the portrait data in the gallery application, for example, by Fig.10 The first person portrait is named as shown in FIG.

[0205] That is, if the first photo is viewed in a large image, and the voice assistant function is activated, if the first person portrait is detected, then the entry for generating the moment video of the first person portrait will be recommended in the interface of the voice assistant function. At this time, the user can input the corresponding voice command (for example, the first voice command) based on the recommended entry. For example, the third interface is Figure 4A In the interface shown in (1), the first window is Figure 4A In the window 402 shown in (1), the first entry is Figure 4A The content of the first voice instruction may be based on the input of the entry 401. The eighth interface may be Figure 4A In the interface shown in (2), the text content corresponding to the first voice command displayed in the fourth window is Figure 4A The entry 403 shown in (2).

[0206] After receiving the first voice command, if multiple photos of the first person portrait (i.e., photos of only the first person portrait without other portraits) can be obtained, a first video is generated based on these photos. The first video is a moment video of the first person portrait, or a memory video.

[0207] Therefore, in a scenario where a user is browsing photos in large images, in response to a first voice command input by the user based on a recommended first term, the electronic device can quickly generate a moment video of the user browsing the portraits in the photos based on the first voice command, thereby greatly improving the user experience.

[0208] Method 2

[0209] Optionally, in some embodiments, in response to the user's operation based on the first term, displaying the playback interface of the first video includes:

[0210] In response to the user clicking on the first entry, a playback interface of the first video is displayed.

[0211] That is, based on the first entry recommended by the voice assistant function, the user can directly click on the first entry to trigger the generation of the first video. Therefore, in the scenario where the user browses photos in large images, in response to the user clicking on the first entry, the mobile phone can quickly generate the first video.

[0212] Optionally, in the process of generating the first video, a first number of photos of the first person portrait may be obtained through a photo screening mechanism. Further, based on the first number of photos of the first person portrait, a second number of photos of the first person portrait may be determined for generating the first video.

[0213] Optionally, when playing the generated first video, the photos used to generate the first video can be played in sequence according to the time information. For example, the photos used to generate the first video can be played in sequence according to the principle that the older the time, the earlier the playback.

[0214] Optionally, the soundtrack of the first video may be intelligently matched music.

[0215] Optionally, the user can modify or adjust the soundtrack of the first video.

[0216] It should be understood that step 1004 is described by taking the generation of a portrait as an example, and the embodiments of the present application are not limited thereto. The user can also instruct the generation of a moment video of multiple portraits through a voice command. For example, the moment video of two or more portraits is generated through a voice command.

[0217] In an embodiment of the present application, based on the user's voice command, a moment video related to the portrait specified by the user is generated to meet the user's desire to view photos related to the portrait, greatly improving the user experience.

[0218] It is understandable that the user can wake up the voice assistant function through the second wake-up method. In the case of waking up the voice assistant function through the second wake-up method, the interface displayed by the electronic device is slightly different from the interface of the voice assistant function waking up through the first wake-up method.

[0219] Optionally, in some embodiments, after displaying the second interface, the method further includes:

[0220] In response to the user's operation of waking up the voice assistant function based on the second wake-up method, displaying a fourth interface, the fourth interface including a second window, the second window being used to display the content of the voice instruction corresponding to the second wake-up method;

[0221] Based on the voice command corresponding to the second wake-up method, the playback interface of the first video is displayed.

[0222] That is to say, in the case of waking up the voice assistant function through the second wake-up method, the electronic device can directly execute the content of the voice instruction (for example, the content of the voice instruction is to generate the first video) to generate the first video. The voice instruction also has the function of waking up the voice assistant function. In addition, the content of the voice instruction corresponding to the second wake-up method is displayed in the interface.

[0223] For example, the fourth interface is Figure 4B In the interface shown in (1), the content of the voice command displayed in the second window is Figure 4B The entry 405 shown in (1).

[0224] In order to show the user the progress of generating the moment video in real time, a progress bar (or loading style) of generating the moment video can also be presented in the interface so that the user can understand the real-time progress. Optionally, in some embodiments, before displaying the playback interface of the first video, the method further includes:

[0225] A fifth interface is displayed, wherein the fifth interface includes a progress bar control, and the progress bar control is used to display the progress of generating the first video.

[0226] That is to say, when generating a moment video of a portrait, if the number of photos including the first portrait is large or is affected by computing power, the process of generating the first video requires a certain waiting time. While waiting for the first video to load, a dynamic icon can be displayed to the user to indicate that the video is currently loading.

[0227] It can be understood that the progress bar control is only one implementation method of displaying the progress of generating the first video, and the embodiments of the present application are not limited thereto. For example, a number or a loading icon can also be used to assist the user in understanding the real-time progress of generating the first video.

[0228] Optionally, in some embodiments, the first interface further includes a thumbnail of a second photo, and the second photo does not include a portrait; the method further includes:

[0229] In response to a user clicking on a thumbnail of the second photo, displaying a sixth interface for displaying a browsing page of the second photo;

[0230] In response to the user's operation of waking up the voice assistant function based on the first wake-up method, the seventh interface is displayed, and the seventh interface includes a third window, and the third window is used to display the entries recommended by the voice assistant function. The third window does not include entries for generating portrait moment videos.

[0231] That is, in the photo page of the gallery application, if the user is viewing photos that do not include portraits (for example, landscape photos, pet photos, etc.), when the user invokes the voice assistant function through the first wake-up method, the voice interaction interface will not recommend the user the entry for generating a moment video. Figure 6 The terms recommended in the window 610 shown in FIG. 6 do not include recommended terms for generating a portrait moment video.

[0232] Alternatively, for photos that do not include portraits (e.g., landscape photos, pet photos, etc.), when the voice assistant function is invoked through the first wake-up method, the voice interaction interface may recommend to the user an entry for generating a moment video containing the content in the photo. For example, for landscape photos, the entry for generating a landscape moment video is recommended. For another example, for pet photos, the entry for generating a pet moment video is recommended.

[0233] For non-gallery application scenarios (for example, users are using desktop applications), the present application embodiment also provides an entry for generating moment videos based on the voice assistant function. Of course, for non-gallery application scenarios, the voice assistant function can also be aroused through the first wake-up method or the second wake-up method, which will be described in detail below.

[0234] Optionally, in some embodiments, the method further comprises:

[0235] In response to the user's operation, displaying a ninth interface, wherein the ninth interface is not used to display a photo browsing page in the gallery application;

[0236] In response to the user's operation of waking up the voice assistant function based on the second wake-up method, a tenth interface is displayed, wherein the tenth interface includes a fifth window, and the fifth window is used to display text content corresponding to the second voice instruction, the second voice instruction is an instruction to wake up the voice assistant function through the second wake-up method, and the second voice instruction is used to instruct the generation of a moment video of the second portrait;

[0237] Based on the second voice command, a playback interface of a second video is displayed, wherein the second video includes a third photo and a fourth photo, and both the third photo and the fourth photo include the second portrait.

[0238] Exemplarily, the ninth interface is an interface of a desktop application. In response to the user waking up the voice assistant function through the second wake-up method (for example, the second voice command is an instruction for generating the moments A and B), the mobile phone interface displays the tenth interface. The tenth interface is as follows: Fig. 8A The fifth window is Fig. 8A 701 shown in (1). The playback interface of the second video is Figure 8B The interface shown in (2).

[0239] Optionally, in some embodiments, the method further comprises:

[0240] In response to the user's operation, displaying an eleventh interface, wherein the eleventh interface is not used to display a photo browsing page in the gallery application;

[0241] In response to the user's operation of waking up the voice assistant function based on the first wake-up method, displaying a twelfth interface, the twelfth interface including a sixth window, the sixth window being used to display entries recommended by the voice assistant function, and the sixth window not including entries for generating a moment video;

[0242] In response to a third voice command input by a user, a thirteenth interface is displayed, the thirteenth interface includes a seventh window, the seventh window is used to display text content corresponding to the third voice command, and the third voice command is used to instruct the moment video of generating the third portrait;

[0243] Based on the third voice command, a playback interface of a third video is displayed, wherein the third video includes a fifth photo and a sixth photo, and both the fifth photo and the sixth photo include the third portrait.

[0244] For example, the eleventh interface is an interface of a desktop application. In response to the user's operation of waking up the voice assistant function through the first wake-up method, the mobile phone interface displays the twelfth interface. The twelfth interface is as follows: Figure 8B The sixth window is Figure 8B Assume that the third voice command is a command for generating the time of A and B, the thirteenth interface is Figure 8B In the interface shown in (2), the seventh window is Figure 8B The window 703 shown in (2) is shown in FIG. 1 . The playback interface of the third video is Figure 8B The interface shown in (4).

[0245] Optionally, in some embodiments, the method further comprises:

[0246] In response to a fourth voice command input by a user, a fourteenth interface is displayed, the fourteenth interface includes a seventh window, the seventh window includes a first control, a text entry corresponding to the fourth voice command, and a second entry, the fourth instruction is used to instruct the generation of a moment video of a fourth person portrait, and the second entry indicates that there is no album of the fourth person portrait;

[0247] In response to the user clicking the first control, a fifteenth interface is displayed, the fifteenth interface is used to display multiple portrait data in the gallery application, the fifteenth interface includes an eighth window, and the eighth window is used to prompt the user to select an album for naming;

[0248] In response to the user's operation on the portrait data of the fourth portrait, displaying a sixteenth interface, the sixteenth interface including a ninth window, the ninth window being used to input a name for the portrait;

[0249] In response to the user completing the operation of naming the portrait data of the fourth portrait, a seventeenth interface is displayed, wherein the seventeenth interface includes a ninth window, and the ninth window is used to prompt the user that the naming of the portrait data of the fourth portrait has been completed.

[0250] That is to say, in a scenario where the user is not browsing photos in large images in a gallery application, if a voice command is received that the user desires to generate a moment video of a certain portrait, when there is no album with the portrait in the gallery, the user can be replied to that the album with the portrait was not found, and the user can be guided to the gallery application to generate an album with the portrait. For example, an album with the portrait in the gallery application can be named, and an album with the portrait can be generated to prepare for the subsequent generation of a moment video with the portrait.

[0251] In some embodiments, the above Fig. 9 The interface shown is used to name the album. For example, the fourteenth interface is Fig. 9 In the interface shown in (1), the seventh window is Fig. 9 In the window 801 shown in (1), the second entry is entry 803, the fourth person portrait is person portrait C, and the first control is control 804. Fig. 9 In the interface shown in (2), the eighth window is Fig. 9 The window 806 shown in (2) is shown in FIG. 16 . Fig. 9 In the interface shown in (3), the ninth window is Fig. 9 The seventeenth interface is Fig. 9 In the interface shown in (6), the ninth window is Fig. 9 Window 810 shown in (6).

[0252] Optionally, in some embodiments, before displaying the seventeenth interface, the method further includes:

[0253] Displaying an eighteenth interface, wherein the eighteenth interface includes a tenth window, wherein the tenth window includes a plurality of character relationship options and a second control;

[0254] Wherein, the display of the seventeenth interface includes:

[0255] In response to the user clicking the second control, the seventeenth interface is displayed.

[0256] That is to say, while naming the portrait album in response to the user's naming operation, the mobile phone can also provide character relationship options for the user to define their character relationships, making the portrait data richer. Fig. 9 The interface shown in (4) or Fig. 9 In the interface shown in (5), the tenth window is Fig. 9 Window 808 shown in (4) or Fig. 9 The second control is Fig. 9 The completion icon 809 shown in (5) is shown in FIG.

[0257] Optionally, when the first video cannot be generated, a window may be popped up to remind the user.

[0258] Optionally, in some embodiments, the first video cannot be generated, including: when the number of photos of the first portrait is less than a first threshold, the first video cannot be generated.

[0259] Alternatively, when the number of portraits (for example, 10 portraits) indicated by the user for generating a portrait video is greater than or equal to the second threshold, the corresponding moment video cannot be generated.

[0260] That is to say, when the first video is generated based on the user's voice command, there may be a situation where the video cannot be generated. In this case, a pop-up window may also be displayed to the user for prompting.

[0261] Fig.12 1 is a schematic diagram of the software structure of the electronic device 100 of the embodiment of the present application. The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system can be divided into four layers, from top to bottom, namely, the application (APP) layer, the application framework layer (abbreviated as FWK), the system library and the kernel layer.

[0262] The application layer can include a series of application packages. For example, Fig.12 As shown, the application layer includes a gallery application and a voice assistant application.

[0263] It can be understood that the application layer may also include other applications, such as camera, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, browser, WeChat, Alipay, Taobao and other applications.

[0264] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer may include some predefined functions.

[0265] It can be understood that the application framework layer may also include other contents, such as a window manager, a content provider, a view system, a phone manager, a resource manager, and a notification manager.

[0266] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, and capture the screen.

[0267] Content providers are used to store and retrieve data and make it accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, and phone books.

[0268] The view system includes visual controls, such as controls for displaying text and controls for displaying pictures. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying pictures. The application layer and the application framework layer run in a virtual machine. The virtual machine executes the java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0269] like Fig.12 As shown, the system library may include camera service functionality.

[0270] The system library may also include multiple functional modules, such as: a surface manager, a media library, a 3D graphics processing library (such as: an open graphics library for embedded systems (OpenGL ES)) and a 2D graphics engine (such as: the skia graphics library (SGL)).

[0271] The surface manager is used to manage the display subsystem and provide the fusion of 2D layers and 3D layers for multiple applications.

[0272] The media library supports playback and recording of multiple audio formats, playback and recording of multiple video formats, and still image files. The media library can support multiple audio and video coding formats, such as: MPEG4, H.264, moving picture experts group audio layer III (MP3), advanced audio coding (AAC), adaptive multi-rate (AMR), joint photographic experts group (JPG) and portable network graphics (PNG).

[0273] The 3D graphics processing library can be used to implement 3D graphics drawing, image rendering, compositing and layer processing.

[0274] A 2D graphics engine is a drawing engine for 2D drawings.

[0275] The Hardware Abstraction Layer (HAL) is an interface layer between the operating system kernel and the hardware circuit, and its purpose is to abstract the hardware. It hides the hardware interface details of a specific platform and provides a virtual hardware platform for the operating system, making it hardware-independent and portable on multiple platforms.

[0276] The driver layer is the layer between hardware and software. Fig.12 As shown, the driver layer may include a power management module, a display driver, a camera driver and other driver modules. Among them, the camera driver is the driver layer of the camera device, which is mainly responsible for the interaction with the hardware. Optionally, the power management module can report the charging event to the application layer, such as the gallery application, so that the gallery application performs photo analysis when the electronic device is in a charging state, which helps to save power consumption.

[0277] Taking the gallery application as an example, the gallery application in the application layer can be displayed on the screen of the electronic device in the form of an icon. When the icon of the gallery application is triggered, the electronic device runs the camera application. The gallery application runs on the electronic device, and the electronic device can send corresponding touch events to the driver layer according to the user's operation. When the touch screen receives the touch event, the gallery application is started, and the gallery page is displayed on the screen by calling the display startup of the driver layer.

[0278] Exemplarily, after the voice assistant in the application layer receives an instruction from the user to generate a moment video of the first person portrait, it calls the gallery application to analyze and filter the photos of the first person portrait, obtains multiple photos for generating the moment video of the first person portrait, and generates the moment video of the first person portrait based on the multiple photos; after the moment video of the first portrait is generated, it automatically jumps to the playback page of the moment video of the first portrait, that is, calls the display driver to display the playback page of the moment video of the first portrait through the display screen.

[0279] From the above, it can be seen that the video processing method provided in the present application generates a moment video related to a portrait specified by the user based on the user's voice command, so as to meet the user's desire to view photos related to the portrait, thereby greatly improving the user experience.

[0280] The embodiment of the present application provides a chip system, which includes one or more processors for calling and running instructions stored in the memory from the memory, so that the method of the embodiment of the present application is executed. The chip system can be composed of chips, or it can include chips and other discrete devices.

[0281] Among them, the chip system may include an input circuit or interface for sending information or data, and an output circuit or interface for receiving information or data.

[0282] The present application also provides a computer program product, which, when executed by a processor, implements the method described in any method embodiment of the present application.

[0283] The computer program product can be stored in a memory, and is finally converted into an executable target file that can be executed by a processor after preprocessing, compiling, assembling and linking.

[0284] The present application also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a computer, the method described in any method embodiment of the present application is implemented. The computer program can be a high-level language program or an executable target program.

[0285] The computer-readable storage medium may be a volatile memory or a nonvolatile memory, or may include both a volatile memory and a nonvolatile memory. The nonvolatile memory may be a read-only memory (ROM), a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM bus RAM (DR RAM).

[0286] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described devices and equipment and the technical effects produced can refer to the corresponding processes and technical effects in the aforementioned method embodiments, and will not be repeated here.

[0287] In several embodiments provided in the present application, the disclosed systems, devices and methods can be implemented in other ways. For example, some features of the method embodiments described above can be ignored or not performed. The device embodiments described above are merely schematic, and the division of units is only a logical function division. There may be other division methods in actual implementation, and multiple units or components may be combined or integrated into another system. In addition, the coupling between the units or the coupling between the components may be direct coupling or indirect coupling, and the above coupling includes electrical, mechanical or other forms of connection.

[0288] It should be understood that in the various embodiments of the present application, the size of the serial number of each process does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0289] In addition, the terms "system" and "network" are often used interchangeably in this article. The term "and / or" in this article is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0290] The terms (or numbers) "first", "second", ..., etc. that appear in the embodiments of the present application are only used for descriptive purposes, that is, only to distinguish different objects, such as different "voice instructions", etc., and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, the features defined as "first", "second", ..., etc. may explicitly or implicitly include one or more features. In the description of the embodiments of the present application, "at least one (item)" refers to one or more. "Multiple" means two or more. "At least one of the following (items)" or similar expressions thereof refers to any combination of these items, including any combination of a single (item) or plural (items).

[0291] In short, the above is only a preferred embodiment of the technical solution of this application, and is not intended to limit the protection scope of this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application should be included in the protection scope of this application.

Claims

1. A video processing method, characterized in that: include: In response to a first operation of the user, displaying a first interface, wherein the first interface includes a thumbnail of a first photo, and the first photo includes a first portrait; In response to a user clicking on a thumbnail of the first photo, displaying a second interface for displaying a browsing page of the first photo; In response to the user's operation of waking up the voice assistant function based on the first wake-up method, displaying a third interface, the third interface including a first window, the first window including a first entry, the first entry being used to represent a video of the moment when the first portrait was generated; In response to the user's operation based on the first entry, a playback interface of a first video is displayed, wherein the first video includes the first photo and a second photo, and the second photo includes the first portrait.

2. The method according to claim 1, characterized in that After displaying the second interface, the method further includes: In response to the user's operation of waking up the voice assistant function based on the second wake-up method, displaying a fourth interface, the fourth interface including a second window, the second window being used to display the content of the voice instruction corresponding to the second wake-up method; Based on the voice command corresponding to the second wake-up method, the playback interface of the first video is displayed.

3. The method according to claim 1 or 2, characterized in that: Before displaying the playback interface of the first video, the method further includes: A fifth interface is displayed, wherein the fifth interface includes a progress bar control, and the progress bar control is used to display the progress of generating the first video.

4. The method according to any one of claims 1 to 3, characterized in that The first interface also includes a thumbnail of a second photo, and the second photo does not include a portrait; and the method further includes: In response to a user clicking on a thumbnail of the second photo, displaying a sixth interface for displaying a browsing page of the second photo; In response to the user's operation of waking up the voice assistant function based on the first wake-up method, the seventh interface is displayed, and the seventh interface includes a third window, and the third window is used to display the entries recommended by the voice assistant function. The third window does not include entries for generating portrait moment videos.

5. The method according to claim 1, characterized in that Before displaying the playback interface of the first video, the method further includes: In response to a first voice instruction input by a user, an eighth interface is displayed, the eighth interface including a fourth window, the fourth window displays text content corresponding to the first voice instruction, and the first voice instruction is input based on the first entry.

6. The method according to claim 1, characterized in that The step of displaying a playback interface of the first video in response to the user's operation based on the first term includes: In response to the user clicking on the first entry, a playback interface of the first video is displayed.

7. The method according to claim 1, characterized in that The method further comprises: In response to the user's operation, a ninth interface is displayed, wherein the ninth interface is not used to display a photo browsing page in the gallery application; In response to the user's operation of waking up the voice assistant function based on the second wake-up method, a tenth interface is displayed, wherein the tenth interface includes a fifth window, and the fifth window is used to display text content corresponding to the second voice instruction, the second voice instruction is an instruction to wake up the voice assistant function through the second wake-up method, and the second voice instruction is used to instruct the generation of a moment video of the second portrait; Based on the second voice command, a playback interface of a second video is displayed, wherein the second video includes a third photo and a fourth photo, and both the third photo and the fourth photo include the second portrait.

8. The method according to claim 1, characterized in that The method further comprises: In response to the user's operation, displaying an eleventh interface, wherein the eleventh interface is not used to display a photo browsing page in the gallery application; In response to the user's operation of waking up the voice assistant function based on the first wake-up method, displaying a twelfth interface, the twelfth interface including a sixth window, the sixth window being used to display entries recommended by the voice assistant function, and the sixth window not including entries for generating a moment video; In response to a third voice command input by a user, a thirteenth interface is displayed, the thirteenth interface includes a seventh window, the seventh window is used to display text content corresponding to the third voice command, and the third voice command is used to instruct the moment video of generating the third portrait; Based on the third voice command, a playback interface of a third video is displayed, wherein the third video includes a fifth photo and a sixth photo, and both the fifth photo and the sixth photo include the third portrait.

9. The method according to claim 8, characterized in that The method further comprises: In response to a fourth voice command input by a user, a fourteenth interface is displayed, the fourteenth interface includes a seventh window, the seventh window includes a first control, a text entry corresponding to the fourth voice command, and a second entry, the fourth voice command is used to instruct the generation of a moment video of a fourth portrait, and the second entry indicates that an album of the fourth portrait does not exist; In response to the user clicking the first control, a fifteenth interface is displayed, the fifteenth interface is used to display multiple portrait data in the gallery application, the fifteenth interface includes an eighth window, and the eighth window is used to prompt the user to select an album for naming; In response to the user's operation on the portrait data of the fourth portrait, displaying a sixteenth interface, the sixteenth interface including a ninth window, the ninth window being used to input a name for the portrait; In response to the user completing the operation of naming the portrait data of the fourth portrait, a seventeenth interface is displayed, wherein the seventeenth interface includes a ninth window, and the ninth window is used to prompt the user that the naming of the portrait data of the fourth portrait has been completed.

10. The method according to claim 9, characterized in that Before displaying the seventeenth interface, the method further includes: Displaying an eighteenth interface, wherein the eighteenth interface includes a tenth window, wherein the tenth window includes a plurality of character relationship options and a second control; Wherein, the display of the seventeenth interface includes: In response to the user clicking the second control, the seventeenth interface is displayed.

11. The method according to any one of claims 1 to 10, characterized in that The operation of the user waking up the voice assistant function based on the first wake-up method includes any one of the following: inputting a wake-up instruction to wake up the voice assistant function; pressing a shortcut key to start the voice assistant function to wake up the voice assistant function.

12. The method according to claim 2 or 7, characterized in that: The user's operation of waking up the voice assistant function based on the second wake-up method includes: waking up the voice assistant function through a breath wake-up method.

13. An electronic device, characterized in that: The electronic device comprises a processor and a memory, wherein the processor and the memory are coupled, and the memory is used to store a computer program. When the computer program is executed by the processor, the electronic device executes the method according to any one of claims 1 to 12.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the electronic device executes the method according to any one of claims 1 to 12.

15. A chip system, characterized in that: The chip system is applied to an electronic device, and the chip system includes one or more processors, and the processor is used to call computer instructions so that the electronic device executes the method as described in any one of claims 1 to 12.

Images