Video processing method and electronic equipment
By introducing the ‘Generate Moment’ function portal in the gallery application of the smart terminal, users can actively generate portrait-related videos, solving the problem of the inability to actively generate videos in the existing technology, and improving the user experience and photo browsing interactivity.
Patent Information
- Application Number
- CN202310863205.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-07-12
- Publication Date
- 2025-01-14
AI Technical Summary
When browsing photos, existing smart terminals cannot actively generate portrait-related videos, resulting in poor user experience.
Provide a video processing method. By adding a 'generate moment' function portal to the gallery application, users can actively generate moment videos related to portraits in photos, including identifying portraits and generating videos based on multiple photos, and displaying dynamics in the interface. The icon indicates the generation process.
Improves the user experience, allowing users to quickly view historical memories moments related to portraits, and enhances the interactive and fun nature of photo browsing.
Smart Images

Figure CN119316533A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of electronic devices, and more specifically, to a video processing method and an electronic device. Background Art
[0002] With the continuous development of smart terminals, the shooting functions of smart terminals are becoming increasingly powerful. Users can use smart terminals to take photos or videos to record the beautiful moments of the past. The needs and experience of users when browsing photos are also constantly enhanced.
[0003] In some scenarios, when a user browses a photo that contains a person, the user will want to view the historical memories of the person. However, in current smart terminals, when a user browses a photo that contains a person, he or she may need to click on the person tag to view photos related to the person, but cannot actively generate videos related to the person, resulting in a poor user experience. Summary of the invention
[0004] In view of this, the present application provides a video processing method, an electronic device, a computer-readable storage medium, and a computer program product, which can actively generate a memory video related to the object in the photo, greatly improving the user experience.
[0005] In a first aspect, a video processing method is provided, comprising:
[0006] In response to a first operation of the user, displaying a first interface, wherein the first interface includes a thumbnail of a first photo, and the first photo includes a first portrait;
[0007] In response to a user clicking on a thumbnail of the first photo, displaying a second interface for displaying a browsing page of the first photo;
[0008] In response to a second operation of the user on the second interface (for example, an operation of sliding up the screen), displaying a third interface, wherein the third interface includes a first area, and the first area includes a first control;
[0009] In response to a user clicking on the first control, a playback interface of a first video is displayed; the first video includes the first photo and a second photo, and the second photo includes the first portrait.
[0010] The above method can be executed by an electronic device or a chip in the electronic device. Based on the above technical solution, after the electronic device (or the chip in the electronic device) receives the second operation of the user on the second interface, if the portrait is recognized, the entrance to generate the moment video is displayed in the interface (for example, the first control in the first area), and after the user clicks the first control, in response to the user clicking the first control, the first video can be generated. The first video is generated based on multiple photos including the first portrait. Compared with the user flipping through multiple photos of the portrait through the portrait tag, the embodiment of the present application sets an entrance to the "generate moment" function, through which the electronic device can actively generate a moment video related to the target portrait for the user, so as to meet the user's desire to view photos related to the portrait, which greatly improves the user experience.
[0011] In some social occasions, such as parties, users will share past photos of family or friends by browsing photos, or users will browse a photo alone. Based on the portraits in the photos being browsed, a memory video of the portrait is generated, which can trigger users to recall, provide users with topic appeals, and help users quickly find common memories.
[0012] It can be understood that, in addition to the first area, the third interface may also include other information about the first photo.
[0013] In some possible implementations, the third interface also includes a partial area of the first photo, a second area and / or a third area; the second area is used to display portrait label information; and the third area is used to display the shooting location information of the first photo.
[0014] In some possible implementations, the first interface further includes a thumbnail of a second photo, and the second photo does not include a portrait; and the method further includes:
[0015] In response to a user clicking on a thumbnail of the second photo, displaying a fourth interface for displaying a browsing page of the second photo;
[0016] In response to a fourth operation (swiping up the screen) of the user on the fourth interface, a fifth interface is displayed, and the fifth interface does not include the first control.
[0017] That is to say, in the case where the photo does not contain a portrait, when the user browses the large picture of the photo, the electronic device responds to the user's swiping up the screen and does not display the entrance to the "Generate Moment" function in the first area.
[0018] In some possible implementations, after displaying the playback interface of the first video, the method further includes:
[0019] In response to a fifth operation of the user on the playback interface of the first video (e.g., clicking a return control or sliding the screen), displaying a sixth interface, wherein the sixth interface includes the first area, the first area does not include the first control, and the first area includes a thumbnail of the first video and a playback control;
[0020] In response to the user clicking the playback control, the playback interface of the first video is displayed.
[0021] Therefore, when the first video has been generated, when the user returns to the previous interface (i.e., the upward sliding page when browsing the first photo in large image), the function entrance originally displayed in the first area at the time of generation is changed to the thumbnail of the first video, so that the user can click to view the generated first video conveniently.
[0022] In some possible implementations, the first interface further includes a thumbnail of a third photo, where the third photo includes the first portrait; and the method further includes:
[0023] In response to a user clicking on a thumbnail of the third photo, a ninth interface is displayed, wherein the ninth interface is used to display a browsing page of the third photo;
[0024] In response to the user's seventh operation on the ninth interface, the tenth interface is displayed, and the fifth interface includes the first area, and the first area includes a thumbnail of the first video and a playback control.
[0025] Therefore, when the first video has already been generated, for other photos that include the same portrait as the first photo, for example, the third photo, when browsing the large image of the third photo, in response to the user swiping up the screen, the electronic device will generate a thumbnail of the first video for the user's convenience in viewing.
[0026] Optionally, the first area further includes a third control; and the method further includes:
[0027] In response to a user clicking on the third control, updating the first video;
[0028] After the update is completed, the playback interface of the updated first video is displayed.
[0029] That is to say, by setting the update control, the generated moment video can also be updated, so as to provide a corresponding entry for the user to actively update the moment video.
[0030] In some possible implementations, the method further includes:
[0031] In response to the eighth operation of the user, an eleventh interface is displayed, where the eleventh interface is used to display a time page of the gallery application, and the eleventh interface includes a second control;
[0032] In response to the user clicking the second control, a twelfth interface is displayed, wherein the twelfth interface is used to display data of a plurality of portraits;
[0033] In response to a user selecting the first portrait, generating a third video, wherein the third video is a video that updates the first video;
[0034] The playback interface of the third video is displayed.
[0035] That is to say, the generated first video can be updated by actively selecting the target portrait to meet the user's demand for updating the moment video of the target portrait.
[0036] In some possible implementations, the first interface further includes a thumbnail of a fourth photo, the fourth photo includes a second number of portraits, and the second number is greater than a second threshold; the method further includes:
[0037] In response to a user clicking on a thumbnail of the fourth photo, a thirteenth interface is displayed, wherein the thirteenth interface is used to display a browsing page of the fourth photo;
[0038] In response to a fourth operation of the user on the thirteenth interface, displaying a fourteenth interface, wherein the fourteenth interface includes the first area, and the first area includes the first control;
[0039] In response to the user clicking the first control, a fifteenth interface is displayed, the fifteenth interface includes a first window, and the first window is used to prompt the user that the video cannot be generated.
[0040] Therefore, in the case where the number of portraits in the photo exceeds the upper limit, a pop-up window can be used to prompt the user so that the user is informed that the moment video cannot be generated.
[0041] In some possible implementations, the method further includes:
[0042] In response to the user clicking the first control, a sixteenth interface is displayed, wherein the sixteenth interface includes a second window, and the second window is used to prompt the user that a video cannot be generated, wherein the number of photos including the first portrait is less than a first threshold.
[0043] Therefore, in the case where the number of photos including the target person's portrait is too small, a pop-up window may be used to prompt the user so that the user is informed that the moment video cannot be generated.
[0044] In some possible implementations, during the process of generating the first video, the method further includes:
[0045] A dynamic icon is displayed in the first area, and the dynamic icon indicates that the first video is being generated. Therefore, in the process of generating a moment video, a dynamic icon can be displayed to let the user know that the moment video is currently being generated.
[0046] The embodiment of the present application also provides another entry for the function of generating a moment. The entry for the function of generating a moment is located on the moment page in the gallery application.
[0047] In some possible implementations, the method further includes:
[0048] In response to a sixth operation of the user, displaying a seventh interface, the seventh interface being used to display a moment page of the gallery application, the seventh interface including a second control;
[0049] In response to the user clicking the second control, an eighth interface is displayed, where the eighth interface is used to display data of a plurality of portraits;
[0050] In response to the user selecting the second portrait, a second video is generated, wherein the second video includes a photo of the second portrait.
[0051] Display the playback interface of the second video.
[0052] Therefore, after clicking the function entrance of generating moment video on the moment page, by providing the option of selecting a target person, a moment video related to the target object desired by the user is generated, which is more targeted.
[0053] In some possible implementations, the method further includes:
[0054] In response to a user selecting a third person portrait, generating a third video, wherein the third video is generated based on a single-person photo of the third person portrait;
[0055] The playback interface of the third video is displayed.
[0056] Similarly, in the scenario where the user selects a target person portrait to generate a video at the moment, there may be a situation where the video cannot be generated.
[0057] In some possible implementations, the method further includes:
[0058] In response to the user selecting the third portrait, the seventeenth interface is displayed, the seventeenth interface includes a third window, and the third window is used to prompt the user that the video cannot be generated; wherein the number of photos including the third portrait is less than a third threshold.
[0059] In some possible implementations, after displaying the eighth interface, the method further includes:
[0060] In response to the user selecting a third number of portraits, an eighteenth interface is displayed, the eighteenth interface including a fourth window, the fourth window being used to prompt the user that a video cannot be generated; wherein the third number is greater than a fourth threshold.
[0061] In some possible implementations, before generating the first video, the method further includes:
[0062] Based on the first portrait, acquiring a plurality of second photos, each of the second photos including the first portrait;
[0063] Selecting a first number of second photos from the plurality of second photos according to a principle of uniform time distribution;
[0064] Selecting a second number of second photos from the first number of second photos according to the timeline from oldest to most recent;
[0065] The generating the first video comprises:
[0066] The first video is generated based on the second number of second photos and the first photos.
[0067] Therefore, through the above-mentioned mechanism for selecting photos and generating videos, moment videos generated from photos under different timelines can be obtained, which provides a better user experience.
[0068] In a second aspect, a video processing method is provided, comprising:
[0069] In response to a sixth operation of the user, displaying a seventh interface, the seventh interface being used to display a moment page of the gallery application, the seventh interface including a second control;
[0070] In response to the user clicking the second control, an eighth interface is displayed, where the eighth interface is used to display data of a plurality of portraits;
[0071] In response to the user selecting the second portrait, a second video is generated, wherein the second video includes a photo of the second portrait.
[0072] Display the playback interface of the second video.
[0073] The above method can be executed by an electronic device or a chip in the electronic device. Based on the above technical solution, the electronic device (or the chip in the electronic device) provides an entrance to the "Generate Moments" function in the Moments page of the gallery application, through which the user can actively select a target portrait, and the electronic device actively generates a moment video related to the target object based on the target portrait selected by the user, which is more targeted and greatly improves the user experience.
[0074] Regarding the entry of the "Generate Moment" function in the Moment page of the gallery application, some possible implementation methods and technical effects of the implementation methods can be referred to the description in the first aspect. For the sake of brevity, they will not be repeated here.
[0075] In a third aspect, an electronic device is provided, comprising a unit for executing the method in any one of the implementations of the first aspect or the second aspect. The electronic device may be a terminal device or a chip in the terminal device. The electronic device comprises an input unit, a display unit, and a processing unit.
[0076] When the electronic device is a terminal device, the processing unit may be a processor, the input unit may be a communication interface, and the display unit may be a graphics processing module and a screen; the terminal device may also include a memory for storing computer program code, and when the processor executes the computer program code stored in the memory, the terminal device executes the method in any one of the implementations of the first aspect or the second aspect.
[0077] When the electronic device is a chip in a terminal device, the processing unit may be a logic processing unit inside the chip, the input unit may be an input interface, a pin or a circuit, etc., and the display unit may be a graphics processing unit inside the chip; the chip may also include a memory, which may be a memory inside the chip (for example, a register, a cache, etc.) or a memory located outside the chip (for example, a read-only memory, a random access memory, etc.); the memory is used to store computer program code, and when the processor executes the computer program code stored in the memory, the chip executes the method in any one of the implementations of the first aspect or the second aspect.
[0078] In a fourth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program code. When the computer program code is executed by an electronic device, the electronic device executes the method in any one of the implementations of the first aspect or the second aspect.
[0079] In a fifth aspect, a computer program product is provided, the computer program product comprising: a computer program code, when the computer program code is executed by an electronic device, the electronic device executes the method in any one of the implementations of the first aspect or the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0080] Figure 1 is a schematic diagram of a hardware system of an electronic device applicable to the present application;
[0081] Figure 2 This is a schematic diagram of an interface for entering a gallery application provided by this application;
[0082] Figure 3A This is a schematic diagram of an interface for generating a moment video provided by this application;
[0083] Figure 3B This is another example of a schematic diagram of an interface for generating a moment video provided by the present application;
[0084] Figure 4 This is a schematic diagram of an interface provided by the present application when a moment video cannot be generated;
[0085] Figure 5 This is another example provided by the present application of an interface schematic diagram when a moment video cannot be generated;
[0086] Figure 6 This is another example of a schematic diagram of an interface for generating a moment video provided by the present application;
[0087] Figure 7 This is another example of a schematic diagram of an interface for generating a moment video provided by the present application;
[0088] Figure 8 This is a schematic diagram of an interface provided by the present application when a moment video cannot be generated;
[0089] Fig. 9 This is another example of a schematic diagram of an interface for editing a moment video provided by the present application;
[0090] Fig.10 This is a schematic diagram of an interface for displaying a video at a certain time in a display area provided by this application;
[0091] Fig.11 This is an example flow chart of the method for generating a moment video provided by the present application;
[0092] Fig.12 is a schematic diagram of a software system of an electronic device suitable for the present application. DETAILED DESCRIPTION
[0093] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings.
[0094] In the embodiments of the present application, unless otherwise specified, “plurality” may mean two or more than two.
[0095] The embodiment of the present application can be applied to an electronic device. The electronic device has a gallery application installed therein.
[0096] In some embodiments of the present application, the electronic device may be a mobile phone, a smart screen, a tablet computer, a wearable electronic device, an in-vehicle electronic device, an augmented reality (AR) device, a virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a projector, and the like.
[0097] The following uses a mobile phone as an example. Figure 1 A schematic structural diagram of an electronic device 100 provided in an embodiment of the present application is shown. Figure 1 A hardware system of an electronic device suitable for the present application is shown.
[0098] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0099] It should be noted that Figure 1 The structure shown does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include Figure 1More or fewer components than those shown, or the electronic device 100 may include Figure 1 Combinations of some of the components shown, or the electronic device 100 may include Figure 1 Subassemblies of some of the components shown. Figure 1 The components shown may be implemented in hardware, software, or a combination of software and hardware.
[0100] The processor 110 may include one or more processing units. For example, the processor 110 may include at least one of the following processing units: an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and a neural-network processing unit (NPU). Different processing units may be independent devices or integrated devices.
[0101] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.
[0102] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0103] In some embodiments, the processor 110 may include one or more interfaces. For example, the processor 110 may include at least one of the following interfaces: an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a SIM interface, and a USB interface. Figure 1 The connection relationship between the modules shown is only a schematic illustration and does not constitute a limitation on the connection relationship between the modules of the electronic device 100. Optionally, the modules of the electronic device 100 may also adopt a combination of multiple connection modes in the above embodiments.
[0104] The electronic device 100 can realize the display function through the GPU, the display screen 194 and the application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.
[0105] The display screen 194 can be used to display images or videos. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini light-emitting diode (Mini LED), a micro light-emitting diode (Micro LED), a micro OLED (Micro OLED) or a quantum dot light emitting diode (QLED). In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.
[0106] The electronic device 100 can realize the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194 and the application processor.
[0107] The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can perform algorithm optimization on the noise, brightness and color of the image. The ISP can also optimize the exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.
[0108] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard red green blue (RGB), YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0109] Digital signal processors are used to process digital signals. In addition to processing digital image signals, they can also process other digital signals.
[0110] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.
[0111] NPU is a processor that draws on the structure of biological neural networks, such as the transmission mode between neurons in the human brain to quickly process input information, and can also continuously self-learn. Through NPU, the electronic device 100 can realize intelligent cognition and other functions, such as image recognition, face recognition, voice recognition and text understanding.
[0112] The external memory interface 120 may be used to connect an external memory card, such as a secure digital (SD) card, to expand the storage capacity of the electronic device 100 .
[0113] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, and at least one application required for a function (for example, a sound playback function and an image playback function). The data storage area may store data created during the use of the electronic device 100 (for example, audio data and a phone book). In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as: at least one disk storage device, a flash memory device, and a universal flash storage (UFS). The processor 110 executes various processing methods of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.
[0114] The electronic device 100 can implement audio functions, such as music playing and recording, through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor.
[0115] The touch sensor 180K is also called a touch control device. The touch sensor 180K can be set on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, which is also called a touch control screen. The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor 180K can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100 and set at a different position from the display screen 194.
[0116] The key 190 includes a power key and a volume key. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive a key input signal and implement a function related to the key input signal.
[0117] The technical solutions involved in the following embodiments can all be implemented in the electronic device 100 having the above hardware architecture.
[0118] For ease of understanding, the following embodiments of the present application will be described in detail with Figure 1 Taking the electronic device with the structure shown as an example, the video recording method provided in the embodiment of the present application is specifically described in combination with the figure and application scenarios.
[0119] This application will take the electronic device as a mobile phone, in which a camera application and a gallery application are installed as an example, and will introduce in detail the video processing method provided by this application.
[0120] The following combination Figure 2 Describe the application scenarios of the embodiments of the present application. Figure 2 , Figure 2 It is a schematic diagram of a graphical user interface (GUI) provided in an embodiment of the present application.
[0121] For example, Figure 2 As shown in (1), the screen display system of the mobile phone displays the current output interface content, and the interface content displays multiple applications (applications, Apps). The user can click on the "Gallery" application icon 201 on the mobile phone desktop; the mobile phone responds to the user's operation of clicking on the "Gallery" application icon 201, opens the gallery application, and the mobile phone displays as shown in Figure 2 The interface of the gallery application shown in (2).
[0122] For another example, the user may also input a voice command through voice control; in response to the voice command input by the user, based on the content recognized by the voice command, the mobile phone opens the gallery application and may also display the following content: Figure 2 The interface shown in (2).
[0123] For another example, when the mobile phone is running other applications and the gallery application is running in the background, the user can also enter the gallery application through the multitasking interface. The embodiment of the present application does not specifically limit the method of entering the gallery application.
[0124] like Figure 2 As shown in (2), the gallery application interface includes different types of tabs, namely: photo page, album page, moment page and creation page (or named discovery page). The gallery application interface displays the photo page by default. The photo page is used to display all photos taken or saved by the user. The album page is used to display the albums corresponding to the classified and saved photos. The moment page is used to display the generated moment video. The creation page is used to freely create or puzzle based on the photos selected by the user.
[0125] Figure 2 (2) shows the interface of the photo page, which includes thumbnails of multiple photos. For example, thumbnails of photo 202, thumbnails of photo 203, and thumbnails of photo 204. Among them, photos 202 and photo 203 include portraits, and photo 204 is a landscape photo and does not include a portrait. For any photo thumbnail in the interface, in response to the user clicking on the photo thumbnail, the mobile phone displays a large picture of the photo.
[0126] When the user clicks Figure 2 The photo 202 shown in (2) can be viewed in large size. The interface of the mobile phone is as follows: Figure 2The interface shown in (3) in FIG. 202 includes two portraits. Figure 2 The interface shown in (3) includes options such as share, favorite, edit, delete, and more. If the user clicks share, the photo 202 can be shared; if the user clicks favorite, the photo 202 can be favorited in a folder; if the user clicks edit, the photo 202 can be edited; if the user clicks delete, the photo 202 can be deleted; if the user clicks more, other operations on the photo 202 (such as moving, copying, adding notes, hiding, renaming, etc.) can be performed. Figure 2 The interface shown in (3) also includes time information and a return control. The time information is used to display the shooting time of the photo 202. If the user clicks the return control, it will return to Figure 2 The interface shown in (2).
[0127] It should be understood that this is only Figure 2 The description is made by taking the example that the photo shown in (3) contains two portraits, but the present application embodiment is not limited thereto. In fact, the photo may contain one portrait or more than two portraits.
[0128] When a user browses a photo containing a person's portrait (e.g., photo 202), the user wants to view historical photos related to the person's portrait. However, in the related art, the user cannot view the historical photos, or needs to return to the main interface of the gallery application, enter the album page or other pages, find the person's tag information, find the related person from the person's tag, and then view the photos related to the person, which is inconvenient.
[0129] The present application provides an interactive method. In order to recommend photos related to the portrait to the user and generate a moment video, the present application embodiment adds an entry for the "Generate Moment" function in the gallery application. Through this entry, the mobile phone can actively generate a moment video of the target portrait for the user, which is easy to operate.
[0130] The embodiment of the present application provides multiple entrances to the "generate time" function.
[0131] In a possible implementation, when a user browses a large picture in a gallery, if a portrait is included in the large picture, in response to the user sliding the screen upward on the picture, the mobile phone displays an entry for the "Generate Moment" function below the picture. Figures 3A to 5 Describes the entry point for the first "generate moment" function.
[0132] Figure 3A An example diagram of a GUI for generating a moment video in an embodiment of the present application is shown. Figure 3AThe interface shown in (1) is the interface of the gallery application, which includes a large picture of a photo (for example, photo 202). The photo contains two portraits. The user swipes up on the interface, and the mobile phone responds to the user's swipe up operation and can display the following Figure 3A The interface shown in (2) in the figure can be used to enter the entrance of the "Generate Time" function. Figure 3A Slide the screen upwards from the dotted arrow area shown in (1) to display the following interface: Figure 3A The interface shown in (2). Figure 3A The interface shown in (2) can be understood as a sliding page up to the large image of the photo.
[0133] like Figure 3A The interface described in (2) includes a portion of the content or a portion of the area of photo 202, card 301, card 302 and card 304. Card 301 is used to display the portrait or character label image contained in the photo. If the user clicks on a character label image, the mobile phone will display photos related to the character label image (or display the cluster of the character label image).
[0134] For example, the portraits displayed in card 301 are labeled images of "A" and "B". Card 302 is used to display the entrance of control 303 of the "generate moment" function. In addition, card 302 may also include other prompt information to prompt the user of the "generate moment" function, for example, the prompt content is "intelligent analysis generates portrait wonderful moments". Card 304 is used to display the location of the photo in the form of a map, for example, the geographical location of the photo when it was taken.
[0135] It should be noted that the name of the portrait can be pre-added by the user. For a portrait without a name, when the thumbnail of the portrait is displayed in the card 301, the corresponding content displayed below the thumbnail of the portrait can be "unnamed" or "no name added" or the like.
[0136] Furthermore, for a portrait without a name, the mobile phone can add a name to it in response to the user's operation of clicking the portrait in the card 301. For example, in response to the user's operation of clicking "portrait without a name" in the card 301, the mobile phone pops up a window in the interface, and the window includes an input field. In response to the user's operation of entering a name through the input field, the portrait is named.
[0137] Control 303 can be understood as a button. When the user clicks control 303, the mobile phone analyzes the data in the gallery in response to the user's operation of clicking control 303, searches for multiple photos containing both portrait A and portrait B (or a group photo of portrait A and portrait B), and generates a moment video using the multiple photos containing both portrait A and portrait B.
[0138] For example, the interface of the generated moment video is displayed as follows Figure 3A As shown in (4). Figure 3A As shown in (4), the cover of the moment video generated by immersive display, or the moment playback page. Immersive display refers to the display method in which the picture fills the mobile phone screen. The cover of the generated video includes text information and time information. The text information can be generated based on the photo. For example, the text of the photo can be the name corresponding to the portrait, or the name of the shooting location, etc. Alternatively, the text information is text that is intelligently matched or intelligently generated based on the content of the photo (or the picture information). The time information refers to the time when the moment is generated. In some embodiments, the text information and time information are only displayed in the first frame of the generated moment video, that is, when the "A and B moment video" is dynamically played, other frames no longer display the text information and the time information. Dynamic playback of "A and B moment video" can be understood as playing the photos used to generate the video in chronological order (for example, from the oldest to the most recent time order).
[0139] It should be noted that, for a portrait without a name, after generating its moment video, the caption information of the moment video can be captioned with other texts, such as: "figure", "this person's moment", etc.
[0140] Understandably, Figure 3A The interface shown in (4) is only the display of the first frame of the generated moment video of the portrait A and the portrait B, and will not stay on this interface. In addition, in the subsequent playback process, other frames will not display the accompanying text information and the time information.
[0141] It should also be noted that Figure 3A (1) is described by taking a photo containing a portrait as an example, that is, when a portrait is detected, the mobile phone displays a Figure 3A The interface in (2) will include a moment card, and further include an entry or button (e.g., control 303) for the "generate moment" function. However, if no portrait is detected, the entry for the "generate moment" function will not be displayed to the user.
[0142] The following combination Figure 3B Describes a situation where a user views a photo that does not include a person. Figure 3B An example diagram of another GUI for generating moment videos according to an embodiment of the present application is shown. Figure 3B The interface shown in (1) includes a thumbnail of photo 204, which is a landscape photo. Photo 204 does not include a portrait. If the user clicks Figure 3BIn (1), in response to the user clicking on the thumbnail of photo 204, the mobile phone displays a large image of photo 204, such as Figure 3B In response to the user sliding up on the display interface of the large picture of photo 204, the mobile phone displays the following Figure 3B The interface shown in (3) is shown in the figure. Figure 3B The interface shown in (3) includes a card 306, and the card 306 is used to display the shooting location information of the photo 204. In addition, Figure 3B The interface shown in (3) does not include a moment card, nor does it include an entry or button (eg, control 303) for the "generate moment" function, but may include information about the location where the photo was taken.
[0143] In addition, the above is not yet generated Figure 3A Take the video corresponding to the photo shown in (1) as an example. Figure 3A The photo shown in (1) has been actively clustered by other photos to generate a time-lapse video. After swiping up, the interface displays the following: Fig. 9 The interface shown in (1).
[0144] In some embodiments, if the time required to generate the moment video is short, or the generation speed is fast, then after the user clicks the "Generate Moment" function, they can directly jump to the above-mentioned "immersive display of the generated moment video cover". If the time required to generate the moment video is long, or the generation speed is slow, then the loading status can be displayed in the card 302 while the user is waiting. For example, Figure 3A In the interface shown in (3), the dynamic icon 305 displayed in the control 303 is used to indicate that it is currently loading.
[0145] It is understood that the loading pattern shown in the dynamic icon 305 is only an example description. In the process of waiting for the generation of the moment video, the dynamic icon 305 can change dynamically (such as by changing dynamically in a circle). Through the dynamic icon 305, the user can know that the moment video is currently being generated.
[0146] That is, after the user clicks control 303, it may jump directly to Figure 3A The interface shown in (4) may also be displayed first. Figure 3A The interface shown in (3) will automatically jump to the Figure 3A The interface shown in (4).
[0147] In addition, when the moment video is generated, the content contained in the card 302 of the slide-up large picture page of the photo will be updated accordingly. Optionally, the user can Figure 3AWhen the sliding operation is performed in the sliding area shown in (4), the user can return to the large picture upper sliding page. At this time, the content contained in the card 302 in the large picture upper sliding page has been updated accordingly, that is, the generated moment video is synchronously updated to the large picture upper sliding page of the corresponding photo and displayed in the form of thumbnails. For example, the interface displays as shown in Fig. 9 As shown in (3), the card 302 will include a thumbnail 901 of the generated moment video.
[0148] It should be understood that Figure 3A The side sliding area shown in (4) is located at the right edge area of the screen, and the side sliding area is only an example description, and the embodiment of the present application is not limited thereto. For example, the side sliding area may also be located at the left edge area of the screen.
[0149] In some embodiments, during the process of generating a moment video, when the user exits the application and enters other applications, assuming that the process of the gallery application is interrupted (for example, the process of the gallery application is cleared or closed, or in other words, in response to the user's operation of closing the gallery application process, the mobile phone stops running the gallery application process), then the process of generating the moment video is interrupted, that is, the photo analysis process is no longer performed; assuming that the process of the gallery application is not cleared, then when the user enters the gallery application again, in response to the user's operation of opening the gallery application again, the content displayed on the interface of the mobile phone depends on whether the moment video has been completed, specifically including: if the moment video has been completed, then the playback page of the moment video is displayed (for example, Figure 3A (4)); if the moment video is still loading, then the loading status of the moment video is displayed (for example, Figure 3A The interface shown in (3)).
[0150] It should be noted that the process of generating the moment video cannot be interrupted. For example, Figure 3A When the user enters the interface shown in (3) in the figure, the user cannot exit from the loading interface to view other photos. However, the gallery application can be returned to the background. After the gallery application is returned to the background, the gallery application is still executing the process of generating moments. In this way, when the user enters the gallery application again, if the moment video has been generated, in response to the user clicking the gallery application again, the mobile phone displays the playback page of the moment video (for example, Figure 3A The interface shown in (4)).
[0151] When generating a moment video based on the currently viewed photo, in some cases, it may be impossible to generate a moment video. The inability to generate a moment video may be due to the following reasons: the number of photos contained in the gallery is limited, the number of relevant portrait photos is small or even no, or the number of portraits contained in the currently viewed photo exceeds the preset threshold, which exceeds the analysis capability of the gallery application, or the photo 202 mentioned above is a photo that the user has just taken, for example, after taking photo 202 in the camera application, directly enter the gallery entrance of the camera interface Figure 2 The interface shown in (3) in FIG. Regardless of the reason, a prompt message can be used to give a prompt to the user.
[0152] for example, Figure 4 FIG. 1 is an example of a prompt window when the video cannot be generated. Figure 3A When the control 303 shown in (2) is clicked, assuming that, except for the photo 202 currently browsed by the user, no other photo containing both the portrait A and the portrait B is found in the gallery application, the mobile phone responds to the user clicking the control 303 by displaying the following Figure 4 The interface shown in , includes window 401. Window 401 prompts the user that no relevant photos are found. The text prompt included in window 401 is "No relevant portrait photos are found. It is recommended to take more relevant portrait photos and charge the screen to increase the generation rate". Optionally, window 401 also includes an "Got it" option. When the user clicks the "Got it" option in window 401, the mobile phone responds to the user's operation of clicking the "Got it" option, and the mobile phone no longer displays window 401, that is, window 401 displayed in the interface disappears. Alternatively, the user does not perform any operation after seeing window 401, and after a preset period of time, the mobile phone no longer displays window 401, that is, window 401 displayed in the interface automatically disappears.
[0153] In some embodiments, if the photo browsed by the user contains too many portraits, which exceeds the analysis capability of the gallery application, in response to the user clicking the Generate Moment function, the gallery application cannot generate a moment video containing more than the preset number of portraits, and a prompt message will be displayed to the user at this time. For example, the photo browsed by the user is a group photo, that is, multiple portraits appear in the group photo.
[0154] Figure 5 Another example of a prompt window for when the video cannot be generated is shown in FIG. Figure 5 In the interface shown in (1), the photos browsed by the user include 10 portraits. When the user slides the screen upward, the interface displays the following Figure 5 As shown in (2). Figure 5In the interface shown in (2), 10 recognized portraits are sequentially displayed in card 301 (due to size limitations, only some portraits are shown in the figure). The embodiment of the present application does not specifically limit the display method of the 10 portraits in card 301. For example, among the 10 portrait thumbnails, only thumbnails of 3 portraits are displayed in card 301. In response to the user's sliding screen operation in card 301 (sliding the screen to the left or sliding the screen to the right), the mobile phone displays thumbnails of other portraits in card 301. For another example, all the thumbnails of the 10 portraits can be displayed in card 301.
[0155] The functions of card 302 and card 304 can be referred to Figure 3A The description of Figure 5 When the control 303 in the card 302 shown in (2) is clicked, the interface is displayed as follows Figure 5 The interface shown in (3).
[0156] Assume that the upper limit of the number of portraits is 10. Figure 5 The number of portraits in the photo shown in (1) is 10, which has reached the upper limit. The phone displays the following Figure 5 The interface shown in (3) in the figure. The interface includes a window 402, which is used to prompt the user why the moment video cannot be generated. For example, the content of the window 402 is "The number of portraits exceeds the upper limit; there are too many portraits in the photo, please select other portraits to generate."
[0157] It should be understood that the above upper limit is only an example description, and the embodiment of the present application does not specifically limit the upper limit of the number of portraits. The upper limit can be a reasonable value set based on actual needs.
[0158] Optionally, the window 402 also includes an "I know" option. The disappearance mechanism of the window 402 can refer to the description of the window 401 above, which will not be repeated here.
[0159] In some embodiments, for multiple photos that have just been taken, if the screen of the mobile phone has not been turned off from the time when the photo is taken to the time when the user clicks to view the photo that has just been taken, in response to the user clicking on one of the multiple photos, the mobile phone displays a large image of the photo; in response to the user swiping up on the large image interface (see, for example, Figure 3A The interface shown in (1) in the figure), the mobile phone displays the entry of the generated time (refer to Figure 3A In the interface shown in (2) above, in response to the user clicking on the entry for generating the moment, a moment video of the portrait is generated.
[0160] That is, in response to the user's photo-taking operation, the mobile phone continuously takes multiple portrait photos (such as portrait Z) within a period of time. For a photo that the user is viewing in large image, in response to the user's swiping up operation on the large image interface of the photo (see Figure 3A The interface shown in (1) in the figure), the mobile phone displays the entry of the generated time (refer to Figure 3A In the interface shown in (2) in the figure, in response to the user clicking on the entry for generating a moment, a moment video of the portrait Z is generated. In addition, since the screen is not turned off, the gallery application does not perform an analysis operation on these continuously shot photos. Therefore, when the mobile phone generates a moment video, it can use the photo of the portrait Z in the gallery application to generate a moment video. However, other photos of the above-mentioned multiple continuously shot portrait photos, excluding the photo currently being viewed, cannot be used to generate a moment video, even if it is a photo of the portrait Z.
[0161] Combination of the above Figures 3A to 5 The first entry of the "generate moment" function is introduced, and the embodiment of the present application also provides another entry of the generate moment function. The entry of the "generate moment" function is located on the moment page in the gallery application.
[0162] In some embodiments, a function entry for generating moment videos is added to the moment page of the gallery application. The difference from the function entry for generating moment videos when browsing photos is that after clicking the function entry for generating moment videos on the moment page, it is necessary to further select portraits to determine which portraits are related to which moment videos to generate. When generating moment videos when browsing photos, the gallery application can automatically identify portraits based on the photos browsed by the user, and generate related moment videos based on the identified portraits.
[0163] The following will be combined Figures 6 to 8 , describing an embodiment of adding a functional entry for generating moment videos to the moment page in a gallery application.
[0164] Figure 6 (1) shows the time page of the gallery application. For example, by clicking Figure 2 In (2), the "Moments" control is used to switch from the photo page to the moment page. Figure 6 The interface shown in (1) is shown in the figure. Figure 6The interface shown in (1) includes a control 501, a first display area, a second display area and a search bar. Control 501 is a functional entry for generating a moment video. The first display area is used to display the card of the latest generated moment video, for example, card 502 is a moment video generated on January 14, 2023; the second display area is used to display the card of the moment video generated at another time (for example, a time later than January 14, 2023). The card of the moment video generated by the embodiment of the present application can be displayed in the first display area or the second display area, and the specific display area depends on the time when the moment video is generated; if it is the latest generated moment video, it can be displayed in the first display area; if it is not the latest generated moment video, it is not displayed in the first display area. The search bar is used for users to enter search content (including but not limited to photos, people, places, etc.) in order to find the desired photos or videos based on the search content.
[0165] For example, the control 501 may be located in the upper right corner of the time page. Figure 6 The location of the control 501 on the moment page shown in (1) is only an example description, and the embodiments of the present application are not limited to this.
[0166] When the user clicks on the control 501, in response to the user's operation of clicking on the control 501, the mobile phone displays an interface for selecting a portrait, so that the user can select a desired portrait to generate a memory video. Figure 6 The interface shown in (2) shows the data of all portraits analyzed by the gallery application. The data of each portrait includes the number of photos corresponding to the portrait. For portraits to which the user has added a name, the portrait data also includes the name or title corresponding to the portrait; for portraits to which the user has not added a name, the portrait data does not include the name or title, but a prompt text "Add name" can be displayed in the portrait card to guide the user to name the portrait. Taking portrait 503 as an example, portrait 503 includes: portrait name (A), the number of photos related to portrait A (90), and check box 504. Photos related to A can be understood as: photos in which portrait A appears, such as photos of portrait A with others, personal photos of portrait A, etc. Check box 504 is used to display whether the portrait is selected by the user. When the user clicks on check box 504, it indicates that portrait 503 is selected.
[0167] Alternatively, if Figure 6 The multiple portrait data shown in (2) can be sorted in descending order according to the number. Alternatively, the multiple portrait data can also be sorted based on other factors, such as the close relationship with the owner, the frequency of appearance, etc., which is not specifically limited.
[0168] For example, when the user selects portrait 503 and portrait 505, the mobile phone responds to the user clicking on check items 504 and 506, and displays an interface such as Figure 6 As shown in (3). Figure 6 As shown in (3), the checkbox 504 in the portrait 503 and the checkbox 506 in the portrait 505 are in the selected state, and at the same time, the interface will also display a prompt content "2 items have been selected". When the user completes the portrait selection, the mobile phone responds to the user's operation of clicking icon 507, and the gallery application starts to analyze the photo data to generate a moment video.
[0169] Similarly, in the case where the user generates a moment video by selecting a portrait, if the time required to generate the moment video is short, or the generation speed is fast, then after the user clicks icon 507, the mobile phone can directly jump to the above-mentioned "immersive display of the generated moment video cover" in response to the user's operation of clicking icon 507. For example, Figure 6 The interface shown in (5) in the figure. If the time required to generate the moment video is long, or the generation speed is slow, the loading status can be displayed in a window while the user is waiting. For example, Figure 6 In the interface shown in (4), the dynamic icon 508 displayed in the window 509 is used to indicate that it is currently loading. The text "Generating portrait moment..." can also be displayed in the window 509 to remind the user that it is currently loading. It can be understood that the dynamic icon 508 is similar to the dynamic icon 305 described above, and the meaning of the dynamic icon 508 is not repeated here. Figure 6 The interface shown in (5) is similar to Figure 3A The interface shown in (4) is similar and the contents of the interface will not be described in detail.
[0170] Optionally, in response to the user Figure 6 The side sliding operation (sliding to the left or sliding to the right) performed on the interface shown in (5) can return to the interface of the time page, for example, Figure 6 In addition, if Figure 6 The video generated at the moment (5) is the latest one, so Figure 6 In the interface shown in (1), the video is displayed in the top display area (the first display area) at this moment; if Figure 6 The moment video generated in (5) is the video obtained by updating the generated moment video. Figure 6 In the interface shown in (1), the moment video is displayed in the corresponding display area (i.e., the display area where the generated moment video was originally located).
[0171] The embodiment of the present application does not specifically limit the way in which the user generates the moment video through which function entrance. It should be noted that if the user selects a portrait and the selected portrait has generated a related moment video, the moment video can be updated based on the portrait selected this time.
[0172] For example, through Figure 6 The method of selecting a portrait shown has generated a video of the moments "A and B". After a period of time (e.g., one day, one month, three months, etc.), the user enters the video again through Figure 6 The portrait selection interface shown in the figure selects portraits "A" and "B" again. In response to the user selecting portraits "A" and "B" again after a period of time, the mobile phone analyzes the image library data again, updates the generated moment video of "A and B", and obtains the updated moment video of "A and B".
[0173] For example, through Figure 3A The method of generating a moment video as shown in FIG. 1 (i.e., triggering the generation of a moment video when browsing a portrait) has generated the moment videos of “A and B”. The user then generates a moment video of “A and B” by Figure 6 The method of selecting portraits shown is to select portraits "A" and "B". At this time, analysis can also be performed based on the gallery data to update the already generated moment video of "A and B" to obtain an updated moment video of "A and B".
[0174] Of course, if the user selects a different portrait from the previous one when generating a moment video, or the moment video of the selected portrait has not been generated before, then the corresponding moment video is generated based on the portrait selected by the user. Figure 7 In the interface shown in (1), after the user selects portrait 601, portrait 602 and portrait 603, the user clicks icon 507. In response to the user clicking icon 507, the mobile phone generates a moment video of portrait 601, portrait 602 and portrait 603. The moment video of portrait 601, portrait 602 and portrait 603 is displayed. Figure 7 The interface shown in (2) is shown in the figure. Figure 7 As shown in (2), the cover of the moment video generated by the mobile phone based on the portrait 601, the portrait 602 and the portrait 603 includes the person corresponding to the portrait 601, the portrait 602 and the portrait 603. Similarly, in the process of selecting the portrait to generate the moment video, there may be a situation where the moment video cannot be generated. In this case, the user may be prompted through a prompt window.
[0175] In some embodiments, when the number of portraits selected by the user is insufficient, the gallery application cannot generate the corresponding moment video. For example, in response to the user selecting portrait A and portrait B, the mobile phone displays the following Figure 8The interface shown in (1) in the figure includes a window 801, through which a prompt is given to the user. The content of the window 801 is similar to the content of the window 401 in the previous text, and is not repeated here for the sake of brevity.
[0176] In some embodiments, when the number of portraits selected by the user exceeds a preset threshold, the gallery application cannot generate the corresponding moment video. For example, when the number of portraits selected by the user is 10, in response to the user selecting 10 portraits, the mobile phone displays the following Figure 8 The interface shown in (2) in FIG. 8 includes a window 802, through which a prompt is issued to the user. The content of the window 802 is similar to the content of the window 402 in the previous text, and for the sake of brevity, it is not repeated here.
[0177] Two entrances for generating moment videos are provided above. After the moment video is generated, when the user opens the large image page of the photo included in the moment video, in response to the user's upward sliding operation on the large image page, the moment video is included in the displayed interface.
[0178] Fig. 9 This is another example of a GUI interface provided by the embodiment of the present application. Fig. 9 As shown in (1), the interface includes a thumbnail of photo 203. Photo 203 and photo 202 contain the same portrait. For example, photo 203 and photo 202 are both group photos of portrait A and portrait B. In response to the user clicking Fig. 9 In the photo 203 shown in (1), the mobile phone displays Fig. 9 The interface shown in (2) includes a large image of the photo 203. It can be understood that Fig. 9 The interface shown in (2) may also include other controls, such as share, favorite, edit, delete, and more. The relevant explanations of each control have been described above and will not be repeated here.
[0179] For example, based on Figure 3A After the interface has generated the video corresponding to the portrait A and the portrait B in the photo 202, the user Fig. 9 In the interface shown in (2), the screen is swiped upwards according to the dotted arrow area. In response to the user's swiping up on the large image browsing page of photo 203, the interface is displayed as follows: Fig. 9 As shown in (3). Fig. 9 As shown in (3), the interface includes a card 302. The card 302 displays a thumbnail 901, i.e., the moment video card of "A and B".
[0180] Thumbnail 901 includes a play control 902. When the user clicks the play control 902, the mobile phone displays the play interface of the video at the moment "A and B" in response to the user's operation of clicking the play control 902, allowing the user to enter the immersive card playback. Immersive card playback is a playback method in which the picture fills the entire screen. As can be seen, Fig. 9 In the interface shown in (5), the picture fills the entire mobile phone screen.
[0181] Optionally, in some embodiments, the mobile phone responds to the user in Fig. 9 (2) Slide up the screen, the interface is displayed as follows Fig. 9 The interface shown in (4) is shown in FIG. Fig. 9 As shown in (4), the interface includes a card 302. The card 302 includes not only a thumbnail 901 and a play control 902, but also an update control 907. In response to the user clicking the update control 907, the mobile phone updates the generated "A and B" moment videos.
[0182] like Fig. 9 The interface shown in (5) includes controls 903, 904, 905, 906, a play progress bar, etc. Control 903 is a return control. When the user clicks on control 903, the mobile phone responds to the user's operation of clicking on control 903 and the mobile phone interface returns to Fig. 9 The interface shown in (3) or Fig. 9 The interface shown in (4) in FIG. 904 is used to provide editing operations to the user. Control 905 is a sharing control; when the user clicks on control 905, the mobile phone responds to the user's operation of clicking on control 905 and displays a sharing interface. Control 906 is a more information control; when the user clicks on control 906, the mobile phone responds to the user's operation of clicking on control 906 and displays a detailed information interface of the video at that moment for the user to view. The playback progress bar can also be called a slider bar. The user can adjust the playback progress by dragging the slider bar. For example, the video is currently playing to the 12th second, and the total duration is 56 seconds.
[0183] Optionally, the progress bar also includes a pause control and a speaker control. If the user clicks the pause control, the mobile phone pauses the video in response to the user clicking the pause control. If the user clicks the speaker control, the mobile phone plays the video in silence in response to the user clicking the speaker control.
[0184] in addition, Fig. 9The interface shown in (5) may also include other controls for editing the video at the bottom of the screen, such as template, music, filter, album, etc. If the user can click on the music control, the mobile phone will respond to the user's operation of clicking the music control and display music options in the interface, so that the user can select music for the video at that moment, such as soothing, romantic, warm, cozy, tranquil, etc. If the user clicks on the template control, the mobile phone will respond to the user's operation of clicking the template control and display template options in the interface, so that the user can process the video at that moment by applying the template. The template can be a template with a certain style or theme generated based on the theme, music, filter, etc. If the user clicks on the filter control, the mobile phone will respond to the user's operation of clicking the filter control and display filter options in the interface, so that the user can select a filter to color the video. Filters are a type of video special effects used to achieve various special effects of videos. If the user clicks on the album control, the mobile phone will respond to the user's operation of clicking the album control and jump to the interface, which displays all the photos used to generate the video, and these photos can be presented to the user in a grid format.
[0185] Optionally, for the moment video generated based on the portrait, the number of photos used may be less than or equal to a preset number.
[0186] It is understandable that the embodiment of the present application does not limit the duration of the generated moment video. For example, the generated moment video can be a 20-second wonderful short video generated based on a portrait, or a 1-minute wonderful short video.
[0187] Fig.10 The figure shows an example of an interface of the time page in the gallery application. Fig.10 As shown, the moment video displayed in the first display area and the moment video displayed in the second display area are generated at different times. The moment video displayed in the first display area is the most recently generated moment video. It can be understood that the moment videos displayed in the display area are all cards corresponding to the moment videos, and the cover of the card can be the photo with the highest aesthetic score in the moment video.
[0188] It should be noted that, for an already generated moment video, when the generated moment video is updated, the updated moment video is still displayed in the display area according to the position of the moment video before the update, that is, even if the generated moment video is updated, its display position in the display area will not change.
[0189] Understandably, Figures 2 to 10 The examples are only for the convenience of understanding of those skilled in the art and do not limit the protection scope of the embodiments of the present application.
[0190] Please refer to Fig.11, is a schematic flow chart of a video processing method provided in an embodiment of the present application. Fig.11 As shown, the method includes:
[0191] Step 701: In response to a first operation of a user, a first interface is displayed, wherein the first interface includes a thumbnail of a first photo, and the first photo includes a first portrait.
[0192] The first operation is to open the gallery application. Figure 2 In the interface shown in (1), the first operation is the user clicking on icon 201.
[0193] It should be understood that step 701 is described by taking the identification of one portrait in the first photo as an example, and the present application embodiment is not limited thereto. The first photo may contain two or more portraits. For example, assuming that the first photo includes two portraits, the first interface is Figure 2 In the interface shown in (2), the first photo is photo 202.
[0194] Step 702: In response to the user clicking on the thumbnail of the first photo, a second interface is displayed, where the second interface is used to display a browsing page of the first photo.
[0195] The second interface is a large picture interface showing the first photo. For example, the second interface can be Figure 2 The interface shown in (3).
[0196] Step 703: In response to a second operation of the user on the second interface, a third interface is displayed, wherein the third interface includes a first area, and the first area includes a first control.
[0197] The second operation may be an operation of sliding the screen upward. Figure 3A In the interface shown in (1), the second operation is the user sliding the screen upward according to the dotted arrow. The third interface may be Figure 3A The interface shown in (2) in FIG. 1 ; the first area may be Figure 3A The area corresponding to the card 302 shown in (2); the first control may be the control 303.
[0198] It is understandable that other information about the first photo can also be displayed in the third interface.
[0199] Optionally, the third interface also includes a partial area of the first photo, a second area and / or a third area; the second area is used to display portrait tag information; and the third area is used to display shooting location information of the first photo.
[0200] Step 704: In response to the user's operation on the first control, a playback interface of a first video is displayed, wherein the first video includes a first photo and a second photo, and the second photo includes the first portrait.
[0201] Of course, when the number of portraits contained in the photo does not exceed the processing upper limit of the gallery application (for example, 10), the gallery application can generate a moment video related to the portraits.
[0202] Optionally, in some embodiments, the user's operation on the first control refers to: the user clicking the first control. Figure 3A Control 303 shown in (2).
[0203] The first video refers to the portrait moment video corresponding to the first photo, which can also be referred to as the moment video. For example, Figure 3A (4) shows the cover of the first video.
[0204] Optionally, when playing the generated first video, the photos used to generate the first video (i.e., the first photo and a preset number of second photos) can be played in sequence according to the time information. For example, the photos used to generate the first video can be played in order of increasing age and being played earlier.
[0205] In an embodiment of the present application, an entrance to the "Generate Moments" function is added to the gallery application. Through this entrance, the electronic device can generate moment videos related to the target portrait for the user to meet the user's desire to view historical memory moments related to the portrait, thereby greatly improving the user experience.
[0206] When a large number of group photos of the first person and the second person are identified or computing power is limited, the process of generating the first video requires a certain waiting time. While waiting for the first video to load, a dynamic icon can be displayed to the user to indicate that the video is currently loading.
[0207] Optionally, in some embodiments, during the process of generating the first video, the method further includes:
[0208] A dynamic icon is displayed in the first area, and the dynamic icon indicates that the first video is being generated.
[0209] Exemplarily, a dynamic icon may be Figure 3A Icon 305 in the interface shown in (3).
[0210] The above description is about the case where the first photo contains a portrait. For the case where the photo does not contain a portrait, for example, a photo of a landscape, after the large photo browsing page is swiped up, the electronic device will not display the function entrance at the time of generation.
[0211] Optionally, in some embodiments, the first interface further includes a thumbnail of a second photo, and the second photo does not include a portrait; the method further includes:
[0212] In response to a user clicking on a thumbnail of the second photo, displaying a fourth interface for displaying a browsing page of the second photo;
[0213] In response to a fourth operation of the user on the fourth interface, a fifth interface is displayed, and the fifth interface does not include the first control.
[0214] For example, the second photo is Figure 2 The fourth interface is Figure 3B The fifth interface is Figure 3B The interface shown in (3).
[0215] Optionally, in some embodiments, after displaying the playback interface of the first video, the method further includes:
[0216] In response to a fifth operation of the user on the playback interface of the first video, a sixth interface is displayed, wherein the sixth interface includes the first area, the first area does not include the first control, and the first area includes a thumbnail of the first video and a playback control;
[0217] In response to the user clicking the playback control, the playback interface of the first video is displayed.
[0218] That is, after the first video is generated, in response to the user's return operation (e.g., clicking Fig. 9 The mobile phone displays the sliding interface of the first photo, and the function entry (first control) originally used to display the creation time in the first area of the interface becomes the thumbnail of the first video and the play control. For example, the sixth interface can be Fig. 9 The interface shown in (3).
[0219] Optionally, in some embodiments, the first interface further includes a thumbnail of a third photo, and the third photo includes the first portrait; the method further includes:
[0220] In response to a user clicking on a thumbnail of the third photo, a ninth interface is displayed, wherein the ninth interface is used to display a browsing page of the third photo;
[0221] In response to the user's seventh operation on the ninth interface, a tenth interface is displayed, wherein the tenth interface includes the first area, and the first area includes a thumbnail of the first video and a playback control.
[0222] For example, assuming that the third photo includes two portraits, the third photo is Figure 2 The ninth interface is the photo 203 shown in (2). Fig. 9 The seventh operation is to follow Fig. 9 The dotted arrow shown in (1) slides upward. The tenth interface is Fig. 9 The interface shown in (3) or the interface shown in (4) in 9.
[0223] After the first video is generated, you can also update the first video. The following two methods are provided:
[0224] Method 1
[0225] Optionally, in some embodiments, the first area further includes a third control; and the method further includes:
[0226] In response to a user clicking on the third control, updating the first video;
[0227] After the update is completed, the playback interface of the updated first video is displayed.
[0228] The third control can be understood as an update control. Exemplarily, the third control is Fig. 9 The update control 907 shown in (4) .
[0229] Method 2
[0230] Optionally, in some embodiments, the method further comprises:
[0231] In response to the eighth operation of the user, an eleventh interface is displayed, where the eleventh interface is used to display a time page of the gallery application, and the eleventh interface includes a second control;
[0232] In response to the user clicking the second control, a twelfth interface is displayed, wherein the twelfth interface is used to display data of a plurality of portraits;
[0233] In response to a user selecting the first portrait, generating a third video, wherein the third video is a video that updates the first video;
[0234] The playback interface of the third video is displayed.
[0235] That is to say, after the first video is generated in response to the user clicking the first control, if the user enters the portrait selection interface at the Generate Moment function entrance on the Moment page of the Gallery application, and selects the target portrait as the first portrait to regenerate the corresponding moment video, then the mobile phone updates the first video in response to the user selecting the first portrait to obtain the third video.
[0236] When the first video cannot be generated, a pop-up window may be displayed to the user to remind the user. The following describes the situation where the first video cannot be generated in different scenarios.
[0237] Optionally, in some embodiments, the first interface further includes a thumbnail of a fourth photo, the fourth photo includes a second number of portraits, and the second number is greater than a second threshold; the method further includes:
[0238] In response to a user clicking on a thumbnail of the fourth photo, a thirteenth interface is displayed, wherein the thirteenth interface is used to display a browsing page of the fourth photo;
[0239] In response to a fourth operation of the user on the thirteenth interface (for example, an operation of sliding up the screen), displaying a fourteenth interface, wherein the fourteenth interface includes the first area, and the first area includes the first control;
[0240] In response to the user clicking the first control, a fifteenth interface is displayed, the fifteenth interface includes a first window, and the first window is used to prompt the user that the video cannot be generated.
[0241] That is, when the number of people in the photo is greater than the second threshold, the first video cannot be generated. Figure 5 The fourteenth interface is Figure 5 The fifteenth interface is Figure 5 In the interface shown in (3), the first window is Figure 5 Window 402 shown in (3).
[0242] Optionally, in some embodiments, the method further comprises:
[0243] In response to the user clicking the first control, a sixteenth interface is displayed, wherein the sixteenth interface includes a second window, and the second window is used to prompt the user that a video cannot be generated, wherein the number of photos including the first portrait is less than a first threshold.
[0244] Exemplarily, the sixteenth interface may be Figure 4 The interface shown in .
[0245] In addition to triggering the generation of the first video when browsing photos in the large picture, the embodiment of the present application also provides another entry for generating the first video, that is, adding a function entry for generating moments in the moment page of the gallery application to trigger the generation of the first video. It should be noted that the function entry for generating moments set on the moment page of the gallery application and the function entry set on the sliding page on the large picture of the photo mentioned above can be implemented independently or in combination, and there is no specific limitation on this.
[0246] Optionally, in some embodiments, the method further comprises:
[0247] In response to the sixth operation of the user, displaying a seventh interface, the seventh interface is used to display a moment page (also called a memory page) of the gallery application, and the seventh interface includes a second control;
[0248] In response to the user clicking the second control, an eighth interface is displayed, where the eighth interface is used to display data of a plurality of portraits;
[0249] In response to the user selecting the second portrait, a second video is generated, wherein the second video includes a photo of the second portrait.
[0250] Display the playback interface of the second video.
[0251] In response to a third operation of the user, displaying a third interface, the third interface is used to display a moment page (also referred to as a moment page) of the gallery application, and the third interface includes a third control;
[0252] In response to the user's operation on the third control, displaying a fourth interface, wherein the fourth interface is used to display data of the plurality of portraits;
[0253] In response to a user's operation of selecting the first portrait and the second portrait, the second video is generated, and the second video is used to update the first video.
[0254] Display the playback interface of the second video.
[0255] For example, the seventh interface is Figure 6 In the interface shown in (1), the second control is Figure 6 The eighth interface is Figure 6 The interface shown in (2).
[0256] Of course, users can select multiple people to generate corresponding videos. For example, Figure 6 In (3), the user selects portrait A and portrait B.
[0257] Similarly, in some embodiments, when a user actively selects a target person portrait to generate a video, it may be impossible to generate the video. In this case, a prompt may be given to the user through a window.
[0258] Optionally, in some embodiments, the method further comprises:
[0259] In response to the user selecting the third portrait, the seventeenth interface is displayed, the seventeenth interface includes a third window, and the third window is used to prompt the user that the video cannot be generated; wherein the number of photos including the third portrait is less than a third threshold.
[0260] For example, the seventeenth interface can be Figure 8 In the interface shown in (1), the third window is window 801.
[0261] Optionally, in some embodiments, the method further comprises:
[0262] After displaying the eighth interface, the method further includes:
[0263] In response to the user selecting a third number of portraits, an eighteenth interface is displayed, the eighteenth interface including a fourth window, the fourth window being used to prompt the user that a video cannot be generated; wherein the third number is greater than a fourth threshold.
[0264] For example, the eighteenth interface can be Figure 8 In the interface shown in (2), the fourth window is window 802.
[0265] Optionally, in some embodiments, before generating the first video, the method further includes:
[0266] Based on the first portrait, obtaining a plurality of second photos;
[0267] Selecting a first number of second photos from the plurality of second photos according to a principle of uniform time distribution;
[0268] From the first number of second photos, a second number of second photos are selected according to the principle of timeline from oldest to most recent, and the preset number is the second number;
[0269] The step of generating the first video includes:
[0270] The first video is generated based on the second number of second photos and the first photos.
[0271] That is to say, before generating the first video, you need to preliminarily select photos that meet the requirements in the gallery. Photos that meet the requirements refer to photos that meet the portrait requirements, or photos that contain the target portrait. For example, if you want to generate a moment video of the first portrait, then the photo that meets the requirements refers to a single photo of the first portrait. For another example, if you want to generate a moment video of the first portrait and the second portrait, then the photo that meets the requirements refers to a group photo of the first portrait and the second portrait, and the group photo does not include other portraits except the first portrait and the second portrait. Of course, optionally, you can also set other requirements for preliminary screening, such as the clarity of the photo, etc.
[0272] For multiple photos that meet the requirements, a first number of photos can be selected based on the principle of uniform distribution over time; then a second number of photos can be selected from the first number of photos based on the principle of a timeline from oldest to most recent, and a first video can be generated based on the second number of photos.
[0273] For example, the photos taken by users in a certain period of time are relatively dense. In order to avoid selecting too many photos in a certain period of time, the photos of the first data can be selected according to the principle of uniform distribution over time.
[0274] Optionally, in some embodiments, selecting a first number of second photos from the plurality of second photos according to a principle of uniform time distribution includes any of the following situations:
[0275] When the number of the plurality of second photos is less than or equal to a first threshold, selecting all of the plurality of second photos;
[0276] When the number of the plurality of second photos is greater than the first threshold, and the number of months corresponding to the second photos in the plurality of second photos is less than the first threshold, selecting the preset number of second photos based on a first strategy, wherein the first strategy refers to: performing multiple rounds of photo selection based on month information until a first number of second photos are obtained;
[0277] When the number of months corresponding to the second photos of the plurality of second photos is greater than the first threshold, the first number of second photos are selected based on a second strategy, wherein the second strategy is to select photos based on month information and photo rating information.
[0278] Taking the video that needs to generate the first portrait and the second portrait as an example, when the generation of the first video is triggered, the photos containing the first portrait and the second portrait can be filtered out from all the photos in the gallery application. Assuming that the first threshold is 100, if the number of the multiple second photos is less than 100, then all are selected. If the number of the multiple second photos is greater than or equal to 100, and the number of months corresponding to the first number of second photos is less than 100 months, then multiple rounds of photo selection can be performed until 100 photos are selected, and each round of photo selection refers to selecting a second photo from each month according to the month. If the number of the multiple second photos is greater than 100, and the number of months corresponding to the number of the multiple second photos is greater than or equal to 100 months, select the second photo with the highest aesthetic score from each month to obtain 100 second photos.
[0279] Optionally, in some embodiments, a second number of second photos is selected from the first number of second photos according to the principle of timeline from oldest to most recent, and the preset number is the second number, including:
[0280] When the first number is less than or equal to a second threshold, selecting all of the plurality of second photos;
[0281] When the first number is greater than the second threshold, a second number of second photos are selected from far to near according to the timeline.
[0282] For example, the second threshold is 50 photos. If the second photo selected in the previous text is 100 photos, then 50 photos can be selected in order of month from far to near.
[0283] Optionally, the first threshold and the second threshold may be different values or the same value, which is not specifically limited.
[0284] It should be noted that new photos (i.e. photos that did not exist when the moment video was generated, which may be photos newly taken by the user) may be used to update the moment video later. When updating the moment video, the aforementioned photo screening logic and the logic for generating the moment video may be re-executed, and the photos used when updating the moment video need to be selected.
[0285] It should be noted that the above logic of selecting photos is described based on the example of determining that the first photo is included, that is, if the user triggers the generation of the first video by sliding the page from the large picture of the first photo, then the generated first video must include the first photo. However, there is no such restriction when the first video is generated from the entrance of the moment page of the gallery application.
[0286] For example, assuming that a user generates a first video from the entrance of the moment page of the gallery application, after the user selects the first portrait and the second portrait, the photos are first selected based on the following logic: N photos (including the first portrait and the second portrait) that meet the requirements are preliminarily selected from the gallery application, assuming that the first threshold is 100, if N is less than 100, then N photos can be selected; if N is greater than 100, and the number of months corresponding to the N photos is less than 100 months, then multiple rounds of photo selection can be performed until 100 photos are selected, and each round of photo selection means selecting a photo from each month according to the month; if N is greater than 100, and the number of months corresponding to the N photos is greater than or equal to 100 months, the photo with the highest aesthetic score is selected from each month to obtain 100 photos. After selecting photos based on the above logic, assuming that M photos are obtained, the video of the first portrait and the second portrait can be generated based on the M photos according to the following logic: if M is less than or equal to 50, then M photos are selected to generate a video; if M is greater than 50, then 50 photos are selected in order from far to near months to generate a video. For example, when N is less than 100 photos, if new photos are added to the database, the user can reselect the first portrait and the second portrait to generate the first video, thereby updating the first video.
[0287] It can be understood that the quantity thresholds involved in each of the above-mentioned implementation methods can be set to reasonable values based on actual needs, and the embodiments of the present application do not make specific limitations on this.
[0288] Fig.12 1 is a schematic diagram of the software structure of the electronic device 100 of the embodiment of the present application. The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system can be divided into five layers, from top to bottom, namely, the application (APP) layer, the application framework layer (abbreviated as FWK), the system library and the kernel layer.
[0289] The application layer can include a series of application packages. For example, Fig.12 As shown, the application layer includes a camera application and a gallery application.
[0290] It is understandable that the application layer may also include other applications, such as calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, browser, WeChat, Alipay, Taobao and other applications.
[0291] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer may include some predefined functions.
[0292] It can be understood that the application framework layer may also include other contents, such as a window manager, a content provider, a view system, a phone manager, a resource manager, and a notification manager.
[0293] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, and capture the screen.
[0294] Content providers are used to store and retrieve data and make it accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, and phone books.
[0295] The view system includes visual controls, such as controls for displaying text and controls for displaying pictures. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying pictures. The application layer and the application framework layer run in a virtual machine. The virtual machine executes the java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
[0296] like Fig.12 As shown, the system library may include camera service functionality.
[0297] The system library may also include multiple functional modules, such as: a surface manager, a media library, a 3D graphics processing library (such as: an open graphics library for embedded systems (OpenGL ES)) and a 2D graphics engine (such as: the skia graphics library (SGL)).
[0298] The surface manager is used to manage the display subsystem and provide the fusion of 2D layers and 3D layers for multiple applications.
[0299] The media library supports playback and recording of multiple audio formats, playback and recording of multiple video formats, and still image files. The media library can support multiple audio and video coding formats, such as: MPEG4, H.264, moving picture experts group audio layer III (MP3), advanced audio coding (AAC), adaptive multi-rate (AMR), joint photographic experts group (JPG) and portable network graphics (PNG).
[0300] The 3D graphics processing library can be used to implement 3D graphics drawing, image rendering, compositing and layer processing.
[0301] A 2D graphics engine is a drawing engine for 2D drawings.
[0302] The kernel layer is the layer between hardware and software. Fig.12As shown, the kernel layer may include driver modules such as a power management module, a display driver, and a camera driver. Among them, the camera driver is the driver layer of the camera device, which is mainly responsible for the interaction with the hardware. Optionally, the power management module can report the charging event to the application layer, such as the gallery application, so that the gallery application performs photo analysis when the electronic device is in a charging state, which helps to save power consumption.
[0303] Taking the gallery application as an example, the gallery application in the application layer can be displayed on the screen of the electronic device in the form of an icon. When the icon of the gallery application is triggered, the electronic device runs the camera application. The gallery application runs on the electronic device, and the electronic device can send corresponding touch events to the driver layer according to the user's operation. When the touch screen receives the touch event, the gallery application is started, and the gallery page is displayed on the screen by calling the display startup of the driver layer.
[0304] Exemplarily, the gallery application in the application layer receives a viewing operation triggered by a user, the viewing operation being used to view pushed photos or videos. The gallery application displays the pushed photos or videos on a display screen by calling a display driver.
[0305] From the above, it can be seen that the video processing method provided by the present application adds an entry for the "Generate Moments" function in the gallery application so as to generate moment videos related to portraits, so as to meet the needs of users who want to view historical memory moments related to the portraits, thereby intuitively perceiving the changes brought about to the object by the passage of time, greatly improving the user experience.
[0306] The present application also provides a computer program product, which, when executed by a processor, implements the method described in any method embodiment of the present application.
[0307] The computer program product can be stored in a memory, and is finally converted into an executable target file that can be executed by a processor after preprocessing, compiling, assembling and linking.
[0308] The present application also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a computer, the method described in any method embodiment of the present application is implemented. The computer program can be a high-level language program or an executable target program.
[0309] The computer-readable storage medium may be a volatile memory or a nonvolatile memory, or may include both a volatile memory and a nonvolatile memory. The nonvolatile memory may be a read-only memory (ROM), a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM bus RAM (DR RAM).
[0310] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described devices and equipment and the technical effects produced can refer to the corresponding processes and technical effects in the aforementioned method embodiments, and will not be repeated here.
[0311] In several embodiments provided in the present application, the disclosed systems, devices and methods can be implemented in other ways. For example, some features of the method embodiments described above can be ignored or not performed. The device embodiments described above are merely schematic, and the division of units is only a logical function division. There may be other division methods in actual implementation, and multiple units or components may be combined or integrated into another system. In addition, the coupling between the units or the coupling between the components may be direct coupling or indirect coupling, and the above coupling includes electrical, mechanical or other forms of connection.
[0312] It should be understood that in the various embodiments of the present application, the size of the serial number of each process does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0313] In addition, the terms "system" and "network" are often used interchangeably in this article. The term "and / or" in this article is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.
[0314] In short, the above is only a preferred embodiment of the technical solution of this application, and is not intended to limit the protection scope of this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application should be included in the protection scope of this application.
Claims
1. A video processing method, characterized in that: include: In response to a first operation of the user, displaying a first interface, wherein the first interface includes a thumbnail of a first photo, and the first photo includes a first portrait; In response to a user clicking on a thumbnail of the first photo, displaying a second interface for displaying a browsing page of the first photo; In response to a second operation of the user on the second interface, displaying a third interface, wherein the third interface includes a first area, and the first area includes a first control; In response to a user clicking on the first control, a playback interface of a first video is displayed; the first video includes the first photo and a second photo, and the second photo includes the first portrait.
2. The method according to claim 1, characterized in that The first interface also includes a thumbnail of a second photo, and the second photo does not include a portrait; and the method further includes: In response to a user clicking on a thumbnail of the second photo, displaying a fourth interface for displaying a browsing page of the second photo; In response to a fourth operation of the user on the fourth interface, a fifth interface is displayed, and the fifth interface does not include the first control.
3. The method according to claim 1 or 2, characterized in that: After displaying the playback interface of the first video, the method further includes: In response to a fifth operation of the user on the playback interface of the first video, a sixth interface is displayed, wherein the sixth interface includes the first area, the first area does not include the first control, and the first area includes a thumbnail of the first video and a playback control; In response to the user clicking the playback control, the playback interface of the first video is displayed.
4. The method according to any one of claims 1 to 3, characterized in that The method further comprises: In response to a sixth operation of the user, displaying a seventh interface, the seventh interface being used to display a moment page of the gallery application, the seventh interface including a second control; In response to the user clicking the second control, an eighth interface is displayed, where the eighth interface is used to display data of a plurality of portraits; In response to a user selecting a second portrait, generating a second video, wherein the second video includes a photo of the second portrait; Display the playback interface of the second video.
5. The method according to any one of claims 1 to 4, characterized in that The first interface also includes a thumbnail of a third photo, and the third photo includes the first portrait; and the method further includes: In response to a user clicking on a thumbnail of the third photo, a ninth interface is displayed, wherein the ninth interface is used to display a browsing page of the third photo; In response to the user's seventh operation on the ninth interface, the tenth interface is displayed, and the fifth interface includes the first area, and the first area includes a thumbnail of the first video and a playback control.
6. The method according to claim 5, characterized in that The first area also includes a third control; the method further includes: In response to a user clicking on the third control, updating the first video; After the update is completed, the playback interface of the updated first video is displayed.
7. The method according to claim 5, characterized in that The method further comprises: In response to the eighth operation of the user, an eleventh interface is displayed, where the eleventh interface is used to display a time page of the gallery application, and the eleventh interface includes a second control; In response to the user clicking the second control, a twelfth interface is displayed, wherein the twelfth interface is used to display data of a plurality of portraits; In response to a user selecting the first portrait, generating a third video, wherein the third video is a video that updates the first video; The playback interface of the third video is displayed.
8. The method according to any one of claims 1 to 7, characterized in that The third interface also includes a partial area of the first photo, a second area and / or a third area; the second area is used to display portrait tag information; and the third area is used to display shooting location information of the first photo.
9. The method according to any one of claims 1 to 7, characterized in that The first interface further includes a thumbnail of a fourth photo, the fourth photo includes a second number of portraits, and the second number is greater than a second threshold; the method further includes: In response to a user clicking on a thumbnail of the fourth photo, a thirteenth interface is displayed, wherein the thirteenth interface is used to display a browsing page of the fourth photo; In response to a fourth operation of the user on the thirteenth interface, displaying a fourteenth interface, wherein the fourteenth interface includes the first area, and the first area includes the first control; In response to the user clicking the first control, a fifteenth interface is displayed, the fifteenth interface includes a first window, and the first window is used to prompt the user that the video cannot be generated.
10. The method according to any one of claims 1 to 9, characterized in that The method further comprises: In response to the user clicking the first control, a sixteenth interface is displayed, wherein the sixteenth interface includes a second window, and the second window is used to prompt the user that a video cannot be generated, wherein the number of photos including the first portrait is less than a first threshold.
11. The method according to claim 4, characterized in that The method further comprises: In response to the user selecting the third portrait, the seventeenth interface is displayed, the seventeenth interface includes a third window, and the third window is used to prompt the user that the video cannot be generated; wherein the number of photos including the third portrait is less than a third threshold.
12. The method according to claim 4, characterized in that After displaying the eighth interface, the method further includes: In response to the user selecting a third number of portraits, an eighteenth interface is displayed, the eighteenth interface including a fourth window, the fourth window being used to prompt the user that a video cannot be generated; wherein the third number is greater than a fourth threshold.
13. The method according to any one of claims 1 to 12, characterized in that In the process of generating the first video, the method further includes: A dynamic icon is displayed in the first area, and the dynamic icon indicates that the first video is being generated.
14. The method according to any one of claims 1 to 13, characterized in that Before generating the first video, the method further includes: Based on the first portrait, acquiring a plurality of second photos, each of the second photos including the first portrait; Selecting a first number of second photos from the plurality of second photos according to a principle of uniform time distribution; Selecting a second number of second photos from the first number of second photos according to the timeline from oldest to most recent; The generating the first video comprises: The first video is generated based on the second number of second photos and the first photos.
15. An electronic device, characterized in that: The electronic device comprises a processor and a memory, wherein the processor and the memory are coupled, and the memory is used to store a computer program. When the computer program is executed by the processor, the electronic device executes the method according to any one of claims 1 to 14.
16. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the electronic device executes the method according to any one of claims 1 to 14.
17. A chip system, characterized in that: The chip system is applied to an electronic device, and the chip system includes one or more processors, and the processor is used to call computer instructions so that the electronic device executes the method as described in any one of claims 1 to 14.
Citation Information
Cited By
Video processing method and electronic device
EP4697199A1
Video processing method and electronic device
WO2025011078A1