Video processing method, electronic device, and computer-readable storage medium
The "One Record, Multiple Captures" mode automatically identifies and captures highlights in videos, generates AI profiles, and provides various video templates. This solves the problem of users struggling to efficiently capture exciting moments and create short videos, improving user experience and increasing the usage rate of the "One-Click Blockbuster" feature.
Patent Information
- Application Number
- CN202210206274.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-02-28
- Publication Date
- 2025-12-09
- Estimated Expiration
- 2042-02-28
AI Technical Summary
In existing technologies, users find it difficult to efficiently capture memorable and exciting moments in photos and create short videos when recording videos, and the usage rate of the one-click blockbuster function is low.
Introducing a "one-record-multiple-captures" mode, this feature automatically identifies highlights and takes photos while recording video by analyzing the video stream, generating AI profiles that allow users to directly create exciting short videos. It also offers a variety of video templates and effects to enhance the user experience.
It enables the automatic capture of high-quality photos and generation of short videos during video recording, improving the user experience and increasing the frequency of use of the one-click blockbuster feature.
Smart Images

Figure CN116700550B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the field of electronic devices, and in particular to a video processing method, an electronic device, and a computer readable storage medium. BACKGROUND
[0002] With the continuous development of intelligent terminals, the photographing and video recording functions have become essential functions of intelligent terminals. The demand and experience of users for recording and photographing are also continuously enhanced. In some recording scenarios, users have the demand to capture memorable highlight photos while recording, and the demand to use recorded videos to edit short videos. SUMMARY
[0003] The present application provides a video processing method, an electronic device, and a computer readable storage medium, aiming to solve the problem of improving the use rate of the one-key big piece function.
[0004] To achieve the above-mentioned purpose, the present application provides the following technical solutions:
[0005] In a first aspect, the present application provides a video processing method, comprising: displaying a first interface of a gallery application, the first interface comprising a first video, a first control, and a first region; the first region comprising a thumbnail of the first video and a thumbnail of at least one associated photo (which can be a highlight photo in the embodiment); the associated photo being a photo automatically taken during the recording of the first video. In response to a first operation performed by a user on the first control, a second interface is displayed; the second interface playing a second video using a first video template; the second video comprising at least one video frame in the first video. The first interface is displayed again, and in response to the user performing the first operation on the first control again, a third interface is displayed, the third interface playing a third video using a second video template, the third video comprising at least one video frame in the first video. The template parameters used by the first video template and the second video template are different, and the template parameters include one or more of music, filter, special effect, border, or transition type.
[0006] In the embodiment of the present application, the user performs the first operation on the first control to display the second interface, and when the user performs the first operation on the first control again, the third interface is displayed. The template parameters of the first video template used by the second interface and the second video template of the third interface are different, presenting different video effects and bringing freshness to the user.
[0007] In a possible implementation, the first video template and the second video template are both video templates in a plurality of alternative video templates; the alternative video templates are video templates matching the overall scene of the first video.
[0008] In another possible implementation, in response to the first operation performed by the user on the first control again, before displaying the third interface, further comprising: in response to a second operation of the user, saving the second video.
[0009] In another possible implementation, the second interface comprises: a save control; and the second operation is a second operation performed on the save control of the second interface.
[0010] In another possible implementation, after saving the second video in response to the second operation of the user, further comprising:
[0011] displaying a fourth interface; the fourth interface plays the second video; and the fourth interface is a detail interface of the second video.
[0012] In another possible implementation, the second interface comprises: a return control; and after saving the second video in response to the second operation of the user, further comprising:
[0013] in response to a third operation of the user on the return control of the second interface, displaying a fourth interface; the fourth interface plays the second video; and the fourth interface is a detail interface of the second video.
[0014] In another possible implementation, the second interface and the third interface both further comprise a style control and a music control; the style control is used to preview video effects when using different styles; and the music control is used to preview video effects when using different music.
[0015] In another possible implementation, after displaying the second interface in response to the first operation performed by the user on the first control, further comprising:
[0016] in response to a fourth operation of the user on the music control, displaying a fifth interface; the fifth interface comprises different music options;
[0017] in response to a fifth operation of the user, displaying a sixth interface; the sixth interface plays a fourth video using music selected by the user; and the fourth video comprises at least one video frame in the first video.
[0018] in response to a sixth operation of the user, saving the fourth video.
[0019] In another possible implementation, the sixth interface further comprises a save control; and the sixth operation is a sixth operation performed on the save control of the sixth interface.
[0020] In another possible implementation, after displaying the second interface in response to the first operation performed by the user on the first control, further comprising:
[0021] In response to a seventh operation performed by the user on the style control, a seventh interface is displayed; the seventh interface includes a plurality of different style options;
[0022] In response to an eighth operation performed by the user, an eighth interface is displayed; the eighth interface plays a fifth video using the style selected by the user; the fifth video includes at least one video frame in the first video;
[0023] In response to a ninth operation performed by the user, the fifth video is saved.
[0024] In another possible implementation, if the first video carries a watermark, neither the second video nor the third video displays the video effect of the frame.
[0025] In another possible implementation, the second interface and the third interface each include a special effect switch control, or the seventh interface includes a special effect switch control; the seventh interface includes a plurality of different style options; and the special effect switch control is used to turn on or turn off the video effects of filters, special effects, and frames.
[0026] In another possible implementation, if the first video carries a watermark, the special effect switch control is in an off state.
[0027] In another possible implementation, the method for selecting the second video template includes:
[0028] randomly selecting a video template from a plurality of alternative video templates as the second video template;
[0029] Alternatively,
[0030] selecting, as the second video template, a video template arranged next to the first video template from a plurality of alternative video templates arranged in a specific order.
[0031] In a second aspect, the present application discloses another video processing method, including:
[0032] displaying a first interface of a gallery application, the first interface including a first video, a first control, and a first region; the first region including a thumbnail of the first video and a thumbnail of at least one associated photo, the associated photo being a photo automatically taken during a recording process of the first video; in response to a first operation performed by the user on the first control, displaying a second interface; the second interface playing a second video using a first video template; the second video including at least one video frame in the first video; the first video template using template parameters including one or more of music, filters, special effects, frames, or transition types; displaying the first interface again; in response to the first operation performed by the user again on the first control, displaying the second interface.
[0033] In the embodiments of the present application, the user performs the first operation on the first control, and the second interface is displayed. When the user performs the first operation on the first control again, the second interface is still displayed, and the same video is presented, thereby maintaining the consistency of the video displayed for the user each time the first control is used.
[0034] In a possible implementation, after the second interface is displayed in response to the user performing the first operation on the first control, the method further includes: returning to the first interface in response to a tenth operation of the user.
[0035] In another possible implementation, the second interface further includes: a return control, and the tenth operation is a tenth operation performed on the return control of the second interface.
[0036] In another possible implementation, the first interface of the gallery application includes:
[0037] In response to an eleventh operation of the user, a ninth interface of the gallery application is displayed; the ninth interface includes a thumbnail of the first video; and in response to a twelfth operation of the user performed on the thumbnail of the first video, the first interface of the gallery application is displayed.
[0038] In a third aspect, the present application discloses an electronic device, including a processor and a memory, the processor and the memory are coupled, and the memory is used to store a computer program, when the computer program is executed by the processor, the electronic device executes the method in any one of the first aspect and the second aspect.
[0039] In a fourth aspect, the present application discloses a computer readable storage medium, the computer readable storage medium stores a computer program, when the computer program is executed by the processor, the processor executes the method in any one of the first aspect and the second aspect.
[0040] It should be understood that the description of technical features, technical solutions, advantages or similar language in the present application does not imply that all features and advantages can be realized in any single embodiment. On the contrary, it can be understood that the description of a feature or advantage means that the specific technical feature, technical solution or advantage is included in at least one embodiment. Therefore, the description of technical features, technical solutions or advantages in the specification does not necessarily refer to the same embodiment. Further, the technical features, technical solutions and advantages described in the embodiments can be combined in any appropriate manner. Those skilled in the art will understand that the embodiments can be implemented without one or more specific technical features, technical solutions or advantages of a particular embodiment. In other embodiments, additional technical features and advantages can be identified in specific embodiments that do not embody all embodiments. BRIEF DESCRIPTION OF DRAWINGS
[0041] Figure 1A schematic diagram illustrating the scenario of recording the original video using the one-record-multiple-views mode provided in this application;
[0042] Figure 2 A scene diagram illustrating the original video recorded in the browsing mode provided in this application;
[0043] Figure 3 Hardware structure diagram of the electronic device provided in this application;
[0044] Figure 4 A software architecture diagram of the electronic device provided in this application;
[0045] Figure 5 A flowchart illustrating the video processing method provided in this application embodiment. Figure 1 ;
[0046] Figure 6 Interface changes for the video processing method provided in the embodiments of this application Figure 1 ;
[0047] Figure 7 A flowchart illustrating the video processing method provided in this application embodiment. Figure 2 ;
[0048] Figure 8 Interface changes for the video processing method provided in the embodiments of this application Figure 2 ;
[0049] Figure 9 A flowchart illustrating the video processing method provided in this application embodiment. Figure 3 ;
[0050] Figure 10 Interface changes for the video processing method provided in the embodiments of this application Figure 3 ;
[0051] Figure 11 A diagram showing the interface changes when exiting the preview screen of a short video in the video processing method provided in this application embodiment;
[0052] Figure 12 A preview interface image of a watermarked short video provided for an embodiment of this application;
[0053] Figure 13 Interface changes of the operation effect switch control provided in the embodiments of this application. Figure 1 ;
[0054] Figure 14 Interface changes of the operation effect switch control provided in the embodiments of this application. Figure 2 . Detailed Implementation
[0055] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. The terms used in the following embodiments are only for the purpose of describing the specific embodiments and are not intended to be limiting to the present application. As used in the specification and the appended claims of the present application, the singular forms “a,” “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that “one or more” as used in the embodiments of the present application refers to one, two or more than two; “and / or” describes the associating relationship of the associated objects, which means that there can be three kinds of relationships; for example, A and / or B can represent the following three cases: A exists alone, A and B exist together, and B exists alone, where A and B can be singular or plural. The character “ / ” generally represents an “or” relationship between the associated objects.
[0056] In the present specification, the phrase “one embodiment” or “some embodiments” etc. means that the specific features, structures or characteristics described in connection with the embodiment are included in one or more embodiments of the present application. Therefore, the phrases “in one embodiment”, “in some embodiments”, “in other some embodiments”, “in further some embodiments” etc. appearing in different places in the present specification are not necessarily all referring to the same embodiment, but mean “one or more but not all embodiments”, unless otherwise specifically emphasized. The terms “include”, “contain”, “have” and their variants mean “including but not limited to”, unless otherwise specifically emphasized.
[0057] The plurality of embodiments of the present application refers to greater than or equal to two. It should be noted that in the description of the embodiments of the present application, the terms “first”, “second” etc. are only used for the purpose of distinguishing the description and cannot be understood as indicating or implying relative importance, nor can it be understood as indicating or implying order.
[0058] Before introducing the embodiments of the present application, some terms or concepts related to the embodiments of the present application are first explained. It should be understood that the naming of the following terms by the present application is not specifically limited. The following terms can have other names. The terms re-named still meet the following related term explanations.
[0059] Magic moment (MM) refers to some magic moments in the process of video recording. For example, MM can be the best moment, the best expression moment or the best action moment. It can be understood that the term MM is not limited in the present application, and MM can also be referred to as a good moment, a magic moment, a magic moment, a decisive moment, a magic key frame or a best shot (BS). In different scenarios, the magic moment can be different types of picture moments. For example, when recording a football match video, the magic moment can be the moment when the player's foot contacts the football when shooting or passing the ball, and the magic moment can also be the moment when the football flies into the goal. When recording a video of a person jumping from the ground, the magic moment can be the moment when the person is at the highest point in the air, or the moment when the person is most relaxed in the air.
[0060] MM tag (TAG) is a kind of time tag, which is used to indicate the position of the magic moment in the recorded video file. For example, one or more MM tags are included in the video file, and the MM tag can indicate that the corresponding image frame in the video file is a magic moment at the 10th second, 1 minute 20 seconds, etc. of the video file.
[0061] MM node is used to analyze the video stream, identify or decide the magic moment, and automatically trigger the shooting when the magic moment is identified. The MM node is also referred to as MM decision engine, BS decision engine, MM decision module, etc., which have the functions of the MM node as shown above.
[0062] One recording multiple shots can be understood as a function that a user can get one or more photos including a magic moment and / or an AI profile by pressing the "shooting" icon once when shooting a video using a camera application. The AI profile can be recorded in the head of the video or stored in other locations. The AI profile records information such as the scene of the video, the magic key frame, the video template, the magic segment, etc. The AI profile can be used to generate a magic short video. The AI profile can include the tag (TAG) of the video. Alternatively, the mobile phone can obtain tag data including the tag (TAG) of the video. And the tag data can be added to the video, usually in the video head. For example, the information recorded in the AI profile can include the overall scene tag of the video, the magic key frame (which can also be referred to as the image frame of the magic moment or the photo of the magic moment), the first N frames of the magic key frame, and the last n frames of the magic key frame, and the magic short video generated by the AI profile has the magic segment in the video shot by the user. Wherein N and n are positive integers. For another example, the information recorded in the AI profile can be MM tag, overall scene tag of the video, segmented scene tag, shot tag, tag of high-quality video frame, etc.
[0063] In some embodiments, the highlight short video can be generated without the AI configuration file. For example, when the user clicks the one-key big video control, the electronic device can trigger the intelligent recognition of the video recorded in the one-recording-multiple-get mode, obtain the label of the video, and then generate the highlight short video using the label of the video.
[0064] In some embodiments, the highlight short video can include highlight photos, and in some embodiments, the highlight short video can not include highlight photos. The video overall scene label can also be referred to as a video overall summary label, which is mainly used to indicate the shooting scene of the video as a whole. The term of the video overall scene label is not limited in the present application. For example, the video overall scene label can be a food label, a night scene label, etc.
[0065] The implementation process of one-recording-multiple-get can be: the MM node automatically identifies the highlight moment and triggers the snapshot during the video recording process, and obtains the photos of the MM; after the recording is completed, the user can be recommended the photos of the highlight moment (MM) and the highlight short video (or referred to as the selected short video, or the highlight video, or the selected video) when the user views the recorded video. It can be understood that the duration of the highlight short video obtained by one-recording-multiple-get is less than the duration of the entire complete video. For example, the entire complete video recorded is 1 minute, and 4 highlight moment photos and a 15-second highlight short video can be obtained. It can also be understood that one-recording-multiple-get can also have other names, such as one-key multiple-get, one-key multiple-shot, one-key film, one-key big video, AI one-key big video, etc.
[0066] Manual snapshot, during the video recording process, manual photographing can be performed at the same time to obtain the desired shot. The MM node can be used to analyze the video stream, identify or decide the highlight moment based on the manually snapped photos.
[0067] Video template, which can be understood as a video effect template, that is, a template for implementing various special effects for a video. For example, the video template can include style and music. The style here can be a filter, that is, the video is color-processed by applying a filter. The filter is a kind of video effect, which is used to realize various special effects of the video. Alternatively, the style here can also be a fast-forward, slow-motion, etc. video effect. Alternatively, the style can also be a transition effect, a sticker, a special effect, etc.
[0068] To improve the image quality of the highlight moments obtained in the video recording mode, the present application introduces a "one recording multiple getting" mode, that is, when recording a video in the video recording mode, the highlight moments are automatically identified by analyzing the video stream, and a photo of the highlight moment is automatically triggered to be taken when the highlight moment is identified. In addition, when the video recording is completed, the photo of the highlight moment and the highlight short video can be viewed in the gallery. Through the "one recording multiple getting" mode, the user's demand for capturing the memorable highlight moment photo when recording a video and the demand for using the recorded video to edit a short video can be met without the user's editing, snapshotting and other operations. Compared with randomly obtaining the photo in the recorded video, the image quality of the highlight moment obtained by the video processing method of the present application is higher, and the user experience is better.
[0069] For example, referring to Figure 1 , the process of recording a video by using the "one recording multiple getting" mode in the present application can be:
[0070] As shown in (1) of Figure 1 , the screen of the mobile phone displays the interface content currently output, and the interface content displays the application icons of multiple application programs (application, App). The user can indicate the mobile phone to start the camera application (hereinafter referred to as the camera) by clicking the "camera" application icon 101 on the desktop of the mobile phone, and the mobile phone displays the shooting interface as shown in (2) of Figure 1 .
[0071] As shown in (2) of Figure 1 , the shooting interface of the camera generally includes a viewfinder 102, a photographing control, a video recording control and a setting control, and multiple controls (such as a portrait function control, a night scene function control or more other controls). The user can start the video recording mode by clicking the video recording control, and the mobile phone can display the recording interface as shown in (3) of Figure 1 . The user can enter the setting interface by clicking the "setting" control 103, and the mobile phone displays the interface as shown in (4) of Figure 1 . Figure 1 The interface shown in (4) shows an option 104 for starting the "one recording multiple getting", which is used to start the function of the one recording multiple getting. That is, when the user starts the function, the mobile phone will automatically adopt the video processing method provided by the present application when in the video recording mode, and the MM node will intelligently identify the highlight moment when recording a video, and will automatically generate a photo of the highlight moment and an AI configuration file after identifying the highlight moment content. Of course, the user can also manually turn off the one recording multiple getting function in the video recording mode through the option 104.
[0072] It can be understood that Figure 1The settings interface shown in (4) may also include other controls for recording settings, such as controls for setting video resolution and video frame rate. Figure 1 The control shown in (4) is merely an illustrative description.
[0073] After enabling the "One Record, Multiple Results" option, the user clicks... Figure 1 The return control 105 shown in (4) allows the phone to return to its previous state. Figure 1 The interface shown in (3) allows users to click the recording control 106 to record video. In other embodiments, the option to record multiple times is enabled by default, and users do not need to click it. Figure 1 Instead of using the settings control 103 shown in (3), click directly. Figure 1 The recording control 106 shown in (3) allows for recording in the one-record-multiple-records mode.
[0074] Figure 1 The interface shown in (5) displays a frame during the recording process (e.g., the frame at the 11th second). Figure 1 The interface shown in (5) includes a recording stop control 107, a recording pause control 108, and a photo capture button 109. During recording, the user can click the photo capture button 109 to manually capture a photo. Figure 1 (5) After clicking the recording stop control 107, the recording process ends. At this time, the mobile phone interface displays as follows: Figure 1 The interface shown in (6) is as follows. Figure 1 The interface shown in (6) is the preview interface after recording is completed. A bubble window 110 can pop up in the interface, and the content displayed in window 110 is: "One-record-multiple-gains wonderful photos have been generated and can be used to create blockbusters with one click". In some other embodiments, if only wonderful photos are generated after the first use of the one-record-multiple-gains function, window 110 can display "One-record-multiple-gains wonderful photos have been generated". In some other embodiments, if only AI configuration files are generated after the first use of the one-record-multiple-gains function, window 110 can display "One-record-multiple-gains video can be used to create blockbusters with one click". Figure 1 Preview image 111 in (6) is a thumbnail of the recorded original video. The original video mentioned in this embodiment can be understood as the original video recorded in the one-record-multiple-views mode. If the user clicks 111, they can enter the gallery application (hereinafter referred to as the gallery) to view the recorded original video.
[0075] After recording in the "One Record, Multiple Views" mode, you will receive the original video, photos of the highlights from the original video, and an AI profile of the original video. You can click on... Figure 1In the preview image 111 in (6), you can enter the gallery to view the original recorded video, photos of highlights, and exciting short videos generated by the AI profile. You can also enter the gallery by clicking on the gallery application.
[0076] For example, after recording the original video in the "one record, multiple views" mode, the process of viewing the original video, photos of the highlights from the original video, and short videos of the highlights can be as follows:
[0077] like Figure 2 As shown in (1), the phone screen displays the current output interface content, which shows the application icons of multiple apps. When the user clicks the "Gallery" application icon 201, the phone is instructed to open the Gallery application, and the phone displays as shown in (1). Figure 2 The interface shown in (2) is shown in the middle. Figure 2 (2) shows thumbnails of photos and videos taken by the user. The original video thumbnail 202, obtained using the "One Record, Multiple Views" mode, may display an "AI" icon. In some embodiments, the "AI" icon on the thumbnail indicates that the video was recorded in the "One Record, Multiple Views" mode; in other embodiments, the "AI" icon indicates that the video is in an associated state. When a video (e.g., the original video mentioned above) is in an associated state, clicking on the original video thumbnail allows users to browse not only the original video but also photos of highlights. When the original video is not in an associated state, photos of highlights cannot be viewed.
[0078] User click Figure 2 The original video thumbnail 202 shown in (2) is obtained using the one-record-multiple-gets mode. The mobile phone displays it as follows: Figure 2 The image shown in (3) is as follows. Figure 2 The interface shown in (3) is a representation of the original recorded video in the gallery application. Figure 2 In the interface shown in (3), the browsing area 203 displays the first frame of the recorded original video, and below the browsing area 203 is the highlight area 204. The highlight area 204 is used to display the original video and photos of the corresponding highlights of the original video (or photos of the highlights associated with the original video). For example, the highlight area 204 includes a thumbnail of the original video and five thumbnails of photos of the highlights.
[0079] If this is your first time viewing this video, Figure 2In the interface shown in (3), a guide box 205 (or called prompt box) appears, which is used to prompt the user with the following information: "One recording, multiple captures" intelligently captures multiple wonderful moments for you. That is, the guide box 205 is used to inform the user that the photo thumbnails in the wonderful moment area 204 contain wonderful moments. As an optional implementation, when the guide box 205 is displayed, the guide box 205 can be highlighted to better remind the user. At this time Figure 2 In the interface shown in (3), the display brightness of the parts other than the guide box 205 and the wonderful moment area 204 can be reduced to highlight the guide box 205 and the wonderful moment area 204. Of course, if it is not the first time to enter the video, the guide box 204 will not appear, and the guide box 205 does not need to be highlighted.
[0080] In addition, Figure 2 The interface shown in (3) also includes a toolbar below the wonderful moment area 204, which includes sharing, collecting, editing, deleting, more, and other options to allow the user to perform corresponding operations on the original video.
[0081] When the user clicks Figure 2 In (3), the display brightness of any position in the area is reduced. The guide box 204 disappears, the display brightness of the interface is uniform, and the original video displayed in the browsing area 203 starts to automatically play, Figure 2 (4) is the interface when the original video is automatically played. In Figure 2 In the interface shown in (4), by sliding or clicking the thumbnail in the wonderful moment area 204 to the current item guide box 2041, the photo or the original video of the wonderful moment selected by the current item guide box 2041 can be displayed in the browsing area 203. That is, the current item guide box 2041 is used to indicate the image currently displayed in the browsing area 203. For example Figure 2 In the interface shown in (4), the original video thumbnail is selected by the current item guide box 2041, and therefore the original video is displayed in the browsing area 203.
[0082] In some embodiments, the album can also display a "one-click big picture" icon 206 in the browsing area 203, which can be near the wonderful moment area 204. The user clicks Figure 2 In the interface shown in (4), the "one-click big picture" icon 206, the phone can generate a wonderful short video using the AI profile associated with the original video, and play the wonderful short video.
[0083] As known from the foregoing, in the embodiments of the present application, the one recording multiple capturing mode can automatically capture photos of the exciting moment without manual snapshotting by the user, and can generate the exciting short video by using the AI configuration file without manual editing of the original video by the user, thereby meeting the needs of the user for capturing the memorable exciting moment photos while recording the video, and the needs of the user for making the short video by editing the recorded video.
[0084] After the user clicks the one-key blockbuster icon 206, the phone can further save the generated exciting short video, and the user can subsequently view the exciting short video in the one recording multiple capturing album. Since the user saves the exciting short video, when the user needs to view the exciting short video, the user can directly view the exciting short video through the one recording multiple capturing album, instead of clicking the one-key blockbuster icon to view the exciting short video, thereby resulting in a low frequency of use of the one-key blockbuster function.
[0085] To improve the frequency of use of the one-key blockbuster function by the user and enhance the experience of the one-key blockbuster function for the user, the embodiments of the present application propose a video processing method for displaying the exciting short video corresponding to the different video templates of the theme of the original video in various different scenarios of use of the one-key blockbuster function by the user, thereby increasing the freshness and interest. The video processing method provided by the embodiments of the present application can be applied to various electronic devices.
[0086] In some embodiments of the present application, the electronic device can be a mobile phone, a smart screen, a tablet computer, a wearable electronic device, a vehicle-mounted electronic device, an augmented reality (AR) device, a virtual reality (VR) device, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a projector, and the like.
[0087] Hereinafter, the electronic device is taken as a mobile phone as an example, Figure 3 A structural schematic diagram of an electronic device 300 provided by the embodiments of the present application is shown. Figure 3 A hardware system of an electronic device suitable for the present application is shown.
[0088] The electronic device 300 can include a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (USB) interface 330, a charging management module 340, a power management module 341, a battery 342, an antenna 1, an antenna 2, a mobile communication module 350, a wireless communication module 360, an audio module 370, a speaker 370A, a receiver 370B, a microphone 370C, a headset jack 370D, a sensor module 380, a key 390, a motor 391, an indicator 392, a camera 393, a display screen 394, and a subscriber identification module (SIM) card interface 395, etc. The sensor module 380 can include a pressure sensor 380A, a gyroscope sensor 380B, a barometric sensor 380C, a magnetic sensor 380D, an acceleration sensor 380E, a distance sensor 380F, a proximity light sensor 380G, a fingerprint sensor 380H, a temperature sensor 380J, a touch sensor 380K, an ambient light sensor 380L, a bone conduction sensor 380M, etc.
[0089] It should be noted that, Figure 3 The structures shown do not constitute specific limitations on the electronic device 300. In some embodiments of the present application, the electronic device 300 can include more or fewer components than those shown, or the electronic device 300 can include a combination of some of the components shown, or the electronic device 300 can include sub-components of some of the components shown. Figure 3 The structures shown do not constitute specific limitations on the electronic device 300. In some embodiments of the present application, the electronic device 300 can include more or fewer components than those shown, or the electronic device 300 can include a combination of some of the components shown, or the electronic device 300 can include sub-components of some of the components shown. Figure 3 The structures shown do not constitute specific limitations on the electronic device 300. In some embodiments of the present application, the electronic device 300 can include more or fewer components than those shown, or the electronic device 300 can include a combination of some of the components shown, or the electronic device 300 can include sub-components of some of the components shown. Figure 3 The structures shown do not constitute specific limitations on the electronic device 300. In some embodiments of the present application, the electronic device 300 can include more or fewer components than those shown, or the electronic device 300 can include a combination of some of the components shown, or the electronic device 300 can include sub-components of some of the components shown. Figure 3 The components shown can be implemented in hardware, software, or a combination of software and hardware.
[0090] The processor 310 can include one or more processing units. For example, the processor 310 can include at least one of the following processing units: an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, a neural-network processing unit (NPU). Different processing units can be independent devices or integrated devices. In some embodiments, the processor 310 can perform any video processing method proposed in the embodiments of the present application. For details, refer to the embodiments of the present application. Figure 5 , Figure 7 and Figure 9 The related content of the foregoing is not repeated here.
[0091] The controller can generate operation control signals according to the instruction operation code and the timing signal, and complete the control of fetching and executing instructions.
[0092] The processor 310 can also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 310 is a cache memory. The memory can hold instructions or data that the processor 310 has just used or is repeatedly using. If the processor 310 needs to use the instructions or data again, it can be directly called from the memory. This avoids repeated access and reduces the waiting time of the processor 310, thereby improving the efficiency of the system.
[0093] Figure 3 The connection relationship between the modules shown is only illustrative and does not constitute a limitation on the connection relationship between the modules of the electronic device 300. Alternatively, the modules of the electronic device 300 can also use a combination of various connection modes in the above embodiments.
[0094] The electronic device 300 can realize the display function through the GPU, the display screen 394, and the application processor. The GPU is a microprocessor for image processing, connected to the display screen 394 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 310 can include one or more GPUs that execute program instructions to generate or change display information.
[0095] The display screen 394 can be used to display images or videos. The display screen 394 includes a display panel. The display panel can adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini light-emitting diode (Mini LED), a micro light-emitting diode (Micro LED), a micro OLED, or a quantum dot light emitting diode (QLED). In some embodiments, the electronic device 300 can include 1 or N display screens 394, N being a positive integer greater than 1. As one possible implementation, the display screen 394 can be used to display photos and short videos of the highlight moment when a user views the photos and short videos of the highlight moment.
[0096] The electronic device 300 can implement the photographing function through the ISP, the camera 393, the video codec, the GPU, the display screen 394, and the application processor.
[0097] The camera 393 is used to capture still images or videos. An object generates an optical image through a lens and projects the optical image to a photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert the electrical signal into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard red green blue (RGB), YUV, or the like format. In some embodiments, the electronic device 300 can include 1 or N cameras 393, N being a positive integer greater than 1. In the embodiments of the present application, the processor 310 can determine a highlight moment (MM) in a video stream recorded by the camera 393, and automatically trigger the camera 393 to take a photo when the MM is determined. The ISP and the DSP can process the image signal of the highlight moment (MM) to obtain an image of the highlight moment.
[0098] A digital signal processor is used to process digital signals, which can process not only digital image signals but also other digital signals.
[0099] A video codec is used to compress or decompress digital video. The electronic device 300 can support one or more video codecs. In this way, the electronic device 300 can play or record videos in multiple encoding formats, such as moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, and MPEG 4.
[0100] An NPU is a processor that draws on the structure of a biological neural network, such as drawing on the mode of transmission between human brain neurons to quickly process input information, and can also constantly self-learn. Through the NPU, the electronic device 300 can achieve intelligent cognitive functions, such as image recognition, face recognition, voice recognition, and text understanding.
[0101] The external memory interface 320 can be used to connect an external memory card, such as a secure digital (SD) card, to expand the storage capacity of the electronic device 300.
[0102] The internal memory 321 can be used to store computer executable program code, which includes instructions. The internal memory 321 can include a program storage area and a data storage area. The processor 310 executes various video processing methods proposed in the embodiments by running instructions stored in the internal memory 321 and / or instructions stored in a memory disposed in the processor.
[0103] The electronic device 300 can achieve audio functions, such as music playback and recording, through the audio module 370, the speaker 370A, the receiver 370B, the microphone 370C, the earphone interface 370D, and the application processor.
[0104] The touch sensor 380K, also known as a touch device. The touch sensor 380K can be disposed on the display screen 394, and the touch sensor 380K and the display screen 394 form a touch screen, also known as a touch screen. The touch sensor 380K is used to detect touch operations acting on or near it. The touch sensor 380K can pass the detected touch operation to the application processor to determine the touch event type.
[0105] The keys 390 include a power-on key and a volume key. The keys 390 can be mechanical keys or touch keys. The electronic device 300 can receive key input signals and implement functions related to the key input signals.
[0106] The technical solutions involved in the following embodiments can be implemented in the electronic device 300 with the hardware architecture described above. In addition, an operating system runs on the components described above. For example, an iOS operating system, an Android open source operating system, a Windows operating system, and the like. Application programs can be installed and run on the operating system.
[0107] Figure 4 is a structural block diagram of an electronic device according to an embodiment of the present application. The layered architecture divides software into several layers, each of which has a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.
[0108] The application layer can include a series of application packages. As shown in Figure 4 , the application package can include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, and the like. For example, in the embodiment of the present application, the camera application supports video recording mode (or movie mode) and one recording multiple getting function.
[0109] In some embodiments, the camera application can support video recording in one recording multiple getting function mode, thereby obtaining the original video, the highlight moment (MM) photo, and the AI profile. The AI profile is stored in the head of the original video. The AI profile can be used to generate a highlight short video.
[0110] In some embodiments, the gallery application is used to support browsing of the original video, the highlight moment (MM) photo, and the highlight short video obtained in the one recording multiple getting function mode.
[0111] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications of the application layer. The application framework layer includes some pre-defined functions. As shown in Figure 4 , the application framework layer can include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.
[0112] The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, and capture the screen, and the like.
[0113] The content provider is used to store and obtain data, and make the data accessible to the application. The data can include video, image, audio, dialed and received calls, browsing history and bookmarks, phonebook, and the like.
[0114] The view system includes visual controls, such as controls that display text, controls that display pictures, etc. The view system can be used to build an application. A display interface can be composed of one or more views. For example, a display interface that includes a short message notification icon can include a view that displays text and a view that displays a picture.
[0115] The phone manager is used to provide the communication function of the electronic device 102. For example, the management of the call status (including call connection, call hang-up, etc.).
[0116] The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc.
[0117] The notification manager enables the application to display notification information in the status bar, which can be used to convey a type of message that can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify the completion of the download, message reminders, etc. The notification manager can also be a notification that appears in the top status bar of the system in the form of a chart or a scrolling text, such as a notification of an application running in the background, and can also be a notification that appears on the screen in the form of a dialog window. For example, the text information is prompted in the status bar, a prompt sound is emitted, the electronic device is vibrated, the indicator light flashes, etc.
[0118] The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.
[0119] The core library includes two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.
[0120] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java file of the application layer and the application framework layer into a binary file. The virtual machine is used to perform the management of the object life cycle, the management of the stack, the management of the thread, the management of the security and the exception, and the garbage collection, etc.
[0121] The system library can include multiple functional modules. For example: surface manager, media library, three-dimensional graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc.
[0122] The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
[0123] The media library supports playback and recording of various commonly used audio, video formats, and static image files. The media library can support various audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, and the like. For example, in an embodiment of the present application, the media library is used to store multimedia information. In an implementation, the media library is used to store time information of a highlight moment (MM) tag, and description of semantic information of the highlight moment, an AI configuration file, and first tag information and the like.
[0124] The three-dimensional graphics processing library is used to implement three-dimensional graphics drawing, image rendering, synthesis, and layer processing.
[0125] The 2D graphics engine is a drawing engine for 2D drawing.
[0126] The kernel layer is a layer between hardware and software. The kernel layer at least includes display drivers, camera drivers, audio drivers, and sensor drivers.
[0127] It should be noted that although the Android system is taken as an example for description in the embodiments of the present application, the basic principles are also applicable to electronic devices based on iOS or Windows operating systems.
[0128] Based on the electronic device mentioned in the foregoing embodiments of the present application, an embodiment of the present application proposes a video processing method applied to the foregoing electronic device. In order to make the description of each embodiment clearer, before introducing each embodiment, first introduce the selection strategy of the video template used in the video processing method proposed in the embodiments of the present application. The selection strategy of the video template can be understood as a strategy for selecting a video template from multiple candidate video templates each time a user needs to reselect a video template for displaying a highlight short video corresponding to an original video.
[0129] The candidate video template can be determined according to the video theme (which can also be understood as the foregoing video overall scene) of the original video. The video theme (i.e., the video overall scene) refers to the overall shooting scene of the video, which can be, for example, food, ancient architecture, travel, wedding, nature, night scene, and the like. In some embodiments, the electronic device can identify the video theme of the original video by intelligently recognizing the video stream of the original video during recording of the original video, and then form a video overall scene tag and store it in an AI configuration file. For example, the video stream of the original video can be input to a preset artificial intelligence model to identify the video theme of the original video. Then, after intelligently identifying the video theme, at least one candidate video template matching the original video can be determined according to the video theme of the original video.
[0130] In some embodiments, the at least one candidate video template matching the original video can be determined by the video overall scene label in the AI profile before the original video is completed and the AI profile associated with the original video is generated. In other embodiments, the at least one candidate video template matching the original video can also be determined by the video overall scene label in the AI profile in response to the operation of the user clicking the one-key big video control.
[0131] In some embodiments, the plurality of video templates can be divided into a plurality of template categories, such as soothing, cheerful, dynamic, fresh, quiet, and the like. Each category includes a plurality of video templates. For example, as shown in Table 1, the preconfigured soothing and quiet template categories are listed in Table 1. The soothing category includes two video templates, namely video template 1 and video template 2, and the quiet category includes two video templates, namely video template 3 and video template 4. When video template 1 is selected, the style name (which can also be understood as the name of video template 1) used is “Soothing_15_1”, the music used is soothing, the music duration is 15s, and the transition types used are overlap 70% and blur. The filter used is “Afternoon 100”, “Afternoon” is the name of the filter, and 100 is the intensity of the filter. No stickers are used in video template 1, the special effect name used is “sun_flower”, and the special effect appears at the beginning of the first segment.
[0132] Table 1
[0133]
[0134]
[0135] Similarly, according to Table 1, the style name of video template 2 is “Soothing_15_2”, the music is romantic, the music duration is 15s, the transition types are overlap 50% and blur, the filter used is “Warm Sun”, the filter intensity is 100, the sticker used is “best_memory”, the sticker appears at the beginning of the first segment, and the special effect used is “flowers”, which appears after the first transition. The related information of other video templates in Table 1 can also be determined by Table 1, which is not described here. It should be noted that Table 1 only gives part of the related information of the video template, and the video template can also include other characteristics, borders, and configurations of different types of video effects. The embodiments of the present application do not limit the preconfigured video effects in the video template.
[0136] In some embodiments, the matching relationship between the video theme and the template category can be preconfigured, for example, the travel theme can match the soothing template category. When the original video is identified as the travel theme, the video template under the soothing template category is selected as the alternative video template. For example, one theme can be preconfigured to match only one template category, or can be preconfigured to match multiple template categories. For example, the night scene theme can match the soothing template category, or the night scene theme can match the soothing and quiet categories. In other embodiments, the matching relationship between the video theme and the video template can also be preconfigured. For example, as shown in Table 1, when the video theme is night scene, the video template 1 and the video template 2 under the soothing template category and the video template 3 under the quiet template category are preconfigured to match.
[0137] It should be noted that there are many ways to determine at least one alternative video template matching the original video, in addition to preconfiguring the matching relationship between the video theme and the alternative video template, which can be intelligent identification of the video stream of the original video, the alternative video template matching the original video, etc. The embodiments of the present application do not limit this.
[0138] In some embodiments, after determining at least one candidate video template matching the original video, when the number of candidate video templates is N, N is an integer greater than or equal to 2, a random selection method can be used to select the video template. For example, the random selection method for selecting the video template can be: according to the length M of the highlight short video and the total number N of the candidate video templates, a video template is selected from the candidate video templates. The formula for selecting the video template is: K = [M-(n-1)]%N, where K is the serial number of the candidate video template. n represents the number of times of selecting the video template, for example, when the video template is selected for the first time, n is 1. M is the length of the highlight short video. N is the total number of candidate video templates. "%" is the remainder calculation symbol. For example, when the length M of the highlight short video is 20s and the total number of candidate video templates is 6, when the template is selected for the first time, the formula for selecting the video template is: K = [M-(n-1)]%N = [20-(1-1)]%6 = 2, that is, when the template is selected for the first time, the video template with serial number 2 in the candidate video templates is selected. When the template is selected for the first time, the formula for selecting the video template is: K = 1, that is, when the template is selected for the second time, the video template with serial number 1 is selected. In this way, using the formula for selecting the video template in the present application, random selection can be achieved every time the video template is selected, and the template selected every time is guaranteed to be different from the template selected last time, which brings enough freshness to the user when browsing the highlight short video, and also ensures that the overall style is unified (i.e., belongs to the same style type) when the user browses the highlight short video, even if the highlight short videos are different video templates, which will not give the user a feeling of fragmentation of too much style jumping.
[0139] In some embodiments, after determining at least one candidate video template matching the original video, when the number of candidate video templates is N, N is an integer greater than or equal to 2, the video template can be selected in a specific order when selecting the video template. For example, the candidate video templates are video template 1, video template 2, video template 3, and video template 4, which are arranged in the order of video template 1, video template 2, video template 3, and video template 4. When the video template is first selected for use in the first selection of the highlight short video, the video template 1 is selected by default. When the video template is reselected for use in the second selection of the highlight short video, the next video template in the predetermined order, i.e., video template 2, is used. When the video template is reselected for use in the third selection, the video template 3 is selected. When the video template is reselected for use in the fourth selection, the video template 4 is selected. When the video template is reselected for use in the fifth selection, the video template 1 is selected. And so on. In this way, the four video templates are used in turn according to the predetermined order, so that different templates are used in each reselection, providing a fresh experience for the user when browsing the highlight short video. For example, the predetermined order of the candidate video templates can be set manually or according to the preconfigured priority weight. For example, the candidate video templates can be sorted according to the recommendation degree, and then the video template can be selected according to the order from high to low. That is, the video template with the highest recommendation degree can be selected when the video template is first selected. For example, the recommendation degree can be the matching degree with the video theme.
[0140] For example, to avoid multiple different short videos under the same video theme, the same video template can be selected when the video template is first selected. For example, the video themes of the original video A and the original video B are both festivals, and the matching candidate video templates are video templates of the happy category, including video template 1, video template 2, video template 3, and video template 4. Then the video template 1 is selected for the first selection of the highlight short video of the original video A, and the video templates are selected in turn according to the predetermined order of video template 1, video template 2, video template 3, and video template 4. The video template 2 can be selected for the first selection of the highlight short video of the original video B, and the video templates are selected in turn according to the predetermined order of video template 3, video template 4, video template 1.
[0141] Based on the foregoing Figure 1 and Figure 2 After the original video, the photos of the highlight moments, and the AI profile are obtained in the one recording multiple obtaining mode, the application scenario of browsing the highlight short video generated by the AI profile is introduced, and multiple embodiments of the video processing method are proposed.
[0142] In the video processing method, the preconfigured trigger condition for selecting the video template according to the selection strategy can be various. First, the trigger condition for selecting the video template according to the selection strategy is introduced Figure 5 The embodiment shown, Figure 5 In the embodiment shown, the condition for triggering the non-first-time browsing of the wonderful short video using the reselected video template is that the operation of clicking the one-key large picture control is received, and the wonderful short video is saved in the last browsing process of the wonderful short video. Under the trigger condition, when the user saves the wonderful short video in the Xth preview of the wonderful short video, the electronic device triggers the selection of the video template according to the selection strategy, until the user previews the wonderful short video in the X+1th time, and the previewed wonderful short video uses the reselected video template. For details, refer to the following Figure 5 The content of the video processing method shown. Wherein, X is a positive integer.
[0143] In the embodiment of the present application, the Xth preview of the wonderful short video can be understood as any browsing process of the wonderful short video, and the X+1th preview of the wonderful short video can be understood as the next preview process of the wonderful short video after the Xth preview of the wonderful short video. In order to facilitate understanding, in the description of the two preview processes of the wonderful short video, the operation of the user in the Xth preview process of the wonderful short video is described as the Xth operation of the user, and the operation of the X+1th preview process of the wonderful short video is described as the X+1th operation of the user.
[0144] Refer to Figure 5 The embodiment of the present application proposes a video processing method, which is applied to the electronic device proposed in the embodiment of the present application. Hereinafter, the steps of the method are described in detail with a mobile phone as an example.
[0145] S501, in response to the Xth operation of the user clicking the gallery application, a photo grid interface is displayed, wherein the photo grid interface at least includes a video thumbnail, and the original video is an original video obtained by shooting in a one-recording-multiple-obtaining mode.
[0146] In the embodiment of the present application, the scenario of the Xth operation of the user clicking the gallery application can be understood as the scenario involved in the description of the Xth preview of the wonderful short video in the embodiment. The process of recording the original video in the one-recording-multiple-obtaining mode can be understood by referring to the description of the foregoing Figure 1 , which will not be described here.
[0147] The photo gallery interface is generally the home page of the camera application, and is used to display thumbnails of various photos and videos taken by the user in chronological order. In this embodiment, in addition to displaying the original video thumbnail, the photo gallery interface can also display thumbnails of other photos taken by the user, and / or thumbnails of other videos not taken in the one-take-multiple-get mode.
[0148] Since the original video in this embodiment refers to the original video taken in the one-take-multiple-get mode, in order to distinguish it from the thumbnails of other videos not taken in the one-take-multiple-get mode, in this embodiment, the original video thumbnail also displays a first identifier. The first identifier is used to indicate that the original video is recorded in the one-take-multiple-get mode. In other embodiments, the first identifier can also be used to indicate that the detail interface of the original video is associated with a photo of a highlight moment of the original video. The first identifier can also be used to indicate that the detail interface of the original video is associated with any one of a highlight short video and a photo of a highlight moment.
[0149] In some embodiments, the phone starts the gallery application in response to the user's Xth click on the gallery application, and then the gallery application displays the photo gallery interface on the display screen by cooperating with multiple modules such as the media library in the software framework layer. The execution process and principle of displaying the photo gallery interface after starting the gallery application can refer to the starting process and principle of the gallery application of the Android system or other operating systems.
[0150] For example, the process of step S501 is as follows: referring to (1) of Figure 6 , the display interface displays icons of multiple APPs. The user clicks the "gallery" application picture 601 for the Xth time, and the phone enters the photo gallery interface shown in (2) of Figure 6 . Figure 6 In (2) of Figure 6 , the original video thumbnail 602 taken today and other thumbnails (the other thumbnails are shown as blank boxes in the figure) are displayed. As can be seen from the original video thumbnail 602 shown in (2) of , the icon 6021 with the "AI" pattern is the first identifier mentioned above.
[0151] There are many ways to trigger the display of the photo gallery interface, and clicking the gallery application is only one of them. The gallery application can also be started by voice to trigger the display of the photo gallery interface. The embodiments of the present application do not limit the operation mode of starting the gallery application and entering the photo gallery interface.
[0152] S502, in response to the user's Xth click on the original video thumbnail, displaying a detail interface of the original video, wherein the detail interface of the original video comprises the original video, a one-key big video control, and a photo thumbnail of a highlight moment.
[0153] The detail interface of the original video can be understood as a presentation of the original video in the gallery application. The photo thumbnail of the highlight moment can be understood as a thumbnail of a highlight moment photo associated with the original video. In some embodiments, a highlight moment area can be displayed on the detail interface of the original video, and the original video thumbnail and the photo thumbnail of the highlight moment are displayed in the highlight moment area. The detail interface of the original video can be used to play the original video, browse the highlight moment photo through the highlight moment area, and browse the highlight short video through the one-key big video control. The highlight moment area can be referred to the description of the highlight moment area 204 shown in (2) of FIG. 2, which will not be repeated here. Figure 2
[0154] The user's Xth click on the original video thumbnail can be understood as an operation of triggering the phone to display the detail interface of the original video for viewing the original video at any time after the original video is recorded. In addition to the click on the original video thumbnail, the user can also trigger the display of the detail interface of the original video through voice triggering, sliding triggering, or other operation modes, such as triggering the display of the detail interface of the original video through touching a specific control on the phone screen, pressing a specific physical button or button combination, inputting voice, or a gesture in the air. For example, after the original video is recorded, the user can click the original video thumbnail on the interface, or trigger the phone to display the detail interface of the original video. For example, the user can click the preview image 111 on the interface shown in (6) of FIG. 1, to trigger the display of the detail interface of the original video. The embodiments of the present application do not limit the operation mode of triggering the display of the detail interface of the original video. Figure 1
[0155] For example, if the user views the highlight moment photo in the one-shot multi-shot mode for the first time, the detail interface of the original video can further comprise a guide box to prompt the user that the one-shot multi-shot mode can intelligently capture multiple highlight moments for the user. For details, please refer to the interface shown in (3) of FIG. 2 and the related description, which will not be repeated here. If the user is not viewing the highlight moment photo in the one-shot multi-shot mode for the first time, the detail interface of the original video can not display the guide box, but directly automatically play the original video. Figure 2
[0156] For example, referring to FIG. 1, the process of step S502 is that the phone displays the interface shown in (2) of FIG. 1, the user clicks the original video thumbnail 602 to enter the detail interface of the original video shown in (3) of FIG. 1. Figure 6 Figure 6 Figure 6 Figure 6 The interface shown in (3) includes the original video 6031, the one-click blockbuster control 603, and the highlight area 6032. Figure 6 (3) shows that the original video 6031 is playing automatically. Alternatively, after the user clicks on the original video thumbnail 602, the details screen of the original video that the phone enters also includes a play button. After the user clicks the play button, the phone then enters... Figure 6 (3) shows the interface where the original video 6031 is playing. This means that the original video can play automatically after entering the details interface, or it can play in response to the user's playback operation after entering the details interface.
[0157] S503. In response to the user's Xth click on the one-click blockbuster control, display the first preview interface of the exciting short video. The first preview interface of the exciting short video is used to preview the exciting short video using the first video template and the save control.
[0158] For example, such as Figure 6 As shown in (4), the first preview interface of the exciting short video uses the first video template. The exciting short video can display a loading animation 604 on the first preview interface to indicate that the exciting short video is being generated. After the exciting short video is generated, the loading animation 604 disappears and the exciting short video plays automatically. In other embodiments, the exciting short video can also be played on the first preview interface after responding to the user's playback operation.
[0159] For example, such as Figure 6 The first preview interface of the exciting short video shown in (4) may include the exciting short video 6033 using the first video template, a music control 605, a share control 606, and a save control 607. The save control is used to save the exciting short video, the style control is used to change the style of the exciting short video in the first preview interface, and the music control is used to change the music of the exciting short video in the first preview interface. The first video template can be understood as a video template with the first video effect, and the first video template can be determined by any of the video template selection strategies mentioned above. For example Figure 6 (4) shows the wonderful short video 6033 that uses the first video template, and it can be seen that the wonderful short video has a border effect.
[0160] Exemplarily, when the user clicks the one-key blockbuster control for the Xth time in step S503, it means that the user clicks the one-key blockbuster control for the first time on the detail interface of the original video, and the mobile phone is triggered to select the video template directly, and the first video template is selected by using the selection strategy of the video template. When the user clicks the one-key blockbuster control for the Xth time in step S503, it means that the user clicks the one-key blockbuster control for the first time, and only when the condition of reselecting the video template is met, the mobile phone is triggered to select the video template, and when the condition of reselecting the video template is not met, the (X-1)th video template is used as the first video template. The first video template can be randomly selected from a plurality of candidate video templates by a random selection method, or can be selected by a specific order selection method. Exemplarily, the first video template used by the user when browsing the highlight short video for the Xth time can be selected by using the selection strategy of the video template before the user clicks the one-key blockbuster control. Until the user clicks the one-key blockbuster, the selected first video template is used to play the highlight short video. For details, refer to the related content of the foregoing introduction of the selection strategy of the video template, which will not be repeated here.
[0161] The first video template can specifically include a first style and a first music. The style can be a filter, that is, the video is color-treated by applying the filter. The filter is a kind of video effect, which is used to realize various special effects of the video. Alternatively, the style here can also be a fast-forward, slow-motion, etc. effect, and can also be a sticker, a frame, etc. effect. For details, refer to the foregoing introduction of the selection strategy of the video template, which will not be repeated here.
[0162] In some embodiments, the highlight short video previewed on the first preview interface can be generated by an AI configuration file. The highlight short video contains the highlight segment in the original video. After the user completes the recording of the original video, the AI configuration file can be obtained by intelligent recognition and analysis of the video stream of the original video, and stored in the same storage location as the original video. When the user clicks the one-key blockbuster control, the mobile phone generates the highlight short video according to the AI configuration file in response to the operation of the user clicking the one-key blockbuster control, and plays it on the first preview interface.
[0163] For example, a short video can be a virtual video. A virtual video is a data file that doesn't actually generate a video file; for instance, the playback logic of a virtual video could be XML playback logic. Because a virtual video isn't an actual generated video file, it occupies less memory than an actual generated video file. For example, if an actual generated video file occupies 5MB, while a virtual video occupies 30KB, playing the virtual video on the first preview screen reduces storage space consumption. When the user is satisfied with the short video previewed on the first preview screen, they can choose to save it. At this point, the actual generated video file is then generated and stored in the album, such as the "One Record, Many Gains" album. Later, the user can access the "One Record, Many Gains" album by launching the gallery application to view the short video.
[0164] For example, the process of performing step S503 can be: See Figure 6 (3) shows the details interface of the original video. Figure 6 (3) shows the details interface of the original video. Click the one-click blockbuster control 603 to enter. Figure 6 (4) shows the first preview interface of the exciting short video. Figure 6 (4) is the initial screen of the first preview interface of the exciting short video. The loading animation 604 is used to indicate that the exciting short video is being generated. The music control 605 is used to change the music of the exciting short video, and the style control 606 is used to change the style of the exciting short video. After the exciting short video is generated, the animation 604 disappears, and the exciting short video automatically plays and enters the preview. Figure 6 The interface shown in (5) is as follows.
[0165] It should be noted that clicking the one-click blockbuster control is only one way to trigger the first preview interface of the exciting short video. In other embodiments, users can trigger the first preview interface of the exciting short video by touching the one-click blockbuster control on the mobile phone screen, pressing a specific physical button or button combination, inputting voice, or using air gestures. This application embodiment does not limit this.
[0166] It should also be noted that steps S501 to S503 can be understood as a specific implementation method for triggering the display of the first preview interface of the exciting short video. In other embodiments, for example, it can also be achieved by clicking... Figure 1 The preview image 111 shown in (6) is used to trigger the first preview interface of the exciting short video by clicking the one-click blockbuster control. There are many specific ways to trigger the first preview interface of the exciting short video, and this application embodiment does not limit them.
[0167] S504. In response to the user's Xth click on the save control, save the short video using the first video template.
[0168] After the user browses the highlight short video using the first video template in step S503, the user can save the highlight short video by clicking the save control, generate an actual video file, and the virtual video generated by the AI configuration file can be emptied or still cached in the local phone. The user can generate a virtual video again by clicking the one-key big video control again. The saved actual video file can be viewed in the gallery. The highlight short video using the first video template can be saved in the one-recording-multiple-storing album or other albums.
[0169] In some other embodiments, after the user clicks the save control for the Xth time, the first preview interface can also prompt that the highlight short video is being saved and / or the current saving progress through a prompt box.
[0170] In some other embodiments, before step S504 is performed, other operations can also be performed, such as previewing the highlight short video using other styles by clicking the style control, and / or previewing the highlight short video using other music by clicking the music control.
[0171] For example, the process of performing step S504 can be that, referring to Figure 6 the first browsing interface shown in (5) of FIG. 6, the user clicks the save control 607 on the first browsing interface, and the phone enters the first browsing interface shown in (6) of FIG. 6, where a prompt box showing “saving” is displayed, and the saving progress is also displayed in the prompt box. Figure 6
[0172] It should be noted that clicking the save control is only one implementation of triggering saving the highlight short video using the first video template. In some other embodiments, the user can trigger saving the highlight short video using the first video template by touching the save control on the phone screen, pressing a specific physical button or button combination, inputting voice, air gesture, etc. The embodiments of the present application do not limit this.
[0173] S505, display the first detail interface of the highlight short video, wherein the first detail interface of the highlight short video is used to play the highlight short video using the first video template.
[0174] The first detail interface of the highlight short video includes the highlight short video using the first video template, and can further include editing, deleting, sharing and other controls. The user can edit the highlight short video using the first video template through the editing control, delete the highlight short video using the first video template through the deleting control, and share the highlight short video using the first video template through the sharing control.
[0175] In some embodiments, the first detail interface of the highlight short video automatically plays the highlight short video using the first video template. Specifically, after the highlight short video is saved, the first detail interface of the highlight short video can be automatically displayed, and the highlight short video using the first video template can be automatically played on the first detail interface. In other embodiments, after the first detail interface is automatically displayed, the user can click the play key to trigger the mobile phone to play the highlight short video using the first video template on the first detail interface.
[0176] For example, the process of step S505 can be that, referring to the first preview interface shown in (6) of FIG. 6, the prompt box 608 prompts that the highlight short video using the first video template is being saved. When the saving is completed, the first detail interface of the highlight short video shown in (7) of FIG. 6 is automatically entered. Figure 6 Figure 6 The highlight short video in the interface shown in (7) of FIG. 6 is automatically played, and the highlight short video can be shared, collected, edited, deleted, etc. through the sharing, collecting, editing, deleting and other controls shown in the interface. In other embodiments, after the highlight short video is saved, the first preview interface of the highlight short video is still displayed. When the user clicks the return control on the first preview interface, the detail interface of the original video shown in (3) of FIG. 6 is returned. For details, refer to the subsequent process of exiting the preview interface of the highlight short video introduced in Figure 6 Figure 6 Figure 11
[0177] S506, in response to the user clicking the gallery application for the X+1th time, displaying a photo grid interface, wherein the photo grid interface at least includes an original video thumbnail, and the original video is an original video obtained by shooting in a one recording multiple obtaining mode.
[0178] Before step S506 is performed, the mobile phone displays a main interface. Specifically, the user can click a control of the main interface to trigger the mobile phone to display the main interface, or the user can click a return control after step S505 is performed to return to the main interface.
[0179] The main interface displays a plurality of applications, at least including a gallery application. When the user needs to view the original video again, the gallery application can be clicked, and the phone displays a photo grid interface in response to the user's X+1th click on the gallery application.
[0180] It should be noted that the execution process and principle of step S506 can be referred to step S501, which will not be repeated here.
[0181] S507, in response to the user's X+1th click on the original video thumbnail, display the detail interface of the original video, wherein the detail interface of the original video includes the original video, one-key video control and photo thumbnail of highlight moment.
[0182] The execution process and principle of step S507 can be referred to the aforementioned step S502, which will not be repeated here.
[0183] For example, referring to Figure 6 , the change process of the phone interface in the execution process of steps S506 to S507 can be: the user clicks the gallery application 601 on the main interface shown in Figure 6 (8), enters the photo grid interface shown in Figure 6 (9), and then clicks the original video thumbnail 602 on Figure 6 (9), and then goes to the detail interface of the original video shown in Figure 6 (10). Figure 6 The interface related description of (8), (9) and (10) can be referred to the aforementioned related description of (1), (2) and (3), which will not be repeated here. Figure 6
[0184] S508, in response to the user's X+1th click on the one-key video control, display the second preview interface of the highlight short video, wherein the second preview interface of the highlight short video is used to preview the highlight short video using the second video template.
[0185] Wherein, the second video template and the first video template present different video effects. Due to the foregoing steps S501 to S505, the highlight short video using the first video template is saved. Therefore, when the user clicks the one-key video control again to trigger the display of the second preview interface of the highlight short video, in order to bring freshness to the user, the highlight short video using the first video template is not displayed, and the highlight short video using the second video template is displayed.
[0186] The second video template can be understood as a video template with a second video effect. This second video effect differs from the first video effect mentioned earlier. When a user clicks the "One-Click Blockbuster" control, it checks whether the user saved the video during their last viewing of a short video. If it's determined that the user saved a short video using the first video effect, then the condition for selecting a video template from the backup templates is met. Therefore, the selection strategy mentioned earlier is used to determine the second video template. While the first and second video templates have different video effects, their overall style is similar, both selected based on the same video scene. This provides users with sufficient novelty while ensuring that browsing short videos doesn't feel disjointed due to drastically different styles.
[0187] It is understood that the condition for triggering the mobile phone to select a new video template in this embodiment is: the user saves a short video. In some embodiments, after executing step S505, that is, after triggering the selection strategy of using any of the aforementioned video templates and determining the second video template, when step S507 is executed and the user clicks the one-click blockbuster control again, the second preview interface of the short video is triggered to present the short video using the second video template to the user.
[0188] For example, see Figure 6 The process of executing step S508 can be as follows: Figure 6 Clicking the one-click blockbuster control 603 on the details interface of the original video shown in (10) will take you to... Figure 6 (11) shows the second preview interface of the exciting short video. Figure 6 (11) and the aforementioned Figure 6 The short videos shown on the interface in (5) use different special effects. Figure 6 The short video shown in (11) features a sparkling star effect. Figure 6 The wonderful short video shown in (5) has a border effect.
[0189] In other embodiments, the second preview interface for the featured short video may further include a save control, a style control, and a music control. The style control can be used to change the style used in the previewed featured short video. The music control can be used to change the music used in the previewed featured video. For example, as shown... Figure 6 As shown in (11), when the user clicks Figure 6 After showing the style control 606 in (11), you can enter... Figure 6The style preview interface shown in (12) allows you to select the style 1, style 2, style 3, style 4, and style 5 effects for your short video. To change the style of the previewed short video, click the "√" icon. To not change the style, click the "√" icon. Figure 6 As shown in (12), click the "×" icon. After clicking the "×" icon, you will enter... Figure 6 The interface of (13) still uses the style and music of the previewed short videos in the second video template. When you want to change the music of the previewed short videos, you can click the music control 605 to enter the... Figure 6 The interface shown in (14) is in Figure 6 On the interface shown in (14), you can select to preview exciting short videos using soothing, romantic, and stunning music effects. When you want to change the music of the previewed exciting short video, you can click the "√" icon. When you don't want to change the style, you can click the "√" icon. Figure 6 As shown in (14), click the "×" icon. After clicking the "×" icon, you will enter... Figure 6 The second preview interface of the wonderful short video shown in (15) is that the wonderful short video preview in the interface still uses the style and music of the second video template.
[0190] In some embodiments, after executing step S508, if the user clicks the save control on the second preview interface of the featured short video, the phone responds to the click operation by saving the featured short video using the second video template, and displays the second details interface of the featured short video after saving. The second details interface of the featured short video is used to play the featured short video using the second video template. Since saving the featured short video triggers the phone to select a new video template using its video template selection strategy, when the user clicks the "One-Click Blockbuster" control for the third time, the phone responds by displaying the third preview interface of the featured short video, which is used to preview the featured short video using the third video template. The video effect of the third video template is different from that of the second video template; the specific process can be referred to the two browsing processes of featured short videos described in steps S501 to S508 above, and will not be repeated here.
[0191] It should be noted that, from Figure 6 (10) enters Figure 6 During (11) process, Figure 6 The interface shown in (11) can also display an animation effect to indicate "Generating a wonderful short video", so as to inform the user that a wonderful short video is currently being generated. This animation effect can be as follows: Figure 6 The motion effect on (4) is shown in 604.
[0192] It should be noted that the execution principle and process of step S508 can refer to the aforementioned step S503, and the main difference is that the video template used by the highlight short video is different. In step S508, the second video template is used, which is different from the first video template in step S503.
[0193] It should be noted that steps S506 to S508 are only one embodiment of triggering the display of the second preview interface of the highlight short video. In other embodiments, the second preview interface of the highlight short video can also be triggered by touching other controls, voice triggering, and other operation modes. The present application embodiment does not limit this.
[0194] It should be noted that, Figure 5 The video processing method shown can be understood as the video processing process when the user clicks the one-key blockbuster control for the Xth time to browse the highlight short video, and the video processing process when the user clicks the one-key blockbuster control for the X+1th time to browse the highlight short video. The Xth time and the X+1th time are any two adjacent operations of clicking the one-key blockbuster control.
[0195] In other embodiments, in the foregoing Figure 5 In the process of browsing the highlight short video for the Xth time, after step S503 is executed, if the user wants to change the music of the highlight short video using the first video template, the music control can be clicked to enter the music preview interface, for example, the interface shown in (14). Figure 6 The music preview interface includes a plurality of different music options, and "√" icons and "×" icons. When you want to change the music used by the previewed highlight short video, you can select the music option and click the "√" icon to confirm the change of the music of the highlight short video using the first video template. When you don't want to change the style, click the "×" icon. After clicking the "×" icon, the use process of the style control is similar and will not be described here. When the user triggers the phone to change the music and / or style in the highlight short video originally using the first video template through the music control and / or the style control, the save control on the first preview interface of the highlight short video can be clicked to save the highlight short video after the music and / or style are changed.
[0196] It should be noted that even if, during the Xth preview of the featured short video, the saved video is not the one displayed on the electronic device using the first video template, but rather a video with a different style and / or music selected by the user, the conditions for using the reselected video template will still be met during the X+1th preview of the featured short video. Consequently, during the X+1th preview of the featured short video, the electronic device will be triggered to reselect the video template using its video template selection strategy, displaying the featured short video using the second video template.
[0197] In this embodiment, in response to the user's Xth click on the "One-Click Blockbuster" control, a first preview interface of a short video is displayed. The first preview interface is used to preview the short video using the first video template. When the user clicks the save control, the electronic device saves the short video using the first video template. The save operation triggers the electronic device's video template selection strategy, selecting a second video template. The video effect of the second video template is different from that of the first video template. Therefore, when the user clicks the "One-Click Blockbuster" control for the (X+1)th time, the electronic device can respond to the X+1th click by displaying a second preview interface of a short video. The second preview interface is used to preview the short video using the second video template. When the user has saved the short video using the first video template, recommending a short video with a different video effect (i.e., the second video template) to the user can bring a sense of novelty and encourage the user to save and use more short videos with different video effects, thereby increasing the usage rate and user experience of the "One-Click Blockbuster" function.
[0198] From the aforementioned Figure 5 As can be seen from the illustrated embodiments, Figure 5 The video processing method shown is mainly applied to scenarios where the condition for reselecting a video template is met when viewing a featured short video for the (X+1)th time. Therefore, based on the aforementioned... Figure 5 The video processing method shown in this application embodiment also proposes... Figure 7 The video processing method shown is applied to scenarios where the conditions for reselecting a video template are not met when viewing a short video for the (X+1)th time.
[0199] exist Figure 7 In the video processing method shown, the conditions for reselecting the video template are also: receiving the operation of clicking the one-click blockbuster control, and saving the exciting short video during the last browsing of exciting short videos. Figure 7 The video processing method shown is similar to Figure 5 The video method shown can also be applied to the electronic devices proposed in the embodiments of this application. The following section uses a mobile phone as an example to illustrate this method. Figure 7 Steps:
[0200] S701, in response to the user's Xth click on the gallery application, display a photo grid interface, wherein the photo grid interface includes at least a raw video thumbnail, the raw video being a raw video obtained by shooting in a one-shot mode.
[0201] The execution process and principle of step S701 can be referred to step S501, which will not be repeated here.
[0202] S702, in response to the user's Xth click on the raw video thumbnail, display a detail interface of the raw video, wherein the detail interface of the raw video includes the raw video, a one-click big picture control, and a photo thumbnail of a highlight moment.
[0203] The execution process and principle of step S702 can be referred to step S502, which will not be repeated here.
[0204] S703, in response to the user's Xth click on the one-click big picture control, display a first preview interface of a highlight short video, wherein the first preview interface of the highlight short video is used to preview the highlight short video using a first video template.
[0205] The execution process and principle of step S703 can be referred to step S503, which will not be repeated here.
[0206] S704, in response to the user's click on the return control, exit the first preview interface of the highlight short video.
[0207] For example, the return control in step S704 can be displayed on the first preview interface of the highlight short video. Then the user can click the return control on the first preview interface of the highlight short video to exit the first preview interface of the highlight short video and return to the previous interface (i.e. the detail interface of the raw video).
[0208] There are many ways to trigger the operation of exiting the first preview interface of the highlight short video, for example, directly clicking the main interface control to return to the main interface, or triggering the operation of exiting the first preview interface of the highlight short video by voice or power button, which is not limited by the embodiments of the present application.
[0209] For example, referring to Figure 8 , the process of executing steps S701 to S704 can be that the user clicks the gallery application 801 on the main interface shown in (1) Figure 8 , the phone responds to the user's operation and enters the photo grid interface shown in (2) Figure 8 , the user clicks the raw video thumbnail 802 on the photo grid interface shown in (2) Figure 8 , and the phone responds to the user's operation and enters the detail interface of the raw video shown in (3) Figure 8(3) shows the details interface of the original video. When the user clicks the One-Click Movie Control 803, the mobile phone responds to the user's operation and proceeds to... Figure 8 (4) shows the first preview interface of the exciting short video. Users in Figure 8 Clicking the return control 804 on the interface shown in (4) will return to the previous screen. Figure 8 (5) shows the details interface of the original video. Among them, Figure 8 The interface shown in (5) is as originally intended. Figure 8 The playback progress and playback status in (3) are used to continue playing the original video.
[0210] In other embodiments, it is also possible to... Figure 8 On the (4) interface, clicking the home virtual control on the main interface returns to Figure 8 The main interface shown in (1) is the first details interface for exiting the short video.
[0211] In this embodiment of the application, before performing step S0704, the user can preview the wonderful short video using the first video template in the first preview interface, and can also edit, change the style, change the music, etc. of the wonderful short video, but does not save the wonderful short video using the first video template. That is, the essence of step S704 can be understood as exiting the first preview interface of the wonderful short video without saving the wonderful short video using the first video template.
[0212] S705, in response to the user's (X+1)th click on the gallery application, displays a photo grid interface, wherein the photo grid interface includes at least a thumbnail of the original video, and the original video is the original video captured in the one-record-many mode.
[0213] Before step S705 is executed, under the user's operation, the phone returns to the state of displaying the main interface, on which the gallery application is displayed. The user can then click on the gallery application, so that the phone responds to the user's click on the gallery application and triggers the display of the photo grid interface.
[0214] The execution process and principle of step S705 can be referred to the aforementioned step S701, and will not be repeated here.
[0215] In some embodiments, steps S705 and S706 may be omitted, and step S707 may be executed directly after step S704. That is, the process can return to the previous step in step S704. Figure 8 (5) shows the details interface of the original video, and then the user clicks Figure 8 The one-click block control shown in (5) triggers the execution step S707.
[0216] S706. In response to the user's (X+1)th click on the original video thumbnail, the details interface of the original video is displayed, which includes the original video, the one-click blockbuster control, and photo thumbnails of the highlights.
[0217] The execution process and principle of step S706 can be referred to the aforementioned step S702, and will not be repeated here.
[0218] S707: In response to the user's (X+1)th click on the one-click blockbuster control, display the first preview interface of the exciting short video. The first preview interface of the exciting short video is used to preview the exciting short video that uses the first video template.
[0219] Steps S705 to S707 represent the process of the user triggering the display of the preview interface for the featured short video for the (X+1)th time. When the preview interface for the featured short video is displayed for the (X+1)th time, since the featured short video was not saved when the preview interface was displayed for the Xth time, when the mobile phone receives the click on the "One-Click Blockbuster" control, it can be determined that the featured short video was not saved when it was viewed for the Xth time. Therefore, the condition for reselecting a video template is not met, and the operation of reselecting a video template is not triggered. Consequently, the displayed preview interface is still the first preview interface of the featured short video, which is the same as when it was triggered for the Xth time. The user is still previewing the featured short video that uses the first video template.
[0220] The execution process and principle of step S707 can be referred to the aforementioned step S703, and will not be repeated here. The changes to the phone's interface during steps S705 to S707 can be referred to... Figure 8 :like Figure 8 As shown in (6), during the (X+1)th time browsing the featured short videos, the user clicked Figure 8 (6) shows the gallery application 801, the phone enters Figure 8 The photo grid interface shown in (7) allows the user to click... Figure 8 The original video thumbnail 802 shown in (7) is accessed by the mobile phone. Figure 8 (8) shows the details interface of the original video. The user clicks... Figure 8 The one-click blockbuster control 803 shown in (8) enters... Figure 8 (9) shows the first preview interface of the exciting short video. (by...) Figure 8 As can be seen, the short video shown during the (X+1)th preview... Figure 8 The interface of (9) is the same as that shown in the Xth preview. Figure 8 The interface of (4) is consistent, and the video templates used in the exciting short videos are the same, all of which are border templates. Figure 8 For descriptions of the interfaces of (6), (7), (8), and (9), please refer to the aforementioned... Figure 8 Steps (1), (2), (3), and (4) will not be repeated here. Steps S705 to S707 can be understood as one implementation of triggering the display of the first preview interface of the exciting short video for the (X+1)th time. There are many other specific ways to trigger the display of the first preview interface of the exciting short video on the mobile phone for the (X+1)th time, which will not be repeated in this embodiment.
[0221] If the user does not save the featured short video, the video template used for each preview will be consistent, making the user feel that the previewed featured short video has not changed. This avoids the misconception that the previously viewed featured short video has been deleted when the user views the featured short video for the X+1th time after not saving it, thus improving the user experience of the "One-Click Blockbuster" control function.
[0222] It should also be noted that, Figure 7 The video processing method shown can be understood as the video processing process when a user clicks the "One-Click Blockbuster" control to browse exciting short videos for the Xth time, and the video processing process when the user clicks the "One-Click Blockbuster" control to browse exciting short videos for the (X+1)th time. The Xth and X+1th times refer to any two consecutive clicks of the "One-Click Blockbuster" control.
[0223] In this embodiment, when the user clicks the "One-Click Blockbuster" control for the Xth time, the electronic device responds to the user's Xth click by displaying a first preview interface of a short video. This first preview interface is used to preview a short video using a first video template. If the electronic device does not save the short video using the first video template and instead exits the first preview interface, the electronic device will still display the first preview interface of the short video when the user clicks the "One-Click Blockbuster" control for the (X+1)th time. This ensures that the video template used in each preview is consistent, even if the user has not saved the video. This prevents the user from mistakenly believing that the previously viewed short video has been deleted when viewing it again, thus improving the user experience of the "One-Click Blockbuster" control function.
[0224] when Figure 5 and Figure 7 When applied to the electronic device proposed in the embodiments of this application, when a user browses and saves a short video, execution is triggered. Figure 5 The video processing method triggers execution when a user browses exciting short videos without saving them. Figure 7 The video processing methods.
[0225] The above-mentioned Figure 5 and Figure 7 In the illustrated video processing method, the condition for triggering the highlight short video to use the newly selected video template is that the operation of clicking the one-key big video control is received and the highlight short video is saved in the last browsing process of the highlight short video. In some other embodiments, for example, the following description Figure 9 In the illustrated video processing method, the condition for triggering the highlight short video to use the newly selected video template can also be that the operation of clicking the one-key big video control is received. Unlike the triggering conditions of Figure 5 and Figure 7 , no matter whether the user performs the operation of saving the highlight short video, as long as the operation of clicking the one-key big video control by the user is received, the mobile phone is triggered to use the video template selection strategy to select the video template at the same time of triggering the preview interface of the highlight short video to be displayed, and thus the video template used by the highlight short video previewed by the user each time is a newly selected template, which brings freshness and interest to the user. For details, refer to the following description of the illustrated video processing method. Figure 9
[0226] Referring to Figure 9 , another video processing method is provided in the embodiments of the present application, which is applied to the electronic device provided in the embodiments of the present application, and the steps of the method are described in detail below with the mobile phone as an example.
[0227] S901, in response to the operation of the user clicking the gallery application for the Xth time, a photo mosaic interface is displayed, wherein the photo mosaic interface at least includes a thumbnail of an original video, and the original video is an original video obtained by shooting in a one-shot-multiple-get mode.
[0228] The execution process and principle of step S901 can be referred to the aforementioned step S701, which will not be described here again.
[0229] S902, in response to the operation of the user clicking the thumbnail of the original video for the Xth time, a detail interface of the original video is displayed, wherein the detail interface of the original video includes the original video, a one-key big video control, and a photo thumbnail of a highlight moment.
[0230] The execution process and principle of step S1902 can be referred to the aforementioned step S702, which will not be described here again.
[0231] S903, in response to the operation of the user clicking the one-key big video control for the Xth time, a first preview interface of a highlight short video is displayed, wherein the first preview interface of the highlight short video is used to preview the highlight short video using a first video template.
[0232] After step S903 is executed, exemplary, further operations can include: in response to the user's Xth click on the save control, saving the highlight short video using the first video template, and after saving is completed, displaying a first detail interface of the highlight short video, wherein the first detail interface of the highlight short video is used to play the highlight short video using the first video template. For details, please refer to the aforementioned steps S504 and S505, which will not be repeated here.
[0233] In other embodiments, after step S903 is executed, further operations can include: in response to the user's click on the style control, displaying a style preview interface, for example, please refer to the description of (12) of the aforementioned (2). Figure 6 In other embodiments, after step S903 is executed, further operations can include: in response to the user's click on the music control, displaying a music preview interface, for example, please refer to the description of (14) of the aforementioned (2). Figure 6
[0234] For details of the execution process and principles of step S903, please refer to the aforementioned step S703, which will not be repeated here.
[0235] S904, in response to the user's X+1th click on the gallery application, displaying a photo grid interface, wherein the photo grid interface includes at least a thumbnail of the original video, and the original video is an original video obtained by shooting in the one recording multiple taking mode.
[0236] Before step S904 is executed, the phone displays the main interface under the user's operation. Then the user can click on the gallery application on the main interface to trigger the phone to display the photo grid interface.
[0237] For details of the execution process and principles of step S904, please refer to the aforementioned step S901, which will not be repeated here.
[0238] S905, in response to the user's X+1th click on the original video thumbnail, displaying a detail interface of the original video, wherein the detail interface of the original video includes the original video, a one-click big picture control, and a photo thumbnail of the highlight moment.
[0239] For details of the execution process and principles of step S905, please refer to the aforementioned step S902, which will not be repeated here.
[0240] S906, in response to the user's X+1th click on the one-click big picture control, displaying a second preview interface of the highlight short video, wherein the second preview interface of the highlight short video is used to preview the highlight short video using the second video template.
[0241] The execution process and principle of step S906 can be referred to the aforementioned step S903. The difference is that the video template of the featured short video in the second preview interface is the second video template, which is different from the first video template used in the featured short video in the first preview interface.
[0242] For example, see Figure 10 ,implement Figure 9 The video processing method shown can be as follows: During the Xth viewing of a short video, the user... Figure 10 On the main interface shown in (1), click on the Gallery app 1001, and the phone will enter... Figure 10 As shown in (2) of the photo grid interface, the user clicks on the original video thumbnail 1002 on the interface shown in (2) of 10 to enter the... Figure 10 (3) shows the details interface of the original video. The user in Figure 10 Click on the one-click blockbuster control 1003 on the interface shown in (3) to enter Figure 10 (4) shows the first preview interface of the exciting short video. During the X+1th viewing of the exciting short video, the user... Figure 10 On the main interface shown in (5), click on the Gallery app 1001, and the phone will enter... Figure 10 The photo grid interface shown in (6) allows the user to click on the original video thumbnail 1002 on the interface shown in (6) of 10 to enter the... Figure 10 (7) shows the details interface of the original video. The user is in Figure 10 Click on the one-click blockbuster control 1003 on the interface shown in (7) to enter Figure 10 (8) shows the second preview interface of the exciting short video. (by...) Figure 10 (4) and Figure 10 As can be seen from (8), the video template used in the preview of the short video for the Xth time is different from the video template used in the X+1th time.
[0243] As can be seen from the aforementioned steps S901 to S906, the video templates used for the Xth and X+1th times the mobile phone displays a short video are different. When clicking the "One-Click Movie" control for the Xth time and the X+1th time, regardless of whether the video was saved while browsing, the electronic device triggers the operation of selecting the video template for the short video using the video template selection strategy every time the "One-Click Movie" control is clicked. This results in the video template used for each short video being viewed being different from the previous one, bringing freshness and fun to the user.
[0244] Next, we will describe the process of exiting the preview interface of the featured short video (including the first preview interface and the second preview interface) involved in any of the video processing methods mentioned above. Besides the methods mentioned above... Figure 8 The interface shown in (4) exits to Figure 8 In addition to the interface shown in (5), you can also exit to the details interface of the featured short videos. The specific exit process is as follows:
[0245] Step 1: Display the preview interface of the exciting short video, which includes at least a back control.
[0246] The preview interface for the featured short video can be understood as a collective term for the first preview interface and the second preview interface for the featured short video mentioned in the embodiments of this application, as well as other interfaces used for previewing the featured short video. There are many processes for triggering the display of the preview interface for the featured short video, such as those mentioned above. Figure 5 , Figure 7 or Figure 9 The method for triggering and displaying the preview interface of the exciting short video is not described in detail in this embodiment.
[0247] For example, see Figure 11 , Figure 11 The interface shown in (1) is the details interface of the original video, where the user... Figure 11 Clicking the one-click blockbuster control 1101 on the interface shown in (1) will take you to... Figure 11 (2) shows the preview interface of the exciting short video, which includes a return control 1102, a save control 1103, a share control 1104, and a style control 1105.
[0248] Step 2: Respond to the user's click on the back control on the preview screen of the featured short video and determine whether the featured short video has been saved.
[0249] If step 2 determines that the featured short video has not been saved, proceed to step 3; if step 2 determines that the featured short video has been saved, proceed to step 4. Here, whether the featured short video has been saved in step 2 can be understood as the preview interface of the featured short video generated on the electronic device's screen, indicating whether the video should be saved.
[0250] In some embodiments, after saving a featured short video on the preview screen, the user will be directly taken to the featured short video's details screen. For example, see the aforementioned... Figure 6 Descriptions of interfaces (4), (5), (6) and (7).
[0251] In some embodiments, if the user clicks the sharing control on the preview interface of the highlight short video, the preview interface of the highlight short video prompts to save the highlight short video, and after the highlight short video is saved, the user can be directed to the sharing platform selected by the user to share the highlight short video, and if the user selects to cancel sharing, the user stays on the preview interface of the highlight short video. At this time, the electronic device displays the preview interface of the highlight short video, and the highlight short video has been saved. When the user clicks the return control on the preview interface, the electronic device executes step 2, determines that the highlight short video has been saved, and executes step 4.
[0252] In addition to the sharing scenario mentioned above, there are other scenarios in which the electronic device displays the preview interface of the highlight short video and the highlight short video has been saved. The embodiments of the present application will not be repeated here.
[0253] In some embodiments, the user only previews the highlight short video on the preview interface of the highlight short video, or performs the operation of changing the style of the highlight short video and / or the music, without performing the operation of triggering the electronic device to save the highlight short video. Therefore, when step 2 is executed, it is determined that the highlight short video has not been saved, and step 3 is triggered to be executed. For example, the scenario in which the electronic device displays the preview interface and the highlight short video has not been saved can refer to the processes of (10), (11), (12), (13), (14) to (15) of (2) and (3) to (4) shown in the foregoing, and the embodiments of the present application will not be repeated here. Figure 6 Figure 8 For example, the scenario in which the electronic device displays the preview interface and the highlight short video has not been saved can refer to the processes of (10), (11), (12), (13), (14) to (15) of (2) and (3) to (4) shown in the foregoing, and the embodiments of the present application will not be repeated here.
[0254] It should be noted that in addition to the operation of the user clicking the return control on the preview interface of the highlight short video, the operation of the user performing a gesture return on the preview interface of the highlight short video, the operation of the user speaking, touching other controls, and a series of operations of triggering the preview interface of the highlight short video to exit can also trigger the execution of the determination of whether the highlight short video has been saved. The electronic device selects the way to exit the preview interface of the highlight short video according to the determination result of whether the highlight short video has been saved. The embodiments of the present application do not limit the operation of triggering the preview interface of the highlight short video to exit.
[0255] For example, referring to Figure 11 , the process of executing step 2 can be that the user clicks the return control 1102 shown in (2) of Figure 11 , or performs a gesture return on the interface shown in (2) of Figure 11 , to trigger the electronic device to execute the determination logic of whether the highlight short video has been saved.
[0256] Step 3, display the detail interface of the original video.
[0257] The detail interface of the original video is used to play the original video. For details, refer to the description of the detail interface of the original video in any of the preceding video processing methods, which will not be repeated here.
[0258] Since the highlight short video is not saved, when the user performs the return operation, the highlight short video preview interface is returned to the previous interface, i.e., the detail interface of the original video. For example, after returning to the detail interface of the original video, the detail interface of the original video is maintained in the playing state and the playing progress before entering the highlight short video preview interface. For example, if the playing state is paused, the user clicks the one-key large video control to enter the preview interface of the original video, and when step 3 is performed, the playing state of the displayed detail interface of the original video is also maintained in the paused state.
[0259] For example, referring to Figure 11 , after the electronic device performs the judgment logic of whether the highlight short video is saved, if it is judged that the highlight short video is not saved, the electronic device enters the detail interface of the original video shown in (3) of Figure 11 . The playing state and the playing progress of the detail interface of the original video shown in (3) of Figure 11 are consistent with the playing state and the playing progress of the detail interface of the original video shown in (1) of Figure 11 .
[0260] Step 4: Display the detail interface of the highlight short video.
[0261] The detail interface of the highlight short video in the embodiments of the present application can also be understood as the detail interface of the highlight short video. The detail interface of the highlight short video is used to play the highlight short video. For details, refer to the description of the first detail interface of the highlight short video or the second detail interface of the highlight short video in any of the preceding video processing methods, which will not be repeated here.
[0262] For example, referring to Figure 11 , after the electronic device performs the judgment logic of whether the highlight short video is saved, if it is judged that the highlight short video is saved, the electronic device enters the detail interface of the highlight short video shown in (4) of Figure 11 . For example, after displaying the detail interface of the highlight short video, the highlight short video is automatically played from the first frame.
[0263] In other embodiments, if the original video recorded by the user has a watermark, the short video will also have a watermark. Therefore, when the electronic device responds to the user clicking the "One-Click Blockbuster" control, the preview interface of the displayed short video may not have a border effect (i.e., the video template used masks the border effect) to avoid the border obscuring the watermark. For example, upon receiving the user's click on the "One-Click Blockbuster" action, the camera application may inform the gallery application whether the original video has a watermark. If it is determined that the video application has a watermark, the border effect in the video template used for the short video is turned off, and the short video without a border is played. Alternatively, if it is determined that the video application has a watermark, a candidate video template without a border effect is selected, and then the short video is displayed using the selected candidate video template. For example... Figure 12 As shown, Figure 12 The featured short videos are watermarked with "Model XXXXXX" 1201, therefore the preview interface of the featured short videos does not have any borders.
[0264] In other embodiments, the style preview interface mentioned in the foregoing embodiments of this application, and / or the preview interface of the featured short video (the preview interface of the featured short video can be understood as a collective term for the first preview interface and the second preview interface of the featured short video), may display a special effects switch control. The special effects switch control is used to turn the filters, special effects, and border effects on or off. When the special effects switch control is on, the video effects of the filters, special effects, and borders included in the video template can be added to the featured short video; when the special effects switch control is off, the video effects of the filters, special effects, and borders included in the video template are not added to the featured short video. For example... Figure 13 The style preview interface shown in (1) has the special effects switch control in the on state. When the user clicks... Figure 13 The special effects switch control shown in (1) allows you to enter... Figure 13 The interface shown in (2) indicates that the effects switch control is off, and the user is prompted that "Effects, stickers, and borders are off." Clicking again... Figure 13 The special effects switch control shown in (2) enters... Figure 13 The interface shown in (3) has the effects switch control on, and prompts the user that "Effects, stickers, and borders are enabled." For example... Figure 14 (1) shows the preview interface of the exciting short video. The user clicks... Figure 14 The special effects switch control shown in (1) allows you to enter... Figure 14 The interface shown in (2) indicates that the effects switch control is off, and the user is prompted that "Effects, stickers, and borders are off." Clicking again... Figure 14the special effect switch control shown in (2) of FIG. 1B, enters Figure 14 the interface shown in (3) of FIG. 1B, the special effect switch control is in an open state, and prompts the user that "special effects, stickers and borders are turned on". If some users do not like the video effects of special effects, stickers and borders, they can turn off the special effect switch control to obtain a satisfactory highlight short video.
[0265] In some other embodiments, if it is determined that the original video has a watermark in response to the operation of the user clicking the one-key large picture control, the special effect switch control is controlled to be in a closed state to avoid the highlight short video using the border special effect from blocking the watermark.
[0266] It should be noted that the first interface of the gallery application mentioned in the embodiments of the present application can be a detail interface of the original video, the first control can be a one-key large picture control, the first region can be a highlight moment area, the first video can be an original video, and the first operation performed on the first control can be an operation of clicking the one-key large picture control. The second interface can be a first preview interface of the highlight short video. The second video can be a highlight short video using a second video template. The third interface can be a second preview interface of the highlight short video. The second operation of the user can be an operation of clicking the save control. The fourth interface can be a first detail interface of the highlight short video. The fifth interface can be a music preview interface. The fourth operation performed on the music control can be an operation of clicking the music control. The fifth operation can be an operation of selecting a music option in the music preview interface. The sixth interface can be a preview interface of the highlight short video after using the music selected by the user. The seventh operation of the user performed on the style control can be an operation of the user clicking the style control. The seventh interface can be a style preview interface. The eighth operation can be an operation of selecting a style. The eighth interface can be a preview interface of the highlight short video after using the style selected by the user. The ninth operation can be an operation of saving the preview interface of the highlight short video after using the style selected by the user. The fifth video can be the highlight short video after using the style selected by the user. The tenth operation can be an operation of clicking the back control. The eleventh operation can be an operation of clicking the gallery application. The ninth interface can be a photo mosaic interface or a mosaic interface of a certain album. The twelfth operation can be an operation of the user clicking a thumbnail of the original video.
[0267] The embodiments of the present application further provide a computer readable storage medium including instructions, when the instructions run on an electronic device, cause the electronic device to perform any video processing method proposed in the embodiments of the present application.
[0268] The embodiments of the present application further provide a computer program product including instructions, when the computer program product runs on an electronic device, cause the electronic device to perform any video processing method proposed in the embodiments of the present application.
[0269] The embodiment further provides a control device including a processor and a memory for storing computer program code including computer instructions, when the processor executes the computer instructions, the control device executes any video processing method proposed in the embodiment. The control device can be an integrated circuit IC, or a system on chip SOC. The integrated circuit can be a general-purpose integrated circuit, or a field-programmable gate array FPGA, or an application-specific integrated circuit ASIC.
[0270] Through the description of the above embodiments, those skilled in the art can clearly understand that, for the convenience and brevity of description, only the above-mentioned division of functional modules is taken as an example, and in actual application, the above-mentioned functions can be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the foregoing method embodiments, which will not be repeated here.
[0271] In several embodiments provided in the embodiment, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the modules or units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interface, device or unit, and can be electrical, mechanical or other forms.
[0272] The units described as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on a plurality of network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.
[0273] In addition, each functional unit in each embodiment of the embodiment can be integrated in one processing unit, or each unit can exist physically independently, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.
[0274] The integrated unit, if implemented in the form of a software function unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments can be embodied in the form of a software product in essence or in the form of a whole or part of the technical solutions that contribute to the prior art, and the computer software product is stored in a storage medium, including a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the methods described in the embodiments. The aforementioned storage medium includes: a flash memory, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk, or an optical disk, and various media that can store program codes.
[0275] The above is merely specific implementations of the present application, but the protection scope of the present application is not limited thereto, any changes or replacements within the technical scope disclosed in the present application should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.
Claims
1. A method of video processing, the method comprising: The application comprises: displaying a first interface of a gallery application, the first interface comprising a first video, a first control, and a first region; the first region comprising a thumbnail of the first video and a thumbnail of at least one associated photo, the associated photo being a photo automatically taken during recording of the first video; in response to a first operation performed by a user on the first control, displaying a second interface; the second interface playing a second video using a first video template; the second video comprising at least one video frame in the first video; displaying the first interface again; in response to the first operation performed by the user again on the first control, displaying a third interface; the third interface playing a third video using a second video template, the third video comprising at least one video frame in the first video; wherein the first video template and the second video template use different template parameters, the template parameters comprising one or more of music, filter, special effect, frame, or transition type.
2. The method of claim 1, wherein, The first video template and the second video template are both video templates in a plurality of alternative video templates; the alternative video templates are video templates matching a video overall scene of the first video.
3. The method according to claim 1 or 2, characterized in that, Before displaying the third interface in response to the first operation performed by the user again on the first control, the application further comprises: in response to a second operation by the user, saving the second video.
4. The method of claim 3, wherein, The second interface comprises a save control; the second operation is a second operation performed on the save control of the second interface.
5. The method of claim 3, wherein, After saving the second video in response to the second operation by the user, the application further comprises: displaying a fourth interface; the fourth interface playing the second video; the fourth interface being a detail interface of the second video.
6. The method of claim 3, wherein, The second interface comprises a return control; after saving the second video in response to the second operation by the user, the application further comprises: in response to a third operation performed by the user on the return control of the second interface, displaying a fourth interface; the fourth interface playing the second video; the fourth interface being a detail interface of the second video.
7. The method of claim 1 or 2, wherein, The second interface and the third interface both further comprise a style control and a music control; the style control is used to preview video effects using a plurality of different styles; the music control is used to preview video effects using a plurality of different music.
8. The method of claim 7, wherein, After displaying the second interface in response to the first operation performed by the user on the first control, the application further comprises: in response to a fourth operation performed by the user on the music control, displaying a fifth interface; the fifth interface comprising a plurality of different music options; in response to a fifth operation by the user, displaying a sixth interface; the sixth interface playing a fourth video using music selected by the user; the fourth video comprising at least one video frame in the first video; in response to a sixth operation by the user, saving the fourth video.
9. The method of claim 8, wherein, The sixth interface further comprises a save control; the sixth operation is a sixth operation performed on the save control of the sixth interface.
10. The method of claim 7, wherein, After displaying the second interface in response to the first operation performed by the user on the first control, the application further comprises: In response to a seventh operation performed by the user on the style control, a seventh interface is displayed; the seventh interface includes a plurality of different style options; In response to an eighth operation performed by the user, an eighth interface is displayed; the eighth interface plays a fifth video using the style selected by the user; the fifth video includes at least one video frame in the first video; In response to a ninth operation performed by the user, the fifth video is saved.
11. The method of claim 1 or 2, wherein, If the first video carries a watermark, neither the second video nor the third video displays a video effect of a frame.
12. The method of claim 1 or 2, wherein, The second interface and the third interface both include a special effect switch control, or the seventh interface includes a special effect switch control; the seventh interface includes a plurality of different style options; the special effect switch control is used to turn on or turn off the video effects of the filter, the special effect, and the frame.
13. The method of claim 12, wherein, If the first video carries a watermark, the special effect switch control is in an off state.
14. The method of claim 1 or 2, wherein, The selection method of the second video template includes: A video template is randomly selected from a plurality of alternative video templates as the second video template; Or, A video template arranged next to the first video template is selected from a plurality of alternative video templates arranged in a specific order as the second video template.
15. The method of claim 1, wherein, The response to the first operation performed by the user again on the first control to display a third interface includes: In response to the first operation performed by the user again on the first control, the third interface is displayed in the case where the second video is saved; The method further includes: In response to the first operation performed by the user again on the first control, the second interface is displayed in the case where the second video is not saved.
16. The method of claim 15, wherein, The first interface is displayed again, including: In response to a tenth operation performed by the user, the first interface is displayed again; The second interface further includes a return control; the tenth operation is a tenth operation performed by the user on the return control of the second interface.
17. The method of claim 1, wherein, The first interface of the gallery application includes: In response to an eleventh operation performed by the user, a ninth interface of the gallery application is displayed; the ninth interface includes a thumbnail of the first video; In response to a twelfth operation performed by the user on the thumbnail of the first video, the first interface of the gallery application is displayed.
18. An electronic device, comprising: The electronic device includes a processor and a memory, the processor and the memory are coupled, the memory is used to store a computer program, when the computer program is executed by the processor, the electronic device executes the method in any one of claims 1 to 17.
19. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, when the computer program is executed by the processor, the processor executes the method in any one of claims 1 to 17.
Citation Information
Patent Citations
Method for processing video file and electronic equipment
CN111061912A
Video and image processing method and device, electronic equipment and storage medium
CN111541936A