Multimedia file processing method, multimedia file processing device and electronic equipment

Abstract

The invention discloses a multimedia file processing method, a multimedia file processing device and electronic equipment, and belongs to the technical field of multimedia file processing. The method comprises the steps that a first multimedia file is obtained, the first multimedia file comprises N frames of pictures, and N is an integer larger than 1; according to the N frames of pictures, a first picture is generated, the first picture comprises at least part of image content of at least M frames of pictures in the N frames of pictures, and M is an integer larger than 1 and smaller than or equal to N; and displaying a thumbnail of the first picture in a preview window of the first multimedia file.

Description

Technical Field

[0001] The present application belongs to the technical field of multimedia file processing, and specifically relates to a multimedia file processing method, a multimedia file processing device and an electronic device. Background Art

[0002] A user can use an electronic device to shoot videos or photos. In related technologies, after a user shoots a burst of photos or videos, the user can view thumbnails of the burst photos and videos in an album interface, wherein the thumbnail of the burst photo is the thumbnail of the first frame of the burst photo, and the thumbnail of the video is the image content of the first frame or other fixed frames in the video.

[0003] If the user needs to view the changing trend of the content in the continuous photos or videos, he needs to long press the continuous photos to view each frame of the continuous photos, or click the video play button to watch the video content. Therefore, the method for users to view the changing trend of the content in the continuous photos or videos in the related art has the defect of complex operation. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a multimedia file processing method, a multimedia file processing device and an electronic device, which can synthesize a first picture according to the image content in at least two frames of pictures in a continuous photo or video, and use the first picture as a thumbnail in the preview window of the continuous photo or video. In this way, the user can know the changing trend of the shooting content in the continuous photo or video through this thumbnail, and the operation is simple.

[0005] In a first aspect, an embodiment of the present application provides a method for processing multimedia files, the method comprising:

[0006] Acquire a first multimedia file, wherein the first multimedia file includes N frames of pictures, where N is an integer greater than 1;

[0007] Generate a first picture according to the N frames of pictures, wherein the first picture includes at least part of image content of at least M frames of pictures among the N frames of pictures, where M is an integer greater than 1 and less than or equal to N;

[0008] A thumbnail of the first picture is displayed in a preview window of the first multimedia file.

[0009] In a second aspect, an embodiment of the present application provides a multimedia file processing device, the device comprising:

[0010] A first acquisition module, configured to acquire a first multimedia file, wherein the first multimedia file includes N frames of pictures, where N is an integer greater than 1;

[0011] An image processing module, configured to generate a first image according to the N frames of images, wherein the first image includes at least a portion of image content of at least M frames of images among the N frames of images, where M is an integer greater than 1 and less than or equal to N;

[0012] The first display module is used to display a thumbnail of the first picture in the preview window of the first multimedia file.

[0013] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0014] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0015] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0016] In a sixth aspect, an embodiment of the present application provides a computer program product, which includes computer instructions, and when the computer instructions are executed by a processor, the method described in the first aspect is implemented.

[0017] In an embodiment of the present application, a first multimedia file is obtained, wherein the first multimedia file includes N frames of pictures, where N is an integer greater than 1; a first picture is generated based on the N frames of pictures, wherein the first picture includes at least part of the image content of at least M frames of pictures in the N frames of pictures, where M is an integer greater than 1 and less than or equal to N; and a thumbnail of the first picture is displayed in a preview window of the first multimedia file. For images containing at least two frames of pictures, such as continuous photos and videos, at least part of the image content of at least two frames of pictures is placed in the same first picture, so that in the preview window of the continuous photos or videos, the image content of at least two frames of pictures in the continuous photos or videos can be previewed through the thumbnail of the first picture, so that the user can be informed of the changing trend of the content captured in the continuous photos or videos, and the operation method is simple. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 is a flowchart of a multimedia file processing method provided by some embodiments of the present application;

[0019] Figure 2a It is one of the interface schematic diagrams in the first embodiment of the present application;

[0020] Figure 2b This is the second interface schematic diagram in the first embodiment of the present application;

[0021] Figure 2c This is the third interface diagram in the first embodiment of the present application;

[0022] Figure 2d This is the fourth interface diagram in the first embodiment of the present application;

[0023] Figure 2e This is the fifth interface diagram in the first embodiment of the present application;

[0024] Figure 3a This is one of the interface schematic diagrams in the second embodiment of the present application;

[0025] Figure 3b This is the second interface diagram in the second embodiment of the present application;

[0026] Figure 3c This is the third interface diagram in the second embodiment of the present application;

[0027] Figure 4 is a schematic diagram of the processing flow of continuous shooting photos in some embodiments of the present application;

[0028] Figure 5a This is one of the interface schematic diagrams in the third embodiment of the present application;

[0029] Figure 5b This is the second interface diagram in the third embodiment of the present application;

[0030] Figure 6a This is one of the interface schematic diagrams in the fourth embodiment of the present application;

[0031] Figure 6b This is the second interface diagram in the fourth embodiment of the present application;

[0032] Figure 7a This is one of the interface schematic diagrams in Embodiment 5 of the present application;

[0033] Figure 7b This is the second interface diagram in the fifth embodiment of the present application;

[0034] Figure 8a is one of the schematic diagrams of image block patterns in some embodiments of the present application;

[0035] Figure 8b This is the second schematic diagram of the image block pattern in some embodiments of the present application;

[0036] Figure 8cThis is a third schematic diagram of image block patterns in some embodiments of the present application;

[0037] Fig. 9 is a schematic diagram of a custom image block style in some embodiments of the present application;

[0038] Fig.10 is a schematic diagram of a video processing flow in some embodiments of the present application;

[0039] Fig.11 is a schematic diagram of the structure of a multimedia file processing device provided by some embodiments of the present application;

[0040] Fig.12 is a schematic diagram of the structure of an electronic device provided by some embodiments of the present application;

[0041] Fig.13 It is a schematic diagram of the hardware structure of an electronic device provided in some embodiments of the present application. DETAILED DESCRIPTION

[0042] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0043] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0044] The multimedia file processing method, multimedia file processing device and electronic device provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

[0045] See also Figure 1 The multimedia file processing method provided in the embodiment of the present application includes the following steps:

[0046] Step 101: Obtain a first multimedia file, wherein the first multimedia file includes N frames of pictures, where N is an integer greater than 1.

[0047] In some implementations, the first multimedia file may be a burst of photos.

[0048] In some implementations, the first multimedia file may be a video.

[0049] It is worth noting that in the related art, the continuous photo as a whole only displays a thumbnail of one frame in the album. Only when the user clicks on the thumbnail and switches the frames in the continuous photo, can the other frames in the continuous photo be viewed. For videos, the first frame or a fixed frame in the video is displayed as the cover of the video in the album, social platform or conversation interface. Only when the user clicks the play button of the video to play the video, can the other frames in the video be viewed.

[0050] In some implementations, the first multimedia file may be acquired by any method such as shooting, downloading, or receiving. For ease of explanation, in the embodiments of the present application, shooting the first multimedia file is generally used as an example for illustration, which is not specifically limited herein.

[0051] Step 102: Generate a first picture according to the N frames of pictures, wherein the first picture includes at least part of the image content of at least M frames of pictures among the N frames of pictures, where M is an integer greater than 1 and less than or equal to N.

[0052] In some embodiments, the first picture represents a picture. Generating the first picture according to the N frames of pictures may be performing at least one of image processing such as cutout, cropping, splicing, and fusion on the N frames of pictures, so that the generated first picture can contain at least part of the image content of at least two frames of pictures in the N frames of pictures.

[0053] In some embodiments, M may be equal to N. In this case, the first picture includes at least a portion of the image content in each of the N frames of pictures.

[0054] For example, for a continuous photo including N frames of pictures, part of the image content may be captured from each of the N frames of pictures, and the N image blocks captured from the N frames of pictures may be spliced ​​to obtain a first picture.

[0055] Another example: for a continuous photo containing N frames of pictures, since the shooting angles of continuous photos usually change little, the first frame of the N frames can be used as the background picture, and the photographed objects in the other N-1 frames, such as people, ornaments, vehicles, etc., can be cut out separately. Finally, the image content of the photographed objects in the N-1 frames obtained by cutting out can be embedded into the background picture to obtain the first picture.

[0056] In some other implementations, M may be smaller than N. In this case, the first picture includes at least a portion of image content in some pictures in the N frames of pictures.

[0057] For example: for a video containing N frames of pictures, the number of image frames is relatively large. At this time, M frames of pictures can be selected from the N frames of pictures as the material for generating the first picture, such as taking a frame of picture from the video every 1s (second) until the end time of the video, and selecting M frames of pictures. At this time, the M frames of pictures are spliced ​​to obtain the first picture; or, after intercepting a part of the image content from the M frames of pictures, the image content intercepted from the M frames of pictures is spliced ​​to obtain the first picture.

[0058] Step 103: Display a thumbnail of the first picture in the preview window of the first multimedia file.

[0059] In some implementations, the preview window for the first multimedia file may be a preview window in an album interface for previewing the first multimedia file, wherein the album interface may include preview windows for one or more images.

[0060] In other embodiments, the preview window of the first multimedia file may be a preview window on a social platform. For example, after a user shares the first multimedia file on a social platform, a preview window of the first multimedia file may be displayed on the social platform. In this way, the shared user may understand the changing trend of the first object in the first multimedia file over time through the thumbnail of the first picture in the preview window without opening the first multimedia file.

[0061] In some other implementations, the preview window of the first multimedia file may be a preview window in a conversation interface. For example, when a user sends the first multimedia file to a friend through the conversation interface, a preview window of the first multimedia file may be displayed in a chat interface with the friend.

[0062] Of course, the preview window of the first multimedia file mentioned above can also be other preview windows, such as a preview window in a shooting preview interface for previewing recently captured images, etc. The preview window of the first multimedia file is not specifically limited here, and for the sake of ease of explanation, in the embodiments of the present application, an example is usually given of the preview window of the first multimedia file being a preview window in an album interface for previewing the first multimedia file.

[0063] In an embodiment of the present application, a first multimedia file is obtained, wherein the first multimedia file includes N frames of pictures, where N is an integer greater than 1; a first picture is generated based on the N frames of pictures, wherein the first picture includes at least part of the image content of at least M frames of pictures in the N frames of pictures, where M is an integer greater than 1 and less than or equal to N; and a thumbnail of the first picture is displayed in a preview window of the first multimedia file. For images containing at least two frames of pictures, such as continuous photos and videos, at least part of the image content of at least two frames of pictures is placed in the same first picture, so that in the preview window of the continuous photos or videos, the image content of at least two frames of pictures in the continuous photos or videos can be previewed through the thumbnail of the first picture, so that the user can be informed of the changing trend of the content captured in the continuous photos or videos, and the operation method is simple.

[0064] As an optional implementation manner, when the first multimedia file includes continuous-shot photos, generating a first picture according to the N frames of pictures includes:

[0065] The image content of the first object in M ​​frames of the N frames of the picture is merged with the background picture of at least one frame of the N frames of the picture to obtain the first picture.

[0066] In some implementations, the first object may be a subject in a picture, such as a person, an ornament, a vehicle, a building, etc.

[0067] In some implementations, the background image refers to the image other than the subject, such as Figure 2a to Figure 2c In the scene shown, two children 31 are used as the subject of the shooting, and the trees 32 and the sky in the background are used as the background picture.

[0068] In some implementations, content recognition may be performed on the picture to distinguish the background image and the first object of the picture.

[0069] Of course, in other embodiments, the first object has a shorter object distance relative to the camera than the background image in the image, and the background image and the first object in the image can be distinguished based on the difference in object distance between the first object and the background image. Alternatively, the position information of each object in the M frames can be compared, and the object with a moving position can be regarded as the first object, and the object with a constant position can be regarded as the background image.

[0070] In some embodiments, the image content of the first object in M ​​of the N frames is merged with the background picture of at least one of the N frames. The image content of the first object in M ​​of the N frames can be cut out to obtain a cutout of the first object, and then the cutout of the first object is embedded into the background picture by pasting, overlaying, etc. to obtain the first picture.

[0071] Of course, the image area containing the first object in the M-frame picture can also be cropped to obtain an image block containing the first object, and the image block containing the first object can be mapped to the background picture to achieve the fusion of the image content of the first object in the M-frame picture among the N-frame pictures with the background picture of at least one frame picture among the N-frame pictures.

[0072] In some implementations, the background image of one of the N frames of images may be used as the background image of the first image. For example, based on the fact that the shooting angle of the continuous photos has a small range of variation or the shooting angle is fixed, the background image of the first frame of the continuous photos may be used as the background image of the first image.

[0073] In other implementations, the background images of at least two frames of the N frames of images may be fused to obtain the background image of the first image, and then the image content of the first object may be embedded into the fused background image.

[0074] For example: based on the continuous change of the shooting angle of the continuous shooting photos according to the continuous shooting order, by fusing the background pictures of at least two frames of the N frames of pictures, a background picture with a larger viewing angle range can be obtained, and then the first object in the M frames of pictures is embedded in the background picture with a larger viewing angle range, so that a more comprehensive picture content in the continuous shooting photos can be previewed through the first picture.

[0075] As an optional implementation manner, fusing the image content of the first object in M ​​frames of the N frames of the picture with the background picture of at least one frame of the N frames of the picture to obtain the first picture includes:

[0076] Obtaining a background image of each of the M frames of the N frames of images;

[0077] Using a panoramic stitching method, stitching the background picture of each frame of the M frames into a second picture;

[0078] Acquire image content of a first object in each of the M frames of pictures and position information of the first object in each of the M frames of pictures;

[0079] According to the position information of the first object in each frame of the M frames, the image content of the first object in each frame of the M frames is embedded into the second picture to obtain the first picture.

[0080] In some embodiments, based on the continuously changing shooting angles of two adjacent frames of photos, the background images in the two adjacent frames are continuous. The above-mentioned panoramic stitching method is used to stitch the background images of each frame of the M frames into a second picture. The background images of the two adjacent frames may partially overlap. At this time, the background image that overlaps with the adjacent image in one of the frames can be cut off, and the non-overlapping background images in the two adjacent frames can be stitched, so that the second picture constitutes a larger background image without overlapping.

[0081] Among them, the second picture can be understood as the background picture of the first picture. Compared with the aforementioned implementation method of using the background picture of a frame of picture as the background picture of the first picture, the second picture can cover a wider viewing angle range, allowing the first picture to display a larger range of scenes.

[0082] In some implementations, the position information of the first object in each of the M frames may be the position information of the first object in the picture where it is located relative to a reference object, for example: Figure 2a to Figure 2c In the scene shown, the first objects are two children 31. At this time, the position information of the two children 31 in the picture may be the relative position information of the two children 31 relative to the tree 32 in the picture.

[0083] In some other implementations, the position information of the first object in each frame of the M frames may be a pixel position of the first object.

[0084] In some embodiments, obtaining the image content of the first object in each frame of the M frames and the position information of the first object in each frame of the M frames can be achieved by identifying the picture to determine the position information of the image content of the first object in the picture, and using a cutout method to cut out the image content of the first object from the picture.

[0085] In some embodiments, based on the position information of the first object in each frame of the M frames, the image content of the first object in each frame of the M frames is embedded into the second picture. The position information of the first object in each picture may be different. At this time, when embedding the image content of the first object in a picture into the second picture, the image content of the first object can be embedded in the position of the second picture corresponding to the position information of the first object.

[0086] For example: Figure 2a to Figure 2c In the scene shown, the first objects are two children 31. At this time, the two children 31 are Figure 2a to Figure 2c The position in the picture shown is moved from left to right, so that when Figure 2a to Figure 2c After the image contents of the two children 31 in the picture are cut out, they can be sequentially placed from left to right. Figure 2a to Figure 2c The image content of the two children 31 in the picture shown is embedded in the second picture to obtain the following Figure 2e The first picture 34 shown in the figure can show the dynamic trend of the two children 31 in the continuous shooting scene. Figure 2d As shown, when the thumbnail of the first picture is displayed in the preview window 33 of the continuous-shot photos, the dynamic trend of the two children 31 in the continuous-shot photos in the shooting scene can be previewed through the thumbnail.

[0087] In this embodiment, by performing panoramic stitching of the background images of M frames, a background image with a wider viewing angle range can be obtained, and the cutout of the first object in the M frames is embedded in the background image with a wider viewing angle range, so that the changing trend of the first object in the M frames in the shooting scene of the continuous photos can be previewed in the first picture.

[0088] As an optional implementation manner, after displaying the thumbnail of the first picture in the preview window of the first multimedia file, the method further includes:

[0089] Receiving a first input of a thumbnail of the first picture;

[0090] In response to the first input, displaying the first picture;

[0091] receiving a second input of a second object in the first picture, wherein the first object in the first picture includes the second object;

[0092] In response to the second input, a third picture in the M frames is stored, wherein the second object is the first object in the third picture.

[0093] In some implementations, pictures other than the third picture in the M frames may be deleted.

[0094] In some embodiments, the first input may include a user's touch input to the first image, such as a click, a double-click, or a long press, or the first input may include a hardware operation of an electronic device in which the user executes the multimedia file processing method of an embodiment of the present application, which is not specifically limited here.

[0095] For example: In the display Figure 2dWhen the album interface 30 is shown, the album interface 30 includes a preview window 33 of the continuous-shot photos, and the preview window 33 displays a thumbnail of the first picture. At this time, if the user clicks on the thumbnail in the preview window 33, the following image can be displayed: Figure 2e A first picture 34 is shown.

[0096] In some embodiments, the second object may be at least one of the plurality of first objects in the first picture.

[0097] In some implementations, the second input may include a touch input to the second object.

[0098] In some embodiments, the second input may further include a touch input to a preset control, where the preset control is used to trigger the storage of the third picture and the deletion of pictures other than the third picture in the M frames.

[0099] For example: Figure 3a As shown, the first picture 34 includes five first objects arranged in sequence, and the five first objects are respectively the first objects in the first to fifth frames of the continuous photos. When the user clicks on the first first object and the third first object in the first picture 34 and clicks on "Save Selected Items" 41, the first frame and the third frame in the continuous photos can be saved, and the second frame, the fourth frame and the fifth frame in the continuous photos can be deleted.

[0100] In some implementations, after the first and third frames in the continuous shooting photos are saved and the second, fourth, and fifth frames in the continuous shooting photos are deleted, as shown in FIG. Figure 3b As shown, the preview window 42 of the first frame of the continuous photos and the preview window 43 of the third frame of the continuous photos can be displayed in the album interface 30 respectively. If the user clicks the preview window 42 of the first frame of the photos, the following is displayed: Figure 3c The first frame of the photograph 44 is shown.

[0101] Of course, in other embodiments, after saving the first and third frames in the continuous photos and deleting the second, fourth and fifth frames in the continuous photos, the first picture can also be updated based on the first and third frames in the continuous photos, so that the updated first picture includes the image content in the first and third frames in the continuous photos. Finally, the preview windows of the first and third frames in the continuous photos are merged in the album interface, and the thumbnail of the first picture is displayed in the preview window. The method of updating the first picture based on the first and third frames in the continuous photos is the same as the method of generating the first picture based on the M-frame pictures, which will not be repeated here.

[0102] In this implementation, the continuous-shot photos can be edited through the first picture, which simplifies the complexity of the operation of editing the continuous-shot photos.

[0103] As an optional implementation, the first picture can also be stored or shared as an independent picture, for example: Figure 2e As shown, when a click operation is received on the "Save Multiple Frames" control 35 in the upper right corner of the first picture, the first picture is saved as an independent JPG or JPEG picture. At this time, the JPG or JPEG picture can be viewed or shared by the user.

[0104] It is worth mentioning that after saving the first picture as an independent JPG or JPEG picture, the JPG or JPEG picture will no longer be used to edit the continuous shooting photos. Only the first picture associated with the continuous shooting photos, such as the first picture corresponding to the thumbnail displayed in the preview window of the continuous shooting photos, can be used to edit the continuous shooting photos.

[0105] For ease of understanding, the multimedia file processing method provided in the embodiment of the present application is used to process continuous shooting photos as an example for illustration. Figure 4 As shown, the process of processing the continuous shooting photos in this embodiment may include the following steps:

[0106] Step 401: Long press the shutter button to take continuous shots.

[0107] Step 402: Automatically save the continuous photos and generate a first picture.

[0108] Step 403: View the thumbnail of the first picture in the preview window of the continuous-shot photos in the album.

[0109] Step 404: Are you satisfied with the first picture?

[0110] In this step, whether the user is satisfied with the first picture can be determined based on the user's feedback operation, for example: Figure 2e As shown, if the user clicks the "Save Multiple Frames" control 35 in the upper right corner of the first picture, it means that the user is satisfied with the first picture. At this time, step 405 is executed.

[0111] In addition, if the user edits the first picture, it means that the user is not satisfied with the current first picture. In this case, step 406 is executed. Figure 3a As shown, if the user clicks on the first first object and the third first object in the first picture 34 and clicks on “Save Selected Items” 41, it means that the user is not satisfied with the current first picture and reselects the first frame and the third frame in the continuous photo to update the first picture.

[0112] Step 405: Perform any operation such as saving and sharing on the first picture and the continuous photos.

[0113] Step 406: Based on the second input of the first picture, update the continuous photos and the first picture.

[0114] In this step, according to the user's second input, some pictures in the continuous shooting photos can be selected to be saved, and the rest can be deleted. Thereafter, the updated first picture and / or the updated continuous shooting photos can be saved.

[0115] In this embodiment, the user can preview the change trend of the continuous-shooting photos through the first picture, and can also edit the continuous-shooting photos based on the first picture.

[0116] As an optional implementation manner, generating a first picture according to the N frames of pictures includes:

[0117] Obtaining an image block of each frame of the M frames of the N frames of the image, wherein each image block includes a portion of image content in a corresponding frame of the image;

[0118] The image blocks of each frame of the M frames are spliced ​​to obtain the first picture.

[0119] In some implementations, obtaining the image blocks of each frame of the M frames of the N frames of the image may be performed by cropping each frame of the M frames of the image, and only retaining the image blocks containing a portion of the image content in the corresponding image.

[0120] In some embodiments, the subject in each frame of the picture may be identified, and an image block containing the subject may be intercepted, so that the image block may include the image content of the subject in the corresponding frame of the picture. For example, when a video is a video of a badminton match, the subject in the badminton match scene may include athletes and badminton. At this time, for a frame of the picture in the video, an image block containing the athlete and / or badminton may be cropped.

[0121] In some implementations, the M frames of pictures may be pictures in a video. In this case, the M frames of pictures may be selected from the video according to a fixed interval time or interval frame number, for example, pictures at multiple time points with the same time interval in the video are selected.

[0122] Of course, for a shorter video, all the frame images in the video can also be directly used as M frame images.

[0123] In some implementations, the image blocks of each frame of the M frames are spliced, which may be to divide the image display area into multiple areas and fill the image blocks of each frame of the M frames into different areas.

[0124] For example: Figure 5aAs shown, the display area of ​​the first picture is divided into M display areas 50 arranged horizontally, and an image block is intercepted from each of the M frames of the picture, and finally the M image blocks are filled into the M display areas 50.

[0125] In some implementations, the M image blocks may be puzzled according to the frame sequence of the pictures to which the M image blocks correspond, so that two adjacent image blocks in the first picture come from two adjacent frames of pictures.

[0126] For example: Figure 5a As shown, the video shot is a video of two children 51 running from the left side to the right side of the tree. The leftmost image block can be an image block in the first picture in the M frame picture, and the second image block on the left can be an image block in the second picture in the M frame picture.

[0127] In some embodiments, there is a scene where a tripod is used to fix an electronic device for video recording. Since the electronic device is fixed by a tripod, the recorded video scene remains unchanged, and only some tiny image elements change, such as light and shadow, color, or some small picture details. In the embodiment of the present application, the image blocks of multiple frames of pictures in the video are spliced ​​to obtain a first picture, and the gradient effect of the video picture can be displayed in the first picture.

[0128] For example, when recording a video of a badminton match, the scene in the video remains unchanged, but the players and the ball change positions in the scene. Or, when using time-lapse photography to record a video of city traffic, the alternation of dawn and dusk, the trajectory of the moon, the movement of light and shadow, etc., the scene in the video remains unchanged, and only the light and shadow and the movement of the moon change positions.

[0129] Another example: Figure 6a As shown in the figure, a tripod is used to fix an electronic device to record the scenery of a city. The city landscape in the video is fixed, but the color of the sky changes over time, from dazzling at noon, to orange-red at dusk, to black at night. At this time, you can select several frames with the same time interval from the video, for example, each with an interval of 1 hour, and then capture a part of the image block from each frame, and splice the captured image blocks together to form a video like this. Figure 6b The first picture shown can show the changing effects of light and shadow in the city during a day.

[0130] As an optional implementation manner, before obtaining the first multimedia file, the method further includes:

[0131] Display the first control on the shooting preview interface;

[0132] receiving a third input to the first control;

[0133] In response to the third input, a target function is started, wherein the target function is used to replace the preview image of the first multimedia file with the first picture.

[0134] In some embodiments, such as Figure 3a to Figure 3c As shown, the first control may include a “Dynamic Photo” control 36 in the shooting preview interface. At this time, the third input may include touch inputs such as a long press or a double click on the “Dynamic Photo” control 36 .

[0135] Of course, in other embodiments, the first control may include a setting button in the shooting preview interface and a target function switch displayed in the setting interface after touching the setting button. In this case, the third input includes a click operation on the setting button and an opening operation on the target function switch. The first control and the third input are not specifically limited herein.

[0136] It is worth mentioning that after turning on the target function, the user can also turn off the target function by operating the first control. At this time, the first picture will no longer be generated based on N frames of pictures, nor will the thumbnail of the first picture be displayed in the preview window of the first multimedia file. For example: when the target function is turned off, the thumbnail of the first frame of the continuous photo can be displayed in the preview window of the continuous photo in a conventional manner.

[0137] In this implementation, the user can turn on or off the target function in the shooting preview interface to make the generation and display of the first picture controllable.

[0138] As an optional implementation manner, the first multimedia file includes a video image, and displaying a thumbnail of the first image in the preview window of the first multimedia file includes:

[0139] Using the first picture as the first frame picture of the video image;

[0140] A thumbnail of the first frame is displayed in the preview window of the video image.

[0141] In this embodiment, by using the first picture as the first frame of the video image, the first frame of the video can be used as a preview image of the video image in a conventional manner, and during the video playback process, the change trend of subsequent video content can also be previewed through the first frame image.

[0142] As an optional implementation manner, the first multimedia file includes a video image, and after displaying the thumbnail of the first picture in the preview window of the first multimedia file, the method further includes:

[0143] receiving a fourth input of a thumbnail of the first image;

[0144] In response to the fourth input, displaying the first picture;

[0145] Receiving a fifth input of a target image block in the first picture, wherein the image blocks in the M-frame picture include the target image block;

[0146] In response to the fifth input, the video image is played with the target picture as a play start point, wherein the target picture is a picture in the M frame pictures that includes the target image block.

[0147] In some implementations, the fourth input has the same meaning as the first input in the aforementioned embodiment, for example, the fourth input is a click operation on the thumbnail of the first picture.

[0148] In some embodiments, the fifth input may include any touch input to the target image block, such as a click operation or a long press operation on the target image block.

[0149] In this implementation, the user can jump to the starting point of the video playback by inputting the fifth input to the first picture. Figure 5a As shown, the first picture of a certain video image includes 6 image blocks, which are image blocks in 6 frames of the first picture collected at intervals of 1 minute in the video image. When the user clicks on the image block arranged in the third position in the first picture, the first picture containing the clicked image block is found, that is, the image frame located at the 2nd minute in the video image, and the video image is played with the first picture as the starting point of video playback, that is, the playback starts from the 2nd minute of the video image.

[0150] As an optional implementation manner, the first multimedia file includes a video image, and after displaying the thumbnail of the first picture in the preview window of the first multimedia file, the method further includes:

[0151] receiving a sixth input of a thumbnail of the first image;

[0152] In response to the sixth input, displaying the first picture;

[0153] Receiving a seventh input of at least two adjacent image blocks in the first picture;

[0154] In response to the seventh input, the video image is cropped to obtain a first video, wherein the first video includes a third picture, a fourth picture, and a picture located between the third picture and the fourth picture in the N frames, the third picture is a picture located at the first position in the frame sequence of the pictures including the at least two adjacent image blocks, and the fourth picture is a picture located at the last position in the frame sequence of the pictures including the at least two adjacent image blocks.

[0155] In some implementations, the sixth input has the same meaning as the first input and the fourth input in the aforementioned embodiments. For example, the sixth input is a click operation on the thumbnail of the first picture.

[0156] In some embodiments, the seventh input may include any touch input to at least two adjacent image blocks, such as a sliding operation or a clicking operation to at least two adjacent image blocks. The seventh input is used to select a range of video image frames to be retained.

[0157] For example: Figure 5b As shown, the first picture of a certain video image includes 6 image blocks, which are image blocks in 6 frames of the first picture collected at intervals of 1 minute in the video image. When the user performs a sliding operation from the second image block to the fourth image block in the first picture, the video image frames to be retained can be selected as the video image frames from the 1st minute to the 4th minute in the video. At this time, if the user clicks the "Capture" control 52 in the upper right corner, the first video is captured from the video image, and the first video is the video segment from the 1st minute to the 4th minute in the video image.

[0158] In some embodiments, the picture that is located at the first position in the frame sequence of the picture including the at least two adjacent image blocks indicates that: since each image block comes from one frame of the picture, the at least two adjacent image blocks come from at least two frames of the picture. At this time, according to the frame sequence of the at least two frames of the picture in the video image, it can be determined that the frame with the earliest frame sequence in the at least two frames of the picture is the third picture, and the frame with the latest frame sequence in the at least two frames of the picture is the fourth picture.

[0159] In this implementation, the video image can be cropped based on the user's operation on the first picture, thereby simplifying the complexity of the operation of cropping the video image.

[0160] As an optional implementation manner, the first multimedia file includes a video image, and the method further includes:

[0161] Displaying a second control on the preview interface of the video image, wherein the second control includes at least two candidate options, and the at least two candidate options are associated with respective image block styles;

[0162] receiving an eighth input of a target candidate option in the second control;

[0163] In response to the eighth input, determining a target image block pattern associated with the target candidate option;

[0164] The step of performing splicing processing on the image blocks of each frame of the M frames of pictures to obtain the first picture includes:

[0165] The image blocks of each frame of the M frames are spliced ​​according to the target image block style to obtain the first image.

[0166] In some implementations, different image block styles may include different numbers of image block display areas and / or different image block arrangements, etc.

[0167] In some embodiments, the second control may include: Figure 7a At least one of the image block quantity control bar 71, the image block direction control bar 72 and the style control 73 in the interface shown.

[0168] Optionally, the eighth input may include a dragging operation on a slider on the image block quantity control bar 71. By dragging the slider on the image block quantity control bar 71, the number of image blocks in the first multimedia file can be adjusted to a number corresponding to the position of the slider, that is, the value of M can be controlled.

[0169] For example, the further to the left the slider on the image block quantity control bar 71 is, the fewer the image blocks in the first multimedia file are; the further to the right the slider on the image block quantity control bar 71 is, the more the image blocks in the first multimedia file are.

[0170] Optionally, the eighth input may include a dragging operation on a slider on the image block direction control bar 72 , and by dragging the slider on the image block direction control bar 72 , the arrangement direction of the image blocks in the first multimedia file may be switched.

[0171] For example, the further to the left the slider on the image block direction control bar 72 is, the more the boundary between adjacent image blocks in the first multimedia file is inclined to the left; the further to the right the slider on the image block direction control bar 72 is, the more the boundary between adjacent image blocks in the first multimedia file is inclined to the right.

[0172] Optionally, the eighth input may include a touch operation on the style control 73, and a touch operation on a selection control 75 in the image block style selection interface 74 triggered to be displayed by the touch operation on the style control 73. Figure 7b The image block style selection interface 74 shown includes a plurality of image block style selection controls 75, and the selection controls 75 are associated with predefined image block styles. If the user selects one of the selection controls 75, the image blocks in the first picture can be displayed according to the predefined image block style corresponding to the selected selection control 75.

[0173] For example, if the user selects the “straight stripe” selection control 75, the boundary lines between adjacent image blocks in the image block pattern are straight lines, for example: Figure 8a If the user selects the "arc stripe" selection control 75, the boundary lines between adjacent image blocks in the image block style are arcs, for example: Figure 8c If the user selects the "radial" selection control 75, the boundary lines between the image blocks in the image block style are radial, for example: Figure 8b The image patch styles shown.

[0174] In this embodiment, one or at least two image block styles can be pre-defined, and before generating the first image, the user can select the target image block style to be used by inputting the eighth input of the candidate options associated with each predefined image block style in a one-to-one correspondence, thereby simplifying the operation process of determining the image block style used for the first image.

[0175] Of course, in addition to the predefined image block styles, users can also customize image block styles.

[0176] As an optional implementation manner, the first multimedia file includes a video image, and the method further includes:

[0177] Displaying a third control on the preview interface of the video image;

[0178] receiving a ninth input to the third control;

[0179] In response to the ninth input, starting the image block style drawing function;

[0180] Receiving a sliding input in a preview interface of the video image;

[0181] In response to the sliding input, determining a custom image block style with a sliding track of the sliding input as a boundary line;

[0182] The step of performing splicing processing on the image blocks of each frame of the M frames of pictures to obtain the first picture includes:

[0183] The image blocks of each frame of the M frames are spliced ​​according to the custom image block style to obtain the first image.

[0184] In some implementations, the third control may represent a custom control, and the ninth input may be any touch operation such as a long press or a click of the custom control by the user.

[0185] In some embodiments, a frame of a video image may be displayed by default in the preview interface of the video image, and the user may perform one or at least two sliding inputs in the preview interface of the video image. At this time, the preview interface of the video image is divided into at least two image block display areas with the sliding track of each sliding input as the boundary line, and each image block display area is used to display an image block.

[0186] In some implementations, displaying the third control on the preview interface of the video image may be that the third control is directly displayed on the preview interface of the video image, or the third control is a secondary control under the control displayed on the preview interface of the video image.

[0187] For example: Figure 7a The preview interface of the video image shown in FIG. 1 shows a style control 73. When the user clicks the style control 73, the following is displayed: Figure 7b The image block style selection interface 74 shown in the figure includes secondary controls of the style control 73, such as a "custom drawing" selection control 76. If the user selects the "custom drawing" selection control 76, the user can draw the image block style by himself, such as Fig. 9 As shown, the user draws three sliding tracks in the display area of ​​the first picture, so that the image blocks in the first picture generated subsequently are divided by the three sliding tracks drawn by the user as dividing lines.

[0188] It is worth mentioning that after determining the image block style required for the first picture, the corresponding image blocks can be captured according to the boundary contours of each image block display area in the image block style, so that each image block can completely fill its corresponding image block display area to obtain a first picture without blank spaces.

[0189] In this implementation, a user-defined method may be adopted to draw a pattern block style with user characteristics, so that the image block style used in the first picture can be personalized.

[0190] For ease of understanding, the multimedia file processing method provided in the embodiment of the present application is used to process a video image as an example for illustration. Fig.10 As shown, the video image processing flow in this embodiment may include the following steps:

[0191] Step 1001: Record video images.

[0192] Step 1002: Whether to enable the target function.

[0193] In this step, the target function can be turned on or off in the preview interface of the recorded video. If the target function is turned on, step 1003 is executed; if the target function is turned off, step 1004 is executed.

[0194] Step 1003: Use the first picture as the first frame of the video image.

[0195] In this step, the first picture may be used to replace the original first frame picture in the video image, or the first picture may be inserted before the original first frame picture in the video image.

[0196] Step 1004: Save the video image, and use the thumbnail of the first picture as a preview image in the video image album.

[0197] Step 1005: View the video image in the album.

[0198] In this step, the preview window of the video image may be clicked in the album to display the first picture in the preview interface of the video image.

[0199] Step 1006: By operating the first picture, the jump to the starting point of the video playback and / or the fast cropping of the video image are realized.

[0200] For example, by a user clicking on a target image block in a first image, the video image is played with the target image containing the target image block as a starting point for playback.

[0201] For another example, through the user's touch operation on at least two adjacent image blocks in the first image, a video segment between at least two frames of images corresponding to the at least two adjacent image blocks in the video image is captured.

[0202] Step 1007: Whether the user is satisfied with the first picture.

[0203] In this step, if the judgment result is that the user meets the first picture, step 1008 is executed; otherwise, step 1009 is executed.

[0204] In some implementations, whether the user is satisfied with the first picture may be determined based on the user's feedback operation, for example, if the user performs an operation of saving the first picture, it indicates that the user is satisfied with the first picture. If the user performs an operation of updating the first picture, such as selecting other frame pictures in the video image except the M frame pictures used to generate the current first picture to generate the first picture, it indicates that the user is not satisfied with the current first picture.

[0205] Step 1008: Perform any operation such as saving and sharing on the first picture.

[0206] Step 1009: Modify the first picture.

[0207] In this step, the first image can be updated based on the user's editing operation on the first image, or the selection operation on the M frame images used to generate the first image, the change operation on the image block style, etc., and then the updated first image can be saved.

[0208] In this embodiment, the user can preview the changing trend of the captured picture in the video image through the first picture, and can also quickly crop the video image and / or jump to the playback starting point based on the first picture.

[0209] The multimedia file processing method provided in the embodiment of the present application can be executed by a multimedia file processing device. In the embodiment of the present application, the multimedia file processing device provided in the embodiment of the present application is described by taking the multimedia file processing method executed by the multimedia file processing device as an example.

[0210] like Fig.11 As shown, the multimedia file processing device 1100 provided in the embodiment of the present application includes the following modules:

[0211] A first acquisition module 1101 is used to acquire a first multimedia file, wherein the first multimedia file includes N frames of pictures, where N is an integer greater than 1;

[0212] An image processing module 1102 is configured to generate a first image according to the N frames of images, wherein the first image includes at least a portion of image content of at least M frames of images among the N frames of images, where M is an integer greater than 1 and less than or equal to N;

[0213] The first display module 1103 is configured to display a thumbnail of the first picture in a preview window of the first multimedia file.

[0214] In some implementations, when the first multimedia file includes continuous-shot photos, the image processing module 1102 is specifically configured to:

[0215] The image content of the first object in M ​​frames of the N frames of the picture is merged with the background picture of at least one frame of the N frames of the picture to obtain the first picture.

[0216] In some implementations, the image processing module 1102 is specifically configured to:

[0217] Obtaining a background image of each of the M frames of the N frames of images;

[0218] Using a panoramic stitching method, stitching the background picture of each frame of the M frames into a second picture;

[0219] Acquire image content of a first object in each of the M frames of pictures and position information of the first object in each of the M frames of pictures;

[0220] According to the position information of the first object in each frame of the M frames, the image content of the first object in each frame of the M frames is embedded into the second picture to obtain the first picture.

[0221] In some implementations, the multimedia file processing apparatus 1100 further includes:

[0222] A first input module, configured to receive a first input of a thumbnail of the first picture after displaying the thumbnail of the first picture in the preview window of the first multimedia file;

[0223] A first response module, configured to display the first picture in response to the first input;

[0224] A second input module, configured to receive a second input of a second object in the first picture, wherein the first object in the first picture includes the second object;

[0225] The second response module is used to store a third picture in the M frames in response to the second input, wherein the second object is the first object in the third picture.

[0226] In some implementations, the image processing module 1102 is specifically configured to:

[0227] Obtaining an image block of each frame of the M frames of the N frames of the image, wherein each image block includes a portion of image content in a corresponding frame of the image;

[0228] The image blocks of each frame of the M frames are spliced ​​to obtain the first picture.

[0229] In some implementations, the multimedia file processing apparatus 1100 further includes:

[0230] A second display module, used for displaying a first control on a shooting preview interface before acquiring the first multimedia file;

[0231] A third input module, used for receiving a third input to the first control;

[0232] The third response module is used to start a target function in response to the third input, wherein the target function is used to replace the preview image of the first multimedia file with the first picture.

[0233] In some implementations, the first multimedia file includes a video image, and the multimedia file processing device 1100 further includes:

[0234] a fourth input module, configured to receive a fourth input of the thumbnail of the first picture after displaying the thumbnail of the first picture in the preview window of the first multimedia file;

[0235] a fourth response module, configured to display the first picture in response to the fourth input;

[0236] a fifth input module, configured to receive a fifth input of a target image block in the first picture, wherein the image blocks in the M-frame picture include the target image block;

[0237] The fifth response module is used to respond to the fifth input and play the video image with the target picture as the playback starting point, wherein the target picture is a picture in the M frame pictures that includes the target image block.

[0238] In some implementations, the first multimedia file includes a video image, and the multimedia file processing device 1100 further includes:

[0239] a sixth input module, configured to receive a sixth input of the thumbnail of the first picture after displaying the thumbnail of the first picture in the preview window of the first multimedia file;

[0240] a sixth response module, configured to display the first picture in response to the sixth input;

[0241] a seventh input module, configured to receive a seventh input of at least two adjacent image blocks in the first picture;

[0242] A seventh response module is used to crop the video image in response to the seventh input to obtain a first video, wherein the first video includes a third picture, a fourth picture and a picture located between the third picture and the fourth picture in the N frames, the third picture is a picture located at the first position in the frame sequence of the picture including the at least two adjacent image blocks, and the fourth picture is a picture located at the last position in the frame sequence of the picture including the at least two adjacent image blocks.

[0243] In some implementations, the first multimedia file includes a video image, and the multimedia file processing device 1100 further includes:

[0244] A third display module, configured to display a second control on the preview interface of the video image, wherein the second control includes at least two candidate options, and the at least two candidate options are associated with respective image block styles;

[0245] An eighth input module, used for receiving an eighth input of a target candidate option in the second control;

[0246] An eighth response module, configured to determine a target image block style associated with the target candidate option;

[0247] The image processing module 1102 is further used for:

[0248] The image blocks of each frame of the M frames are spliced ​​according to the target image block style to obtain the first image.

[0249] In some implementations, the second control further includes a first option, and the multimedia file processing apparatus 1100 further includes:

[0250] a ninth input module, configured to receive a ninth input for the first option in the second control;

[0251] a ninth response module, configured to display an image block style drawing interface in response to the ninth input;

[0252] a tenth input module, configured to receive a sliding input in the image block pattern drawing interface;

[0253] a tenth response module, configured to determine, in response to the sliding input, a custom image block style with a sliding track of the sliding input as a boundary line;

[0254] The image processing module 1102 is further used for:

[0255] The image blocks of each frame of the M frames are spliced ​​according to the custom image block style to obtain the first image.

[0256] The multimedia file processing device 1100 in the embodiment of the present application can be an electronic device, or a component in an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0257] The multimedia file processing device 1100 in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0258] The multimedia file processing device 1100 provided in the embodiment of the present application can implement each process implemented in the aforementioned multimedia file processing method embodiment of the present application, and will not be described again here to avoid repetition.

[0259] Alternatively, if Fig.12 As shown, an embodiment of the present application further provides an electronic device 1200, including a processor 1201 and a memory 1202, wherein the memory 1202 stores programs or instructions that can be executed on the processor 1201, and when the program or instructions are executed by the processor 1201, the various steps of the above-mentioned multimedia file processing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0260] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0261] Fig.13 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0262] The electronic device 1300 includes but is not limited to: a radio frequency unit 1301, a network module 1302, an audio output unit 1303, an input unit 1304, a sensor 1305, a display unit 1306, a user input unit 1307, an interface unit 1308, a memory 1309, and a processor 1310 and other components.

[0263] Those skilled in the art will appreciate that the electronic device 1300 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1310 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.13 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0264] The input unit 1304 is used to obtain a first multimedia file, wherein the first multimedia file includes N frames of pictures, where N is an integer greater than 1;

[0265] The processor 1310 is configured to generate a first picture according to the N frames of pictures, wherein the first picture includes at least part of image content of at least M frames of pictures among the N frames of pictures, where M is an integer greater than 1 and less than or equal to N;

[0266] The display unit 1306 is configured to display a thumbnail of the first picture in a preview window of the first multimedia file.

[0267] In some implementations, when the first multimedia file includes continuous-shot photos, the processor 1310 generates the first picture according to the N frames of pictures, including:

[0268] The image content of the first object in M ​​frames of the N frames of the picture is merged with the background picture of at least one frame of the N frames of the picture to obtain the first picture.

[0269] In some implementations, the processor 1310 performs the step of fusing the image content of the first object in M ​​frames of the N frames of the picture with the background picture of at least one frame of the N frames of the picture to obtain the first picture, including:

[0270] Obtaining a background image of each of the M frames of the N frames of images;

[0271] Using a panoramic stitching method, stitching the background picture of each frame of the M frames into a second picture;

[0272] Acquire image content of a first object in each of the M frames of pictures and position information of the first object in each of the M frames of pictures;

[0273] According to the position information of the first object in each frame of the M frames, the image content of the first object in each frame of the M frames is embedded into the second picture to obtain the first picture.

[0274] In some implementations, after the display unit 1306 displays the thumbnail of the first picture in the preview window of the first multimedia file:

[0275] A user input unit 1307, configured to receive a first input for a thumbnail of the first picture;

[0276] The processor 1310 is configured to control the display unit 1306 to display the first picture in response to the first input;

[0277] The user input unit 1307 is further configured to receive a second input for a second object in the first picture, wherein the first object in the first picture includes the second object;

[0278] The processor 1310 is further configured to, in response to the second input, control the memory 1309 to store a third picture in the M frames, wherein the second object is the first object in the third picture.

[0279] In some implementations, the step of generating a first picture according to the N frames of pictures performed by the processor 1310 includes:

[0280] Obtaining an image block of each frame of the M frames of the N frames of the image, wherein each image block includes a portion of image content in a corresponding frame of the image;

[0281] The image blocks of each frame of the M frames are spliced ​​to obtain the first picture.

[0282] In some implementations, before the input unit 1304 executes the step of acquiring the first multimedia file:

[0283] The display unit 1306 is further used to display the first control on the shooting preview interface;

[0284] The user input unit 1307 is further used to receive a third input to the first control;

[0285] The processor 1310 is further configured to enable a target function in response to the third input, wherein the target function is configured to replace the preview image of the first multimedia file with the first picture.

[0286] In some implementations, the first multimedia file includes a video image, and after the display unit 1306 displays the thumbnail of the first picture in the preview window of the first multimedia file:

[0287] The user input unit 1307 is further configured to receive a fourth input for a thumbnail of the first picture;

[0288] The processor 1310 is further configured to control the display unit 1306 to display the first picture in response to the fourth input;

[0289] The user input unit 1307 is further configured to receive a fifth input of a target image block in the first picture, wherein the image blocks in the M frames of pictures include the target image block;

[0290] The processor 1310 is further configured to, in response to the fifth input, control the display unit 1306 to play the video image with the target picture as the starting point of playback, wherein the target picture is a picture in the M frames that includes the target image block.

[0291] In some implementations, the first multimedia file includes a video image, and after the display unit 1306 displays the thumbnail of the first picture in the preview window of the first multimedia file:

[0292] The user input unit 1307 is further configured to receive a sixth input for a thumbnail of the first picture;

[0293] The processor 1310 is further configured to control the display unit 1306 to display the first picture in response to the sixth input;

[0294] The user input unit 1307 is further configured to receive a seventh input of at least two adjacent image blocks in the first picture;

[0295] Processor 1310 is also used to crop the video image in response to the seventh input to obtain a first video, wherein the first video includes a third picture, a fourth picture and a picture located between the third picture and the fourth picture in the N frames, the third picture is a picture located at the first position in the frame sequence of the picture including the at least two adjacent image blocks, and the fourth picture is a picture located at the last position in the frame sequence of the picture including the at least two adjacent image blocks.

[0296] In some implementations, the first multimedia file includes a video image:

[0297] The display unit 1306 is further configured to display a second control on the preview interface of the video image, wherein the second control includes at least two candidate options, and the at least two candidate options are associated with respective image block styles;

[0298] The user input unit 1307 is further used to receive an eighth input of a target candidate option in the second control;

[0299] The processor 1310 is further configured to determine, in response to the eighth input, a target image block pattern associated with the target candidate option;

[0300] The processor 1310 performs the splicing process on the image blocks of each frame of the M frames of pictures to obtain the first picture, including:

[0301] The image blocks of each frame of the M frames are spliced ​​according to the target image block style to obtain the first image.

[0302] In some embodiments, the first multimedia file includes a video image;

[0303] The display unit 1306 is further configured to display a third control on the preview interface of the video image;

[0304] The user input unit 1307 is further used to receive a ninth input to the third control;

[0305] The processor 1310 is further configured to enable an image block pattern drawing function in response to the ninth input;

[0306] The user input unit 1307 is further used to receive a sliding input in the preview interface of the video image;

[0307] The processor 1310 is further configured to determine, in response to the sliding input, a custom image block style with a sliding track of the sliding input as a boundary line;

[0308] The processor 1310 performs the splicing process on the image blocks of each frame of the M frames of pictures to obtain the first picture, including:

[0309] The image blocks of each frame of the M frames are spliced ​​according to the custom image block style to obtain the first image.

[0310] It can be understood that the implementation process of each implementation method mentioned in this embodiment can refer to the relevant description of the aforementioned multimedia file processing method embodiment, and achieve the same or corresponding technical effects. To avoid repetition, it will not be repeated here.

[0311] It should be understood that in the embodiment of the present application, the input unit 1304 may include a graphics processor (Graphics Processing Unit, GPU) 13041 and a microphone 13042, and the graphics processor 13041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1306 may include a display panel 13061, and the display panel 13061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1307 includes a touch panel 13071 and at least one of other input devices 13072. The touch panel 13071 is also called a touch screen. The touch panel 13071 may include two parts: a touch detection device and a touch controller. Other input devices 13072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0312] The memory 1309 can be used to store software programs and various data. The memory 1309 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1309 may include a volatile memory or a non-volatile memory, or the memory 1309 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1309 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0313] The processor 1310 may include one or more processing units; optionally, the processor 1310 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1310.

[0314] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned multimedia file processing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0315] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0316] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned multimedia file processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0317] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0318] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned multimedia file processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0319] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0320] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0321] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A multimedia file processing method, characterized in that: The method comprises: Acquire a first multimedia file, wherein the first multimedia file includes N frames of pictures, where N is an integer greater than 1; Generate a first picture according to the N frames of pictures, wherein the first picture includes at least part of image content of at least M frames of pictures among the N frames of pictures, where M is an integer greater than 1 and less than or equal to N; A thumbnail of the first picture is displayed in a preview window of the first multimedia file.

2. The method according to claim 1, characterized in that: In a case where the first multimedia file includes continuous-shot photos, generating a first picture according to the N frames of pictures includes: The image content of the first object in M ​​frames of the N frames of the picture is merged with the background picture of at least one frame of the N frames of the picture to obtain the first picture.

3. The method according to claim 2, characterized in that The step of fusing the image content of the first object in M ​​frames of the N frames of the picture with the background picture of at least one frame of the N frames of the picture to obtain the first picture includes: Obtaining a background image of each of the M frames of the N frames of the image; Using a panoramic stitching method, stitching the background picture of each frame of the M frames into a second picture; Acquire image content of a first object in each of the M frames of pictures and position information of the first object in each of the M frames of pictures; According to the position information of the first object in each frame of the M frames, the image content of the first object in each frame of the M frames is embedded into the second picture to obtain the first picture.

4. The method according to any one of claims 1 to 3, characterized in that After displaying the thumbnail of the first picture in the preview window of the first multimedia file, the method further includes: Receiving a first input of a thumbnail of the first picture; In response to the first input, displaying the first picture; receiving a second input of a second object in the first picture, wherein the first object in the first picture includes the second object; In response to the second input, a third picture in the M frames is stored, wherein the second object is the first object in the third picture.

5. The method according to any one of claims 1 to 3, characterized in that The step of generating a first picture according to the N frames of pictures includes: Obtaining an image block of each frame of the M frames of the N frames of the image, wherein each image block includes a portion of image content in a corresponding frame of the image; The image blocks of each frame of the M frames are spliced ​​to obtain the first picture.

6. The method according to any one of claims 1 to 3, characterized in that Before acquiring the first multimedia file, the method further includes: Display the first control on the shooting preview interface; receiving a third input to the first control; In response to the third input, a target function is started, wherein the target function is used to replace the preview image of the first multimedia file with the first picture.

7. The method according to claim 5, characterized in that The first multimedia file includes a video image, and after displaying the thumbnail of the first picture in the preview window of the first multimedia file, the method further includes: receiving a fourth input of a thumbnail of the first image; In response to the fourth input, displaying the first picture; Receiving a fifth input of a target image block in the first picture, wherein the image blocks in the M-frame picture include the target image block; In response to the fifth input, the video image is played with the target picture as a play start point, wherein the target picture is a picture in the M frame pictures that includes the target image block.

8. The method according to claim 5, characterized in that The first multimedia file includes a video image, and after displaying the thumbnail of the first picture in the preview window of the first multimedia file, the method further includes: receiving a sixth input of a thumbnail of the first image; In response to the sixth input, displaying the first picture; Receiving a seventh input of at least two adjacent image blocks in the first picture; In response to the seventh input, the video image is cropped to obtain a first video, wherein the first video includes a third picture, a fourth picture, and a picture located between the third picture and the fourth picture in the N frames, the third picture is a picture located at the first position in the frame sequence of the picture including the at least two adjacent image blocks, and the fourth picture is a picture located at the last position in the frame sequence of the picture including the at least two adjacent image blocks.

9. The method according to claim 5, characterized in that The first multimedia file includes a video image, and the method further includes: Displaying a second control on the preview interface of the video image, wherein the second control includes at least two candidate options, and the at least two candidate options are associated with respective image block styles; receiving an eighth input of a target candidate option in the second control; In response to the eighth input, determining a target image block pattern associated with the target candidate option; The step of performing splicing processing on the image blocks of each frame of the M frames of pictures to obtain the first picture includes: The image blocks of each frame of the M frames are spliced ​​according to the target image block style to obtain the first image.

10. The method according to claim 5, characterized in that The first multimedia file includes a video image, and the method further includes: Displaying a third control on the preview interface of the video image; receiving a ninth input to the third control; In response to the ninth input, starting an image block pattern drawing function; Receiving a sliding input in a preview interface of the video image; In response to the sliding input, determining a custom image block style with a sliding track of the sliding input as a boundary line; The step of performing splicing processing on the image blocks of each frame of the M frames of pictures to obtain the first picture includes: The image blocks of each frame of the M frames are spliced ​​according to the custom image block style to obtain the first image.

11. A multimedia file processing device, characterized in that: The device comprises: A first acquisition module, configured to acquire a first multimedia file, wherein the first multimedia file includes N frames of pictures, where N is an integer greater than 1; An image processing module, configured to generate a first image according to the N frames of images, wherein the first image includes at least a portion of image content of at least M frames of images among the N frames of images, where M is an integer greater than 1 and less than or equal to N; The first display module is used to display a thumbnail of the first picture in the preview window of the first multimedia file.

12. An electronic device comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor; wherein the processor is used to read the program in the memory to implement the steps in the multimedia file processing method as described in any one of claims 1 to 10.

Images