Dynamic video playing method and device, electronic equipment and medium

Abstract

The invention discloses a dynamic video playing method and device, electronic equipment and a medium, and belongs to the technical field of camera shooting. The method comprises the steps that a panoramic image associated with a dynamic video is displayed, the panoramic image is obtained by fusing at least two images, the at least two images are obtained in the shooting process of the dynamic video, the dynamic video comprises at least two video clips, and each image is associated with at least one video clip; a first input is received, the first input is used for selecting a first image area in the panoramic image, the first image area comprises image content of at least one target image, and the target image is an image in the at least two images; and in response to the first input, based on the first image area, playing a first video clip associated with the at least one target image in the dynamic video.

Description

Technical Field

[0001] The present application belongs to the field of terminal technology, and specifically relates to a dynamic video playback method, device, electronic device and medium. Background Art

[0002] With the development of terminal technology, the functions of electronic devices are becoming more and more abundant. For example, electronic devices can play dynamic videos.

[0003] For example, if a user needs an electronic device to play a dynamic video, the user can first trigger the electronic device to display an album interface through input, and then the user can click on the video icon in the album interface to trigger the electronic device to play the video; similarly, if the user needs an electronic device to play a video, the user can first find the video icon in the album interface and click on the video icon to trigger the electronic device to play the video.

[0004] However, according to the above method, since multiple inputs are required to trigger the electronic device to play the dynamic video, the operation process of the electronic device playing the dynamic video is relatively complicated. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide a dynamic video playback method, device, electronic device and medium, which can simplify the operation process of playing video and dynamic video by electronic devices.

[0006] In a first aspect, an embodiment of the present application provides a method for playing a dynamic video, the method comprising: displaying a panoramic image associated with a dynamic video, the panoramic image being obtained by fusing at least two images, the at least two images being images acquired during the shooting of the dynamic video, the dynamic video comprising at least two video clips, each image being associated with at least one video clip; receiving a first input, the first input being used to select a first image area in the panoramic image, the first image area comprising image content of at least one target image, the target image being an image of the at least two images; in response to the first input, based on the first image area, playing a first video clip associated with the at least one target image in the dynamic video.

[0007] In a second aspect, an embodiment of the present application provides a dynamic video playback device, comprising: a display module, a receiving module and a processing module; the display module is used to display a panoramic image associated with a dynamic video, the panoramic image is obtained by fusion of at least two images, the at least two images are images acquired during the shooting of the dynamic video, the dynamic video includes at least two video clips, and each image is associated with at least one video clip; the receiving module is used to receive a first input, the first input is used to select a first image area in the panoramic image, the first image area includes image content of at least one target image, and the target image is an image of the at least two images; the processing module is used to play a first video clip associated with at least one target image in the dynamic video based on the first image area in response to the first input received by the receiving module.

[0008] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0009] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0010] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0011] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0012] In an embodiment of the present application, since the electronic device can display a panoramic image associated with a dynamic video, the panoramic image is obtained by fusing at least two images acquired during the shooting process of the dynamic video, and each of the at least two images is associated with at least one video clip in the dynamic video. Therefore, when the user triggers the electronic device to select a first image area in the panoramic image (the first image area includes the image content of at least one target image) through a first input, the electronic device can play the first video clip associated with at least one target image in the dynamic video. That is, by selecting an image area in the panoramic image, the electronic device can be triggered to play at least part of the video clip in the dynamic video associated with the panoramic image, thereby simplifying the operation process of playing the dynamic video. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 It is a flowchart of a dynamic video playback method provided in an embodiment of the present application;

[0014] Figure 2A This is a schematic diagram of an interface for applying a dynamic video playback method provided in an embodiment of the present application;

[0015] Figure 2B This is a schematic diagram of an interface for applying a dynamic video playback method provided in an embodiment of the present application;

[0016] Figure 3A This is a schematic diagram of an interface for applying a dynamic video playback method provided in an embodiment of the present application;

[0017] Figure 3B This is a schematic diagram of an interface for applying a dynamic video playback method provided in an embodiment of the present application;

[0018] Figure 3C This is a schematic diagram of an interface for applying a dynamic video playback method provided in an embodiment of the present application;

[0019] Figure 4A This is a schematic diagram of an interface for applying a dynamic video playback method provided in an embodiment of the present application;

[0020] Figure 4B This is a schematic diagram of an interface for applying a dynamic video playback method provided in an embodiment of the present application;

[0021] Figure 5 is a structural diagram of a dynamic video playback device provided in an embodiment of the present application;

[0022] Figure 6 is a structural schematic diagram of an electronic device provided in an embodiment of the present application;

[0023] Figure 7 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0024] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0025] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0026] The following, in conjunction with the accompanying drawings, describes in detail the photographing method, device, electronic device and medium provided in the embodiments of the present application through specific embodiments and their application scenarios.

[0027] The dynamic video playback method provided in the embodiment of the present application can be executed by an electronic device or at least one of a functional module and an entity module in the electronic device that can implement the dynamic video playback method. The specific execution can be determined according to actual use requirements and is not limited in the embodiment of the present application. In the embodiment of the present application, an electronic device executing the dynamic video playback method is taken as an example to illustrate the dynamic video playback method provided in the embodiment of the present application.

[0028] The present application embodiment provides a dynamic video playback method. Figure 1 A schematic diagram of the process of the dynamic video playback method provided in the embodiment of the present application is shown. Figure 1 As shown, the dynamic video playback method provided in the embodiment of the present application may include the following steps 101 to 103.

[0029] Step 101: An electronic device displays a panoramic image associated with a dynamic video.

[0030] The panoramic image is obtained by fusing at least two images, where the at least two images are images acquired during the shooting of a dynamic video. The dynamic video includes at least two video clips, and each image is associated with at least one video clip.

[0031] The at least two video clips include the at least one video clip.

[0032] In some embodiments of the present application, the at least one video clip may be any one of the following: video clips with continuous playback time, and video clips with matching contents (such as including the same object).

[0033] In some embodiments of the present application, the electronic device dynamic video and the at least two images mentioned above may be images taken by the electronic device through the same camera.

[0034] In some embodiments of the present application, the at least two images are captured by the electronic device during the process of capturing dynamic video. Specifically, the electronic device may determine some video frames in the process of capturing dynamic video as at least two images.

[0035] In some embodiments of the present application, each of the at least two images corresponds to a video frame in a dynamic video.

[0036] In some implementations of the present application, the association of an image with at least one video clip may be any of the following: an image identifier of the image is associated with a clip identifier of the at least one video clip, or an image identifier of the image is associated with an identifier of a key video frame in the at least one video clip.

[0037] The key video frame is at least one of the following:

[0038] a video frame in the video clip whose image content matches the image content of the image;

[0039] Video frames captured at the same time as the images;

[0040] The video frame with the middle playback time in the video clip. For example, if the duration of a video clip is A seconds (s), the key video frame can be the video frame corresponding to A / 2 seconds;

[0041] A video frame located at the center of a video clip. For example, a video clip includes 51 video frames, and the key video frame may be the 26th video frame.

[0042] In some embodiments of the present application, the shooting angles of the at least two images are different.

[0043] Step 102: The electronic device receives a first input from a user.

[0044] Step 103: The electronic device plays a first video segment associated with at least one target image in the dynamic video based on the first image area in response to the first input.

[0045] The first input may be used to select a first image area in the panoramic image, the first image area including image content of at least one target image, and the target image may be an image among the at least two images mentioned above.

[0046] In some embodiments of the present application, “the first image area includes image content of at least one target image” may include: for each target image in the at least one target image, the first image area includes at least part of the image content of a target image.

[0047] For example, the first image region may include all image content of the i-th target image and part of image content of the j-th target image, where i and j are positive integers.

[0048] In some embodiments of the present application, if the first image area includes image content of one target image, the electronic device can play at least one video clip associated with the one target image in the dynamic video.

[0049] If the first image area includes image contents of at least two target images, the electronic device may continuously play the video segments associated with the at least two target images according to the play order of the video segments associated with the at least two target images.

[0050] In some embodiments of the present application, the first input includes but is not limited to: a touch input by a user through a touch device such as a finger or a stylus, or a voice command input by a user, or a specific gesture input by a user, or other feasible input. The specific input may be determined according to actual use requirements and is not limited in the embodiments of the present application.

[0051] In some embodiments of the present application, the above-mentioned specific gesture can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a two-finger open gesture, a two-finger pinch gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture.

[0052] In some embodiments of the present application, the touch input may be a click input, a long press input, a heavy press input, a two-finger open input, a slide input, a two-finger pinch input, or any possible touch input, which is not limited in the embodiments of the present application. The click input may be a single click input, a double click input, or any number of click inputs.

[0053] In some embodiments of the present application, the above step 103 can be implemented by the following steps 103A and 103B.

[0054] Step 103A: The electronic device updates and displays the first image area in response to the first input according to input parameters of the first input.

[0055] In some embodiments of the present application, the input parameters of the first input may include, but are not limited to: input position, input trajectory, input time, and input object.

[0056] In some embodiments of the present application, updating the display of the first image area includes at least one of the following: updating the display size of the first image area (method 1), rotating the display angle of the first image area (method 2).

[0057] Wherein, updating the display size of the first image area may include: enlarging the first image area or reducing the first image area.

[0058] In some embodiments of the present application, in mode 1, the first input may be any of the following:

[0059] (1) updating the input of the display range of the panoramic image;

[0060] (2) Input of display parameters for adjusting the range selection frame displayed on the panoramic image.

[0061] In some embodiments of the present application, under normal circumstances, the electronic device can display the entire image area of ​​the panoramic image. In the above (1), the user can trigger the electronic device to reduce the display range of the panoramic image through the first input to enlarge the display size of the first image area in the panoramic image. It can be understood that the first image area is the display area of ​​the panoramic image after the display range is adjusted.

[0062] In some embodiments of the present application, in the above (1), the first input may include but is not limited to any of the following: a double-click input by a user on the panoramic image, an input by a user spreading two fingers on the panoramic image, a sliding input by a user on the panoramic image, a preset gesture input or a preset voice input by a user to trigger enlarging the display size of the panoramic image, etc.

[0063] For example, Figure 2A As shown, the user can double-click on the panoramic image 20, and the electronic device can reduce the display range of the panoramic image, and based on the reduced display range, as shown in FIG. Figure 2B As shown, the area double-clicked by the user, that is, a partial image area in the panoramic image, that is, the first image area 22, is magnified and displayed; that is, the electronic device updates and displays the first image area according to the input position of the first input. It can be seen that before the user double-clicks, the electronic device displays the entire image area of ​​the panoramic image, and after the user double-clicks, the electronic device magnifies and displays the image area double-clicked by the user in the panoramic image.

[0064] It is understood that after the electronic device adjusts the display range of the panoramic image, the display ratio of the image area of ​​the panoramic image displayed by the electronic device also changes. For example, after the user double-clicks on the panoramic image, the electronic device can display the image area double-clicked by the user according to the display ratio of 16:9.

[0065] In some embodiments of the present application, when the first input is a double-click input, the electronic device may determine an image area within a preset range centered on the input position of the first input as the first image area.

[0066] In some embodiments of the present application, when the first input is a two-finger open input, the electronic device may determine the first image area based on the input trajectory of the first input, for example, determining the image area between the two fingers in the panoramic image as the first image area.

[0067] In some embodiments of the present application, in mode 2, the first input may be: an input of a user sliding clockwise or counterclockwise on the panoramic image.

[0068] For example, the user slides 30 degrees counterclockwise on the first image area of ​​the panoramic image, so that the electronic device can respond to the first input and rotate the first image area 30 degrees counterclockwise according to the angle corresponding to the input trajectory of the first input.

[0069] In some embodiments of the present application, in the above (2), the above step 102 can be implemented by the following step 102A, and the above step 103A can be implemented by the following step 103A1.

[0070] Step 102A: When a range selection box is displayed on the panoramic image, the electronic device receives a first input of the user to the range selection box.

[0071] Step 103A1: The electronic device, in response to a first input, enlarges a first image area selected by a display range selection box in the panoramic image according to an input parameter of the first input.

[0072] For other descriptions of the input parameters of the first input, refer to the relevant description in the above embodiment.

[0073] In some embodiments of the present application, when an electronic device displays a panoramic image, the electronic device may display a range selection box on the panoramic image, so that a user can trigger the electronic device to adjust the display parameters of the range selection box by performing a first input on the range selection box, and then the electronic device can determine the image area within the adjusted range selection box as the first image area.

[0074] In some embodiments of the present application, the display parameters of the range selection box may include at least one of the following: display position, display size, and aspect ratio.

[0075] In some embodiments of the present application, the user moves the range selection box to adjust the display position of the range selection box.

[0076] In some embodiments of the present application, the user can drag a border or a top corner of the range to adjust the display size and aspect ratio of the range selection box.

[0077] In some embodiments of the present application, before the electronic device displays the range selection box, such as Figure 2A As shown, the user can first perform an input on the panoramic image 20, such as a click input, and then Figure 3A As shown, the electronic device may display a range selection box 21 on the panoramic image 20, so that the user can drag the right side frame of the range selection box 21 to the right, that is, the first input, such as Figure 3B As shown, the electronic device can increase the display size of the range selection frame 21, so that the electronic device can Figure 3B The image area within the range selection frame 21 shown is determined as the first image area 22, and, as shown in FIG. Figure 2B As shown, the electronic device can enlarge and display the first image area 22 .

[0078] It can be understood that since the electronic device can enlarge and display the first image area, the user can confirm whether the image area selected in the panoramic image meets the requirements based on the enlarged first image area, which can improve the human-computer interaction performance and improve the user experience.

[0079] In this way, since the user can trigger the electronic device to select and enlarge the first image area by first inputting the range selection box on the panoramic image, it is convenient for the user to visually select the image area, thereby improving the accuracy of image area selection. In addition, after selecting the first image area, since the first image area can be enlarged, the user can perform a second confirmation of the image area, thereby further improving the user experience and the human-computer interaction performance. In this way, the accuracy and experience of image area selection can be improved.

[0080] In some embodiments of the present application, in the above (three), the electronic device can respond to the first input. When the first input is a sliding input of the user on the panoramic image, the electronic device can determine the image area passed by the sliding track of the sliding input in the panoramic image as the first image area, and enlarge and display the first image area.

[0081] Step 103B: The electronic device plays a first video segment corresponding to at least one target image in the dynamic video based on the updated first image area.

[0082] In some embodiments of the present application, the electronic device may play a first video segment corresponding to at least one target image in a dynamic video after receiving a confirmation input from the user regarding an updated first image area.

[0083] In some embodiments of the present application, the above confirmation input includes but is not limited to: a touch input of the user on the updated first image area through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible input. The specific input can be determined according to actual use requirements and is not limited in the embodiments of the present application.

[0084] In some embodiments of the present application, the above-mentioned specific gesture can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture.

[0085] In some embodiments of the present application, the touch input may be a click input, a long press input, a heavy press input, a slide input, a two-finger pinch input, or any possible touch input, which is not limited in the embodiments of the present application. The click input may be a single click input, a double click input, or any number of click inputs.

[0086] For example, Figure 2B As shown, the user can long press on the first image area 22 displayed in the enlarged manner to confirm the input, so as to Figure 3C As shown, the electronic device can display a dynamic video playback interface 23, that is, play a first video segment corresponding to at least one target image in the dynamic video.

[0087] In some embodiments of the present application, the electronic device may automatically play a first video segment corresponding to at least one target image in a dynamic video after a preset time period after updating the display of the first image area.

[0088] For example, after the first image area is magnified and displayed, if no user input is received within a preset time period, the electronic device determines that the user is satisfied with the selected image area, and can automatically play the first video segment corresponding to at least one target image in the dynamic video.

[0089] In some embodiments of the present application, if the user is not satisfied with the first image area currently displayed by the electronic device, the user can execute a cancel input to trigger the electronic device to redisplay the entire image area of ​​the panoramic image, and then the user can re-execute the first input to reselect the first image area. After the user is satisfied with the selected first image area, the first video clip corresponding to at least one target image in the dynamic video is played based on the updated first image area that satisfies the user.

[0090] It can be understood that the purpose of the electronic device updating the display of the first image area based on the input parameter of the first input is to highlight the first image area so that the user can confirm whether the selected first image area meets the user's needs.

[0091] In this way, when the user triggers the electronic device to select the first image area in the panoramic image through the first input, since the electronic device can first update and display the first image area, and can determine based on the updated first image area whether the image area selected by the electronic device meets the user's expectations or requirements, thereby ensuring that the video clips played by the electronic device meet the user's playback needs, and further improving the accuracy of playing video clips in dynamic videos.

[0092] In some embodiments of the present application, the above step 103 may include the following steps 103C to 103E.

[0093] Step 103C: The electronic device determines, in response to the first input and based on the first association relationship, at least one video frame associated with at least one target image in the dynamic video.

[0094] The first association relationship may be an association relationship between an image in the at least two images and a video frame in the dynamic video, and the video segment associated with the image is determined by the video frame associated with the image.

[0095] In some embodiments of the present application, at least one target image corresponds one-to-one to the at least one video frame.

[0096] In some embodiments of the present application, the first association relationship may be a relationship list between identifiers of at least two images and frame numbers or cache identifiers of video frames in dynamic video, such as cache timestamps.

[0097] In some embodiments of the present application, determining a video segment associated with an image from a video frame associated with an image may include: assuming that an image (hereinafter referred to as image 1) is associated with a video frame a in a dynamic video, then:

[0098] 1) The electronic device may determine a video segment consisting of the video frame a and at least one video frame located before the video frame a in the dynamic video as a video segment associated with the image;

[0099] 2) The electronic device may determine a video segment consisting of the video frame a and at least one video frame in the dynamic video that is located after the video frame a as the video segment associated with the image.

[0100] 3) The electronic device may determine a video segment consisting of the video frame a, at least one video frame located before the video frame a, and at least one video frame located after the video frame a as the video segment associated with the image.

[0101] Exemplarily, the electronic device may determine a video segment in a dynamic video whose playing time is within a first playing time range as a video segment associated with an image. Specifically, the first playing time range includes at least one of the following: a playing time range extending forward by a third preset time length starting from the playing time of the video frame associated with the image (such as video frame a); a playing time range extending backward by a fourth preset time length starting from the playing time of video frame a.

[0102] The third preset time length and the fourth preset time length may be the same or different.

[0103] For example, the third preset time length may be 1.5 s, and the fourth preset time length may be 1.2 s.

[0104] For example, the third preset time length may be 1.5 s, and the fourth preset time length may be 1.5 s.

[0105] It should be noted that, in the above embodiment, the first association relationship between an image and a video frame in a dynamic video is used to illustrate the playing of at least one video frame associated with at least one target image in the dynamic video.

[0106] In actual implementation, since the panoramic image is obtained by the fusion of at least two images, each image area in the panoramic image includes at least part of the image content of a video frame in the dynamic video; thus, an association relationship between the image area in the panoramic image and the video frame in the dynamic video can be directly established, so that the corresponding video clip in the dynamic video can be played more directly and quickly based on the image area selected by the user.

[0107] Exemplarily, assuming that the first image area includes N fusion areas, the first image area corresponds to N+1 video frames in the dynamic video, wherein the fusion area is the fusion image portion between two adjacent images, one fusion area corresponds to two images, and thus one fusion area is associated with two video frames in the dynamic video, and N can be a positive integer.

[0108] For example, assuming that the panoramic image is formed by sequentially merging image 1, image 2, image 3, and image 4, and image 1 corresponds to video frame a1, image 2 corresponds to video frame a2, image 3 corresponds to video frame a3, and image 4 corresponds to video frame a4, then:

[0109] If the first image region includes a fusion image region between image 1 and image 2, the electronic device may determine that the first image region is associated with video frame a1 and video frame a2 in the dynamic video.

[0110] If the first image area includes an image area corresponding to the image 1 in the panoramic image and does not include a fusion area, the electronic device may determine that the first image area is associated with the video frame a1.

[0111] Step 103D: The electronic device determines a play time period according to the play time of the first video frame and the play time of the second video frame.

[0112] Step 103E: The electronic device plays the first video segment in the dynamic video whose playing time is within the playing time period.

[0113] The first video frame and the second video frame are respectively the video frames with the smallest frame number and the video frames with the largest frame number in the at least one video frame.

[0114] In some embodiments of the present application, when the number of video frames associated with the first image area is greater than 1, the electronic device can determine the start time of the playback time period based on the video frame with the smallest frame number among the video frames, and determine the end time of the playback time period based on the video frame with the largest frame number. In this way, the electronic device can play a continuous video clip in the dynamic video based on the first image area selected by the user.

[0115] In some embodiments of the present application, the above-mentioned playing time period is a relative time period. Specifically, the playing time period is a relative time period with reference to the total duration of the dynamic video.

[0116] For example, assuming that the first video frame is played at the 2nd second and the second video frame is played at the 2.5th second, the electronic device can determine that the playback time period is from the 2nd second to the 2.5th second of the playback duration corresponding to the dynamic video.

[0117] It can be understood that when the number of video frames in the at least one video frame is 1, the first video frame and the second video frame are the same video frame. When the number of video frames in the at least one video frame is greater than 1, the first video frame and the second video frame are different.

[0118] In some embodiments of the present application, the electronic device may determine a playback time period based on the playback time of the first video frame, the playback time of the second video frame, the third preset duration, and the fourth preset duration.

[0119] For example, the electronic device can determine the start time of the playback time period as: the time corresponding to the first preset duration before the playback time of the first video frame, that is, the start time of the playback time period = the playback time of the first video frame - the third preset duration; and the electronic device can determine the end time of the playback time period as: the time corresponding to the first preset duration after the playback time of the second video frame, that is, the end time of the playback time period = the playback time of the second video frame + the fourth preset duration.

[0120] In some embodiments of the present application, the electronic device may also determine the playback time period based on the playback time of the first video frame, the playback time of the second video frame, any one of the third preset duration and the fourth preset duration.

[0121] For example, the electronic device determines the start time of the playback time period according to the playback time of the first video frame and the third preset duration, and determines the playback time of the second video frame as the end time of the playback time period.

[0122] For example, the electronic device determines the start time of the playback time period according to the playback time of the first video frame, and determines the end time of the playback time period according to the playback time of the second video frame and the fourth preset duration.

[0123] In this way, since at least one video frame corresponding to at least one target image in the video dynamics can be determined based on the first association relationship, and a playback time period can be determined based on the earliest and latest playback times corresponding to the at least one video frame, and the video clips in the dynamic video whose playback time is within the playback time period are played, the accuracy of playing video clips in the dynamic video can be improved.

[0124] In this way, since the user can trigger the electronic device to select the image area in the panoramic image corresponding to the input through input of the panoramic image, and play the specific video clip in the dynamic video according to the association between the target image corresponding to the image area in the panoramic image and the video frame in the dynamic video, the joint playback of the dynamic video and the panoramic image can be realized, thereby improving the playback flexibility.

[0125] The dynamic video playback method provided in the embodiment of the present application is described below with reference to examples.

[0126] For example, Figure 2A As shown, the electronic device displays a panoramic image 20, and the user can click on the panoramic image 20, and then Figure 3A As shown, the electronic device may display a range selection box 21 on the panoramic image 20, so that the user can drag the right side frame of the range selection box 21 to the right, that is, the second input, as shown in FIG. Figure 3B As shown in FIG. 1 , the electronic device may increase the display size of the range selection frame 21. Then, the electronic device may determine the image area within the resized range selection frame as the first image area, and Figure 2B As shown, the electronic device can magnify and display the first image area 22. Therefore, the electronic device can determine the video frame 1, the video frame 2 and the video frame 3 in the dynamic video based on the magnified first image area and the first association relationship. The playing time of these three video frames are respectively: T2, T3, and T4, so that the electronic device can select the time period of the dynamic video to be played as T2-1.5s to T4+1.5s.

[0127] Then, the electronic device can switch from the display interface of the panoramic image to Figure 3C The dynamic video playback interface 23 is shown.

[0128] Then, in one method, the electronic device can automatically start playing the dynamic video from the time T2-1.5s and end the dynamic video playback at the time T4+1.5s, thereby showing the effect of dynamic display of the panoramic image and realizing the panoramic dynamic image.

[0129] Or, in another way, Figure 3CAs shown, after the user long presses the play interface 23, the electronic device can start playing the dynamic video from time T2-1.5s and end the dynamic video playback at time T4+1.5s, thereby showing the effect of dynamic display of panoramic images and realizing panoramic dynamic images.

[0130] Furthermore, after the electronic device finishes playing, Figure 2A As shown, the electronic device can redisplay the panoramic image 20 .

[0131] In this way, when a user views a panoramic image, he or she can select a partial image area of ​​the panoramic image through the range adjustment box to trigger the electronic device to play the video clip corresponding to the partial image area in the dynamic video, thereby improving the dynamic linkage between the video and the panoramic image and increasing the interest of the playback.

[0132] For example, Figure 2A As shown, the electronic device displays a panoramic image 20, and the user can double-click the first image area on the panoramic image 20, and the electronic device can reduce the display range of the panoramic image, so as to Figure 2B As shown, the first image area 22 double-clicked by the user is magnified. Therefore, the electronic device can determine the video frame 1, video frame 2 and video frame 3 in the dynamic video based on the magnified first image area and the first association relationship. The playback time of these three video frames is respectively: T2, T3, and T4, so the electronic device can select the time period of the dynamic video to be played as T2-1.5s to T4+1.5s.

[0133] Then, the electronic device can switch from the display interface of the panoramic image to Figure 3C The dynamic video playback interface 23 is shown.

[0134] Then, in one method, the electronic device can automatically start playing the dynamic video from the time T2-1.5s and end the dynamic video playback at the time T4+1.5s, thereby showing the effect of dynamic display of the panoramic image and realizing the panoramic dynamic image.

[0135] Or, another way is, Figure 3C As shown, after the user long presses the play interface 23, the electronic device can start playing the dynamic video from time T2-1.5s and end the dynamic video playback at time T4+1.5s, thereby showing the effect of dynamic display of panoramic images and realizing panoramic dynamic images.

[0136] Furthermore, after the electronic device finishes playing, Figure 2A As shown, the electronic device can redisplay the panoramic image 20 .

[0137] In this way, when a user views a panoramic image, the display range of the panoramic image can be adjusted or the display size of a certain image area can be increased to trigger the electronic device to select the image area within the adjusted display range of the panoramic image and play the video clip corresponding to the image area in the dynamic video, thereby improving the dynamic linkage between the video and the panoramic image and enhancing the playback interest.

[0138] Furthermore, the user can select the range for playing dynamic video by enlarging the panoramic image, which is more in line with user usage habits and improves the convenience of user operation.

[0139] In the dynamic video playback method provided in the embodiment of the present application, since the electronic device can display a panoramic image associated with a dynamic video, the panoramic image is obtained by fusing at least two images acquired during the shooting process of the dynamic video, and each of the at least two images is associated with at least one video clip in the dynamic video. Therefore, when the user triggers the electronic device to select a first image area in the panoramic image (the first image area includes the image content of at least one target image) through a first input, the electronic device can play the first video clip associated with at least one target image in the dynamic video, that is, the electronic device can be triggered to play at least part of the video clip in the dynamic video associated with the panoramic image by selecting an image area in the panoramic image, thereby simplifying the operation process of playing the dynamic video.

[0140] In some embodiments of the present application, the dynamic video playback method provided in the embodiments of the present application may further include the following step 104.

[0141] Step 104: During the process of playing the first video clip, the electronic device adjusts the display range of the panoramic image according to the playing progress of the first video clip.

[0142] In some embodiments of the present application, the electronic device can adjust the display range of the panoramic image according to the first association relationship and the playback progress of the first video clip. For the description of the first association relationship, refer to the relevant description in the above embodiment, which will not be repeated here to avoid repetition.

[0143] In some embodiments of the present application, the electronic device may display the playback screen of the first video clip and a partial image area of ​​the panoramic image in different regions during the playback of the first video clip, and adjust the display range of the panoramic image according to the playback progress of the first video clip and the first association relationship, so that the display range of the panoramic image is consistent with the playback progress of the first video clip.

[0144] In some embodiments of the present application, the electronic device may display the playback screen of the first video clip and the display range of the panoramic image in the same aspect ratio.

[0145] In some embodiments of the present application, a user can trigger an electronic device to simultaneously display a partial image area of ​​the panoramic image and a playback interface of a first video clip by inputting an identifier of a panoramic image; or, a user can trigger an electronic device to simultaneously display a partial image area of ​​the panoramic image and a playback interface of a dynamic video by inputting an identifier of a dynamic video.

[0146] The dynamic video playback method provided in the embodiment of the present application is described below with reference to the accompanying drawings.

[0147] Exemplarily, during the playback of the first video clip, Figure 4A As shown, the electronic device can simultaneously display the first image area 40 in the panoramic image and the play interface 41 of the first video clip, and the play interface 41 includes a progress indicator 42 indicating the play progress of the dynamic video. Figure 4A As shown, the user can input the play mark 43 in the play interface 41, such as Figure 4B As shown, the electronic device can play the first video clip, and according to the playing progress of the first video clip, determine the frame number of at least one video frame corresponding to the first image area, and then determine whether these frame numbers include the frame number of the video frame currently played by the first video clip. If not, and it is determined that the image area matching the currently played video frame is located on the right side of the current display range of the panoramic image, then Figure 4B As shown, the electronic device automatically slides the panoramic image to the left until the displayed image area corresponds to the frame number of the video frame currently played by the first video clip, thereby realizing the linkage playback of the panoramic image and the dynamic video. In this way, since the user can watch the video clips in the dynamic video and view the panoramic image at the same time, the playback flexibility and playback effect of the electronic device are further improved. It should be noted that Figure 4B The arrow in is only used to indicate the update direction of the display range of the panoramic image. In actual implementation, the arrow may not be displayed or may be invisible to the user.

[0148] In this way, since the electronic device can adjust the display range of the panoramic image according to the playback progress of the video clip in the dynamic video, the user can view the corresponding image area in the panoramic image while watching the dynamic video, thereby improving the playback efficiency, fun and convenience.

[0149] In some embodiments of the present application, before the above step 101, the dynamic video playback method provided by the embodiment of the present application may also include the following steps 105 to 107.

[0150] Step 105 : When displaying the panoramic preview interface, the electronic device caches the preview video frames in the panoramic preview interface and the audio data corresponding to the preview video frames.

[0151] In some embodiments of the present application, the panoramic preview interface may also be referred to as the panoramic shooting preview interface, which have the same meaning and can be interchanged. Both are preview interfaces displayed when the electronic device is in the panoramic shooting mode.

[0152] In some embodiments of the present application, the electronic device may collect audio data through a microphone of the electronic device, and then the electronic device may cache the audio data collected by the microphone.

[0153] For example, when the electronic device displays a panoramic preview interface, the user can narrate the shooting scene, and the electronic device can collect the user's narration audio through a microphone, and cache the narration audio and the preview video frames in the panoramic preview interface.

[0154] Step 106: The electronic device obtains at least two images during the process of caching the preview video frame and the corresponding audio data.

[0155] In some embodiments of the present application, the electronic device may start acquiring at least two images after displaying the panoramic preview interface for a fifth preset time period; or, the electronic device may start acquiring at least two images after receiving a user's shooting input, such as the second input described below.

[0156] It can be understood that the update frame rate of the preview video frame in the panoramic preview interface is greater than the acquisition frame rate of the electronic device acquiring the image of the at least two images.

[0157] For example, the update frame rate of the preview video frame in the panoramic preview interface is 30 frames per second, and the frequency of the electronic device acquiring images may be 2 images per second.

[0158] It should be noted that the panoramic preview interface and the at least two images correspond to the same camera, that is, the preview video frame cached by the electronic device and the at least two images are captured by the same camera. It can be understood that each of the at least two images corresponds to a preview video frame cached by the electronic device.

[0159] For example, taking the example of an electronic device displaying a panoramic preview interface corresponding to the front camera, each time the front camera captures a preview video frame, the electronic device can display the preview video frame in the panoramic preview interface. Assuming that when the front camera captures the i-th preview video frame, the time for capturing the j-th image in at least two images is reached, then: on the one hand, the electronic device can cache the i-th preview video frame and display the i-th preview video frame in the panoramic preview interface; on the other hand, the electronic device can use the i-th preview video frame as the j-th image in at least two images, where j is less than i, and i and j are both positive integers.

[0160] In some embodiments of the present application, the duration of the electronic device caching preview video frames and corresponding audio data is greater than or equal to the target duration, and the target duration is the time difference between the time when the electronic device obtains the first image and the time when the electronic device obtains the last image.

[0161] It can be understood that, during the process of the electronic device acquiring at least two images, the electronic device can continuously cache the preview video frames and the corresponding audio data to perform a more comprehensive video recording of the shooting scene of the panoramic image.

[0162] Step 107: The electronic device generates a dynamic video based on the preview video frames and corresponding audio data cached in the first time period, and performs image fusion processing on at least two images to obtain a panoramic image.

[0163] The first time period may be determined by a time period for acquiring at least two images.

[0164] In some embodiments of the present application, the electronic device may encode the cached preview video frames and the corresponding audio data according to the time sequence of the preview video frames and the corresponding audio data cached in the first time period to obtain a dynamic video.

[0165] In some embodiments of the present application, the electronic device generates a dynamic video based on the preview video frames and corresponding audio data cached in the first time period, which may include:

[0166] The electronic device encodes the preview video frames and corresponding audio data buffered between the second time point and the third time point to generate a dynamic video.

[0167] The second time point is a time point corresponding to a first preset time length before the first time point, and the third time point is a time point corresponding to a second preset time length after the acquisition end time of the at least two images.

[0168] In some embodiments of the present application, the second preset duration may be any possible duration such as 1 second, 2 seconds, 3 seconds or 1.5 seconds.

[0169] In some embodiments of the present application, the first preset duration and the second preset duration may be the same or different. For example, taking the first preset duration and the second preset duration as the same, the first preset duration and the second preset duration may be 1.5 seconds.

[0170] In some embodiments of the present application, the electronic device may perform image fusion processing on the at least two images according to the chronological order of acquisition time of the at least two images to obtain a panoramic image.

[0171] It can be understood that the electronic device can perform image fusion processing on the at least two images according to the shooting time of the at least two images and the image contents of the at least two images to obtain a panoramic image.

[0172] In some embodiments of the present application, the electronic device may encode the cached audio data and preview video frames during the process of caching the preview video frames and the corresponding audio data; or, it may encode the cached audio data and preview video frames after completing the caching of the audio data and preview video frames.

[0173] It can be understood that it can be regarded as a dynamic video of the shooting scene of the panoramic image.

[0174] In some embodiments of the present application, after the electronic device obtains the first video and the panoramic image, it can establish a first association relationship between the image area in the panoramic image and the video frame in the first video according to the correspondence between the first image and the preview image.

[0175] For example, the electronic device may establish a correspondence list between area identifiers of image areas in the panoramic image and frame numbers of video frames in the first video to obtain a first association relationship.

[0176] In some embodiments of the present application, the region identifier of the image region may be identified by a cache sequence number of a preview image corresponding to the image region, such as a cache timestamp.

[0177] In this way, when the electronic device displays a panoramic preview interface, it can cache preview video frames and corresponding audio data, and obtain at least two images in the process of caching preview video frames, and can generate dynamic video based on the preview video frames and corresponding audio data cached in a first time period, and perform image fusion processing on the at least two collected images to obtain a panoramic image. That is, the electronic device can shoot dynamic video and panoramic images at the same time in the same time period, thereby improving shooting efficiency.

[0178] In some embodiments of the present application, before the above step 106, the dynamic video playback method provided in the embodiment of the present application may further include the following step 108, and the above step 106 may be specifically implemented by the following step 106A.

[0179] Step 108: While buffering the preview video frame and the corresponding audio data, the electronic device receives a second input from the user to a shooting control in the panoramic preview interface.

[0180] Step 106A: The electronic device selects at least two images from the preview video frames cached after the first time point in response to the second input.

[0181] The first time point is the input time point of the second input.

[0182] In some embodiments of the present application, after receiving the second input, the electronic device can use the preview video frame shot most recently as the first image and detect the shooting angle. After detecting that the shooting angle changes by a preset angle, the electronic device can select the second image, and so on, until the electronic device selects the last image of at least two images. Of course, the electronic device can also periodically acquire images until at least two images are obtained.

[0183] It can be understood that after the user performs the second input on the shooting control, the user can continue to adjust the shooting angle of the electronic device so that the electronic device can select images with different shooting angles.

[0184] It can be understood that the number of images of the at least two images can be preset or determined by user input.

[0185] For example, the electronic device may end the image selection operation after receiving the third input from the user to the shooting control.

[0186] In some embodiments of the present application, the time point at which the electronic device ends caching the preview video frame is later than the time point at which the electronic device selects the last image, for example, later than the second preset time. In this way, since the electronic device can end caching the audio data and the preview video frame after the second preset time after completing the image selection, that is, the electronic device caches the preview video frame and the audio data for a period of time after completing the image selection, the video content covered in the dynamic video can be richer than the image content in the panoramic image, so that the dynamic video can restore the shooting scene of the panoramic image more completely.

[0187] In some embodiments of the present application, the second input includes but is not limited to: a touch input of a user to a shooting control through a touch device such as a finger or a stylus, or a voice command input by a user, or a specific gesture input by a user, or other feasible input. The specific input can be determined according to actual use requirements and is not limited in the embodiments of the present application.

[0188] In some embodiments of the present application, the above-mentioned specific gesture can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture.

[0189] In some embodiments of the present application, the touch input may be a click input, a long press input, a heavy press input, or any possible touch input, which is not limited in the embodiments of the present application. The click input may be a single click input, a double click input, or any number of click inputs.

[0190] In some embodiments of the present application, the electronic device may end shooting after capturing a preset number of first images, or the electronic device may end the image selection operation after receiving user input, such as the user inputting into the shooting control again.

[0191] In some embodiments of the present application, the electronic device stops previewing the video frame and the corresponding audio data after a second preset time period after completing the selection of at least two images.

[0192] In this way, since the electronic device can capture images after receiving the user's shooting input, i.e., the second input, to obtain at least two images, it can ensure that at least two images captured by the electronic device meet the user's shooting requirements, thereby improving shooting accuracy.

[0193] In some embodiments of the present application, before the above step 107, the dynamic video playback method provided by the embodiment of the present application may further include the following step 109.

[0194] Step 109: The electronic device determines the time period between the second time point and the third time point as the first time period.

[0195] The second time point is a time point corresponding to a first preset time length before the first time point, and the third time point is a time point corresponding to a second preset time length after the acquisition end time of the at least two images.

[0196] For the description of the second time point, please refer to the relevant description of the second time point in the above embodiment, which will not be repeated here to avoid repetition.

[0197] It can be understood that the second time point is earlier than the input time point of the first input by a first preset time length.

[0198] For example, assuming that the input time of the first input is t1 and the first preset time length is T0, the second time point is: t1-T0.

[0199] In some embodiments of the present application, the electronic device may start encoding the preview video frames and audio data cached after the second time point after receiving the second input; that is, encoding is performed during the process of caching the preview video frames. In this way, compared with the solution of encoding after caching, encoding during the process of caching the preview images and audio data can shorten the time taken by the electronic device to shoot dynamic video.

[0200] In some embodiments of the present application, the first preset duration may be any possible duration such as 1s, 1.5s, 2s or 3s.

[0201] It is understandable that the electronic device may discard the preview video frames and corresponding audio data cached outside the first time period.

[0202] In some embodiments of the present application, after the electronic device enters the panoramic image mode, that is, displays the panoramic preview interface, the electronic device can cache the preview image and audio data of the first preset duration in real time in the background. Among them, when the cache duration of the electronic device is greater than the first preset duration, the electronic device can retain the audio data and preview image cached within the most recent first preset duration, and discard the remaining audio data and preview image until the electronic device receives a second input.

[0203] The dynamic video playback method provided in the embodiment of the present application is exemplarily described below with reference to the accompanying drawings.

[0204] For example, after the electronic device displays the panoramic preview interface, the electronic device caches the preview video frames and audio data in real time; then, the user clicks the shooting control in the panoramic preview interface at time t5, so that the electronic device can start to select images at intervals, record the selection time point, and keep caching the preview video frames and audio data, and encode the preview video frames and audio data cached after t5-1.5s. It can be understood that the preview video frames and audio data cached in the process of selecting images should also be encoded in real time.

[0205] After shooting for a period of time, if the user can click the shooting control again, the electronic device can end the image selection operation, which means that the selection of at least two images has been completed.

[0206] Furthermore, after the user clicks the shooting control again, the electronic device continues to cache the preview video frame and the corresponding audio data for 1.5 seconds, and encodes them, and finally generates a dynamic video including a video clip of 1.5 seconds before the image selection starts, a video clip during the image selection process, and a video clip of 1.5 seconds after the selection ends. In this way, since a panoramic image can be shot during the process of shooting a dynamic video, the shooting scene corresponding to the panoramic image can be restored through the dynamic video, thereby improving the shooting efficiency and shooting fun.

[0207] In this way, since the electronic device can determine the time period between the second time point and the third time point as the encoding range corresponding to the dynamic video, it can ensure that the video content of the dynamic video includes but is not limited to the image content in the panoramic image, so that the video content covered in the dynamic video can be richer than the image content in the panoramic image, so that the dynamic video can more completely record or restore the shooting scene of the panoramic image.

[0208] It should be noted that the above embodiment is illustrated by taking the electronic device in panoramic shooting mode, that is, displaying a panoramic preview image as an example. In actual implementation, the electronic device can cache preview video frames and corresponding audio data during the process of shooting a wide-field image with a certain shooting process, so as to generate a dynamic video while completing the shooting of the wide-field image, so as to record the shooting scene corresponding to the wide-field image through the dynamic video, thereby improving shooting efficiency and shooting effect, and increasing interest.

[0209] The dynamic video playback method provided in the embodiment of the present application can be executed by a dynamic video playback device. In the embodiment of the present application, the dynamic video playback device provided in the embodiment of the present application is described by taking the dynamic video playback method executed by the dynamic video playback device as an example.

[0210] The present application embodiment provides a dynamic video playback device, Figure 5 The structure diagram of the dynamic video playback device is shown in FIG. Figure 5 As shown, the dynamic video playback device 500 may include a display module 501, a receiving module 502 and a processing module 503;

[0211] The display module 501 is used to display a panoramic image associated with a dynamic video, where the panoramic image is obtained by fusing at least two images, where the at least two images are images acquired during the shooting of the dynamic video, where the dynamic video includes at least two video clips, and each image is associated with at least one video clip;

[0212] The receiving module 502 is configured to receive a first input, where the first input is used to select a first image area in the panoramic image, where the first image area includes image content of at least one target image, where the target image is an image in the at least two images;

[0213] The processing module 503 is configured to play a first video segment associated with the at least one target image in the dynamic video based on the first image area in response to the first input received by the receiving module 502 .

[0214] In some embodiments of the present application, the display module is further configured to update and display the first image area in response to the first input according to an input parameter of the first input;

[0215] The processing module is specifically configured to play a first video segment associated with the at least one target image in the dynamic video based on the updated first image area.

[0216] In some embodiments of the present application, the receiving module is specifically configured to receive the first input to the range selection box when a range selection box is displayed on the panoramic image;

[0217] The display module is specifically configured to, in response to the first input and according to input parameters of the first input, enlarge and display the first image area selected by the range selection box in the panoramic image.

[0218] In some embodiments of the present application, the processing module is specifically used to:

[0219] Determine, according to a first association relationship, at least one video frame associated with the at least one target image in the dynamic video, wherein the first association relationship is an association relationship between an image in the at least two images and a video frame in the dynamic video, and the video segment associated with the image is determined by the video frame associated with the image;

[0220] Determine a playback time period according to a playback time of a first video frame and a playback time of a second video frame, wherein the first video frame and the second video frame are respectively video frames with the smallest frame number and the largest frame number in the at least one video frame;

[0221] The first video segment in the dynamic video whose playing time is within the playing time period is played.

[0222] In some embodiments of the present application, the processing module is further used to adjust the display range of the panoramic image according to the playback progress of the first video clip during the playback of the first video clip.

[0223] In some embodiments of the present application, the processing module is further used to:

[0224] Before the display module displays the panoramic image associated with the dynamic video, when the display module displays the panoramic preview interface, cache the preview video frames in the panoramic preview interface and the audio data corresponding to the preview video frames;

[0225] In the process of caching the preview video frame and the corresponding audio data, acquiring the at least two images;

[0226] Based on the preview video frames and corresponding audio data cached in the first time period, the dynamic video is generated, and image fusion processing is performed on the at least two images to obtain the panoramic image;

[0227] The first time period is determined by a time period for acquiring the at least two images.

[0228] In some embodiments of the present application, the receiving module is further configured to receive a second input to a shooting control in the panoramic preview interface before the processing module acquires the at least two images;

[0229] The processing module is specifically configured to select the at least two images from the preview video frames cached after a first time point in response to the second input received by the receiving module, wherein the first time point is an input time point of the second input.

[0230] In some embodiments of the present application, the processing module is further used to determine the time period between the second time point and the third time point as the first time period before generating the dynamic video based on the preview video frames and corresponding audio data cached in the first time period;

[0231] The second time point is a time point corresponding to a first preset time length before the first time point, and the third time point is a time point corresponding to a second preset time length after the acquisition end time of the at least two images.

[0232] In the dynamic video playback device provided in the present application, since the electronic device can display a panoramic image associated with a dynamic video, the panoramic image is obtained by fusing at least two images obtained during the shooting process of the dynamic video, and each of the at least two images is associated with at least one video segment in the dynamic video, therefore when the user triggers the electronic device to select a first image area in the panoramic image (the first image area includes the image content of at least one target image) through a first input, the electronic device can play the first video segment associated with at least one target image in the dynamic video, that is, the electronic device can be triggered to play at least part of the video segment in the dynamic video associated with the panoramic image by selecting an image area in the panoramic image, thereby simplifying the operation process of playing the dynamic video.

[0233] The dynamic video playback device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a car-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0234] The dynamic video playback device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0235] The dynamic video playback device provided in the embodiment of the present application can achieve Figures 1 to 4B The various processes implemented in the method embodiment achieve the same technical effect and will not be described again here to avoid repetition.

[0236] Alternatively, if Figure 6 As shown, an embodiment of the present application further provides an electronic device 600, including a processor 601 and a memory 602, wherein the memory 602 stores programs or instructions that can be executed on the processor 601, and when the program or instructions are executed by the processor 601, the various steps of the above-mentioned dynamic video playback method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0237] It should be noted that the electronic devices in the embodiments of the present application include mobile electronic devices and non-mobile electronic devices.

[0238] Figure 7 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0239] The electronic device 1500 includes but is not limited to: a radio frequency unit 1501, a network module 1502, an audio output unit 1503, an input unit 1504, a sensor 1505, a display unit 1506, a user input unit 1507, an interface unit 1508, a memory 1509, and a processor 1510 and other components.

[0240] Those skilled in the art will appreciate that the electronic device 1500 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1510 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 7 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0241] The display unit 1506 is used to display a panoramic image associated with a dynamic video, wherein the panoramic image is obtained by fusing at least two images, wherein the at least two images are images acquired during the shooting of the dynamic video, wherein the dynamic video includes at least two video segments, and each image is associated with at least one video segment;

[0242] The user input unit 1507 is used to receive a first input, where the first input is used to select a first image area in the panoramic image, where the first image area includes image content of at least one target image, where the target image is an image in the at least two images;

[0243] The processing unit 1510 is configured to play a first video segment associated with the at least one target image in the dynamic video based on the first image area in response to the first input received by the user input unit 1507 .

[0244] In some embodiments of the present application, the display unit 1506 is further configured to update and display the first image area in response to the first input according to an input parameter of the first input;

[0245] The processing unit 1510 is specifically configured to play the first video segment associated with the at least one target image in the dynamic video based on the updated first image area.

[0246] In some embodiments of the present application, the user input unit 1507 is specifically configured to receive the first input to the range selection box when a range selection box is displayed on the panoramic image;

[0247] The display unit 1506 is specifically configured to, in response to the first input, enlarge and display the first image area selected by the range selection box in the panoramic image according to the input parameters of the first input.

[0248] In some embodiments of the present application, the processing unit 1510 is specifically configured to:

[0249] Determine, according to a first association relationship, at least one video frame associated with the at least one target image in the dynamic video, wherein the first association relationship is an association relationship between an image in the at least two images and a video frame in the dynamic video, and the video segment associated with the image is determined by the video frame associated with the image;

[0250] Determine a playback time period according to a playback time of a first video frame and a playback time of a second video frame, wherein the first video frame and the second video frame are respectively video frames with the smallest frame number and the largest frame number in the at least one video frame;

[0251] The first video segment whose playing time in the dynamic video is within the playing time period is played.

[0252] In some embodiments of the present application, the processing unit 1510 is further configured to adjust a display range of the panoramic image according to a playback progress of the first video segment during playback of the first video segment.

[0253] In some embodiments of the present application, the processing unit 1510 is further configured to:

[0254] Before the display unit 1506 displays the panoramic image associated with the dynamic video, when the display unit 1506 displays the panoramic preview interface, cache the preview video frames in the panoramic preview interface and the audio data corresponding to the preview video frames;

[0255] In the process of caching the preview video frame and the corresponding audio data, acquiring the at least two images;

[0256] Based on the preview video frames and corresponding audio data cached in the first time period, the dynamic video is generated, and image fusion processing is performed on the at least two images to obtain the panoramic image;

[0257] The first time period is determined by a time period for acquiring the at least two images.

[0258] In some embodiments of the present application, the user input unit 1507 is further configured to receive a second input to a shooting control in the panoramic preview interface before the processing unit 1510 acquires the at least two images;

[0259] The processing unit 1510 is specifically configured to select the at least two images from the preview video frames cached after a first time point in response to the second input received by the user input unit 1507, where the first time point is an input time point of the second input.

[0260] In some embodiments of the present application, the processing unit 1510 is further configured to determine a time period between a second time point and a third time point as the first time period before generating the dynamic video based on the preview video frames and corresponding audio data cached in the first time period;

[0261] The second time point is a time point corresponding to a first preset time length before the first time point, and the third time point is a time point corresponding to a second preset time length after the acquisition end time of the at least two images.

[0262] In the electronic device provided by the present application, since the electronic device can display a panoramic image associated with a dynamic video, the panoramic image is obtained by fusing at least two images acquired during the shooting process of the dynamic video, and each of the at least two images is associated with at least one video clip in the dynamic video, when the user triggers the electronic device to select a first image area in the panoramic image (the first image area includes the image content of at least one target image) through a first input, the electronic device can play the first video clip associated with at least one target image in the dynamic video, that is, the electronic device can be triggered to play at least part of the video clip in the dynamic video associated with the panoramic image by selecting an image area in the panoramic image, thereby simplifying the operation process of playing the dynamic video.

[0263] It should be understood that in the embodiment of the present application, the input unit 1504 may include a graphics processor (Graphics Processing Unit, GPU) 15041 and a microphone 15042, and the graphics processor 15041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1506 may include a display panel 15061, and the display panel 15061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1507 includes a touch panel 15071 and at least one of other input devices 15072. The touch panel 15071 is also called a touch screen. The touch panel 15071 may include two parts: a touch detection device and a touch controller. Other input devices 15072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0264] The memory 1509 can be used to store software programs and various data. The memory 1509 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1509 may include a volatile memory or a non-volatile memory, or the memory 1509 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1509 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0265] The processor 1510 may include one or more processing units; optionally, the processor 1510 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1510.

[0266] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned dynamic video playback method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0267] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0268] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned dynamic video playback method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0269] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0270] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned dynamic video playback method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0271] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0272] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0273] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A dynamic video playback method, characterized in that: The method comprises: Displaying a panoramic image associated with a dynamic video, wherein the panoramic image is obtained by fusing at least two images, wherein the at least two images are images acquired during the shooting of the dynamic video, wherein the dynamic video includes at least two video clips, and each image is associated with at least one video clip; receiving a first input, the first input being used to select a first image area in the panoramic image, the first image area including image content of at least one target image, the target image being an image among the at least two images; In response to the first input, a first video segment associated with the at least one target image in the dynamic video is played based on the first image area.

2. The method according to claim 1, characterized in that: The step of playing a first video segment associated with the at least one target image in the dynamic video based on the first image area in response to the first input comprises: in response to the first input, updating and displaying the first image area according to input parameters of the first input; Based on the updated first image area, a first video segment associated with the at least one target image in the dynamic video is played.

3. The method according to claim 2, characterized in that The receiving a first input comprises: In a case where a range selection box is displayed on the panoramic image, receiving the first input to the range selection box; The step of updating and displaying the first image area in response to the first input and according to an input parameter of the first input comprises: In response to the first input, a first image area selected by the range selection box in the panoramic image is enlarged and displayed according to input parameters of the first input.

4. The method according to any one of claims 1 to 3, characterized in that The playing of the first video segment associated with the at least one target image in the dynamic video includes: Determine, according to a first association relationship, at least one video frame associated with the at least one target image in the dynamic video, wherein the first association relationship is an association relationship between an image in the at least two images and a video frame in the dynamic video, and the video segment associated with the image is determined by the video frame associated with the image; Determine a playback time period according to a playback time of a first video frame and a playback time of a second video frame, wherein the first video frame and the second video frame are respectively video frames with the smallest frame number and the largest frame number in the at least one video frame; The first video segment in the dynamic video whose playing time is within the playing time period is played.

5. The method according to any one of claims 1 to 4, characterized in that The method further comprises: During the playback of the first video clip, the display range of the panoramic image is adjusted according to the playback progress of the first video clip.

6. The method according to any one of claims 1 to 4, characterized in that Before displaying the panoramic image associated with the dynamic video, the method further includes: When displaying a panoramic preview interface, cache preview video frames in the panoramic preview interface and audio data corresponding to the preview video frames; In the process of caching the preview video frame and the corresponding audio data, acquiring the at least two images; Based on the preview video frames and corresponding audio data cached in the first time period, the dynamic video is generated, and image fusion processing is performed on the at least two images to obtain the panoramic image; The first time period is determined by a time period for acquiring the at least two images.

7. The method according to claim 6, characterized in that Before acquiring the at least two images, the method further includes: Receiving a second input to a shooting control in the panoramic preview interface; The acquiring of at least two images comprises: In response to the second input, the at least two images are selected from preview video frames cached after a first time point, the first time point being an input time point of the second input.

8. The method according to claim 7, characterized in that Before generating the dynamic video based on the preview video frames and corresponding audio data cached in the first time period, the method further includes: Determine the time period between the second time point and the third time point as the first time period; The second time point is a time point corresponding to a first preset time length before the first time point, and the third time point is a time point corresponding to a second preset time length after the acquisition end time of the at least two images.

9. A dynamic video playback device, characterized in that: The device comprises: a display module, a receiving module and a processing module; The display module is used to display a panoramic image associated with a dynamic video, wherein the panoramic image is obtained by fusing at least two images, wherein the at least two images are images acquired during the shooting process of the dynamic video, wherein the dynamic video includes at least two video clips, and each image is associated with at least one video clip; The receiving module is configured to receive a first input, wherein the first input is used to select a first image area in the panoramic image, wherein the first image area includes image content of at least one target image, and the target image is an image in the at least two images; The processing module is used to play a first video segment associated with the at least one target image in the dynamic video based on the first image area in response to the first input received by the receiving module.

10. The device according to claim 9, characterized in that The display module is further configured to update and display the first image area in response to the first input according to an input parameter of the first input; The processing module is specifically configured to play the first video segment associated with the at least one target image in the dynamic video based on the updated first image area.

11. The device according to claim 10, characterized in that The receiving module is specifically configured to receive the first input to the range selection box when a range selection box is displayed on the panoramic image; The display module is specifically configured to, in response to the first input and according to input parameters of the first input, enlarge and display the first image area selected by the range selection box in the panoramic image.

12. The device according to any one of claims 9 to 11, characterized in that The processing module is specifically used for: Determine, according to a first association relationship, at least one video frame associated with the at least one target image in the dynamic video, wherein the first association relationship is an association relationship between an image in the at least two images and a video frame in the dynamic video, and the video segment associated with the image is determined by the video frame associated with the image; Determine a playback time period according to a playback time of a first video frame and a playback time of a second video frame, wherein the first video frame and the second video frame are respectively video frames with the smallest frame number and the largest frame number in the at least one video frame; The first video segment in the dynamic video whose playing time is within the playing time period is played.

13. The device according to any one of claims 9 to 12, characterized in that The processing module is further configured to adjust the display range of the panoramic image according to the playback progress of the first video segment during the playback of the first video segment.

14. The device according to any one of claims 9 to 13, characterized in that The processing module is further used for: Before the display module displays the panoramic image associated with the dynamic video, when the display module displays the panoramic preview interface, cache the preview video frames in the panoramic preview interface and the audio data corresponding to the preview video frames; In the process of caching the preview video frame and the corresponding audio data, acquiring the at least two images; Based on the preview video frames and corresponding audio data cached in the first time period, the dynamic video is generated, and image fusion processing is performed on the at least two images to obtain the panoramic image; The first time period is determined by a time period for acquiring the at least two images.

15. The device according to claim 14, characterized in that The receiving module is further configured to receive a second input to a shooting control in the panoramic preview interface before the processing module acquires the at least two images; The processing module is specifically configured to select the at least two images from the preview video frames cached after a first time point in response to the second input received by the receiving module, wherein the first time point is an input time point of the second input.

16. The device according to claim 15, characterized in that The processing module is further configured to determine the time period between the second time point and the third time point as the first time period before generating the dynamic video based on the preview video frames and the corresponding audio data cached in the first time period; The second time point is a time point corresponding to a first preset time length before the first time point, and the third time point is a time point corresponding to a second preset time length after the acquisition end time of the at least two images.

17. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the dynamic video playback method as described in any one of claims 1 to 8 are implemented.

18. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the dynamic video playback method as described in any one of claims 1 to 8 are implemented.

Images