A method for producing panoramic promotional short videos based on panoramic images

Abstract

The present invention discloses a method for producing a panoramic promotional short video based on panoramic images, comprising the following steps: identifying the position information of feature points of interest in each panoramic image, and determining the fan angle of a continuous area involved in the feature points of interest; a user specifies the total length of the panoramic promotional short video in advance; determining the time when the intercepted information of a single panoramic image appears in the short video according to the fan angle of the continuous area involved in the feature points of interest; determining the rotation angular velocity of a camera simulating the generation of a single-point rotating panoramic video by a single panoramic image according to the fan angle and the time when the corresponding intercepted information appears in the short video; generating a single-point rotating panoramic video, and intercepting continuous video segments involved in the feature points; synthesizing the extracted continuous video segments involved in the feature points to generate a panoramic promotional short video; the present invention generates single-point rotating panoramic videos by using multiple panoramic images respectively, and then synthesizes these panoramic videos into a panoramic video, so that the switching between multiple scenes is continuous, smooth, and the connection is natural.

Description

Technical Field

[0001] The present invention relates to the technical field of short video production, and in particular to a method for producing panoramic promotional short videos based on panoramic images. Background Art

[0002] Mobile internet products and technologies are developing rapidly, with short video products becoming the most advanced and popular ecosystem in the current internet industry. The creation and dissemination of short video content is a crucial means and method for providing content services to internet users. The key to short video promotion lies in its ability to convey essential information despite its short duration, catering to viewers' fragmented time and enabling them to quickly absorb sufficient information and generate sufficient interest. However, the most pressing need in the current internet sector, especially in the area of ​​content production, is to efficiently and quickly generate highly edited short videos using traditional multimedia video content. Summary of the Invention

[0003] The purpose of this section is to summarize some aspects of the embodiments of the present invention and briefly introduce some preferred embodiments. Some simplifications or omissions may be made in this section and the abstract and title of this application to avoid obscuring the purpose of this section, the abstract and the title of the invention, and such simplifications or omissions should not be used to limit the scope of the present invention.

[0004] In view of the above existing problems, the present invention is proposed.

[0005] To solve the above technical problems, the present invention provides the following technical solution: a method for producing a panoramic promotional short video based on panoramic images, which comprises the following steps:

[0006] Arrange the N processed panoramic images into a virtual path sequence, and stitch the panoramic images of two adjacent virtual path points together;

[0007] Determine the initial camera orientation and the final camera orientation for each panoramic image, and determine the fan angle θ of the area between the initial camera orientation and the final camera orientation. n ;

[0008] The user provides the total length T of the panoramic promotional short video;

[0009] According to the sector angle θ n Determine the rotation angular velocity w of the camera generated by a single panoramic image to generate a single-point rotating panoramic video, and judge whether w is within the set threshold range [w min , w max If it is, go to the next step; if not, return and ask the user to re-set the total length of the panoramic promotional short video;

[0010] Each panoramic image is converted into a single panoramic video. The panoramic video is a single-point rotation video of a single panoramic image. The initial frame is determined according to the initial camera orientation position, and the end frame is determined according to the end camera orientation position. The continuous video segment between the initial frame and the end frame is intercepted;

[0011] The extracted video clips are synthesized into a panoramic promotional short video according to the order of virtual path points;

[0012] Among them, w min is the set minimum rotation angular velocity, w max is the set maximum rotation angular velocity.

[0013] As a preferred solution of the method for producing a panoramic promotional short video based on panoramic images of the present invention, the method further includes the following steps:

[0014] Determine whether a single-point rotation panoramic video selects an initial frame and an end frame. If no initial frame is manually selected, identify the feature area of ​​interest in each panoramic image, and use the frame of the object or scene displayed in the end frame of the previous virtual path point at this virtual point as the initial frame. If there is no previous virtual point, the default end frame is the initial frame; if the end frame is not selected, use the frame where the presented camera direction is consistent with the direction of the virtual path connecting this virtual path point and the next virtual path point as the end frame; if there is no next virtual point, the default initial frame is the end frame.

[0015] As a preferred solution of the method for producing a panoramic promotional short video based on a panoramic image of the present invention, the steps of selecting the initial frame and the end frame are as follows:

[0016] When the initial frame and the end frame are manually selected, the system compares the features of the end frame of the previous virtual path point with the initial frame of the next virtual path point to determine whether they are reasonable.

[0017] As a preferred solution of the method for producing a panoramic promotional short video based on a panoramic image of the present invention, the steps of selecting the initial frame and the end frame are as follows:

[0018] An initial frame is set for the first point of the virtual path and an end frame is set for all points of the virtual path. Features are extracted from the end frame of the panoramic video of the previous virtual path point and compared with the features at the next virtual path point. The initial frame of the panoramic video of the next virtual path point is automatically selected through image recognition technology.

[0019] As a preferred solution of the panoramic promotional short video production method based on panoramic images of the present invention, the calculation formula of the rotation angular velocity w is:

[0020]

[0021] t is the display time of the switching effect from one virtual path point to the next virtual path point.

[0022] As a preferred solution of the method for producing a panoramic promotional short video based on a panoramic image of the present invention, when w<w min When the total length T of the given panoramic promotional short video is too long; when w>w max , the total length T of the given panoramic promotional short video is too short.

[0023] When w is not within the set threshold range

w min , w max

【T min , T max ], prompting the user to re-set the total length T of the panoramic promotional short video;

[0024]

[0025]

[0026] As a preferred solution of the method for producing a panoramic promotional short video based on a panoramic image of the present invention, after the initial frame and the end frame are selected, the following steps are further included:

[0027] The system determines the relationship between the viewing direction of the end frame of a single panoramic image single-point rotation video of a point on the virtual path and the movement direction of the two related virtual path points, and presets the switching effect for the transition from the virtual path point to the next virtual path point.

[0028] As a preferred solution of the method for producing a panoramic promotional short video based on panoramic images of the present invention, the step of presetting the switching effect includes:

[0029] The angle θ1" formed between the initial frame viewing angle direction and the direction of the virtual point movement trajectory, and the angle θ2" formed between the ending frame viewing angle direction and the direction of the virtual point movement trajectory, the angle θ1" ranges from 60 to 120°, and the preset switching effect is zooming in. The angle θ1" ranges from 240 to 300°, and the preset switching effect is zooming out. If the angle θ1" is in other value ranges, the preset switching effect is translation; the angle θ2" ranges from 60 to 120°, and the preset switching effect is zooming in. The angle θ2" ranges from 240 to 300°, and the preset switching effect is zooming out. Otherwise, the preset switching effect is translation.

[0030] As a preferred solution of the method for producing a panoramic promotional short video based on panoramic images of the present invention, the step of converting each panoramic image into a single panoramic video is as follows:

[0031] The video template sets the panoramic image to complete the preset operation within the set time. The panoramic image is instructed to rotate one circle clockwise or counterclockwise within a certain period of time. According to the human visual perception of continuous motion, the panoramic image is divided into a sufficient number of frames, and each frame is played sequentially to synthesize a panoramic video.

[0032] The beneficial effects of the present invention are as follows: under the condition of limiting the duration of short videos, one or more panoramic images are selected to generate single-point rotating panoramic videos, and the angular velocity of the simulated camera rotation of each single-point rotating panoramic video is calculated according to the fan angle of the initial frame and the end frame of the single-point rotating panoramic video on its corresponding panoramic image. If the angular velocity of the simulated camera rotation is unreasonable, the duration of the limited short video is adjusted to improve the effect of watching the panoramic video. The switching between multiple scenes is continuous and smooth, and the connection is natural, so that the viewer can understand the route of travel; there is no need to associate with an IP address, and it can be directly downloaded and shared in video format; it can be applied to the work of making short videos, and is particularly suitable for the work of making short videos using panoramic images. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be derived from these drawings without inventive effort. Among them:

[0034] Figure 1 It is a schematic diagram of the process of the present invention.

[0035] Figure 2 This is a simulation diagram of the sequence of virtual points in the panoramic roaming video. DETAILED DESCRIPTION

[0036] To make the above-mentioned objects, features, and advantages of the present invention more clearly understood, the following detailed description of the specific embodiments of the present invention is given in conjunction with the accompanying drawings. It is obvious that the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary persons in this field without creative work should fall within the scope of protection of the present invention.

[0037] In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention may also be implemented in other ways different from those described herein. Those skilled in the art may make similar generalizations without violating the connotation of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.

[0038] Secondly, the term "one embodiment" or "embodiment" herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The phrase "in one embodiment" appearing in various places throughout this specification does not necessarily refer to the same embodiment, nor does it refer to a separate or selective embodiment that is mutually exclusive of other embodiments.

[0039] The present invention is described in detail with reference to schematic diagrams. For ease of illustration, cross-sectional views of device structures may be partially enlarged and not to scale when describing embodiments of the present invention. Furthermore, the schematic diagrams are merely illustrative and should not limit the scope of the present invention. Furthermore, in actual production, the three-dimensional dimensions of length, width, and depth should be included.

[0040] In the description of the present invention, it should be noted that the terms "upper, lower, inner, and outer" and other references to orientations or positional relationships are based on the orientations or positional relationships shown in the accompanying drawings and are intended solely to facilitate and simplify the description of the present invention. They are not intended to indicate or imply that the devices or components referred to must have, be constructed, or operate in a specific orientation, and therefore should not be construed as limitations on the present invention. Furthermore, the terms "first, second, or third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0041] In this disclosure, unless otherwise specified or limited, the terms "mounted," "connected," and "connected" should be interpreted broadly. For example, they may refer to fixed, removable, or integral connections. They may also refer to mechanical, electrical, or direct connections, indirect connections through an intermediary, or internal communication between two components. Those skilled in the art will understand the specific meanings of these terms in this disclosure.

[0042] Example 1

[0043] Reference Figure 1 This is the first embodiment of the present invention, which provides a method for producing panoramic promotional short videos based on panoramic images. This method is used to synthesize panoramic roaming videos, which do not need to be associated with IP addresses and can be directly downloaded and shared in video format, saving time and effort.

[0044] A method for producing a panoramic promotional short video based on panoramic images, comprising the following steps:

[0045] S1: Obtain N panoramic images and optimize each panoramic image. The optimization steps include:

[0046] S101: After color calibration is completed, horizontal calibration is performed;

[0047] S102: Perform visual center correction on the panoramic image;

[0048] S103: After the panoramic image effect meets the requirements, the panoramic camera itself and the shooting auxiliary equipment are removed from the panoramic image and the panoramic image is filled with ground;

[0049] S2: Arranging the multiple processed panoramic images into a virtual path sequence, and stitching the panoramic images of two adjacent virtual path points exactly;

[0050] S3: Determine the initial camera orientation position and the final camera orientation position for each panoramic image, and determine the fan angle θ of the area between the initial camera orientation position and the final camera orientation position n ; For a single panoramic image single-point rotation video, an initial frame and an end frame are selected, the initial frame is determined according to the initial camera orientation position, and the end frame is determined according to the end camera orientation position, the end frame of the panoramic video of the previous virtual path point and the initial frame of the next virtual path point are identified, and it is determined whether the feature points are consistent. If the feature points are consistent, no processing is performed. If the feature points are inconsistent, a message to modify the initial frame of the next virtual path point is sent to the user. If it is still not modified, go to step S4. If it is modified, return to step S3;

[0051] S4: The total length T of the panoramic promotional short video given by the user;

[0052] S5: According to the sector angle θ n Determine the rotation angular velocity w of the camera generated by a single panoramic image to generate a single-point rotating panoramic video simulation, Determine whether w is within the set threshold range [w min , w max 】, if yes, go to the next step, if not, return and ask the user to reset the total length of the panoramic promotional short video, the system provides the value range of feedback T【T min , T max ], prompting the user to re-set the total length T of the panoramic promotional short video according to the value range of T;

[0053]

[0054]

[0055] t is the time it takes to display the effect of switching from one virtual path point to the next, w min is the set minimum rotation angular velocity, w max is the set maximum rotation angular velocity. In this embodiment, w min Preferably 10° / s, w max Preferably 20° / s;

[0056] S6: performing a preset video template processing on the single panoramic image. Specifically, the video template sets the panoramic image to complete a preset operation within a set time, that is, the panoramic image rotates one circle in a clockwise or counterclockwise direction within a certain period of time. Based on the human visual perception of continuous motion, the panoramic image is divided into a sufficient number of frames, and each frame is played sequentially to synthesize a panoramic video; each panoramic image is then converted into a single panoramic video, which is a single-point rotation video of a single panoramic image;

[0057] S7: The system determines the relationship between the viewing direction of the end frame of the single-point rotation video of a single panoramic image at a point on the virtual path and the movement directions of the two related virtual path points, and presets a switching effect for transitioning from the virtual path point to the next virtual path point. The step of presetting the switching effect includes:

[0058] The angle θ1" formed between the viewing angle direction of the initial frame and the direction of the moving trajectory of the virtual point, and the angle θ2" formed between the viewing angle direction of the ending frame and the direction of the moving trajectory of the virtual point. The value range of the angle θ1" is 60-120°, and the preset switching effect is zooming in. The value range of the angle θ1" is 240-300°, and the preset switching effect is zooming out. If the angle θ1" is in other value ranges, the preset switching effect is translation. The value range of the angle θ2" is 60-120°, and the preset switching effect is zooming in. The value range of the angle θ2" is 240-300°, and the preset switching effect is zooming out. Otherwise, the preset switching effect is translation. The dynamic effect of walking from one virtual path point to the next virtual path point consists of two effects, specifically, Figure 2 In the floor plan shown, a switching lens point is set on the virtual path between a virtual path point A and the next virtual path point B. A switching effect generated based on θ1” is performed between the virtual path point A and the switching lens point, and a switching effect generated based on θ2” is performed between the switching lens and the next virtual path point B.

[0059] 0.5s before the switching effect based on θ1" is completed, the switching effect based on θ2" is executed to switch from the switching lens point to the virtual lens point B. This can avoid the pause problem and the resulting unrealistic lens effect during the switching between the two switching effects. At the same time, the switching time is extended to give the system time to load and cache the panoramic video of the next virtual point, giving the audience a more realistic viewing experience.

[0060] S8: Synthesize the extracted video clips according to the virtual point sequence to generate a panoramic promotional short video.

[0061] Specifically, the feature points of interest are determined through a trained data model. In this embodiment, a data model for the home furnishing industry is preferred to automatically identify indoor furniture and use it as the feature points of interest extracted from the panoramic image.

[0062] Specifically, the panoramic image is generated into a single-point rotating panoramic video according to a preset template. The template function settings include whether to set the author's name watermark, video resolution (standard definition / high definition), and rotation direction (clockwise / counterclockwise).

[0063] In this embodiment, while limiting the length of short videos, one or more panoramic images are selected to generate single-point rotation panoramic videos. The angular velocity of the simulated camera rotation of each single-point rotation panoramic video is calculated based on the fan angles of the initial frame and the ending frame of the single-point rotation panoramic video on the corresponding panoramic image. If the angular velocity of the simulated camera rotation is unreasonable, the length of the limited short video is adjusted to improve the viewing experience of the panoramic video. The switching between multiple scenes is continuous and smooth, and the connection is natural, allowing viewers to understand the route of travel. In addition, the panoramic videos synthesized by this method do not need to be associated with an IP address and can be directly downloaded and shared in video format.

[0064] Example 2

[0065] This embodiment provides a method for producing a panoramic promotional short video based on panoramic images. The difference from Example 1 is that it provides a method for manually selecting the initial frame and the end frame.

[0066] In step S4, when the initial frame and the end frame are manually selected, the system performs a feature comparison on the end frame of the previous virtual path point and the initial frame of the next virtual path point to determine whether they are reasonable; when the end frame of the current virtual path point and the initial frame of the next virtual path point display the same object or scene, or the initial frame of the current virtual path point and the end frame of the previous virtual path point display the same object or scene, and the feature points are similar, it is determined to be a reasonable situation and no processing is performed; otherwise, if there are obstacles such as walls between the two virtual path points, resulting in the object or scene displayed in the end frame of the previous virtual point not appearing in the panoramic image of the next virtual point, but there is no problem with the selected end frame and the initial frame, for this problem, the reminder can be ignored and the next step can be proceeded without modification. Except for this case, it is determined that the similarity of the feature points is very small, and the user is reminded to modify. If the user chooses not to modify, go to step S7. If the user chooses to modify, return to the feature comparison step.

[0067] Example 3

[0068] This embodiment provides a method for producing a panoramic promotional short video based on panoramic images. The difference from Embodiment 1 is that it realizes automatic selection of the initial frame and the end frame.

[0069] In step S4, if the initial frame and the end frame are not selected, the initial frame of the first single panoramic image single-point rotation video is the end frame by default, and the camera direction presented is consistent with the direction of the virtual path connecting the first virtual path point and the second virtual path point. At the same time, the initial frame of the single panoramic image single-point rotation video of the second virtual path point is consistent with the virtual path direction, thereby determining the initial frame and the end frame of the single panoramic image single-point rotation video at each virtual path point thereafter, and the end frame of the single panoramic image single-point rotation video at the last virtual path point is the initial frame.

[0070] Example 4

[0071] This embodiment provides a method for producing a panoramic promotional short video based on panoramic images, which is the fourth embodiment of the present invention. The difference from embodiment 1 is that in step S8, when generating a panoramic promotional short video, the synthesized video clips can also be imported into music and voice commentary.

[0072] Among them, when users upload panoramic images, they can upload the explanation text of each single panoramic image, extract keywords from the explanation text of each panoramic image, and select the time t when the intercepted information of the single panoramic image appears in the short video. n To generate AI voice explanations at the right time.

[0073] Determine the time t when the intercepted information of a single panoramic image appears in the short video n , t n =T*θ n / (θ1+θ2+...+θ N );t n The duration of the video segment extracted from each panoramic video.

[0074] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit the present invention. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

Claims

1. A method for producing a panoramic promotional short video based on panoramic images, characterized by: The following steps are included: Arrange the N processed panoramic images into a virtual path sequence, and stitch the panoramic images of two adjacent virtual path points together; Determine the initial camera orientation and the final camera orientation for each panoramic image, and determine the fan angle of the area between the initial camera orientation and the final camera orientation. θ n ; The total length of the panoramic promotional short video given by the user T ; According to the fan angle θ n Determine the angular velocity of the camera rotation to generate a single-point rotating panoramic video from a single panoramic image w , angular velocity w The calculation formula is, , t Display time for the switching effect from one virtual path point to the next virtual path point; judge w Is it within the set threshold range? w min , w max If it is, go to the next step; if not, return and ask the user to re-set the total length of the panoramic promotional short video; Each panoramic image is converted into a single panoramic video. The panoramic video is a single-point rotation video of a single panoramic image. The initial frame is determined according to the initial camera orientation position, and the end frame is determined according to the end camera orientation position. The continuous video segment between the initial frame and the end frame is intercepted; The extracted video clips are synthesized into a panoramic promotional short video according to the order of virtual path points; in, w min is the set minimum rotation angular velocity, w max is the set maximum rotation angular velocity.

2. The method for producing a panoramic promotional short video based on a panoramic image according to claim 1, wherein: The following steps are also included: Determine whether a single-point rotation panoramic video selects an initial frame and an end frame. If no initial frame is manually selected, identify the feature area of ​​interest in each panoramic image, and use the frame of the object or scene displayed in the end frame of the previous virtual path point at this virtual point as the initial frame. If there is no previous virtual point, the default end frame is the initial frame; if the end frame is not selected, use the frame where the presented camera direction is consistent with the direction of the virtual path connecting this virtual path point and the next virtual path point as the end frame; if there is no next virtual point, the default initial frame is the end frame.

3. The method for producing a panoramic promotional short video based on a panoramic image according to claim 1, wherein: The steps for selecting the initial frame and the end frame are: When the initial frame and the end frame are manually selected, the system compares the features of the end frame of the previous virtual path point with the initial frame of the next virtual path point to determine whether they are reasonable.

4. The method for producing a panoramic promotional short video based on a panoramic image according to claim 1, wherein: The steps for selecting the initial frame and the end frame are: An initial frame is set for the first point of the virtual path and an end frame is set for all points of the virtual path. Features are extracted from the end frame of the panoramic video of the previous virtual path point and compared with the features at the next virtual path point. The initial frame of the panoramic video of the next virtual path point is automatically selected through image recognition technology.

5. The method for producing a panoramic promotional short video based on a panoramic image according to any one of claims 1 to 4, characterized in that: when w < w min The total length of the given panoramic promotional short video is T Too big; when w > w max The total length of the given panoramic promotional short video is T Too small; when w Not within the set threshold range w min , w max 】, the system provides feedback T The value range of T min , T max ], prompting users to re-set the total length of the panoramic promotional short video T ; ； 。 6. The method for producing a panoramic promotional short video based on a panoramic image according to any one of claims 1 to 4, characterized in that: After the initial frame and the end frame are selected, the following steps are also included: The system determines the relationship between the viewing direction of the end frame of a single panoramic image single-point rotation video of a point on the virtual path and the movement direction of the two related virtual path points, and presets the switching effect for the transition from the virtual path point to the next virtual path point.

7. The method for producing a panoramic promotional short video based on a panoramic image according to claim 6, wherein: The steps for presetting the switching effect include: The angle between the initial frame viewing direction and the direction of the virtual point movement trajectory θ 1 ” , the angle between the end frame viewing direction and the direction of the virtual point moving trajectory θ 2 ” , angle θ 1 ” The value range is 60~120°, and the preset switching effect is magnification. θ 1 ” The value range is 240~300°, and the preset switching effect is to reduce the angle. θ 1 ” In other value ranges, the preset switching effect is translation; Angle θ 2 ” The value range is 60~120°, and the preset switching effect is magnification. θ 2 ” The value range is 240~300°, and the default switching effect is zoom out. Otherwise, the default switching effect is pan.

8. The method for producing a panoramic promotional short video based on a panoramic image according to any one of claims 1 to 4, characterized in that: The steps to convert each panoramic image into a single panoramic video are: The video template sets the panoramic image to complete the preset operation within the set time. The panoramic image is instructed to rotate one circle clockwise or counterclockwise within a certain period of time. According to the human visual perception of continuous motion, the panoramic image is divided into a sufficient number of frames, and each frame is played sequentially to synthesize a panoramic video.

Images