Panoramic video playback method, device, electronic device and storage medium

Abstract

The present invention provides a panoramic video playback method, device, electronic device, and storage medium. The method comprises: collecting interactive action data of a user while watching a panoramic video to be processed and identifying video frame features of the panoramic video to be processed; determining the user's target preferred action within a target video frame based on the interactive action data; screening the target video frame features of the target video frame and matching the target preferred action with the target video frame features to obtain a fused data set; extracting video style features of each fused data set, and splicing fused data sets with the same video style features in chronological order to form multiple video playback trajectory links of video clip points with different video style features; and playing the panoramic video to be processed based on the video playback trajectory links of each video clip point in chronological order. This achieves automatic matching of video playback screens that meet user needs and video content characteristics for the user.

Description

Technical Field

[0001] The present invention relates to the field of video playback technology, and in particular to a panoramic video playback method, device, electronic device and storage medium. Background Art

[0002] Panoramic videos are spherical, 720-degree videos with no blind spots. However, when the video is automatically played, only about 120 degrees of viewing angle is displayed on the screen, accounting for only one-sixth of the 720-degree panoramic video, which is unable to present more exciting images. As a result, the current visible video angle may not be the most needed by the viewer.

[0003] Related technologies show that viewers need to use the gyroscope and gestures to find the most visually striking scene. Because 720-degree panoramic videos cannot automatically rotate the angle accurately or dynamically zoom the video during playback, viewers spend a lot of time adjusting the video angle, and they have to repeat these steps every time to find the scene.

[0004] Therefore, currently, finding a panoramic video playback method that automatically matches the video playback screen that meets the user's needs has become a research hotspot. Summary of the Invention

[0005] The present invention provides a panoramic video playback method, device, electronic device and storage medium, which can automatically match a video playback screen that meets the user's needs and video content characteristics for the user.

[0006] The present invention provides a panoramic video playback method, which includes: collecting interactive action data of a user during viewing a to-be-processed panoramic video, and identifying video frame features of the to-be-processed panoramic video; determining a target preference action of the user in a target video frame based on the interactive action data; screening target video frame features of the target video frame from the video frame features, and matching the target preference action with the target video frame features to obtain a fusion data group; extracting video style features of each group of the fusion data groups, and splicing the fusion data groups with the same video style features in chronological order to form multiple groups of video playback track links of video clip points with different video style features; and playing the to-be-processed panoramic video based on the video playback track links of each group of video clip points in chronological order.

[0007] According to a panoramic video playback method provided by the present invention, the video playback trajectory link stores the optimal display viewing angle, zoom focal length and welcome value data of each of the video segment points; before the panoramic video to be processed is played in chronological order based on the video playback trajectory link of each group of video segment points, the method further includes: obtaining the optimal display viewing angle, zoom focal length and welcome value data of each of the video segment points in adjacent video segment points; based on the optimal display viewing angle, zoom focal length and welcome value data of each of the video segment points in adjacent video segment points, respectively determining the viewing angle difference of the optimal display viewing angle of the adjacent video segment points, the focal length difference of the zoom focal length of the adjacent video segment points, and the welcome value data difference of the welcome value data of the adjacent video segment points; the playing of the panoramic video to be processed based on the video playback trajectory link of each group of video segment points in chronological order specifically includes: playing the panoramic video to be processed in chronological order based on the viewing angle difference, the focal length difference, the welcome value data difference, and the video playback trajectory link of each group of video segment points.

[0008] According to a panoramic video playback method provided by the present invention, the panoramic video to be processed is played in chronological order based on the viewing angle difference, the focal length difference, the welcome value data difference, and the video playback trajectory link of each group of video clip points. Specifically, when the viewing angle difference is less than or equal to the viewing angle difference threshold, the focal length difference is less than or equal to the focal length difference threshold, and the welcome value data difference is less than or equal to the welcome value data difference threshold, the video playback trajectory link of each group of video clip points is played in chronological order in sequence to achieve the playback of the panoramic video to be processed.

[0009] According to a panoramic video playback method provided by the present invention, the panoramic video to be processed is played in chronological order based on the viewing angle difference, the focal length difference, the welcome value data difference, and the video playback trajectory links of each group of video segment points. Specifically, the method includes: when the viewing angle difference is greater than a viewing angle difference threshold, and / or the focal length difference is greater than a focal length difference threshold, and / or the welcome value data difference is greater than a welcome value data difference threshold, determining a transition viewing angle of a transition video segment point based on the viewing angle difference, determining a transition zoom focal length of the transition video segment point based on the focal length difference, and determining a transition welcome value data of the transition video segment point based on the welcome value data difference, wherein the transition video segment point is located between adjacent video segment points; determining a transition video playback trajectory link of the transition video segment point based on the transition viewing angle, the transition zoom focal length, and the transition welcome value data; and playing the panoramic video to be processed in chronological order based on the transition video playback trajectory link of the transition video segment point and the video playback trajectory links of each group of video segment points, so as to achieve playback of the panoramic video to be processed.

[0010] According to a panoramic video playback method provided by the present invention, before the fusion data groups with the same video style features are spliced ​​in chronological order to form a plurality of video playback trajectory links of video clip points with different video style features, the method further includes: based on the video style features of each group of the fusion data groups, optimizing the fusion data groups to obtain a target fusion data group with preset video style features, and using the target fusion data group as the fusion data group, wherein the target fusion data group with the preset video style features is a fusion data group whose feature value of the preset video style features exceeds the feature threshold; the splicing of the fusion data groups with the same video style features in chronological order to form a plurality of video playback trajectory links of video clip points with different video style features specifically includes: splicing the target fusion data groups with the same video style features in chronological order to form a plurality of video playback trajectory links of video clip points with different video style features.

[0011] According to a panoramic video playback method provided by the present invention, the interactive action data includes at least any one or more of the gesture sliding action data of the user while watching the panoramic video to be processed, the gyroscope angle data of the player operated by the user while watching the panoramic video to be processed, the video playback residence time data of the panoramic video to be processed, and the video playback angle data of the panoramic video to be processed.

[0012] The present invention also provides a panoramic video playback device, which includes: an acquisition module for collecting interactive action data of a user during viewing a panoramic video to be processed, and identifying video frame features of the panoramic video to be processed; a determination module for determining the target preference action of the user in a target video frame based on the interactive action data; a fusion module for screening the target video frame features of the target video frame from the video frame features, and matching the target preference action with the target video frame features to obtain a fused data group; a processing module for extracting video style features of each group of the fused data groups, and splicing the fused data groups with the same video style features in chronological order to form multiple groups of video playback trajectory links of video clip points with different video style features; a playback module for playing the panoramic video to be processed in chronological order based on the video playback trajectory links of each group of video clip points.

[0013] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, any of the above-described panoramic video playback methods is implemented.

[0014] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements any of the above-described panoramic video playback methods.

[0015] The present invention also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the computer program implements any of the above-mentioned panoramic video playback methods.

[0016] The panoramic video playback method, device, electronic device and storage medium provided by the present invention collect interactive action data of users in the process of watching the panoramic video to be processed and identify the video frame features of the panoramic video to be processed; based on the interactive action data, determine the user's target preference action in the target video frame; screen the target video frame features of the target video frame from the video frame features, and match the target preference action with the target video frame features to obtain a fusion data group; extract the video style features of each group of fusion data groups, and splice the fusion data groups with the same video style features in chronological order to form multiple groups of video playback trajectory links of video clip points with different video style features; play the panoramic video to be processed in chronological order based on the video playback trajectory links of each group of video clip points, so as to automatically match the video playback screen that meets the user's needs and video content characteristics for the user, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the present invention or the prior art, a brief introduction is given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0018] Figure 1 It is a flowchart of the panoramic video playback method provided by the present invention.

[0019] Figure 2 It is a flow chart of playing the panoramic video to be processed based on the video playback trajectory link of each group of video clip points in chronological order provided by the present invention.

[0020] Figure 3 This is a flow chart of the present invention for playing the panoramic video to be processed based on the viewing angle difference, focal length difference, and welcome value data difference in combination with the video playback trajectory link of each group of video clip points.

[0021] Figure 4 It is a structural schematic diagram of the panoramic video playback device provided by the present invention.

[0022] Figure 5 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0023] To make the objectives, technical solutions, and advantages of the present invention more clear, the technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the embodiments described are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.

[0024] The panoramic video playback method provided by the present invention can determine the video playback trajectory links of each group of video clip points according to the specific needs of the user and the content characteristics of the video, and play the panoramic video to be processed based on the video playback trajectory links of each group of video clip points.

[0025] Figure 1 It is a flowchart of the panoramic video playback method provided by the present invention.

[0026] The following will be combined Figure 1 The process of the panoramic video playback method provided by the present invention is described.

[0027] In an exemplary embodiment of the present invention, Figure 1It can be seen that the panoramic video playback method may include steps 110 to 150, and each step will be introduced below.

[0028] In step 110 , interactive action data of the user during viewing of the panoramic video to be processed is collected, and video frame features of the panoramic video to be processed are identified.

[0029] In one embodiment, during the forward trajectory playback of the panoramic video to be processed, interactive action data of the user while watching the panoramic video to be processed may be collected.

[0030] In another exemplary embodiment of the present invention, the interactive action data may include at least one or more of the gesture sliding action data of the user while watching the panoramic video to be processed, the gyroscope angle data of the player operated by the user while watching the panoramic video to be processed, the video playback residence time data of the panoramic video to be processed, and the video playback angle data of the panoramic video to be processed.

[0031] In another embodiment, video frame features of the panoramic video to be processed can also be identified. In one example, semantic segmentation and video content understanding technologies can be used to extract key content feature data from the video frame (corresponding to the panoramic video to be processed), such as object recognition and scene understanding.

[0032] In step 120 , the user's target preferred action in the target video frame is determined based on the interactive action data.

[0033] In another embodiment, the user's target preferred action within the target video frame can be determined based on the interactive action data. In one example, a user behavior analysis module can be pre-trained. During application, the interactive action data can be input into the user behavior analysis module, and the user behavior analysis module outputs the user's target preferred action within the target video frame corresponding to the interactive action data. In other words, the user's viewing habits and preferences within the target video frame can be determined through analysis of the interactive action data. The target video frame can be a specific video frame in the panoramic video to be processed, which can be determined based on actual conditions.

[0034] In step 130 , target video frame features of a target video frame are screened from the video frame features, and the target preferred action is matched with the target video frame features to obtain a fusion data set.

[0035] In another embodiment, target video frame features of a target video frame can be screened from multiple video frame features, and the target preferred action can be matched with the target video frame features to obtain a fused data set. It is understood that the fused data set includes the target video frame features of the target video frame and the target preferred action of the target video frame. In other words, the fused data set comprehensively considers the specific needs of the user and the content characteristics of the video, thereby automatically matching the user with a video playback screen that meets the user's needs and the video content characteristics, thereby laying the foundation for improving the user experience.

[0036] In step 140 , the video style features of each fused data set are extracted, and the fused data sets with the same video style features are spliced ​​in chronological order to form multiple video playback trajectory links of video clip points with different video style features.

[0037] In step 150 , the panoramic video to be processed is played in chronological order based on the video playback trajectory links of each group of video segment points.

[0038] In one embodiment, the video style features of each fused data group can be extracted, and the fused data groups with the same video style features can be spliced ​​in chronological order to form multiple video playback trajectory links of video clip points with different video style features. Among them, a behavior recommendation algorithm module can be pre-trained, and the video style features of each fused data group can be extracted based on the behavior recommendation algorithm module, and the fused data groups with the same video style features can be spliced ​​in chronological order, so that multiple video playback trajectory links of video clip points with different video style features can be formed, that is, the behavior recommendation algorithm module can output multiple video playback trajectory links of video clip points with different video style features. Among them, the video clip points can be considered as video clips composed of target video frames.

[0039] Furthermore, the panoramic video being processed can be played in chronological order based on the video playback trajectory links of each group of video clip points. The video playback trajectory links of each group of video clip points can automatically rotate the video angle and automatically scale the screen ratio according to the user's specific needs and video content characteristics, thereby automatically matching the video playback screen that meets the user's needs and video content characteristics, improving the user experience.

[0040] The panoramic video playback method provided by the present invention collects interactive action data of users in the process of watching the panoramic video to be processed and identifies the video frame features of the panoramic video to be processed; based on the interactive action data, determines the target preference action of the user in the target video frame; screens the target video frame features from the video frame features, and matches the target preference action with the target video frame features to obtain a fusion data group; extracts the video style features of each group of fusion data groups, and splices the fusion data groups with the same video style features in chronological order to form multiple groups of video playback trajectory links of video clip points with different video style features; plays the panoramic video to be processed based on the video playback trajectory links of each group of video clip points in chronological order, so as to automatically match the video playback screen that meets the user needs and video content characteristics for the user, thereby improving the user experience.

[0041] Figure 2 It is a flow chart of playing the panoramic video to be processed based on the video playback trajectory link of each group of video clip points in chronological order provided by the present invention.

[0042] The following will be combined Figure 2 The process of playing the panoramic video to be processed based on the video playback trajectory link of each group of video clip points in chronological order as described above is explained.

[0043] In an exemplary embodiment of the present invention, the video playback track link stores the optimal display viewing angle, zoom focal length and welcome value data of each video clip point. Figure 2 It can be seen that, in chronological order, playing the panoramic video to be processed based on the video playback trajectory link of each group of video clip points may include steps 210 to 230, and each step will be described below.

[0044] In step 210, the optimal display viewing angle, zoom focal length and welcome value data of each video segment point in the adjacent video segment points are obtained.

[0045] In step 220, based on the optimal display viewing angle, zoom focal length and welcome value data of each of the adjacent video segment points, the viewing angle difference of the optimal display viewing angle of the adjacent video segment points, the focal length difference of the zoom focal length of the adjacent video segment points, and the welcome value data difference of the welcome value data of the adjacent video segment points are determined respectively.

[0046] In step 230 , the panoramic video to be processed is played in chronological order based on the viewing angle difference, focal length difference, and welcome value data difference, combined with the video playback trajectory links of each group of video clip points.

[0047] In one embodiment, the optimal display viewing angles of two video segment points in adjacent video segment points, the zoom focal lengths of the two video segment points, and the popularity value data of the two video segment points may be obtained.

[0048] In another embodiment, based on the optimal display viewing angles of two video clip points, the zoom focal lengths of the two video clip points, and the welcome value data of the two video clip points, the viewing angle difference of the optimal display viewing angles of adjacent video clip points, the focal length difference of the zoom focal lengths of adjacent video clip points, and the welcome value data difference of the welcome value data of adjacent video clip points are respectively determined. Furthermore, based on the viewing angle difference, focal length difference, and welcome value data difference, the panoramic video to be processed is played in chronological order in combination with the video playback trajectory links of each group of video clip points.

[0049] During the application process, the video playback trajectory link stores the optimal display viewing angle, zoom focal length, and welcome value data for each point, and also stores the optimal viewing angle, zoom focal length, and welcome value data for the next point. When the video is played to the current point, the video viewing angle can be adjusted or the focal length can be zoomed based on the generated point data. At the same time, the data of the current point and the next point are compared to determine whether the next point needs to change the viewing angle or focal length, or whether a transition animation of switching the viewing angle or focal length is needed. If necessary, the viewing angle data and zoom focal length data of the transition point between the two points are generated by calculating the time difference, angle difference, and focal length difference between the two points, and then combined with the welcome value data of the transition point to obtain the optimal transition animation path. This can meet the different demands of viewers for the picture and improve the viewing experience.

[0050] Figure 3 This is a flow chart of the present invention for playing the panoramic video to be processed based on the viewing angle difference, focal length difference, and welcome value data difference in combination with the video playback trajectory link of each group of video clip points.

[0051] The following will be combined Figure 3 The process of playing the panoramic video to be processed based on the video playback trajectory link of each group of video clip points based on the viewing angle difference, focal length difference, and welcome value data difference is explained.

[0052] In an exemplary embodiment of the present invention, Figure 3 It can be seen that based on the viewing angle difference, focal length difference, and welcome value data difference, the video playback trajectory link of each group of video clip points is combined to play the panoramic video to be processed, which may include steps 310 to 340. Each step will be introduced below.

[0053] In step 310, when the viewing angle difference is less than or equal to the viewing angle difference threshold, the focal length difference is less than or equal to the focal length difference threshold, and the welcome value data difference is less than or equal to the welcome value data difference threshold, the video playback trajectory links based on each group of video clip points are played in chronological order to achieve the playback of the panoramic video to be processed.

[0054] In one embodiment, when the angle difference is less than or equal to the viewing angle difference threshold, the focal length difference is less than or equal to the focal length difference threshold, and the welcome value data difference is less than or equal to the welcome value data difference threshold, it means that the optimal display viewing angle, zoom focal length and welcome value data of adjacent video clip points are not much different, and the transition can be natural during playback. Therefore, the video playback trajectory links based on each group of video clip points can be played in chronological order to realize the playback of the processed panoramic video.

[0055] In step 320, when the viewing angle difference is greater than the viewing angle difference threshold, and\or the focal length difference is greater than the focal length difference threshold, and\or the welcome value data difference is greater than the welcome value data difference threshold, the transition viewing angle of the transition video segment point is determined based on the viewing angle difference, the transition zoom focal length of the transition video segment point is determined based on the focal length difference, and the transition welcome value data of the transition video segment point is determined based on the welcome value data difference.

[0056] In step 330, based on the transition viewing angle, the transition zoom focal length, and the transition welcome value data, a transition video playback trajectory link of the transition video segment point is determined.

[0057] In step 340, the transition video playback track links based on the transition video segment points and the video playback track links of each group of video segment points are played in chronological order to play the panoramic video to be processed.

[0058] In another embodiment, when the viewing angle difference is greater than a viewing angle difference threshold, and / or the focal length difference is greater than a focal length difference threshold, and / or the welcome value data difference is greater than a welcome value data difference threshold, it indicates that the optimal display viewing angle, / or zoom focal length, and / or welcome value data of adjacent video clip points are significantly different. Therefore, it is necessary to rely on the time difference, angle difference, and focal length difference between the two points to calculate the optimal dwell time, viewing angle, zoom focal length, and other data of the transition point in the transition animation. Based on this data, animations such as translation, rotation, zoom, and transparency of the intermediate transition point are generated. Through animation switching, the video content of the point with high welcome value is highlighted, and the video content of the point with low welcome value is hidden or blurred, while ensuring that the point switching transition is natural and smooth, providing the user with the best viewing experience. In particular, the transition video clip point can be located between adjacent video clip points.

[0059] In another embodiment, when the viewing angle difference is greater than a viewing angle difference threshold, and / or the focal length difference is greater than a focal length difference threshold, and / or the welcome value data difference is greater than a welcome value data difference threshold, the transition viewing angle of the transition video segment point can be determined based on the viewing angle difference; the transition zoom focal length of the transition video segment point can be determined based on the focal length difference; and the transition welcome value data of the transition video segment point can be determined based on the welcome value data difference. Furthermore, based on the transition viewing angle, transition zoom focal length, and transition welcome value data, a transition video playback trajectory link can be determined for the transition video segment point.

[0060] In one example, the transition viewing angle of the transition video segment point can be determined based on the viewing angle difference based on the averaging method; the transition zoom focal length of the transition video segment point can be determined based on the focal length difference; and the transition welcome value data of the transition video segment point can be determined based on the welcome value data difference.

[0061] In another embodiment, after determining the transition video playback trajectory links for the transition video clip points, the video playback trajectory links for the transition video clip points and the video playback trajectory links for each group of video clip points can be played in chronological order to achieve playback of the panoramic video to be processed. Through animation switching, the video content of the points with high popularity values ​​is highlighted, and the video content of the points with low popularity values ​​is hidden or blurred, while ensuring a natural and smooth transition between points, providing users with an optimal viewing experience.

[0062] In another exemplary embodiment of the present invention, Figure 1 Taking the above embodiment as an example, before splicing the fused data groups with the same video style features in chronological order to form a plurality of video playback trajectory links of video clip points with different video style features (corresponding to step 140), the panoramic video playback method may further include the following steps:

[0063] Based on the video style features of each fusion data group, the fusion data group is optimized to obtain a target fusion data group with a preset video style feature, and the target fusion data group is used as the fusion data group, wherein the target fusion data group with the preset video style feature is a fusion data group whose feature value of the preset video style feature exceeds a feature threshold;

[0064] The target fusion data groups with the same video style features are spliced ​​in chronological order to form multiple groups of video playback trajectory links of video clip points with different video style features.

[0065] In one embodiment, in order to further optimize the fused data set and improve the playback effect of the final processed panoramic video, the fused data set can be optimized based on the video style characteristics of each fused data set to obtain a target fused data set with preset video style characteristics, and the target fused data set is used as the fused data set. It is understood that a fused data set whose feature value of the preset video style feature exceeds the feature threshold can be considered as a fused data set with outstanding video style characteristics, thereby enabling the processed panoramic video to be effectively displayed and played.

[0066] In this embodiment, a fusion data group with outstanding video style characteristics can be screened out from multiple fusion data groups to obtain a target fusion data group, and the target fusion data group can be used as the fusion data group. Furthermore, the target fusion data groups with the same video style characteristics can be spliced ​​in chronological order to form multiple groups of video playback trajectory links for video clip points with different video style characteristics, and then the panoramic video to be processed can be played based on the video playback trajectory links of each group of video clip points in chronological order. In this way, in the process of playing the panoramic video to be processed, it can meet the personalized needs of the user and be closely related to the characteristics of the video content. Finally, the scene of the panoramic video is displayed in the form of dynamic playback, providing users with a new and highly personalized panoramic video viewing experience.

[0067] According to the foregoing description, the panoramic video playback method provided by the present invention collects interactive action data of users in the process of watching the panoramic video to be processed and identifies the video frame features of the panoramic video to be processed; based on the interactive action data, determines the user's target preference action in the target video frame; screens the target video frame features in the video frame features, and matches the target preference action with the target video frame features to obtain a fusion data group; extracts the video style features of each group of fusion data groups, and splices the fusion data groups with the same video style features in chronological order to form multiple groups of video playback trajectory links of video clip points with different video style features; plays the panoramic video to be processed based on the video playback trajectory links of each group of video clip points in chronological order, so as to automatically match the video playback screen that meets the user's needs and video content characteristics for the user, thereby improving the user experience.

[0068] The panoramic video playback device provided by the present invention is described below. The panoramic video playback device described below and the panoramic video playback method described above can be referenced to each other.

[0069] Figure 4 It is a structural schematic diagram of the panoramic video playback device provided by the present invention.

[0070] In an exemplary embodiment of the present invention, Figure 4 It can be seen that the panoramic video playback device may include a collection module 410, a determination module 420, a fusion module 430, a processing module 440, and a playback module 450. Each module will be described below.

[0071] The acquisition module 410 may be configured to collect interactive action data of a user while watching the panoramic video to be processed, and identify video frame features of the panoramic video to be processed;

[0072] The determination module 420 may be configured to determine the target preferred action of the user in the target video frame based on the interactive action data;

[0073] The fusion module 430 may be configured to filter the target video frame features of the target video frame from the video frame features, and match the target preferred action with the target video frame features to obtain a fused data set;

[0074] The processing module 440 may be configured to extract the video style features of each of the fused data groups, and to splice the fused data groups with the same video style features in chronological order to form a plurality of video playback trajectory links of video clip points with different video style features;

[0075] The playback module 450 may be configured to play the panoramic video to be processed in chronological order based on the video playback track links of each group of video segment points.

[0076] In an exemplary embodiment of the present invention, the video playback trajectory link stores the optimal display viewing angle, zoom focal length and welcome value data of each of the video clip points;

[0077] The playback module 450 may also be configured to:

[0078] Obtaining optimal display viewing angle, zoom focal length, and welcome value data for each of the adjacent video segment points;

[0079] Based on the optimal display viewing angle, zoom focal length, and welcome value data of each of the adjacent video segment points, respectively determine the viewing angle difference of the optimal display viewing angle of the adjacent video segment points, the focal length difference of the zoom focal length of the adjacent video segment points, and the welcome value data difference of the welcome value data of the adjacent video segment points;

[0080] The playback module 450 can play the panoramic video to be processed in chronological order based on the video playback trajectory links of each group of video clip points in the following manner:

[0081] In chronological order, based on the viewing angle difference, the focal length difference, and the welcome value data difference, the panoramic video to be processed is played in combination with the video playback trajectory link of each group of video clip points.

[0082] In an exemplary embodiment of the present invention, the playback module 450 can play the panoramic video to be processed in chronological order based on the viewing angle difference, the focal length difference, the welcome value data difference, and the video playback trajectory link of each group of video segment points in the following manner:

[0083] When the viewing angle difference is less than or equal to the viewing angle difference threshold, the focal length difference is less than or equal to the focal length difference threshold, and the welcome value data difference is less than or equal to the welcome value data difference threshold, the video playback trajectory links based on each group of video clip points are played in chronological order to realize the playback of the panoramic video to be processed.

[0084] In an exemplary embodiment of the present invention, the playback module 450 can play the panoramic video to be processed in chronological order based on the viewing angle difference, the focal length difference, the welcome value data difference, and the video playback trajectory link of each group of video segment points in the following manner:

[0085] In a case where the viewing angle difference is greater than a viewing angle difference threshold, and / or the focal length difference is greater than a focal length difference threshold, and / or the welcome value data difference is greater than a welcome value data difference threshold, determining a transition viewing angle of a transition video segment point based on the viewing angle difference, determining a transition zoom focal length of the transition video segment point based on the focal length difference, and determining transition welcome value data of the transition video segment point based on the welcome value data difference, wherein the transition video segment point is located between adjacent video segment points;

[0086] Determining a transition video playback trajectory link of the transition video segment point based on the transition viewing angle, the transition zoom focal length, and the transition welcome value data;

[0087] In chronological order, the transition video playback track links based on the transition video segment points and the video playback track links of each group of video segment points are played in sequence to achieve the playback of the panoramic video to be processed.

[0088] In an exemplary embodiment of the present invention, the fusion module 430 may also be configured to:

[0089] Based on the video style features of each group of the fused data groups, the fused data groups are optimized to obtain a target fused data group with preset video style features, and the target fused data group is used as the fused data group, wherein the target fused data group with the preset video style features is a fused data group whose feature value of the preset video style features exceeds a feature threshold;

[0090] The processing module 440 can use the following method to achieve splicing of the fused data groups with the same video style features in chronological order to form multiple video playback track links of video clip points with different video style features:

[0091] The target fusion data groups with the same video style features are spliced ​​in chronological order to form multiple groups of video playback trajectory links of video clip points with different video style features.

[0092] In an exemplary embodiment of the present invention, the interactive action data includes at least one or more of the gesture sliding action data of the user while watching the panoramic video to be processed, the gyroscope angle data of the player operated by the user while watching the panoramic video to be processed, the video playback residence time data of the panoramic video to be processed, and the video playback angle data of the panoramic video to be processed.

[0093] Figure 5 An example of a physical structure diagram of an electronic device is shown below. Figure 5 As shown, the electronic device may include: a processor 510, a communication interface 520, a memory 530, and a communication bus 540, wherein the processor 510, the communication interface 520, and the memory 530 communicate with each other via the communication bus 540. The processor 510 may call logic instructions in the memory 530 to execute a panoramic video playback method, which includes: collecting interactive action data of a user while viewing a panoramic video to be processed, and identifying video frame features of the panoramic video to be processed; determining a target preferred action of the user in a target video frame based on the interactive action data; screening target video frame features of the target video frame from the video frame features, and matching the target preferred action with the target video frame features to obtain a fused data set; extracting video style features of each fused data set, and splicing fused data sets with the same video style features in chronological order to form multiple video playback trajectory links of video clip points with different video style features; and playing the panoramic video to be processed in chronological order based on the video playback trajectory links of each video clip point.

[0094] Furthermore, the logic instructions in the aforementioned memory 530 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the portion that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as a USB flash drive, a mobile hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0095] On the other hand, the present invention also provides a computer program product, which includes a computer program, which can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the panoramic video playback method provided by the above methods, which includes: collecting interactive action data of the user during the viewing of the panoramic video to be processed, and identifying the video frame features of the panoramic video to be processed; based on the interactive action data, determining the target preference action of the user in the target video frame; screening the target video frame features of the target video frame from the video frame features, and matching the target preference action with the target video frame features to obtain a fusion data group; extracting the video style features of each group of the fusion data groups, and splicing the fusion data groups with the same video style features in chronological order to form multiple groups of video playback trajectory links of video clip points with different video style features; playing the panoramic video to be processed in chronological order based on the video playback trajectory links of each group of video clip points.

[0096] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute the panoramic video playback method provided by the above-mentioned methods, the method comprising: collecting interactive action data of a user during viewing of a panoramic video to be processed, and identifying video frame features of the panoramic video to be processed; determining a target preference action of the user in a target video frame based on the interactive action data; screening target video frame features of the target video frame from the video frame features, and matching the target preference action with the target video frame features to obtain a fused data group; extracting video style features of each group of the fused data groups, and splicing the fused data groups with the same video style features in chronological order to form multiple groups of video playback trajectory links of video clip points with different video style features; and playing the panoramic video to be processed based on the video playback trajectory links of each group of video clip points in chronological order.

[0097] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one location or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Persons of ordinary skill in the art will be able to understand and implement the present invention without inventive effort.

[0098] Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented using software plus a necessary general-purpose hardware platform, or of course, hardware. Based on this understanding, the essence of the above technical solution, or the portion that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, or an optical disk, and includes a number of instructions for causing a computer device (such as a personal computer, server, or network device) to execute the methods described in each embodiment or certain portions of the embodiments.

[0099] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A panoramic video playback method, characterized in that: The method comprises: Collecting interactive action data of a user while watching a panoramic video to be processed, and identifying video frame features of the panoramic video to be processed; determining a target preferred action of the user within a target video frame based on the interactive action data; screening target video frame features of the target video frame from the video frame features, and matching the target preferred action with the target video frame features to obtain a fusion data set; Extracting video style features from each of the fused data groups, and splicing fused data groups with the same video style features in chronological order to form multiple groups of video playback trajectory links of video clip points with different video style features; The panoramic video to be processed is played in chronological order based on the video playback trajectory links of each group of video clip points, wherein, before splicing the fused data groups with the same video style features in chronological order to form multiple groups of video playback trajectory links of video clip points with different video style features, the method further includes: Based on the video style features of each group of the fused data groups, the fused data groups are optimized to obtain a target fused data group with preset video style features, and the target fused data group is used as the fused data group, wherein the target fused data group with the preset video style features is a fused data group whose feature value of the preset video style features exceeds a feature threshold; The fusion data groups with the same video style features are spliced ​​in chronological order to form multiple video playback track links of video clip points with different video style features, specifically including: The target fusion data groups with the same video style features are spliced ​​in chronological order to form multiple groups of video playback trajectory links of video clip points with different video style features.

2. The panoramic video playback method according to claim 1, wherein: The video playback track link stores the optimal display viewing angle, zoom focal length and welcome value data of each video clip point; Before playing the panoramic video to be processed based on the video playback trajectory links of each group of video clip points in chronological order, the method further includes: Obtaining optimal display viewing angle, zoom focal length, and welcome value data for each of the adjacent video segment points; Based on the optimal display viewing angle, zoom focal length, and welcome value data of each of the adjacent video segment points, respectively determine the viewing angle difference of the optimal display viewing angle of the adjacent video segment points, the focal length difference of the zoom focal length of the adjacent video segment points, and the welcome value data difference of the welcome value data of the adjacent video segment points; Playing the panoramic video to be processed based on the video playback trajectory link of each group of video clip points in chronological order specifically includes: In chronological order, based on the viewing angle difference, the focal length difference, and the welcome value data difference, the panoramic video to be processed is played in combination with the video playback trajectory link of each group of video clip points.

3. The panoramic video playback method according to claim 2, wherein: The playing of the panoramic video to be processed in chronological order based on the viewing angle difference, the focal length difference, and the welcome value data difference in combination with the video playback trajectory link of each group of video clip points specifically includes: When the viewing angle difference is less than or equal to the viewing angle difference threshold, the focal length difference is less than or equal to the focal length difference threshold, and the welcome value data difference is less than or equal to the welcome value data difference threshold, the video playback trajectory links based on each group of video clip points are played in chronological order to realize the playback of the panoramic video to be processed.

4. The panoramic video playback method according to claim 2, wherein: The playing of the panoramic video to be processed in chronological order based on the viewing angle difference, the focal length difference, and the welcome value data difference in combination with the video playback trajectory link of each group of video clip points specifically includes: In a case where the viewing angle difference is greater than a viewing angle difference threshold, and / or the focal length difference is greater than a focal length difference threshold, and / or the welcome value data difference is greater than a welcome value data difference threshold, determining a transition viewing angle of a transition video segment point based on the viewing angle difference, determining a transition zoom focal length of the transition video segment point based on the focal length difference, and determining transition welcome value data of the transition video segment point based on the welcome value data difference, wherein the transition video segment point is located between adjacent video segment points; Determining a transition video playback trajectory link of the transition video segment point based on the transition viewing angle, the transition zoom focal length, and the transition welcome value data; In chronological order, the transition video playback track links based on the transition video segment points and the video playback track links of each group of video segment points are played in sequence to achieve the playback of the panoramic video to be processed.

5. The panoramic video playback method according to any one of claims 1 to 4, characterized in that: The interactive action data includes at least one or more of the gesture sliding action data of the user while watching the panoramic video to be processed, the gyroscope angle data of the player operated by the user while watching the panoramic video to be processed, the video playback residence time data of the panoramic video to be processed, and the video playback angle data of the panoramic video to be processed.

6. A panoramic video playback device, characterized in that: The device is used to implement the panoramic video playback method according to any one of claims 1 to 5, and the device includes: An acquisition module is used to collect interactive action data of users while watching the panoramic video to be processed, and to identify video frame features of the panoramic video to be processed; a determination module, configured to determine a target preferred action of the user in a target video frame based on the interactive action data; a fusion module, configured to filter target video frame features of the target video frame from the video frame features, and match the target preferred action with the target video frame features to obtain a fused data set; A processing module is used to extract the video style features of each group of the fused data groups, and splice the fused data groups with the same video style features in chronological order to form multiple groups of video playback trajectory links of video clip points with different video style features; The playback module is used to play the panoramic video to be processed in chronological order based on the video playback trajectory link of each group of video clip points.

7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the panoramic video playback method according to any one of claims 1 to 5 is implemented.

8. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the panoramic video playback method according to any one of claims 1 to 5 is implemented.

9. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the panoramic video playback method according to any one of claims 1 to 5 is implemented.

Images