Panoramic video playing method and device, electronic equipment and storage medium

Abstract

The invention provides a panoramic video playing method and apparatus, an electronic device and a storage medium. The method comprises the steps of collecting interactive action data of a user in a process of watching a to-be-processed panoramic video and identifying video frame features of the to-be-processed panoramic video; determining a target preference action of the user in the target video frame based on the interaction action data; screening target video frame features of the target video frame, and matching the target preference action with the target video frame features to obtain a fusion data set; extracting video style characteristics of each group of fused data groups, and splicing the fused data groups with the same video style characteristics according to a time sequence to form a plurality of groups of video playing track links of video clip point locations with different video style characteristics; and playing the to-be-processed panoramic video based on the video playing track link of each group of video clip point locations according to the time sequence. The video playing picture meeting the user requirements and the video content characteristics is automatically matched for the user.

Description

Technical Field

[0001] The present invention relates to the field of video playback technology, and in particular to a panoramic video playback method, device, electronic equipment and storage medium. Background Art

[0002] Panoramic videos are spherical 720-degree videos with no blind spots, but from the perspective of automatic video playback, only about 120 degrees of viewing angle is displayed on the screen, which is only one-sixth of the viewing angle of the 720-degree panoramic video, and cannot present more wonderful pictures. This directly leads to the current visible video viewing angle not necessarily being what the viewer needs most.

[0003] According to the related technology, viewers need to use the gyroscope and gesture sliding to find the visually impactful scene. Since the 720 panoramic video cannot automatically rotate the angle accurately or dynamically zoom the video when playing, it takes a lot of time for viewers to adjust the video angle, and they need to repeat the above actions every time to find the scene.

[0004] Therefore, currently, finding a panoramic video playback method that automatically matches the video playback screen that meets the user's needs has become a research hotspot. Summary of the invention

[0005] The present invention provides a panoramic video playback method, device, electronic device and storage medium, which can automatically match a video playback screen that meets the user's needs and video content characteristics for the user.

[0006] The present invention provides a panoramic video playback method, which comprises: collecting interactive action data of a user in a process of watching a panoramic video to be processed, and identifying video frame features of the panoramic video to be processed; determining a target preference action of the user in a target video frame based on the interactive action data; screening a target video frame feature of the target video frame from the video frame features, and matching the target preference action with the target video frame feature to obtain a fused data group; extracting video style features of each group of the fused data groups, and splicing the fused data groups with the same video style features in chronological order to form a plurality of groups of video playback track links of video clip points with different video style features; and playing the panoramic video to be processed based on the video playback track links of each group of video clip points in chronological order.

[0007] According to a panoramic video playback method provided by the present invention, the video playback trajectory link stores the optimal display viewing angle, zoom focal length and welcome value data of each of the video segment points; before the panoramic video to be processed is played in chronological order based on the video playback trajectory link of each group of video segment points, the method further includes: obtaining the optimal display viewing angle, zoom focal length and welcome value data of each of the video segment points in adjacent video segment points; based on the optimal display viewing angle, zoom focal length and welcome value data of each of the video segment points in adjacent video segment points, respectively determining the viewing angle difference of the optimal display viewing angle of adjacent video segment points, the focal length difference of the zoom focal length of adjacent video segment points, and the welcome value data difference of the welcome value data of adjacent video segment points; the panoramic video to be processed is played in chronological order based on the video playback trajectory link of each group of video segment points, specifically including: in chronological order, based on the viewing angle difference, the focal length difference, and the welcome value data difference, the panoramic video to be processed is played in combination with the video playback trajectory link of each group of video segment points.

[0008] According to a panoramic video playback method provided by the present invention, the panoramic video to be processed is played in chronological order based on the viewing angle difference, the focal length difference, the welcome value data difference, and the video playback trajectory links of each group of video clip points. Specifically, when the viewing angle difference is less than or equal to the viewing angle difference threshold, the focal length difference is less than or equal to the focal length difference threshold, and the welcome value data difference is less than or equal to the welcome value data difference threshold, the video playback trajectory links of each group of video clip points are played in chronological order in sequence to achieve the playback of the panoramic video to be processed.

[0009] According to a panoramic video playback method provided by the present invention, the panoramic video to be processed is played in chronological order based on the viewing angle difference, the focal length difference, the welcome value data difference, and the video playback trajectory links of each group of video segment points, specifically including: when the viewing angle difference is greater than a viewing angle difference threshold, and\or the focal length difference is greater than a focal length difference threshold, and\or the welcome value data difference is greater than a welcome value data difference threshold, determining a transition viewing angle of a transition video segment point based on the viewing angle difference, and determining a transition zoom focal length of a transition video segment point based on the focal length difference, and determining transition welcome value data of a transition video segment point based on the welcome value data difference, wherein the transition video segment point is located between adjacent video segment points; determining a transition video playback trajectory link of the transition video segment point based on the transition viewing angle, the transition zoom focal length, and the transition welcome value data; and playing the panoramic video to be processed in chronological order based on the transition video playback trajectory link of the transition video segment point and the video playback trajectory links of each group of video segment points in sequence, so as to play the panoramic video to be processed.

[0010] According to a panoramic video playback method provided by the present invention, before splicing the fused data groups with the same video style features in chronological order to form a plurality of video playback trajectory links of video clip points with different video style features, the method further includes: optimizing the fused data groups based on the video style features of each group of the fused data groups to obtain a target fused data group with preset video style features, and using the target fused data group as the fused data group, wherein the target fused data group with the preset video style features is a fused data group whose feature value of the preset video style features exceeds the feature threshold; splicing the fused data groups with the same video style features in chronological order to form a plurality of video playback trajectory links of video clip points with different video style features, specifically includes: splicing the target fused data groups with the same video style features in chronological order to form a plurality of video playback trajectory links of video clip points with different video style features.

[0011] According to a panoramic video playback method provided by the present invention, the interactive action data at least includes any one or more of the gesture sliding action data of the user when watching the panoramic video to be processed, the gyroscope angle data of the player operated by the user when watching the panoramic video to be processed, the video playback residence time data of the panoramic video to be processed, and the video playback angle data of the panoramic video to be processed.

[0012] The present invention also provides a panoramic video playback device, which includes: an acquisition module, which is used to collect interactive action data of a user in the process of watching a panoramic video to be processed, and to identify video frame features of the panoramic video to be processed; a determination module, which is used to determine the target preference action of the user in a target video frame based on the interactive action data; a fusion module, which is used to screen the target video frame features of the target video frame from the video frame features, and match the target preference action with the target video frame features to obtain a fused data group; a processing module, which is used to extract video style features of each group of the fused data groups, and splice the fused data groups with the same video style features in chronological order to form multiple groups of video playback track links of video clip points with different video style features; a playback module, which is used to play the panoramic video to be processed in chronological order based on the video playback track links of each group of video clip points.

[0013] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, any of the panoramic video playback methods described above is implemented.

[0014] The present invention also provides a non-transitory computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the panoramic video playback method as described above is implemented.

[0015] The present invention also provides a computer program product, including a computer program, wherein when the computer program is executed by a processor, the panoramic video playback method described above is implemented.

[0016] The panoramic video playback method, device, electronic device and storage medium provided by the present invention collect interactive action data of users in the process of watching the panoramic video to be processed and identify the video frame features of the panoramic video to be processed; determine the target preference action of the user in the target video frame based on the interactive action data; screen the target video frame features of the target video frame from the video frame features, and match the target preference action with the target video frame features to obtain a fused data group; extract the video style features of each group of fused data groups, and splice the fused data groups with the same video style features in chronological order to form multiple groups of video playback track links of video clip points with different video style features; play the panoramic video to be processed based on the video playback track links of each group of video clip points in chronological order, so as to automatically match the video playback screen that meets the user's needs and video content characteristics for the user, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0018] Figure 1 It is a flow chart of the panoramic video playback method provided by the present invention.

[0019] Figure 2 It is a flow chart of playing the panoramic video to be processed in chronological order based on the video playback trajectory links of each group of video clip points provided by the present invention.

[0020] Figure 3 It is a flow chart of playing the panoramic video to be processed based on the viewing angle difference, focal length difference, welcome value data difference and the video playback trajectory link of each group of video clip points provided by the present invention.

[0021] Figure 4 It is a structural schematic diagram of the panoramic video playback device provided by the present invention.

[0022] Figure 5 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0023] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0024] The panoramic video playback method provided by the present invention can determine the video playback trajectory links of each group of video segment points according to the specific needs of the user and the content characteristics of the video, and play the panoramic video to be processed based on the video playback trajectory links of each group of video segment points.

[0025] Figure 1 It is a flow chart of the panoramic video playback method provided by the present invention.

[0026] The following will be combined Figure 1 The process of the panoramic video playback method provided by the present invention is described.

[0027] In an exemplary embodiment of the present invention, Figure 1It can be seen that the panoramic video playback method may include steps 110 to 150, and each step will be introduced below.

[0028] In step 110, the interactive action data of the user during the process of watching the panoramic video to be processed is collected, and the video frame features of the panoramic video to be processed are identified.

[0029] In one embodiment, during the forward trajectory playback of the panoramic video to be processed, the interactive action data of the user in the process of watching the panoramic video to be processed can be collected.

[0030] In another exemplary embodiment of the present invention, the interactive action data may include at least any one or more of the gesture sliding action data of the user while watching the panoramic video to be processed, the gyroscope angle data of the player operated by the user while watching the panoramic video to be processed, the video playback residence time data of the panoramic video to be processed, and the video playback angle data of the panoramic video to be processed.

[0031] In another embodiment, video frame features of the panoramic video to be processed may also be identified. In one example, semantic segmentation and video content understanding techniques may be used to extract key content feature data in the video screen (corresponding to the panoramic video to be processed), such as object recognition, scene understanding, etc.

[0032] In step 120 , based on the interactive action data, the target preferred action of the user in the target video frame is determined.

[0033] In another embodiment, the user's target preference action in the target video frame can be determined based on the interactive action data. In one example, a user behavior analysis module can be pre-trained, and during the application process, the interactive action data can be input into the user behavior analysis module to obtain the user's target preference action in the target video frame corresponding to the interactive action data output by the user behavior analysis module, that is, the user's viewing habits and preferences in the target video frame are obtained through the interactive action data analysis. Among them, the target video frame can be a specific video frame in the panoramic video to be processed, which can be determined according to the actual situation.

[0034] In step 130, target video frame features of the target video frame are screened from the video frame features, and the target preferred action is matched with the target video frame features to obtain a fused data set.

[0035] In another embodiment, the target video frame features of the target video frame can be screened from the multiple video frame features, and the target preference action can be matched with the target video frame features to obtain a fused data set. It can be understood that the fused data set includes the target video frame features of the target video frame and the target preference action of the target video frame. In other words, the fused data set comprehensively considers the specific needs of the user and the content characteristics of the video, thereby automatically matching the video playback screen that meets the user's needs and the video content characteristics for the user, and improving the user experience.

[0036] In step 140, the video style features of each fused data group are extracted, and the fused data groups with the same video style features are spliced ​​in chronological order to form a plurality of video playback track links of video clip points with different video style features.

[0037] In step 150, the panoramic video to be processed is played in chronological order based on the video playback track links of each group of video segment points.

[0038] In one embodiment, the video style features of each group of fused data groups can be extracted, and the fused data groups with the same video style features can be spliced ​​in chronological order to form multiple groups of video playback trajectory links of video clip points with different video style features. Among them, the behavior recommendation algorithm module can be pre-trained to obtain the video style features of each group of fused data groups, and the fused data groups with the same video style features can be spliced ​​in chronological order, so that multiple groups of video playback trajectory links of video clip points with different video style features can be formed, that is, the behavior recommendation algorithm module can output multiple groups of video playback trajectory links of video clip points with different video style features. Among them, the video clip points can be considered as video clips composed of target video frames.

[0039] Furthermore, the panoramic video to be processed can be played in chronological order based on the video playback track links of each group of video clip points. The video playback track links of each group of video clip points can automatically rotate the video angle and automatically scale the screen ratio according to the specific needs of the user and the content characteristics of the video, so as to automatically match the video playback screen that meets the user's needs and the video content characteristics for the user, thereby improving the user experience.

[0040] The panoramic video playback method provided by the present invention collects interactive action data of users in the process of watching the panoramic video to be processed and identifies the video frame features of the panoramic video to be processed; based on the interactive action data, determines the target preference action of the user in the target video frame; screens the target video frame features of the target video frame in the video frame features, and matches the target preference action with the target video frame features to obtain a fused data group; extracts the video style features of each group of fused data groups, and splices the fused data groups with the same video style features in chronological order to form a plurality of groups of video playback track links of video clip points with different video style features; plays the panoramic video to be processed based on the video playback track links of each group of video clip points in chronological order, so as to automatically match the video playback screen that meets the user's needs and video content characteristics for the user, thereby improving the user experience.

[0041] Figure 2 It is a flow chart of playing the panoramic video to be processed in chronological order based on the video playback trajectory links of each group of video clip points provided by the present invention.

[0042] The following will be combined Figure 2 The process of playing the panoramic video to be processed based on the video playback trajectory link of each group of video clip points in chronological order as described above is explained.

[0043] In an exemplary embodiment of the present invention, the video playback track link stores the optimal display viewing angle, zoom focal length and welcome value data of each video segment point. Figure 2 It can be seen that, in chronological order, playing the panoramic video to be processed based on the video playback track link of each group of video clip points may include steps 210 to 230, and each step will be introduced below.

[0044] In step 210, the optimal display viewing angle, zoom focal length and welcome value data of each video segment point in the adjacent video segment points are obtained.

[0045] In step 220, based on the optimal display viewing angle, zoom focal length and welcome value data of each of the adjacent video segment points, the viewing angle difference of the optimal display viewing angle of the adjacent video segment points, the focal length difference of the zoom focal length of the adjacent video segment points, and the welcome value data difference of the welcome value data of the adjacent video segment points are determined respectively.

[0046] In step 230, the panoramic video to be processed is played in chronological order based on the viewing angle difference, focal length difference, and welcome value data difference, combined with the video playback trajectory links of each group of video clip points.

[0047] In one embodiment, the optimal display viewing angles of two video segment points in adjacent video segment points, the zoom focal lengths of the two video segment points, and the popularity value data of the two video segment points may be obtained.

[0048] In another embodiment, based on the optimal display viewing angles of two video clip points, the zoom focal lengths of the two video clip points, and the welcome value data of the two video clip points, the viewing angle difference of the optimal display viewing angles of adjacent video clip points, the focal length difference of the zoom focal lengths of adjacent video clip points, and the welcome value data difference of the welcome value data of adjacent video clip points are determined respectively. Further, in chronological order, based on the viewing angle difference, focal length difference, and welcome value data difference, the panoramic video to be processed is played in combination with the video playback track links of each group of video clip points.

[0049] During the application process, the video playback trajectory link stores the optimal display viewing angle, zoom focal length, and welcome value data for each point, and also stores the optimal viewing angle, zoom focal length, and welcome value data for the next point. When the video is played to the current point, the video viewing angle can be adjusted or the focal length can be zoomed based on the generated point data. At the same time, the data of the current point and the next point are compared to determine whether the next point needs to change the viewing angle or focal length, or whether a transition animation of switching the viewing angle or focal length is required. If necessary, the viewing angle data and zoom focal length data of the transition point between the two points are generated by calculating the time difference, angle difference, and focal length difference between the two points, and then combined with the welcome value data of the transition point to obtain the optimal transition animation path. This can meet the different demands of viewers for the picture and improve the viewing experience.

[0050] Figure 3 It is a flow chart of playing the panoramic video to be processed based on the viewing angle difference, focal length difference, welcome value data difference and the video playback trajectory link of each group of video clip points provided by the present invention.

[0051] The following will be combined Figure 3 The process of playing the panoramic video to be processed based on the viewing angle difference, focal length difference, welcome value data difference and the video playback trajectory link of each group of video clip points is explained.

[0052] In an exemplary embodiment of the present invention, Figure 3 It can be seen that based on the viewing angle difference, focal length difference, and welcome value data difference, the video playback trajectory link of each group of video clip points can be combined to play the panoramic video to be processed, which may include steps 310 to 340. Each step will be introduced below.

[0053] In step 310, when the viewing angle difference is less than or equal to the viewing angle difference threshold, the focal length difference is less than or equal to the focal length difference threshold, and the welcome value data difference is less than or equal to the welcome value data difference threshold, the video playback trajectory links based on each group of video clip points are played in chronological order to realize the playback of the panoramic video to be processed.

[0054] In one embodiment, when the angle difference is less than or equal to the viewing angle difference threshold, the focal length difference is less than or equal to the focal length difference threshold, and the welcome value data difference is less than or equal to the welcome value data difference threshold, it means that the optimal display viewing angle, zoom focal length and welcome value data of adjacent video segment points are not much different, and the transition can be natural during the playback process. Therefore, the video playback trajectory links based on each group of video segment points can be played in chronological order to realize the playback of the processed panoramic video.

[0055] In step 320, when the viewing angle difference is greater than the viewing angle difference threshold, and\or the focal length difference is greater than the focal length difference threshold, and\or the welcome value data difference is greater than the welcome value data difference threshold, the transition viewing angle of the transition video segment point is determined based on the viewing angle difference, the transition zoom focal length of the transition video segment point is determined based on the focal length difference, and the transition welcome value data of the transition video segment point is determined based on the welcome value data difference.

[0056] In step 330, based on the transition viewing angle, transition zoom focal length, and transition welcome value data, a transition video playback trajectory link of the transition video segment point is determined.

[0057] In step 340, the transition video playback track links based on the transition video segment points and the video playback track links of each group of video segment points are played in chronological order to play the panoramic video to be processed.

[0058] In another embodiment, when the viewing angle difference is greater than the viewing angle difference threshold, and / or the focal length difference is greater than the focal length difference threshold, and / or the welcome value data difference is greater than the welcome value data difference threshold, it indicates that the optimal display viewing angle, / or zoom focal length, and / or welcome value data of adjacent video clip points are quite different. Therefore, it is necessary to rely on the time difference, angle difference, and focal length difference of the two points to calculate the optimal stay time, viewing angle, zoom focal length, and other data of the transition point in the transition animation. Based on the above data, generate animations such as translation, rotation, zoom, and transparency of the intermediate transition point. Through animation switching, highlight the video content of the point with high welcome value, hide or blur the video content of the point with low welcome value, and ensure that the point switching transition is natural and smooth, giving users the best viewing experience. Among them, the transition video clip point can be located between adjacent video clip points.

[0059] In another embodiment, when the viewing angle difference is greater than the viewing angle difference threshold, and / or the focal length difference is greater than the focal length difference threshold, and / or the welcome value data difference is greater than the welcome value data difference threshold, the transition viewing angle of the transition video segment point can be determined based on the viewing angle difference; the transition zoom focal length of the transition video segment point can be determined based on the focal length difference; and the transition welcome value data of the transition video segment point can be determined based on the welcome value data difference. Further, based on the transition viewing angle, the transition zoom focal length, and the transition welcome value data, the transition video playback track link of the transition video segment point can be determined.

[0060] In one example, the transition viewing angle of the transition video segment point can be determined based on the viewing angle difference based on an averaging method; the transition zoom focal length of the transition video segment point can be determined based on the focal length difference; and the transition welcome value data of the transition video segment point can be determined based on the welcome value data difference.

[0061] In another embodiment, after determining the transition video playback track link of the transition video segment point, the transition video playback track link of the transition video segment point and the video playback track link of each group of video segment points can be played in chronological order to play the panoramic video to be processed. Through the form of animation switching, the video content of the point with high welcome value is highlighted, and the video content of the point with low welcome value is hidden or blurred, while ensuring that the point switching transition is natural and smooth, giving users the best viewing experience.

[0062] In yet another exemplary embodiment of the present invention, Figure 1 Taking the above embodiment as an example, before splicing the fused data groups with the same video style features in chronological order to form a plurality of video playback track links of video clip points with different video style features (corresponding to step 140), the panoramic video playback method may further include the following steps: Based on the video style features of each group of fused data groups, the fused data groups are optimized to obtain a target fused data group with preset video style features, and the target fused data group is used as the fused data group, wherein the target fused data group with the preset video style features is a fused data group whose feature value of the preset video style features exceeds the feature threshold; The target fusion data groups with the same video style features are spliced ​​in chronological order to form multiple groups of video playback trajectory links with video clip points with different video style features.

[0063] In one embodiment, in order to further optimize the fused data group and improve the playback effect of the final panoramic video to be processed, the fused data group can be optimized based on the video style features of each group of fused data groups to obtain a target fused data group with preset video style features, and the target fused data group is used as the fused data group. It can be understood that the fused data group whose feature value of the preset video style feature exceeds the feature threshold can be considered as a fused data group with outstanding video style features, so that the panoramic video to be processed can be effectively displayed and played.

[0064] In this embodiment, a fusion data group with outstanding video style characteristics can be screened out from multiple groups of fusion data groups to obtain a target fusion data group, and the target fusion data group is used as the fusion data group. Furthermore, the target fusion data group with the same video style characteristics can be spliced ​​in chronological order to form multiple groups of video playback trajectory links of video clip points with different video style characteristics, and then the panoramic video to be processed is played based on the video playback trajectory links of each group of video clip points in chronological order. Thereby, in the process of playing the panoramic video to be processed, it can meet the personalized needs of the user and is closely related to the characteristics of the video content. Finally, the scene of the panoramic video is displayed in the form of dynamic playback, providing users with a new and highly personalized panoramic video viewing experience.

[0065] According to the foregoing description, the panoramic video playback method provided by the present invention collects interactive action data of users in the process of watching the panoramic video to be processed and identifies video frame features of the panoramic video to be processed; based on the interactive action data, determines the user's target preference action in the target video frame; screens the target video frame features of the target video frame in the video frame features, and matches the target preference action with the target video frame features to obtain a fused data group; extracts the video style features of each group of fused data groups, and splices the fused data groups with the same video style features in chronological order to form multiple groups of video playback trajectory links of video clip points with different video style features; plays the panoramic video to be processed in chronological order based on the video playback trajectory links of each group of video clip points, so as to automatically match the video playback screen that meets the user's needs and video content characteristics for the user, thereby improving the user experience.

[0066] The panoramic video playback device provided by the present invention is described below. The panoramic video playback device described below and the panoramic video playback method described above can be referenced to each other.

[0067] Figure 4 It is a structural schematic diagram of the panoramic video playback device provided by the present invention.

[0068] In an exemplary embodiment of the present invention, Figure 4 It can be known that the panoramic video playback device may include a collection module 410, a determination module 420, a fusion module 430, a processing module 440, and a playback module 450, and each module will be introduced below.

[0069] The acquisition module 410 may be configured to collect interactive action data of a user in the process of watching the panoramic video to be processed, and to identify video frame features of the panoramic video to be processed; The determination module 420 may be configured to determine the target preferred action of the user in the target video frame based on the interactive action data; The fusion module 430 may be configured to filter the target video frame features of the target video frame from the video frame features, and match the target preferred action with the target video frame features to obtain a fused data set; The processing module 440 may be configured to extract the video style features of each group of the fused data groups, and splice the fused data groups with the same video style features in chronological order to form a plurality of video playback track links of video clip points with different video style features; The playback module 450 may be configured to play the panoramic video to be processed in chronological order based on the video playback track links of each group of video segment points.

[0070] In an exemplary embodiment of the present invention, the video playback track link stores the optimal display viewing angle, zoom focal length and welcome value data of each of the video clip points; The playback module 450 may also be configured to: Obtaining the optimal display viewing angle, zoom focal length and welcome value data of each of the adjacent video segment points; Based on the optimal display viewing angle, zoom focal length and welcome value data of each of the adjacent video segment points, respectively determine the viewing angle difference of the optimal display viewing angle of the adjacent video segment points, the focal length difference of the zoom focal length of the adjacent video segment points, and the welcome value data difference of the welcome value data of the adjacent video segment points; The playback module 450 can play the to-be-processed panoramic video in chronological order based on the video playback track links of each group of video segment points in the following manner: In chronological order, based on the viewing angle difference, the focal length difference, and the welcome value data difference, the panoramic video to be processed is played in combination with the video playback trajectory links of each group of video clip points.

[0071] In an exemplary embodiment of the present invention, the playback module 450 can play the panoramic video to be processed in chronological order based on the viewing angle difference, the focal length difference, the welcome value data difference, and the video playback trajectory link of each group of video segment points in the following manner: When the viewing angle difference is less than or equal to the viewing angle difference threshold, the focal length difference is less than or equal to the focal length difference threshold, and the welcome value data difference is less than or equal to the welcome value data difference threshold, the video playback trajectory links based on each group of video clip points are played in chronological order to realize the playback of the panoramic video to be processed.

[0072] In an exemplary embodiment of the present invention, the playback module 450 can play the panoramic video to be processed in chronological order based on the viewing angle difference, the focal length difference, the welcome value data difference, and the video playback trajectory link of each group of video segment points in the following manner: In the case where the viewing angle difference is greater than the viewing angle difference threshold, and\or the focal length difference is greater than the focal length difference threshold, and\or the welcome value data difference is greater than the welcome value data difference threshold, determining the transition viewing angle of the transition video segment point based on the viewing angle difference, determining the transition zoom focal length of the transition video segment point based on the focal length difference, and determining the transition welcome value data of the transition video segment point based on the welcome value data difference, wherein the transition video segment point is located between adjacent video segment points; Determine a transition video playback trajectory link of the transition video segment point based on the transition viewing angle, the transition zoom focal length, and the transition welcome value data; In chronological order, the transition video playback track links based on the transition video segment points and the video playback track links of each group of video segment points are played in sequence to achieve the playback of the panoramic video to be processed.

[0073] In an exemplary embodiment of the present invention, the fusion module 430 may also be configured to: Based on the video style features of each group of the fused data groups, the fused data groups are optimized to obtain a target fused data group with preset video style features, and the target fused data group is used as the fused data group, wherein the target fused data group with the preset video style features is a fused data group whose feature value of the preset video style features exceeds a feature threshold; The processing module 440 can realize splicing the fused data groups with the same video style features in chronological order to form multiple groups of video playback track links of video clip points with different video style features in the following manner: The target fusion data groups with the same video style features are spliced ​​in chronological order to form a plurality of video playback track links with video clip points with different video style features.

[0074] In an exemplary embodiment of the present invention, the interactive action data includes at least one or more of the gesture sliding action data of the user when watching the panoramic video to be processed, the gyroscope angle data of the player operated by the user when watching the panoramic video to be processed, the video playback residence time data of the panoramic video to be processed, and the video playback angle data of the panoramic video to be processed.

[0075] Figure 5 An example of a physical structure diagram of an electronic device is shown in FIG. Figure 5 As shown, the electronic device may include: a processor 510, a communication interface 520, a memory 530 and a communication bus 540, wherein the processor 510, the communication interface 520 and the memory 530 communicate with each other through the communication bus 540. The processor 510 may call the logic instructions in the memory 530 to execute the panoramic video playback method, which includes: collecting interactive action data of the user in the process of watching the panoramic video to be processed, and identifying the video frame features of the panoramic video to be processed; based on the interactive action data, determining the target preference action of the user in the target video frame; selecting the target video frame features of the target video frame in the video frame features, and matching the target preference action with the target video frame features to obtain a fusion data group; extracting the video style features of each group of the fusion data groups, and splicing the fusion data groups with the same video style features in time order to form a plurality of video playback track links of video clip points with different video style features; and playing the panoramic video to be processed based on the video playback track links of each group of video clip points in time order.

[0076] In addition, the logic instructions in the above-mentioned memory 530 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0077] On the other hand, the present invention also provides a computer program product, which includes a computer program. The computer program can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the panoramic video playback method provided by the above-mentioned methods, which includes: collecting interactive action data of a user during viewing a panoramic video to be processed, and identifying video frame features of the panoramic video to be processed; based on the interactive action data, determining a target preference action of the user in a target video frame; screening target video frame features of the target video frame from the video frame features, and matching the target preference action with the target video frame features to obtain a fused data group; extracting video style features of each group of the fused data groups, and splicing the fused data groups with the same video style features in chronological order to form multiple groups of video playback trajectory links of video clip points with different video style features; playing the panoramic video to be processed in chronological order based on the video playback trajectory links of each group of video clip points.

[0078] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute the panoramic video playback method provided by the above-mentioned methods, the method comprising: collecting interactive action data of a user during viewing of a panoramic video to be processed, and identifying video frame features of the panoramic video to be processed; determining a target preference action of the user in a target video frame based on the interactive action data; screening target video frame features of the target video frame from the video frame features, and matching the target preference action with the target video frame features to obtain a fused data group; extracting video style features of each group of the fused data groups, and splicing the fused data groups with the same video style features in chronological order to form multiple groups of video playback trajectory links of video clip points with different video style features; and playing the panoramic video to be processed in chronological order based on the video playback trajectory links of each group of video clip points.

[0079] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0080] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0081] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A panoramic video playback method, characterized in that: The method comprises: Collecting interactive action data of a user while watching a panoramic video to be processed, and identifying video frame features of the panoramic video to be processed; Determining a target preferred action of the user in a target video frame based on the interactive action data; Selecting the target video frame features of the target video frame from the video frame features, and matching the target preferred action with the target video frame features to obtain a fused data set; Extracting video style features of each group of the fused data groups, and splicing the fused data groups with the same video style features in chronological order to form multiple groups of video playback trajectory links of video clip points with different video style features; The to-be-processed panoramic video is played in chronological order based on the video playback track links of each group of video clip points.

2. The panoramic video playback method according to claim 1, characterized in that: The video playback track link stores the optimal display viewing angle, zoom focal length and welcome value data of each video segment point; Before playing the panoramic video to be processed based on the video playback track links of each group of video segment points in chronological order, the method further includes: Obtaining the optimal display viewing angle, zoom focal length and welcome value data of each of the adjacent video segment points; Based on the optimal display viewing angle, zoom focal length and welcome value data of each of the adjacent video segment points, respectively determine the viewing angle difference of the optimal display viewing angle of the adjacent video segment points, the focal length difference of the zoom focal length of the adjacent video segment points, and the welcome value data difference of the welcome value data of the adjacent video segment points; The playing of the panoramic video to be processed based on the video playing track link of each group of video clip points in time sequence specifically includes: In chronological order, based on the viewing angle difference, the focal length difference, and the welcome value data difference, the panoramic video to be processed is played in combination with the video playback trajectory links of each group of video clip points.

3. The panoramic video playback method according to claim 2, characterized in that: The playing of the panoramic video to be processed in chronological order based on the viewing angle difference, the focal length difference, and the welcome value data difference in combination with the video playback track link of each group of video segment points specifically includes: When the viewing angle difference is less than or equal to the viewing angle difference threshold, the focal length difference is less than or equal to the focal length difference threshold, and the welcome value data difference is less than or equal to the welcome value data difference threshold, the video playback trajectory links based on each group of video clip points are played in chronological order to realize the playback of the panoramic video to be processed.

4. The panoramic video playback method according to claim 2, characterized in that: The playing of the panoramic video to be processed in chronological order based on the viewing angle difference, the focal length difference, and the welcome value data difference in combination with the video playback track link of each group of video segment points specifically includes: In the case where the viewing angle difference is greater than the viewing angle difference threshold, and\or the focal length difference is greater than the focal length difference threshold, and\or the welcome value data difference is greater than the welcome value data difference threshold, determining the transition viewing angle of the transition video segment point based on the viewing angle difference, determining the transition zoom focal length of the transition video segment point based on the focal length difference, and determining the transition welcome value data of the transition video segment point based on the welcome value data difference, wherein the transition video segment point is located between adjacent video segment points; Determine a transition video playback trajectory link of the transition video segment point based on the transition viewing angle, the transition zoom focal length, and the transition welcome value data; In chronological order, the transition video playback track links based on the transition video segment points and the video playback track links of each group of video segment points are played in sequence to achieve the playback of the panoramic video to be processed.

5. The panoramic video playback method according to claim 1, characterized in that: Before splicing the fused data groups with the same video style features in chronological order to form a plurality of video playback track links of video clip points with different video style features, the method further includes: Based on the video style features of each group of the fused data groups, the fused data groups are optimized to obtain a target fused data group with preset video style features, and the target fused data group is used as the fused data group, wherein the target fused data group with the preset video style features is a fused data group whose feature value of the preset video style features exceeds a feature threshold; The fusion data groups with the same video style features are spliced ​​in chronological order to form multiple groups of video playback track links of video clip points with different video style features, specifically including: The target fusion data groups with the same video style features are spliced ​​in chronological order to form a plurality of video playback track links with video clip points with different video style features.

6. The panoramic video playback method according to any one of claims 1 to 5, characterized in that: The interactive action data includes at least one or more of the gesture sliding action data of the user when watching the panoramic video to be processed, the gyroscope angle data of the player operated by the user when watching the panoramic video to be processed, the video playback residence time data of the panoramic video to be processed, and the video playback angle data of the panoramic video to be processed.

7. A panoramic video playback device, characterized in that: The device comprises: A collection module, used to collect interactive action data of users in the process of watching the panoramic video to be processed, and to identify video frame features of the panoramic video to be processed; A determination module, configured to determine a target preferred action of the user in a target video frame based on the interactive action data; A fusion module, used for screening the target video frame features of the target video frame from the video frame features, and matching the target preferred action with the target video frame features to obtain a fusion data set; A processing module, used for extracting the video style features of each group of the fused data groups, and splicing the fused data groups with the same video style features in chronological order to form a plurality of video playback track links of video clip points with different video style features; The playback module is used to play the panoramic video to be processed in chronological order based on the video playback track link of each group of video clip points.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the panoramic video playback method as described in any one of claims 1 to 6 is implemented.

9. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the panoramic video playback method as described in any one of claims 1 to 6 is implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the panoramic video playback method as described in any one of claims 1 to 6 is implemented.

Images