Panoramic video generation method and apparatus, panoramic video playing method and apparatus, and device, medium and program product

Abstract

The present disclosure relates to a panoramic video generation method and apparatus, a panoramic video playing method and apparatus, and a device, a medium and a program product. The panoramic video generation method comprises: acquiring an original panoramic multimedia material; presenting a first material track fragment on a video editing interface, wherein a video editing track is presented on the video editing interface, the first material track fragment is presented on the video editing track, and the first material track fragment is formed on the basis of the original panoramic multimedia material; in response to an editing instruction of setting an interaction event for a first video track fragment in the video editing interface, presenting in the video editing interface a track fragment corresponding to the interaction event; and generating a target panoramic video on the basis of the track fragment on the video editing track in the video editing interface. In the embodiments of the present disclosure, by means of presenting in the video editing interface the track fragment corresponding to the interaction event, after a branch operation option in the interaction event is triggered, a branch material corresponding to the branch operation option is displayed, such that the interaction efficiency between a user and a target video is improved.

Description

Panoramic video generation, playback method, device, equipment, medium and program product

[0001] This application claims priority to the Chinese invention patent application entitled “Panoramic video generation, playback method, device, equipment, medium and program product” filed on March 6, 2023, with application number 202310205043.2. The entire contents of that application are incorporated herein by reference. Technical Field

[0002] The present disclosure relates to the field of computer technology, and in particular to a method, apparatus, device, storage medium, and program product for generating and playing panoramic videos. Background Art

[0003] With the continuous development of multimedia technology and Internet technology, users can watch various videos on the Internet through smart terminals, and can also comment on the video effects and user preferences for the videos they watch. If users like the video, they can also like or forward the video.

[0004] However, although users can perform interactive operations such as commenting, liking or forwarding videos, they cannot interact with the video during playback, which makes the interaction between users and videos less efficient.

[0005] Summary of the Invention

[0006] In order to solve the above technical problems, the embodiments of the present disclosure provide a panoramic video generation method, apparatus, device, storage medium and program product, which improve the interaction efficiency between users and target videos.

[0007] In a first aspect, an embodiment of the present disclosure provides a method for generating a panoramic video, the method comprising:

[0008] Obtaining original panoramic multimedia materials;

[0009] Presenting the first material track segment on a video editing interface; the video editing interface presents a video editing track, the video editing track presents the first material track segment, the first material track segment being formed based on the original panoramic multimedia material;

[0010] In response to an editing instruction for setting an interaction event for the first video track segment in the video editing interface, a track segment corresponding to the interaction event is presented in the video editing interface, wherein the editing instruction is used to indicate the interaction material, timeline position and at least one branch material of the interaction event, the interaction material is used to indicate at least one branch option operation of the interaction event, different branch option operations in the at least one branch option operation are respectively used to trigger presentation of different branch materials in the at least one branch material, and the track segment corresponding to the interaction event includes a second material track segment and at least one third material track segment, the second material track segment is located at the timeline position, the second material track segment is formed based on the interaction material, and the at least one third material track segment is respectively formed based on the at least one branch material;

[0011] A target panoramic video is generated based on the track segments on the video editing track in the video editing interface.

[0012] In a second aspect, an embodiment of the present disclosure provides a method for playing a panoramic video, wherein the panoramic video includes original panoramic multimedia material and interactive events corresponding to the original panoramic multimedia material, including:

[0013] Playing a panoramic video screen corresponding to a target panoramic video, wherein the interactive material, a timeline position, and at least one branch material of the interactive event are included, the interactive material being used to indicate at least one branch option operation of the interactive event, different branch option operations in the at least one branch option operation being respectively used to trigger presentation of different branch materials in the at least one branch material, and the track segments corresponding to the interactive event including a second material track segment and at least one third material track segment, the second material track segment being located at the timeline position, the second material track segment being formed based on the interactive material, and the at least one third material track segment being respectively formed based on the at least one branch material;

[0014] In response to the target panoramic video being played to the timeline position, displaying the interactive material included in the interactive event in the panoramic video screen;

[0015] In response to a triggering operation on the interactive material, a video screen corresponding to a branch material associated with the interactive material and included in the interactive event is displayed.

[0016] In a third aspect, an embodiment of the present disclosure provides a panoramic video generation device, the device comprising:

[0017] A panoramic multimedia material acquisition module is used to acquire original panoramic multimedia materials;

[0018] a video editing interface display module, configured to present the first material track segment on a video editing interface; the video editing interface presents a video editing track, the video editing track presents the first material track segment, the first material track segment being formed based on the original panoramic multimedia material;

[0019] an interactive event editing module for presenting, in response to an editing instruction for setting an interactive event for the first video track segment in the video editing interface, a track segment corresponding to the interactive event in the video editing interface, wherein the editing instruction is used to indicate the interactive material, timeline position, and at least one branch material of the interactive event, the interactive material is used to indicate at least one branch option operation of the interactive event, different branch option operations in the at least one branch option operation are respectively used to trigger presentation of different branch materials in the at least one branch material, the track segment corresponding to the interactive event includes a second material track segment and at least one third material track segment, the second material track segment is located at the timeline position, the second material track segment is formed based on the interactive material, and the at least one third material track segment is respectively formed based on the at least one branch material;

[0020] The target panoramic video generation module is used to generate a target panoramic video based on the track segments on the video editing track in the video editing interface.

[0021] In a third aspect, an embodiment of the present disclosure provides a panoramic video playback device, wherein the panoramic video includes original panoramic multimedia material and interactive events corresponding to the original panoramic multimedia material, the device comprising:

[0022] A panoramic video screen playback module is configured to play a panoramic video screen corresponding to a target panoramic video, wherein the interactive material, timeline position, and at least one branch material of the interactive event are provided, the interactive material being used to indicate at least one branch option operation of the interactive event, different branch option operations in the at least one branch option operation being respectively used to trigger presentation of different branch materials in the at least one branch material, the track segments corresponding to the interactive event comprising a second material track segment and at least one third material track segment, the second material track segment being located at the timeline position, the second material track segment being formed based on the interactive material, and the at least one third material track segment being respectively formed based on the at least one branch material;

[0023] An interactive material display module, configured to display the interactive material included in the interactive event in the panoramic video screen in response to the target panoramic video being played to the timeline position;

[0024] The branch material screen display module is used to display the video screen corresponding to the branch material associated with the interactive material included in the interactive event in response to the triggering operation on the interactive material.

[0025] In a fifth aspect, an embodiment of the present disclosure provides an electronic device, comprising:

[0026] one or more processors;

[0027] a storage device for storing one or more programs;

[0028] When the one or more programs are executed by the one or more processors, the one or more processors implement the panoramic video generation method as described in any one of the first aspects above or the panoramic video playback method as described in any one of the second aspects above.

[0029] In a sixth aspect, an embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements a panoramic video generation method as described in any one of the first aspects above or a panoramic video playback method as described in any one of the second aspects above.

[0030] In the seventh aspect, an embodiment of the present disclosure provides a computer program product, which includes a computer program or instructions, and when the computer program or instructions are executed by a processor, it implements the panoramic video generation method as described in any one of the first aspects above or the panoramic video playback method as described in any one of the second aspects above.

[0031] Embodiments of the present disclosure provide a method, apparatus, device, storage medium, and program product for generating a panoramic video. The method includes: obtaining original panoramic multimedia material; presenting a first material track segment on a video editing interface; presenting a video editing track on the video editing interface, and presenting the first material track segment on the video editing track, wherein the first material track segment is formed based on the original panoramic multimedia material; in response to an editing instruction in the video editing interface for setting an interactive event for the first video track segment, presenting a track segment corresponding to the interactive event in the video editing interface, wherein the editing instruction is used to indicate interactive material, a timeline position, and at least one branch material of the interactive event, the interactive material is used to indicate at least one branch option operation of the interactive event, different branch option operations in the at least one branch option operation are used to trigger the presentation of different branch materials in the at least one branch material, and the track segments corresponding to the interactive event include a second material track segment and at least one third material track segment, the second material track segment is located at the timeline position, the second material track segment is formed based on the interactive material, and the at least one third material track segment is respectively formed based on the at least one branch material; and generating a target panoramic video based on the track segments on the video editing track in the video editing interface. In the embodiment of the present disclosure, the track segment corresponding to the interactive event is presented in the video editing interface, so that after the branch operation option in the interactive event is triggered, the branch material corresponding to the branch operation option is displayed, thereby improving the interaction efficiency between the user and the target video. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The above and other features, advantages, and aspects of the various embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that the originals and elements are not necessarily drawn to scale.

[0033] FIG1 shows an architecture diagram of a video production scenario provided by an embodiment of the present disclosure;

[0034] FIG2 is a flow chart of a method for generating a panoramic video according to an embodiment of the present disclosure;

[0035] FIG3 is a schematic diagram of a panoramic video editing interface in an embodiment of the present disclosure;

[0036] FIG4 is a schematic diagram of a flow chart of a panoramic video playback method according to an embodiment of the present disclosure;

[0037] FIG5 is a schematic diagram of a panoramic video playback interface in an embodiment of the present disclosure;

[0038] FIG6 is a schematic structural diagram of a panoramic video generation device according to an embodiment of the present disclosure;

[0039] FIG7 is a schematic structural diagram of a panoramic video playback device according to an embodiment of the present disclosure;

[0040] FIG8 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0041] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0042] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0043] As used herein, the term "including" and its variations are open-ended, i.e., "including but not limited to." The term "based on" means "based, at least in part, on." The term "one embodiment" means "at least one embodiment," the term "another embodiment" means "at least one additional embodiment," and the term "some embodiments" means "at least some embodiments." Other terms are defined in the following description.

[0044] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0045] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, they should be understood as "one or more".

[0046] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0047] In response, it is used to indicate the conditions or states on which the executed operations depend. When the dependent conditions or states are met, one or more operations executed can be in real time or with a set delay. Unless otherwise specified, there is no restriction on the order of execution of the multiple operations executed.

[0048] Figure 1 is a schematic diagram of a scenario that can be used to implement the information delivery method provided by an embodiment of the present disclosure. As shown in Figure 1, system 100 may include multiple user terminals 110, a network 120, a server 130, and a database 140. For example, system 100 can be used to implement the information delivery method described in any embodiment of the present disclosure.

[0049] It will be understood that the user terminal 110 may be any other type of electronic device capable of performing data processing, which may include but is not limited to: a mobile phone, a station, a unit, a device, a multimedia computer, a multimedia tablet, an Internet node, a communicator, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device or any combination thereof, including accessories and peripherals of these devices or any combination thereof.

[0050] The user can operate through the application installed on the user terminal 110, and the application transmits the user behavior data to the server 130 via the network 120. The user terminal 110 can also receive the data transmitted by the server 130 via the network 120. The embodiments of the present disclosure have no restrictions on the hardware system and software system of the user terminal 110. For example, the user terminal 110 can be based on a processor such as ARM or X86, can have input / output devices such as a camera, a touch screen, and a microphone, and can run an operating system such as Windows, iOS, Linux, Android, or Hongmeng OS.

[0051] The user terminal 110 can implement the information delivery method provided by the embodiments of the present disclosure by running a process or thread. In some examples, the user terminal 110 can use its built-in application to execute the information delivery method. In other examples, the user terminal 110 can execute the information delivery method by calling an application stored externally to the user terminal 110.

[0052] The network 120 may be a single network or a combination of at least two different networks. For example, the network 120 may include, but is not limited to, a local area network, a wide area network, a public network, a private network, or a combination of several thereof. The network 120 may be a computer network such as the Internet and / or various telecommunication networks (e.g., 3G / 4G / 5G mobile communication networks, Wi-Fi, Bluetooth, ZigBee, etc.), and the embodiments of the present disclosure are not limited thereto.

[0053] The server 130 can be a single server, a server group, or a cloud server, wherein the servers within the server group are connected via a wired or wireless network. A server group can be centralized, such as a data center, or distributed. The server 130 can be local or remote. The server 130 can communicate with the user terminal 110 via a wired or wireless network. The embodiments of the present disclosure do not limit the hardware system and software system of the server 130.

[0054] The database 140 can generally refer to a device with a storage function. The database 140 is mainly used to store various data used, generated and output by the user terminal 110 and the server 130 during work. The database 140 can be local or remote. The database 140 can include various memories, such as random access memory (RAM), read-only memory (ROM), etc. The storage devices mentioned above are just some examples, and the storage devices that can be used by the system 100 are not limited to these. The embodiments of the present disclosure do not limit the hardware system and software system of the database 140. For example, it can be a relational database or a non-relational database.

[0055] The database 140 may be connected or communicated with the server 130 or a portion thereof via the network 120 , or directly connected or communicated with the server 130 , or a combination of the two.

[0056] In some examples, database 140 may be a standalone device. In other examples, database 140 may be integrated into at least one of user terminal 110 and server 130. For example, database 140 may be located on user terminal 110 or on server 130. In another example, database 140 may be distributed, with a portion located on user terminal 110 and another portion located on server 130.

[0057] The panoramic video generation method proposed in the embodiment of the present application will be described in detail below with reference to the accompanying drawings.

[0058] Figure 2 is a flowchart of a panoramic video generation method in an embodiment of the present disclosure. This embodiment is applicable to the case of generating panoramic interactive videos. The method can be executed by a panoramic video generation device, which can be implemented in software and / or hardware. The panoramic video generation method can be implemented in the electronic device described in Figure 1.

[0059] As shown in FIG2 , the panoramic video generation method provided by the embodiment of the present disclosure mainly includes steps S110 - S140 .

[0060] S110: Acquire original panoramic multimedia material.

[0061] In the embodiments of the present disclosure, the original panoramic multimedia material can be understood as the multimedia material included in the original panoramic video. For example, the original panoramic multimedia material can include one or more combinations of video material, audio material, image material (stickers, picture-in-picture, special effects), etc. In the embodiments of the present disclosure, the original panoramic multimedia material is an example of a panoramic video material.

[0062] In one embodiment of the present disclosure, the original panoramic multimedia material can be a panoramic video shot by a panoramic video creator, or a virtual panoramic video created by a panoramic video creator through a video creation platform. In the embodiment of the present disclosure, the production method of the original panoramic multimedia material is not limited.

[0063] S120. Present the first material track segment on a video editing interface. The video editing interface presents a video editing track, and the video editing track presents the first material track segment. The first material track segment is formed based on the original panoramic multimedia material.

[0064] In one embodiment of the present disclosure, the acquired original panoramic multimedia material is brought into a video editor, so that a first material track segment corresponding to the original panoramic multimedia material can be presented in a video editing interface of the video editor.

[0065] In one embodiment of the present disclosure, as shown in FIG3 , the video editing interface 30 includes a video screen display area 31 and a video track segment display area 32. The video screen display area 31 is used to display the panoramic video screen corresponding to the original panoramic multimedia material. The video track segment display area 32 includes a first material track segment 33. The panoramic video screen displayed in the video screen display area 31 corresponds to the timeline where the first material track segment 33 is located. That is, when a user clicks the 3rd second in the first material track segment 33, the video screen corresponding to the 3rd second of the panoramic multimedia material is displayed in the video screen display area 31.

[0066] S130. In response to an editing instruction for setting an interactive event for the first video track segment in the video editing interface, a track segment corresponding to the interactive event is presented in the video editing interface, wherein the editing instruction is used to indicate the interactive material, timeline position and at least one branch material of the interactive event, the interactive material is used to indicate at least one branch option operation of the interactive event, different branch option operations in the at least one branch option operation are respectively used to trigger different branch materials in the at least one branch material to be presented, the track segment corresponding to the interactive event includes a second material track segment and at least one third material track segment, the second material track segment is located at the timeline position, the second material track segment is formed based on the interactive material, and the at least one third material track segment is respectively formed based on the at least one branch material.

[0067] In an embodiment of the present disclosure, track segments corresponding to multiple interactive events can be added in the video editing interface. As shown in FIG3 , track segments corresponding to two interactive events can be added in the video editing interface, wherein each interactive event corresponds to one track segment. In the embodiment of the present disclosure, adding two interactive events is used as an example for explanation. That is, as shown in FIG3 , including a second material track segment 34 and a second material track segment 35, the gray portion in the second material track segment 34 and the second material track segment 35 indicates that the timeline position of the second material track segment displays its corresponding interactive material, and the white portion indicates that the second material track segment 34 and the second material track segment 35 are empty segments.

[0068] In an embodiment of the present disclosure, when the interaction event is a voice interaction event, the interaction material is used to indicate the voice information that the user needs to input.

[0069] For example, the gray portion of the second material track segment 34 represents the material track segment corresponding to the interactive material. When the panoramic video corresponding to the original panoramic multimedia material plays to the start of the timeline, the interactive material is displayed within the panoramic video. This interactive material prompts the user for voice input. When the panoramic video corresponding to the original panoramic multimedia material plays to the end of the timeline, the interactive material disappears from the panoramic video and is no longer displayed.

[0070] In an embodiment of the present disclosure, when the interaction event is a touch interaction event, the interaction material is used to indicate an area that the user needs to touch.

[0071] Take the gray part of the second material track segment 34 as the material track segment corresponding to the interactive material, and the gray part of the second material track segment 35 as the material track segment corresponding to the interactive material as an example for explanation. As shown in Figure 3, during this editing process, the editing instructions of the interactive event are set, that is, there are two second material track segments. And the timeline positions corresponding to the two second material track segments are the same. When the panoramic video corresponding to the original panoramic multimedia material is played to the starting position of the timeline, two interactive materials are displayed in the panoramic video screen. The two interactive materials are used to prompt the user to touch the two areas. The user can select one of the two interactive materials to trigger, so that the panoramic video can challenge the branch material associated with the touched interactive material to play. When the panoramic video corresponding to the original panoramic multimedia material is played to the end position of the timeline, the interactive material disappears in the panoramic video screen, the interactive material is no longer displayed, and it will not jump to the panoramic video corresponding to the branch material.

[0072] In the disclosed embodiment, the video creator can freely set the touchable area indicated by the interactive material.

[0073] It should be noted that, in the embodiments of the present disclosure, touch is used as an example for explanation. The setting method of the press interaction event is the same as the setting method of the touch interaction event, and will not be repeated in the embodiments of the present disclosure.

[0074] When the interaction event is a gesture tracking interaction event, the interaction material is used to indicate the action gesture that the user needs to perform. Specifically, when the interaction event is a gesture tracking interaction event, the interaction material can be position information in 6 degrees of freedom or 3 degrees of freedom. Furthermore, when the interaction event is a gesture tracking interaction event, the rotation angle and movement distance on each axis are used. The specific setting method is the same as the setting method of the above-mentioned interaction event and will not be repeated in the embodiments of this disclosure.

[0075] In one embodiment of the present disclosure, in response to an editing instruction for setting an interactive event for the first video track segment in the video editing interface, presenting a track segment corresponding to the interactive event in the video editing interface includes: in response to triggering an interactive event adding instruction for the first video track segment in the video editing interface, adding a second material track segment corresponding to the interactive material in the interactive event in the video editing interface; in response to a time selection operation for the second material track segment in the video editing interface, obtaining a timeline position corresponding to the time selection operation as the timeline position corresponding to the second material track segment.

[0076] In an embodiment of the present disclosure, an interaction event adding control is displayed in the video editing interface. In response to the interaction event adding control, interaction materials that can be added (voice interaction events, touch interaction events, press interaction events, gesture tracking interaction events) are acquired and displayed. In response to the selection operation of the interaction material, a second material track segment corresponding to the interaction material is added in the video editing interface.

[0077] Furthermore, in response to the video creation user's time selection operation on the second material track segment, the timeline position corresponding to the selected interactive material is determined.

[0078] In one embodiment of the present disclosure, in response to an editing instruction for setting an interactive event for the first video track segment in the video editing interface, presenting the track segment corresponding to the interactive event in the video editing interface includes: in response to a branch material selection operation for the second material track segment in the video editing interface, obtaining the branch material corresponding to the branch material selection operation, and creating a third material track segment corresponding to the branch material; establishing an association relationship between the branch material and the interactive material, so that the interactive material indicates that a branch option operation is set to trigger the presentation of the branch material corresponding to the third material track segment.

[0079] In one embodiment of the present disclosure, the interactive material is used to indicate at least one branch option operation of the interactive event, and different branch option operations in the at least one branch option operation are respectively used to trigger different branch materials in the at least one branch material to be presented, and the track segment corresponding to the interactive event includes at least one third material track segment, and the at least one third material track segment is respectively formed based on the at least one branch material.

[0080] In one embodiment of the present disclosure, the third material track segment formed by the branch material can also be edited with an interactive event similar to the first video track segment, so that the branch material can also be set as a branch material to increase the fun of the interactive radio.

[0081] 140. Generate a target panoramic video based on the track segments on the video editing track in the video editing interface.

[0082] In one embodiment of the present disclosure, generating a target panoramic video based on the track segment on the video editing track in the video editing interface includes: in response to triggering an operation to generate the target panoramic video in the video editing interface, generating a target interactive video based on the track segment on the video editing track in the video editing interface.

[0083] In an embodiment of the present disclosure, the video editing interface includes a video generation control. In response to a triggering operation on the video generation control, a target interactive video is generated based on track segments on the video editing track in the video editing interface. Furthermore, the target panoramic video can be saved locally for personal consumption or published on a video platform for other users to consume.

[0084] FIG4 is a flowchart of a panoramic video playback method according to an embodiment of the present disclosure. This embodiment is applicable to panoramic interactive video consumption. The method can be executed by a panoramic video playback device. The panoramic video generation device can be implemented in software and / or hardware. The panoramic video playback method can be implemented in the electronic device described in FIG1. ​​The electronic device can also be any one or more of an AR device, a VR device, or an XR device.

[0085] As shown in FIG4 , the panoramic video playback method provided in the embodiment of the present disclosure mainly includes steps S210 - S230 .

[0086] S210. Play the panoramic video screen corresponding to the target panoramic video, wherein the interactive material, timeline position and at least one branch material of the interactive event, the interactive material is used to indicate at least one branch option operation of the interactive event, different branch option operations in the at least one branch option operation are respectively used to trigger different branch materials in the at least one branch material to be presented, the track segment corresponding to the interactive event includes a second material track segment and at least one third material track segment, the second material track segment is located at the timeline position, the second material track segment is formed based on the interactive material, and the at least one third material track segment is respectively formed based on the at least one branch material.

[0087] In the embodiments of the present disclosure, the target panoramic video refers to the target panoramic video obtained using the panoramic video generation method described in the above embodiments. Furthermore, the target panoramic video can be a locally acquired target panoramic video or a panoramic video downloaded from a video platform. In the embodiments of the present disclosure, the method for acquiring the panoramic video is not specifically limited.

[0088] In the embodiment of the present disclosure, before playing the panoramic video screen corresponding to the target panoramic video, it also includes: obtaining a description file, and parsing the description file to obtain the original panoramic multimedia material and the interactive event corresponding to the original panoramic multimedia material.

[0089] In the embodiment of the present disclosure, a video consuming user obtains a description file and parses the description file to obtain original panoramic multimedia materials and interactive events corresponding to the original panoramic multimedia materials.

[0090] S220: In response to the target panoramic video being played to the timeline position, displaying the interactive material included in the interactive event in the panoramic video screen.

[0091] In an embodiment of the present disclosure, in response to a video consumption user's playback operation on the panoramic video, the panoramic video is played. When the panoramic video is played to the timeline position, the interactive material included in the interactive event is displayed in the panoramic video screen. The interactive material is used to indicate at least one branch option operation of the interactive event, and different branch option operations in the at least one branch option operation are respectively used to trigger the presentation of different branch materials in the at least one branch material.

[0092] In the embodiment of the present disclosure, the interactive event is a voice interactive event as an example for explanation. In response to the panoramic video being played to the starting position of the timeline corresponding to the interactive material, the interactive material is superimposed and displayed on the video screen. The interactive material is used to indicate at least one branch option operation of the interactive event. For example: the interactive material can be a text box that prompts the user to input voice information, and the interactive material can also be a voice playback that prompts the user to input voice information. The interactive material can also be displayed in the form of special effects or picture-in-picture. Furthermore, the interactive material can be one or more. The number of interactive materials is no longer specified in the embodiment of the present disclosure.

[0093] S230: In response to a triggering operation on the interactive material, display a video screen corresponding to a branch material associated with the interactive material and included in the interactive event.

[0094] In an embodiment of the present disclosure, when the interaction event is a voice interaction event, responding to a trigger operation on the interaction material includes: extracting semantic feature information from the acquired voice information; calculating the matching degree between the semantic feature information of the voice information and the preset semantic feature information corresponding to the interaction material based on the semantic feature information of the voice information and the preset semantic feature information; and receiving a trigger operation on the interaction material when the matching degree is greater than a matching degree threshold.

[0095] In an embodiment of the present disclosure, after a video consumption user inputs voice information according to the instructions of the interactive material, semantic feature information is extracted from the acquired voice information; based on the semantic feature information of the voice information and the preset semantic feature information corresponding to the interactive material, the matching degree between the semantic feature information of the voice information and the preset semantic feature information is calculated; and when the matching degree is greater than a matching degree threshold, a trigger operation for the interactive material is received.

[0096] For example: there are two interactive materials, each corresponding to different preset semantic feature information. The preset semantic feature information corresponding to interactive material 1 is one step forward, and the preset semantic feature information corresponding to interactive material 1 is one step back. If the degree of match between the semantic feature information extracted from the acquired voice information and the preset semantic feature information corresponding to interactive material 1 is greater than the matching threshold, the panoramic video picture corresponding to the branch material associated with the interactive material 1 is played. If the degree of match between the semantic feature information extracted from the acquired voice information and the preset semantic feature information corresponding to interactive material 2 is greater than the matching threshold, the panoramic video picture corresponding to the branch material associated with the interactive material 2 is played.

[0097] In one embodiment of the present disclosure, when the interactive event is a gesture tracking interactive event, in response to a triggering operation on the interactive material, a video screen corresponding to the branch material associated with the interactive material included in the interactive event is displayed, including: identifying the action gesture performed by the user; when the identified current action gesture is a preset action gesture, displaying a panoramic video screen associated with the interactive control corresponding to the preset action gesture.

[0098] In an embodiment of the present disclosure, after a video consuming user makes a specified action gesture according to the instructions of the interactive material, the action gesture performed by the user is identified; when the current action gesture identified is a preset action gesture, a panoramic video screen associated with the interactive control corresponding to the preset action gesture is displayed.

[0099] For example, the interactive material instructs the user to perform a waving action. If the waving action performed by the user is recognized, the panoramic video corresponding to the branch material corresponding to the waving action is played.

[0100] In one embodiment of the present disclosure, when the interaction event is a touch interaction event, in response to an operation on the interaction control, a panoramic video screen associated with the interaction control is displayed, including: in response to a touch operation on the area that the interaction material indicates the user needs to touch, a trigger operation on the interaction material is received.

[0101] In the embodiment of the present disclosure, after the video consuming user triggers the required touch area according to the instruction of the interactive material, the branch material associated with the touch area is determined, and the panoramic video corresponding to the branch material is played.

[0102] As shown in Figure 5, the interactive material is displayed as two hand-shaped icons to indicate that the video consumer can touch or press the area. For example, the two hand-shaped icons correspond to different branch materials. If the left hand-shaped icon is touched, the panoramic video corresponding to the branch material associated with the interactive material 1 is played. If the right hand-shaped icon is touched, the panoramic video corresponding to the branch material associated with the interactive material 2 is played.

[0103] In the embodiment of the present disclosure, if the video consuming user does not perform any interactive operation within the time range of the interactive material display, the panoramic video corresponding to any branch material will not be played, and only the panoramic video corresponding to the original panoramic multimedia material will be played.

[0104] In an embodiment of the present disclosure, by responding to a user's triggering operation on interactive materials during the playback of a target panoramic video, jumping to a branch video corresponding to the triggering operation, the interactivity between the user and the video is improved.

[0105] The panoramic video generation device provided in the embodiment of the present disclosure can execute the steps executed in the panoramic video generation method provided in the embodiment of the method of the present disclosure, and the execution steps and beneficial effects are not repeated here.

[0106] Figure 6 is a structural diagram of a panoramic video generating device in an embodiment of the present disclosure. This embodiment is applicable to the case of generating panoramic interactive videos. The method can be executed by the panoramic video generating device, and the panoramic video generating device can be implemented in software and / or hardware. The panoramic video generating method can be implemented in the electronic device described in Figure 1.

[0107] As shown in FIG6 , the panoramic video generating device 60 provided by the embodiment of the present disclosure mainly includes: a panoramic multimedia material acquiring module 61 , a video editing interface display module 62 , an interactive event editing module 63 and a target panoramic video generating module 64 .

[0108] Among them, a panoramic multimedia material acquisition module 61 is used to acquire original panoramic multimedia material; a video editing interface display module 62 is used to present the first material track segment on the video editing interface; a video editing track is presented on the video editing interface, and the first material track segment is presented on the video editing track, and the first material track segment is formed based on the original panoramic multimedia material; an interactive event editing module 63 is used to respond to an editing instruction for setting an interactive event for the first video track segment in the video editing interface, and present the track segment corresponding to the interactive event in the video editing interface, wherein the editing instruction is used to indicate the interactive material, timeline position and at least one of the interactive event. Branch material, the interactive material is used to indicate at least one branch option operation of the interactive event, different branch option operations in the at least one branch option operation are respectively used to trigger different branch materials in the at least one branch material to be presented, the track segment corresponding to the interactive event includes a second material track segment and at least one third material track segment, the second material track segment is located at the timeline position, the second material track segment is formed based on the interactive material, and the at least one third material track segment is respectively formed based on the at least one branch material; a target panoramic video generation module 64 is used to generate a target panoramic video based on the track segment on the video editing track in the video editing interface.

[0109] In one embodiment of the present disclosure, the interactive event editing module 63 is specifically used to respond to triggering an interactive event adding instruction for the first video track segment in the video editing interface, add a second material track segment corresponding to the interactive material in the interactive event in the video editing interface; and respond to a time selection operation for the second material track segment in the video editing interface, obtain the timeline position corresponding to the time selection operation as the timeline position corresponding to the second material track segment.

[0110] In one embodiment of the present disclosure, the interactive event editing module 63 is specifically used to respond to the branch material selection operation for the second material track segment in the video editing interface, obtain the branch material corresponding to the branch material selection operation, and create a third material track segment corresponding to the branch material; establish an association relationship between the branch material and the interactive material, so that the interactive material indicates that a branch option operation is set to trigger the presentation of the branch material corresponding to the third material track segment.

[0111] In one embodiment of the present disclosure, when the interaction event is a voice interaction event, the interaction material is used to indicate the voice information that the user needs to input.

[0112] In one embodiment of the present disclosure, when the interaction event is a touch interaction event, the interaction material is used to indicate an area that the user needs to touch.

[0113] In one embodiment of the present disclosure, when the interaction event is a gesture tracking interaction event, the interaction material is used to indicate the action gesture that the user needs to perform.

[0114] In one embodiment of the present disclosure, the target panoramic video generation module 64 is specifically used to generate the target panoramic video based on the track segment on the video editing track in the video editing interface in response to triggering the target panoramic video generation operation in the video editing interface.

[0115] The panoramic video generation device provided in the embodiment of the present disclosure can execute the steps executed in the panoramic video generation method provided in the embodiment of the method of the present disclosure, and the execution steps and beneficial effects are not repeated here.

[0116] Figure 7 is a schematic diagram of the structure of a panoramic video playback device in an embodiment of the present disclosure. This embodiment is applicable to the consumption of panoramic interactive videos. The method can be executed by the panoramic video playback device. The panoramic video generation device can be implemented in software and / or hardware. The panoramic video playback method can be implemented in the electronic device described in Figure 1. The electronic device can also be any one or more of an AR device, a VR device, or an XR device.

[0117] As shown in FIG7 , the panoramic video playback device provided in the embodiment of the present disclosure mainly includes a panoramic video screen playback module 71 , an interactive material display module 72 and a branch material screen display module 73 .

[0118] Among them, the panoramic video screen playback module 71 is used to play the panoramic video screen corresponding to the target panoramic video, wherein the interactive material, timeline position and at least one branch material of the interactive event, the interactive material is used to indicate at least one branch option operation of the interactive event, and different branch option operations in the at least one branch option operation are respectively used to trigger different branch materials in the at least one branch material to be presented, and the track segment corresponding to the interactive event includes a second material track segment and at least one third material track segment, the second material track segment is located at the timeline position, the second material track segment is formed based on the interactive material, and the at least one third material track segment is respectively formed based on the at least one branch material; the interactive material display module 72 is used to display the interactive material included in the interactive event in the panoramic video screen in response to the target panoramic video being played to the timeline position; the branch material screen display module 73 is used to display the video screen corresponding to the branch material associated with the interactive material included in the interactive event in response to the trigger operation for the interactive material.

[0119] In one embodiment of the present disclosure, the device also includes: a description file parsing module, which is used to obtain a description file before playing the panoramic video screen corresponding to the target panoramic video, and parse the description file to obtain the original panoramic multimedia material and the interactive events corresponding to the original panoramic multimedia material.

[0120] In one embodiment of the present disclosure, when the interaction event is a voice interaction event, responding to a trigger operation for the interaction material includes: extracting semantic feature information from the acquired voice information; calculating the matching degree between the semantic feature information of the voice information and the preset semantic feature information corresponding to the interaction material based on the semantic feature information of the voice information and the preset semantic feature information; and receiving a trigger operation for the interaction material when the matching degree is greater than a matching degree threshold.

[0121] In one embodiment of the present disclosure, when the interactive event is a gesture tracking interactive event, in response to the triggering operation on the interactive material, it includes: identifying the action gesture performed by the user; when the identified current action gesture is a preset action gesture, displaying the panoramic video screen associated with the interactive control corresponding to the preset action gesture.

[0122] In one embodiment of the present disclosure, when the interaction event is a touch interaction event, responding to the operation on the interaction control includes: responding to the touch operation on the area indicated by the interaction material that the user needs to touch, receiving a trigger operation on the interaction material.

[0123] The panoramic video playback device provided in the embodiment of the present disclosure can execute the steps executed in the panoramic video playback method provided in the embodiment of the method of the present disclosure, and the execution steps and beneficial effects are not repeated here.

[0124] Figure 8 is a schematic diagram of the structure of an electronic device in an embodiment of the present disclosure. Specific reference is made below to Figure 8, which shows a schematic diagram of the structure of an electronic device 800 suitable for implementing an embodiment of the present disclosure. The electronic device 800 in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), wearable terminal devices, and the like, as well as fixed terminals such as digital TVs, desktop computers, smart home devices, and the like. The electronic device shown in Figure 8 is merely an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.

[0125] As shown in Figure 8, the electronic device 800 may include a processing device (such as a central processing unit, a graphics processing unit, etc.) 801, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 802 or the program loaded from the storage device 808 into the random access memory (RAM) 803 to implement the picture rendering method of the embodiment as described in the present disclosure. In the RAM 803, various programs and data required for the operation of the terminal device 800 are also stored. The processing device 801, ROM 802 and RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0126] Typically, the following devices may be connected to the I / O interface 805: an input device 806 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 807 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 808 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 809. The communication device 809 may allow the terminal device 800 to communicate with other devices wirelessly or by wire to exchange data. Although FIG8 illustrates the terminal device 800 with various devices, it should be understood that not all of the illustrated devices are required to be implemented or present. More or fewer devices may alternatively be implemented or present.

[0127] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart, thereby implementing the panoramic video generation method as described above. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 809, or installed from the storage device 808, or installed from the ROM 802. When the computer program is executed by the processing device 801, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0128] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0129] In some embodiments, the client and server can communicate using any currently known or later developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or later developed network.

[0130] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0131] The computer-readable medium carries one or more programs. When the one or more programs are executed by the terminal device, the terminal device: obtains original panoramic multimedia material; presents the first material track segment on a video editing interface; the video editing interface presents a video editing track, and the video editing track presents the first material track segment, the first material track segment being formed based on the original panoramic multimedia material; in response to an editing instruction for setting an interactive event for the first video track segment in the video editing interface, presents a track segment corresponding to the interactive event in the video editing interface, wherein the editing instruction is used to indicate the interactive material, timeline position and at least one branch material of the interactive event, the interactive material is used to indicate at least one branch option operation of the interactive event, different branch option operations in the at least one branch option operation are respectively used to trigger the presentation of different branch materials in the at least one branch material, the track segment corresponding to the interactive event includes a second material track segment and at least one third material track segment, the second material track segment is located at the timeline position, the second material track segment is formed based on the interactive material, and the at least one third material track segment is respectively formed based on the at least one branch material; and based on the track segments on the video editing track in the video editing interface, a target panoramic video is generated.

[0132] Optionally, when the above one or more programs are executed by the terminal device, the terminal device may also execute other steps described in the above embodiment.

[0133] The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the terminal device, the terminal device: plays the panoramic video screen corresponding to the target panoramic video, wherein the interactive material, timeline position and at least one branch material of the interactive event, the interactive material is used to indicate at least one branch option operation of the interactive event, and different branch option operations in the at least one branch option operation are respectively used to trigger different branch materials in the at least one branch material to be presented, and the track segment corresponding to the interactive event includes a second material track segment and at least one third material track segment, the second material track segment is located at the timeline position, the second material track segment is formed based on the interactive material, and the at least one third material track segment is respectively formed based on the at least one branch material; in response to the target panoramic video being played to the timeline position, the interactive material included in the interactive event is displayed in the panoramic video screen; in response to the trigger operation for the interactive material, the video screen corresponding to the branch material associated with the interactive material included in the interactive event is displayed.

[0134] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0135] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0136] The units involved in the embodiments described in this disclosure may be implemented in software or hardware, wherein the name of a unit does not necessarily limit the unit itself.

[0137] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0138] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0139] According to one or more embodiments of the present disclosure, an embodiment of the present disclosure provides a panoramic video generation method, including: obtaining original panoramic multimedia material; presenting a first material track segment on a video editing interface; a video editing track is presented on the video editing interface, and the first material track segment is presented on the video editing track, wherein the first material track segment is formed based on the original panoramic multimedia material; in response to an editing instruction for setting an interactive event for the first video track segment in the video editing interface, presenting a track segment corresponding to the interactive event in the video editing interface, wherein the editing instruction is used to indicate the interactive material, timeline position and at least one branch material of the interactive event, the interactive material is used to indicate at least one branch option operation of the interactive event, different branch option operations in the at least one branch option operation are respectively used to trigger the presentation of different branch materials in the at least one branch material, and the track segment corresponding to the interactive event includes a second material track segment and at least one third material track segment, the second material track segment is located at the timeline position, the second material track segment is formed based on the interactive material, and the at least one third material track segment is respectively formed based on the at least one branch material; based on the track segments on the video editing track in the video editing interface, generating a target panoramic video.

[0140] According to one or more embodiments of the present disclosure, an embodiment of the present disclosure provides a panoramic video playback method, wherein the panoramic video includes an original panoramic multimedia material and an interactive event corresponding to the original panoramic multimedia material, including: playing a panoramic video screen corresponding to a target panoramic video, wherein the interactive material, timeline position and at least one branch material of the interactive event, the interactive material is used to indicate at least one branch option operation of the interactive event, and different branch option operations in the at least one branch option operation are respectively used to trigger different branch materials in the at least one branch material to be presented, and the track segment corresponding to the interactive event includes a second material track segment and at least one third material track segment, the second material track segment is located at the timeline position, the second material track segment is formed based on the interactive material, and the at least one third material track segment is respectively formed based on the at least one branch material; in response to the target panoramic video being played to the timeline position, the interactive material included in the interactive event is displayed in the panoramic video screen; in response to the trigger operation for the interactive material, the video screen corresponding to the branch material associated with the interactive material included in the interactive event is displayed.

[0141] According to one or more embodiments of the present disclosure, the embodiments of the present disclosure provide a panoramic video generation device, including: a panoramic multimedia material acquisition module for acquiring original panoramic multimedia material; a video editing interface display module for presenting the first material track segment on the video editing interface; a video editing track is presented on the video editing interface, and the first material track segment is presented on the video editing track, and the first material track segment is formed based on the original panoramic multimedia material; an interactive event editing module for responding to an editing instruction for setting an interactive event for the first video track segment in the video editing interface, and presenting a track segment corresponding to the interactive event in the video editing interface, wherein the editing instruction is used to indicate the interactive event. Interactive material, a timeline position and at least one branch material, the interactive material is used to indicate at least one branch option operation of the interactive event, different branch option operations in the at least one branch option operation are respectively used to trigger different branch materials in the at least one branch material to be presented, the track segment corresponding to the interactive event includes a second material track segment and at least one third material track segment, the second material track segment is located at the timeline position, the second material track segment is formed based on the interactive material, and the at least one third material track segment is respectively formed based on the at least one branch material; a target panoramic video generation module is used to generate a target panoramic video based on the track segment on the video editing track in the video editing interface.

[0142] According to one or more embodiments of the present disclosure, an embodiment of the present disclosure provides a panoramic video playback device, wherein the panoramic video includes original panoramic multimedia material and an interactive event corresponding to the original panoramic multimedia material, including: a panoramic video screen playback module, used to play the panoramic video screen corresponding to a target panoramic video, wherein the interactive material, timeline position and at least one branch material of the interactive event, the interactive material is used to indicate at least one branch option operation of the interactive event, different branch option operations in the at least one branch option operation are respectively used to trigger different branch materials in the at least one branch material to be presented, the track segment corresponding to the interactive event includes a second material track segment and at least one third material track segment, the second material track segment is located at the timeline position, the second material track segment is formed based on the interactive material, and the at least one third material track segment is respectively formed based on the at least one branch material; an interactive material display module, used to display the interactive material included in the interactive event in the panoramic video screen in response to the target panoramic video being played to the timeline position; and a branch material screen display module, used to display the video screen corresponding to the branch material associated with the interactive material included in the interactive event in response to the trigger operation on the interactive material.

[0143] According to one or more embodiments of the present disclosure, an electronic device is provided, including:

[0144] one or more processors;

[0145] a storage device for storing one or more programs;

[0146] When the one or more programs are executed by the one or more processors, the one or more processors implement the panoramic video generation method as described in any one of the above items or the panoramic video playback method as described in any one of the above items.

[0147] According to one or more embodiments of the present disclosure, an embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the panoramic video generation method as described in any one of the above items or the panoramic video playback method as described in any one of the above items.

[0148] According to one or more embodiments of the present disclosure, an embodiment of the present disclosure provides a computer program product, which includes a computer program or instructions, and when the computer program or instructions are executed by a processor, it implements the panoramic video generation method as described in any one of the above or the panoramic video playback method as described in any one of the above.

[0149] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0150] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0151] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A panoramic video generation method, comprising: Acquire original panoramic multimedia materials; Presenting the first material track segment on a video editing interface; A video editing track is presented on the video editing interface, and the first material track segment is presented on the video editing track, where the first material track segment is formed based on the original panoramic multimedia material; In response to an editing instruction for setting an interactive event for the first video track segment in the video editing interface, presenting a track segment corresponding to the interactive event in the video editing interface, wherein the editing instruction is used to indicate the interactive material, the timeline position and at least one branch material of the interactive event, the interactive material is used to indicate at least one branch option operation of the interactive event, different branch option operations in the at least one branch option operation are respectively used to trigger different branch materials in the at least one branch material to be presented, the track segment corresponding to the interactive event includes a second material track segment and at least one third material track segment, the second material track segment is located at the timeline position, the second material track segment is formed based on the interactive material, and the at least one third material track segment is respectively formed based on the at least one branch material; A target panoramic video is generated based on the track segments on the video editing track in the video editing interface.

2. The method according to claim 1, wherein: In response to an editing instruction for setting an interactive event for the first video track segment in the video editing interface, presenting the track segment corresponding to the interactive event in the video editing interface includes: In response to triggering an interaction event adding instruction for the first video track segment in the video editing interface, adding a second material track segment corresponding to the interaction material in the interaction event in the video editing interface; In response to a time selection operation on the second material track segment in the video editing interface, a timeline position corresponding to the time selection operation is obtained as a timeline position corresponding to the second material track segment.

3. The method according to claim 2, wherein: In response to an editing instruction for setting an interactive event for the first video track segment in the video editing interface, presenting the track segment corresponding to the interactive event in the video editing interface includes: In response to a branch material selection operation on the second material track segment in the video editing interface, obtaining a branch material corresponding to the branch material selection operation, and creating a third material track segment corresponding to the branch material; An association relationship is established between the branch material and the interactive material, so that the interactive material indicates that a branch option operation is set to trigger presentation of the branch material corresponding to the third material track segment.

4. The method according to claim 1, wherein: When the interaction event is a voice interaction event, the interaction material is used to indicate the voice information that the user needs to input.

5. The method according to claim 1, wherein: When the interaction event is a touch interaction event, the interaction material is used to indicate an area that the user needs to touch.

6. The method according to claim 1, wherein: When the interaction event is a gesture tracking interaction event, the interaction material is used to indicate the action gesture that the user needs to perform.

7. The method according to claim 1, wherein: Generating a target panoramic video based on the track segments on the video editing track in the video editing interface includes: In response to triggering an operation of generating the target panoramic video in the video editing interface, the target panoramic video is generated based on track segments on the video editing track in the video editing interface.

8. A method for playing a panoramic video, wherein the panoramic video includes an original panoramic multimedia material and an interactive event corresponding to the original panoramic multimedia material, comprising: Playing a panoramic video screen corresponding to a target panoramic video, wherein the interactive material, the timeline position and at least one branch material of the interactive event, the interactive material is used to indicate at least one branch option operation of the interactive event, different branch option operations in the at least one branch option operation are respectively used to trigger different branch materials in the at least one branch material to be presented, and the track segment corresponding to the interactive event includes a second material track segment and at least one third material track segment, the second material track segment is located at the timeline position, the second material track segment is formed based on the interactive material, and the at least one third material track segment is respectively formed based on the at least one branch material; In response to the target panoramic video being played to the timeline position, displaying the interactive material included in the interactive event in the panoramic video screen; In response to a triggering operation on the interaction material, a video screen corresponding to a branch material associated with the interaction material and included in the interaction event is displayed.

9. The method according to claim 8, wherein: Before playing the panoramic video screen corresponding to the target panoramic video, the following steps are also included: A description file is obtained and parsed to obtain original panoramic multimedia material and interactive events corresponding to the original panoramic multimedia material.

10. The method according to claim 8, wherein: When the interaction event is a voice interaction event, in response to a triggering operation on the interaction material, the method includes: Extracting semantic feature information from the acquired voice information; Based on the semantic feature information of the voice information and the preset semantic feature information corresponding to the interactive material, calculating the matching degree between the semantic feature information of the voice information and the preset semantic feature information; When the matching degree is greater than a matching degree threshold, a trigger operation for the interactive material is received.

11. The method according to claim 8, wherein: When the interaction event is a gesture tracking interaction event, in response to a triggering operation on the interaction material, the method includes: Recognize the action gestures performed by the user; When the recognized current action posture is a preset action posture, a trigger operation for the interactive material is received.

12. The method according to claim 8, wherein: When the interaction event is a touch interaction event, in response to an operation on the interaction control, displaying a panoramic video screen associated with the interaction control includes: In response to a touch operation on an area that the interaction material indicates a user needs to touch, a trigger operation on the interaction material is received.

13. A panoramic video generation device, comprising: A panoramic multimedia material acquisition module is used to acquire original panoramic multimedia materials; A video editing interface display module, used for presenting the first material track segment on the video editing interface; A video editing track is presented on the video editing interface, and the first material track segment is presented on the video editing track, where the first material track segment is formed based on the original panoramic multimedia material; an interactive event editing module, for presenting in the video editing interface a track segment corresponding to the interactive event in response to an editing instruction for setting an interactive event for the first video track segment in the video editing interface, wherein the editing instruction is used to indicate the interactive material, timeline position and at least one branch material of the interactive event, the interactive material is used to indicate at least one branch option operation of the interactive event, different branch option operations in the at least one branch option operation are respectively used to trigger presentation of different branch materials in the at least one branch material, the track segment corresponding to the interactive event includes a second material track segment and at least one third material track segment, the second material track segment is located at the timeline position, the second material track segment is formed based on the interactive material, and the at least one third material track segment is respectively formed based on the at least one branch material; The target panoramic video generation module is used to generate a target panoramic video based on the track segments on the video editing track in the video editing interface.

14. A panoramic video playback device, the panoramic video comprising original panoramic multimedia material and interactive events corresponding to the original panoramic multimedia material, comprising: A panoramic video screen playback module, used for playing a panoramic video screen corresponding to a target panoramic video, wherein the interactive material, a timeline position and at least one branch material of the interactive event, the interactive material is used to indicate at least one branch option operation of the interactive event, different branch option operations in the at least one branch option operation are respectively used to trigger different branch materials in the at least one branch material to be presented, and the track segment corresponding to the interactive event includes a second material track segment and at least one third material track segment, the second material track segment is located at the timeline position, the second material track segment is formed based on the interactive material, and the at least one third material track segment is respectively formed based on the at least one branch material; An interactive material display module, configured to display the interactive material included in the interactive event in the panoramic video screen in response to the target panoramic video being played to the timeline position; The branch material screen display module is used to display the video screen corresponding to the branch material associated with the interactive material included in the interactive event in response to the trigger operation on the interactive material.

15. An electronic device, comprising: one or more processors; A storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 12.

16. A computer-readable storage medium having a computer program stored thereon, wherein when the program is executed by a processor, the method according to any one of claims 1 to 12 is implemented.

17. A computer program product, comprising a computer program or instructions, which implement the method according to any one of claims 1 to 12 when executed by a processor.

Images