Interactive information display methods, media content generation methods, devices, electronic equipment, storage media, and program products

Abstract

Embodiments of this disclosure provide a method for displaying interactive information, a method for generating media content, an apparatus, an electronic device, a storage medium, and a program product. The method for displaying interactive information includes receiving a first display operation for media content, displaying a media content screen of the media content in response to the first display operation, displaying relevant interactive information on at least a portion of the media content screen, displaying relevant screen elements of the relevant interactive information on the media content screen, displaying the relevant interactive information at a relevant display position of the relevant screen element corresponding to the relevant interactive information, and setting the relevant screen element by the publisher of the relevant interactive information. Embodiments of this disclosure can diversify the method of displaying interactive information by using the above technical solution.

Description

Technical Field

[0001] This application claims the priority of Chinese Patent Application No. 202410162145.5 filed on February 4, 2024, and the entire content disclosed in the above Chinese patent application is incorporated herein by reference as part of this application.

[0002] Embodiments of the present disclosure relate to a method for displaying interactive information, a method for generating media content, an apparatus, an electronic device, a storage medium, and a program product.

Background Art

[0003] Currently, when displaying media content, interactive information of the media content can be displayed. For example, barrage information of the media content can be displayed. However, the display method of interactive information is relatively single.

Summary of the Invention

Problems to be Solved by the Invention

[0004] Embodiments of the present disclosure provide a method for displaying interactive information, a method for generating media content, an apparatus, an electronic device, a storage medium, and a program product, thereby diversifying the display method of interactive information.

Means for Solving the Problems

[0005] In a first aspect, embodiments of the present disclosure provide a method for displaying interactive information applied to a first application program, the method comprising: receiving a first display operation on media content; The following are included in response to the first display operation: displaying the media content screen of the media content and displaying at least a portion of the related interactive information on the media content screen; displaying the related screen elements of the related interactive information on the media content screen; displaying the related interactive information at the related display position of the related screen elements corresponding to the related interactive information; and setting the related screen elements by the publisher of the related interactive information.

[0006] In a second aspect, embodiments of the present disclosure further provide a method for generating media content to be applied to a second application program, the method being: In response to a material display operation, a material interface is displayed, at least one candidate material is displayed on the material interface, and the candidate material is filmed from a single viewpoint. The system includes displaying media content generation and presentation information in response to a confirmation operation acting on the material interface, wherein the media content is a panoramic video generated based on original material, the media content supports displaying the interactive information at the relevant display position of the relevant screen element corresponding to the interactive information, the original material is a candidate material confirmed by the confirmation operation, and the generation and presentation information is used to indicate that the generation of the media content is complete.

[0007] In a third aspect, embodiments of the present disclosure further provide an interactive information display device that is deployed in a first application program, the device is An operation receiving module for receiving a first display operation on media content, The system includes a first information display module used to display the media content screen of the media content and display at least a portion of related interactive information of the media content screen in response to the first display operation, wherein related screen elements of the related interactive information are displayed on the media content screen, the related interactive information is displayed at the related display position of the related screen element corresponding to the related interactive information, and the related screen element is set by the publisher of the related interactive information.

[0008] In a fourth aspect, embodiments of the present disclosure further provide a media content generation device to be deployed in a second application program, the device being: A material display module used to display a material interface in response to a material display operation, wherein at least one candidate material is displayed in the material interface, and the candidate material is shot from a single viewpoint; The system comprises a presentation module used to display media content generation presentation information in response to a confirmation operation acting on the material interface, wherein the media content is a panoramic video generated based on original material, and the media content supports displaying the interactive information at the relevant display position of the relevant screen element corresponding to the interactive information, the original material is a candidate material confirmed by the confirmation operation, and the generation presentation information is used to indicate that the generation of the media content is complete.

[0009] In a fifth aspect, embodiments of the present disclosure further provide electronic devices, which include, One or more processors, It comprises memory for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors are made to implement the interactive information display method or media content generation method described in the embodiments of this disclosure.

[0010] In a sixth aspect, embodiments of the present disclosure further provide a computer-readable storage medium in which a computer program is stored and which, when executed by a processor, enables a method for displaying interactive information or generating media content as described in embodiments of the present disclosure.

[0011] In the seventh aspect, embodiments of the present disclosure further provide a computer program product that, when executed by a computer, causes the computer to implement the interactive information display method or media content generation method described in embodiments of the present disclosure.

[0012] The embodiments of this disclosure provide a method for displaying interactive information, a method for generating media content, an apparatus, an electronic device, a storage medium, and a program product.

[0013] The method for displaying the interactive information includes receiving a first display operation for media content, and in response to the first display operation, displaying the media content screen of the media content and displaying at least a portion of the relevant interactive information on the media content screen, displaying the relevant screen elements of the relevant interactive information on the media content screen, displaying the relevant interactive information at the relevant display position of the relevant screen elements corresponding to the relevant interactive information, and setting the relevant screen elements of the relevant interactive information by the publisher of the relevant interactive information.

[0014] The method for generating media content includes: displaying a material interface in response to a material display operation, displaying at least one candidate material on the material interface, and confirming that the candidate material was shot from a single viewpoint; displaying media content generation presentation information in response to a confirmation operation acting on the material interface, confirming that the media content is a panoramic video generated based on original material, that the media content supports displaying the interactive information at a relevant display position on a relevant screen element corresponding to the interactive information, that the original material is the candidate material confirmed by the confirmation operation, and that the generation presentation information is used to indicate that the generation of the media content is complete.

[0015] The above and other features, advantages and aspects of each embodiment of the present disclosure will become more apparent through the following specific embodiments with reference to the drawings. Throughout the drawings, similar or similar reference numerals indicate similar or similar elements. It should be understood that the drawings are schematic and not necessarily drawn to scale with respect to the actual objects and elements. [Brief explanation of the drawing]

[0016] [Figure 1] Figure 1 is a schematic flowchart of the method for displaying interactive information according to an embodiment of this disclosure. [Figure 2] Figure 2 is a schematic diagram illustrating the display of relevant interactive information according to an embodiment of this disclosure. [Figure 3] Figure 3 is a schematic flowchart of another interactive information display method according to an embodiment of the present disclosure. [Figure 4] Figure 4 is a schematic diagram showing detailed information relating to an embodiment of this disclosure. [Figure 5] Figure 5 is a schematic flowchart of a media content generation method according to an embodiment of the present disclosure. [Figure 6] Figure 6 is a schematic diagram of the media content generation process according to an embodiment of this disclosure. [Figure 7]FIG. 7 is a schematic diagram of the process of generating a panoramic photo according to an embodiment of the present disclosure. [Figure 8] FIG. 8 is a structural block diagram of an interactive information display device according to an embodiment of the present disclosure. [Figure 9] FIG. 9 is a structural block diagram of a media content generation device according to an embodiment of the present disclosure. [Figure 10] FIG. 10 is a structural schematic diagram of an electronic device according to an embodiment of the present disclosure.

DETAILED DESCRIPTION OF THE INVENTION

[0017] Hereinafter, embodiments of the present disclosure will be described in more detail with reference to the drawings. Although several embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be implemented in various forms and should not be construed as being limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are merely for illustrative purposes and not for limiting the protection scope of the present disclosure.

[0018] It should be understood that each step described in the method embodiments of the present disclosure may be executed in a different order and / or simultaneously. In addition, the method embodiments may include additional steps and / or steps shown with omission of execution. The scope of the present disclosure is not limited in this manner.

[0019] The term "comprising" and its variations used in this specification are open inclusion, that is, "including ○○, but not limited thereto". The term "based on" means "at least partially based on". The term "an embodiment" means "at least one embodiment", the term "another embodiment" means "at least one another embodiment", and the term "some embodiments" means "at least some embodiments". Related definitions of other terms are given in the following description.

[0020] It should be noted that the concepts such as “First,” “Second,” etc., as used in this disclosure are merely for the purpose of distinguishing different devices, modules, or units, and are not intended to limit the order or interdependence of the functions performed by these devices, modules, or units.

[0021] It should be noted that the modifications “one” and “multiple” used in this disclosure are not restrictive but schematic, and should be understood as “one or more” unless explicitly indicated in the context, as would be understood by those skilled in the art.

[0022] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0023] To ensure that this is understood, data relating to this technical solution (including, but not limited to, the data itself, or the acquisition or use of the data) should comply with the requirements of the corresponding laws and regulations.

[0024] Figure 1 is a schematic flowchart of a method for displaying interactive information according to an embodiment of the present disclosure. The method may be applied to a first application program and executed by an interactive information display device, which may be implemented by software and / or hardware, and may be located on an electronic device, for example, a mobile phone or a tablet computer. The method for displaying interactive information according to an embodiment of the present disclosure is applied to scenes for displaying interactive information of media content, and in particular to scenes for displaying barrage information of media content. As shown in Figure 1, the method for displaying interactive information according to this embodiment may include the following:

[0025] S101 Receives the first display operation for media content.

[0026] The media content described above may be media content corresponding to a first display operation, for example, media content that is instructed to be displayed by the first display operation. The type of media content is not limited, and for example, the media content may include video content and / or graphic content. The video content may include panoramic video and / or non-panoramic video. Optionally, the media content may include panoramic video, thereby displaying a visual effect where, when interactive information is subsequently displayed, the interactive information is positioned within the panoramic space corresponding to the panoramic video, for example, the display viewpoint of the interactive information is switched in accordance with the switching of the display viewpoint of the panoramic video, thereby further enhancing the display effect of the interactive information. The first display operation may be a trigger operation to instruct the display of a certain media content, for example, a playback operation for a certain media content.

[0027] Specifically, if the current user wishes to view a certain media content, they can perform a first display operation for that media content. In response, the first application program can receive the first display operation performed by the current user.

[0028] In this embodiment, the current user performing the first display operation and the publisher of the media content may be the same or different users. For example, the first display operation can support a user in viewing media content they have posted, or it can support a user in viewing media content posted by other users.

[0029] When the current user checks media content they have posted by performing the first display operation, the media content checked by the user may be posted by the current user. For example, the current user may trigger the generation of the media content to be posted by the first application program or an application program other than the first application program, and / or post the media content by the first application program or an application program other than the first application program. In this case, the application program used by the current user to trigger the generation of the media content and the application program used by the current user to post the media content may be the same or different application programs.

[0030] In some embodiments, if the media content viewed by the current user is media content that the user has posted, the current user may, for example, trigger the generation of the media content to be posted by a second application program. For example, the second application program or a server corresponding to the second application program may generate the media content to be posted, and the first application program may post the media content that was triggered and generated by the second application program. For example, the second application program can call the first application program to post the media content, thereby further shortening the posting path for the media content that was triggered and generated by the second application program.

[0031] As an option, the media content is generated triggered by a second application program, and prior to the first display operation that receives a first display operation for the media content, the posting interface for the media content is displayed in response to a posting interface display command for the media content, the posting interface display command is generated by the second application program, and the media content is posted in response to a media content posting operation acting on the posting interface.

[0032] The second application program and the first application program may be the same or different application programs. The following explanation will use the case where the second and first application programs are different application programs as an example. For example, the first application program may be an application program that supports the display and posting of media content, such as a video application program, and the second application program may be an application program that supports the shooting and creation of media content, such as a video editing application program. The posting interface display command may be a posting interface command that instructs the first application program to display media content triggered and generated by the second application program. The media content posting operation may be a trigger operation that instructs to post the media content. The method of executing the media content posting operation is not limited to these; for example, the media content posting operation may be a trigger operation of the media content posting control or a predetermined swipe gesture operation.

[0033] For example, a second application program may, after triggering and generating a media content, generate a posting interface display command for the media content, which instructs the first application program to display the posting interface for the media content, for example, by instructing the first application program installed on an electronic device on which the second application program is installed to display the posting interface for the media content.

[0034] In response to a posting interface display command generated by the second application program, the first application program displays the posting interface for the media content that was triggered and generated by the second application program, and when it receives a media content posting operation acting on the posting interface, it can post the media content that was triggered and generated by the second application program in response to the media content posting operation.

[0035] S102 In response to the first display operation, the media content screen of the media content is displayed, and at least a portion of the related interactive information of the media content screen is displayed, the related screen elements of the related interactive information are displayed on the media content screen, the related interactive information is displayed at the related display position of the related screen element corresponding to the related interactive information, and the related screen element is set by the publisher of the related interactive information.

[0036] The media content screen described above may be understood as the currently displayed media content screen, and the media content screen may change as the media content is displayed.

[0037] Related interactive information may be interactive information associated with the currently displayed media content screen. The type of interactive information is not limited; for example, interactive information may include bullet hell information and / or comment information, and the following explanation will use the case where the interactive information is bullet hell information as an example.

[0038] When interactive information is associated with a media content screen, it may be understood that the associated screen elements of the interactive information are displayed on the media content screen. The associated screen elements of the interactive information may be screen elements associated with the interactive information, for example, the display position of the interactive information may be the associated display position of its associated screen elements, and the associated screen elements of the interactive information may be set by the publisher of the interactive information, for example, the publisher may set the associated screen elements of the interactive information on the media content screen before or after posting the interactive information. The method of setting the associated screen elements is not limited.

[0039] The related display position of a related screen element may be understood as a position associated with the display position of the related screen element, for example, a position within a predetermined distance range from the display position of the related screen element, and this position may, for example, overlap with the display position of the related screen element, or be located above, below, to the left or to the right of the display position of the related screen element. The screen element may be understood as an element in a media content screen, for example, an image of a person displayed on the media content screen, or a point element displayed on the media content screen.

[0040] Specifically, when a first display operation for media content is received, the system can respond to the first display operation by displaying the media content screen 20 of the media content, and display at least a portion 21 of the related interactive information 21 of the currently displayed media content based on the display position of the related screen elements of the related interactive information 21 on the media content screen 20. For example, the system can display at least a portion 21 of the related interactive information 21 of the media content screen 20 at the related display position of the related screen element, as shown in Figure 2 (in the figure, the case where the media content is a panoramic video is used as an example).

[0041] The method of displaying the related interactive information 21 at a relevant display location is not limited. For example, the issuer identifier of the related interactive information 21 and / or at least some of the information content of the related interactive information can be displayed at the relevant display location. Exemplarily, as shown in Figure 2, the issuer identifier of the related interactive information 21 can be displayed, and at least some of the information content of the related interactive information can be displayed above the issuer identifier. The issuer identifier may be understood as an identifier of the issuer, such as the issuer's icon and / or nickname.

[0042] If the media content is a panoramic video, the currently displayed media content screen 20 may be a portion of the screen area of ​​the panoramic photograph 22 corresponding to the panoramic video, as shown in Figure 2. Interactive information (not shown in Figure 2) whose related screen elements are not currently displayed on the media content screen 20 does not need to be displayed in the first application program. It should be noted that the panoramic photograph 22 is actually displayed in a spherical shape, but in Figure 2, it is displayed in a flat shape to make it easier to view the screen in the panoramic photograph 22.

[0043] As is understood, interactive information is displayed in the relevant display position of its associated screen element. If the display position and / or viewing angle of the associated screen element of the interactive information changes as the media content is displayed, the display position and / or viewing angle of the interactive information will also change accordingly. If the associated screen element of the interactive information moves outside the display area of ​​the screen as the media content is displayed—in other words, if the associated screen element of the interactive information is no longer visible on the media content screen—the display of the interactive information can be canceled.

[0044] In some embodiments, for each related screen element displayed on the media content screen, when related interactive information is displayed at the related display position of the related screen element, one or more related interactive pieces of information corresponding to the related screen element may be displayed at the related display position, and it is not necessary to switch the displayed one or more related interactive pieces of information corresponding to the related screen element during the media content display process. For example, when the related screen element is displayed, the related interactive information displayed at the related display position of the related screen element is maintained so as not to change. In this case, as an option, displaying at least some of the related interactive information of the media content screen includes displaying the related interactive information corresponding to the related screen element at the related display position of the related screen element, and maintaining the displayed related interactive information so as not to change.

[0045] In some embodiments, when displaying related interactive information at the related display position of each related screen element displayed on the media content screen, different related interactive information corresponding to the related screen element can be switched and displayed at the related display position. For example, the related interactive information displayed at the related display position can be switched according to a predetermined switching time length, thereby allowing the user to easily confirm it. In this case, the option of displaying at least some of the related interactive information of the media content screen includes switching and displaying different related interactive information corresponding to the related screen element at the related display position of the related screen element.

[0046] The method for displaying interactive information according to this embodiment includes receiving a first display operation for media content, displaying the media content screen of the media content in response to the first display operation, displaying at least a portion of the relevant interactive information on the media content screen, displaying the relevant screen elements of the relevant interactive information on the media content screen, displaying the relevant interactive information at the relevant display position of the relevant screen elements corresponding to the relevant interactive information, and setting the relevant screen elements of the relevant interactive information by the publisher of the relevant interactive information. In this embodiment, by using the above technical solution, it is possible to support the publisher setting the relevant screen elements of the interactive information posted by the publisher on the media content screen, and to support the display of the interactive information posted by the publisher at the display position of the relevant screen elements, thereby diversifying the display method of interactive information and satisfying the various display requirements of users for interactive information.

[0047] Figure 3 is a schematic flowchart of another interactive information display method according to an embodiment of the present disclosure. The solution in this embodiment may be combined with one or more selectable solution in the above embodiment. The options further include at least one of the following steps: displaying a media content screen of the media content and, after displaying relevant interactive information of at least a portion of the media content screen, posting first interactive information for the media content in response to an interactive information posting operation based on the media content screen, wherein the first interactive information corresponds to the information posting operation; and displaying at least one display surface in response to a second display operation for second interactive information among the at least portion of the relevant interactive information, and displaying detailed information of the second interactive information on the target display surface of the at least one display surface.

[0048] Accordingly, as shown in Figure 3, the method for displaying interactive information according to this embodiment may include the following:

[0049] S201 receives the first display operation for media content.

[0050] S202 In response to the first display operation, the media content screen of the media content is displayed and at least a portion of the related interactive information of the media content screen is displayed, and S203 and / or S204 are executed, the related screen elements of the related interactive information are displayed on the media content screen, the related interactive information is displayed in the related display position of the related screen element corresponding to the related interactive information, and the related screen element is set by the publisher of the related interactive information.

[0051] S203 In response to an interactive information posting operation based on the media content screen, first interactive information for the media content is posted, and the first interactive information corresponds to the information posting operation.

[0052] An interactive information posting operation may be a trigger operation that instructs the posting of interactive information for the currently displayed media content. The interactive information posting operation may be performed based on the currently displayed media content screen. The method of performing the interactive information posting operation is not limited; for example, the interactive information posting operation may be a trigger operation of an interactive information posting control or a predetermined swipe operation. The first interactive information may be understood as interactive information that is instructed to be posted by the interactive information posting operation. The type of information content of the first interactive information is not limited; for example, the information content of the first interactive information may include text content, image content and / or links. The links may support the display of an interface or content corresponding to the links.

[0053] In this embodiment, when displaying media content, it is possible to support users posting interactive information based on the media content screen of the media content. For example, it is possible to support users entering the interactive information posting process by triggering the media content screen of the media content, thereby further diversifying the methods for posting interactive information.

[0054] Specifically, when an interactive information posting operation based on a media content screen is received, the system can respond to the interactive information posting operation by posting first interactive information for the media content to which the media content screen belongs, for example, by posting new interactive information associated with the media content screen.

[0055] In some embodiments, in response to an interactive information posting operation based on the media content screen, and before posting first interactive information to the media content, an information input area is displayed in response to a first trigger operation acting on the media content screen, and the information input area is used for the user to input information content for the first interactive information.

[0056] The first trigger operation may be a trigger operation on the media content screen, or it may be a trigger operation that acts on any screen position on the currently displayed media content screen.

[0057] In the above embodiment, the information content of the first interactive information may be entered by the current user. For example, when the first application program receives a first trigger operation acting on the media content screen, it can display an information input area, which is used for the current user to enter the information content of the first interactive information to be posted into the information input area. As a result, when the program receives an interactive information posting operation from the current user, it can acquire the information content entered by the current user into the information input area as the information content of the first interactive information and post the first interactive information.

[0058] In some embodiments, in response to an interactive information posting operation based on the media content screen, before posting the first interactive information for the media content, the first screen element on the media content screen is made the associated screen element for the first interactive information, and the first screen element corresponds to the second trigger operation, in response to a second trigger operation acting on the media content screen.

[0059] The first screen element may be a screen element corresponding to a second trigger operation on the media content screen. The second trigger operation may be a trigger operation that sets the associated screen elements of the first interactive information. The method of executing the second trigger operation is not limited; for example, the second trigger operation may be a trigger operation at a certain position on the media content screen, in which case the first screen element may be a screen element displayed at the trigger position of the second trigger operation on the media content screen, for example, a screen object (e.g., a person) displayed at the trigger position of the second trigger operation, or an element point displayed at the trigger position of the second trigger operation. The second trigger operation may also be an input operation for coordinates at a certain position, in which case the first screen element may be a screen element located at those position coordinates on the media content screen, for example, a screen object (e.g., a person) or an element point located at those position coordinates. The second trigger operation may further be a box selection operation that acts on the media content screen, in which case the first screen element may be at least some of the screen elements displayed in the area selected by the box selection operation. The second trigger operation and the first trigger operation may be the same or different. If the second trigger operation and the first trigger operation are the same, the first trigger operation may be used to instruct the system to determine the relevant screen elements and information input areas of the first interactive information.

[0060] In the above embodiment, the current user can set the associated screen elements of the first interactive information on the media content screen by performing a second trigger operation before posting the first interactive information to the media content. For example, the current user can anchor any area or position on the media content screen to post the interactive information, thereby combining the displayed media content screen with the interactive information. For instance, when the first application program receives a second trigger operation performed by the current user on the media content screen, it can determine the screen element on the media content screen corresponding to the second trigger operation as the associated screen element of the first interactive information.

[0061] S204 In response to a second display operation for the second interactive information among at least some of the related interactive information, at least one display surface is displayed, and detailed information of the second interactive information is displayed on the target display surface of the at least one display surface.

[0062] The second display operation may be a trigger operation to instruct the display of detailed information about a particular interactive piece of information, and the method of performing the second display operation is not limited; for example, the second display operation may be a single-click or double-click operation of a related interactive piece of information that is currently displayed. The second interactive piece of information may be related interactive information corresponding to the second display operation, for example, related interactive information of a particular piece of information that the second display operation instructs to be displayed.

[0063] The display surface may be a flat or curved surface for displaying details of interactive information, and different display surfaces may be used to display different details of the same related interactive information (e.g., second interactive information), and / or different display surfaces may be used to display details of different related interactive information. The following example describes the case where different display surfaces are used to display details of different related interactive information. The target display surface may be a display surface for displaying details of second interactive information, and the position of the target display surface on at least one displayed display surface is not restricted. For example, the target display surface may be a display surface among the at least one display surface that is parallel to the plane on which the screen is located.

[0064] For example, when a second display operation is received for a second interactive piece of information among at least some of the displayed related interactive information, for instance, when a related interactive piece of information is detected that has been triggered and displayed by the current user, at least one display surface 40 may be displayed, and detailed information of the second interactive piece may be displayed within the target display surface of the at least one display surface 40, for example, within a display surface 40 parallel to the plane on which the screen is located (i.e., the target display surface), as shown in Figure 4.

[0065] In this embodiment, the display method of at least one display surface is not limited. For example, the at least one display surface may be arranged continuously along a predetermined direction, for example, in a clockwise or counterclockwise direction, and two adjacent display surfaces may form a predetermined angle, that is, adjacent display surfaces of the at least one display surface are arranged to form a predetermined angle. The predetermined angle may be greater than 0° and 180° or less, and its specific value may be flexibly set as needed.

[0066] In some embodiments, after displaying at least one display surface, the currently displayed display surface is switched by controlling the rotation of the at least one display surface in response to a switching operation on the display surface, and the different display surface is used to display detailed information of different related interactive information corresponding to a second screen element, further comprising the second screen element being the related screen element of the second interactive information.

[0067] A switching operation may be a trigger operation that instructs the system to switch the currently displayed display surface, and the method of performing the switching operation is not limited. For example, if at least one of the displayed display surfaces is parallel to the display direction of the media content and its arrangement direction is perpendicular to the display direction of the media content, the switching operation may include a horizontal swipe operation. The second screen element is the associated screen element of the second interactive information. The associated interactive information corresponding to the second screen element may be understood as the associated interactive information of the second screen element.

[0068] In the above embodiment, different display surfaces may be used to display detailed information of different related interactive information corresponding to the second screen element, and the system can support switching the currently displayed display surface by performing a switching operation, thereby allowing the user to view detailed information of different related interactive information.

[0069] For example, when a switching operation on a display surface is received, such as a horizontal swipe operation by the current user, the currently displayed display surface can be switched by controlling at least one of the displayed display surfaces to rotate along the rotation direction corresponding to the switching operation (e.g., clockwise or counterclockwise), and further switching the currently displayed detailed information is used for the current user to review. Here, each display surface can rotate along the same axis of rotation, for example, they rotate synchronously along the same axis of rotation.

[0070] The interactive information display method according to this embodiment supports users posting interactive information based on the media content screen they are viewing, and / or displaying detailed information about the interactive information on the display surface. This further diversifies the posting and display methods for interactive information, thereby improving the user experience.

[0071] Figure 5 is a schematic flowchart of a media content generation method according to an embodiment of the present disclosure. The method may be applied to a second application program and executed by a media content generation device, which may be implemented by software and / or hardware and may be located on an electronic device, for example, a mobile phone or a tablet computer. The media content generation method according to an embodiment of the present disclosure is applied to a media content generation scene, and in particular to a scene in which a panoramic video is generated based on material shot from a single viewpoint. As shown in Figure 5, the media content generation method according to this embodiment may include the following:

[0072] S301 In response to a material display operation, a material interface is displayed, and at least one candidate material is displayed on the material interface, wherein the candidate material was shot from a single viewpoint.

[0073] The material display operation may be a trigger operation to instruct the system to display candidate materials. The method of performing the material display operation is not limited; for example, the material display operation may be an operation that triggers the creation entry for a panoramic video. The material interface may be a candidate material display interface, and at least one candidate material may be displayed on the material interface. The candidate material is a material that the user can select, and the type of candidate material is not limited; for example, the candidate material may be a photographic material or a video material, and the case where the candidate material is a photographic material will be described below as an example. The candidate material is shot from a single viewpoint, for example, shot with a non-panoramic camera.

[0074] For example, when a material display operation is received, for instance, when it is detected that the current user has triggered a panoramic video creation entry 60 (for example, as shown in the first figure in Figure 6), the material interface may be displayed, and at least one candidate material may be displayed in the material interface, for example, as shown in the second figure in Figure 6, which is used for the current user to make a selection.

[0075] S302 In response to a confirmation operation acting on the material interface, the system displays media content generation presentation information, the media content being a panoramic video generated based on original material, the media content supporting the display of interactive information at the relevant display position of the relevant screen element corresponding to the interactive information, the original material being a candidate material confirmed by the confirmation operation, and the generation presentation information being used to indicate that the generation of the media content is complete.

[0076] The confirmation operation may be a trigger operation that confirms the generation of a panoramic video using the selected candidate material. The method of performing the confirmation operation is not limited; for example, the confirmation operation may be an operation that triggers a confirmation control in the material interface, or a swipe operation that acts on the material interface.

[0077] The original material may be a candidate material confirmed by the confirmation operation, for example, a candidate material that is selected in the material interface. The number of original materials may be one or more; the following explanation will use the case where there is one original material as an example.

[0078] The media content may be a panoramic video generated from original material. The media content may also support displaying interactive information using prior art display methods, so as to be understood that the media content supports and displays the interactive information at the relevant display position of the relevant screen element corresponding to the interactive information.

[0079] The generation presentation information may be information indicating that the generation of media content is complete, and the generation presentation information may be presented in the form of text and / or images. Optionally, the generation presentation information may include a preview screen of the panoramic video, in which case the user can be informed that the generation of media content is complete by displaying a preview screen of the generated media content.

[0080] Specifically, when a confirmation operation acting on the material interface is received, for example, when it is detected that the current user has triggered a confirmation control 61 in the material interface (for example, as shown in the second figure in Figure 6), the system triggers the generation of media content (for example, a panoramic video) based on the original material selected by the user. After the generation of the media content is complete, the system can display media content generation notification information, for example, a preview screen of the generated media content, as shown in the third figure in Figure 6, thereby informing the current user that the generation of the media content is complete.

[0081] In this embodiment, the method for triggering the generation of media content based on the original material selected by the user is not limited. For example, a second application program may be triggered to generate media content based on the original material selected by the user, or a server corresponding to the second application program may be triggered to generate media content based on the original material selected by the user. The generation methods used by the second application program and the server when generating media content may be the same, different, or set as needed. This embodiment will describe the case where the second application program generates media content based on the original material selected by the user as an example.

[0082] In some embodiments, media content can be generated based on original material 70 selected by the user before displaying media content generation information. For example, the original material 70 can be enlarged into a panoramic photograph 22 using a predetermined image enlargement algorithm, for example, as shown in Figure 7 (in Figure 7, the screen located within the dotted box in the panoramic photograph 22 is the original screen in the original material), a panoramic image sequence frame is generated based on the panoramic photograph 22, and a panoramic video is generated based on the generated panoramic image sequence frame, with the panoramic video being the generated media content.

[0083] In this case, the options further include, before displaying the media content generation and presentation information, expanding the original material into a panoramic photograph and generating a panoramic image sequence frame based on the panoramic photograph, and generating the media content based on the panoramic image sequence frame.

[0084] The specified image enlargement algorithm may be an existing image enlargement algorithm; for example, an existing image enlargement algorithm can be used to enlarge original material selected by the user into a panoramic photograph. It should be noted that if the specified image enlargement algorithm is an existing image enlargement algorithm, it is generally used only to enlarge flat photographs, not to generate panoramic photographs. This embodiment diversifies the method of generating panoramic photographs by enlarging panoramic photographs using the specified image enlargement algorithm. The dimensions of the enlarged panoramic photograph are not limited; for example, the dimensions of the enlarged panoramic photograph may be 8K·16000·8000px.

[0085] The panoramic image sequence frames may be used to generate video frames for a panoramic video, and the method for generating the panoramic photograph sequence frames may be set as needed. For example, different regions of a panoramic photograph can be sequentially clipped and processed to obtain the panoramic image sequence frames.

[0086] After acquiring a panoramic image sequence frame, a panoramic video can be generated based on this panoramic image sequence frame. For example, by combining motion estimation and compensation techniques, a long encoder can be used to convert the panoramic image sequence frame into video frames for a panoramic video, thereby obtaining the panoramic video.

[0087] In some embodiments, the viewpoint of the panoramic video is switched according to the viewpoint of the target object, and before generating a panoramic image sequence frame based on the panoramic photograph, the target object displayed on the source screen of the original material is extracted and a dynamic model of the target object is generated, and generating a panoramic image sequence frame based on the panoramic photograph includes generating a panoramic image sequence frame based on the panoramic photograph and the dynamic model.

[0088] The target object may be an object displayed in the original material, or it may be an object of a predetermined type, such as a person displayed in the original material. The dynamic model may be a model that describes the movement process of the target object in the panoramic video, and this movement process may include, but is not limited to, a translation process and / or a rotation process.

[0089] In the above embodiment, the viewpoint of the panoramic video is switched as the viewpoint of the target object in the original material is switched, thereby further improving the display effect of the panoramic video and providing the user with an immersive experience when viewing the panoramic video.

[0090] For example, deep learning and motion recognition techniques can be used to extract target objects from original material and generate dynamic models of those target objects. For instance, a person can be extracted as a target object from the original material, and 3D modeling techniques can be used to adjust and bind the target object's motion and posture to generate a dynamic model of that object. This allows for the generation of panoramic image sequence frames based on the generated panoramic photograph and the dynamic model.

[0091] Furthermore, during the panoramic video generation process, music can be added to the panoramic video, and / or a smooth lens movement scheme can be generated based on the background environment of the panoramic photo. This improves the smoothness of the screen in the panoramic video, ensures stable movement and / or rotation of the target object in the panoramic video, and thereby further enhances the display effect of the panoramic video.

[0092] In this embodiment, after the generation of media content is complete, the posting of the generated media content can be triggered by a trigger operation by the current user. For example, the second application program can post the media content in response to a trigger operation by the current user, or the first application program can be instructed to post the media content in response to a trigger operation by the current user.

[0093] When a first application program instructs to post media content, the options further include, after displaying generation and presentation information for the media content, generating a posting interface display command for the media content in response to the command generation operation, the posting interface display command being used to instruct the first application program to display the posting interface for the media content, and the posting interface being used to post the media content.

[0094] The command generation operation may be an operation to instruct the generation of a posting interface display command. The method of execution of the command generation operation is not limited; for example, the command generation operation may be an operation that triggers a command generation control displayed in a second application program, or an operation that performs a predetermined gesture. The posting interface display command may be used to instruct a first media content to display the posting interface for the media content, thereby posting the media content.

[0095] For example, when the second application program receives an instruction generation operation, for instance, when it detects that the current user has triggered an instruction generation control 62 displayed in the second application program (for example, as shown in the third figure in Figure 6), it can generate a posting interface display instruction for the media content, which instructs the first application program to display the posting interface for the media content.

[0096] In response to a posting interface display command generated by the second application program, the first application program displays the posting interface for the media content that was triggered and generated by the second application program, and when it receives a media content posting operation acting on the posting interface, it can post the media content that was triggered and generated by the second application program in response to the media content posting operation.

[0097] The media content generation method according to this embodiment includes: displaying a material interface in response to a material display operation, displaying at least one candidate material on the material interface, and confirming that the candidate material was shot from a single viewpoint; displaying media content generation presentation information in response to a confirmation operation acting on the material interface, confirming that the media content is a panoramic video generated based on original material, supporting the display of the interactive information at a related display position on a related screen element corresponding to the interactive information, confirming that the original material is the candidate material confirmed by the confirmation operation, and using the generation presentation information to indicate that the generation of the media content is complete. In this embodiment, by using the above technical solution, panoramic media content can be generated using original material shot from a single viewpoint, and when displaying the media content, it is possible to support the display of the interactive information at a related display position on a related screen element corresponding to the interactive information, thereby diversifying the media content generation method and the interactive information display method, reducing the difficulty of generating panoramic media content, and improving the utilization rate of material shot from a single viewpoint.

[0098] Figure 8 is a structural block diagram of an interactive information display device according to an embodiment of the present disclosure. The device is placed in a first application program, and may be implemented by software and / or hardware, or may be placed in an electronic device, for example, a mobile phone or a tablet computer, and can display interactive information of media content by executing an interactive information display method, for example, displaying bullet information of media content. As shown in Figure 8, the interactive information display device according to this embodiment may include an operation receiving module 801 and a first information display module 802. The operation receiving module 801 is used to receive a first display operation on media content. The first information display module 802 is used to display the media content screen of the media content and to display at least a portion of the related interactive information of the media content screen in response to the first display operation, wherein the related screen elements of the related interactive information are displayed on the media content screen, the related interactive information is displayed at the related display position of the related screen element corresponding to the related interactive information, and the related screen element is set by the publisher of the related interactive information.

[0099] In the interactive information display device according to this embodiment, the operation receiving module receives a first display operation for media content, and the first information display module, in response to the first display operation, displays the media content screen of the media content and displays at least a portion of the related interactive information on the media content screen, the related screen elements of the related interactive information are displayed on the media content screen, the related interactive information is displayed at the related display position of the related screen element corresponding to the related interactive information, and the related screen elements of the related interactive information are set by the publisher of the related interactive information. In this embodiment, by using the above technical solution, it is possible to support the publisher setting the related screen elements of the interactive information posted by the publisher on the media content screen, and to support the display of the interactive information posted by the publisher at the display position of the related screen element, thereby diversifying the interactive information display method and meeting the different interactive information display needs of users.

[0100] As an option, the aforementioned media content includes panoramic video.

[0101] Furthermore, the interactive information display device according to this embodiment may further include at least one of the following: an information posting module used to post first interactive information to the media content in response to an interactive information posting operation based on the media content screen, after displaying the media content screen of the media content and displaying at least a portion of the relevant interactive information on the media content screen; and a second information display module used to display at least one display surface and display detailed information of the second interactive information on the target display surface of the at least one display surface, after displaying the media content screen of the media content and displaying at least a portion of the relevant interactive information on the media content screen.

[0102] Furthermore, the interactive information display device according to this embodiment may further include at least one of the following: an area display module used to display an information input area in response to a first trigger operation acting on the media content screen in response to an interactive information posting operation based on the media content screen, before posting first interactive information for the media content, wherein the information input area is used for the user to input the information content of the first interactive information; and an element determination module used to make a first screen element on the media content screen a related screen element of the first interactive information in response to a second trigger operation acting on the media content screen in response to an interactive information posting operation based on the media content screen, before posting first interactive information for the media content, wherein the first screen element corresponds to the second trigger operation.

[0103] Furthermore, the interactive information display device according to this embodiment may further include a display surface switching module, which is used to switch the currently displayed display surface by controlling the rotation of at least one display surface in response to a switching operation on the display surface after displaying at least one display surface, and which is used to display detailed information of different related interactive information corresponding to a second screen element, wherein the second screen element is the related screen element of the second interactive information.

[0104] As an option, adjacent display surfaces among the at least one display surface are arranged to form a predetermined angle.

[0105] As an option, the first information display module 802 is used to display related interactive information corresponding to the related screen element at the related display position of the related screen element and to maintain the displayed related interactive information so as not to change, or to switch and display different related interactive information corresponding to the related screen element at the related display position of the related screen element.

[0106] As an alternative, the media content may be generated triggered by a second application program, and the interactive information display device according to this embodiment may further include an interface display module used to display the posting interface for the media content in response to a posting interface display command for the media content before receiving a first display operation for the media content, wherein the posting interface display command is generated by the second application program, and a content posting module for posting the media content in response to a media content posting operation acting on the posting interface.

[0107] An interactive information display device according to an embodiment of the present disclosure can perform an interactive information display method according to any embodiment of the present disclosure and has a functional module and beneficial effects corresponding to performing an interactive information display method. Technical details not described in detail in this embodiment may be referenced to an interactive information display method according to any embodiment of the present disclosure.

[0108] Figure 9 is a structural block diagram of a media content generation device according to an embodiment of the present disclosure. The device is located in a second application program, and may be implemented by software and / or hardware, and may be located in an electronic device, for example, a mobile phone or a tablet computer, and can generate media content by performing a media content generation method, for example, generating a panoramic video based on material shot from a single viewpoint. As shown in Figure 9, the media content generation device according to this embodiment may include a material display module 901 and a presentation module 902, The material display module 901 is used to display a material interface in response to a material display operation, and the material interface displays at least one candidate material, wherein the candidate material was shot from a single viewpoint. The presentation module 902 is used to display media content generation presentation information in response to a confirmation operation acting on the material interface, and is used to indicate that the media content is a panoramic video generated based on original material, that the media content supports displaying the interactive information at the relevant display position of the relevant screen element corresponding to the interactive information, that the original material is a candidate material confirmed by the confirmation operation, and that the generation presentation information indicates that the generation of the media content is complete.

[0109] In the media content generation device according to this embodiment, the material display module displays a material interface in response to a material display operation, and at least one candidate material is displayed on the material interface, and the candidate material is shot from a single viewpoint. The presentation module displays media content generation presentation information in response to a confirmation operation acting on the material interface, and the media content is a panoramic video generated based on original material. The media content supports the display of the interactive information at the relevant display position of the relevant screen element corresponding to the interactive information. The original material is the candidate material confirmed by the confirmation operation, and the generation presentation information is used to indicate that the generation of the media content is complete. In this embodiment, by using the above technical solution, panoramic media content can be generated using original material shot from a single viewpoint, and when displaying the media content, the display of the interactive information at the relevant display position of the relevant screen element corresponding to the interactive information is supported. This diversifies the media content generation method and the interactive information display method, reduces the difficulty of generating panoramic media content, and improves the utilization rate of material shot from a single viewpoint.

[0110] Furthermore, the media content generation device according to this embodiment may further include, before displaying media content generation and presentation information, a material enlargement module for expanding the original material into a panoramic photograph and generating a panoramic image sequence frame based on the panoramic photograph, and a media content generation module for generating the media content based on the panoramic image sequence frame.

[0111] As an option, the viewpoint of the panoramic video may be switched according to the viewpoint of the target object, and the media content generation device according to this embodiment may further include a model generation module for extracting the target object displayed on the original material screen and generating a dynamic model of the target object before generating a panoramic image sequence frame based on the panoramic photograph, and the material enlargement module may be used to generate a panoramic image sequence frame based on the panoramic photograph and the dynamic model.

[0112] Furthermore, the media content generation device according to this embodiment may further include a command generation module used to generate a posting interface display command for the media content in response to a command generation operation after displaying media content generation presentation information, the posting interface display command being used to instruct a first application program to display the posting interface for the media content, and the posting interface being used to post the media content.

[0113] As an option, the generated presentation information includes a preview screen of the panoramic video.

[0114] A media content generation apparatus according to an embodiment of this disclosure can perform a media content generation method according to any embodiment of this disclosure and has a functional module and beneficial effects corresponding to performing a media content generation method. Technical details not described in detail in this embodiment may be referenced to a media content generation method according to any embodiment of this disclosure.

[0115] Hereinafter, with reference to Figure 10, which is a schematic diagram of the structure of an electronic device (e.g., terminal device) 1000 suitable for realizing an embodiment of the present disclosure. The terminal device in the embodiment of the present disclosure may include, but is not limited to, mobile devices such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable media players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. The electronic device shown in Figure 10 is merely an example and does not in any way limit the functions and scope of use of the embodiment of the present disclosure.

[0116] As shown in Figure 10, the electronic device 1000 may include a processing unit (e.g., a central processor, a graphics processor, etc.) 1001, which can perform various appropriate operations and processes based on a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1008 into a random access memory (RAM) 1003. The RAM 1003 further stores various programs and data necessary for the operation of the electronic device 1000. The processing unit 1001, ROM 1002, and RAM 1003 are connected to each other via a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.

[0117] Generally, input devices 1006, including, for example, touch panels, touchpads, keyboards, mice, cameras, microphones, accelerometers, and gyroscopes; output devices 1007, including, for example, liquid crystal displays (LCDs), loudspeakers, and vibrators; storage devices 1008, including, for example, magnetic tapes and hard disks; and communication devices 1009 may be connected to the I / O interface 1005. The communication devices 1009 may be permitted to exchange data between the electronic device 1000 and other devices via wireless or wired communication. Figure 10 shows an electronic device 1000 with various devices, but it should be understood that it is not required to implement or have all of the illustrated devices. More or fewer devices may be implemented or have all of them instead.

[0118] In particular, based on embodiments of the present disclosure, the process described above with reference to the flowchart may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product which includes a computer program contained in a non-temporary computer-readable storage medium, and which includes program code for performing the method shown in the flowchart. In such embodiments, the computer program may be downloaded and installed from a network by a communication device 1009, or installed from a storage device 1008, or installed from a ROM 1002. When the computer program is executed by the processing unit 1001, it performs the functions limited to the methods of embodiments of the present disclosure.

[0119] It should be noted that the computer-readable storage medium in this disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination of both. The computer-readable storage medium may be, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of more than these. More specific examples of computer-readable storage mediums may include, but are not limited to, an electrical connection having one or more wires, a portable computer magnetic disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), an optical fiber, compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this disclosure, the computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, apparatus, or device. In this disclosure, the computer-readable signal medium may include data signals propagating in the baseband or as part of a carrier, which may include computer-readable program code. Such propagating data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The computer-readable signal medium may further be any computer-readable storage medium other than a computer-readable storage medium, and the computer-readable signal medium may transmit, propagate, or transmit programs used by or in combination with instruction execution systems, apparatus, or devices. The program code contained in the computer-readable medium may be transmitted by any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), or any suitable combination thereof.

[0120] In some embodiments, client terminals and servers may communicate using any currently known or future-to-be-developed network protocol, such as HTTP (HyperText Transfer Protocol), and may be connected to each other with digital data communications (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), the Internet (e.g., the internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or future-to-be-developed networks.

[0121] The computer-readable media described above may be included in the electronic device described above, or it may exist independently but not assembled into the electronic device.

[0122] When the computer-readable medium contains one or more programs and the one or more programs are executed by the electronic device, the electronic device is configured to receive a first display operation for media content, and in response to the first display operation, to display a media content screen of the media content and display at least a portion of related interactive information on the media content screen, to display related screen elements of the related interactive information on the media content screen, to display the related interactive information at the related display position of the related screen element corresponding to the related interactive information, and to configure the related screen element to be set by the publisher of the related interactive information, or In response to a material display operation, the material interface is displayed, at least one candidate material is displayed on the material interface, and the candidate material is shot from a single viewpoint. In response to a confirmation operation acting on the material interface, media content generation presentation information is displayed, the media content is a panoramic video generated based on the original material, the media content supports displaying the interactive information at the relevant display position of the relevant screen element corresponding to the interactive information, the original material is the candidate material confirmed by the confirmation operation, and the generation presentation information is used to indicate that the generation of the media content is complete.

[0123] Computer program code for performing the operations of the Disclosure may be written in one or more programming languages ​​or a combination thereof, and such programming languages ​​include, but are not limited to, object-oriented programming languages ​​such as Java, Smalltalk, and C++, and further include ordinary procedural programming languages ​​such as the "C" language or similar programming languages. The program code may run entirely on the user's computer, partially on the user's computer, run as a single standalone software package, partially on the user's computer and partially on a remote computer, or run entirely on a remote computer or server. If a remote computer is involved, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or it may be connected to an external computer (for example, connected via the Internet using an Internet service provider).

[0124] The flowcharts and block diagrams in the drawings illustrate the implementable system architectures, functions, and operations of systems, methods, and computer program products relating to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, program segment, or portion of code, which includes one or more executable instructions for implementing a defined logical function. It should be noted that in some alternative implementations, the functions represented in the blocks may also occur in a different order than that shown in the drawings. For example, two blocks shown successively may actually be executed essentially simultaneously, or they may be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system that performs the defined function or operation, or by a combination of dedicated hardware and computer instructions.

[0125] The units relating to the embodiments of this disclosure may be implemented in software or in hardware. The name of the module may not be limited to the unit itself.

[0126] The functions described above in this specification may be performed at least partially by one or more hardware logic components. For example, exemplary types of hardware logic components that may be used include, but are not limited to, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standards (ASSPs), on-chip systems (SOCs), and complex-programmable logic devices (CPLDs).

[0127] In the context of this disclosure, a machine-readable medium may be a tangible medium that contains or stores a program used by or in combination with an instruction execution system, device, or apparatus. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or apparatus, or any suitable combination thereof. More specific examples of machine-readable storage media include electrical connections by one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0128] According to one or more embodiments of the present disclosure, Embodiment 1 provides a method for displaying interactive information applied to a first application program, and the method is Receiving the first display operation for media content, The following are included in response to the first display operation: displaying the media content screen of the media content and displaying at least a portion of the related interactive information on the media content screen; displaying the related screen elements of the related interactive information on the media content screen; displaying the related interactive information at the related display position of the related screen elements corresponding to the related interactive information; and setting the related screen elements by the publisher of the related interactive information.

[0129] According to one or more embodiments of this disclosure, Example 2 is based on the method described in Example 1, wherein the media content includes panoramic video.

[0130] According to one or more embodiments of the present disclosure, Embodiment 3 is based on the method of Embodiment 1, and after displaying the media content screen of the media content and displaying at least a portion of the relevant interactive information of the media content screen, In response to an interactive information posting operation based on the media content screen, a first interactive information is posted for the media content, and the first interactive information corresponds to the information posting operation. The method further includes at least one of the following steps: displaying at least one display surface in response to a second display operation on a second interactive piece of information from at least some of the related interactive information, and displaying detailed information of the second interactive piece on a target display surface of the at least one display surface.

[0131] According to one or more embodiments of this disclosure, Embodiment 4 is based on the method of Embodiment 3, and in response to an interactive information posting operation based on the media content screen, before posting the first interactive information for the media content, Steps include: displaying an information input area in response to a first trigger operation acting on the media content screen, the information input area being used by the user to input information content for the first interactive information, and The process further includes at least one of the following steps: in response to a second trigger operation acting on the media content screen, a first screen element on the media content screen becomes a related screen element of the first interactive information, and the first screen element corresponds to the second trigger operation.

[0132] According to one or more embodiments of this disclosure, Example 5 is based on the method of Example 3, and after displaying at least one display surface, The currently displayed display surface is switched by controlling the rotation of at least one display surface in response to a switching operation on the display surface, and the different display surface is used to display detailed information of different related interactive information corresponding to a second screen element, further comprising the second screen element being the related screen element of the second interactive information.

[0133] According to one or more embodiments of the present disclosure, Embodiment 6 is based on the method of Embodiment 3, wherein adjacent display surfaces of the at least one display surface are arranged to form a predetermined angle.

[0134] According to one or more embodiments of this disclosure, Example 7 is based on the method of Example 1, and displays at least a portion of the relevant interactive information of the media content screen, The related interactive information corresponding to the related screen element is displayed at the related display position of the related screen element, and the displayed related interactive information is maintained so as not to change, or This includes switching and displaying different related interactive information corresponding to the aforementioned related screen element at the related display position of the related screen element.

[0135] According to one or more embodiments of the present disclosure, Example 8 is based on the method of any one of Examples 1 to 7, wherein the media content is triggered and generated by a second application program, and prior to receiving a first display operation on the media content, In response to a command to display the posting interface for the media content, the posting interface for the media content is displayed, and the command to display the posting interface was generated by the second application program. The further includes posting media content in response to a media content posting operation acting on the posting interface.

[0136] According to one or more embodiments of the present disclosure, Embodiment 9 provides a method for generating media content to be applied to a second application program, the method being: In response to a material display operation, a material interface is displayed, at least one candidate material is displayed on the material interface, and the candidate material is filmed from a single viewpoint. The system includes displaying media content generation and presentation information in response to a confirmation operation acting on the material interface, wherein the media content is a panoramic video generated based on original material, the media content supports displaying the interactive information at the relevant display position of the relevant screen element corresponding to the interactive information, the original material is a candidate material confirmed by the confirmation operation, and the generation and presentation information is used to indicate that the generation of the media content is complete.

[0137] According to one or more embodiments of this disclosure, Example 10 is based on the method of Example 9, and before displaying the media content generation presentation information, The original material is expanded into a panoramic photograph, and a panoramic image sequence frame is generated based on the panoramic photograph. The further includes generating media content based on the panoramic image sequence frames.

[0138] According to one or more embodiments of this disclosure, Embodiment 11 is based on the method of Embodiment 10, wherein the viewpoint of the panoramic video is switched according to the viewpoint of the target object, and before generating a panoramic image sequence frame based on the panoramic photograph, This further includes extracting the target object displayed on the material screen of the original material and generating a dynamic model of the target object. Generating a panoramic image sequence frame based on the aforementioned panoramic photograph is: This includes generating a panoramic image sequence frame based on the panoramic photograph and the dynamic model.

[0139] According to one or more embodiments of this disclosure, Example 12 is based on the method of any one of Examples 9 to 11, and after displaying the media content generation and presentation information, The system further includes generating a posting interface display command for the media content in response to a command generation operation, the posting interface display command being used to instruct a first application program to display the posting interface for the media content, and the posting interface being used to post the media content.

[0140] According to one or more embodiments of the present disclosure, Example 13 is based on the method of any one of Examples 9 to 11, wherein the generated presentation information includes a preview screen of the panoramic video.

[0141] According to one or more embodiments of the present disclosure, Embodiment 14 provides an interactive information display device that is placed in a first application program, and the device is An operation receiving module for receiving a first display operation on media content, The system includes a first information display module used to display the media content screen of the media content and display at least a portion of related interactive information of the media content screen in response to the first display operation, wherein related screen elements of the related interactive information are displayed on the media content screen, the related interactive information is displayed at the related display position of the related screen element corresponding to the related interactive information, and the related screen element is set by the publisher of the related interactive information.

[0142] According to one or more embodiments of the present disclosure, Embodiment 15 provides a media content generation device to be placed in a second application program, the device is A material display module used to display a material interface in response to a material display operation, wherein at least one candidate material is displayed in the material interface, and the candidate material is shot from a single viewpoint; The system includes a presentation module used to display media content generation presentation information in response to a confirmation operation acting on the material interface, wherein the media content is a panoramic video generated based on original material, the media content supports displaying the interactive information at the relevant display position of the relevant screen element corresponding to the interactive information, the original material is a candidate material confirmed by the confirmation operation, and the generation presentation information is used to indicate that the generation of the media content is complete.

[0143] According to one or more embodiments of this disclosure, Example 16 provides an electronic device, which is, One or more processors, It comprises memory for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors are made to implement the interactive information display method described in any one of Examples 1 to 8, or the media content generation method described in any one of Examples 9 to 13.

[0144] According to one or more embodiments of the present disclosure, Embodiment 17 provides a computer-readable storage medium in which a computer program is stored, and when the program is executed by a processor, the interactive information display method described in any one of Embodiments 1 to 8 or the media content generation method described in any one of Embodiments 9 to 13 is realized.

[0145] According to one or more embodiments of the present disclosure, Embodiment 18 provides a computer program product, and when the computer program product is executed by a computer, the computer implements the interactive information display method described in any one of Embodiments 1 to 8, or the media content generation method described in any one of Embodiments 9 to 13.

[0146] The above description is merely a description of preferred embodiments and applicable technical principles of the present disclosure. As those skilled in the art will understand, the scope of the disclosure relating to this disclosure should not be limited to technical solutions comprising a specific combination of the above technical features, but should also include other technical solutions comprising any combination of the above technical features or their equivalents without departing from the above-disclosed concept. For example, technical solutions comprising substituting the above features with similar functional technical features disclosed in this disclosure (but not limited to those disclosed therein) may be included.

[0147] Furthermore, although the operations have been described in a specific order, this should not be interpreted as requiring these operations to be performed in a specific or sequential order as indicated. In certain environments, multitasking and concurrent processing may be advantageous. Similarly, while the above discussion includes some specific implementation details, these should not be construed as limiting the scope of this disclosure. Some features described in the context of independent embodiments may be further combined and implemented in a single embodiment. Conversely, various features described in the context of a single embodiment may be implemented independently or in any suitable subcombination in multiple embodiments.

[0148] While the subject matter has been described in a specific language as structural features and / or methodological behavior, it should be understood that the subject matter defined in the attached claims is not necessarily limited to the specific features or behaviors described above. On the contrary, the specific features and behaviors described above are merely illustrative forms of realizing the claims.

Claims

1. A method for displaying interactive information applied to a first application program, Receiving a first display operation for media content, A method for displaying interactive information, comprising: displaying a media content screen of the media content in response to the first display operation; displaying related interactive information on at least a portion of the media content screen; displaying related screen elements of the related interactive information on the media content screen; displaying the related interactive information at the related display position of the related screen element corresponding to the related interactive information; and setting the related screen element by the publisher of the related interactive information.

2. The method according to claim 1, wherein the media content includes a panoramic video.

3. After displaying the media content screen of the media content and displaying at least a portion of the relevant interactive information on the media content screen, In response to an interactive information posting operation based on the media content screen, a first interactive information is posted for the media content, and the first interactive information corresponds to the information posting operation. The method according to claim 1 or 2, further comprising at least one of the steps of: displaying at least one display surface in response to a second display operation on a second interactive information among at least some of the related interactive information; and displaying detailed information of the second interactive information on a target display surface among the at least one display surface.

4. In response to an interactive information posting operation based on the media content screen, before posting the first interactive information for the media content, In response to a first trigger operation acting on the media content screen, an information input area is displayed, and the information input area is used by the user to input information content for the first interactive information; The method according to claim 3, further comprising at least one of the following steps: in response to a second trigger operation acting on the media content screen, a first screen element on the media content screen becomes a related screen element of the first interactive information, and the first screen element corresponds to the second trigger operation.

5. After displaying at least one display surface, The method according to claim 3 or 4, further comprising controlling the rotation of at least one display surface in response to a switching operation on the display surface to switch the currently displayed display surface, the different display surface being used to display detailed information of different related interactive information corresponding to a second screen element, the second screen element being the related screen element of the second interactive information.

6. The method according to any one of claims 3 to 5, wherein adjacent display surfaces among the at least one display surface are arranged to form a predetermined angle.

7. Displaying at least some of the relevant interactive information on the media content screen is: The related interactive information corresponding to the related screen element is displayed at the related display position of the related screen element, and the displayed related interactive information is maintained so as not to change, or The method according to any one of claims 1 to 6, comprising switching and displaying different related interactive information corresponding to the related screen element at the related display position of the related screen element.

8. The aforementioned media content is generated triggered by the second application program, and before receiving the first display operation for the media content, In response to a command to display the posting interface for the media content, the posting interface for the media content is displayed, and the command to display the posting interface was generated by the second application program. The method according to any one of claims 1 to 7, further comprising posting media content in response to a media content posting operation acting on the posting interface.

9. A method for generating media content to be applied to a second application program, In response to a material display operation, a material interface is displayed, at least one candidate material is displayed on the material interface, and the candidate material is filmed from a single viewpoint. A method for generating media content, comprising: displaying media content generation presentation information in response to a confirmation operation acting on the material interface; the media content being a panoramic video generated based on original material; the media content supporting the display of the interactive information at the relevant display position of the relevant screen element corresponding to the interactive information; the original material being a candidate material confirmed by the confirmation operation; and the generation presentation information being used to indicate that the generation of the media content is complete.

10. Before displaying media content generation and presentation information, The original material is expanded into a panoramic photograph, and a panoramic image sequence frame is generated based on the panoramic photograph. The method according to claim 9, further comprising generating the media content based on the panoramic image sequence frames.

11. The viewpoint of the panoramic video is switched according to the viewpoint of the target object, and before generating a panoramic image sequence frame based on the panoramic photograph, This further includes extracting the target object displayed on the material screen of the original material and generating a dynamic model of the target object. Generating a panoramic image sequence frame based on the aforementioned panoramic photograph is: The method according to claim 10, comprising generating a panoramic image sequence frame based on the panoramic photograph and the dynamic model.

12. After displaying the media content generation and presentation information, The method according to any one of claims 9 to 11, further comprising generating a posting interface display command for media content in response to a command generation operation, the posting interface display command being used to instruct a first application program to display a posting interface for the media content, and the posting interface being used to post the media content.

13. The method according to any one of claims 9 to 12, wherein the generated presentation information includes a preview screen of the panoramic video.

14. An interactive information display device placed in a first application program, An operation receiving module configured to receive a first display operation on media content, An interactive information display device comprising: a first information display module configured to display a media content screen of the media content and display related interactive information of at least a portion of the media content screen in response to the first display operation, wherein related screen elements of the related interactive information are displayed on the media content screen, the related interactive information is displayed at the related display position of the related screen element corresponding to the related interactive information, and the related screen element is set by the issuer of the related interactive information.

15. A media content generation device to be placed in a second application program, A material display module configured to display a material interface in response to a material display operation, wherein at least one candidate material is displayed on the material interface, and the candidate material is shot from a single viewpoint; A media content generation device comprising: a display module used to indicate that the generation of media content is complete, wherein the media content is a panoramic video generated based on original material, the media content supports displaying the interactive information at the relevant display position of the relevant screen element corresponding to the interactive information, the original material is a candidate material confirmed by the confirmation operation, and the generation display information is used to indicate that the generation of the media content is complete.

16. It is an electronic device, At least one processor, The system comprises a memory that is communicated to at least one of the processors, An electronic device wherein a computer program that can be executed by the at least one processor is stored in the memory, and the computer program is executed by the at least one processor so that the at least one processor can perform the method for displaying interactive information according to any one of claims 1 to 8, or the method for generating media content according to any one of claims 9 to 13.

17. A computer-readable storage medium, A computer-readable storage medium in which computer instructions are stored, and which, when executed by a processor, is used to realize a method for displaying interactive information according to any one of claims 1 to 8, or a method for generating media content according to any one of claims 9 to 13.

18. A computer program product, The computer program product includes a computer program, which, when executed by a processor, implements a method for displaying interactive information according to any one of claims 1 to 8, or a method for generating media content according to any one of claims 9 to 13.

Images