Method, apparatus, electronic device and storage medium for generating multimedia content

Abstract

According to embodiments of the present disclosure, a method, an apparatus, an electronic device and a storage medium for generating multimedia content are provided. The method comprises: sequentially presenting one or more interactive elements for a first user to interact with, wherein for each interactive element; displaying a plurality of feedback elements; determining, according to a detected action of the first user, a selection of one of the plurality of feedback elements by the first user; and generating a first multimedia content and a second multimedia content, wherein the first multimedia content and the second multimedia content record a process in which the first user interacts with the one or more interactive elements through the action, content of the plurality of feedback elements for each interactive element is presented in the first multimedia content, and content of the plurality of feedback elements is hidden in the second multimedia content. In this way, the automatic generation of the video can be facilitated, the creation efficiency can be improved, and the interactive interest and user experience can be enhanced.

Description

TECHNICAL FIELD

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and in particular, to a method, apparatus, electronic device and computer-readable storage medium for generating multimedia content. BACKGROUND

[0002] With the development of computer technology, various multimedia content has become an important way for people to obtain information and socialize. Such multimedia content can be a video work made by shooting and editing. Sometimes, in order to increase the watchability and participation of the video work, the creator can add special effects and interactive elements to the video. In this way, the viewer can interact with the video at certain nodes as the video plays. Thus, the interestingness and user experience of the video work are improved. SUMMARY

[0003] In a first aspect of the present disclosure, a method for generating multimedia content is provided. The method comprises: sequentially presenting one or more interactive elements for a first user to interact with, wherein for each interactive element; displaying a plurality of feedback elements; determining, according to a detected action of the first user, a selection of one of the plurality of feedback elements by the first user; and generating a first multimedia content and a second multimedia content, wherein the first multimedia content and the second multimedia content record a process in which the first user interacts with the one or more interactive elements by the action, the content of the plurality of feedback elements for each interactive element is presented in the first multimedia content, and the content of the plurality of feedback elements is hidden in the second multimedia content.

[0004] In a second aspect of the present disclosure, a method for interacting with interactive multimedia content is provided. The method comprises: playing, to a second user, a second multimedia content recorded by a first user, the second multimedia content recording a process in which the first user interacts with one or more interactive elements by an action, wherein in the second multimedia content, the content of a plurality of feedback elements for each interactive element is hidden; and in response to a request of the second user, sequentially presenting the one or more interactive elements to the second user for the second user to interact with, wherein for each interactive element: displaying the plurality of feedback elements; and determining, according to a detected action of the second user, a selection of one of the plurality of feedback elements by the second user.

[0005] In a third aspect of the disclosure, an apparatus for generating interactive multimedia content is provided. The apparatus comprises: a first presentation module configured to sequentially present one or more interactive elements for a first user to interact with, wherein for each interactive element: a plurality of feedback elements are displayed; and a selection of one of the plurality of feedback elements by the first user is determined according to a detected action of the first user; and a generation module configured to generate a first multimedia content and a second multimedia content, wherein the first multimedia content and the second multimedia content record a process in which the first user interacts with the one or more interactive elements by the action, content of the plurality of feedback elements for each interactive element is presented in the first multimedia content, and content of the plurality of feedback elements is concealed in the second multimedia content.

[0006] In a fourth aspect of the disclosure, an apparatus for interacting with multimedia content is provided. The apparatus comprises: a playing module configured to play, to a second user, a second multimedia content recorded by a first user, the second multimedia content recording a process in which the first user interacts with one or more interactive elements by an action, wherein in the second multimedia content, content of a plurality of feedback elements for each interactive element is concealed; and a second presentation module configured to sequentially present, to the second user, the one or more interactive elements for the second user to interact with in response to a request of the second user, wherein for each interactive element: the plurality of feedback elements are displayed; and a selection of one of the plurality of feedback elements by the second user is determined according to a detected action of the second user.

[0007] In a fifth aspect of the disclosure, an electronic device is provided. The electronic device comprises at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. The instructions, when executed by the at least one processing unit, cause the electronic device to perform the method of the first aspect or the second aspect.

[0008] In a sixth aspect of the disclosure, a computer-readable storage medium is provided. The computer-readable storage medium has stored thereon a computer program which, when executed by a processor, implements the method of the first aspect or the second aspect.

[0009] It is to be understood that the description in the Summary section is not intended to define key or essential features of embodiments of the disclosure, nor is it intended to limit the scope of the disclosure. Other features of the disclosure will be apparent from the following description. BRIEF DESCRIPTION OF DRAWINGS

[0010] The above and other features, aspects and advantages of embodiments of the disclosure will become more apparent from the following description in conjunction with the accompanying drawings. In the drawings, the same or similar reference numerals designate the same or similar elements, wherein:

[0011] Figure 1 A schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented is shown;

[0012] Figure 2 A flowchart showing an example process for generating multimedia content according to some embodiments of the present disclosure is shown;

[0013] Figures 3A to 3H A schematic diagram showing an example user interface (UI) of an electronic device according to some embodiments of the present disclosure is shown;

[0014] Figure 4 A flowchart showing an example process for interacting with multimedia content according to some embodiments of the present disclosure is shown;

[0015] Figure 5 A schematic diagram showing an example UI of an electronic device according to some embodiments of the present disclosure is shown;

[0016] Figures 6A to 6D A schematic diagram showing an example UI of an electronic device according to some embodiments of the present disclosure is shown;

[0017] Figure 7 A block diagram showing an apparatus for generating multimedia content according to some embodiments of the present disclosure is shown;

[0018] Figure 8 A block diagram showing an apparatus for interacting with multimedia content according to some embodiments of the present disclosure is shown; and

[0019] Figure 9 A block diagram showing an apparatus capable of implementing a number of embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0020] Embodiments of the present disclosure will be described below in greater detail with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be embodied in various forms and should not be interpreted as being limited to the embodiments set forth herein; rather, these embodiments are provided so that the present disclosure can be more thoroughly and completely understood. It will be appreciated that the drawings of the present disclosure and the embodiments thereof are only for illustrative purposes and should not be construed as limiting the scope of protection of the present disclosure.

[0021] In the description of embodiments of the present disclosure, the term "includes" and its derivatives, are not intended to be limiting of the respective processes, systems, and / or methods described herein. Rather, the term "includes" and its derivatives are intended to be broad and encompass the respective processes, systems, and / or methods described herein, and any future processes, systems, and / or methods that can be developed or identified that have similar function. The term "based on" is intended to be broad and encompass the respective processes, systems, and / or methods described herein, and any future processes, systems, and / or methods that can be developed or identified that have similar function. The terms "one embodiment" or "an embodiment" are intended to be broad and encompass both a single process, system, and / or method, as well as a plurality of processes, systems, and / or methods. The term "some embodiments" is intended to be broad and encompass both a single process, system, and / or method, as well as a plurality of processes, systems, and / or methods. The following detailed description is presented in terms of some embodiments. It should be noted, however, that other embodiments can be formed without departing from the scope of the present disclosure.

[0022] In the description of the embodiments of the present disclosure, the use of the words "first", "second", etc. is only for the purpose of distinguishing between different elements, objects, targets, units, and does not imply the order or difference in time, space, priority of these elements, objects, targets, units.

[0023] It can be understood that, before using the technical solutions disclosed in the embodiments of the present disclosure, the type, use range, use scenario, etc. of the personal information involved in the present disclosure should be informed to the user and the authorization of the user should be obtained in a proper manner according to relevant laws and regulations.

[0024] For example, in response to receiving the active request of the user, prompt information is sent to the user to explicitly prompt the user that the operation requested to be performed will require obtaining and using the personal information of the user. Thus, the user can voluntarily choose whether to provide the personal information to the electronic device, application program, server or storage medium, etc. software or hardware that performs the operation of the technical solution of the present disclosure according to the prompt information.

[0025] As an optional but non-limiting implementation manner, in response to receiving the active request of the user, the manner of sending prompt information to the user may, for example, be a pop-up window manner, and the prompt information may be presented in the form of text in the pop-up window. In addition, the pop-up window may also carry selection controls for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0026] It can be understood that the above notification and user authorization process is only illustrative and does not limit the implementation of the present disclosure, and other manners meeting the relevant laws and regulations can also be applied to the implementation of the present disclosure.

[0027] As described above, interactive video can greatly improve the user's participation in watching video, thereby improving the interest of the video and attracting the user's attention to the video. However, the creation of interactive video usually depends on manual editing of ordinary video, which is time-consuming and laborious, has a long cycle and low efficiency, and is difficult to meet the demand of large-scale creation of interactive video.

[0028] Embodiments of the present disclosure provide a scheme for generating multimedia content. According to the scheme, the user is sequentially shown interactive elements to be interacted with. For each interactive element, a plurality of feedback elements are displayed, and the selection of the user on one of the plurality of feedback elements is determined according to the detected action of the user. Thus, the multimedia content recording the process of the user interacting with one or more interactive elements through actions can be automatically generated.

[0029] In addition, in order to enhance the interestingness of the video, different versions of the multimedia content can be generated for the creator and the viewer. For example, in the version for the creator, the content of the multiple feedback elements for each interactive element is presented, while in the version for the viewer, the content of the feedback elements is hidden.

[0030] Various example implementations of the scheme are described in further detail below in conjunction with the accompanying drawings. It should be understood that although in some embodiments, the scheme is described by way of example with reference to a tacit challenge game, the scope of the present disclosure is not limited thereto, and the disclosed scheme of generating multimedia content is equally applicable to other application scenarios.

[0031] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. As Figure 1 shown, the example environment 100 can include an electronic device 110. The electronic device 110 is a terminal device associated with a user 102, and can be installed with an application for browsing, shooting, editing, and making multimedia content 112. For example, the multimedia content 112 can be an interactive video. Thus, in the context of the present disclosure, the multimedia content can also be referred to as an interactive video or interactive work 112, and in some embodiments, the two can be used interchangeably.

[0032] In some embodiments, the interactive video 112 can record the process in which the user 102 interacts with the interactive elements by actions. Specifically, each interactive element can be associated with multiple feedback elements. In addition to showing the user 112 the interactive elements, the user 112 can also be shown the multiple feedback elements associated with each interactive element. In turn, for each interactive element, the selection of the user 102 on the corresponding at least one feedback element can be determined by detecting the actions of the user 102.

[0033] For example, in Figure 1 the example scenario shown, a creator and a viewer of the multimedia content jointly complete a tacit challenge game. In the tacit challenge game, the creator can record an interactive video recording his answers to one or more questions. After the recording is completed, the interactive video can be published on a video platform for the viewer to browse. When playing the interactive video, the alternative answers to each question and the content of the answer selected by the creator are hidden, so that the viewer can only see the process of the creator posing the questions, but cannot learn the specific answers. Subsequently, the viewer can record a video of his independent answers to the same questions. In turn, based on the answers of the creator and the viewer to the same questions, the matching degree, i.e., the tacit degree, of the two can be determined.

[0034] In the above example scenario, the question is an interactive element, and the alternative answers to the question are feedback elements. In the following, the creator can also be referred to as a questioner, and the viewer can also be referred to as an answerer. It should be understood that the question and the answer are only given as one of the specific examples of the interactive element and the feedback element, respectively, and other forms of the interactive element and the feedback element can also be used in other embodiments. Thus, the scope of the present disclosure is not limited in this respect.

[0035] With continued reference to Figure 1 In the process of generating the multimedia content 112 (e.g., the creator asking questions), the electronic device 110 can sequentially present one or more questions for the user 102 to answer. The questions can be selected by the user 102 from a set of candidate questions, or the questions can be edited by the user 102. Each question can have a plurality of alternative answers, and the alternative answers can be displayed in an answer board. For example, the alternative answers to the question “Do you like sports?” can include “like” and “dislike.” In some embodiments, the electronic device 110 can first display a plurality of default alternative answers to the question. In turn, the user 102 can make modifications to one or more of the alternative answers, thereby increasing the diversity and personalization of the answering.

[0036] The electronic device 110 can determine the selection of one of the alternative answers by the user 102 by detecting the action of the user 102. In some embodiments, the action of the user 102 can include a partial body action or expression, such as turning the head to one side of the answer to be selected, pointing to the answer to be selected with a hand, a mouth, or the like, or a gesture to the touch screen of the electronic device 110, and the like. Additionally or alternatively, in some embodiments, the action of the user 102 can include a full body action, such as jumping to one side of the answer to be selected, and the like. In this way, the interactive part of the video can be enriched, and the interest of the work can be increased.

[0037] In the process of generating the multimedia content 112, the electronic device 110 can record the questions answered by the user 102 in a table component. Additionally, the table component can also record the order of the questions. Further, the electronic device 110 can generate a sub-template prop corresponding to the answering special effect based on the table component. In some embodiments, the electronic device 110 can communicate with a remote server (not shown) to implement the provision of services for the application, the storage and access of the multimedia content and its special effects, and the props.

[0038] Further, to achieve differentiated display of the interactive video, the electronic device 110 can utilize the first layer prop to draw display areas for the multiple alternative answers and the second layer prop to draw the content of the multiple alternative answers when displaying the alternative answers. Accordingly, the electronic device 110 can generate different versions of the multimedia content. For example, in the version generated for the creator (e.g., the first multimedia content), both the first layer prop and the second layer prop can be recorded, while in the version generated for the viewer (e.g., the second multimedia content), only the first layer prop can be recorded without the second layer prop. In this way, when the creator records the video, the electronic device 110 can display the answers to the questions, while in the published video, the display areas for the multiple alternative answers for each question can be filled with other content (e.g., other patterns, icons, etc.). In other words, the viewers of the video can only see the answering process of the creator for each question, but cannot view the answers selected by the creator. Thus, the viewers can later independently answer the same questions to test the tacit understanding between the creator and the viewers.

[0039] Further, in some embodiments, the electronic device 110 can also generate virtual resources associated with the multimedia content 112 to be distributed to other users (e.g., viewers) who browse the multimedia content 112 and interact with one or more interactive elements. The virtual resources can include, but are not limited to, points, coupons, props, gifts, red packets, etc. distributed to other users. For example, in the case where a viewer completes a specific operation according to the prompt information in the video, at least a portion of the virtual resources can be distributed to the viewer. The amount of the virtual resources distributed can be related to the interactive performance of the viewer. For example, the amount of the virtual resources distributed can be determined based on the matching degree of the answers of the viewer and the creator on one or more questions. In this way, the participation of the users can be enhanced and the video play amount can be increased.

[0040] In some embodiments, the user 102 can publish the generated multimedia content 112 on a video platform via the electronic device 110. Additionally, a link to the anchor control for recording the answering video can be attached in the publication page of the multimedia content 112 for the viewers to answer the same questions. Specifically, by activating the anchor control, the sub-template prop corresponding to the answering special effect can be enabled. Accordingly, during the recording of the answering video, the electronic device of the answerer sequentially displays the questions to which the questioner has answered based on the sub-template prop. The electronic device of the answerer can also send a message to the application upper layer to indicate the alternative answers corresponding to the questions and the order of the questions.

[0041] The electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal including a mobile handset, a tablet computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an electronic book device, a game device, or any combinations of these devices, including accessories and peripherals for these devices, or any combinations thereof. In some embodiments, the electronic device 110 can also support any type of interface to the user (such as "wearable" circuitry, etc.). The remote server is various types of computing systems / servers capable of providing computing power, including but not limited to mainframes, edge computing nodes, computing devices in a cloud environment, etc.

[0042] It should be understood that the structure and functionality of the environment 100 are described for illustrative purposes only and are not intended to imply any limitations with regard to the scope of the present disclosure. It should also be understood that the environment 100 is equally applicable to a scenario in which multimedia content corresponding to a response video is generated. In this scenario, the user 102 is a respondent or a viewer and records a response video via the electronic device 110.

[0043] Embodiments will also be described in the following with reference to several example states of user interfaces (UIs). It should be understood that these UIs and interactions are merely illustrative and that various other interface designs and interactions can exist. Additionally, the controls included in these UIs can be implemented using any currently known or future developed UI elements and techniques. Furthermore, the types, forms, modes of operation, layouts, arrangements, etc. of these controls are illustrative and are not intended to limit the scope of the present disclosure in any way.

[0044] Figure 2 A flowchart of an example process 200 for generating multimedia content according to some embodiments of the present disclosure is shown. Illustratively, the process 200 can be implemented independently by the electronic device 110 or by a combination of the electronic device 110 and other computing devices. For ease of discussion, the process 200 will be described with reference to the environment 100 of FIG. 1 and in conjunction with the example UIs of FIGS. 2-5. Figure 1 Figure 1 Figures 3A to 3H

[0045] As an example scenario, the process 200 can be a process in which a creator records multimedia content, and accordingly, the user 102 is a creator of the multimedia content. As shown in FIG. 1, the electronic device 110 can present one or more interactive elements in sequence for the user 102 to interact with, at block 210. Figure 2

[0046] ​​​​For each interactive element, the electronic device 110 can display a plurality of feedback elements. Figure 3A A schematic diagram showing an example UI of the electronic device 110 is shown. As Figure 3A shown, the interface 300 is a tacit challenge interface, where the interactive element is a question, and the feedback elements are alternative answers. The interface 300 includes a display area 301 for the question, a control 302 for editing the question, display areas 303 and 304 for a plurality of alternative answers to the question. An image 305 of the user 102 or an avatar corresponding to the user 102 is also presented in the interface 300. In addition, the interface 300 also includes a recording control 306 for controlling the start and end of recording of the interactive video.

[0047] In some embodiments, the electronic device 110 can determine the selection of one of the plurality of feedback elements by the user 102 according to the detected action of the user 102. As Figure 3B shown, the question 301 "Do you like sports?" and two alternative answers, i.e., the alternative answer 303 "like" and the alternative answer 304 "dislike", are shown in the interface 310. Since the detected action 315 of the user 102 is to turn the head to the alternative answer 303, it can be determined that the user 102 selects the answer 303.

[0048] As an example, the user action for selecting an alternative answer can include a local action or expression of the user's body, e.g., turning the head to the side of the answer to be selected, pointing to the answer to be selected with a hand, mouth, etc., or a gesture to the touch screen of the electronic device 110, etc. The user action can also include a full-body action, e.g., jumping to the side of the answer to be selected. In this way, the user's sense of participation can be enhanced, and the interactive session of the video and the interest can be enriched.

[0049] Additionally or alternatively, in some embodiments, after detecting the valid action of the user, the electronic device 110 can present a special effect 316 to indicate the selection of the feedback element by the user.

[0050] In some embodiments, the displayed interactive element can be randomly selected by the electronic device 110 from a predefined set of interactive elements. Additionally or alternatively, the user 102 can edit, modify, delete the displayed interactive element. In such embodiments, the electronic device 110 can receive the edit of at least one of the one or more interactive elements by the user 102.

[0051] In Figure 3CIn the illustrated interface 320, the electronic device 110 detects a long-press gesture by the user 102 on the display area 321 for the question. As an example, the long-press gesture can trigger an editing operation on the content of the question in the display area 321. In turn, the electronic device 110 receives an input by the user 102 on the question. As another example, the user 102 can delete the presented question by triggering the edit control 302.

[0052] In some embodiments, the plurality of feedback elements for the interactive element can be randomly selected by the electronic device 110 from a predefined set of feedback elements. Additionally or alternatively, the user 102 can edit, modify, delete at least one of the displayed feedback elements. In such embodiments, the electronic device 110 can receive an edit by the user 102 on at least one of the plurality of feedback elements for at least one of the one or more interactive elements.

[0053] For example, in the illustrated interface 320, the user 102 can trigger the edit control 302 to delete the question “What is the favorite taste of Tofu Pudding?” Figure 3C In the illustrated interface 320, the displayed alternative answers for the question “What is the favorite taste of Tofu Pudding?” are answer 322 “Salty” and answer 323 “Sweet”. As Figure 3D As illustrated, in the interface 330, the electronic device 110 detects a long-press gesture by the user 102 on the display area of the alternative answer 322. As an example, the long-press gesture can trigger an editing operation on the content of the answer in the display area. In turn, the electronic device 110 receives an input by the user 102 on the alternative answer, e.g., answer 332 “Spicy”.

[0054] In some embodiments, the electronic device 110 can detect a predetermined action by the user 102. If the predetermined action is detected, the electronic device 110 can skip the currently presented interactive element to the user 102. As Figure 3E As illustrated, in the interface 340, the electronic device 110 detects a predetermined action 343 by the user, e.g., a swipe gesture to the left in the display area 341 for the question. As an example, the predetermined action can be used to skip the currently presented question, i.e., to change the question. Further, in response to the predetermined action, the electronic device 110 can present another question of the one or more questions and the corresponding plurality of alternative answers. As Figure 3F As illustrated, in response to the left swipe gesture, in the interface 350, the question presented in the display area 351 for the question is changed to “What is the favorite taste?” and the alternative answers are also changed accordingly.

[0055] The predetermined action to skip the question can include, but is not limited to, a quick turn of the head, a nod, a raise of the head, a clap, a swipe gesture, a tap gesture, etc. Of course, as previously mentioned, the user 102 can also delete the currently presented question by triggering the control 342.

[0056] With continued referenceFigure 2 After completing the interaction with the selected one or more interactive elements and feedback elements, at block 220, the electronic device 110 generates the first multimedia content and the second multimedia content. The first multimedia content and the second multimedia content record the process of the user 102 interacting with the one or more interactive elements through the actions. In the first multimedia content, the content of the plurality of feedback elements for each interactive element can be presented, and in the second multimedia content, the content of the plurality of feedback elements for each interactive element is hidden.

[0057] In some embodiments, the electronic device 110 can record the interactive element in which the user 102 interacts in the table component among the one or more interactive elements. Additionally, the table component can also record the order of the interactive elements. In an example scenario, the electronic device 110 can generate the sub-template prop corresponding to the quiz special effect based on the table component.

[0058] In some embodiments, to avoid affecting the independent interaction of the same interactive element by the viewer of the multimedia content, the selection of the specific feedback element by the creator should be hidden. Thus, the multimedia content can be displayed differently. Specifically, the electronic device 110 can draw the display area for the plurality of feedback elements with the first layer prop. Then, the electronic device 110 can draw the content of the plurality of feedback elements with the second layer prop. In turn, when generating the second multimedia content, the electronic device 110 can record the first layer prop without recording the second layer prop.

[0059] In an example scenario, when the creator records the quiz video, the electronic device 110 can display the answer of the question to the creator, and when the creator plays back the quiz video, the answer of the question is also presented. However, in the quiz video published to the viewer, the display area of the plurality of alternative answers for each question is rendered as other content (e.g., other patterns, icons, etc.). As Figure 3G shown, in the interface 360, the recording of the interactive video has been completed, and the user 102 can trigger the control 363 to publish the multimedia content. In the published multimedia content (i.e., the second multimedia content), the display areas 361 and 362 of the alternative answers of the question are rendered as different icons. In this way, the viewer can only see the answering process of the creator for each question, and cannot view the specific answer selected by the creator. Thus, the viewer can later independently answer the same question.

[0060] Additionally, in some embodiments, the electronic device 110 can generate a virtual resource associated with the second multimedia content in order to issue to other users who browse the multimedia content and interact with the one or more interactive elements. As Figure 3HAs shown, in the interface 370, the virtual resource is a red envelope 373. The user 102 can trigger the control 374 to push the multimedia content to a specific user to invite the specific user to answer the question.

[0061] In other embodiments, the virtual resource can include, but is not limited to, points, coupons, props, gifts, red envelopes, and the like. Additionally or alternatively, in some embodiments, the amount of virtual resource awarded can be determined based on how well other users (e.g., viewers) match the user (e.g., the creator) in interacting with one or more interactive elements. For example, in a tacit challenge, the more times the creator and the viewer select the same answer for the same question, the more virtual resource is awarded to the viewer.

[0062] According to embodiments of the present disclosure, the automatic generation of interactive videos can be facilitated, thereby improving the efficiency of creation and the quality of videos. Different versions of multimedia content can be generated based on one recording, and the relevance between, for example, the question-asking process and the answering process can be built, thereby enhancing the interest and interactive experience of the videos. In addition, the awarding of virtual resources can significantly improve the engagement of viewers, promote the play volume of videos, and thus improve the user experience.

[0063] Figure 4 A flowchart of an example process 400 for interacting with multimedia content according to some embodiments of the present disclosure is shown. By way of example, the process 200 can be implemented by an electronic device independently, or by a combination of an electronic device and other computing devices. For ease of discussion, the process 400 will be described with reference to the electronic device 110 and the user 102 as a viewer of the multimedia content. Figure 1 and in conjunction with Figure 5 , Figures 6A to 6D .

[0064] By way of example scenario, the process 400 can be a process in which a viewer interacts with multimedia content, where the user 102 is a viewer of the multimedia content. As Figure 4 shown, at block 410, the electronic device 110 plays, to the user 102, multimedia content recorded by another user (e.g., a creator), which records the process in which the other user interacts with one or more interactive elements by actions, and in the multimedia content, the content of a plurality of feedback elements for each interactive element is hidden.

[0065] Figure 5 A schematic diagram of an example UI of the electronic device 110 according to some embodiments of the present disclosure is shown. As Figure 5 shown, the interface 500 displays multimedia content related to a tacit challenge published by another user, with an anchor control 510 linked to a recorded answering video attached, for the viewer to answer the same question.

[0066] At block 420, the electronic device 110 detects the request of the user 102. If the request of the user is detected, at block 430, the electronic device 110 sequentially presents one or more interactive elements to the user 102 for interaction.

[0067] In some embodiments, the electronic device 110 can display the one or more interactive elements using a sub-template prop that records the one or more interactive elements. For example, the sub-template prop can be generated based on the interaction of another user with the one or more interactive elements along with the multimedia content. Specifically, at block 410, the electronic device 110 can receive a request of the user 102 to create a multimedia content. In response to the request, the electronic device 110 can display a sub-template prop that records the one or more interactive elements. The sub-template prop can be displayed along with the multimedia content. Figure 5 In the example scenario shown, the electronic device 110 detects that the anchor control 510 is activated. In turn, the electronic device 110 can enable a sub-template prop corresponding to the quiz effect. In response to the activation of the control 510, as shown in FIG. 6A, the electronic device 110 displays a quiz interface 600 to the user 102. Figure 6A In the example scenario shown, the electronic device 110 detects that the anchor control 510 is activated. In turn, the electronic device 110 can enable a sub-template prop corresponding to the quiz effect. In response to the activation of the control 510, as shown in FIG. 6A, the electronic device 110 displays a quiz interface 600 to the user 102.

[0068] Accordingly, during the recording of the quiz video, the electronic device 110 can sequentially present the questions to which the quiz maker has provided answers based on the sub-template prop. The electronic device 110 of the quiz maker can also send a message to the application layer to indicate the order of the questions and the corresponding answer choices. In this way, it can be ensured that the presented questions are adapted to the corresponding answer choices.

[0069] For each interactive element, the electronic device 110 can display a plurality of feedback elements. For example, the electronic device 110 can display the plurality of feedback elements at random positions. In some embodiments, the electronic device 110 can display the plurality of feedback elements in a random order. Figure 6B In the example scenario shown, the positions 612 and 613 of the answer choices for the question 611 in the interface 610 are random, and thus can be adapted to the Figure 3D The display positions 332 and 323 of the corresponding answer choices in the interface 330 of the creator shown can be different.

[0070] Further, according to the detected action of the user 102, the electronic device 110 can determine the selection of one of the plurality of feedback elements by the user 102. As shown in FIG. 6B, the electronic device 110 detects the action (e.g., finger indication) of the user 102 on the answer choice 613. Figure 6B In the example scenario shown, the electronic device 110 detects the action (e.g., finger indication) of the user 102 on the answer choice 613. In response, the electronic device 110 determines that the answer choice 613 is selected.

[0071] Additionally, in some embodiments, the electronic device 110 can determine whether the interaction of the user 102 with the one or more interactive elements is completed. Further, if the interaction is completed, the electronic device 110 can issue at least a portion of the virtual resources to the user 102 from the virtual resources associated with the multimedia content. As Figure 6C shown, after the interaction is completed, the interface 620 can present the user 102 with the virtual resources 622 to be issued. In Figure 6C the example shown, the virtual resources are shown as red packets. Of course, the virtual resources can also include points, coupons, props, gifts, or any other appropriate forms. The scope of the present disclosure is not limited in this respect. Accordingly, the user 102 can view the amount of the virtual resources issued by triggering the control 623, as Figure 6D shown.

[0072] In some embodiments, if it is determined that the interaction of the user 102 with the one or more interactive elements is completed, the electronic device 110 can display to the user 102 the matching degree of the user 102 with another user regarding the interaction of the one or more interactive elements. As Figure 6C shown, in the mutual understanding challenge scenario, the interface 620 also presents the matching degree 621 of the answers between the answerer and the questioner regarding the question.

[0073] In some embodiments, the amount of the virtual resources issued can be associated with the interactive performance of the user 102. The electronic device 110 can determine the amount of the virtual resources issued to the user based on the matching degree of the user 102 with another user regarding the interaction of the one or more interactive elements. As an example, the amount of the virtual resources issued can be proportional to the matching degree. In addition, in Figure 6D the example shown, the interface 630 also includes a control 633 for triggering the recording of the interactive video of the user 102 as the questioner.

[0074] Embodiments of the present disclosure provide a scheme for interacting with multimedia content. The scheme can automatically generate a process of recording the user's interaction with the interactive elements through actions, and issue virtual resources to the user according to the interactive performance. Different versions of multimedia content can be generated for creators and viewers, so that the interest of the interaction can be enhanced. In addition, the issuance of virtual resources can significantly improve the engagement of the viewers, and promote the play volume of the video.

[0075] Embodiments of the present disclosure also provide a corresponding apparatus for implementing the above-mentioned method or process. Figure 7 A block diagram of an apparatus 700 for generating multimedia content according to some embodiments of the present disclosure is shown. The apparatus 700 can be implemented as or included in the electronic device 110. Various modules / components in the apparatus 700 can be implemented by hardware, software, firmware, or any combination thereof.

[0076] As shown in Figure 7 The apparatus 700 further includes a first presentation module 710 configured to sequentially present one or more interactive elements for a first user to interact with, wherein for each interactive element: display a plurality of feedback elements; and in accordance with a detected action of the first user, determine a selection of one of the plurality of feedback elements by the first user.

[0077] The apparatus 700 further includes a generation module 720 configured to generate a first multimedia content and a second multimedia content, wherein the first multimedia content and the second multimedia content record a process of the first user interacting with the one or more interactive elements through the action, present content of the plurality of feedback elements for each interactive element in the first multimedia content, and in the second multimedia content, the content of the plurality of feedback elements is hidden.

[0078] In some embodiments, the apparatus 700 further includes a first receiving module configured to receive an edit of at least one of the one or more interactive elements by the first user.

[0079] In some embodiments, the apparatus 700 further includes a second receiving module configured to receive an edit of at least one of the plurality of feedback elements of at least one of the one or more interactive elements by the first user.

[0080] In some embodiments, the apparatus 700 further includes a detection module configured to detect a predetermined action of the first user; and a skipping module configured to, in response to detecting the predetermined action, skip an interactive element currently presented to the user; and present another of the one or more interactive elements and the plurality of feedback elements.

[0081] In some embodiments, the generation module 720 is configured to: record, in a table component, an interactive element of the one or more interactive elements that is interacted with by the first user; and generate a sub-template prop based on the table component.

[0082] In some embodiments, the first presentation module 710 is configured to draw a display area for the plurality of feedback elements with a first layer prop; and draw content of the plurality of feedback elements with a second layer prop, and wherein generating the second multimedia content includes: recording the first layer prop without recording the second layer prop.

[0083] The apparatus 700 further includes a virtual resource generation module configured to generate a virtual resource associated with the second multimedia content for distribution to a second user who browses the second multimedia content and interacts with the one or more interactive elements.

[0084] Figure 8A block diagram of an apparatus 800 for interacting with multimedia content according to some embodiments of the present disclosure is shown. The apparatus 800 can be implemented as or included in the electronic device 110. Various modules / components in the apparatus 800 can be implemented by hardware, software, firmware, or any combination thereof.

[0085] As shown, the apparatus 800 includes a playing module 810 configured to play, to a second user, second multimedia content recorded by a first user, the second multimedia content recording a process in which the first user interacts with one or more interactive elements through actions, wherein in the second multimedia content, content of a plurality of feedback elements for each interactive element is concealed. Figure 8

[0086] The apparatus 800 further includes a second presenting module 820 configured to, in response to a request of the second user, present, to the second user, the one or more interactive elements in turn for the second user to interact, wherein for each interactive element: display the plurality of feedback elements; and determine, according to a detected action of the second user, a selection of one of the plurality of feedback elements by the second user.

[0087] In some embodiments, the second presenting module 820 is configured to display the plurality of feedback elements at random positions.

[0088] In some embodiments, the second presenting module 820 is configured to display the one or more interactive elements using a sub-template prop recorded with the one or more interactive elements, wherein the sub-template prop is generated based on the interaction of the first user with the one or more interactive elements along with the second multimedia content.

[0089] In some embodiments, the apparatus 800 further includes a displaying module configured to, in response to completion of the interaction of the second user with the one or more interactive elements, display, to the user, a matching degree of the interaction of the first user with the second user with respect to the one or more interactive elements.

[0090] The apparatus 800 further includes a virtual resource dispensing module configured to, in response to completion of the interaction of the second user with the one or more interactive elements, dispense, to the second user, at least a portion of virtual resources from virtual resources associated with the second multimedia content.

[0091] In some embodiments, the virtual resource dispensing module is configured to determine an amount of the virtual resources to dispense to the second user based on the matching degree of the interaction of the first user with the second user with respect to the one or more interactive elements.

[0092] ​The units included in devices 700 and 800 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units may be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the units in devices 700 and 800 may be implemented at least partially by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that may be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), complex programmable logic devices (CPLDs), and so on.

[0093] Figure 9 A block diagram of a computing device / server 900 in which one or more embodiments of the present disclosure may be implemented is shown. It should be understood that... Figure 9 The computing device / server 900 shown is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein.

[0094] like Figure 9 As shown, the computing device / server 900 is in the form of a general-purpose computing device. Components of the computing device / server 900 may include, but are not limited to, one or more processors or processing units 910, memory 920, storage devices 930, one or more communication units 940, one or more input devices 960, and one or more output devices 960. The processing unit 910 may be a physical or virtual processor and is capable of performing various processes according to programs stored in the memory 920. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capabilities of the computing device / server 900.

[0095] The computing device / server 900 typically includes multiple computer storage media. Such media can be any available media accessible to the computing device / server 900, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 920 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 930 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media capable of storing information and / or data (e.g., training data for training) and accessible within the computing device / server 900.

[0096] The computing device / service 900 can further include additional removable / non-removable, volatile / non-volatile memory devices. Although not shown, a floppy disk drive, a magnetic tape drive, a CD-ROM drive, etc., can provide storage of computer-readable instructions for the computing device / service 900. In such instances, each can be connected to the bus by one or more data media interfaces. The memory 920 can include a computer-readable program product 924 having one or more program modules that implement the various embodiments of the present disclosure. Figure 9

[0097] The communication unit 940 enables communication with other computing devices over a communication medium. Additionally, the functionality of the components of the computing device / service 900 can be implemented in a single computing cluster or a plurality of computer machines that are capable of communicating over a communication connection. As such, the computing device / service 900 can operate in a networked environment using logical connections to one or more other servers, a network personal computer (PC) or another network node.

[0098] The input device 940 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. The output device 960 can be one or more output devices, such as a display, a speaker, a printer, etc. The computing device / service 900 can also communicate with one or more external devices (not shown) such as a storage device, a display device, etc. through the communication unit 940, as needed, one or more devices that enable a user to interact with the computing device / service 900, or any devices (e.g., a network card, a modem, etc.) that enable the computing device / service 900 to communicate with one or more other computing devices. Such communication can be carried out through an input / output (I / O) interface (not shown).

[0099] According to an exemplary implementation of the present disclosure, a computer readable storage medium is provided, having stored thereon one or more computer instructions, wherein the one or more computer instructions are executed by a processor to implement the method described above.

[0100] Various aspects of the disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems) and computer program products according to implementations of the disclosure. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer readable program instructions.

[0101] ​These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can include a non-transitory computer readable storage medium that can be a computer- readable storage medium having no data, programs, program modules, e.g., instructions for operation, or digital content stored thereon or therein for a short time or not at all. The computer readable storage medium can also have other meanings inhered therein by those skilled in the art.

[0102] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0103] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0104] implementations of the present disclosure have been described above, the description is illustrative only and not restrictive ones, and is not exhaustive nor limited to the disclosed implementations. Many modifications and changes can occur to one of ordinary skill in the art without departing from the scope and spirit of the described implementations. The scope of the respective implementations is defined by the appended claims, and the interpretation of the claims should be based on the entire specification of which this description is a part. The selection of the terms to be used in this document is intended to best explain the principles of the respective implementations, practical application, or improvement to the art, or to enable other of ordinary skill in the art to understand the respective implementations disclosed herein.

Claims

1. A method for generating multimedia content, comprising: sequentially presenting one or more interactive elements for a first user to interact with, an interactive element of the one or more interactive elements indicating a question, wherein for each interactive element: displaying a plurality of feedback elements, a feedback element of the plurality of feedback elements indicating an alternative answer to the question; and determining, in accordance with a detected action of the first user, a selection of one of the plurality of feedback elements by the first user; and generating a first multimedia content and a second multimedia content, wherein the first multimedia content and the second multimedia content record a process in which the first user interacts with the one or more interactive elements by the action, content of the plurality of feedback elements for each interactive element is presented in the first multimedia content, and content of the plurality of feedback elements is concealed in the second multimedia content.

2. The method of claim 1, further comprising: receiving an edit of at least one of the one or more interactive elements by the first user.

3. The method of claim 1, further comprising: receiving an edit of at least one of the plurality of feedback elements for at least one of the one or more interactive elements by the first user.

4. The method of claim 1, further comprising: detecting a predetermined action of the first user; and in response to detecting the predetermined action, skipping an interactive element that is currently presented to the first user; and presenting another interactive element of the one or more interactive elements and a plurality of feedback elements.

5. The method of claim 1, wherein generating the first multimedia content and second multimedia content comprises: recording, in a table component, an interactive element of the one or more interactive elements that is interacted with by the first user; and generating a sub-template prop based on the table component.

6. The method of claim 1, wherein displaying a plurality of feedback elements comprises: rendering, with a first layer prop, a display area for the plurality of feedback elements; and rendering, with a second layer prop, content of the plurality of feedback elements, and wherein generating the second multimedia content comprises: recording the first layer prop without recording the second layer prop.

7. The method of claim 1, further comprising: generating a virtual resource associated with the second multimedia content for distribution to a second user who browses the second multimedia content and interacts with the one or more interactive elements.

8. A method for interacting with multimedia content, comprising: playing, to a second user, a second multimedia content recorded by a first user, the second multimedia content recording a process in which the first user interacts with one or more interactive elements by an action, wherein in the second multimedia content, content of a plurality of feedback elements for each interactive element is concealed, an interactive element of the one or more interactive elements indicating a question, a feedback element of the plurality of feedback elements indicating an alternative answer to the question; and ​ ​ ​ ​ ​ ​ ​ in response to a request by the second user, sequentially presenting the one or more interactive elements to the second user for interaction by the second user, wherein for each interactive element: displaying the plurality of feedback elements; and determining a selection by the second user of one of the plurality of feedback elements based on detected actions by the second user.

9. The method of claim 8, wherein displaying the plurality of feedback elements comprises: displaying the plurality of feedback elements at random locations.

10. The method of claim 8, wherein sequentially presenting the one or more interactive elements to the second user comprises: displaying the one or more interactive elements using a sub-template prop having the one or more interactive elements recorded therein, wherein the sub-template prop is generated based on the interaction by the first user with the one or more interactive elements with the second multimedia content.

11. The method of claim 8, further comprising: in response to completion of the interaction by the second user with the one or more interactive elements, displaying to the second user a degree of match of the interaction by the second user with the first user with respect to the one or more interactive elements.

12. The method of claim 8, further comprising: in response to completion of the interaction by the second user with the one or more interactive elements, dispensing to the second user at least a portion of a virtual resource associated with the second multimedia content.

13. The method of claim 12, wherein dispensing to the second user at least a portion of the virtual resource comprises: determining an amount of the virtual resource to dispense to the second user based on the degree of match of the interaction by the first user with the second user with respect to the one or more interactive elements.

14. An apparatus for generating multimedia content, comprising: a first presentation module configured to sequentially present one or more interactive elements for interaction by a first user, an interactive element of the one or more interactive elements indicating a question, wherein for each interactive element: displaying a plurality of feedback elements, a feedback element of the plurality of feedback elements indicating an alternative answer to the question; and determining a selection by the first user of one of the plurality of feedback elements based on detected actions by the first user. and a generation module configured to generate a first multimedia content and a second multimedia content, wherein the first multimedia content and the second multimedia content record a process of the interaction by the first user with the one or more interactive elements through the actions, content of the plurality of feedback elements for each interactive element is presented in the first multimedia content, and content of the plurality of feedback elements is concealed in the second multimedia content.

15. An apparatus for interacting with multimedia content, comprising: ​ ​ a playing module configured to play, to a second user, a second multimedia content recorded by a first user, the second multimedia content recording a process in which the first user interacts with one or more interactive elements through actions, wherein in the second multimedia content, content of a plurality of feedback elements for each interactive element is hidden, an interactive element of the one or more interactive elements indicates a question, a feedback element of the plurality of feedback elements indicates an alternative answer for the question; and a second presenting module configured to, in response to a request of the second user, present, to the second user in turn, the one or more interactive elements for the second user to interact, wherein for each interactive element: display the plurality of feedback elements; and determine, according to a detected action of the second user, a selection of one of the plurality of feedback elements by the second user.

16. An electronic device, comprising: at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions which when executed by the at least one processing unit cause the electronic device to perform the method according to any one of claims 1-7 or claims 8-13.

17. A computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method according to any one of claims 1-7 or claims 8-13. ​ ​

Images