Method and apparatus for generating multimedia content, electronic device, and storage medium

Abstract

The embodiments of the present disclosure provide a method and apparatus for generating multimedia content, an electronic device, and a storage medium. The method comprises: successively displaying one or more interactive elements with which a first user can interact, wherein for each interactive element; displaying a plurality of feedback elements; according to a detected action of the first user, determining a selection of one of the plurality of feedback elements by the first user; generating first multimedia content and second multimedia content, wherein the first multimedia content and the second multimedia content record the process of the first user using actions to interact with the one or more interactive elements; presenting within the first multimedia content the content of the plurality of feedback elements for each interaction element, and in the second multimedia content, hiding the content of the plurality of feedback elements. The method promotes automatic video generation, increases creation efficiency, and enhances interaction interest and user experience.

Description

Method, device, electronic device and storage medium for generating multimedia content

[0001] This application claims priority to the Chinese invention patent application filed on December 23, 2022, with the invention name “Method, device, electronic device and storage medium for generating multimedia content” and application number 202211665112.X. The entire contents of this application are incorporated by reference into this application. Technical Field

[0002] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, apparatuses, electronic devices, and computer-readable storage media for generating multimedia content. Background Art

[0003] With the development of computer technology, various multimedia content has become an important way for people to obtain information and socialize. This multimedia content can be video works produced through filming and editing. Sometimes, to increase the viewing and participation of video works, creators can add special effects and interactive elements to the videos. This allows viewers to interact with the videos at specific points as they play, thereby enhancing the interest of the videos and the user experience.

[0004] Summary of the Invention

[0005] In a first aspect of the present disclosure, a method for generating multimedia content is provided. The method includes: sequentially presenting one or more interactive elements for a first user to interact with, wherein for each interactive element; displaying multiple feedback elements; determining, based on a detected action of the first user, whether the first user has selected one of the multiple feedback elements; and generating first multimedia content and second multimedia content, wherein the first multimedia content and the second multimedia content record the process of the first user interacting with the one or more interactive elements through the action, the content of the multiple feedback elements for each interactive element is presented in the first multimedia content, and the content of the multiple feedback elements is hidden in the second multimedia content.

[0006] In a second aspect of the present disclosure, a method for interacting with interactive multimedia content is provided. The method includes: playing second multimedia content recorded by a first user to a second user, the second multimedia content recording the first user's interaction with one or more interactive elements through actions, wherein the second multimedia content hides the content of multiple feedback elements for each interactive element; and, in response to a request from the second user, sequentially presenting the one or more interactive elements to the second user for interaction, wherein for each interactive element: multiple feedback elements are displayed; and determining, based on a detected action of the second user, a selection of one of the multiple feedback elements by the second user.

[0007] In a third aspect of the present disclosure, a device for generating interactive multimedia content is provided. The device includes: a first presentation module configured to sequentially present one or more interactive elements for a first user to interact with, wherein for each interactive element: multiple feedback elements are displayed; and based on a detected action of the first user, a selection of one of the multiple feedback elements by the first user is determined; and a generation module configured to generate first multimedia content and second multimedia content, wherein the first multimedia content and the second multimedia content record the process of the first user interacting with the one or more interactive elements through actions, the content of the multiple feedback elements for each interactive element is presented in the first multimedia content, and the content of the multiple feedback elements is hidden in the second multimedia content.

[0008] In a fourth aspect of the present disclosure, a device for interacting with multimedia content is provided. The device includes: a playback module configured to play second multimedia content recorded by a first user to a second user, the second multimedia content recording the first user's interaction with one or more interactive elements through actions, wherein the second multimedia content hides the content of multiple feedback elements for each interactive element; and a second presentation module configured to, in response to a request from the second user, sequentially present the one or more interactive elements to the second user for interaction, wherein for each interactive element: multiple feedback elements are displayed; and based on a detected action of the second user, determine the second user's selection of one of the multiple feedback elements.

[0009] In a fifth aspect of the present disclosure, an electronic device is provided. The electronic device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the electronic device to perform the method of the first aspect or the second aspect.

[0010] In a sixth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the method of the first aspect or the second aspect is implemented.

[0011] It should be understood that the contents described in the summary of the present invention are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0013] FIG1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

[0014] FIG2 illustrates a flow chart of an example process for generating multimedia content according to some embodiments of the present disclosure;

[0015] 3A to 3H illustrate schematic diagrams of example user interfaces (UIs) of electronic devices according to some embodiments of the present disclosure;

[0016] FIG4 illustrates a flow diagram of an example process for interacting with multimedia content according to some embodiments of the present disclosure;

[0017] FIG5 shows a schematic diagram of an example UI of an electronic device according to some embodiments of the present disclosure;

[0018] 6A to 6D illustrate schematic diagrams of example UIs of electronic devices according to some embodiments of the present disclosure;

[0019] FIG7 shows a block diagram of an apparatus for generating multimedia content according to some embodiments of the present disclosure;

[0020] FIG8 shows a block diagram of an apparatus for interacting with multimedia content according to some embodiments of the present disclosure; and

[0021] FIG9 illustrates a block diagram of a device capable of implementing various embodiments of the present disclosure. DETAILED DESCRIPTION

[0022] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0023] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below.

[0024] In the description of the embodiments of the present disclosure, the use of words such as "first" and "second" is merely to distinguish between different elements, objects, targets, and units, and does not imply the order or difference of these elements, objects, targets, and units in time, space, or priority.

[0025] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0026] For example, in response to a user's active request, a prompt message is sent to the user to clearly inform the user that the operation requested will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the electronic device, application, server, storage medium, or other software or hardware that performs the operations of the disclosed technical solution based on the prompt message.

[0027] As an optional but non-limiting implementation, in response to receiving a user's active request, a prompt message may be sent to the user, for example, in the form of a pop-up window, in which the prompt message may be presented in text form. Furthermore, the pop-up window may also include a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0028] It is understandable that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0029] As mentioned earlier, interactive videos can significantly enhance user engagement, making them more engaging and engaging. However, creating interactive videos often relies on manual editing of standard videos. This approach is labor-intensive, time-consuming, and inefficient, making it difficult to meet the needs of large-scale interactive video creation.

[0030] Embodiments of the present disclosure provide a solution for generating multimedia content. According to this solution, interactive elements to be interacted with are sequentially presented to a user. For each interactive element, multiple feedback elements are displayed, and based on detected user actions, the user's selection of one of the multiple feedback elements is determined. Consequently, multimedia content can be automatically generated that records the process of the user's actions interacting with one or more interactive elements.

[0031] Furthermore, to enhance the video's appeal, different versions of multimedia content can be generated for creators and viewers. For example, in the creator version, multiple feedback elements for each interactive element are presented, while in the viewer version, these feedback elements are hidden.

[0032] It should be understood that although in some embodiments, the tacit understanding challenge game is used as an example for description, the scope of the present disclosure is not limited thereto, and the disclosed solution for generating multimedia content is also applicable to other application scenarios.

[0033] FIG1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in FIG1 , example environment 100 may include an electronic device 110. Electronic device 110 is a terminal device associated with user 102 and may be installed with an application for browsing, capturing, editing, and creating multimedia content 112. For example, multimedia content 112 may be an interactive video. Therefore, in the context of the present disclosure, multimedia content may also be referred to as an interactive video or interactive work 112, and in some embodiments, the two may be used interchangeably.

[0034] In some embodiments, the interactive video 112 may record the process of user 102 interacting with interactive elements through actions. Specifically, each interactive element may be associated with multiple feedback elements. In addition to displaying the interactive elements to user 112, multiple feedback elements associated with each interactive element may also be displayed to user 112. Furthermore, for each interactive element, user 102's actions may be detected to determine whether user 102 has selected at least one corresponding feedback element.

[0035] For example, in the example scenario shown in Figure 1, the creator of multimedia content and the viewer complete a tacit understanding challenge game together. In the tacit understanding challenge game, the creator can record an interactive video of his or her answers to one or more questions. After the recording is completed, the interactive video can be posted on the video platform for viewers to browse. When the interactive video is played, the alternative answers to each question and the content of the answer selected by the creator are hidden, so the viewer can only see the creator's question-setting process, but cannot know the specific answer. Subsequently, the viewer can record a video of his or her independent answer to the same question. Furthermore, based on the answers of the creator and the viewer to the same question, the degree of matching between the two, that is, the degree of tacit understanding, can be determined.

[0036] In the above example scenario, the question serves as an interactive element, and the alternative answers to the question serve as feedback elements. Hereinafter, the creator may also be referred to as the question setter, and the viewer may also be referred to as the answerer. It should be understood that the question and answer are merely provided as specific examples of interactive elements and feedback elements, respectively. In other embodiments, other forms of interactive elements and feedback elements may also be used. Therefore, the scope of the present disclosure is not limited in this respect.

[0037] Continuing with reference to Figure 1, in the process of generating multimedia content 112 (for example, the creator asks questions), the electronic device 110 can sequentially display one or more questions for the user 102 to answer. The question can be selected by the user 102 from a set of candidate questions, or it can be a question edited by the user 102. Each question can have multiple alternative answers, and these alternative answers can be displayed in an answer board. For example, the alternative answers to the question "Do you like sports?" may include "like" and "dislike". In some embodiments, the electronic device 110 may first display multiple default alternative answers to the question. Furthermore, the user 102 can modify one or more alternative answers, thereby increasing the diversity and personalization of the answers.

[0038] The electronic device 110 can determine the user's 102 selection of one of the multiple alternative answers by detecting the user's 102 actions. In some embodiments, the user's 102 actions can include local body movements or expressions, such as tilting the head toward the selected answer, pointing at the selected answer with a hand or mouth, or gestures on the touch screen of the electronic device 110. Additionally or alternatively, in some embodiments, the user's 102 actions can include full-body movements, such as jumping toward the selected answer. This approach can enrich the interactive aspects of the video and increase the interest of the work.

[0039] In the process of generating multimedia content 112, electronic device 110 can record the questions answered by user 102 in a table component. Additionally, the table component can also record the order of the questions. Furthermore, electronic device 110 can generate sub-template props corresponding to the answering special effects based on the table component. In some embodiments, electronic device 110 can communicate with a remote server (not shown) to implement the provision of application services, storage and access to multimedia content and its special effects and props.

[0040] Furthermore, to achieve differentiated display in interactive videos, when displaying alternative answers, electronic device 110 can use a first layer of props to draw a display area for multiple alternative answers, and a second layer of props to draw the content of the multiple alternative answers. Accordingly, electronic device 110 can generate different versions of multimedia content. For example, in the version generated for the creator (e.g., the first multimedia content), both the first and second layers of props can be recorded, while in the version generated for the viewer (e.g., the second multimedia content), only the first layer of props can be recorded, without the second layer of props. Thus, when the creator records the video, electronic device 110 can display the answer to the question, while in the published video, the display area for the multiple alternative answers to each question can be filled with other content (e.g., other graphics, icons, etc.). In other words, viewers of the video can only see the creator's answer process for each question, but cannot view the answer the creator chooses. This allows viewers to later independently answer the same question, testing the rapport between creator and viewer.

[0041] In addition, in some embodiments, the electronic device 110 may also generate virtual resources associated with the multimedia content 112 so as to be distributed to other users (e.g., viewers) who browse the multimedia content 112 and interact with one or more interactive elements. Virtual resources may include, but are not limited to, points, coupons, props, gifts, red envelopes, etc. distributed to other users. For example, when a viewer completes a specific operation according to the prompt information in the video, at least a portion of the virtual resources may be distributed to the viewer. The amount of virtual resources distributed may be related to the viewer's interactive performance. For example, the amount of virtual resources distributed may be determined based on the degree of match between the viewer's and the creator's answers to one or more questions. In this way, the user's sense of participation may be enhanced and the video playback volume may be increased.

[0042] In some embodiments, the user 102 can publish the generated multimedia content 112 on the video platform via the electronic device 110. Additionally, the publishing page of the multimedia content 112 can be attached with an anchor control that links to the recorded answering video for viewers to answer the same question. Specifically, by activating the anchor control, the sub-template props corresponding to the answering special effects can be enabled. Accordingly, in the process of recording the answering video, the electronic device of the answerer sequentially displays the questions that the questioner has answered based on the sub-template props. The electronic device of the answerer can also send a message to the upper layer of the application to indicate the alternative answers corresponding to the question and the order of the questions.

[0043] The electronic device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface for the user (such as a "wearable" circuit, etc.). The remote server is various types of computing systems / servers that can provide computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, and the like.

[0044] It should be understood that the structure and functionality of environment 100 are described for exemplary purposes only and do not imply any limitation on the scope of the present disclosure. It should also be understood that environment 100 is also applicable to scenarios where multimedia content corresponding to a quiz video is generated. In this scenario, user 102 is either a quiz responder or a viewer, and records the quiz video via electronic device 110.

[0045] The embodiments will be described below with reference to example states of several user interfaces (UIs). It should be understood that these UIs and interactions are merely illustrative, and that various interface designs and interaction methods may exist. In addition, the controls included in these UIs may be implemented using any currently known or future developed UI elements and technologies. Furthermore, the types, forms, modes of operation, layouts in the UIs, and arrangements of these controls are all illustrative and are not intended to limit the scope of this disclosure in any form.

[0046] FIG2 illustrates a flow chart of an example process 200 for generating multimedia content according to some embodiments of the present disclosure. For example, process 200 may be implemented independently by electronic device 110 of FIG1 , or by a combination of electronic device 110 and other computing devices. For ease of discussion, process 200 will be described with reference to environment 100 of FIG1 and in conjunction with FIG3A through FIG3H .

[0047] As an example scenario, process 200 may be a process in which a creator records multimedia content, and accordingly, user 102 serves as the creator of the multimedia content. As shown in FIG2 , at block 210 , electronic device 110 sequentially displays one or more interactive elements for user 102 to interact with.

[0048] For each interactive element, the electronic device 110 can display multiple feedback elements. Figure 3A shows a schematic diagram of an example UI of the electronic device 110 according to some embodiments of the present disclosure. As shown in Figure 3A, the interface 300 is a tacit challenge interface, in which the interactive elements are questions and the feedback elements are alternative answers. The interface 300 includes a display area 301 for questions, a control 302 for editing questions, and display areas 303 and 304 for multiple alternative answers to the questions. The interface 300 also presents an image 305 of the user 102 or an avatar corresponding to the user 102. In addition, the interface 300 also includes a recording control 306 for controlling the start and end of recording of the interactive video.

[0049] In some embodiments, electronic device 110 can determine user 102's selection of one of multiple feedback elements based on a detected action of user 102. As shown in FIG3B , interface 310 displays question 301, "Do you like sports?" and two alternative answers: alternative answer 303, "I like it," and alternative answer 304, "I don't like it." Because user 102's detected action 315 is tilting his head toward alternative answer 303, user 102's selection of answer 303 can be determined.

[0050] For example, the user action used to select an alternative answer can include a local movement or expression of the user's body, such as tilting the head toward the desired answer, pointing to the desired answer with a hand or mouth, or gestures on the touch screen of the electronic device 110. The user action can also include a full-body movement, such as jumping toward the desired answer. In this way, the user's sense of participation can be enhanced, enriching the interactive elements and fun of the video.

[0051] Additionally or alternatively, in some embodiments, after detecting a valid action of the user, the electronic device 110 may present a special effect 316 to indicate the user's selection of the feedback element.

[0052] In some embodiments, the displayed interactive element may be randomly selected by the electronic device 110 from a predefined set of interactive elements. Additionally or alternatively, the user 102 may edit, modify, or delete the displayed interactive element. In such an embodiment, the electronic device 110 may receive the user 102's edit of at least one of the one or more interactive elements.

[0053] In interface 320 shown in FIG3C , electronic device 110 detects a long-press gesture by user 102 on display area 321 for a question. For example, the long-press gesture may trigger an edit operation on the question content in display area 321. Subsequently, electronic device 110 receives the user's input regarding the question. For another example, user 102 may delete the displayed question by triggering edit control 302.

[0054] In some embodiments, the multiple feedback elements for the interactive element may be randomly selected by the electronic device 110 from a predefined set of feedback elements. Additionally or alternatively, the user 102 may edit, modify, or delete at least one of the displayed feedback elements. In such an embodiment, the electronic device 110 may receive an edit from the user 102 to at least one of the multiple feedback elements for at least one of the one or more interactive elements.

[0055] For example, in interface 320 shown in FIG3C , the answer options displayed for the question "What flavor do you like for tofu pudding?" are answer 322 "Cooked" and answer 323 "Sweet." As shown in FIG3D , in interface 330 , electronic device 110 detects a long press gesture by user 102 on the display area for answer option 322. For example, a long press gesture can trigger an edit operation on the answer content in the display area. Subsequently, electronic device 110 receives user 102's input for the answer option, for example, answer 332 "Spicy."

[0056] In some embodiments, the electronic device 110 can detect a predetermined action of the user 102. If the predetermined action is detected, the electronic device 110 can skip the interactive element currently displayed to the user 102. As shown in Figure 3E, in the interface 340, the electronic device 110 detects a predetermined action 343 of the user, for example, sliding a finger to the left in the display area 341 for the question. As an example, the predetermined action can be used to skip the currently displayed question, that is, to change the question. Further, in response to the predetermined action, the electronic device 110 can display another question of one or more questions and the corresponding multiple alternative answers. As shown in Figure 3F, in response to the left swipe gesture, in the interface 350, the question displayed in the display area 351 for the question is changed to "What is your favorite taste?", and the alternative answers are also changed accordingly.

[0057] The predetermined action for skipping a question may include, but is not limited to, quickly turning the head, nodding, looking up, clapping, sliding gestures, clicking gestures, etc. Of course, as mentioned above, the user 102 may also delete the currently displayed question by triggering the control 342 .

[0058] Continuing with FIG2 , after completing the interaction with the selected one or more interactive elements and feedback elements, electronic device 110 generates first and second multimedia content at block 220. The first and second multimedia content record the process of user 102 interacting with the one or more interactive elements through actions. The first multimedia content may include the content of multiple feedback elements for each interactive element, while the second multimedia content may include the content of multiple feedback elements for each interactive element.

[0059] In some embodiments, the electronic device 110 may record the interactive elements interacted with by the user 102 in a table component. Additionally, the table component may also record the order of the interactive elements. In an example scenario, the electronic device 110 may generate a sub-template prop corresponding to a question-answering special effect based on the table component.

[0060] In some embodiments, to avoid influencing viewers of multimedia content to independently interact with the same interactive elements, the creator's selection of specific feedback elements should be hidden. Thus, multimedia content can be displayed differently. Specifically, electronic device 110 can use a first layer of props to draw a display area for multiple feedback elements. Then, electronic device 110 can use a second layer of props to draw the content of the multiple feedback elements. Subsequently, when generating the second multimedia content, electronic device 110 can record the first layer of props but not the second layer of props.

[0061] In an example scenario, when the creator records a question-posing video, the electronic device 110 can display the answer to the question to the creator, and when the creator plays back the question-posing video, the answer to the question is also presented. However, in the question-posing video released to the viewer, the display area for multiple alternative answers to each question is rendered as other content (e.g., other patterns, icons, etc.). As shown in Figure 3G, in interface 360, the recording of the interactive video has been completed, and the user 102 can trigger control 363 to publish multimedia content. In the published multimedia content (i.e., the second multimedia content), the display areas 361 and 362 of the alternative answers to the question are rendered as different icons. In this way, the viewer can only see the creator's answering process for each question, but cannot view the specific answer selected by the creator. Thus, the viewer can answer the same question independently later.

[0062] Additionally, in some embodiments, electronic device 110 can generate a virtual resource associated with the second multimedia content for distribution to other users who browse the multimedia content and interact with one or more interactive elements. As shown in FIG3H , in interface 370 , the virtual resource is a red envelope 373. User 102 can trigger control 374 to push the multimedia content to a specific user, inviting the specific user to answer a question.

[0063] In other embodiments, virtual resources may include, but are not limited to, points, coupons, props, gifts, red envelopes, and the like. Additionally or alternatively, in some embodiments, the amount of virtual resources distributed may be determined based on the degree of matching between other users (e.g., viewers) and the user (e.g., creator) in their interactions with respect to one or more interactive elements. For example, in a tacit understanding challenge, the more times a creator and a viewer choose the same answer to the same question, the more virtual resources will be distributed to the viewer.

[0064] According to the embodiments of the present disclosure, the automatic generation of interactive videos can be facilitated, thereby improving creation efficiency and video quality. Based on a single recording, different versions of multimedia content can be generated, thereby establishing connections between the question-posing process and the answering process, thereby enhancing the video's fun and interactive experience. Furthermore, the distribution of virtual resources can significantly increase viewer engagement, promote video playback, and thus improve the user experience.

[0065] FIG4 illustrates a flow chart of an example process 400 for interacting with multimedia content according to some embodiments of the present disclosure. For example, process 200 may be implemented independently by an electronic device, or by a combination of an electronic device and other computing devices. For ease of discussion, process 400 will be described with reference to FIG1 and in conjunction with FIG5 and FIG6A through FIG6D.

[0066] As an example scenario, process 400 can be a process of a viewer interacting with multimedia content, wherein user 102 serves as the viewer of the multimedia content. As shown in FIG4 , at block 410, electronic device 110 plays multimedia content recorded by another user (e.g., an author) to user 102. The multimedia content records the process of the other user interacting with one or more interactive elements through actions, and in the multimedia content, the content of multiple feedback elements for each interactive element is hidden.

[0067] Figure 5 illustrates a schematic diagram of an example UI of electronic device 110 according to some embodiments of the present disclosure. As shown in Figure 5 , interface 500 displays multimedia content related to a tacit understanding challenge posted by another user, along with an anchor control 510 linking to a recorded answer video, allowing viewers to answer the same question.

[0068] In block 420 , the electronic device 110 detects a request from the user 102 . If a request from the user is detected, then in block 430 , the electronic device 110 sequentially presents one or more interactive elements to the user for the user 102 to interact with.

[0069] In some embodiments, the electronic device 110 can use a sub-template prop that records one or more interactive elements to display one or more interactive elements. For example, the sub-template prop can be generated along with the multimedia content based on another user's interaction with the one or more interactive elements. Specifically, in the example scenario shown in Figure 5, the electronic device 110 detects that the anchor control 510 is activated. Then, the electronic device 110 can enable the sub-template prop corresponding to the answering effect. In response to the control 510 being activated, as shown in Figure 6A, the electronic device 110 switches to the user 102's answering interface 600, which includes a display area 601 for the question, display areas 602 and 603 for multiple alternative answers, an image 604 of the user 102, or an avatar corresponding to the user 102. In addition, the interface 600 also includes a recording control 605 for controlling the start and end of the recording of the answering video.

[0070] Accordingly, while recording the answering video, the electronic device 110 can sequentially display the questions the questioner has answered based on the sub-template props. The answerer's electronic device 110 can also send a message to the upper application layer to indicate the corresponding alternative answers and the order of the questions. In this way, the displayed questions can be ensured to be compatible with the corresponding alternative answers.

[0071] For each interactive element, electronic device 110 may display multiple feedback elements. For example, electronic device 110 may display multiple feedback elements in random positions. In the example scenario shown in FIG6B , positions 612 and 613 of the alternative answers to question 611 in interface 610 are random and may differ from positions 332 and 323 of the corresponding alternative answers in the creator's interface 330 shown in FIG3D .

[0072] Furthermore, based on the detected action of user 102, electronic device 110 can determine user 102's selection of one of the multiple feedback elements. As shown in FIG6B , user 102's action on alternative answer 613 (e.g., pointing with a finger) is detected, and electronic device 110 determines that alternative answer 613 is selected.

[0073] Additionally, in some embodiments, the electronic device 110 can determine whether the interaction between the user 102 and one or more interactive elements is completed. Further, if the interaction is completed, the electronic device 110 can issue at least a portion of the virtual resources to the user 102 from the virtual resources associated with the multimedia content. As shown in Figure 6C, after the interaction is completed, the interface 620 can present the virtual resources 622 to be issued to the user 102. In the example of Figure 6C, the virtual resources are shown as red envelopes. Of course, virtual resources can also include points, coupons, props, gifts, or any other appropriate form. The scope of the present disclosure is not limited in this respect. Accordingly, the user 102 can view the amount of the issued virtual resources by triggering the control 623, as shown in Figure 6D.

[0074] In some embodiments, if it is determined that user 102 has completed interaction with one or more interactive elements, electronic device 110 may display to user 102 the degree of match between user 102 and another user's interaction with respect to the one or more interactive elements. As shown in FIG6C , in a tacit understanding challenge scenario, interface 620 also displays the degree of match 621 between the answerer and the questioner regarding the question.

[0075] In some embodiments, the amount of virtual resources distributed can be associated with the interactive performance of user 102. Electronic device 110 can determine the amount of virtual resources distributed to a user based on the degree of match between user 102 and another user regarding one or more interactive elements. As an example, the amount of virtual resources distributed can be proportional to the degree of match. In addition, in the example of Figure 6D, interface 630 also includes a control 633 for triggering the recording of an interactive video of user 102 as the question setter.

[0076] Embodiments of the present disclosure provide a solution for interacting with multimedia content. This solution automatically generates a record of the user's actions interacting with interactive elements and distributes virtual resources to users based on their interaction performance. Different versions of multimedia content can be generated for creators and viewers, thereby enhancing the fun of interaction. Furthermore, the distribution of virtual resources can significantly increase viewer engagement and boost video playback.

[0077] Embodiments of the present disclosure also provide corresponding apparatuses for implementing the above-described methods or processes. FIG7 shows a block diagram of an apparatus 700 for generating multimedia content according to some embodiments of the present disclosure. The apparatus 700 may be implemented as or included in the electronic device 110. The various modules / components in the apparatus 700 may be implemented by hardware, software, firmware, or any combination thereof.

[0078] As shown in Figure 7, the device 700 includes a first display module 710, which is configured to display one or more interactive elements in sequence for the first user to interact, wherein for each interactive element: multiple feedback elements are displayed; and based on the detected action of the first user, the first user's selection of one of the multiple feedback elements is determined.

[0079] The device 700 also includes a generation module 720, which is configured to generate first multimedia content and second multimedia content, wherein the first multimedia content and the second multimedia content record the process of the first user interacting with one or more interactive elements through actions, presenting the content of multiple feedback elements for each interactive element in the first multimedia content, and in the second multimedia content, the content of the multiple feedback elements is hidden.

[0080] In some embodiments, the apparatus 700 further includes a first receiving module configured to receive an edit of at least one of the one or more interactive elements by the first user.

[0081] In some embodiments, the apparatus 700 further includes a second receiving module configured to receive an edit by the first user of at least one feedback element among the plurality of feedback elements of at least one interactive element among the one or more interactive elements.

[0082] In some embodiments, the device 700 also includes a detection module configured to detect a predetermined action of the first user; and a skip module configured to skip the interactive element currently displayed to the user in response to detecting the predetermined action; and display another interactive element among the one or more interactive elements and multiple feedback elements.

[0083] In some embodiments, the generation module 720 is configured to: record the interactive element interacted by the first user among the one or more interactive elements in a table component; and generate a sub-template prop based on the table component.

[0084] In some embodiments, the first display module 710 is configured to draw a display area for multiple feedback elements using a first layer of props; and draw content of the multiple feedback elements using a second layer of props, and wherein generating the second multimedia content includes: recording the first layer of props without recording the second layer of props.

[0085] The apparatus 700 further includes a virtual resource generation module configured to generate a virtual resource associated with the second multimedia content, so as to distribute the virtual resource to a second user who browses the second multimedia content and interacts with one or more interactive elements.

[0086] 8 shows a block diagram of an apparatus 800 for interacting with multimedia content according to some embodiments of the present disclosure. The apparatus 800 may be implemented as or included in the electronic device 110. Each module / component in the apparatus 800 may be implemented by hardware, software, firmware, or any combination thereof.

[0087] As shown in Figure 8, the device 800 includes a playback module 810, which is configured to play second multimedia content recorded by the first user to the second user, where the second multimedia content records the process of the first user interacting with one or more interactive elements through actions, wherein in the second multimedia content, the content of multiple feedback elements for each interactive element is hidden.

[0088] The device 800 also includes a second display module 820, which is configured to, in response to a request from the second user, sequentially display one or more interactive elements to the second user for the second user to interact with, wherein for each interactive element: multiple feedback elements are displayed; and based on the detected action of the second user, the second user's selection of one of the multiple feedback elements is determined.

[0089] In some embodiments, the second display module 820 is configured to display the plurality of feedback elements in random positions.

[0090] In some embodiments, the second display module 820 is configured to display the one or more interactive elements using a sub-template prop having one or more interactive elements recorded thereon, wherein the sub-template prop is generated along with the second multimedia content based on the first user's interaction with the one or more interactive elements.

[0091] In some embodiments, the apparatus 800 further includes a display module configured to display to the user a degree of matching between the first user and the second user's interactions with respect to one or more interactive elements in response to the second user completing the interaction with the one or more topics.

[0092] The apparatus 800 further includes a virtual resource issuing module configured to issue at least a portion of virtual resources associated with the second multimedia content to the second user in response to the second user completing the interaction with the one or more interactive elements.

[0093] In some embodiments, the virtual resource issuing module is configured to determine the amount of virtual resources issued to the second user based on a degree of matching between the first user and the second user's interactions with respect to one or more interactive elements.

[0094] The units included in devices 700 and 800 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units can be implemented using software and / or firmware, such as machine executable instructions stored on a storage medium. In addition to or as an alternative to machine executable instructions, some or all of the units in devices 700 and 800 can be implemented at least in part by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0095] Figure 9 shows a block diagram of a computing device / server 900 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the computing device / server 900 shown in Figure 9 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein.

[0096] As shown in Figure 9, computing device / server 900 is in the form of a general-purpose computing device. Components of computing device / server 900 may include, but are not limited to, one or more processors or processing units 910, memory 920, storage device 930, one or more communication units 940, one or more input devices 960, and one or more output devices 960. Processing unit 910 may be a real or virtual processor and is capable of performing various processes according to a program stored in memory 920. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to increase the parallel processing capabilities of computing device / server 900.

[0097] The computing device / server 900 typically includes a plurality of computer storage media. Such media can be any available media accessible to the computing device / server 900, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 920 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory) or some combination thereof. The storage device 930 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk or any other medium, which can be used to store information and / or data (e.g., training data for training) and can be accessed within the computing device / server 900.

[0098] The computing device / service 900 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 9 , a disk drive for reading from or writing to a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 920 may include a computer program product 924 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0099] The communication unit 940 enables communication with other computing devices via a communication medium. Additionally, the functionality of the components of the computing device / server 900 can be implemented as a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the computing device / server 900 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or other network nodes.

[0100] Input device 940 may be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 960 may be one or more output devices, such as a display, speaker, printer, etc. Computing device / server 900 may also communicate with one or more external devices (not shown) via communication unit 940 as needed, such as storage devices, display devices, etc., with one or more devices that allow users to interact with computing device / server 900, or with any device that allows computing device / server 900 to communicate with one or more other computing devices (e.g., a network card, modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0101] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which one or more computer instructions are stored, wherein the one or more computer instructions are executed by a processor to implement the method described above.

[0102] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0103] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0104] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device, so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0105] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0106] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the implementations disclosed herein.

Claims

1. A method for generating multimedia content, comprising: One or more interactive elements are sequentially displayed for interaction by the first user, wherein for each interactive element: Display multiple feedback elements; as well as determining, based on the detected action of the first user, a selection of one of the plurality of feedback elements by the first user; as well as Generate first multimedia content and second multimedia content, wherein the first multimedia content and the second multimedia content record a process in which the first user interacts with the one or more interactive elements through the action, present the contents of the multiple feedback elements for each interactive element in the first multimedia content, and hide the contents of the multiple feedback elements in the second multimedia content.

2. The method according to claim 1, further comprising: An edit of at least one of the one or more interactive elements by the first user is received.

3. The method according to claim 1, further comprising: An edit by the first user to at least one feedback element of the plurality of feedback elements of at least one interactive element of the one or more interactive elements is received.

4. The method according to claim 1, further comprising: detecting a predetermined action of the first user; as well as In response to detecting the predetermined action, skipping the interactive element currently being presented to the first user; as well as Another interactive element of the one or more interactive elements and a plurality of feedback elements are presented.

5. The method of claim 1 , wherein generating the first multimedia content and the second multimedia content comprises: The interactive element interacted by the first user among the one or more interactive elements Elements are recorded in the table component; as well as Generates child template props based on the table component.

6. The method of claim 1 , wherein displaying a plurality of feedback elements comprises: Drawing a display area for the plurality of feedback elements using the first layer of props; as well as Using the second layer of props to draw the contents of the multiple feedback elements, And wherein generating the second multimedia content includes: recording the first layer of props without recording the second layer of props.

7. The method according to claim 1, further comprising: A virtual resource associated with the second multimedia content is generated for distribution to a second user who browses the second multimedia content and interacts with the one or more interactive elements.

8. A method for interacting with multimedia content, comprising: Playing second multimedia content recorded by the first user to a second user, the second multimedia content recording a process in which the first user interacts with one or more interactive elements through actions, wherein the content of multiple feedback elements for each interactive element is hidden in the second multimedia content; as well as In response to the second user's request, the one or more interactive elements are sequentially displayed to the second user for interaction by the second user, wherein for each interactive element: displaying the plurality of feedback elements; as well as A selection of one of the plurality of feedback elements by the second user is determined based on the detected action of the second user.

9. The method of claim 8, wherein displaying the plurality of feedback elements comprises: The plurality of feedback elements are displayed in random positions.

10. The method according to claim 8, wherein sequentially presenting the one or more interactive elements to the second user comprises: The one or more interactive elements are displayed using a sub-template prop having the one or more interactive elements recorded therein, wherein the sub-template prop is generated along with the second multimedia content based on the interaction between the first user and the one or more interactive elements.

11. The method according to claim 8, further comprising: In response to the second user completing the interaction with the one or more interactive elements, displaying to the second user a degree of matching between the second user's interactions with the first user with respect to the one or more interactive elements.

12. The method according to claim 8, further comprising: In response to the second user completing the interaction with the one or more interactive elements, at least a portion of the virtual resources associated with the second multimedia content is released to the second user.

13. The method according to claim 12, wherein issuing at least a portion of the virtual resource to the second user comprises: The amount of the virtual resource issued to the second user is determined based on the degree of matching between the first user and the second user's interactions with respect to the one or more interactive elements.

14. An apparatus for generating multimedia content, comprising: The first display module is configured to sequentially display one or more interactive elements for the first user to interact with, wherein for each interactive element: Display multiple feedback elements; as well as determining, based on the detected action of the first user, a selection of one of the plurality of feedback elements by the first user; as well as The generating module is configured to generate first multimedia content and second multimedia content, wherein the first multimedia content and the second multimedia content record the process of the first user interacting with the one or more interactive elements through the action, present the content of the multiple feedback elements for each interactive element in the first multimedia content, and hide the content of the multiple feedback elements in the second multimedia content.

15. An apparatus for interacting with multimedia content, comprising: a playback module configured to play second multimedia content recorded by the first user to a second user, the second multimedia content recording a process of the first user interacting with one or more interactive elements through actions, wherein in the second multimedia content, content of multiple feedback elements for each interactive element is hidden; as well as The second display module is configured to display the one or more interactive elements to the second user in sequence in response to the second user's request for the second user to interact with. For each interactive element: displaying the plurality of feedback elements; as well as A selection of one of the plurality of feedback elements by the second user is determined based on the detected action of the second user.

16. An electronic device comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the electronic device to perform the method according to any one of claims 1 to 7 or claims 8 to 13.

17. A computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method according to any one of claims 1 to 7 or claims 8 to 13.

Images