Interaction processing for multimedia data

Abstract

Embodiments of the present disclosure provide an interaction processing method and apparatus for multimedia data. The interaction processing method for multimedia data comprises: during the playback of multimedia data, firstly, acquiring multimedia data from a server and performing playback processing on same; when a playback interaction condition for the multimedia data is triggered, displaying an interaction item corresponding to the playback interaction condition; and acquiring a target interaction item submitted by a user and sending same to the server, so as to transfer resources to a resource account associated with the user on the basis of the target interaction item and perform playback response processing, thereby providing the user with interaction in the process of playback processing of the multimedia data.

Description

Interactive processing of multimedia data TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of data processing, and particularly relates to interactive processing of multimedia data. BACKGROUND

[0002] With the continuous development and popularization of the Internet, the application range of online services based on the Internet is also becoming wider and wider, and has gradually covered most users. In this case, various forms of online services have appeared, such as online video playing by obtaining a video from a background through a page of an application program or a webpage, and participating in video playing by inputting a barrage during online video playing. However, with the increasing richness of video resources, the competition faced by a provider of video resources in the process of improving video access traffic is also becoming more and more fierce. SUMMARY

[0003] One or more embodiments of the present disclosure provide an interactive processing method of multimedia data, comprising: acquiring multimedia data sent by a server and performing playing processing. After a playing interaction condition of the multimedia data is triggered, an interaction item corresponding to the playing interaction condition is displayed. A target interaction item submitted by a user is acquired and sent to the server, so as to perform resource transfer into a resource account associated with the user based on the target interaction item and perform playing response processing.

[0004] One or more embodiments of the present disclosure provide another interactive processing method of multimedia data, comprising: sending multimedia data to a user terminal. A target interaction item submitted by a user is received and sent by the user terminal. The target interaction item is submitted after a playing interaction condition of the multimedia data is triggered and an interaction item corresponding to the playing interaction condition is displayed. Resource transfer into a resource account associated with the user based on the target interaction item is performed and playing response processing is performed.

[0005] One or more embodiments of the present disclosure provide an interactive processing device of multimedia data, comprising: a playing module configured to acquire multimedia data sent by a server and perform playing processing. A display module configured to display an interaction item corresponding to a playing interaction condition of the multimedia data after the playing interaction condition is triggered. An interaction item sending module configured to acquire a target interaction item submitted by a user and send the target interaction item to the server, so as to perform resource transfer into a resource account associated with the user based on the target interaction item and perform playing response processing.

[0006] One or more embodiments of the present disclosure provide another interactive processing device of multimedia data, comprising: a data sending module configured to send multimedia data to a user terminal. An interactive item receiving module is configured to receive a target interactive item submitted by a user of the user terminal. The target interactive item is submitted after a play interactive condition of the multimedia data is triggered and a corresponding interactive item is displayed. A play response module is configured to perform resource transfer-in to a resource account associated with the user based on the target interactive item and perform play response processing.

[0007] One or more embodiments of the present disclosure provide an interactive processing device of multimedia data, comprising: a processor; and a memory configured to store computer executable instructions which, when executed, cause the processor to: acquire multimedia data sent by a server and perform play processing. After a play interactive condition of the multimedia data is triggered, display an interactive item corresponding to the play interactive condition. Acquire a target interactive item submitted by a user and send to the server to perform resource transfer-in to a resource account associated with the user based on the target interactive item and perform play response processing.

[0008] One or more embodiments of the present disclosure provide another interactive processing device of multimedia data, comprising: a processor; and a memory configured to store computer executable instructions which, when executed, cause the processor to: send multimedia data to a user terminal. Receive a target interactive item submitted by a user of the user terminal. The target interactive item is submitted after a play interactive condition of the multimedia data is triggered and a corresponding interactive item is displayed. Perform resource transfer-in to a resource account associated with the user based on the target interactive item and perform play response processing.

[0009] One or more embodiments of the present disclosure provide a computer readable storage medium for storing computer executable instructions which, when executed, implement the following processes: acquire multimedia data sent by a server and perform play processing. After a play interactive condition of the multimedia data is triggered, display an interactive item corresponding to the play interactive condition. Acquire a target interactive item submitted by a user and send to the server to perform resource transfer-in to a resource account associated with the user based on the target interactive item and perform play response processing.

[0010] One or more embodiments of the present disclosure provide another computer-readable storage medium for storing computer-executable instructions, which, when executed, implement the following processes: sending multimedia data to a user terminal. Receiving a target interaction item submitted by a user of the user terminal. The target interaction item is submitted after a play interaction condition of the multimedia data is triggered and a corresponding interaction item is displayed. Resource transfer is performed to a resource account associated with the user based on the target interaction item, and a play response process is performed. BRIEF DESCRIPTION OF DRAWINGS

[0011] In order to more clearly illustrate the technical solutions in the one or more embodiments of the present disclosure or the related art, the drawings needed to be used in the embodiment or related art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments described in the present disclosure, and other drawings can be obtained by those skilled in the art without creative labor.

[0012] FIG. 1 is a schematic diagram of a multimedia data interaction processing method implementation environment provided by one or more embodiments of the present disclosure;

[0013] FIG. 2 is a flowchart of a multimedia data interaction processing method provided by one or more embodiments of the present disclosure;

[0014] FIG. 3 is a schematic diagram of an interaction page provided by one or more embodiments of the present disclosure;

[0015] FIG. 4 is a flowchart of a multimedia data interaction processing method applied to a short video interaction scenario provided by one or more embodiments of the present disclosure;

[0016] FIG. 5 is another flowchart of a multimedia data interaction processing method provided by one or more embodiments of the present disclosure;

[0017] FIG. 6 is a schematic diagram of a multimedia data interaction processing device embodiment provided by one or more embodiments of the present disclosure;

[0018] FIG. 7 is a schematic diagram of another multimedia data interaction processing device embodiment provided by one or more embodiments of the present disclosure;

[0019] FIG. 8 is a structural schematic diagram of a multimedia data interaction processing device provided by one or more embodiments of the present disclosure;

[0020] FIG. 9 is a structural schematic diagram of another multimedia data interaction processing device provided by one or more embodiments of the present disclosure. DETAILED DESCRIPTION

[0021] In order to make the technical scheme in the one or more embodiments of the present disclosure better understood by the person skilled in the art, the technical scheme in the one or more embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in the one or more embodiments of the present disclosure. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all the embodiments. Based on the one or more embodiments of the present disclosure, all other embodiments obtained by the person skilled in the art without creative labor should belong to the protection scope of the present document.

[0022] The multimedia data interactive processing method provided by the one or more embodiments of the present disclosure can be applied to the implementation environment of multimedia playing. Referring to FIG. 1, the implementation environment at least includes a user terminal 101 and a server 102. The user terminal 101 is used for playing multimedia data and interactive processing in the playing process, and cooperates with the server 102 to perform playing response processing of the interactive processing of the multimedia data. The user terminal 101 can be a mobile phone, a personal computer, a tablet computer, an electronic book reader, a device for information interaction based on VR (Virtual Reality, virtual reality technology), a vehicle-mounted terminal, an IoT device, a wearable smart device, a laptop computer, a desktop computer, and the like. The server 102 is used for performing playing response processing in response to the interactive processing of the user terminal in the playing process of the multimedia data. The server 102 can be a server, a server cluster composed of a plurality of servers, or one or more cloud servers in a cloud computing platform.

[0023] In the implementation environment, when the user terminal 101 cooperates with the server 102 to perform interactive processing in the playing process of the multimedia data, the user terminal 101 first acquires multimedia data for playing from the server 102. In the acquisition process, the server 102 cooperates with the user terminal 101 to send the multimedia data to the user terminal 101. After the user terminal 101 acquires the multimedia data, the user terminal 101 performs playing processing of the multimedia data. When the playing interactive condition is triggered, the user terminal 101 displays an interactive item corresponding to the playing interactive condition. The user terminal 101 acquires a target interactive item submitted by a user participating in the playing interaction based on the displayed interactive item, and submits the target interactive item submitted by the user to the server 102, so that the server 102 can perform resource transfer to a resource account associated with the user based on the provided target interactive item, and perform corresponding playing response processing. In this way, the user can perform playing interaction around the multimedia data in the playing process of the multimedia data.

[0024] One or more embodiments of the multimedia data interactive processing method provided by the present disclosure are as follows.

[0025] Referring to FIG. 2, the method for interactive processing of multimedia data provided by the embodiment includes steps S202 to S206.

[0026] In step S202, the multimedia data sent by the server is acquired and played.

[0027] The multimedia data described in the embodiment can be video data, animation data or cartoon data, and can also be multimedia data in other data forms, such as multimedia data composed of any form of voice data and text data, and multimedia data composed of any form of image data and voice and text or text data. The embodiment takes the multimedia data in the form of video data as an example to describe the playing process and the interactive process of the multimedia data. The playing process and the interactive process of the multimedia data in other data forms can refer to the specific implementation of the playing process and the interactive process of the video data, which will not be described herein.

[0028] Optionally, the multimedia data is provided by a provider of a resource service. A user can browse and view the multimedia data provided by the resource service during the process of accessing the resource service, and perform corresponding interactive processing during the playing process of the multimedia data. The resource service refers to a service that provides resource-related processing to a user, such as a service that provides a user with the creation of a resource account and the transfer of resources to the created user resource account, and a service that provides a group composed of multiple users with the creation of a common / shared resource account, and each user in the group can transfer resources to the created group resource account.

[0029] In addition, to improve the flexibility and participation procedure of a user in accessing multimedia data and performing interactive playing of the multimedia data in a resource service, the multimedia data can be uploaded by a user, or edited by a user to obtain multimedia data that can be played and interacted with during the playing process. For the case where a user creates a group in a resource service or participates in a group that has been created in a resource service, the multimedia data can be uploaded by a group member of the group to which the user belongs, or edited by a group member to obtain multimedia data that can be played and interacted with during the playing process.

[0030] Optionally, the multimedia data is uploaded by the user or a group member of the group to which the user belongs; or the multimedia data is edited according to the editing instructions of the user and / or the group member for the to-be-edited data.

[0031] In specific implementation, first, the multimedia data sent by the server is acquired and played. In the process of acquiring the multimedia data, an access request can be submitted to the server, and the server returns the multimedia data in response to the access request.

[0032] In an optional implementation of the embodiment, the multimedia data sent by the server is acquired and played, including: submitting an access request of the resource service to the server according to an access instruction of the user accessing the resource service; receiving the multimedia data sent by the server, and displaying a play window of the multimedia data on an interactive page.

[0033] In the specific implementation process, after the user terminal sends the access request to the server, the server determines the multimedia data corresponding to the access request, and sends the determined multimedia data to the user terminal sending the access request.

[0034] Optionally, the multimedia data is determined according to the multimedia access record of the user, or according to the multimedia access record of the group to which the user belongs. It should be noted that, considering that the multimedia access record of the user and the multimedia access record of the group to which the user belongs belong to the data privacy of the user to some extent, therefore, the data authorization of the user or the group to which the user belongs can be obtained before the multimedia data is determined according to the multimedia access record of the user or the multimedia access record of the group to which the user belongs, such as data authorization when the user accesses the resource service for the first time, or data authorization in the process of playing multimedia data and playing interaction through accessing the resource service for the first time.

[0035] In actual application, there may be a case that the user accesses multimedia projects with data relationship, and for this, in the process of acquiring multimedia data from the server, the corresponding multimedia data can be acquired from the server based on the multimedia project accessed by the user. Specifically, in another optional implementation of the embodiment, the multimedia data sent by the server is acquired and played, including: receiving a data segment of the multimedia project accessed by the user sent by the server, and playing the data segment on an interactive page.

[0036] Among them, the multimedia project refers to a set of multimedia data with a play continuous relationship or a content association relationship composed of part of multimedia data, such as a video drama composed of multiple sets of videos, a short video drama composed of multiple short videos, or an animation continuous drama composed of multiple sets of animations.

[0037] In addition, in order to improve the interactivity of the user in the playing process of the multimedia data, the corresponding multimedia data can be acquired from the server based on the interaction of the user with the multimedia data when the multimedia data is in the playing state. Specifically, in the third optional implementation provided by the embodiment, the multimedia data sent by the server is acquired and played, including: acquiring the selection instruction of the user for the virtual object in the multimedia data and submitting to the server; receiving the data segment corresponding to the virtual object sent by the server, and playing the data segment on the interactive page; or, acquiring the selection instruction of the user for the data branch of the multimedia data and submitting to the server; receiving the data segment corresponding to the data branch sent by the server, and playing the data segment on the interactive page.

[0038] The virtual object in the multimedia data refers to the virtual object displayed in the playing process of the multimedia data, such as a character, an object or an environment displayed in the playing process of the multimedia data. The data branch of the multimedia data refers to that, on the basis of pre-configuring multiple plot branches for the multimedia data, when a node of the selectable plot branch is played, the user can select any one plot branch from the configured multiple plot branches to play the multimedia data of the plot branch from the server.

[0039] It should be noted that the above-mentioned three implementation manners of acquiring and playing the multimedia data sent by the server can be selected according to actual needs in the specific implementation process. It should be noted that the above-mentioned three implementation manners can also be combined with any two or three according to actual needs, and the corresponding technical means can also be selected from the three implementation manners to form a new implementation manner according to actual needs, for example, acquiring the selection instruction of the user for the virtual object of the multimedia project and submitting to the server, receiving the data segment of the virtual object in the multimedia project sent by the server, and playing the data segment on the interactive page.

[0040] It should be further noted that the process of obtaining the multimedia data sent by the server and performing the playing process can also be replaced by obtaining the multimedia data sent by the server, and correspondingly, the specific implementation manner of obtaining the multimedia data sent by the server can adopt part of the technical means provided by the above three implementation manners, or adopt part of the technical means provided by the new implementation manner formed on the basis of the above three implementation manners, for example, the process of obtaining the multimedia data sent by the server comprises: submitting an access request of a resource service to the server according to an access instruction of the user accessing the resource service, and receiving the multimedia data sent by the server; or receiving the data segment of the multimedia item accessed by the user sent by the server; or obtaining the selection instruction of the user for the virtual object or the data branch in the multimedia data and submitting the selection instruction to the server, and receiving the data segment corresponding to the virtual object or the data branch sent by the server.

[0041] In step S204, after the playing interaction condition of the multimedia data is triggered, the interaction item corresponding to the playing interaction condition is displayed.

[0042] In the process of obtaining the multimedia data and performing the playing process of the multimedia data, the user can perform the playing interaction in the playing process of the multimedia data. In this embodiment, the playing interaction condition is triggered after the playing interaction condition of the multimedia data is triggered, and the interaction item corresponding to the playing interaction condition is displayed. On this basis, the user can perform the playing interaction through the provided interaction item.

[0043] The playing interaction condition in this embodiment refers to the condition for performing the playing interaction in the playing process of the multimedia data, and specifically refers to the condition for performing the playing interaction through the display of the interaction item. Optionally, the playing interaction condition comprises at least one of the following: whether the playing state is in a preset playing state, whether the playing progress reaches a preset playing node, whether the user action data of the user in the interaction page is a preset action, whether the interaction information input by the user matches a preset interaction instruction, and whether an interaction instruction for the virtual object of the multimedia data displayed in the playing window is detected.

[0044] Specifically, for the playing interaction condition of whether the playing state is in the preset playing state, if the playing state is in the preset playing state, it is determined that the playing interaction condition is triggered, otherwise, if the playing state is not in the preset playing state, it is determined that the playing interaction condition is not triggered. Optionally, the preset playing state includes a playing start state, a playing pause state and / or a playing complete state; for the playing interaction condition of whether the playing progress reaches the preset playing node, if the playing progress reaches the preset playing node, it is determined that the playing interaction condition is triggered, otherwise, if the playing progress reaches the preset playing node, it is determined that the playing interaction condition is not triggered, wherein the preset playing node can be a preset time node or a data node (multimedia node or video node), such as a plot node in which a certain character appears in multimedia data; for the playing interaction condition of whether the user action data of the user on the interaction page is the preset action, if the user action data of the user on the interaction page is the preset action, it is determined that the playing interaction condition is triggered, otherwise, if the user action data of the user on the interaction page is not the preset action, it is determined that the playing interaction condition is not triggered; specifically, the user action data can be identified, if the identified user action is the preset action, it is determined that the playing interaction condition is triggered; for the playing interaction condition of whether the interaction information input by the user matches the preset interaction instruction, if the interaction information input by the user matches the preset interaction instruction, it is determined that the playing interaction condition is triggered, otherwise, if the interaction information input by the user does not match the preset interaction instruction, it is determined that the playing interaction condition is not triggered, wherein the interaction information input by the user can be voice information and / or text information, for example, if the voice information input by the user contains the corpus “interaction”, it is determined that the playing interaction condition is triggered, or if the text information input by the user contains the keyword “interaction”, it is determined that the playing interaction condition is triggered; for the playing interaction condition of whether the interaction instruction for the virtual object of the multimedia data displayed by the playing window is detected, if the interaction instruction for the virtual object of the multimedia data displayed by the playing window is detected, it is determined that the playing interaction condition is triggered, otherwise, if the interaction instruction for the virtual object of the multimedia data displayed by the playing window is not detected, it is determined that the playing interaction condition is not triggered; for example, if the interaction instruction for a specific character, object or environment in the multimedia data displayed by the playing window is detected, it is determined that the playing interaction condition is not triggered.

[0045] The five playing interaction conditions provided above can be selected according to actual needs in the implementation process, and it should be noted that the five playing interaction conditions can be combined to form new playing interaction conditions according to actual needs, for example, the playing interaction condition that whether the playing state is in the preset playing state and whether the user action data of the user on the interaction page is the preset action, if the playing state is in the preset playing state and the user action data of the user on the interaction page is the preset action, it is determined that the playing interaction condition is triggered; in addition, the corresponding technical means can be selected from the five playing interaction conditions to form new playing interaction conditions according to actual needs, for example, the playing interaction condition that whether the interaction information input by the user matches the virtual object of the multimedia data displayed by the playing window, if the interaction information input by the user matches the virtual object of the multimedia data displayed by the playing window, it is determined that the playing interaction condition is triggered.

[0046] In the specific implementation, in the case that the playing interaction condition of the multimedia data is triggered, the interaction item corresponding to the playing interaction condition is displayed from the triggered playing interaction condition. In an optional implementation provided by the embodiment, displaying the interaction item corresponding to the playing interaction condition comprises: displaying the interaction text corresponding to the playing interaction condition and at least one interaction item and the resource amount associated with each interaction item on the interaction page.

[0047] In addition, any one or any two of the three interaction contents, that is, the interaction text, the at least one interaction item and the resource amount associated with each interaction item, can be displayed on the interaction page, for example, at least one interaction item is displayed on the interaction page, or the interaction text is displayed on the interaction page; for example, the interaction text and at least one interaction item are displayed on the interaction page, or at least one interaction item and the resource amount associated with each interaction item are displayed on the interaction page.

[0048] At least one of the interaction text, the interaction item and the resource amount (that is, at least one of the three interaction contents, that is, the interaction text, the at least one interaction item and the resource amount associated with each interaction item) is displayed in the playing window of the interaction page, and / or at least one of the interaction text, the interaction item and the resource amount (that is, at least one of the three interaction contents, that is, the interaction text, the at least one interaction item and the resource amount associated with each interaction item) is displayed in the interaction area of the interaction page.

[0049] For example, the interactive page of a certain short video in the short video drama shown in FIG. 3, the short video is played and displayed in the play window 301 of the interactive page, in the case that the play progress reaches a preset play node, or in the case that the user input interactive information matches a preset interactive instruction, the interactive text 302 is displayed in the play window 301, the first interactive item 304 and the second interactive item 305 are displayed in the interactive area 303, the associated resource amount "resource amount a" is displayed in the first interactive item 304, and the associated resource amount "resource amount b" is displayed in the second interactive item 305.

[0050] In this embodiment, in order to improve the interactive experience and interactive participation of the user in the play interaction of the multimedia data, in the case that the play interaction condition is triggered, and before the interactive item operation corresponding to the play interaction condition is displayed, the play interaction of the multimedia data can be entered by pausing the play of the multimedia data or locking the multimedia data.

[0051] Specifically, in an optional implementation provided by this embodiment, after the play interaction condition is triggered and before the interactive item operation corresponding to the play interaction condition is displayed, the method further includes: pausing the play of the multimedia data, and / or locking the play state of the multimedia data.

[0052] It should be noted that the process of displaying the interactive item corresponding to the play interaction condition of the multimedia data after the play interaction condition of the multimedia data is triggered can be replaced by displaying the interactive item of the multimedia data, wherein the interactive item includes an interactive text and at least one interactive item and / or the resource amount associated with each interactive item; in addition, the process of displaying the interactive item corresponding to the play interaction condition can also be replaced by displaying the interactive text corresponding to the play interaction condition and at least one interactive item and / or the resource amount associated with each interactive item.

[0053] In step S206, the target interactive item submitted by the user is acquired and sent to the server, so as to perform resource transfer to the resource account associated with the user based on the target interactive item and perform play response processing.

[0054] Based on the display of the interactive item, the user can perform play interaction of the multimedia data based on the displayed interactive item, specifically, the target interactive item can be submitted based on the display of the interactive item, here, the target interactive item submitted by the user is acquired and sent to the server, after the server receives the sent target interactive item, resource transfer is performed to the resource account associated with the user based on the target interactive item and play response processing (play interaction processing) is performed.

[0055] In a specific implementation, based on the displayed interactive items, in an optional implementation of the embodiment, the target interactive item is determined as follows: the interactive item selected by the user from the displayed at least one interactive item is taken as the target interactive item.

[0056] In addition, in order to improve the flexibility of the user in playing the multimedia data, the target interactive item can also be determined according to the interactive item and / or the resource amount input by the user. For example, according to the interactive information input by the user, the interactive item corresponding to the interactive information is determined as the target interactive item. For example, according to the voice information or text information input by the user, if the voice information contains the corpus of the first interactive item, the first interactive item is taken as the target interactive item, and if the text information contains the keyword of the second interactive item, the second interactive item is taken as the target interactive item.

[0057] For another example, according to the interactive information input by the user, the resource amount corresponding to the interactive information is determined, and the interactive item associated with the resource amount is taken as the target interactive item. For example, according to the voice information or text information input by the user, if the voice information contains the corpus of the resource amount associated with the first interactive item, the first interactive item is taken as the target interactive item, and if the text information contains the keyword of the resource amount associated with the first interactive item, the second interactive item is taken as the target interactive item.

[0058] In the embodiment, after the target interactive item submitted by the user is acquired and sent to the server, the server performs resource transfer to the resource account associated with the user based on the target interactive item after receiving the sent target interactive item and performs playing response processing (playing interactive processing); correspondingly, the playing response processing can also be performed in cooperation with the server after the target interactive item submitted by the user is acquired and sent to the server.

[0059] In an optional implementation of the embodiment, after the step of acquiring the target interactive item submitted by the user and sending to the server, the method further comprises: cooperating with the server to perform the playing response processing corresponding to the target interactive item and / or the playing interactive condition, or performing the playing interactive processing corresponding to the target interactive item and / or the playing interactive condition, or cooperating with the server to perform the playing interactive processing.

[0060] As described above, in the case that the playing of the multimedia data is paused and / or the playing state of the multimedia data is locked after the playing interactive condition is triggered and before the operation of displaying the interactive item corresponding to the playing interactive condition is performed, based on the above, in an optional implementation of the embodiment, the playing response processing corresponding to the playing interactive condition is performed, which comprises: receiving the unlocking instruction issued by the server, and unlocking the playing state of the multimedia data based on the unlocking instruction.

[0061] In another optional implementation provided by the embodiment, the playing response processing corresponding to the playing interaction condition comprises: receiving a data segment corresponding to the target interaction item issued by the server, and playing the data segment in the playing window.

[0062] Optionally, the data segment is determined in a data segment corresponding to each data branch configured at a preset playing node of the multimedia data for the playing interaction condition, or the data segment is obtained by inputting the played data before the preset playing node, the target interaction item and / or a data generation field into a large language model to generate multimedia data.

[0063] In addition, after obtaining the target interaction item submitted by the user and sending the target interaction item to the server, the server performs resource transfer into a resource account associated with the user based on the target interaction item and performs playing response processing (playing interaction processing) after receiving the sent target interaction item. To improve the willingness of the user to participate in the playing interaction in the playing process of the multimedia video, the enthusiasm of the user to participate in the playing interaction can be improved by issuing benefits to the user, and further, the perception of the user to the benefit issuance can be improved by playing multimedia data related to the benefit, specifically, in an optional implementation provided by the embodiment, after the step of obtaining the target interaction item submitted by the user and sending the target interaction item to the server, the method further comprises: receiving multimedia sub-data for issuing a benefit prompt generated based on a to-be-issued benefit issued by the server, and playing the multimedia sub-data in the playing window.

[0064] Optionally, the multimedia sub-data for issuing a benefit prompt can be generated by a resource service provider based on a to-be-issued benefit, and can be obtained by inputting the to-be-issued benefit and a data generation field into a large language model to generate multimedia sub-data.

[0065] In actual application, after sending the target interaction item to the server, in the process of transferring resources into a resource account associated with the user based on the target interaction item after receiving the sent target interaction item, there can be a situation of transferring resources into a user resource account created by the user alone, and there can also be a situation of transferring resources into a group resource account created by the user together with other users. The following respectively provides implementation manners for resource transfer in the two situations.

[0066] For the situation of transferring resources into a user resource account created by the user alone, in an optional implementation provided by the embodiment, the resource transfer into the resource account associated with the user based on the target interaction item comprises: transferring resources out of the resource account of the user based on the amount of resources associated with the target interaction item, and transferring the transferred resources into a user resource account (personal resource account or independent resource account) created by the user in the resource service.

[0067] In another optional implementation of the embodiment provided by the present embodiment, in the case that the user transfers resources to the group resource account created by the user and other users, the method for transferring resources based on the target interaction item to the resource account associated with the user comprises: transferring resources from the resource account of the user based on the resource amount of the target interaction item, and transferring the transferred resources to the group resource account (common resource account) created by the group to which the user belongs in the resource service.

[0068] In the embodiment, after the server transfers resources to the resource account associated with the user based on the received target interaction item, the server needs to perform corresponding playback response processing. In the case that the playback interaction condition comprises whether the playback state is in a preset playback state, and the preset playback state comprises a playback completion state, that is, in the case that the playback interaction condition is that the playback state is a playback completion state, that is, in the case that the playback of the multimedia video is completed, in an optional implementation of the embodiment provided by the present embodiment, the playback response processing comprises: setting an unlocking deadline of the next multimedia data of the multimedia data in the data sequence to which the multimedia data belongs; and optionally, after the unlocking deadline expires, opening the access permission of the next multimedia data to the user or the group to which the user belongs.

[0069] For example, a plurality of short videos constitute a short video series, after the currently accessed short video is played, the next short video of the short video is determined, and the unlocking date of the next short video is set. After the unlocking date arrives, the next short video is unlocked, and the user can access the next short video.

[0070] In addition, in the process of performing the playback response processing, in another optional implementation of the embodiment provided by the present embodiment, the playback response processing comprises at least one of the following three implementation manners: issuing the benefit corresponding to the target interaction item to the user, issuing the benefit matched with the virtual object triggered by the interaction instruction to the user, and issuing the benefit to each group member of the group to which the user belongs.

[0071] It should be noted that in the process of the server performing the play response processing, in addition to the two optional embodiments provided above, the server can also perform the play response processing in any one of the following four optional embodiments: optional embodiment one: generating an unlocking instruction of the multimedia data and issuing it to the user terminal to unlock the play state; optional embodiment two: determining the data segment corresponding to the target interaction item in the data segments corresponding to each data branch configured by the multimedia data at the preset play node of the play interaction condition and issuing it to the user terminal; optional embodiment three: inputting the played data before the preset play node, the target interaction item and the data generation field into the large language model to generate the multimedia data, and issuing the output data segment corresponding to the target interaction item to the user terminal. Optional embodiment four: generating multimedia sub-data for benefit distribution prompt based on the to-be-distributed benefit and issuing it to the user terminal to play the multimedia sub-data on the interaction page; the multimedia sub-data is generated by the large language model.

[0072] Further, it should be noted that the six implementation manners for performing the play response processing provided above can be implemented according to actual needs in the specific implementation process, and it should be noted that the six implementation manners can also be combined by at least two of them to form a new implementation manner according to actual needs, and the corresponding technical means can also be combined from the six implementation manners to form a new implementation manner according to actual needs, such as inputting the played data before the preset play node, the target interaction item and the data generation field into the large language model to generate the multimedia data, the output data segment corresponding to the target interaction item, and the unlocking instruction of the multimedia data; issuing the output data segment and the generated unlocking instruction to the user terminal to unlock the play state based on the unlocking instruction, and playing the data segment in the play window; for example, based on the to-be-distributed benefit, generate multimedia sub-data for benefit distribution prompt, and generate an unlocking instruction of the multimedia data, issue the multimedia sub-data and the unlocking instruction to the user terminal to unlock the play state and play the multimedia sub-data on the interaction page.

[0073] Based on this, the above-mentioned processing process of cooperating with the server to perform the playing response processing corresponding to the target interaction item and / or the playing interaction condition, the processing process of performing the playing interaction processing corresponding to the target interaction item and / or the playing interaction condition, and the processing process of cooperating with the server to perform the playing interaction processing, can respectively execute the processing process corresponding to the six optional implementation modes of the server performing the playing response processing provided above: for example, optional implementation mode one: obtaining the unlocking deadline of the next multimedia data of the multimedia data in the data sequence to which the multimedia data belongs from the server and displaying; optional implementation mode two: obtaining the distribution result of the benefit distribution from the server; optional implementation mode three: receiving the unlocking instruction issued by the server, and unlocking the playing state of the multimedia data based on the unlocking instruction; optional implementation mode four: receiving the data segment corresponding to the target interaction item determined in the data segment configured at the preset playing node of each data branch from the server, and playing the data segment in the playing window; optional implementation mode five: receiving the data segment corresponding to the target interaction item generated by the large language model from the server, and playing the data segment in the playing window; optional implementation mode six: receiving the multimedia sub-data for generating a benefit distribution prompt based on the to-be-distributed benefit from the server, and playing the multimedia sub-data in the interaction page.

[0074] Correspondingly, in the above six implementation modes, the server can form a new implementation mode by integrally combining at least two of them according to actual needs, or can form a new implementation mode by combining corresponding technical means selected from the six implementation modes according to actual needs. In this case, the processing process of cooperating with the server to perform the playing response processing corresponding to the target interaction item and / or the playing interaction condition, the processing process of performing the playing interaction processing corresponding to the target interaction item and / or the playing interaction condition, and the processing process of cooperating with the server to perform the playing interaction processing, can also execute the processing process corresponding to the new implementation mode executed by the server, for example, receiving the data segment and the generated unlocking instruction issued by the server, unlocking the playing state based on the unlocking instruction, and playing the data segment in the playing window; for another example, receiving the multimedia sub-data and the unlocking instruction issued by the server, unlocking the playing state, and playing the multimedia sub-data in the interaction page.

[0075] The implementation process of the above-mentioned interactive processing method of multimedia data can be executed by the user terminal, and the implementation process of another interactive processing method of multimedia data provided in the following method embodiment can be executed by the server. Both can cooperate with each other in the execution process. Therefore, the above-mentioned implementation process can refer to the corresponding content of the following another interactive processing method of multimedia data, and correspondingly, the following another interactive processing method of multimedia data can also refer to the corresponding content of the above-mentioned method embodiment.

[0076] The multimedia data interaction processing method provided in the embodiment is further described below in combination with Fig. 4, taking the application of the multimedia data interaction processing method in a short video interaction scenario as an example. Referring to Fig. 4, the multimedia data interaction processing method applied in the short video interaction scenario specifically includes the following steps.

[0077] In step S402, an access request is submitted to the server according to an access instruction of the user accessing the resource service.

[0078] In step S408, the short video sent by the server is received, and a play window of the short video is displayed on the interaction page.

[0079] In step S410, after the play interaction condition of the short video is triggered, the interaction item corresponding to the play interaction condition is displayed.

[0080] In step S412, the target interaction item selected by the user from the displayed interaction items is obtained.

[0081] In step S414, the target interaction item is sent to the server.

[0082] In step S426, the unlocking deadline of the next short video in the short video series to which the short video belongs and the benefit distribution short video are received.

[0083] In step S428, the unlocking deadline of the next short video is displayed on the interaction page, and the benefit distribution short video is played in the play window.

[0084] The above steps S402, S408-S414, S426-S428 provided in the embodiment are executed by the user terminal. It should be noted that the above steps S402, S408-S414, S426-S428 executed by the user terminal and the steps S404-S406 and S416-S424 executed by the server in the following embodiment can cooperate with each other in the execution process. Therefore, when reading the present embodiment, the corresponding content of steps S404-S406 and S416-S424 provided in the following method embodiment should be referred to, and when reading the following method embodiment, the corresponding content of steps S402, S408-S414, S426-S428 provided in the present embodiment should be referred to.

[0085] It should be noted that any one of steps S402, steps S408 to S414, steps S426 to S428, or a combination of any multiple steps, can be combined with any one of steps S202 to S206 or any multiple steps to form a new implementation manner according to the needs of implementation deployment. In addition, any one or any multiple technical features in steps S402, steps S408 to S414, steps S426 to S428 can be combined with any one or multiple technical features provided in steps S202 to S206 to form a new implementation manner according to the actual deployment needs. Alternatively, any one or any multiple technical features in steps S402, steps S408 to S414, steps S426 to S428 can be replaced by any one or multiple technical features provided in steps S202 to S206 to form a new implementation manner according to the actual deployment needs, which will not be described one by one here.

[0086] One or more embodiments of another multimedia data interactive processing method provided by the disclosure are as follows.

[0087] Referring to FIG. 5, the multimedia data interactive processing method provided by the embodiment specifically includes steps S502 to S506.

[0088] In step S502, multimedia data is sent to a user terminal.

[0089] The multimedia data described in the embodiment can be video data, animation data, or animation data, and can also be multimedia data in other data forms, such as multimedia data composed of any form of voice data and text data, and multimedia data composed of any form of image data and voice and text or text data. The embodiment takes video data as an example of multimedia data in this data form to explain the multimedia data playing processing process and playing interactive process. The playing processing process and playing interactive process of multimedia data in other data forms can refer to the specific implementation manner of the playing processing process and playing interactive process of video data. The embodiment will not be described one by one here.

[0090] Optionally, the multimedia data is provided by a resource service provider. The user can browse and view the multimedia data provided by the resource service in the process of accessing the resource service, and perform corresponding playing interactive processing in the playing process of the multimedia data. The resource service refers to a service that provides resource-related processing to users, such as a service that provides users with creating a resource account and transferring resources to the created user resource account, and a service that provides a group composed of multiple users with creating a common / shared resource account, and each user in the group can transfer resources to the created group resource account.

[0091] In addition, in order to improve the flexibility and participation procedure of the user in accessing multimedia data and playing interactive multimedia data in the resource service, the multimedia data can be uploaded by the user or obtained by the user editing the uploaded data to obtain multimedia data capable of playing interactive multimedia data in the playing process; in the case that the user creates a group in the resource service or participates in a group created in the resource service, the multimedia data can be uploaded by the group members of the group to which the user belongs or obtained by the group members editing the uploaded data to obtain multimedia data capable of playing interactive multimedia data in the playing process.

[0092] Optionally, the multimedia data is uploaded by the user or the group members of the group to which the user belongs; or the multimedia data is obtained by multimedia data editing according to the editing instruction of the user and / or the group members for the to-be-edited data.

[0093] In the implementation, the multimedia data is first sent to the user terminal to perform playing processing of the multimedia data in the user terminal. Specifically, in the process of sending the multimedia data to the user terminal, the multimedia data can be sent to the user terminal in response to the access request submitted by the user terminal according to the access request.

[0094] In an optional implementation of the embodiment, the multimedia data sent to the user terminal comprises: receiving the access request submitted by the user terminal, determining the multimedia data corresponding to the access request, and sending the determined multimedia data to the user terminal.

[0095] Optionally, the multimedia data is determined according to the multimedia access record of the user or according to the multimedia access record of the group to which the user belongs.

[0096] It should be noted that, considering that the multimedia access record of the user and the multimedia access record of the group to which the user belongs belong to the data privacy of the user to a certain extent, the data authorization of the user or the group to which the user belongs can be obtained before the multimedia data is determined according to the multimedia access record of the user or the multimedia access record of the group to which the user belongs, such as the data authorization when the user accesses the resource service for the first time or the data authorization when the user plays multimedia data and plays interactive multimedia data for the first time by accessing the resource service.

[0097] In actual application, there can be a case that the user accesses a multimedia project with data relationship, in which case, in the process of sending multimedia data to the user terminal, the corresponding multimedia data can be determined based on the multimedia project accessed by the user and sent to the user terminal. Specifically, in another optional implementation provided by the embodiment, sending multimedia data to the user terminal comprises: reading the data segment of the multimedia project accessed by the user terminal and sending to the user terminal. Wherein, the multimedia project refers to a set of multimedia data with continuous playing relationship or content association relationship composed of part of multimedia data, such as a video drama composed of multiple video sets, a short video drama composed of multiple short videos, or an animation series composed of multiple animation sets.

[0098] In addition, in order to improve the interactivity of the user in the process of playing the multimedia data, the corresponding multimedia data can also be determined based on the interaction of the user with the multimedia data and sent to the user terminal when the multimedia data is already in the playing state. Specifically, in a third optional implementation provided by the embodiment, sending multimedia data to the user terminal comprises: determining the data segment corresponding to the virtual object according to the selection instruction of the user terminal for the virtual object in the multimedia data and sending to the user terminal; or determining the data segment corresponding to the data branch of the multimedia data according to the selection instruction of the user terminal for the data branch and sending to the user terminal.

[0099] Wherein, the virtual object in the multimedia data refers to the virtual object displayed in the process of playing the multimedia data, such as the character, object or environment displayed in the process of playing the multimedia data. The data branch of the multimedia data refers to that on the basis of pre-configuring multiple plot branches for the multimedia data, when playing to the node where the plot branch can be selected, the user can select any one of the configured plot branches for playing, and the multimedia data of the plot branch is obtained from the server for playing.

[0100] The above-mentioned three implementation manners of sending multimedia data to the user terminal can be selected for implementation according to actual needs in the specific implementation process. It should be noted that the above-mentioned three implementation manners can also be combined in any two or three to form a new implementation manner according to actual needs, and the corresponding technical means can also be combined to form a new implementation manner according to actual needs.

[0101] Step S504, receiving the target interaction item submitted by the user terminal.

[0102] After the multimedia data is sent to the user terminal, the user terminal performs a playing process of the multimedia data, and in this process, the user can perform a playing interaction in the playing process of the multimedia data. Specifically, the playing interaction can be performed in the manner that an interaction item corresponding to a playing interaction condition of the multimedia data is displayed after the playing interaction condition is triggered, and the playing interaction is performed on the basis of the provided interaction item. Here, the target interaction item submitted by the user is received and sent by the user terminal.

[0103] Optionally, the target interaction item is submitted after the playing interaction condition of the multimedia data is triggered and the corresponding interaction item is displayed.

[0104] The playing interaction condition described in this embodiment refers to a condition for performing a playing interaction in the playing process of the multimedia data, and specifically refers to a condition for performing a playing interaction in the manner that an interaction item is displayed. Optionally, the playing interaction condition includes at least one of the following: whether a playing state is in a preset playing state, whether a playing progress reaches a preset playing node, whether user action data of the user on an interaction page is a preset action, whether interaction information input by the user matches a preset interaction instruction, and whether an interaction instruction for a virtual object of the multimedia data displayed in a playing window is detected.

[0105] Specifically, for the playing interaction condition of whether the playing state is in the preset playing state, if the playing state is in the preset playing state, it is determined that the playing interaction condition is triggered, and otherwise, if the playing state is not in the preset playing state, it is determined that the playing interaction condition is not triggered. Optionally, the preset playing state includes a playing start state, a playing pause state, and / or a playing complete state.

[0106] For the play interaction condition of whether the play progress reaches the preset play node, if the play progress reaches the preset play node, it is determined that the play interaction condition is triggered, otherwise, if the play progress does not reach the preset play node, it is determined that the play interaction condition is not triggered, wherein the preset play node can be a preset time node or a data node (multimedia node or video node), such as a plot node in which a certain character appears in multimedia data; for the play interaction condition of whether the user action data of the user on the interaction page is a preset action, if the user action data of the user on the interaction page is a preset action, it is determined that the play interaction condition is triggered, otherwise, if the user action data of the user on the interaction page is not a preset action, it is determined that the play interaction condition is not triggered; specifically, the user action data can be identified, if the identified user action is a preset action, it is determined that the play interaction condition is triggered; for the play interaction condition of whether the interaction information input by the user matches the preset interaction instruction, if the interaction information input by the user matches the preset interaction instruction, it is determined that the play interaction condition is triggered, otherwise, if the interaction information input by the user does not match the preset interaction instruction, it is determined that the play interaction condition is not triggered, wherein the interaction information input by the user can be voice information and / or text information, for example, if the voice information input by the user contains the corpus “interaction”, it is determined that the play interaction condition is triggered, or if the text information input by the user contains the keyword “interaction”, it is determined that the play interaction condition is triggered; for the play interaction condition of whether the interaction instruction for the virtual object of the multimedia data displayed by the play window is detected, if the interaction instruction for the virtual object of the multimedia data displayed by the play window is detected, it is determined that the play interaction condition is triggered, otherwise, if the interaction instruction for the virtual object of the multimedia data displayed by the play window is not detected, it is determined that the play interaction condition is not triggered; for example, if the interaction instruction for a specific character, object or environment in the multimedia data displayed by the play window is detected, it is determined that the play interaction condition is not triggered.

[0107] The five playing interaction conditions provided above can be selected according to actual needs in the implementation process, and it should be noted that the five playing interaction conditions can be combined to form new playing interaction conditions according to actual needs, for example, the playing interaction condition that whether the playing state is in the preset playing state and whether the user action data of the user in the interaction page is the preset action, if the playing state is in the preset playing state and the user action data of the user in the interaction page is the preset action, it is determined that the playing interaction condition is triggered; in addition, the corresponding technical means can be selected from the five playing interaction conditions to form new playing interaction conditions according to actual needs, for example, the playing interaction condition that whether the interaction information input by the user matches the virtual object of the multimedia data displayed by the playing window, if the interaction information input by the user matches the virtual object of the multimedia data displayed by the playing window, it is determined that the playing interaction condition is triggered.

[0108] Optionally, the interaction item corresponding to the playing interaction condition is displayed in the following manner: the interaction text corresponding to the playing interaction condition and at least one interaction item and the resource amount associated with each interaction item are displayed on the interaction page.

[0109] In addition, any one or any two of the three interaction contents, i.e., the interaction text, at least one interaction item, and the resource amount associated with each interaction item, corresponding to the playing interaction condition can be displayed on the interaction page, for example, at least one interaction item is displayed on the interaction page, or the interaction text is displayed on the interaction page; for example, the interaction text and at least one interaction item are displayed on the interaction page, or at least one interaction item and the resource amount associated with each interaction item are displayed on the interaction page.

[0110] At least one of the interaction text, the interaction item, and the resource amount (i.e., at least one of the three interaction contents, i.e., the interaction text, at least one interaction item, and the resource amount associated with each interaction item) is displayed in the playing window of the interaction page, and / or at least one of the interaction text, the interaction item, and the resource amount (i.e., at least one of the three interaction contents, i.e., the interaction text, at least one interaction item, and the resource amount associated with each interaction item) is displayed in the interaction area of the interaction page.

[0111] In an optional implementation provided by the embodiment, the target interaction item is determined in the following manner: the interaction item selected by the user from the displayed at least one interaction item is taken as the target interaction item.

[0112] Further, in order to improve the flexibility of the user in playing the multimedia data, the target interactive item can be determined according to the interactive item and / or resource amount input by the user. For example, the target interactive item can be determined according to the interactive information input by the user. For example, if the voice information input by the user contains the corpus of the first interactive item, the first interactive item is determined as the target interactive item. If the text information input by the user contains the keyword of the second interactive item, the second interactive item is determined as the target interactive item.

[0113] For another example, the target interactive item can be determined according to the resource amount corresponding to the interactive information input by the user. For example, if the voice information input by the user contains the corpus of the resource amount associated with the first interactive item, the first interactive item is determined as the target interactive item. If the text information input by the user contains the keyword of the resource amount associated with the first interactive item, the second interactive item is determined as the target interactive item.

[0114] In step S506, resource transfer is performed to the resource account associated with the user based on the target interactive item, and a playing response is processed.

[0115] In actual application, after receiving the target interactive item sent by the user terminal, in the process of performing resource transfer to the resource account associated with the user based on the target interactive item, the user can perform resource transfer to the user resource account created by the user himself / herself, or the user can perform resource transfer to the group resource account created by the user and other users. The following describes the implementation of resource transfer in the two cases.

[0116] In the case of performing resource transfer to the user resource account created by the user himself / herself, in an optional embodiment provided by the present embodiment, the resource transfer is performed to the resource account associated with the user based on the target interactive item, including: performing resource transfer from the resource account of the user based on the resource amount associated with the target interactive item, and transferring the transferred resource to the user resource account (personal resource account or independent resource account) created by the user in the resource service.

[0117] In the case of performing resource transfer to the group resource account created by the user and other users, in another optional embodiment provided by the present embodiment, the resource transfer is performed to the resource account associated with the user based on the target interactive item, including: performing resource transfer from the resource account of the user based on the resource amount of the target interactive item, and transferring the transferred resource to the group resource account (common resource account) created by the group to which the user belongs in the resource service.

[0118] In the embodiment, after the received target interaction item is associated with the resource account of the user and the resource is transferred in, corresponding playback response processing needs to be performed. In the case where the playback interaction condition includes whether the playback state is in a preset playback state, and the preset playback state includes a playback completion state, that is, in the case where the playback interaction condition is that the playback state is in the playback completion state, that is, in the case where the multimedia video is played, in an optional implementation provided by the embodiment, the playback response processing includes: setting an unlocking deadline of the next multimedia data of the multimedia data in the data sequence to which the multimedia data belongs; optionally, after the unlocking deadline expires, the access permission of the next multimedia data is opened to the user or a group to which the user belongs.

[0119] For example, a plurality of short videos constitute a short video drama, after the short video currently accessed by the user is played, the next short video of the short video is determined, and the unlocking date of the next short video is set. After the unlocking date arrives, the next short video is unlocked, and the user can access the next short video.

[0120] In addition, in the process of performing the playback response processing, in another optional implementation provided by the embodiment, the playback response processing includes at least one of the following three implementation manners: issuing the benefit corresponding to the target interaction item to the user, issuing the benefit matched with the virtual object triggered by the interaction instruction to the user, and issuing the benefit to each group member of the group to which the user belongs.

[0121] It should be noted that, in the process of performing the playback response processing, in addition to the two optional implementations provided above, any one of the following four optional implementations can be used to perform the playback response processing: optional implementation one: generating an unlocking instruction of the multimedia data and issuing it to the user terminal to unlock the playback state; optional implementation two: determining the data segment corresponding to the target interaction item in the data segment corresponding to each data branch configured at the preset playback node of the multimedia data for the playback interaction condition and issuing it to the user terminal; optional implementation three: inputting the played data before the preset playback node, the target interaction item, and the data generation field into a large language model to generate multimedia data, and issuing the output data segment corresponding to the target interaction item to the user terminal. Optional implementation four: generating multimedia sub-data for a benefit issuance prompt based on the to-be-issued benefit and issuing it to the user terminal to play the multimedia sub-data on the interaction page; the multimedia sub-data is generated by a large language model.

[0122] It should be further noted that the six implementation manners of providing the playing response processing provided above can be selected for implementation according to actual needs in the specific implementation process. It should be noted that the six implementation manners can be combined in at least two manners to form a new implementation manner according to actual needs, and corresponding technical means can be combined to form a new implementation manner according to actual needs. For example, the played data before the preset playing node, the target interaction item and the data generation field are input into the large language model to generate multimedia data, the data segment corresponding to the target interaction item is output, and the unlocking instruction for generating the multimedia data is output; the output data segment and the generated unlocking instruction are sent to the user terminal to unlock the playing state based on the unlocking instruction, and the data segment is played in the playing window; for another example, multimedia sub-data for generating a benefit delivery prompt based on the to-be-delivered benefit is generated, and an unlocking instruction for generating the multimedia data is generated, and the multimedia sub-data and the unlocking instruction are sent to the user terminal to unlock the playing state and play the multimedia sub-data in the interaction page.

[0123] The application of the multimedia data interaction processing method provided in the embodiment in a short video interaction scenario is taken as an example, and the multimedia data interaction processing method provided in the embodiment is further described in combination with FIG. 4. Referring to FIG. 4, the multimedia data interaction processing method applied in the short video interaction scenario specifically includes the following steps.

[0124] In step S404, the access request submitted by the user terminal is received.

[0125] In step S406, the short video corresponding to the access request is determined, and the determined short video is sent to the user terminal.

[0126] In step S416, the target interaction item selected by the user from the displayed interaction items is received.

[0127] In step S418, the resource is transferred out from the user's resource account based on the resource amount associated with the target interaction item, and the transferred resource is transferred into the user resource account created by the user in the resource service.

[0128] In step S420, the unlocking deadline of the next short video in the short video drama to which the short video belongs is set.

[0129] In step S422, the benefit corresponding to the target interaction item is delivered to the user, and a benefit delivery short video corresponding to the benefit delivery is generated.

[0130] In step S424, the unlocking deadline of the next short video and the benefit delivery short video are sent to the user terminal.

[0131] It should be noted that any one or any combination of steps S404 to S406, steps S416 to S424, or a combination of any multiple steps, can be combined with any one or any multiple steps of steps S502 to S506 to form a new implementation manner according to the needs of implementation deployment. In addition, any one or any multiple technical features in steps S404 to S406, steps S416 to S424 can be combined with any one or multiple technical features provided in steps S502 to S506 to form a new implementation manner according to the actual deployment needs. Alternatively, any one or any multiple technical features in steps S404 to S406, steps S416 to S424 can be replaced by any one or multiple technical features provided in steps S502 to S506 to form a new implementation manner according to the actual deployment needs, which will not be described one by one here.

[0132] The multimedia data interaction processing device provided in the present disclosure can implement, for example, the following.

[0133] In the above embodiment, a multimedia data interaction processing method is provided, and a multimedia data interaction processing device corresponding thereto is also provided, which will be described below with reference to the accompanying drawings.

[0134] Referring to FIG. 6, a schematic diagram of an embodiment of a multimedia data interaction processing device provided in the present embodiment is shown.

[0135] Since the device embodiment corresponds to the method embodiment, the description is relatively simple, and the related parts can be referred to the corresponding description of the method embodiment provided above. The device embodiment described below is only illustrative.

[0136] The multimedia data interaction processing device provided in the present embodiment includes a playing module 602 configured to acquire multimedia data sent by a server and perform playing processing; a display module 604 configured to display an interaction item corresponding to a playing interaction condition of the multimedia data after the playing interaction condition is triggered; and an interaction item sending module 606 configured to acquire a target interaction item submitted by a user and send the target interaction item to the server, so as to perform resource transfer into a resource account associated with the user based on the target interaction item and perform playing response processing.

[0137] The multimedia data interaction processing device provided in the present disclosure can implement, for example, the following.

[0138] Referring to FIG. 7, a schematic diagram of an embodiment of an interactive processing device for multimedia data is shown.

[0139] Since the device embodiment corresponds to the method embodiment, the description is relatively simple, and the relevant part can refer to the corresponding description of the method embodiment provided above. The device embodiment described below is only illustrative.

[0140] The embodiment provides an interactive processing device for multimedia data, which comprises a data sending module 702 configured to send multimedia data to a user terminal; an interactive item receiving module 704 configured to receive a target interactive item submitted by a user and sent by the user terminal; the target interactive item is submitted after a playing interactive condition of the multimedia data is triggered and a corresponding interactive item is displayed; and a playing response module 706 configured to perform resource transfer-in to a resource account associated with the user based on the target interactive item and perform playing response processing.

[0141] The disclosure provides an interactive processing device for multimedia data, which is based on the same technical concept as the method for interactive processing of multimedia data described above. One or more embodiments of the disclosure also provide an interactive processing device for multimedia data, which is used to execute the method for interactive processing of multimedia data provided above. FIG. 8 is a structural schematic diagram of an interactive processing device for multimedia data according to one or more embodiments of the disclosure.

[0142] The embodiment provides an interactive processing device for multimedia data, which comprises: as shown in FIG. 8, the interactive processing device for multimedia data can have great differences due to different configurations or performances, and can comprise one or more processors 801 and memories 802. One or more storage application programs or data can be stored in the memories 802. The memory 802 can be temporary storage or persistent storage. The application programs stored in the memory 802 can comprise one or more modules (not shown in the figure), and each module can comprise a series of computer executable instructions in the interactive processing device for multimedia data. Further, the processor 801 can be configured to communicate with the memory 802 and execute the series of computer executable instructions in the memory 802 on the interactive processing device for multimedia data. The interactive processing device for multimedia data can further comprise one or more power supplies 803, one or more wired or wireless network interfaces 804, one or more input / output interfaces 805, one or more keyboards 806, and the like.

[0143] In one specific embodiment, the multimedia data interactive processing device includes a memory and one or more programs, wherein one or more programs are stored in the memory, and one or more programs can include one or more modules, and each module can include a series of computer executable instructions in the multimedia data interactive processing device, and configured to be executed by one or more processors, the one or more programs include computer executable instructions for: obtaining multimedia data sent by a server and performing a playing process; after a playing interactive condition of the multimedia data is triggered, displaying an interactive item corresponding to the playing interactive condition; obtaining a target interactive item submitted by a user and sending to the server, to perform resource transfer to a resource account associated with the user based on the target interactive item and perform a playing response process.

[0144] Another multimedia data interactive processing device is provided by the present disclosure, which is configured to implement the above-mentioned another multimedia data interactive processing method. FIG. 9 is a structural schematic diagram of a multimedia data interactive processing device according to one or more embodiments of the present disclosure.

[0145] The multimedia data interactive processing device provided by the present embodiment includes: as shown in FIG. 9, the multimedia data interactive processing device can be different in configuration or performance, and can include one or more processors 901 and a memory 902. The memory 902 can store one or more storage applications or data. The memory 902 can be temporary storage or persistent storage. The applications stored in the memory 902 can include one or more modules (not shown in the figure), and each module can include a series of computer executable instructions in the multimedia data interactive processing device. Further, the processor 901 can be configured to communicate with the memory 902, and execute a series of computer executable instructions in the memory 902 on the multimedia data interactive processing device. The multimedia data interactive processing device can further include one or more power supplies 903, one or more wired or wireless network interfaces 904, one or more input / output interfaces 905, one or more keyboards 906, and the like.

[0146] In one specific embodiment, the interactive processing device of multimedia data comprises a memory and one or more programs, wherein one or more programs are stored in the memory, and one or more programs can comprise one or more modules, and each module can comprise a series of computer executable instructions of the interactive processing device of multimedia data, and the one or more programs configured to be executed by one or more processors include the following computer executable instructions: sending multimedia data to a user terminal; receiving a target interactive item submitted by a user sent by the user terminal; the target interactive item is submitted after a corresponding interactive item is triggered and displayed under a play interactive condition of the multimedia data; and performing resource transfer and play response processing based on the target interactive item to a resource account associated with the user.

[0147] The disclosure provides a computer readable storage medium, for example, an interactive processing method of multimedia data as described above. Based on the same technical concept, one or more embodiments of the disclosure also provide a computer readable storage medium.

[0148] The computer readable storage medium provided by the embodiment is used for storing computer executable instructions, and the computer executable instructions realize the following processes when executed: obtaining multimedia data sent by a server and performing play processing; after a play interactive condition of the multimedia data is triggered, displaying an interactive item corresponding to the play interactive condition; obtaining a target interactive item submitted by a user and sending the target interactive item to the server, so as to perform resource transfer and play response processing based on the target interactive item to a resource account associated with the user.

[0149] It should be noted that the embodiment of the computer readable storage medium in the disclosure and the embodiment of the interactive processing method of multimedia data in the disclosure are based on the same inventive concept, so the specific implementation of the embodiment can refer to the foregoing implementation of the corresponding method, and the repeated parts will not be described herein.

[0150] The disclosure provides another computer readable storage medium, for example, another interactive processing method of multimedia data as described above. Based on the same technical concept, one or more embodiments of the disclosure also provide another computer readable storage medium.

[0151] The computer readable storage medium provided by the embodiment is used for storing computer executable instructions, and the computer executable instructions realize the following processes when executed: obtaining multimedia data sent by a server and performing play processing; after a play interactive condition of the multimedia data is triggered, displaying an interactive item corresponding to the play interactive condition; obtaining a target interactive item submitted by a user and sending the target interactive item to the server, so as to perform resource transfer and play response processing based on the target interactive item to a resource account associated with the user.

[0152] It should be noted that the embodiment of the present disclosure about another computer readable storage medium is based on the same inventive concept as the embodiment of the method of interacting with another multimedia data in the present disclosure, and therefore the specific implementation of the embodiment can refer to the implementation of the corresponding method, and the repeated parts will not be described here.

[0153] The embodiments in the present disclosure are described in a progressive manner, and the same or similar parts between the embodiments can refer to each other. Each embodiment focuses on the difference from other embodiments, such as the device embodiment, the equipment embodiment, and the computer readable storage medium embodiment, which are similar to the method embodiment, and therefore the description is relatively simple. The related content in the device embodiment, the equipment embodiment, and the computer readable storage medium embodiment can refer to the part of the description of the method embodiment.

[0154] The specific embodiments of the present disclosure are described above. Other embodiments are within the scope of the appended claims. In some cases, acts or steps recited in the claims can be performed in a different order and still accomplish desirable results. Additionally, the process depicted in the figures does not necessarily require the particular order shown, or sequential order, to achieve desirable results. In certain implementations, multitasking and parallel processing can be advantageous or necessary.

[0155] In the 1930s, it was clear to distinguish whether an improvement in a technology was in hardware (e.g., improvement in circuit structure of diodes, transistors, switches, etc.) or in software (e.g., improvement in method flow). However, as technology has evolved, many improvements in method flow today can be considered as direct improvements in hardware circuit structure. Designers almost always obtain the corresponding hardware circuit structure by programming the improved method flow into the hardware circuit. Therefore, it cannot be said that an improvement in a method flow cannot be implemented by a hardware entity module. For example, a programmable logic device (PLD) (e.g., a field programmable gate array (FPGA)) is an integrated circuit whose logic function is determined by user programming of the device. A digital system is "integrated" on a PLD by the designer programming it, rather than by asking a chip manufacturer to design and fabricate a custom integrated circuit chip. Moreover, instead of manually fabricating an integrated circuit chip, this programming is now mostly implemented by "logic compiler" software, which is similar to a software compiler used in program development, and the original code before compilation is also written in a specific programming language, which is called a hardware description language (HDL), and there are many HDLs, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc., and the most commonly used are VHDL (Very-High-Speed Integrated Circuit Hardware Description Language) and Verilog. Those skilled in the art should also be aware that only a slight logical programming of the method flow in the above-mentioned hardware description languages and programming into an integrated circuit can easily obtain a hardware circuit that implements the logical method flow.

[0156] The controller can be implemented in any suitable way, for example, the controller can take the form of a microprocessor or processor and a computer readable medium storing computer readable program code, such as software or firmware, executable by the (micro)processor, logic gates, switches, an application specific integrated circuit (ASIC), a programmable logic controller and an embedded microcontroller, examples of which include but are not limited to the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20 and Silicone Labs C8051F320, the memory controller can also be implemented as part of the control logic of the memory. Those skilled in the art will also know that, in addition to being implemented in pure computer readable program code, the controller can also be implemented to perform the same functions in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers and embedded microcontrollers, etc. by logically programming the method steps. Therefore, such a controller can be considered as a hardware component, and the means included therein for implementing various functions can also be considered as structures within the hardware component. Alternatively, the means for implementing various functions can even be considered as both a software module implementing a method and a structure within a hardware component.

[0157] The systems, apparatuses, modules or units illustrated by the above embodiments can be specifically implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer can be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0158] For the sake of brevity, the above apparatuses are described in functional form in various units. Of course, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0159] Those skilled in the art will appreciate that one or more embodiments of the disclosure can be provided as a method, a system or a computer program product. Therefore, one or more embodiments of the disclosure can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Moreover, the disclosure can take the form of a computer program product implemented on one or more computer readable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage and the like) containing computer usable program code.

[0160] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks.

[0161] These computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart block or blocks.

[0162] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks.

[0163] In one typical configuration, the computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0164] The memory can include non-persistent memory and / or volatile memory, such as random access memory (RAM) and / or cache memory, for storing, in general, data and / or program instructions. The memory can also include non-volatile memory, such as read-only memory (ROM), electrically programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, or non-volatile random access memory (NVRAM) for storing, in general, data and / or program instructions. The memory is an example of computer readable media.

[0165] Computer-readable media includes permanent and non-permanent, movable and non-movable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer-readable storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible by a computing device. According to the definition herein, computer-readable media does not include transitory media such as modulated data signals and carriers.

[0166] It should also be noted that the terms "comprising", "containing", or any other variant thereof are intended to cover non-exclusive inclusions, such that a process, method, article or apparatus that comprises a list of elements does not only include those elements, but can also include other elements not expressly listed or inherent to such process, method, article or apparatus. Without more limitations, the element defined by the phrase "comprising at least one" does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising the element.

[0167] One or more embodiments of the present disclosure can be described in the general context of computer-executable instructions being executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, and the like, which perform particular tasks or implement particular abstract data types. One or more embodiments of the present disclosure can also be practiced in distributed computing environments where tasks are performed by remote processing devices that are connected through a communication network. In a distributed computing environment, program modules can be located in both local and remote computer storage media including storage devices.

[0168] The above description is only an embodiment of the present document and is not intended to limit the present document. For those skilled in the art, the present document can have various changes and modifications. Any modification, equivalent replacement, improvement, etc. within the spirit and principle of the present document shall be included in the scope of claims of the present document.

Claims

1. A method for interactive processing of multimedia data, comprising: Retrieve multimedia data sent by the server and perform playback processing; After the playback interaction condition of the multimedia data is triggered, the interactive item corresponding to the playback interaction condition is displayed. The system retrieves the target interaction item submitted by the user and sends it to the server to transfer resources to the resource account associated with the user based on the target interaction item and to perform playback response processing.

2. The interactive processing method for multimedia data according to claim 1, wherein the playback interaction conditions include at least one of the following: Is the playback status in the preset playback state? Has the playback progress reached the preset playback node? Are the user action data on the interactive page the preset actions? Does the user input interaction information match the preset interaction instructions? Are the interaction instructions for the virtual object of the multimedia data displayed in the playback window detected? in, The preset playback states include playback start state, playback pause state, and / or playback complete state.

3. The interactive processing method for multimedia data according to claim 1, wherein displaying the interactive item corresponding to the playback interactive condition includes: The interactive page displays the interactive text corresponding to the playback interactive conditions and at least one interactive item, as well as the amount of resources associated with each interactive item; Wherein, at least one of the interactive text, interactive items, and resource amount is displayed in the playback window of the interactive page, and / or, the at least one is displayed in the interactive area of ​​the interactive page.

4. The multimedia data interactive processing method according to claim 1, wherein the target interactive item is determined in the following manner: The target interaction item is the interaction item selected by the user from at least one of the displayed interaction items, or the target interaction item is determined based on the interaction item input by the user and / or the amount of resources.

5. The multimedia data interaction processing method according to claim 1, after the step of obtaining the target interaction item submitted by the user and sending it to the server is executed, it further includes: In cooperation with the server, perform playback response processing corresponding to the target interactive item and / or the playback interactive condition.

6. The multimedia data interactive processing method according to claim 5, wherein after the playback interaction condition is triggered, and before the operation of displaying the interactive item corresponding to the playback interaction condition is executed, it further includes: Pause the playback of the multimedia data, and / or lock the playback status of the multimedia data; Accordingly, the playback response processing corresponding to the playback interaction condition includes: The system receives an unlock command from the server and unlocks the playback status of the multimedia data based on the unlock command.

7. The multimedia data interactive processing method according to claim 5, wherein performing the playback response processing corresponding to the playback interaction condition includes: Receive the data segment corresponding to the target interactive item sent by the server, and play the data segment in the playback window; The data segment is determined from the data segments corresponding to each data branch configured for the preset playback node of the multimedia data in response to the playback interaction conditions, or the data segment is obtained by generating multimedia data by inputting the previously played data before the preset playback node, the target interaction item, and the data generation field into a large language model.

8. The multimedia data interactive processing method according to claim 1, after the step of obtaining the target interaction item submitted by the user and sending it to the server is executed, it further includes: The system receives multimedia sub-data from the server, which is generated based on the rights to be issued and prompts the issuance of rights, and plays the multimedia sub-data in the playback window.

9. The multimedia data interactive processing method according to claim 2, wherein if the playback interaction condition is whether the playback state is in the playback completed state, the corresponding playback response processing includes: Set an unlock period for the next multimedia data in the data sequence to which the multimedia data belongs, so that access to the next multimedia data can be granted to the user or the group to which the user belongs after the unlock period expires.

10. The interactive processing method for multimedia data according to claim 1, wherein the playback response processing includes: The rights and benefits corresponding to the target interaction item are issued to the user, rights and benefits matching the virtual object triggered by the interaction command are issued to the user, and / or rights and benefits are issued to each group member of the group to which the user belongs.

11. The multimedia data interactive processing method according to claim 1, wherein the step of transferring resources to the resource account associated with the user based on the target interactive item includes: Based on the resource amount associated with the target interaction item, resources are transferred out from the user's resource account, and the transferred resources are transferred into the user resource account created by the user in the resource service; or, Based on the resource amount of the target interaction item, resources are transferred out from the user's resource account and then transferred to the group resource account created in the resource service by the group to which the user belongs.

12. The interactive processing method for multimedia data according to claim 1, wherein acquiring the multimedia data sent by the server and performing playback processing includes: Based on the user's access instruction to access the resource service, an access request for the resource service is submitted to the server; Receive the multimedia data sent by the server and display the playback window of the multimedia data on the interactive page; The multimedia data is determined based on the user's multimedia access records, or based on the multimedia access records of the group to which the user belongs.

13. The interactive processing method for multimedia data according to claim 1, wherein acquiring the multimedia data sent by the server and performing playback processing includes: Receive data fragments of the multimedia project accessed by the user sent by the server, and play the data fragments on the interactive page.

14. The interactive processing method for multimedia data according to claim 1, wherein acquiring the multimedia data sent by the server and performing playback processing includes: Obtain the user's selection instruction for virtual objects or data branches in the multimedia data and submit it to the server; Receive data fragments corresponding to the virtual object or data branch sent by the server, and play the data fragments on the interactive page.

15. The interactive processing method for multimedia data according to claim 1, wherein the multimedia data is uploaded by the user or a group member of the group to which the user belongs; Alternatively, the multimedia data can be obtained by editing multimedia data according to the user's editing instructions for the data to be edited.

16. A method for interactive processing of multimedia data, comprising: Send multimedia data to the user terminal; Receive the target interaction item submitted by the user sent by the user terminal; The target interactive item is submitted after the multimedia data playback interactive conditions are triggered and the corresponding interactive item is displayed. Based on the target interaction item, resources are transferred to the user's associated resource account and playback response is performed.

17. The multimedia data interactive processing method according to claim 16, wherein the step of transferring resources to the resource account associated with the user based on the target interactive item includes: Based on the resource amount associated with the target interaction item, resources are transferred out from the user's resource account, and the transferred resources are transferred into the user resource account created by the user in the resource service; or, Based on the resource amount of the target interaction item, resources are transferred out from the user's resource account and then transferred to the group resource account created in the resource service by the group to which the user belongs.

18. The interactive processing method for multimedia data according to claim 16, wherein the playback response processing includes: An unlock command for the multimedia data is generated and sent to the user terminal to unlock the playback status; or, Set an unlock period for the next multimedia data in the data sequence to which the multimedia data belongs, so that access to the next multimedia data can be granted to the user or the group to which the user belongs after the unlock period expires.

19. The interactive processing method for multimedia data according to claim 16, wherein the playback response processing includes: In the data segments corresponding to each data branch configured for the preset playback node of the multimedia data in response to the playback interaction conditions, the data segment corresponding to the target interaction item is determined and sent to the user terminal; or, The previously played data before the preset playback node, the target interactive item, and the data generation field are input into the large language model to generate multimedia data, and the data fragments corresponding to the target interactive item are sent to the user terminal.

20. The interactive processing method for multimedia data according to claim 16, wherein the playback response processing includes: The rights and benefits corresponding to the target interaction item are issued to the user; rights and benefits matching the virtual object triggered by the interaction command are issued to the user; and / or rights and benefits are issued to each group member of the group to which the user belongs. or, Multimedia sub-data is generated based on the rights to be issued, prompting the issuance of rights, and sent to the user terminal to play the multimedia sub-data on the interactive page; the multimedia sub-data is generated through a large language model.

21. A multimedia data interactive processing device, comprising: The playback module is configured to acquire multimedia data sent by the server and perform playback processing. The display module is configured to display the interactive item corresponding to the playback interactive condition after the playback interactive condition of the multimedia data is triggered. The interaction item sending module is configured to obtain the target interaction item submitted by the user and send it to the server, so as to transfer resources to the resource account associated with the user based on the target interaction item and perform playback response processing.

22. A multimedia data interactive processing device, comprising: The data transmission module is configured to send multimedia data to the user terminal. An interaction item receiving module is configured to receive target interaction items submitted by the user and sent by the user terminal. The target interactive item is submitted after the multimedia data playback interactive conditions are triggered and the corresponding interactive item is displayed. The playback response module is configured to transfer resources to the user's associated resource account based on the target interaction item and perform playback response processing.

23. A multimedia data interactive processing device, comprising: processor; And, a memory configured to store computer-executable instructions, which, when executed, cause the processor to: Retrieve multimedia data sent by the server and perform playback processing; After the playback interaction condition of the multimedia data is triggered, the interactive item corresponding to the playback interaction condition is displayed. The system retrieves the target interaction item submitted by the user and sends it to the server to transfer resources to the resource account associated with the user based on the target interaction item and to perform playback response processing.

24. A multimedia data interactive processing device, comprising: processor; And, a memory configured to store computer-executable instructions, which, when executed, cause the processor to: Send multimedia data to the user terminal; The system receives a target interaction item submitted by the user terminal; the target interaction item is submitted after the multimedia data playback interaction condition is triggered and the corresponding interaction item is displayed. Based on the target interaction item, resources are transferred to the user's associated resource account and playback response is performed.

25. A computer-readable storage medium for storing computer-executable instructions that, when executed, implement the steps of the method of claim 1 or 16.

Images