Interactive processing method and device for multimedia data

Abstract

The embodiment of the present specification provides a multimedia data interactive processing method and device, wherein the multimedia data interactive processing method comprises the following steps: in the playing process of the multimedia data, first, the multimedia data is acquired from a server and played, and after the playing interactive condition of the multimedia data is triggered, an interactive item corresponding to the playing interactive condition is displayed, a target interactive item submitted by a user is acquired and sent to the server, resource transfer-in is performed to a resource account associated with the user based on the target interactive item, and playing response processing is performed, so as to provide the user with the interaction in the playing process of the multimedia data.

Description

[0001] This patent application is a divisional application of Chinese patent application No. CN202411099163.X, filed on August 9, 2024, entitled "Interactive Processing Method and Apparatus for Multimedia Data". Technical Field

[0002] This document relates to the field of data processing technology, and in particular to an interactive processing method and apparatus for multimedia data. Background Technology

[0003] As the internet continues to develop and expand, the application scope of online services provided by the internet is becoming wider and wider, gradually covering most users. In this context, various forms of online services have emerged, such as retrieving videos from the backend through application pages or web pages for online video playback. Users can also participate in video playback interactions by inputting bullet comments. However, as video resources become increasingly abundant, video resource providers face increasingly fierce competition in the process of increasing video access traffic. Summary of the Invention

[0004] This specification provides one or more embodiments of a multimedia data interactive processing method, including: acquiring multimedia data sent by a server and performing playback processing; displaying interactive items corresponding to the playback interactive conditions after the multimedia data playback interactive conditions are triggered; acquiring a target interactive item submitted by a user and sending it to the server, so as to transfer resources to the resource account associated with the user based on the target interactive item and perform playback response processing.

[0005] This specification provides one or more embodiments of another multimedia data interactive processing method, including: sending multimedia data to a user terminal; receiving a target interactive item submitted by a user from the user terminal; the target interactive item being submitted after the playback interactive conditions of the multimedia data are triggered and the corresponding interactive item is displayed; and transferring resources to the resource account associated with the user based on the target interactive item and performing playback response processing.

[0006] This specification provides one or more embodiments of a multimedia data interactive processing apparatus, including: a playback module configured to acquire multimedia data sent by a server and perform playback processing; a display module configured to display an interactive item corresponding to the playback interaction condition after the multimedia data playback interaction condition is triggered; and an interactive item sending module configured to acquire a target interactive item submitted by a user and send it to the server, so as to transfer resources to the resource account associated with the user based on the target interactive item and perform playback response processing.

[0007] This specification provides one or more embodiments of another multimedia data interactive processing apparatus, including: a data sending module configured to send multimedia data to a user terminal; an interaction item receiving module configured to receive a target interaction item submitted by a user sent by the user terminal; the target interaction item being submitted after the playback interaction conditions of the multimedia data are triggered and the corresponding interaction item is displayed; and a playback response module configured to transfer resources to the resource account associated with the user based on the target interaction item and perform playback response processing.

[0008] This specification provides one or more embodiments of a multimedia data interactive processing device, including: a processor; and a memory configured to store computer-executable instructions, which, when executed, cause the processor to: acquire multimedia data sent by a server and perform playback processing; display an interactive item corresponding to the playback interaction condition after the multimedia data playback interaction condition is triggered; acquire a target interactive item submitted by a user and send it to the server to transfer resources to the resource account associated with the user based on the target interactive item and perform playback response processing.

[0009] This specification provides one or more embodiments of another multimedia data interactive processing device, including: a processor; and a memory configured to store computer-executable instructions, which, when executed, cause the processor to: send multimedia data to a user terminal; receive a user-submitted target interaction item sent by the user terminal; the target interaction item is submitted after a playback interaction condition for the multimedia data is triggered and a corresponding interaction item is displayed; and, based on the target interaction item, transfer resources to the user's associated resource account and perform playback response processing.

[0010] This specification provides one or more embodiments of a computer-readable storage medium for storing computer-executable instructions, which, when executed, perform the following processes: acquiring multimedia data sent by a server and performing playback processing; displaying an interactive item corresponding to the playback interactive condition after the playback interactive condition of the multimedia data is triggered; acquiring a target interactive item submitted by a user and sending it to the server, so as to transfer resources to the resource account associated with the user based on the target interactive item and perform playback response processing.

[0011] This specification provides one or more embodiments of another computer-readable storage medium for storing computer-executable instructions, which, when executed, implement the following process: sending multimedia data to a user terminal; receiving a target interactive item submitted by the user terminal; the target interactive item being submitted after the playback interactive conditions of the multimedia data are triggered and the corresponding interactive item is displayed; and transferring resources to the resource account associated with the user based on the target interactive item and performing playback response processing. Attached Figure Description

[0012] To more clearly illustrate the technical solutions in one or more embodiments of this specification or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this specification. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0013] Figure 1 A schematic diagram illustrating the implementation environment of a multimedia data interactive processing method provided in one or more embodiments of this specification;

[0014] Figure 2 A flowchart illustrating a multimedia data interactive processing method provided in one or more embodiments of this specification;

[0015] Figure 3 A schematic diagram of an interactive page provided for one or more embodiments of this specification;

[0016] Figure 4 A flowchart illustrating a multimedia data interaction processing method for short video interaction scenarios, provided for one or more embodiments of this specification;

[0017] Figure 5 A flowchart illustrating another multimedia data interactive processing method provided in one or more embodiments of this specification;

[0018] Figure 6 A schematic diagram of an embodiment of a multimedia data interactive processing device provided in one or more embodiments of this specification;

[0019] Figure 7 A schematic diagram of another embodiment of a multimedia data interactive processing apparatus provided in one or more embodiments of this specification;

[0020] Figure 8 A schematic diagram of the structure of a multimedia data interactive processing device provided in one or more embodiments of this specification;

[0021] Figure 9This is a schematic diagram of the structure of another multimedia data interactive processing device provided in one or more embodiments of this specification. Detailed Implementation

[0022] To enable those skilled in the art to better understand the technical solutions in one or more embodiments of this specification, the technical solutions in one or more embodiments of this specification will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this specification, and not all of the embodiments. Based on one or more embodiments of this specification, all other embodiments obtained by those skilled in the art without creative effort should fall within the protection scope of this document.

[0023] The interactive processing method for multimedia data provided in one or more embodiments of this specification is applicable to the multimedia playback environment. (Refer to...) Figure 1 The implementation environment includes at least:

[0024] User terminal 101 and server 102;

[0025] The user terminal 101 is used for multimedia data playback processing and interactive processing during playback, and cooperates with the server 102 to perform playback response processing for multimedia data interactive processing. The user terminal 101 can be a mobile phone, personal computer, tablet computer, e-book reader, VR (Virtual Reality) based information interaction device, vehicle terminal, IoT device, wearable smart device, laptop computer and desktop computer, etc.

[0026] Server 102 is used to respond to the interactive processing of user terminals during the playback processing of multimedia data and to perform playback response processing. Server 102 can be a single server, a server cluster consisting of several servers, or one or more cloud servers in a cloud computing platform.

[0027] In this implementation environment, when user terminal 101 and server 102 cooperate to interact during the playback of multimedia data, user terminal 101 first obtains the multimedia data to be played from server 102. During the acquisition process, server 102 cooperates with user terminal 101 to send the multimedia data to user terminal 101. After obtaining the multimedia data, user terminal 101 performs playback processing of the multimedia data. When the playback interaction conditions of the multimedia data are triggered, it displays the interaction items corresponding to the playback interaction conditions, obtains the target interaction items submitted by the user participating in the playback interaction based on the displayed interaction items, and submits the target interaction items submitted by the user to server 102. This enables server 102 to transfer resources to the user's associated resource account based on the provided target interaction items and perform corresponding playback response processing, thereby realizing the user's playback interaction around the multimedia data during the playback process.

[0028] This specification provides one or more embodiments of a multimedia data interactive processing method, as follows:

[0029] Reference Figure 2 The multimedia data interactive processing method provided in this embodiment specifically includes steps S202 to S206.

[0030] Step S202: Obtain the multimedia data sent by the server and perform playback processing.

[0031] The multimedia data described in this embodiment can be video data, animation data, or cartoon data. It can also be multimedia data in other data formats, such as multimedia data composed of any form of audio and text data, or multimedia data composed of any form of image data and audio / text or text data. This embodiment uses video data as an example to describe the multimedia data playback processing and interaction process. For the playback processing and interaction processes of other multimedia data formats, please refer to the specific implementation methods of the video data playback processing and interaction process; these will not be elaborated upon in this embodiment.

[0032] Optionally, multimedia data is provided by a resource service provider. Users can browse and view the multimedia data provided by the resource service while accessing it, and perform corresponding playback interactions during the playback process. The resource service refers to services that provide users with resource-related processing, such as creating resource accounts and transferring resources to those accounts, and creating shared resource accounts for groups of multiple users, allowing each user in the group to transfer resources to the created group resource account.

[0033] In addition, to enhance the flexibility and participation of users in accessing and playing multimedia data in the resource service, multimedia data can also be uploaded by users, or users can edit the uploaded data to obtain multimedia data that can be played interactively during the playback process; for users who create groups in the resource service or participate in existing groups in the resource service, multimedia data can also be uploaded by group members of the user's group, or group members can edit the uploaded data to obtain multimedia data that can be played interactively during the playback process.

[0034] Optionally, the multimedia data is uploaded by the user or a member of the group to which the user belongs; or, the multimedia data is obtained by editing the multimedia data according to the editing instructions of the user and / or group members for the data to be edited.

[0035] In practice, the system first acquires the multimedia data sent by the server and then processes it for playback. Specifically, during the acquisition of multimedia data, an access request can be submitted to the server, which responds by returning the multimedia data.

[0036] In one optional implementation of this embodiment, acquiring multimedia data sent by the server and performing playback processing includes:

[0037] Based on the user's access instruction to access the resource service, an access request for the resource service is submitted to the server;

[0038] The system receives the multimedia data sent by the server and displays a playback window for the multimedia data on the interactive page.

[0039] In the specific execution process, after the user terminal sends the access request to the server, the server determines the multimedia data corresponding to the access request and sends the determined multimedia data to the user terminal that sent the access request.

[0040] Optionally, the multimedia data may be determined based on the user's multimedia access records, or based on the multimedia access records of the group to which the user belongs. It should be noted that, considering that the user's multimedia access records and the multimedia access records of the user's group constitute a degree of user data privacy, data authorization from the user or the user's group may be obtained before determining the multimedia data based on these records. For example, data authorization may be granted when the user first accesses the resource service, or during the user's first multimedia data playback and interaction through the resource service.

[0041] In practical applications, there may be situations where users access multimedia items with data relationships. In this regard, during the process of obtaining multimedia data from the server, the corresponding multimedia data can be obtained from the server based on the multimedia items accessed by the user. Specifically, in another optional implementation provided in this embodiment, obtaining multimedia data sent by the server and performing playback processing includes: receiving data segments of the multimedia items accessed by the user sent by the server, and playing the data segments on the interactive page.

[0042] Multimedia projects refer to collections of multimedia data that have a continuous playback relationship or content association relationship, such as video dramas composed of multiple episodes, short video dramas composed of multiple short videos, or animated series composed of multiple episodes of animation.

[0043] Furthermore, to enhance user interactivity during multimedia data playback, even when the multimedia data is already playing, the system can retrieve the corresponding multimedia data from the server based on user interactions with the multimedia data. Specifically, in the third optional implementation provided in this embodiment, retrieving the multimedia data sent by the server and performing playback processing includes:

[0044] Obtain the user's selection instruction for virtual objects in the multimedia data and submit it to the server;

[0045] Receive the data fragment corresponding to the virtual object sent by the server, and play the data fragment on the interactive page;

[0046] or,

[0047] Obtain the user's selection instruction for the data branch of the multimedia data and submit it to the server;

[0048] Receive the data segment corresponding to the data branch sent by the server, and play the data segment on the interactive page.

[0049] Virtual objects in multimedia data refer to virtual objects displayed during the playback process, such as characters, objects, or environments. Data branches in multimedia data refer to the ability, when playback reaches a node with selectable story branches, to allow users to choose any one of these branches and retrieve the multimedia data for that branch from the server for playback.

[0050] It should be noted that, in the specific implementation process, any one of the three methods provided above for obtaining and playing multimedia data sent by the server can be selected according to actual needs. It should also be noted that any two or three of the above three methods can be combined as a whole according to actual needs, and appropriate technical means can be selected from the three methods to form a new implementation method. For example, obtaining the user's selection instruction for the virtual object of the multimedia project and submitting it to the server, receiving the data fragment of the virtual object in the multimedia project sent by the server, and playing the data fragment on the interactive page.

[0051] Furthermore, it should be noted that the process of acquiring and playing multimedia data sent by the server can also be replaced by acquiring multimedia data sent by the server. Accordingly, the specific implementation of acquiring multimedia data sent by the server can adopt some of the technical means provided by the three implementation methods mentioned above, or adopt some of the technical means provided by a new implementation method formed on the basis of the three implementation methods mentioned above. For example, acquiring multimedia data sent by the server may include: submitting an access request for a resource service to the server according to the user's access instruction for accessing the resource service, and receiving multimedia data sent by the server; or receiving data fragments of multimedia items accessed by the user sent by the server; or acquiring the user's selection instruction for virtual objects or data branches in the multimedia data and submitting it to the server, and receiving data fragments corresponding to the virtual objects or data branches sent by the server.

[0052] Step S204: After the playback interaction condition of the multimedia data is triggered, display the interaction item corresponding to the playback interaction condition.

[0053] During the process of acquiring and playing multimedia data, users can interact with the playback. In this embodiment, after the playback interaction conditions are triggered, interactive items corresponding to the playback interaction conditions are displayed. Based on this, users can interact with the playback through the provided interactive items.

[0054] The playback interaction conditions described in this embodiment refer to the conditions for playback interaction during the playback of multimedia data, specifically the conditions for playback interaction by displaying interactive items. Optionally, the playback interaction conditions include at least one of the following: whether the playback state is in a preset playback state, whether the playback progress has reached a preset playback node, whether the user's action data on the interaction page is a preset action, whether the user's input interaction information matches a preset interaction command, and whether an interaction command for the virtual object of the multimedia data displayed in the playback window is detected.

[0055] Specifically, regarding the playback interaction condition of whether the playback state is in the preset playback state, if the playback state is in the preset playback state, the playback interaction condition is determined to be triggered; otherwise, if the playback state is not in the preset playback state, the playback interaction condition is determined not to be triggered. Optionally, the preset playback state includes the playback start state, the playback pause state, and / or the playback complete state.

[0056] Regarding the playback interaction condition of whether the playback progress has reached the preset playback node, if the playback progress reaches the preset playback node, it is determined that the playback interaction condition has been triggered; otherwise, if the playback progress reaches the preset playback node, it is determined that the playback interaction condition has not been triggered. The preset playback node can be a pre-set time node or a data node (multimedia node or video node), such as a plot node in multimedia data where a certain character appears.

[0057] The playback interaction condition is determined based on whether the user's action data on the interactive page is a preset action. If the user's action data on the interactive page is a preset action, the playback interaction condition is determined to be triggered. Conversely, if the user's action data on the interactive page is not a preset action, the playback interaction condition is determined not to be triggered. Specifically, the playback interaction condition can be determined by identifying the user action data. If the identified user action is a preset action, the playback interaction condition is determined to be triggered.

[0058] The playback interaction condition is determined based on whether the user's input interaction information matches the preset interaction command. If the user's input interaction information matches the preset interaction command, the playback interaction condition is determined to be triggered. Otherwise, if the user's input interaction information does not match the preset interaction command, the playback interaction condition is determined not to be triggered. The user's input interaction information can be voice information and / or text information. For example, if the user's input voice information contains the word "interaction", the playback interaction condition is determined to be triggered. Or, if the user's input text information contains the keyword "interaction", the playback interaction condition is determined to be triggered.

[0059] Regarding the playback interaction condition of whether an interaction command is detected on the virtual object of the multimedia data displayed in the playback window, if an interaction command is detected on the virtual object of the multimedia data displayed in the playback window, it is determined that the playback interaction condition has been triggered; otherwise, if no interaction command is detected on the virtual object of the multimedia data displayed in the playback window, it is determined that the playback interaction condition has not been triggered. For example, if an interaction command is detected on a specific person, object, or environment in the multimedia data displayed in the playback window, it is determined that the playback interaction condition has not been triggered.

[0060] The five playback interaction conditions provided above can be selected for implementation according to actual needs. It should be noted that at least two of these conditions can be combined to form new playback interaction conditions. For example, a playback interaction condition could be whether the playback state is in a preset state and whether the user's action data on the interaction page is a preset action. If the playback state is in a preset state and the user's action data on the interaction page is a preset action, then the playback interaction condition is triggered. Furthermore, appropriate technical means can be selected from the five playback interaction conditions to form new playback interaction conditions. For example, a playback interaction condition could be whether the user's input interaction information matches the virtual object of the multimedia data displayed in the playback window. If the user's input interaction information matches the virtual object of the multimedia data displayed in the playback window, then the playback interaction condition is triggered.

[0061] In specific implementation, when the playback interaction condition of multimedia data is triggered, the interactive items corresponding to the playback interaction condition are displayed based on the triggered playback interaction condition. In an optional implementation provided in this embodiment, displaying the interactive items corresponding to the playback interaction condition includes: displaying the interactive text corresponding to the playback interaction condition and at least one interactive item on the interactive page, as well as the resource amount associated with each interactive item.

[0062] In addition, the interactive page can display any one or any two of the following three types of interactive content: interactive text corresponding to the interactive conditions, at least one interactive item, and the amount of resources associated with each interactive item. For example, the interactive page can display at least one interactive item, or interactive text; or interactive text and at least one interactive item, or at least one interactive item and the amount of resources associated with each interactive item.

[0063] Wherein, at least one of the interactive text, interactive items, and resource amounts (i.e., at least one of the three interactive contents—interactive text, at least one interactive item, and resource amounts associated with each interactive item—is displayed in the playback window of the interactive page, and / or, at least one of the interactive text, interactive items, and resource amounts (i.e., at least one of the three interactive contents—interactive text, at least one interactive item, and resource amounts associated with each interactive item—is displayed in the interactive area of ​​the interactive page.)

[0064] For example, Figure 3The interactive page of a short video in the short video drama shown above is where the short video is played and displayed in the playback window 301 of the interactive page. When the playback progress reaches a preset playback node, or when the user's input interaction information matches the preset interaction command, the interactive text 302 is displayed in the playback window 301, and the first interaction item 304 and the second interaction item 305 are displayed in the interaction area 303. The first interaction item 304 displays the associated resource amount "Transfer resource amount a", and the second interaction item 305 displays the associated resource amount "Transfer resource amount b".

[0065] In this embodiment, to enhance the user's interactive experience and sense of participation in multimedia data playback, when the playback interaction condition is triggered, and before displaying the corresponding interactive item operation, the user can also enter the multimedia data playback interaction by pausing or locking the multimedia data.

[0066] Specifically, in one optional implementation of this embodiment, after the playback interaction condition is triggered and before the operation of the interactive item corresponding to the playback interaction condition is executed, the method further includes: pausing the playback of the multimedia data, and / or locking the playback status of the multimedia data.

[0067] It should be noted that the process of displaying the interactive item corresponding to the playback interactive condition after the playback interactive condition of the multimedia data is triggered can be replaced by displaying the interactive item of the multimedia data, wherein the interactive item includes interactive text and at least one interactive item and / or the resource amount associated with each interactive item; in addition, the process of displaying the interactive item corresponding to the playback interactive condition can also be replaced by displaying the interactive text corresponding to the playback interactive condition and at least one interactive item and / or the resource amount associated with each interactive item.

[0068] Step S206: Obtain the target interaction item submitted by the user and send it to the server, so as to transfer resources to the resource account associated with the user based on the target interaction item and perform playback response processing.

[0069] Based on the above-mentioned interactive items, users can interact with multimedia data playback based on the displayed interactive items. Specifically, they can submit a target interactive item based on the displayed interactive items to perform playback interaction. Here, the target interactive item submitted by the user is obtained and sent to the server. After receiving the sent target interactive item, the server transfers resources to the user's associated resource account based on the target interactive item and performs playback response processing (playback interaction processing).

[0070] In a specific implementation, based on the displayed interactive items, in an optional implementation of this embodiment, the target interactive item is determined in the following way: the interactive item selected by the user from at least one of the displayed interactive items is taken as the target interactive item.

[0071] Furthermore, to enhance the flexibility of user interaction in multimedia data playback, the target interaction item can be determined based on the user-input interaction item and / or the amount of resources. For example, the interaction item corresponding to the user-input interaction information can be determined as the target interaction item. For instance, based on the user-input voice or text information, if the voice information contains the corpus of the first interaction item, then the first interaction item is taken as the target interaction item; if the text information contains the keywords of the second interaction item, then the second interaction item is taken as the target interaction item.

[0072] For example, the resource amount corresponding to the user's input interaction information is determined, and the interaction item associated with that resource amount is taken as the target interaction item. For instance, based on the user's input voice or text information, if the voice information contains corpus of the resource amount associated with the first interaction item, then the first interaction item is taken as the target interaction item; if the text information contains keywords of the resource amount associated with the first interaction item, then the second interaction item is taken as the target interaction item.

[0073] In this embodiment, after obtaining the target interaction item submitted by the user and sending it to the server, the server, upon receiving the sent target interaction item, transfers resources to the resource account associated with the user based on the target interaction item and performs playback response processing (playback interaction processing); correspondingly, after obtaining the target interaction item submitted by the user and sending it to the server, it can also cooperate with the server to perform playback response processing.

[0074] In one optional implementation of this embodiment, after obtaining the target interaction item submitted by the user and sending it to the server for execution, the method further includes: cooperating with the server to perform playback response processing corresponding to the target interaction item and / or the playback interaction conditions; or performing playback interaction processing corresponding to the target interaction item and / or the playback interaction conditions; or cooperating with the server to perform playback interaction processing.

[0075] As described above, in the case of pausing the playback of the multimedia data and / or locking the playback state of the multimedia data after the playback interaction condition is triggered and before the operation of the interactive item corresponding to the playback interaction condition is executed, in an optional implementation of this embodiment, the playback response processing corresponding to the playback interaction condition is performed, including: receiving an unlocking instruction issued by the server and unlocking the playback state of the multimedia data based on the unlocking instruction.

[0076] In another optional implementation of this embodiment, the playback response processing corresponding to the playback interaction conditions includes: receiving the data segment corresponding to the target interaction item sent by the server, and playing the data segment in the playback window.

[0077] Optionally, the data segment is determined from the data segments corresponding to each data branch configured in the multimedia data for the preset playback node of the playback interaction conditions, or the data segment is obtained by generating multimedia data by inputting the already played data before the preset playback node, the target interaction item and / or data generation field into a large language model.

[0078] Furthermore, after obtaining the target interaction item submitted by the user and sending it to the server, the server, upon receiving the sent target interaction item, transfers resources to the resource account associated with the user based on the target interaction item and performs playback response processing (playback interaction processing). On this basis, to enhance the user's willingness to participate in playback interaction during the multimedia video playback process, the server can also increase the user's enthusiasm for participation by issuing benefits. Furthermore, the server can also enhance the user's perception of benefit issuance by playing multimedia data related to the benefits. Specifically, in one optional implementation of this embodiment, after the step of obtaining the target interaction item submitted by the user and sending it to the server is executed, the method further includes: receiving multimedia sub-data generated by the server based on the benefits to be issued, providing a benefit issuance prompt, and playing the multimedia sub-data in the playback window.

[0079] Optionally, the multimedia sub-data for providing notifications of rights distribution can be pre-generated by the resource service provider based on the rights to be distributed, or it can be obtained by inputting the rights to be distributed and the data generation fields into a large language model to generate multimedia sub-data.

[0080] In practical applications, when a target interaction item is sent to the server, and the server transfers resources to the user's associated resource account based on the target interaction item, there may be situations where the user transfers resources to a user resource account created by themselves, or there may be situations where the user transfers resources to a group resource account created by other users. The following provides implementation methods for resource transfer in these two situations respectively.

[0081] In an optional implementation of this embodiment, for the scenario where a user transfers resources to a user resource account that they have created independently, the transfer of resources to the user's associated resource account based on the target interaction item includes: transferring resources out of the user's resource account based on the amount of resources associated with the target interaction item, and transferring the transferred resources to the user resource account (personal resource account or independent resource account) created by the user in the resource service.

[0082] In another optional implementation of this embodiment, for the scenario where a user transfers resources to a group resource account jointly created with other users, the transfer of resources to the resource account associated with the user based on the target interaction item includes: transferring resources out of the user's resource account based on the resource amount of the target interaction item, and transferring the transferred resources to the group resource account (shared resource account) created by the group to which the user belongs in the resource service.

[0083] In this embodiment, the target interaction item is sent to the server. After the server transfers resources to the user's associated resource account based on the received target interaction item, it needs to perform corresponding playback response processing. In the case where the playback interaction conditions include whether the playback state is in a preset playback state, and the preset playback state includes a playback completion state (i.e., when the playback interaction condition is that the playback state is in a playback completion state, i.e., when the multimedia video playback is complete), in an optional implementation of this embodiment, the playback response processing includes: setting an unlocking period for the next multimedia data in the data sequence to which the multimedia data belongs; optionally, after the unlocking period expires, access to the next multimedia data is granted to the user or the group to which the user belongs.

[0084] For example, multiple short videos form a short video series. After the short video currently accessed by the user finishes playing, the next episode of the short video is determined, and the unlock date of the next episode is set. After the unlock date arrives, the next episode is unlocked and the user can access it.

[0085] In addition, during the playback response processing, another optional implementation provided in this embodiment includes at least one of the following three methods: issuing rights corresponding to the target interactive item to the user, issuing rights matching the virtual object triggered by the interactive command to the user, and issuing rights to each group member of the group to which the user belongs.

[0086] It should be noted that, in addition to the two optional implementation methods provided above, the server can also use any one of the following four optional implementation methods to perform playback response processing:

[0087] Option 1: Generate an unlock command for multimedia data and send it to the user terminal to unlock the playback status;

[0088] Option 2: In the data segments corresponding to each data branch of the multimedia data configured for the preset playback node under the playback interaction conditions, determine the data segment corresponding to the target interaction item and send it to the user terminal;

[0089] Option 3: Input the previously played data before the preset playback node, the target interactive item, and the data generation field into the large language model to generate multimedia data, and send the data fragments corresponding to the output target interactive item to the user terminal.

[0090] Optional Implementation Method 4: Based on the rights to be issued, generate multimedia sub-data to prompt the issuance of rights and distribute it to the user terminal so that the multimedia sub-data can be played on the interactive page; the multimedia sub-data is generated through a large language model.

[0091] Furthermore, it should be noted that any of the six playback response processing methods provided above can be selected for implementation according to actual needs. It should also be noted that these six methods can be combined in combination to form new implementation methods, or appropriate technical means can be selected from the six methods to form new implementation methods. For example, the previously played data before the preset playback node, the target interactive item, and the data generation field can be input into a large language model to generate multimedia data, outputting data fragments corresponding to the target interactive item and unlocking instructions for the generated multimedia data; the output data fragments and the generated unlocking instructions can be sent to the user terminal to unlock the playback state based on the unlocking instructions and play the data fragments in the playback window; another example is generating multimedia sub-data based on pending benefits to prompt the distribution of benefits, generating unlocking instructions for multimedia data, sending multimedia sub-data and unlocking instructions to the user terminal to unlock the playback state and play the multimedia sub-data on the interactive page.

[0092] Based on this, the above-mentioned process of cooperating with the server to perform playback response processing corresponding to the target interaction item and / or playback interaction conditions, the process of performing playback interaction processing corresponding to the target interaction item and / or playback interaction conditions, and the process of cooperating with the server to perform playback interaction processing can respectively execute the processing processes corresponding to the six optional implementation methods of performing playback response processing with the server provided above:

[0093] For example, in optional implementation method one: obtain the unlock period of the next multimedia data in the data sequence to which the multimedia data belongs from the server and display it;

[0094] Optional Implementation Method Two: Obtain the distribution results of rights and benefits from the server;

[0095] Option 3: Receive the unlock command issued by the server, and unlock the playback status of the multimedia data based on the unlock command;

[0096] Option 4: Receive the data segment corresponding to the target interactive item determined in the data segments corresponding to each data branch configured in the preset playback node, sent by the server, and play the data segment in the playback window;

[0097] Option 5: Receive the data fragments corresponding to the target interactive items generated by the large language model from the server, and play the data fragments in the playback window;

[0098] Option 6: Receive multimedia sub-data from the server that generates a notification for the distribution of rights based on the rights to be distributed, and play the multimedia sub-data on the interactive page.

[0099] Correspondingly, when the server combines at least two of the above six implementation methods to form a new implementation method according to actual needs, or selects appropriate technical means from the six implementation methods to form a new implementation method according to actual needs, the following processes can also be executed: the playback response processing corresponding to the target interaction item and / or playback interaction conditions, the playback interaction processing corresponding to the target interaction item and / or playback interaction conditions, and the playback interaction processing processing in cooperation with the server. For example, receiving data segments and generated unlock commands from the server, unlocking the playback state based on the unlock commands, and playing the data segments in the playback window; or receiving multimedia sub-data and unlock commands from the server, unlocking the playback state, and playing the multimedia sub-data on the interactive page.

[0100] The implementation process of the multimedia data interactive processing method provided above can be executed by a user terminal. The implementation process of the other multimedia data interactive processing method provided in the following method embodiment can be executed by a server. The two can cooperate with each other during execution. Therefore, when reading the above implementation process, you can refer to the corresponding content of the following other multimedia data interactive processing method embodiment. Correspondingly, when reading the following other multimedia data interactive processing method embodiment, you can also refer to the corresponding content of the above method embodiment.

[0101] The following example uses the application of a multimedia data interactive processing method provided in this embodiment in a short video interactive scenario, combined with... Figure 4 The interactive processing method for multimedia data provided in this embodiment will be further explained below. Figure 4 The interactive processing method for multimedia data applied to short video interactive scenarios includes the following steps.

[0102] Step S402: Submit an access request to the server according to the user's access instruction for accessing the resource service.

[0103] Step S408: Receive the short video sent by the server and display the playback window of the short video on the interactive page.

[0104] Step S410: After the short video playback interaction condition is triggered, display the interaction item corresponding to the playback interaction condition.

[0105] Step S412: Obtain the target interactive item selected by the user among the displayed interactive items.

[0106] Step S414: Send the target interaction item to the server.

[0107] Step S426: Receive the unlocking period and rights distribution information for the next short video in the short video series to which the short video belongs from the server.

[0108] Step S428: Display the unlock period of the next short video on the interactive page, and play the short video of rights distribution in the playback window.

[0109] Steps S402, S408 to S414, and S426 to S428 provided in this embodiment are executed by the user terminal. It should be noted that the steps S402, S408 to S414, and S426 to S428 executed by the user terminal can cooperate with steps S404 to S406 and S416 to S424 executed by the server in the following embodiment. Therefore, when reading this embodiment, please refer to the corresponding content of steps S404 to S406 and S416 to S424 provided in the following method embodiment. When reading the following method embodiment, please refer to the corresponding content of steps S402, S408 to S414, and S426 to S428 provided in this embodiment.

[0110] It should be noted that any one or more of steps S402, S408 to S414, and S426 to S428 can be combined with any one or more of steps S202 to S206 to form a new implementation method according to the needs of implementation and deployment. In addition, any one or more technical features in steps S402, S408 to S414, and S426 to S428 can be selected according to the actual deployment needs and combined with any one or more technical features provided in steps S202 to S206 to form a new implementation method. Alternatively, any one or more technical features in steps S402, S408 to S414, and S426 to S428 can also be replaced with any one or more technical features provided in steps S202 to S206 to form a new implementation method according to the actual deployment needs. These will not be elaborated on here.

[0111] One or more embodiments of another multimedia data interactive processing method provided in this specification are as follows:

[0112] Reference Figure 5 The interactive processing method for multimedia data provided in this embodiment specifically includes steps S502 to S506.

[0113] Step S502: Send multimedia data to the user terminal.

[0114] The multimedia data described in this embodiment can be video data, animation data, or cartoon data. It can also be multimedia data in other data formats, such as multimedia data composed of any form of audio and text data, or multimedia data composed of any form of image data and audio / text or text data. This embodiment uses video data as an example to describe the multimedia data playback processing and interaction process. For the playback processing and interaction processes of other multimedia data formats, please refer to the specific implementation methods of the video data playback processing and interaction process; these will not be elaborated upon in this embodiment.

[0115] Optionally, multimedia data is provided by a resource service provider. Users can browse and view the multimedia data provided by the resource service while accessing it, and perform corresponding playback interactions during the playback process. The resource service refers to services that provide users with resource-related processing, such as creating resource accounts and transferring resources to those accounts, and creating shared resource accounts for groups of multiple users, allowing each user in the group to transfer resources to the created group resource account.

[0116] In addition, to enhance the flexibility and participation of users in accessing and playing multimedia data in the resource service, multimedia data can also be uploaded by users, or users can edit the uploaded data to obtain multimedia data that can be played interactively during the playback process; for users who create groups in the resource service or participate in existing groups in the resource service, multimedia data can also be uploaded by group members of the user's group, or group members can edit the uploaded data to obtain multimedia data that can be played interactively during the playback process.

[0117] Optionally, the multimedia data is uploaded by the user or a member of the group to which the user belongs; or, the multimedia data is obtained by editing the multimedia data according to the editing instructions of the user and / or group members for the data to be edited.

[0118] In practice, multimedia data is first sent to the user terminal for playback. Specifically, during the process of sending multimedia data to the user terminal, multimedia data can be sent in response to an access request submitted by the user terminal.

[0119] In one optional implementation of this embodiment, sending multimedia data to a user terminal includes: receiving an access request submitted by the user terminal, determining the multimedia data corresponding to the access request, and sending the determined multimedia data to the user terminal.

[0120] Optionally, the multimedia data may be determined based on the user's multimedia access records, or based on the multimedia access records of the group to which the user belongs.

[0121] It should be noted that, considering that a user's multimedia access records and the multimedia access records of the user's group are to some extent considered part of the user's data privacy, data authorization from the user or the user's group can be obtained before determining the multimedia data based on the user's multimedia access records or the multimedia access records of the user's group. For example, data authorization can be granted when the user first accesses the resource service, or during the process of the user first accessing the resource service to play multimedia data and interact with the playback.

[0122] In practical applications, there may be situations where users access multimedia projects with data relationships. In this case, during the process of sending multimedia data to the user terminal, the corresponding multimedia data can be determined and sent to the user terminal based on the multimedia project accessed by the user. Specifically, in another optional implementation provided in this embodiment, sending multimedia data to the user terminal includes: reading data segments of the multimedia project accessed by the user terminal and sending them to the user terminal. Here, a multimedia project refers to a collection of multimedia data composed of partial multimedia data that has a continuous playback relationship or content association relationship, such as a video drama composed of multiple episodes, a short video drama composed of multiple short videos, or an animated series composed of multiple episodes of animation.

[0123] Furthermore, to enhance user interactivity during multimedia data playback, even when the multimedia data is already playing, the corresponding multimedia data can be determined and sent to the user terminal based on the user's interaction with the multimedia data. Specifically, in the third optional implementation provided in this embodiment, sending multimedia data to the user terminal includes:

[0124] Based on the selection instruction for virtual objects in multimedia data submitted by the user terminal, determine the data segment corresponding to the virtual object and send it to the user terminal;

[0125] or,

[0126] Based on the data branch selection instruction for multimedia data submitted by the user terminal, the data segment corresponding to the data branch is determined and sent to the user terminal.

[0127] Virtual objects in multimedia data refer to virtual objects displayed during the playback process, such as characters, objects, or environments. Data branches in multimedia data refer to the ability, when playback reaches a node with selectable story branches, to allow users to choose any one of these branches and retrieve the multimedia data for that branch from the server for playback.

[0128] The above-mentioned three methods for sending multimedia data to user terminals can be implemented according to actual needs. It should be noted that any two or three of the above three methods can be combined to form a new method, and appropriate technical means can be selected from the three methods to form a new method.

[0129] Step S504: Receive the target interaction item submitted by the user sent by the user terminal.

[0130] After the multimedia data is sent to the user terminal, the user terminal performs multimedia data playback processing. During this process, the user can perform playback interaction. Specifically, the user can perform playback interaction based on the interactive items corresponding to the playback interaction conditions after the multimedia data playback interaction conditions are triggered. Here, the user-submitted target interactive items are received from the user terminal.

[0131] Optionally, the target interactive item is submitted after the multimedia data playback interactive conditions are triggered and the corresponding interactive item is displayed.

[0132] The playback interaction conditions described in this embodiment refer to the conditions for playback interaction during the playback of multimedia data, specifically the conditions for playback interaction by displaying interactive items. Optionally, the playback interaction conditions include at least one of the following: whether the playback state is in a preset playback state, whether the playback progress has reached a preset playback node, whether the user's action data on the interaction page is a preset action, whether the user's input interaction information matches a preset interaction command, and whether an interaction command for the virtual object of the multimedia data displayed in the playback window is detected.

[0133] Specifically, regarding the playback interaction condition of whether the playback state is in the preset playback state, if the playback state is in the preset playback state, the playback interaction condition is determined to be triggered; otherwise, if the playback state is not in the preset playback state, the playback interaction condition is determined not to be triggered. Optionally, the preset playback state includes the playback start state, the playback pause state, and / or the playback complete state.

[0134] Regarding the playback interaction condition of whether the playback progress has reached the preset playback node, if the playback progress reaches the preset playback node, it is determined that the playback interaction condition has been triggered; otherwise, if the playback progress reaches the preset playback node, it is determined that the playback interaction condition has not been triggered. The preset playback node can be a pre-set time node or a data node (multimedia node or video node), such as a plot node in multimedia data where a certain character appears.

[0135] The playback interaction condition is determined based on whether the user's action data on the interactive page is a preset action. If the user's action data on the interactive page is a preset action, the playback interaction condition is determined to be triggered. Conversely, if the user's action data on the interactive page is not a preset action, the playback interaction condition is determined not to be triggered. Specifically, the playback interaction condition can be determined by identifying the user action data. If the identified user action is a preset action, the playback interaction condition is determined to be triggered.

[0136] The playback interaction condition is determined based on whether the user's input interaction information matches the preset interaction command. If the user's input interaction information matches the preset interaction command, the playback interaction condition is determined to be triggered. Otherwise, if the user's input interaction information does not match the preset interaction command, the playback interaction condition is determined not to be triggered. The user's input interaction information can be voice information and / or text information. For example, if the user's input voice information contains the word "interaction", the playback interaction condition is determined to be triggered. Or, if the user's input text information contains the keyword "interaction", the playback interaction condition is determined to be triggered.

[0137] Regarding the playback interaction condition of whether an interaction command is detected on the virtual object of the multimedia data displayed in the playback window, if an interaction command is detected on the virtual object of the multimedia data displayed in the playback window, it is determined that the playback interaction condition has been triggered; otherwise, if no interaction command is detected on the virtual object of the multimedia data displayed in the playback window, it is determined that the playback interaction condition has not been triggered. For example, if an interaction command is detected on a specific person, object, or environment in the multimedia data displayed in the playback window, it is determined that the playback interaction condition has not been triggered.

[0138] The five playback interaction conditions provided above can be selected for implementation according to actual needs. It should be noted that at least two of these conditions can be combined to form new playback interaction conditions. For example, a playback interaction condition could be whether the playback state is in a preset state and whether the user's action data on the interaction page is a preset action. If the playback state is in a preset state and the user's action data on the interaction page is a preset action, then the playback interaction condition is triggered. Furthermore, appropriate technical means can be selected from the five playback interaction conditions to form new playback interaction conditions. For example, a playback interaction condition could be whether the user's input interaction information matches the virtual object of the multimedia data displayed in the playback window. If the user's input interaction information matches the virtual object of the multimedia data displayed in the playback window, then the playback interaction condition is triggered.

[0139] Optionally, the interactive items corresponding to the playback interaction conditions are displayed in the following manner: the interactive text corresponding to the playback interaction conditions and at least one interactive item, as well as the resource amount associated with each interactive item, are displayed on the interaction page.

[0140] In addition, the interactive page can display any one or any two of the following three types of interactive content: interactive text corresponding to the interactive conditions, at least one interactive item, and the amount of resources associated with each interactive item. For example, the interactive page can display at least one interactive item, or interactive text; or interactive text and at least one interactive item, or at least one interactive item and the amount of resources associated with each interactive item.

[0141] Wherein, at least one of the interactive text, interactive items, and resource amounts (i.e., at least one of the three interactive contents—interactive text, at least one interactive item, and resource amounts associated with each interactive item—is displayed in the playback window of the interactive page, and / or, at least one of the interactive text, interactive items, and resource amounts (i.e., at least one of the three interactive contents—interactive text, at least one interactive item, and resource amounts associated with each interactive item—is displayed in the interactive area of ​​the interactive page.)

[0142] In one optional implementation of this embodiment, the target interactive item is determined as follows: the interactive item selected by the user from at least one interactive item displayed is taken as the target interactive item.

[0143] Furthermore, to enhance the flexibility of user interaction in multimedia data playback, the target interaction item can be determined based on the user-input interaction item and / or the amount of resources. For example, the interaction item corresponding to the user-input interaction information can be determined as the target interaction item. For instance, based on the user-input voice or text information, if the voice information contains the corpus of the first interaction item, then the first interaction item is taken as the target interaction item; if the text information contains the keywords of the second interaction item, then the second interaction item is taken as the target interaction item.

[0144] For example, the resource amount corresponding to the user's input interaction information is determined, and the interaction item associated with that resource amount is taken as the target interaction item. For instance, based on the user's input voice or text information, if the voice information contains corpus of the resource amount associated with the first interaction item, then the first interaction item is taken as the target interaction item; if the text information contains keywords of the resource amount associated with the first interaction item, then the second interaction item is taken as the target interaction item.

[0145] Step S506: Based on the target interaction item, transfer resources to the resource account associated with the user and perform playback response processing.

[0146] In practical applications, after receiving the target interaction item sent by the user terminal, during the process of transferring resources to the user's associated resource account based on the target interaction item, there may be situations where the user transfers resources to a user resource account created by themselves, or there may be situations where the user transfers resources to a group resource account created jointly with other users. The following provides implementation methods for transferring resources in these two situations respectively.

[0147] In an optional implementation of this embodiment, for the scenario where a user transfers resources to a user resource account that they have created independently, the transfer of resources to the user's associated resource account based on the target interaction item includes: transferring resources out of the user's resource account based on the amount of resources associated with the target interaction item, and transferring the transferred resources to the user resource account (personal resource account or independent resource account) created by the user in the resource service.

[0148] In another optional implementation of this embodiment, for the scenario where a user transfers resources to a group resource account jointly created with other users, the transfer of resources to the resource account associated with the user based on the target interaction item includes: transferring resources out of the user's resource account based on the resource amount of the target interaction item, and transferring the transferred resources to the group resource account (shared resource account) created by the group to which the user belongs in the resource service.

[0149] In this embodiment, after the received target interaction item transfers resources to the user's associated resource account, corresponding playback response processing is required. If the playback interaction conditions include whether the playback state is in a preset playback state, and the preset playback state includes a playback completion state (i.e., when the playback interaction condition is that the playback state is in a playback completion state, i.e., the multimedia video playback is complete), in an optional implementation of this embodiment, the playback response processing includes: setting an unlocking period for the next multimedia data in the data sequence to which the multimedia data belongs; optionally, after the unlocking period expires, access to the next multimedia data is granted to the user or the group to which the user belongs.

[0150] For example, multiple short videos form a short video series. After the short video currently accessed by the user finishes playing, the next episode of the short video is determined, and the unlock date of the next episode is set. After the unlock date arrives, the next episode is unlocked and the user can access it.

[0151] In addition, during the playback response processing, another optional implementation provided in this embodiment includes at least one of the following three methods: issuing rights corresponding to the target interactive item to the user, issuing rights matching the virtual object triggered by the interactive command to the user, and issuing rights to each group member of the group to which the user belongs.

[0152] It should be noted that, in addition to the two optional implementation methods provided above, the server can also use any one of the following four optional implementation methods to perform playback response processing:

[0153] Option 1: Generate an unlock command for the multimedia data and send it to the user terminal to unlock the playback status;

[0154] Option 2: In the data segments corresponding to each data branch configured for the preset playback node of the multimedia data in response to the playback interaction conditions, determine the data segment corresponding to the target interaction item and send it to the user terminal;

[0155] Option 3: Input the previously played data before the preset playback node, the target interactive item, and the data generation field into the large language model to generate multimedia data, and send the data fragment corresponding to the target interactive item to the user terminal.

[0156] Optional Implementation Method Four: Based on the rights to be issued, generate multimedia sub-data to prompt the issuance of rights and distribute it to the user terminal so as to play the multimedia sub-data on the interactive page; the multimedia sub-data is generated through a large language model.

[0157] Furthermore, it should be noted that any of the six playback response processing methods provided above can be selected for implementation according to actual needs. It should also be noted that these six methods can be combined in combination to form new implementation methods, or appropriate technical means can be selected from the six methods to form new implementation methods. For example, the previously played data before the preset playback node, the target interactive item, and the data generation field can be input into a large language model to generate multimedia data, outputting data fragments corresponding to the target interactive item, and generating an unlocking command for the multimedia data; the output data fragments and the generated unlocking command are then sent to the user terminal to unlock the playback state based on the unlocking command, and the data fragments are played in the playback window; another example is generating multimedia sub-data for a rights distribution prompt based on pending rights, generating an unlocking command for the multimedia data, sending the multimedia sub-data and the unlocking command to the user terminal to unlock the playback state and play the multimedia sub-data on the interactive page.

[0158] The following example uses the application of a multimedia data interactive processing method provided in this embodiment in a short video interactive scenario, combined with... Figure 4 The interactive processing method for multimedia data provided in this embodiment will be further explained below. Figure 4 The interactive processing method for multimedia data applied to short video interactive scenarios includes the following steps.

[0159] Step S404: Receive the access request submitted by the user terminal.

[0160] Step S406: Determine the short video corresponding to the access request and send the determined short video to the user terminal.

[0161] Step S416: Receive the target interactive item selected by the user from the displayed interactive items sent by the user terminal.

[0162] Step S418: Based on the resource amount associated with the target interaction item, transfer resources out of the user's resource account and transfer the transferred resources into the user resource account created by the user in the resource service.

[0163] Step S420: Set the unlock period for the next short video in the short video series to which the short video belongs.

[0164] Step S422: Distribute the rights corresponding to the target interaction item to the user and generate a short video corresponding to the rights distribution.

[0165] Step S424: Send the unlocking period and rights distribution short video of the next short video to the user terminal.

[0166] It should be noted that any one or more of steps S404 to S406 and steps S416 to S424 can be combined with any one or more of steps S502 to S506 to form a new implementation method according to the needs of implementation and deployment. In addition, any one or more technical features in steps S404 to S406 and steps S416 to S424 can be selected according to the actual deployment needs and combined with any one or more technical features provided in steps S502 to S506 to form a new implementation method. Alternatively, any one or more technical features in steps S404 to S406 and steps S416 to S424 can also be replaced with any one or more technical features provided in steps S502 to S506 to form a new implementation method according to the actual deployment needs. These will not be elaborated on here.

[0167] This specification provides an embodiment of a multimedia data interactive processing device as follows:

[0168] In the above embodiments, a multimedia data interactive processing method is provided, and correspondingly, a multimedia data interactive processing device is also provided, which will be described below with reference to the accompanying drawings.

[0169] Reference Figure 6 This illustration shows a schematic diagram of an embodiment of a multimedia data interactive processing device provided in this embodiment.

[0170] Since the apparatus embodiments correspond to the method embodiments, the descriptions are relatively simple. For relevant parts, please refer to the corresponding descriptions of the method embodiments provided above. The apparatus embodiments described below are merely illustrative.

[0171] This embodiment provides a multimedia data interactive processing device, the device comprising:

[0172] The playback module 602 is configured to acquire multimedia data sent by the server and perform playback processing.

[0173] The display module 604 is configured to display the interactive item corresponding to the playback interactive condition after the playback interactive condition of the multimedia data is triggered.

[0174] The interaction item sending module 606 is configured to obtain the target interaction item submitted by the user and send it to the server, so as to transfer resources to the resource account associated with the user based on the target interaction item and perform playback response processing.

[0175] Another embodiment of the multimedia data interactive processing device provided in this specification is as follows:

[0176] In the above embodiments, another method for interactive processing of multimedia data is provided, and correspondingly, another device for interactive processing of multimedia data is also provided, which will be described below with reference to the accompanying drawings.

[0177] Reference Figure 7 This illustration shows a schematic diagram of an embodiment of a multimedia data interactive processing device provided in this embodiment.

[0178] Since the apparatus embodiments correspond to the method embodiments, the descriptions are relatively simple. For relevant parts, please refer to the corresponding descriptions of the method embodiments provided above. The apparatus embodiments described below are merely illustrative.

[0179] This embodiment provides a multimedia data interactive processing device, the device comprising:

[0180] The data transmission module 702 is configured to send multimedia data to the user terminal;

[0181] The interaction item receiving module 704 is configured to receive a target interaction item submitted by the user terminal; the target interaction item is submitted after the playback interaction condition of multimedia data is triggered and the corresponding interaction item is displayed.

[0182] The playback response module 706 is configured to transfer resources to the user's associated resource account based on the target interaction item and perform playback response processing.

[0183] This specification provides an embodiment of a multimedia data interactive processing device as follows:

[0184] Corresponding to the multimedia data interactive processing method described above, based on the same technical concept, one or more embodiments of this specification also provide a multimedia data interactive processing device, which is used to execute the multimedia data interactive processing method provided above. Figure 8 This is a schematic diagram of the structure of a multimedia data interactive processing device provided in one or more embodiments of this specification.

[0185] This embodiment provides a multimedia data interactive processing device, including:

[0186] like Figure 8As shown, multimedia data interactive processing devices can vary significantly due to differences in configuration or performance. They may include one or more processors 801 and memories 802, with the memory 802 storing one or more application programs or data. The memory 802 can be temporary or persistent storage. The application programs stored in the memory 802 may include one or more modules (not shown), each module including a series of computer-executable instructions from the multimedia data interactive processing device. Furthermore, the processor 801 may be configured to communicate with the memory 802, executing the series of computer-executable instructions in the memory 802 on the multimedia data interactive processing device. The multimedia data interactive processing device may also include one or more power supplies 803, one or more wired or wireless network interfaces 804, one or more input / output interfaces 805, one or more keyboards 806, etc.

[0187] In one specific embodiment, the multimedia data interactive processing device includes a memory and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs may include one or more modules, and each module may include a series of computer-executable instructions for the multimedia data interactive processing device, and is configured to be executed by one or more processors. The one or more programs include computer-executable instructions for performing the following:

[0188] Retrieve multimedia data sent by the server and perform playback processing;

[0189] After the playback interaction condition of the multimedia data is triggered, the interactive item corresponding to the playback interaction condition is displayed.

[0190] The system retrieves the target interaction item submitted by the user and sends it to the server to transfer resources to the resource account associated with the user based on the target interaction item and to perform playback response processing.

[0191] Another embodiment of the multimedia data interactive processing device provided in this specification is as follows:

[0192] Corresponding to the other multimedia data interactive processing method described above, based on the same technical concept, one or more embodiments of this specification also provide another multimedia data interactive processing device, which is used to execute the other multimedia data interactive processing method provided above. Figure 9 This is a schematic diagram of the structure of a multimedia data interactive processing device provided in one or more embodiments of this specification.

[0193] Another multimedia data interactive processing device provided in this embodiment includes:

[0194] like Figure 9 As shown, multimedia data interactive processing devices can vary significantly due to differences in configuration or performance. They may include one or more processors 901 and memory 902, with memory 902 storing one or more application programs or data. Memory 902 can be temporary or persistent storage. The application programs stored in memory 902 may include one or more modules (not shown), each module including a series of computer-executable instructions from the multimedia data interactive processing device. Furthermore, processor 901 may be configured to communicate with memory 902, executing the series of computer-executable instructions in memory 902 on the multimedia data interactive processing device. The multimedia data interactive processing device may also include one or more power supplies 903, one or more wired or wireless network interfaces 904, one or more input / output interfaces 905, one or more keyboards 906, etc.

[0195] In one specific embodiment, the multimedia data interactive processing device includes a memory and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs may include one or more modules, and each module may include a series of computer-executable instructions for the multimedia data interactive processing device, and is configured to be executed by one or more processors. The one or more programs include computer-executable instructions for performing the following:

[0196] Send multimedia data to the user terminal;

[0197] The system receives a target interaction item submitted by the user terminal; the target interaction item is submitted after the multimedia data playback interaction condition is triggered and the corresponding interaction item is displayed.

[0198] Based on the target interaction item, resources are transferred to the user's associated resource account and playback response is performed.

[0199] This specification provides an embodiment of a computer-readable storage medium as follows:

[0200] In accordance with the above-described interactive processing method for multimedia data, and based on the same technical concept, one or more embodiments of this specification also provide a computer-readable storage medium.

[0201] The computer-readable storage medium provided in this embodiment is used to store computer-executable instructions, which, when executed, implement the following process:

[0202] Retrieve multimedia data sent by the server and perform playback processing;

[0203] After the playback interaction condition of the multimedia data is triggered, the interactive item corresponding to the playback interaction condition is displayed.

[0204] The system retrieves the target interaction item submitted by the user and sends it to the server to transfer resources to the resource account associated with the user based on the target interaction item and to perform playback response processing.

[0205] It should be noted that the embodiments of a computer-readable storage medium described in this specification and the embodiments of a multimedia data interactive processing method described in this specification are based on the same inventive concept. Therefore, the specific implementation of this embodiment can be referred to the implementation of the corresponding method described above, and the repeated parts will not be described again.

[0206] Another embodiment of a computer-readable storage medium provided in this specification is as follows:

[0207] In response to the other interactive processing method for multimedia data described above, and based on the same technical concept, one or more embodiments of this specification also provide another computer-readable storage medium.

[0208] The computer-readable storage medium provided in this embodiment is used to store computer-executable instructions, which, when executed, implement the following process:

[0209] Send multimedia data to the user terminal;

[0210] The system receives a target interaction item submitted by the user terminal; the target interaction item is submitted after the multimedia data playback interaction condition is triggered and the corresponding interaction item is displayed.

[0211] Based on the target interaction item, resources are transferred to the user's associated resource account and playback response is performed.

[0212] It should be noted that the embodiments of another computer-readable storage medium described in this specification and the embodiments of another multimedia data interactive processing method described in this specification are based on the same inventive concept. Therefore, the specific implementation of this embodiment can be referred to the implementation of the corresponding method described above, and the repeated parts will not be described again.

[0213] The various embodiments in this specification are described in a progressive manner. The same or similar parts between the various embodiments can be referred to each other. Each embodiment focuses on describing the differences from other embodiments. For example, the device embodiment, equipment embodiment and computer-readable storage medium embodiment are all similar to the method embodiment, so the description is relatively simple. When reading the relevant content of the device embodiment, equipment embodiment and computer-readable storage medium embodiment, please refer to the description of the method embodiment.

[0214] The foregoing has described specific embodiments of this specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims may be performed in a different order than that shown in the embodiments and may still achieve the desired result. Furthermore, the processes depicted in the drawings do not necessarily require the specific or sequential order shown to achieve the desired result. In some embodiments, multitasking and parallel processing are possible or may be advantageous.

[0215] In the 1930s, improvements to a technology could be clearly distinguished as either hardware improvements (e.g., improvements to the circuit structure of diodes, transistors, switches, etc.) or software improvements (improvements to the methodology). However, with technological advancements, many improvements to the methodology today can be considered direct improvements to the hardware circuit structure. Designers almost always obtain the corresponding hardware circuit structure by programming the improved methodology into the hardware circuit. Therefore, it cannot be said that an improvement to the methodology cannot be implemented using hardware physical modules. For example, a Programmable Logic Device (PLD) (such as a Field Programmable Gate Array (FPGA)) is such an integrated circuit whose logic function is determined by the user programming the device. Designers can program and "integrate" a digital system onto a PLD themselves, without needing chip manufacturers to design and manufacture dedicated integrated circuit chips. Furthermore, nowadays, instead of manually manufacturing integrated circuit chips, this programming is mostly implemented using "logic compiler" software. Similar to the software compiler used in program development, the original code before compilation must also be written in a specific programming language, called a Hardware Description Language (HDL). There are many HDLs, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, and RHDL (Ruby Hardware Description Language). Currently, the most commonly used are VHDL (Very-High-Speed ​​Integrated Circuit Hardware Description Language) and Verilog. Those skilled in the art should also understand that by simply performing some logic programming on the method flow using one of these hardware description languages ​​and programming it into an integrated circuit, the hardware circuit implementing the logical method flow can be easily obtained.

[0216] The controller can be implemented in any suitable manner. For example, it can take the form of a microprocessor or processor and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro)processor, logic gates, switches, application-specific integrated circuits (ASICs), programmable logic controllers, and embedded microcontrollers. Examples of controllers include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicon Labs C8051F320. A memory controller can also be implemented as part of the control logic of the memory. Those skilled in the art will also recognize that, in addition to implementing the controller in purely computer-readable program code form, the same functionality can be achieved by logically programming the method steps to make the controller take the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers, and embedded microcontrollers. Therefore, such a controller can be considered a hardware component, and the means included therein for implementing various functions can also be considered as structures within the hardware component. Alternatively, the means for implementing various functions can be considered as both software modules implementing the method and structures within the hardware component.

[0217] The systems, devices, modules, or units described in the above embodiments can be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, a computer can be, for example, a personal computer, laptop computer, cellular phone, camera phone, smartphone, personal digital assistant, media player, navigation device, email device, game console, tablet computer, wearable device, or any combination of these devices.

[0218] For ease of description, the above apparatus is described by dividing it into various functional units. Of course, when implementing the embodiments of this specification, the functions of each unit can be implemented in one or more software and / or hardware.

[0219] Those skilled in the art will understand that one or more embodiments of this specification can be provided as a method, system, or computer program product. Therefore, one or more embodiments of this specification may take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this specification may take the form of a computer program product embodied on one or more computer-readable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0220] This specification is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this specification. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0221] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0222] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0223] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0224] Memory may include non-persistent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0225] Computer-readable media include both permanent and non-permanent, removable and non-removable media that can store information using any method or technology. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer-readable storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0226] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising at least one…" does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0227] One or more embodiments of this specification can be described in the general context of computer-executable instructions, such as program modules, that are executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform a particular task or implement a particular abstract data type. One or more embodiments of this specification can also be practiced in distributed computing environments where tasks are performed by remote processing devices connected via a communication network. In distributed computing environments, program modules can reside in local and remote computer storage media, including storage devices.

[0228] The above description is merely an embodiment of this document and is not intended to limit the scope of this document. Various modifications and variations can be made to this document by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this document should be included within the scope of the claims of this document.

Claims

1. A method for interactive processing of multimedia data, comprising: Retrieve video data sent by the server and perform playback processing; After the playback interaction condition of the multimedia data is triggered, the interactive item corresponding to the playback interaction condition is displayed. The system retrieves the target interactive item selected by the user among the displayed interactive items and sends it to the server. Based on the resource amount associated with the target interactive item, the system transfers resources out of the user's resource account and transfers the transferred resources to the user resource account created by the user in the resource service. The system then cooperates with the server to perform playback interaction processing corresponding to the target interactive item or the playback interaction conditions.

2. The interactive processing method for multimedia data according to claim 1, wherein the playback interaction conditions further include at least one of the following: Whether the playback status is in the preset playback status, whether the user's input interaction information matches the preset interaction instructions, and whether interaction instructions for the virtual object of the video data displayed in the playback window are detected; in, The preset playback states include playback start state, playback pause state, and / or playback complete state.

3. The interactive processing method for multimedia data according to claim 1, wherein displaying the interactive item corresponding to the playback interactive condition includes: The interactive page displays the interactive text corresponding to the playback interactive conditions and at least one interactive item, as well as the amount of resources associated with each interactive item; Among them, at least one of the interactive text, interactive items, and resource amount is displayed in the playback window of the interactive page.

4. The multimedia data interactive processing method according to claim 1, wherein after the playback interaction condition is triggered, and before the operation of displaying the interactive item corresponding to the playback interaction condition is executed, it further includes: Pause the playback of the video data, and / or lock the playback status of the video data; Accordingly, the playback interaction processing corresponding to the target interaction item or the playback interaction condition in cooperation with the server includes: The system receives a data segment and a generated unlock command from the server, unlocks the playback state based on the unlock command, and plays the data segment in the playback window.

5. The multimedia data interactive processing method according to claim 1, wherein the step of cooperating with the server to perform playback interactive processing corresponding to the target interactive item includes: Receive the data segment corresponding to the target interactive item sent by the server, and play the data segment in the playback window; The data segment is determined from the data segments corresponding to each data branch configured in the video data for the preset playback node of the playback interaction conditions, or the data segment is obtained by inputting the already played data before the preset playback node, the target interaction item, and the data generation field into a large language model to generate video data.

6. The multimedia data interactive processing method according to claim 1, wherein the step of cooperating with the server to perform playback interactive processing corresponding to the target interactive item or the playback interactive condition includes: The system receives multimedia sub-data from the server, which is generated based on the rights to be issued and prompts the issuance of rights, and plays the multimedia sub-data in the playback window.

7. The multimedia data interactive processing method according to claim 2, wherein if the playback interaction condition is whether the playback state is in the playback completed state, the method further includes: Set an unlock period for the next video data in the data sequence to which the video data belongs, so that access to the next video data can be granted to the user or the group to which the user belongs after the unlock period expires.

8. The interactive processing method for multimedia data according to claim 1 further includes: The rights corresponding to the target interaction item are issued to the user, and the rights matching the virtual object triggered by the interaction command are issued to the user.

9. The multimedia data interactive processing method according to claim 1, wherein acquiring video data sent by the server and performing playback processing includes: Based on the user's access instruction to access the resource service, an access request for the resource service is submitted to the server; Receive the video data sent by the server and display the video data playback window on the interactive page.

10. The multimedia data interactive processing method according to claim 1, wherein acquiring video data sent by the server and performing playback processing includes: Obtain the user's selection instruction for virtual objects or data branches in the video data and submit it to the server; Receive data fragments corresponding to the virtual object or data branch sent by the server, and play the data fragments on the interactive page.

11. The interactive processing method for multimedia data according to claim 1, wherein the video data is uploaded by the user or a member of the group to which the user belongs; Alternatively, the video data can be obtained by editing the video data according to the user's editing instructions for the data to be edited.

12. A method for interactive processing of multimedia data, comprising: Retrieve video data sent by the server and perform playback processing; After the playback interaction condition of the multimedia data is triggered, the interactive item corresponding to the playback interaction condition is displayed. Based on the user's input interaction information, the interaction item corresponding to the interaction information is determined as the target interaction item and sent to the server. Based on the resource amount associated with the target interaction item, resources are transferred out from the user's resource account and transferred to the user resource account created by the user in the resource service. The server then cooperates to perform playback interaction processing corresponding to the target interaction item or the playback interaction condition.

13. The multimedia data interactive processing method according to claim 12, wherein the step of cooperating with the server to perform playback interactive processing corresponding to the target interactive item or the playback interactive condition includes: Receive the data segment and the generated unlock command sent by the server, unlock the playback state based on the unlock command, and play the data segment in the playback window; or, The system receives multimedia sub-data from the server, which is generated based on the rights to be issued and prompts the issuance of rights, and plays the multimedia sub-data in the playback window.

14. The multimedia data interactive processing method according to claim 12, wherein the step of cooperating with the server to perform playback interactive processing corresponding to the target interactive item or the playback interactive condition includes: Receive the data segment corresponding to the target interactive item sent by the server, and play the data segment in the playback window; The data segment is determined from the data segments corresponding to each data branch configured in the video data for the preset playback node of the playback interaction conditions, or the data segment is obtained by inputting the already played data before the preset playback node, the target interaction item, and the data generation field into a large language model to generate video data.

15. A method for interactive processing of multimedia data, comprising: Send video data to the user terminal; Receive the target interactive item selected by the user in the interactive items corresponding to the displayed playback interactive conditions sent by the user terminal; The interactive items are displayed after the playback interaction conditions are triggered. Based on the resource amount associated with the target interaction item, resources are transferred out from the user's resource account, and the transferred resources are transferred to the user's resource account created in the resource service. The user terminal then cooperates with the user terminal to perform playback response processing corresponding to the target interaction item or the playback interaction condition.

16. The multimedia data interactive processing method according to claim 15, wherein the step of cooperating with the user terminal to perform playback response processing corresponding to the target interactive item or the playback interactive condition includes: In the data segments corresponding to each data branch configured for the preset playback node of the multimedia data in response to the playback interaction conditions, the data segment corresponding to the target interaction item is determined and sent to the user terminal; or, The previously played data before the preset playback node, the target interactive item, and the data generation field are input into the large language model to generate multimedia data, and the data fragments corresponding to the target interactive item are sent to the user terminal.

17. The multimedia data interactive processing method according to claim 15, wherein the step of cooperating with the user terminal to perform playback response processing corresponding to the target interactive item or the playback interactive condition includes: The rights and benefits corresponding to the target interaction item are issued to the user; rights and benefits matching the virtual object triggered by the interaction command are issued to the user; and / or rights and benefits are issued to each group member of the group to which the user belongs. or, Multimedia sub-data is generated based on the rights to be issued, prompting the issuance of rights, and then sent to the user terminal to play the multimedia sub-data on the interactive page; the multimedia sub-data is generated through a large language model.

18. The multimedia data interactive processing method according to claim 15, wherein the step of cooperating with the user terminal to perform playback response processing corresponding to the target interactive item or the playback interactive condition includes: The previously played data before the preset playback node, the target interactive item, and the data generation field are input into the large language model to generate multimedia data. The data fragments corresponding to the target interactive item and the unlocking instructions for generating the multimedia data are output. The output data segment and the generated unlock command are sent to the user terminal to unlock the playback status based on the unlock command and play the data segment in the playback window.

19. A method for interactive processing of multimedia data, comprising: Send video data to the user terminal; Receive the target interaction item sent by the user terminal; The target interactive item is determined based on the interactive information input by the user; the interactive item is displayed after the playback interactive condition is triggered. Based on the resource amount associated with the target interaction item, resources are transferred out from the user's resource account, and the transferred resources are transferred to the user's resource account created in the resource service. The user terminal then cooperates with the user terminal to perform playback response processing corresponding to the target interaction item or the playback interaction condition.

20. A multimedia data interactive processing device, comprising: The playback module is configured to acquire video data sent by the server and perform playback processing. The display module is configured to display the interactive item corresponding to the playback interactive condition after the playback interactive condition of the multimedia data is triggered. The interaction item sending module is configured to obtain the target interaction item selected by the user in the displayed interaction items and send it to the server, so as to transfer resources from the user's resource account based on the resource amount associated with the target interaction item, transfer the transferred resources to the user resource account created by the user in the resource service, and cooperate with the server to perform playback interaction processing corresponding to the target interaction item or the playback interaction condition.

21. A multimedia data interactive processing device, comprising: The data transmission module is configured to send video data to the user terminal; An interactive item receiving module is configured to receive a target interactive item selected by the user from the interactive items corresponding to the displayed playback interactive conditions, sent by the user terminal; the interactive item is displayed after the playback interactive conditions are triggered. The playback response module is configured to transfer resources from the user's resource account based on the resource amount associated with the target interaction item, transfer the transferred resources to the user's user resource account created in the resource service, and cooperate with the user terminal to perform playback response processing corresponding to the target interaction item or the playback interaction condition.

22. A multimedia data interactive processing device, comprising: processor; And, a memory configured to store computer-executable instructions, which, when executed, cause the processor to: Retrieve video data sent by the server and perform playback processing; After the playback interaction condition of the multimedia data is triggered, the interactive item corresponding to the playback interaction condition is displayed. The system retrieves the target interactive item selected by the user among the displayed interactive items and sends it to the server. Based on the resource amount associated with the target interactive item, the system transfers resources out of the user's resource account and transfers the transferred resources to the user resource account created by the user in the resource service. The system then cooperates with the server to perform playback interaction processing corresponding to the target interactive item or the playback interaction conditions.

23. A multimedia data interactive processing device, comprising: processor; And, a memory configured to store computer-executable instructions, which, when executed, cause the processor to: Send video data to the user terminal; The system receives a target interactive item selected by the user from the interactive items corresponding to the displayed playback interactive conditions, sent by the user terminal; the interactive item is displayed after the playback interactive conditions are triggered. Based on the resource amount associated with the target interaction item, resources are transferred out from the user's resource account, and the transferred resources are transferred to the user's resource account created in the resource service. The user terminal then cooperates with the user terminal to perform playback response processing corresponding to the target interaction item or the playback interaction condition.

24. A computer-readable storage medium for storing computer-executable instructions that, when executed, implement the steps of the method of claim 1 or 15.

Images