An interactive content display method and system, an electronic device, and a storage medium

Abstract

The application discloses an interactive content display method and system, an electronic device and a storage medium. The method comprises the following steps: loading current interaction materials according to emotional interaction data, the emotional interaction data being data units generated in advance according to interaction configuration information and used for controlling interaction execution; querying an object space-time index based on the time of a current target frame to obtain a position area of a target object; generating an interaction safety field based on the position area of the target object and each avoidance area, and calculating the score of the interaction safety field; when the score of the interaction safety field meets a corresponding threshold value, displaying an interaction entrance based on the current interaction materials and generating an exposure token; in response to a triggering operation of a user on the displayed interaction entrance, sending an execution token request to a server based on the exposure token; when the execution token is received, querying and analyzing the object space-time index according to the execution time to obtain an object anchor point; and playing emotional special effects according to the object anchor point, the interaction safety field and the current interaction materials.

Description

Technical Field

[0001] This application relates to the field of multimedia data processing technology, and in particular to an interactive content display method and system, electronic device, and storage medium. Background Technology

[0002] In the field of video playback and advertising display technology, content monetization is typically achieved through various forms such as pre-roll ads, corner ads, overlay ads, pause ads, widget ads, and interactive buttons. Existing video advertising systems can display ads on the playback interface based on content, user, or advertiser strategies; simultaneously, existing players can obtain the position of objects in the video frame through facial recognition, human detection, or keypoint detection, and overlay animation effects on top of the video layer.

[0003] In scenarios where advertising effects need to be spatially bound and temporally synchronized with objects in the video frame, existing technical solutions typically only locate the object area based on a preset timestamp or simply overlay the recognition results with the advertising material. In on-demand scenarios, these methods are prone to issues such as effects being applied to the wrong position or still triggering when the character leaves the screen, due to user dragging, speed changes, buffer rollbacks, and resolution switching. In live streaming scenarios, due to the different delays between the recognition results, advertising configurations, and the live stream, effects may lag or drift. Furthermore, with subtitles, control bars, face areas, brand entrances, and other overlays coexisting in the player, without a unified layer arbitration and avoidance mechanism, advertising effects can easily obscure the main text content.

[0004] Although existing technologies can perform ad delivery, object recognition, and animation overlay separately, there are still problems in spatiotemporal alignment and rendering scheduling between ad effects and video objects, such as time misalignment, inaccurate spatial attachment, effects obscuring the main text, feedback drift due to live streaming delays, repeated triggering, and inconsistent states. Therefore, it is impossible to guarantee accurate display of effects. Summary of the Invention

[0005] In view of the shortcomings of the prior art, this application provides an interactive content display method and system, electronic device and storage medium to solve the technical problem that the prior art cannot guarantee accurate display of special effects in various scenarios.

[0006] To achieve the above objectives, this application provides the following technical solution:

[0007] The first aspect of this application provides a method for displaying interactive content, including:

[0008] The current interactive material is loaded based on the emotional interaction data; wherein, the emotional interaction data is a data unit generated in advance based on the interaction configuration information and used to control the execution of the interaction;

[0009] Based on the time of the current target frame, query the spatiotemporal index of the object to obtain the location region of the target object;

[0010] An interactive safety field is generated based on the location area of ​​the target object and each avoidance area, and a score for the interactive safety field is calculated.

[0011] At least when the score of the interactive security field meets the corresponding threshold, the interactive entry point is displayed and an exposure token is generated based on the current interactive material;

[0012] In response to the user's triggering operation on the display interaction entry, an execution token request is sent to the server based on the exposure token;

[0013] Upon receiving the execution token, the object's spatiotemporal index is queried based on the execution time, and the query results are parsed to obtain the object's anchor point.

[0014] Emotional effects are played based on the object anchor point, the interactive safety field, and the current interactive material.

[0015] Optionally, in the above-described interactive content display method, before loading the current interactive material based on the emotion interaction data, the method further includes:

[0016] Obtain candidate input data for the target video;

[0017] Based on the analysis of candidate input data, the time periods in the target video that meet the set interaction conditions are used as candidate emotional interaction time windows.

[0018] Optionally, in the above-described interactive content display method, before loading the current interactive material based on the emotion interaction data, the method further includes:

[0019] Generate or receive the trajectory of the target object in each frame of the target video;

[0020] Based on the trajectory of the target object in each frame of the target video, generate a spatiotemporal index of the object;

[0021] Emotional interaction data is generated based on the interaction configuration information.

[0022] Optionally, in the above-described interactive content display method, loading the current interactive material based on emotion interaction data includes:

[0023] When the decoding frame time of the currently playing target video falls within the candidate emotion interaction time window, the emotion interaction data is loaded;

[0024] Based on the emotional interaction data, preload the entry animation, action panel, and emotional special effects materials.

[0025] Optionally, in the above-described interactive content display method, after obtaining the location region of the target object by querying the spatiotemporal index of the object based on the time of the current target frame, the method further includes:

[0026] Based on the location region of the target object, calculate the visibility of the target object therein;

[0027] Wherein, the step of displaying the interactive entry point and generating an exposure token based on the current interactive material when at least the score of the interactive safety field meets the corresponding threshold includes:

[0028] When both the score of the interactive safety field and the visibility of the target object meet the corresponding thresholds, the interactive entry point is displayed and an exposure token is generated based on the current interactive material.

[0029] Optionally, the above-mentioned interactive content display method also includes:

[0030] If the score of the interactive security field or the visibility of the target object does not meet the corresponding threshold, the process enters the downgrade entry point, performs the downgrade operation, and reports the downgrade reason.

[0031] Optionally, in the above-described interactive content display method, the step of playing emotional effects based on the object anchor point, the interactive safety field, and the current interactive material includes:

[0032] The emotional effect parameters are determined based at least on the object anchor point, the interaction safety field, and the emotional action type in the current interaction material;

[0033] Play emotional effects based on emotional effect parameters and continuously monitor changes in the target area;

[0034] If the changes in the object area are detected to meet the set change conditions, update the effect path in the emotion effect parameters or perform a downgraded feedback.

[0035] When the duration of the emotional effect reaches the valid duration, a completion event is reported or a completion token is requested.

[0036] A second aspect of this application provides an interactive content display system, including:

[0037] Client and server;

[0038] The server is used to send an execution token back to the client when it receives an execution token request from the client;

[0039] The client is used for:

[0040] The current interactive material is loaded based on the emotional interaction data; wherein, the emotional interaction data is a data unit generated in advance based on the interaction configuration information and used to control the execution of the interaction;

[0041] Based on the time of the current target frame, query the spatiotemporal index of the object to obtain the location region of the target object;

[0042] An interactive safety field is generated based on the location area of ​​the target object and each avoidance area, and a score for the interactive safety field is calculated.

[0043] At least when the score of the interactive security field meets the corresponding threshold, the interactive entry point is displayed and an exposure token is generated based on the current interactive material;

[0044] In response to the user's triggering operation on the display interaction entry, an execution token request is sent to the server based on the exposure token;

[0045] Upon receiving the execution token, the object's spatiotemporal index is queried based on the execution time, and the query results are parsed to obtain the object's anchor point.

[0046] Emotional effects are played based on the object anchor point, the interactive safety field, and the current interactive material.

[0047] Optionally, in the above-described interactive content display system, the server is further configured to:

[0048] Obtain candidate input data for the target video;

[0049] Based on the analysis of candidate input data, the time periods in the target video that meet the set interaction conditions are used as candidate emotional interaction time windows.

[0050] Optionally, in the above-described interactive content display system, the server is further configured to:

[0051] Generate or receive the trajectory of the target object in each frame of the target video;

[0052] Based on the trajectory of the target object in each frame of the target video, generate a spatiotemporal index of the object;

[0053] Emotional interaction data is generated based on the interaction configuration information.

[0054] Optionally, in the above-mentioned interactive content display system, when the client loads the current interactive material based on the emotion interaction data, it is used to:

[0055] When the decoding frame time of the currently playing target video falls within the candidate emotion interaction time window, the emotion interaction data is loaded;

[0056] Based on the emotional interaction data, preload the entry animation, action panel, and emotional special effects materials.

[0057] Optionally, in the above-described interactive content display system, the client is further configured to:

[0058] Based on the location region of the target object, calculate the visibility of the target object therein;

[0059] Wherein, when the client displays the interactive entry and generates an exposure token based on the current interactive material, at least when the scoring in the interactive security field meets the corresponding threshold, it is used for:

[0060] When both the score of the interactive safety field and the visibility of the target object meet the corresponding thresholds, the interactive entry point is displayed and an exposure token is generated based on the current interactive material.

[0061] Optionally, in the above-described interactive content display system, the client is further configured to:

[0062] If the score of the interactive security field or the visibility of the target object does not meet the corresponding threshold, the process enters the downgrade entry point, performs the downgrade operation, and reports the downgrade reason.

[0063] Optionally, in the above-mentioned interactive content display system, when the client plays emotional effects based on the object anchor point, the interactive safety field, and the current interactive material, it is used to:

[0064] The emotional effect parameters are determined based at least on the object anchor point, the interaction safety field, and the emotional action type in the current interaction material;

[0065] Play emotional effects based on emotional effect parameters and continuously monitor changes in the target area;

[0066] If the changes in the object area are detected to meet the set change conditions, update the effect path in the emotion effect parameters or perform a downgraded feedback.

[0067] When the duration of the emotional effect reaches the valid duration, a completion event is reported or a completion token is requested.

[0068] A third aspect of this application provides an electronic device, comprising:

[0069] Memory and processor;

[0070] The memory is used to store programs;

[0071] The processor is used to execute the program, which, when executed, is specifically used to implement the interactive content display method as described in any of the above.

[0072] A fourth aspect of this application provides a computer storage medium for storing a computer program, which, when executed by a processor, is used to implement the interactive content display method as described in any of the preceding claims.

[0073] This application provides an interactive content display method that pre-generates data units for controlling interaction execution based on interaction configuration information. Specifically, it generates executable interactive data packages for the player based on the interaction configuration information, transforming content interaction configuration from ordinary display rules into executable units containing control and constraint information. Therefore, when content display is needed, the current interactive material is loaded based on emotional interaction data. Then, the object's spatiotemporal index is queried based on the time of the current target frame to obtain the target object's location area. This object spatiotemporal index query mechanism based on video frame time ensures accurate acquisition of the target object area in scenarios such as user dragging, speed adjustment, stuttering, resolution switching, and live streaming delays, avoiding spatiotemporal misalignment between advertising emotional effects and on-screen objects. Next, an interactive safety field is generated based on the target object's location area and various avoidance areas, and a score for the interactive safety field is calculated. Only when the interactive safety field score meets the corresponding threshold is the interactive entry point displayed based on the current interactive material, and an exposure token is generated, thereby minimizing the obstruction of key images by effects. In response to the user's trigger operation to display the interactive entry point, an execution token request is sent to the server based on the exposure token. This token-based interaction mechanism avoids duplicate triggers and billing, ensuring consistency in attribution state and accuracy in display. Upon receiving an execution token, the object's spatiotemporal index is queried based on the execution time, and the query results are parsed to obtain the object's anchor point. This allows for a second query, effectively guaranteeing the accuracy of the object's location. Finally, emotional effects are played based on the object anchor point, the interaction safety field, and the current interactive material. Therefore, this solution effectively avoids issues such as misalignment of emotional effects with on-screen objects, obscuring of the main text, duplicate triggers, and inconsistent attribution states in scenarios involving on-demand dragging, speed changes, stuttering, and live streaming delays, thus ensuring accurate display of effects. Attached Figure Description

[0074] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of this application. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0075] Figure 1 A flowchart illustrating an interactive content display method provided in this application embodiment;

[0076] Figure 2 A flowchart illustrating a method for generating candidate emotion interaction time windows provided in an embodiment of this application;

[0077] Figure 3 A flowchart illustrating a method for loading current interactive materials based on emotional interaction data, provided in an embodiment of this application;

[0078] Figure 4 A flowchart illustrating a method for generating emotional interaction data and object spatiotemporal indexes provided in an embodiment of this application;

[0079] Figure 5 A flowchart illustrating a method for playing emotional special effects provided in this application embodiment;

[0080] Figure 6 A schematic diagram of the architecture of an interactive content display system provided in this application embodiment;

[0081] Figure 7 This is a schematic diagram of the architecture of an electronic device provided in an embodiment of this application. Detailed Implementation

[0082] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0083] In this application, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes the element.

[0084] This application provides an interactive content display method to address the technical problem that existing technologies cannot guarantee accurate display of special effects in various scenarios. Optionally, the interactive content display method provided in this application can be applied to an interactive content display system composed of a client and a server. The server not only performs verification and returns an execution token, but also performs pre-video playback work, i.e., pre-processing offline data, which may include, but is not limited to, generating candidate emotion interaction time windows, object spatiotemporal indexes, and emotion interaction data. Of course, these tasks can also be pre-executed through other systems to facilitate content display on the client. In this application embodiment, the client mainly performs the following... Figure 1 The process is shown below.

[0085] like Figure 1 As shown in the embodiment of this application, an interactive content display method includes the following steps:

[0086] S101. Load the current interactive material based on the emotion interaction data.

[0087] The emotion interaction data is a data unit pre-generated based on the interaction configuration information, used to control the execution of the interaction. In other words, the emotion interaction data is not simply the interaction configuration, but rather a control data packet for the player to execute interactive content (such as interactive advertisements).

[0088] To facilitate the rapid display of the required emotional effects later, the current interactive materials are preloaded based on the emotional interaction data. Optionally, the current interactive materials may include, but are not limited to, entry animations, action panels, and emotional effect materials.

[0089] Optionally, in another embodiment of this application, considering that emotional effects are usually only required within specific video segments, the time window corresponding to the video segment in the target video that requires emotional effects can be determined in advance, so that subsequent steps are performed only within that time window. Therefore, optionally, in this embodiment of the application, before performing step S101, the generation of candidate emotional interaction time windows can also be performed in advance. Optionally, the candidate emotional interaction time windows can be generated by the server.

[0090] like Figure 2 As shown in the figure, this application embodiment provides a method for generating candidate emotion interaction time windows, including:

[0091] S201. Obtain candidate input data for the target video.

[0092] The target video can be any video that needs to be processed. Candidate input data includes at least one of the following: content segment information, live event information, and operational configuration information. Optionally, content segment information includes, but is not limited to, one or more pieces of information related to the content segment, such as content identifier, playback time period, and scene tags. Live event information includes, but is not limited to, one or more pieces of information related to the live event, such as live room identifier, event type, event occurrence time, and broadcaster status. Operational configuration information includes, but is not limited to, one or more pieces of information configured according to operational needs, such as advertiser identifier, delivery time, action type, frequency control rules, and material configuration.

[0093] S202. Based on the analysis of candidate input data, the time period in the target video where the corresponding video segment meets the set interaction conditions is used as the candidate emotion interaction time window.

[0094] Based on candidate input data, combined with the target object's appearance status, ad creative configuration, and frequency control rules, candidate emotional interaction time windows are determined. Specifically, for each defined time period, the video clips of the target video within that time period are analyzed based on the candidate input data to determine whether they meet the set interaction conditions. If they do, that time period is designated as a candidate emotional interaction time window. For example, this analysis might include whether the video clips within the time period contain the target object, whether entry animations and emotional effects are configured, whether there are executable actions, and whether the user's frequency control conditions are met. If all conditions are met, that time period is designated as a candidate emotional interaction time window.

[0095] Accordingly, in another embodiment of this application, a specific implementation of step S101 is as follows: Figure 3 As shown, it includes:

[0096] S301. When the decoding frame time of the currently playing target video falls within the candidate emotion interaction time window, load the emotion interaction data.

[0097] Specifically, when the decoding frame time of the currently playing video falls within the candidate emotion interaction time window, the client player determines that the client has entered the candidate emotion interaction time window and loads the emotion interaction data.

[0098] S302. Preload entry animations, action panels, and emotional effects materials based on emotional interaction data.

[0099] Specifically, based on the relevant information in the emotional interaction data, the entry animation, action panel, and emotional effect materials are preloaded.

[0100] S102. Based on the time of the current target frame, query the spatiotemporal index of the object to obtain the location region of the target object.

[0101] The target object is any object specified in the target video being played. The current target frame is the target frame currently being played. The target frame can be any frame of the video, or frames selected according to a set frequency, or the current video frame can be used as the target frame when a user triggers an event such as dragging, speed change, stuttering recovery, or resolution switching.

[0102] The object spatiotemporal index is not a simple record of face or body bounding boxes, but a multidimensional index of the spatial location detection information of objects built according to the video frame timeline. Therefore, based on the time of the current target frame, the location region of the target object in the current target frame is retrieved from the object spatiotemporal index.

[0103] Therefore, before executing step S101, it is necessary to pre-generate not only the emotion interaction data but also the object spatiotemporal index. Optionally, the emotion interaction data and object spatiotemporal index can be generated by the server.

[0104] Optionally, such as Figure 4 As shown in the embodiment of this application, a method for generating emotional interaction data and object spatiotemporal indexes includes:

[0105] S401, Generate or receive the trajectory of the target object in each frame of the target video.

[0106] Optionally, if the target video is on-demand content, offline recognition and cross-frame tracking can be performed on each frame of the image to generate the trajectory of the target object, including but not limited to bounding boxes, key points, segmentation masks, confidence scores, and occlusion states. If the target video is live content, the object region stream output in real time from the live streaming client, edge recognition service, or cloud recognition service can be received to obtain the trajectory of the target object in each frame of the target video.

[0107] S402. Generate a spatiotemporal index of the object based on the trajectory of the target object in each frame of the target video.

[0108] Specifically, the video frame time, decoding frame time, or live capture time can be used as the index key to associate the target object's trajectory information such as the bounding box, key points, mask, confidence level, and occlusion status in the corresponding frame, forming a spatiotemporal index of the object.

[0109] S403. Generate emotional interaction data based on the interaction configuration information.

[0110] Specifically, emotional interaction data can be generated based on one or more of the interaction configuration information, such as advertising creatives, action types, entry styles, anchor rules, safety field templates, and attribution rules. Optionally, emotional interaction data may include multiple elements from entry animations, introductory text, action panels, emotional effect creatives, object spatiotemporal index references, anchor rules, safety field templates, exposure token rules, execution token rules, completion token rules, and exception code rules.

[0111] S103. Generate an interactive safety field based on the location area of ​​the target object and each avoidance area, and calculate the score of the interactive safety field.

[0112] The avoidance area refers to areas other than the target object's location that also need to be avoided from being obscured. These areas may include, but are not limited to, subtitle areas, control bar areas, face protection zones, advertising entry areas, and other overlay areas. Therefore, based on the target object's location area and each avoidance area, a data field is generated that can display emotional effects while minimizing obstruction of the target object's location area and each avoidance area. This data field serves as the interaction safety field; that is, the interaction safety field is a data field for safe interaction that minimizes obstruction of the target object's location area and each avoidance area.

[0113] To determine whether special effects interactions are permissible within a safe interactive field, or whether adaptive interactions are possible based on the field's conditions to ensure accurate effect display, an evaluation of the safe interactive field is necessary to obtain a score. This score can be calculated based on factors such as path overlap ratio and device performance.

[0114] S104. At least when the score of the interactive safety field meets the corresponding threshold, display the interactive entry point and generate an exposure token based on the current interactive material.

[0115] When the score in the interactive safety field meets the corresponding threshold, it indicates that special effects can be displayed. Therefore, at this point, the interactive entry point is displayed based on the entry animation and other elements in the current interactive materials to provide users with opportunities to interact. Simultaneously, an exposure token is generated to promptly respond to user interactions.

[0116] Optionally, considering that when the visibility of the target object is low, it is equivalent to the target object not existing in the current target frame, in another embodiment of this application, after executing step S102, the following can be further executed:

[0117] Calculate the visibility of the target object within its location region.

[0118] Optionally, it can be obtained by weighting at least two of the following: the object detection confidence of the target object in the target object's location region, the area ratio of the object region, the completeness of key points, the visible ratio of the mask, the occlusion ratio, and the off-screen ratio.

[0119] Accordingly, in the embodiments of this application, the specific implementation of step S104 includes:

[0120] When both the score of the interactive safety field and the visibility of the target object meet the corresponding thresholds, the interactive entry point is displayed based on the current interactive material and an exposure token is generated.

[0121] Alternatively, in another embodiment of this application, considering that the current conditions cannot meet the corresponding threshold, the following can be further performed:

[0122] If the score of the interactive security field or the visibility of the target object does not meet the corresponding threshold, the process will enter the downgrade entry point, perform the downgrade operation, and report the reason for the downgrade.

[0123] The degradation operation includes at least one of the following: delaying display, hiding the entry, displaying a static entry, or playing general feedback from the edge of the screen.

[0124] S105. Respond to the user's triggered operation on the display interaction entry point and send an execution token request to the server based on the exposure token.

[0125] Specifically, in response to a user's trigger action on the interactive entry point, an execution token request is sent to the server. This execution token request includes an exposure token, an emotion interaction data identifier, a user identifier, the action type, and the current playback time. The server then performs validation based on the information in the execution token request. For example, validation may be performed based on the exposure token, ad validity, frequency control rules, idempotent state, and the validity of the emotion interaction data. If the validation passes, an execution token is returned to the client. If the validation fails, a failure code is returned, and the client does not execute subsequent steps; that is, the object attachment effect is not performed, and the client can access a downgraded or hidden entry point.

[0126] Optionally, if other interaction methods exist, the user will also send an execution token request to the server based on the exposure token when triggering an operation through other interaction methods. For example, clicking, touching, remote control confirmation, or gesture operations on guide bubbles or emotion action controls.

[0127] S106. Upon receiving the execution token, query the object's spatiotemporal index based on the execution time, parse the query results, and obtain the object's anchor point.

[0128] The execution time is the timestamp of the special effect that needs to be displayed. The object anchor point is the spatial reference point that binds the emotional effect to the target object, which can specifically include at least one of the following: the top of the head key point, the left and right shoulder key points, the body center point, and the outer edge point of the object frame.

[0129] To avoid using expired coordinates, upon receiving the execution token from the server, the object's spatiotemporal index is queried again based on the specific execution time to re-determine the target object's location region. Then, the re-determined target object's location region is parsed to obtain the target object's anchor point, i.e., the object anchor point.

[0130] S107. Play emotional effects based on object anchor points, interactive safety fields, and current interactive materials.

[0131] Based on the object anchor point, the interaction safety field, and the current interactive material, information such as the location and method of playing emotional effects can be determined, and the emotional effects can be played according to the determined information.

[0132] Optionally, in another embodiment of this application, one specific implementation of step S107 is as follows: Figure 5 As shown, it includes:

[0133] S501. Determine the emotional effect parameters based at least on the object anchor point, the interaction safety field, and the emotional action type in the current interactive material.

[0134] Specifically, the layer arbitrator can determine parameters such as the display level, motion path, scaling ratio, transparency, avoidance method, and degradation strategy of emotional effects based on the object anchor point, interaction safety field, and emotional action type in the current interactive material, combined with the size of the special effects material, the UI level status of the player, and the device performance status, and output these parameters to the client's rendering engine.

[0135] S502. Play emotional effects according to the emotional effect parameters and continuously monitor changes in the target area.

[0136] The client-side rendering engine continuously plays mood effects based on the parameters output by the layer arbitrator. Furthermore, it continuously monitors changes in the object area during playback, adapting accordingly or stopping the display in a timely manner.

[0137] S503. Determine whether the changes in the monitored object area meet the set change conditions.

[0138] If the detected change in the object area meets the set change conditions, step 504 is executed. If the detected change in the object area does not meet the set change conditions, it means that playback can continue, so step S505 is executed.

[0139] S504, Update the effect path in the emotion effect parameters.

[0140] In updating the effect path in the emotion effect parameters, the process returns to step S502 to allow playback based on the new path. It should be noted that if the change is too significant, a degradation feedback can be implemented. That is, if step S503 detects that the change in the object area meets the set change conditions, degradation feedback can also be executed.

[0141] S505, when determining whether the playback duration of the emotional special effects has reached the valid duration.

[0142] If the duration of the emotional effect playback reaches the valid duration, then step S506 is executed. If the duration of the emotional effect playback does not reach the valid duration, then step S502 is executed continuously.

[0143] S506, Report a completion event or request a completion token.

[0144] When the duration of the emotional effect reaches the valid duration, it means that the current emotional effect has been played. Therefore, at this time, a completion event is reported to the server or a completion token is requested.

[0145] Optionally, if playback fails or a downgrade is performed, the error code, downgrade reason, object identifier, security field score, and action type are reported to facilitate subsequent delivery analysis.

[0146] This application provides an interactive content display method that generates data units that control the execution of interactions based on interaction configuration information. Specifically, it generates an executable interaction package for the player based on the interaction configuration information, making the content interaction configuration no longer just ordinary display rules, but an executable unit containing control and constraint information. Therefore, when content display is needed, the current interactive material is loaded based on emotional interaction data. Then, the object's spatiotemporal index is queried based on the time of the current target frame to obtain the target object's location area. This object spatiotemporal index query mechanism based on video frame time ensures accurate acquisition of the target object area in scenarios such as user dragging, speed adjustment, stuttering, resolution switching, and live streaming delays, avoiding spatiotemporal misalignment between advertising emotional effects and on-screen objects. Next, an interactive safety field is generated based on the target object's location area and various avoidance areas, and a score for the interactive safety field is calculated. Only when the interactive safety field score meets the corresponding threshold is the interactive entry point displayed based on the current interactive material, and an exposure token is generated, thereby minimizing the obstruction of key images by special effects. In response to the user's trigger operation to display the interactive entry point, an execution token request is sent to the server based on the exposure token. This token-based interaction mechanism avoids duplicate triggers and billing, ensuring consistency in attribution state and accuracy in display. Upon receiving an execution token, the object's spatiotemporal index is queried based on the execution time, and the query results are parsed to obtain the object's anchor point. This allows for a second query, effectively guaranteeing the accuracy of the object's location. Finally, emotional effects are played based on the object anchor point, the interaction safety field, and the current interactive material. Therefore, this solution effectively avoids issues such as misalignment of emotional effects with on-screen objects, obscuring of the main text, duplicate triggers, and inconsistent attribution states in scenarios involving on-demand dragging, speed changes, stuttering, and live streaming delays.

[0147] Another embodiment of this application provides an interactive content display system, such as... Figure 6 As shown, it includes:

[0148] Client error 601, server error 602.

[0149] The server 602 is used to send an execution token back to the client 601 when it receives an execution token request from the client 601.

[0150] Client 601 is used for:

[0151] The current interactive material is loaded based on the emotion interaction data. This emotion interaction data is a pre-generated data unit used to control the execution of the interaction, based on the interaction configuration information.

[0152] Based on the time of the current target frame, query the spatiotemporal index of the object to obtain the location region of the target object.

[0153] An interactive safety field is generated based on the location area of ​​the target object and each avoidance area, and a score for the interactive safety field is calculated.

[0154] At least when the score of the interactive safety field meets the corresponding threshold, the interactive entry point is displayed and an exposure token is generated based on the current interactive material.

[0155] In response to the user's trigger action to display the interactive entry point, an execution token request is sent to the server via 602 based on the exposure token.

[0156] Upon receiving the execution token, the object's spatiotemporal index is queried based on the execution time, and the query results are parsed to obtain the object's anchor point.

[0157] Play emotional effects based on the object's anchor point, the interaction safety field, and the current interactive material.

[0158] Optionally, in another embodiment of the interactive content display system provided in this application, the server is further configured to:

[0159] Obtain candidate input data for the target video.

[0160] Based on the analysis of candidate input data, the time periods in the target video that meet the set interaction conditions are used as candidate emotion interaction time windows.

[0161] Optionally, in another embodiment of the interactive content display system provided in this application, the server is further configured to:

[0162] Generate or receive the trajectory of the target object in each frame of the target video.

[0163] Generate a spatiotemporal index of the target object based on its trajectory in each frame of the target video.

[0164] Emotional interaction data is generated based on the interaction configuration information.

[0165] Optionally, in another embodiment of the interactive content display system provided in this application, when the client loads the current interactive material based on the emotion interaction data, it is used for:

[0166] When the decoding frame time of the currently playing target video falls within the candidate emotion interaction time window, load the emotion interaction data.

[0167] Preload entry animations, action panels, and emotional effects materials based on emotional interaction data.

[0168] Optionally, in another embodiment of the interactive content display system provided in this application, the client is further configured to:

[0169] Calculate the visibility of the target object within its location region.

[0170] In this embodiment of the application, when the client displays the interactive entry point and generates an exposure token based on the current interactive material after the scoring in at least the interactive safety field meets the corresponding threshold, it is used for:

[0171] When both the score of the interactive safety field and the visibility of the target object meet the corresponding thresholds, the interactive entry point is displayed based on the current interactive material and an exposure token is generated.

[0172] Optionally, in another embodiment of the interactive content display system provided in this application, the client is further configured to:

[0173] If the score of the interactive security field or the visibility of the target object does not meet the corresponding threshold, the process will enter the downgrade entry point, perform the downgrade operation, and report the reason for the downgrade.

[0174] Optionally, in another embodiment of the interactive content display system provided in this application, when the client plays emotional effects based on the object anchor point, the interactive safety field, and the current interactive material, it is used for:

[0175] The emotional effect parameters should be determined based on at least the object anchor point, the interaction safety field, and the emotional action type in the current interactive material.

[0176] Play emotional effects based on the emotional effect parameters and continuously monitor changes in the target area.

[0177] If the changes in the detected object area meet the set change conditions, update the effect path in the emotion effect parameters or execute a downgraded feedback.

[0178] When the duration of the emotional effect reaches the valid duration, report a completion event or request a completion token.

[0179] It should be noted that the specific working process of the server and client provided in the above embodiments of this application can be referred to the implementation process of the corresponding steps in the above method embodiments, and will not be repeated here.

[0180] Another embodiment of this application provides an electronic device, such as... Figure 7 As shown, it includes:

[0181] Memory 701 and processor 702.

[0182] The memory 701 is used to store the program.

[0183] The processor 702 is used to execute the program stored in the memory 701. When the program is executed, it is specifically used to implement the interactive content display method provided in any of the above embodiments.

[0184] Another embodiment of this application provides a computer storage medium for storing a computer program, which, when executed by a processor, is used to implement the interactive content display method as described above.

[0185] Computer storage media, including both permanent and non-permanent, removable and non-removable media, can store information using any method or technology. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0186] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0187] The above description of the disclosed embodiments enables those skilled in the art to make or use this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for displaying interactive content, characterized in that, include: The current interactive material is loaded based on the emotional interaction data; wherein, the emotional interaction data is a data unit generated in advance based on the interaction configuration information and used to control the execution of the interaction; Based on the time of the current target frame, query the spatiotemporal index of the object to obtain the location region of the target object; An interactive safety field is generated based on the location area of ​​the target object and each avoidance area, and a score for the interactive safety field is calculated. At least when the score of the interactive security field meets the corresponding threshold, the interactive entry point is displayed and an exposure token is generated based on the current interactive material; In response to the user's triggering operation on the display interaction entry, an execution token request is sent to the server based on the exposure token; Upon receiving the execution token, the object's spatiotemporal index is queried based on the execution time, and the query results are parsed to obtain the object's anchor point. Emotional effects are played based on the object anchor point, the interactive safety field, and the current interactive material.

2. The method according to claim 1, characterized in that, Before loading the current interactive material based on the emotion interaction data, the process also includes: Obtain candidate input data for the target video; Based on the analysis of candidate input data, the time periods in the target video that meet the set interaction conditions are used as candidate emotional interaction time windows.

3. The method according to claim 1, characterized in that, Before loading the current interactive material based on the emotion interaction data, the process also includes: Generate or receive the trajectory of the target object in each frame of the target video; Based on the trajectory of the target object in each frame of the target video, generate a spatiotemporal index of the object; Emotional interaction data is generated based on the interaction configuration information.

4. The method according to claim 2, characterized in that, The step of loading the current interactive material based on emotion interaction data includes: When the decoding frame time of the currently playing target video falls within the candidate emotion interaction time window, the emotion interaction data is loaded; Based on the emotional interaction data, preload the entry animation, action panel, and emotional special effects materials.

5. The method according to claim 1, characterized in that, After obtaining the location region of the target object by querying the spatiotemporal index of the target object based on the time of the current target frame, the method further includes: Based on the location region of the target object, calculate the visibility of the target object therein; Wherein, the step of displaying the interactive entry point and generating an exposure token based on the current interactive material when at least the score of the interactive safety field meets the corresponding threshold includes: When both the score of the interactive safety field and the visibility of the target object meet the corresponding thresholds, the interactive entry point is displayed and an exposure token is generated based on the current interactive material.

6. The method according to claim 5, characterized in that, Also includes: If the score of the interactive security field or the visibility of the target object does not meet the corresponding threshold, the process enters the downgrade entry point, performs the downgrade operation, and reports the downgrade reason.

7. The method according to claim 1, characterized in that, The step of playing emotional effects based on the object anchor point, the interaction safety field, and the current interactive material includes: The emotional effect parameters are determined based at least on the object anchor point, the interaction safety field, and the emotional action type in the current interaction material; Play emotional effects based on emotional effect parameters and continuously monitor changes in the target area; If the changes in the object area are detected to meet the set change conditions, update the effect path in the emotion effect parameters or perform a downgraded feedback. When the duration of the emotional effect reaches the valid duration, a completion event is reported or a completion token is requested.

8. An interactive content display system, characterized in that, include: Client and server; The server is used to send an execution token back to the client when it receives an execution token request from the client; The client is used for: The current interactive material is loaded based on the emotional interaction data; wherein, the emotional interaction data is a data unit generated in advance based on the interaction configuration information and used to control the execution of the interaction; Based on the time of the current target frame, query the spatiotemporal index of the object to obtain the location region of the target object; An interactive safety field is generated based on the location area of ​​the target object and each avoidance area, and a score for the interactive safety field is calculated. At least when the score of the interactive security field meets the corresponding threshold, the interactive entry point is displayed and an exposure token is generated based on the current interactive material; In response to the user's triggering operation on the display interaction entry, an execution token request is sent to the server based on the exposure token; Upon receiving the execution token, the object's spatiotemporal index is queried based on the execution time, and the query results are parsed to obtain the object's anchor point. Emotional effects are played based on the object anchor point, the interactive safety field, and the current interactive material.

9. An electronic device, characterized in that, include: Memory and processor; The memory is used to store programs; The processor is used to execute the program, which, when executed, is specifically used to implement the interactive content display method as described in any one of claims 1 to 7.

10. A computer storage medium, characterized in that, Used to store a computer program, which, when executed by a processor, is used to implement the interactive content display method as described in any one of claims 1 to 7.

Images