Object interaction method, apparatus, terminal and storage medium

Abstract

Embodiments of the present application disclose an object interaction method and device, a terminal and a storage medium. An application interface is displayed, the application interface comprising a display area and an interaction area. Multimedia content is displayed in the display area, the multimedia content comprising a target object, and the target object corresponding to an interaction object. A preset playing progress corresponding to the multimedia content is determined. If the multimedia content reaches the preset playing progress, the interaction object is superimposed and displayed on the multimedia content. The interaction object is controlled to be displayed according to a preset display track, the starting point of the preset display track being the display area and the end point being the interaction area. In the embodiments of the present application, a new interaction mode for the target object in the multimedia content is provided, the interaction between the user and the target object is increased, and the diversity of the display multimedia content interaction mode is improved.

Description

Technical Field

[0001] This application relates to the field of computer technology, and specifically to an object interaction method, apparatus, terminal, and storage medium. Background Technology

[0002] In recent years, with the continuous development of social applications, the content styles on these applications are also constantly changing, and more and more users prefer to see more interesting multimedia content. Current solutions typically display content through multimedia formats such as text and images, and users can only perform actions such as liking and commenting on the displayed content, resulting in a limited content presentation format.

[0003] Therefore, how to enhance the diversity of interactive methods for displaying multimedia content is a problem that needs to be solved. Summary of the Invention

[0004] This application provides an object interaction method, apparatus, terminal, and storage medium, which can enhance the diversity of object interaction methods in displayed multimedia content.

[0005] This application provides an object interaction method, comprising: displaying an application interface, the application interface including a display area and an interaction area, the display area displaying multimedia content, the multimedia content including a target object, and the target object corresponding to an interactive object; determining a preset playback progress corresponding to the multimedia content; if the multimedia content reaches the preset playback progress, superimposing the interactive object on the multimedia content; and controlling the interactive object to display according to a preset display trajectory, the starting point of the preset display trajectory being the display area and the ending point being the interaction area.

[0006] This application embodiment also provides an object interaction device, including: a first display unit for displaying an application interface, the application interface including a display area and an interaction area, the display area displaying multimedia content, the multimedia content including a target object, and the target object corresponding to an interactive object; a determining unit for determining a preset playback progress corresponding to the multimedia content; a second display unit for overlaying the interactive object on the multimedia content if the multimedia content reaches the preset playback progress; the second display unit is further used to control the interactive object to be displayed according to a preset display trajectory, the starting point of the preset display trajectory being the display area and the ending point being the interaction area.

[0007] This application also provides a terminal, including a memory storing multiple instructions; the processor loads the instructions from the memory to execute the steps in any of the object interaction methods provided in this application.

[0008] This application also provides a computer-readable storage medium storing a plurality of instructions adapted for loading by a processor to execute steps in any of the object interaction methods provided in this application.

[0009] This application also provides a computer program product, including a computer program / instructions, which, when executed by a processor, implement the steps in any of the object interaction methods provided in this application.

[0010] This application embodiment can display an application interface, which includes a display area and an interactive area. The display area displays multimedia content, which includes a target object and a corresponding interactive object. A preset playback progress corresponding to the multimedia content is determined. If the multimedia content reaches the preset playback progress, the interactive object is overlaid on the multimedia content. The interactive object is controlled to display according to a preset display trajectory, the starting point of which is the display area and the ending point is the interactive area. In this application, the interactive object corresponding to the target object is overlaid on the multimedia content, and the interactive object is controlled to move from the display area to the interactive area. Since the multimedia content is only displayed within the display area, the effect displayed on the application interface is that the interactive object breaks out of the existing display area and reaches the interactive area, thus giving the target object in the multimedia content a new interactive effect. This provides a new interaction method for the target object in the multimedia content, increases the interaction between the user and the target object, and enhances the diversity of interactive methods for the displayed multimedia content. Attached Figure Description

[0011] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0012] Figure 1a This is a schematic diagram of a scenario illustrating the object interaction method provided in an embodiment of this application;

[0013] Figure 1b This is a flowchart illustrating the object interaction method provided in an embodiment of this application;

[0014] Figure 1c This is a schematic diagram of the application interface of the object interaction method provided in the embodiments of this application;

[0015] Figure 1d This is a schematic diagram of the application interface of the object interaction method provided in the embodiments of this application;

[0016] Figure 2a This is a flowchart illustrating an object interaction method provided in another embodiment of this application;

[0017] Figure 2b This is a schematic diagram of a synthesized transparent video provided in one embodiment of this application;

[0018] Figure 3a This is a flowchart illustrating an object interaction method provided in yet another embodiment of this application;

[0019] Figure 3b This is a schematic diagram illustrating the process of an advertiser placing an advertising video according to one embodiment of this application;

[0020] Figure 4a This is a flowchart illustrating an object interaction method provided in yet another embodiment of this application;

[0021] Figure 4b This is an interactive schematic diagram of the object interaction method provided in the embodiments of this application;

[0022] Figure 5 This is a schematic diagram of the structure of the object interaction device provided in the embodiments of this application;

[0023] Figure 6 This is a schematic diagram of the terminal structure provided in the embodiments of this application. Detailed Implementation

[0024] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0025] This application provides an object interaction method, apparatus, terminal, and storage medium.

[0026] Specifically, the interactive device can be integrated into an electronic device, such as a terminal or server. The terminal can be a mobile phone, tablet, smart Bluetooth device, laptop, or personal computer (PC); the server can be a single server or a server cluster consisting of multiple servers.

[0027] In some embodiments, the object interaction device may also be integrated into multiple electronic devices. For example, the object interaction device may be integrated into multiple servers, and the object interaction method of this application may be implemented by multiple servers.

[0028] In some embodiments, the server may also be implemented as a terminal.

[0029] For example, refer to Figure 1a The electronic device can be equipped with an object interaction device and can display an application interface, which includes a display area and an interaction area. The display area displays multimedia content, which includes a target object and a corresponding interactive object. The device can determine the preset playback progress of the multimedia content. If the multimedia content reaches the preset playback progress, the interactive object is overlaid on the multimedia content. The device can control the interactive object to be displayed according to a preset display trajectory, where the starting point of the preset display trajectory is the display area and the ending point is the interaction area.

[0030] Therefore, interactive objects corresponding to the target object can be overlaid on top of multimedia content, and the interactive objects can be controlled to move from the display area to the interaction area. Since the multimedia content is only displayed within the display area, the effect displayed on the application interface is that the interactive object breaks out of the existing display area and arrives at the interaction area, thus giving the target object in the multimedia content a new interactive effect. This provides a new way to interact with the target object in the multimedia content, increases the interaction between the user and the target object, and enhances the diversity of interactive methods for the displayed multimedia content.

[0031] The following sections will provide detailed explanations.

[0032] It is understood that in the specific embodiments of this application, data related to user information, identification information, input operations, etc. are involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0033] In this embodiment, an object interaction method is provided, such as Figure 1b As shown, the specific flow of this object interaction method can be as follows:

[0034] 110. Display the application interface, which includes a display area and an interactive area. The display area displays multimedia content, which includes target objects, and the target objects correspond to interactive objects.

[0035] The application interface refers to the display interface of an application, also known as the UI. The application interface is typically displayed on the terminal screen. This application can be a social application, such as an instant messaging application, an information sharing application, etc. Generally, an application interface can include at least one area, each area used to display different content. For example, in this application, the display area and the interaction area can be pre-set areas located on the application interface. The display area is used to display multimedia content, and the interaction area is used to display interactive objects. The display area and the interaction area can be located at the top, bottom, middle, or any position on the application interface. The display area and the interaction area can be adjacent or non-adjacent, or partially overlapping or not overlapping, depending on the application scenario and requirements. Figure 1c As shown, Figure 1c The interactive area and the display area are adjacent and share a common edge, allowing interactive objects to move smoothly from the display area to the interactive area. Figure 1d In the context of displaying the target object (fireworks) and its corresponding interactive object, the effect of fireworks blooming is simultaneously displayed. In order to fully showcase the multiple dynamic effects of the interactive object, the interactive area can be the area outside the display area as shown in the figure.

[0036] In practical applications, when a social application is running on a terminal, it can respond to a display trigger operation for multimedia content and display the multimedia content in the display area of ​​the application interface. This display trigger operation can include, but is not limited to, touch, drag, swipe, long press, short press, double-tap, click, and ending drag operations. Users can perform display trigger operations through input devices such as touchscreens, mice, keyboards, or gamepads. The specific operation method depends on the software product's operation method or specific settings. For example, after running a social application on a terminal, a user will see the application's interface. This interface does not display the display area or interactive area. The user can use gestures to slide the interface upwards from any position on the screen to reveal the display area and interactive area. When the display area reaches a preset size (e.g., full display), the multimedia content will begin to be displayed.

[0037] Multimedia content can be content displayed on the application interface in the form of images or videos, where images can be static or dynamic. A target object refers to an object pre-determined from the multimedia content. It can be pre-set based on the content elements within the multimedia content. For example, if the multimedia content is an image depicting item A, item B, person A, and person B, item A in the image can be set as the target object. An interactive object is an object used to display interactive effects of the target object. This interactive effect can be dynamic and can be pre-set according to the target object. For example, when the target object is item A in an image, the interactive object can be a dynamic effect generated based on item A. This dynamic effect can be the result of animate processing of item A, such as generating a 3D basketball effect from a static basketball in the multimedia content, and implementing effects such as movement and collision. Figure 1c As shown, the display area on the application interface before overlaying interactive objects displays video content posted by Xiao A. The video content includes Xiao A's animated image (i.e., the target object). When the interactive object corresponding to Xiao A's animated image is overlaid, the interactive object's animation effect is to move from the display area to the interaction area. It can also be a dynamic effect corresponding to item A, such as generating fireworks or firecrackers based on the keyword "Happy New Year" on item A. Or, for example... Figure 1d As shown, the display area on the application interface before overlaying interactive objects displays video content posted by Xiao B. Fireworks are the target object in the image. When the interactive effects corresponding to the fireworks are overlaid, the fireworks effects can be displayed, and dynamic fireworks can be generated and moved to the interactive area. In this way, by displaying dynamic effects of item A, the interaction between the user and item A is increased, enhancing the diversity of interactive methods for the displayed multimedia content.

[0038] Interactive objects can display dynamic effects through dynamic videos. For example, dynamic videos can be integrated with multimedia content to create new videos for playback, or they can be directly overlaid on multimedia content. For instance, a transparent video can be created to display interactive objects. When an interactive object needs to be displayed, the transparent video can be overlaid on top of the multimedia content to show the effect of dynamic interactive objects derived from the target object in the multimedia content, thus presenting a better interactive effect.

[0039] In some implementations, a transparent video corresponding to each multimedia content can be pre-made, allowing for direct access and playback of the corresponding transparent video. This increases the smoothness of dynamic effects on interactive objects and allows for setting different playback conditions for the transparent video and multimedia content, providing greater flexibility. Before step 120, steps 1.1 to 1.2 may also be included, as follows:

[0040] 1.1 Obtain the initial video corresponding to the interactive object and the transparency information corresponding to the interactive object. The initial video includes the interactive object, and the transparency information is used to indicate the transparent area when the initial video is played.

[0041] 1.2. Based on the initial video and transparency information, generate a target interactive video. The target interactive video is a transparent video used to display interactive objects according to a preset display trajectory.

[0042] The initial video refers to the video used to display the interactive object. For example, the initial video can be used to display the dynamic effects of the interactive object. Transparency information can include the transparency values ​​of pixels in each frame of the initial video. The transparency value of pixels in transparent areas can be 0. Thus, each frame of the initial video can be an image including the interactive object graphic and the transparent background area. For example, the initial video can include dynamic footage of the interactive object. The area where the interactive object is located can be defined as the colored area, and the area other than the colored area can be defined as the transparent area. The transparency value of the transparent area can be adjusted to 0 using transparency information to generate a target interactive video with an transparency channel. The target interactive video only displays the interactive object.

[0043] In some implementations, an initial interactive video containing interactive objects can be pre-made. In this case, it is necessary to distinguish between the interactive objects and the background to determine transparent areas based on the background, thereby obtaining transparency information and ultimately obtaining a target interactive video that only displays the interactive objects. Step 1.1 may include steps 1.1.1 to 1.1.2, as follows:

[0044] 1.1.1 Obtain the initial interactive video;

[0045] 1.1.2 Separate the initial interactive video to obtain the initial video and transparent information.

[0046] The initial interactive video refers to a video containing animation effects of interactive objects and a background image. The animation effects of the interactive objects are used to display the interactive objects according to a preset display trajectory. The background image refers to the area displayed in the initial interactive video excluding the interactive objects. For example, the area where the interactive objects are located in the initial interactive video can be defined as the interactive object area, and the area excluding the interactive object area can be defined as the background area. The background image can be obtained by separating the interactive object area and the background area in each frame, and the corresponding transparency information of the background image can be generated. For example, the transparency value of the corresponding pixel in the background image can be recorded as a preset transparency value. The initial video can also be the initial interactive video. While separating the background image, the background color in the initial interactive video can also be adjusted to a preset color, such as black, to obtain the initial video.

[0047] In some implementations, transparent areas in the initial video can be determined using transparency information, allowing for the adjustment of the transparency of all pixels requiring adjustment at once. Step 1.2 may include steps 1.2.1 to 1.2.2, as follows:

[0048] 1.2.1. Based on the transparency information, determine the transparent areas in the initial video;

[0049] 1.2.2 Adjust the transparency of the transparent area to generate the target interactive video.

[0050] For example, based on the transparency value in the transparency information, pixels with transparency values ​​less than or equal to a preset transparency value can be identified as pixels in the transparent area, and the area containing all such pixels can be identified as the transparent area in each frame. The preset transparency value can be 0, thereby adjusting the transparency value of all pixels in the transparent area to 0, so that each frame of the initial video can be an image including interactive object graphics and transparent background areas.

[0051] 120. Determine the preset playback progress corresponding to the multimedia content.

[0052] The preset playback progress refers to the playback progress set in advance for multimedia content. This preset playback progress can be expressed as a time value or a ratio, such as the 30th second of a multimedia file's playback, or the ratio of the already played duration to the total duration of the multimedia file (50%). If the multimedia content is an image, its preset playback progress can be the duration of the image display, or a display duration threshold can be set for the image, with the ratio of the display duration to the display duration threshold used as the ratio value. It should be noted that the values ​​of the time value and the ratio value are not limited to the values ​​mentioned above, and the preset playback progress can be different for each multimedia content, specifically determined according to the application scenario or content elements of the multimedia content.

[0053] 130. If the multimedia content reaches the preset playback progress, an interactive object will be overlaid on the multimedia content.

[0054] Overlay display refers to displaying interactive objects on top of multimedia content. The overlap range between the multimedia content and the interactive objects can be set according to the application scenario and experience. This overlap range can change according to the dynamic effects of the interactive objects. For example, to present a better interactive effect, the interactive objects can partially cover the multimedia content when they are first displayed. If the interactive objects have dynamic effects of increasing or decreasing size, the overlap range can be changed as the interactive objects increase or decrease size until the dynamic effect ends.

[0055] In some implementations, to increase user interaction with the target object and enhance the diversity of interactive methods for the displayed multimedia content, step 130 may include step 2, as follows:

[0056] 2. If the multimedia content reaches the preset playback progress, in response to the interactive trigger operation for the target object, the interactive object will be overlaid and displayed on the multimedia content.

[0057] Interactive trigger operations can include, but are not limited to, touch, drag, swipe, long press, short press, double-tap, click, ending drag, and keyword input. Users can perform interactive trigger operations through input devices such as touchscreens, mice, keyboards, or gamepads. The specific operation method depends on the software product's operation method or specific settings. For example, the application interface also includes an operation area displaying a "like" icon. Users can click this icon to "like" and trigger the display of interactive objects, such as... Figure 1d As shown, User A is the user operating the current terminal. After User A likes the video content posted by User B, the fireworks effect corresponding to the target object (fireworks) is triggered, and the interactive object moves to the interactive area. The preset playback progress in step 2 can be the first second of the multimedia content playback or other times, so as to wait for the interactive trigger operation after the multimedia content starts playing, so as to trigger the display of the interactive object.

[0058] In some implementations, to increase user interaction with the target object and enhance the diversity of interactive methods for the displayed multimedia content, the interaction trigger operation includes a preset keyword input operation. In response to the interaction trigger operation for the target object, the interactive object is overlaid and displayed on the multimedia content, which may include steps 3.1 to 3.2, as follows:

[0059] 3.1 Responding to input operations, obtain the input text information;

[0060] 3.2 When the text information contains preset keywords, display and interact with the multimedia content overlaid.

[0061] Users can input information using devices such as touchscreens, mice, keyboards, or gamepads. Text information can include descriptive text for multimedia content, user-entered comments, and so on. For example, in the application's interface, users can comment using their input devices. If a user's comment includes preset keywords, such as "Happy New Year," an interactive element will be displayed. Figure 1c As shown, the name of the target object in the video, "Little A", can be used as a preset keyword. The user operating the current terminal is user A. When user A enters the comment "Little A is so cute" through the terminal, it is determined that the text information entered by the user contains the preset keyword, and thus the interactive object of Little A is displayed.

[0062] In some implementations, "overlaying and displaying interactive objects on the multimedia content" in step 130, step 2, or step 3.2 may include steps 4.1 to 4.3, as follows:

[0063] 4.1 Overlaying a target interactive video onto multimedia content. The target interactive video is a transparent video used to display interactive objects according to a preset display trajectory. The playback area of ​​the target interactive video includes the display area and the interactive area.

[0064] 4.2 Controlling interactive objects to display according to a preset display trajectory, including:

[0065] 4.3 In the target interactive video, control the interactive object to move from the display area to the interactive area according to the preset display trajectory.

[0066] The preset display trajectory refers to the pre-defined display trajectory of the interactive object, with its starting point in the display area and its ending point in the interaction area. The display path, color, shape, etc. of this trajectory can all be set according to the application scenario. For example, the preset display trajectory can be a continuous trajectory or a discontinuous trajectory, a straight line, an arc, an arbitrary line, and so on.

[0067] By playing a target interactive video over multimedia content, interactive objects in the video move from the display area to the interaction area. Since the multimedia content is only displayed within the display area, the effect on the application interface is that a corresponding interactive object is generated within the multimedia content. This interactive object breaks out of the existing playback frame (display area) to reach the interaction area, thereby increasing user interaction with the target object and enhancing the diversity of interactive methods for the displayed multimedia content. Furthermore, this effect is achieved through transparent video, which both increases user immersion and enhances the smoothness of the dynamic effects of the interactive object.

[0068] In some implementations, to improve the synchronization rate between the multimedia content and the target interactive video during the overlay playback process and avoid abnormal playback states such as frame drops or frame skipping, the frames in the multimedia content and the target interactive video are overlaid in chronological order. Step 4.1 may include steps 4.1.1 to 4.1.2, as follows:

[0069] 4.1.1 Determine the current frame to the target frame of the multimedia content as the background image, and determine all frames of the target interactive video as the foreground image;

[0070] 4.1.2 Display the foreground image overlaid on the background image in chronological order.

[0071] The current frame is the frame to be displayed when the multimedia content begins playing the target interactive video. The target frame is a frame pre-set according to the application scenario or multimedia content. It can be the last frame of the multimedia content, the current frame, or a frame that meets the target playback progress, etc. For example, the frame corresponding to the 45th second of the multimedia content playback or the frame with 80% of the total playback time can be used as the target frame. If the multimedia content is a static image, the target frame is also the current frame.

[0072] In this context, the temporal order refers to the order determined by the time information of the frames. For example, the frames of the multimedia content can be divided into frames 1, 2, and 3 according to the time sequence from the current frame to the target frame. The frames of the target interactive video can be divided into frames 4, 5, 6, 7, and 8 according to the time sequence. In this case, frame 4 can be superimposed on frame 1, frame 5 on frame 2, and frame 6 on frame 3. Since frame 3 is the last frame of the multimedia content, frames 7 and 8 can be superimposed on frame 3 for display.

[0073] In some implementations, since the remaining playback time of the multimedia content and the playback time of the target interactive video may differ, in order to optimize the synchronized playback of the multimedia content and the target interactive video and provide a better interactive experience, when the multimedia content is a video or a moving image, the following steps may be included before step 4.1.1:

[0074] Get the remaining playback time of the multimedia content and the playback time of the target interactive video;

[0075] The target frame of the multimedia content is determined based on the remaining playback time of the multimedia content and the playback time of the target interactive video.

[0076] For example, if the remaining playback time of the multimedia content is m, the playback time of the target interactive video is n, and the time corresponding to the current frame of the multimedia content is l, if m is greater than or equal to n, then the frame corresponding to l+n can be determined as the target frame. If m is less than n, then the playback rules of the multimedia content can be further obtained. If the multimedia content is played once, then the last frame of the multimedia content is taken as the target frame. If the multimedia content is played in a loop, then the frame corresponding to l+n is taken as the target frame during the loop playback.

[0077] In practical applications, to enable multimedia content and target interactive video to play simultaneously and provide a better interactive effect, when m and n are different, the playback frame rate of the multimedia content or the playback frame rate of the target interactive video can be adjusted so that the remaining playback time of the multimedia content and the playback time of the target interactive video are the same. At this time, the foreground image and background image with the same playback time can be superimposed.

[0078] In some implementations, to increase user interaction with the target object and enhance the diversity of interactive methods for the displayed multimedia content, steps 5.1 to 5.2 may be included before step 4.1, as follows:

[0079] 5.1 If the multimedia content reaches the preset playback progress, obtain the target identifier information as the interactive object;

[0080] 5.2 Generate an interactive video of the target based on the target identification information.

[0081] Identification information refers to information that can be used to identify a user, such as a nickname, avatar, etc. Target identification information is the identification information of the user who performs the display trigger operation for multimedia content. For example, a user's nickname can be used as the interactive object to generate a target interactive video. In this case, the target object can be a pre-set item or other element in the multimedia content associated with the user's nickname. For instance, the target object in the multimedia content could be a text box containing "XXX," and the interactive object could be a dynamic video containing a text box with "A." When user A enters the comment "Really interesting," where "interesting" is a preset keyword, the dynamic video containing the text box with "A" will be played on top of the multimedia content.

[0082] In some implementations, to increase the convenience and flexibility of generating target interactive videos, improve processing efficiency, and enhance the diversity of interactive methods for displayed multimedia content, step 5.2 may include steps 5.2.1 to 5.2.2, as follows:

[0083] 5.2.1 Obtain the interactive video template. The interactive video template is used to edit and create an interactive video containing identification information.

[0084] 5.2.2 Fill the target identification information into the interactive video template to generate the target interactive video.

[0085] Interactive video templates refer to pre-set video templates that can be edited to create the desired interactive video. For example, after a user enters preset keywords, their nickname or avatar can be retrieved and filled into the editable area of ​​the interactive video template to generate the target interactive video.

[0086] In some implementations, step 5.2.1 may include the following steps:

[0087] Get the initial video template corresponding to the interactive object and the transparency information corresponding to the interactive object. The transparency information is used to indicate the transparent area when the initial video is played.

[0088] Generate an interactive video template based on the initial video template and transparency information.

[0089] In some implementations, the step of generating an interactive video template based on an initial video template and transparency information may include: determining transparent areas in the initial video template based on the transparency information; adjusting the transparency of the transparent areas to generate the interactive video template. The step of obtaining the initial video template corresponding to the interactive object and the transparency information corresponding to the interactive object may include: obtaining the initial interactive video template; performing separation processing on the initial interactive video template to obtain the initial video template and transparency information. Specific implementation methods for the above steps can be found in the descriptions of steps 1.1–1.2, 1.1.1–1.1.2, and 1.2.1–1.2.2 above, and will not be repeated here.

[0090] In some implementations, the interactive video template includes at least one material filling position, and step 5.2.2 may include the following steps:

[0091] 5.2.2.1 Obtain at least one target material corresponding to the target identification information;

[0092] 5.2.2.2. Based on the type of target material, fill the target material into the corresponding material filling position to generate the target interactive video.

[0093] In this context, "materials" refers to content composed of user identification information, which can include images, text, etc. "Target materials" refers to materials corresponding to target identification information. Material types can include, but are not limited to, images and text. Further subdivision of images and text can be used to obtain more material types based on specific application scenarios. For example, one target identification information can include multiple target materials, each corresponding to different types such as images and text. "Material fill positions" refers to the editable areas in the interactive video template used to fill materials. In practical applications, different material fill positions can be set according to the type of identification information. For example, the interactive video template includes two material fill positions corresponding to the user's nickname and avatar, respectively. Thus, by using multiple material fill positions, different types of user identification information can be filled, enhancing the diversity of interactive multimedia content. Furthermore, distinguishing different types of identification information and material fill positions by type allows for the corresponding filling of acquired user identification information, increasing the convenience and flexibility of generating target interactive videos.

[0094] 140. Control the interactive object to be displayed according to the preset display trajectory. The starting point of the preset display trajectory is the display area, and the ending point is the interactive area.

[0095] In some implementations, to enhance the smoothness of the dynamic effects of interactive objects, the display area and the interactive area overlap or intersect at least one boundary, so that when the interactive object moves from the display area to the interactive area, it can move along a continuous trajectory.

[0096] In practical applications, after step 140, the following step may also be included: in response to an interactive trigger operation on the interactive object, controlling the interactive object to perform a preset action. Interactive trigger operations may include, but are not limited to, touch, drag, swipe, long press, short press, double-tap, click, ending drag, and keyword input. Users can perform interactive trigger operations through input devices such as touchscreens, mice, keyboards, or gamepads. The specific operation method depends on the software product's operation method or specific settings. For example, a user can click on an interactive object located in the interactive area to make the interactive object shake. This preset action can be achieved by playing an interactive video in the interactive area.

[0097] The object interaction scheme provided in this application embodiment can be applied to various social application scenarios. For example, taking an instant messaging application product as an example, an application interface can be displayed, which includes a display area and an interaction area. The display area displays multimedia content, which includes a target object, and the target object corresponds to an interactive object. A preset playback progress corresponding to the multimedia content is determined. If the multimedia content reaches the preset playback progress, the interactive object is superimposed on the multimedia content. The interactive object is controlled to be displayed according to a preset display trajectory, where the starting point of the preset display trajectory is the display area and the ending point is the interaction area.

[0098] The solution provided in this application overlays interactive objects corresponding to the target object on top of multimedia content and controls the interactive objects to move from the display area to the interaction area. Since the multimedia content is only displayed within the display area, the effect displayed on the application interface is that the interactive object breaks out of the existing display area and arrives at the interaction area, thereby enabling the target object in the multimedia content to exhibit a new interactive effect. This provides a new interaction method for the target object in the multimedia content, increases the interaction between the user and the target object, and enhances the diversity of interactive methods for the displayed multimedia content.

[0099] Furthermore, in this embodiment, a transparent video is used to display interactive objects, and a target interactive video is played on top of the multimedia content. When the interactive object in the target interactive video moves from the display area to the interactive area, the transparent video corresponding to the multimedia content can be directly called and played, increasing the smoothness of the dynamic effects of the interactive object. At the same time, different playback conditions can be set for the transparent video and the multimedia content, making it more flexible.

[0100] The method described in the above embodiments will be further described in detail below.

[0101] In this embodiment, the method of this application embodiment will be described in detail using the application of interactive advertising videos on a terminal as an example.

[0102] like Figure 2aAs shown, the specific process of an object interaction method is as follows:

[0103] 210. In response to a display trigger operation for the ad video content, retrieve the ad video and the target interactive video from the server, and display the ad video in the ad area of ​​the application interface.

[0104] The trigger for displaying ad video content can be a swipe gesture. For example, after a user opens an instant messaging application on their device and clicks the "Discover" tab, they are redirected to the Moments interface (the application interface). This interface includes an ad area (the display area) and an interaction area. When the user swipes up and down to browse the Feeds content, and reaches the ad area, ad videos will be displayed intermittently in the display area according to the ad delivery strategy. Here, Feeds refers to a continuously updated information stream presented to the user; for example, content can be displayed to the user in the order it was updated. The display trigger can also include a pull-to-refresh action, where pulling down reloads and refreshes the page to retrieve new ad video content.

[0105] 220. When more than half of the display area is displayed on the terminal screen, start playing the advertising video.

[0106] When the user scrolls down until more than half of the displayed ad area is visible, the ad video begins to play.

[0107] 230. If the advertisement video reaches the preset playback progress, or in response to an interactive trigger operation for the target object, a target interactive video is overlaid on the advertisement video, the target interactive video including the interactive object corresponding to the target object.

[0108] Virtual avatars can be used as interactive objects, such as anime characters. For example, during the playback of an advertisement video, the virtual avatar can be integrated into the video and displayed in video format. For instance, when the advertisement video reaches a certain point in time (such as a frame where the virtual avatar is displayed), or triggered by clicking, long-pressing, shaking, or adding comments below the advertisement video, the virtual avatar can break out of the advertisement's limited area and remain in the lower right corner of the display area, possibly with slight animation effects. This virtual avatar does not disappear as the advertisement video loops.

[0109] In practical applications, instant messaging applications can support transparent video playback, allowing the target interactive video to be transparent. Before playback, the target interactive video can be preloaded simultaneously with the advertising video, enabling immediate playback upon triggering and improving the smoothness of the interactive display. For example, a terminal can overlay a transparent video (target interactive video) onto the full-screen material (advertising video) to achieve a frame-breaking effect.

[0110] Since existing communication applications do not support transparent channels, achieving transparent video capabilities requires additional stitching of video components representing alpha information. This can be done on the server side by combining the initial RGB channel video and the initial alpha channel video into a transparent video (target interactive video), or on the terminal side. For example, after decoding and stitching the video on the terminal, the GPU can be used to fuse the initial video and alpha information (transparent information) to obtain a transparent video, which can then be rendered onto the terminal screen. Figure 2b As shown, alpha information refers to information containing the alpha channel, which indicates the transparency and semi-transparency of an image. Alpha information can be used to indicate the transparency information of each frame of the initial video. RGB channels refer to color channels. By adding the alpha channel information corresponding to the pixels of the initial video frame to the RGB channels of the initial video frame, an RGB channel with transparency information is obtained, thus adjusting the transparency of the initial video to obtain a transparent video.

[0111] In practical applications, when playing advertising videos or target interactive videos, other elements on the application interface, such as the outer avatar, nickname, badge, likes, comments, etc., also respond to the click logic.

[0112] 241. In response to interactive trigger operations on interactive objects, control the interactive objects to perform preset actions.

[0113] For example, such as Figure 1c As shown, when the interactive object corresponding to the animated character of Little A in the advertisement video moves from the advertisement area to the interactive area outside the advertisement area under the interactive trigger operation (click, long press, shake or comment, etc.), Little A in the interactive area can perform animation effects such as waving and smiling in the interactive area through the interactive trigger operation (such as clicking Little A in the interactive area).

[0114] 242. In response to a switching operation, switch the application interface to the target interface.

[0115] The target interface can be the native ad page corresponding to the ad video, a mini-program, or other custom interfaces. For example, a user can click on the virtual avatar or ad video located in the interactive area to redirect the currently displayed interface to the native ad page, mini-program, or custom link corresponding to the ad video.

[0116] The switching operation can include, but is not limited to, touch, drag, swipe, long press, short press, double tap, click, end drag, and input keywords. Users can interact and trigger the operation through input devices such as touch screen, mouse, keyboard or gamepad. The specific operation method depends on the operation method or specific settings of the software product. The switching operation can be an operation on advertising videos, interactive objects or other objects.

[0117] In practical applications, when redirecting to the target interface, a redirect area can be set in the lower right corner of the ad area. Advertisers (the publishers of the ad videos) can flexibly configure the redirect area, and users can switch interfaces by clicking the icons within the redirect area. Switchable interfaces include a custom link mini-program, the native ad page, and the video account's dynamic feed. Furthermore, the time period during which the ad can redirect can be specified, such as the 5th-15th second of the ad video playback being clickable, or the end of the target interactive video playback being clickable; clicks at other times are invalid.

[0118] For details on the implementation of each step in this embodiment, please refer to the previous embodiments, which will not be repeated here.

[0119] As can be seen from the above, the solution provided in this embodiment plays a target interactive video on top of the advertising video. The interactive object in the video moves from the display area to the interaction area. Since the advertising video is only displayed within the display area, the effect displayed on the application interface is that a corresponding interactive object is generated within the advertising video, and the interactive object breaks out of the existing playback frame (display area) to reach the interaction area. This increases the interaction between the user and the target object, enhancing the diversity of interactive methods for the displayed advertising video. Furthermore, displaying the interactive object as a target interactive video facilitates its invocation or preloading, increases the smoothness of the interactive object's dynamic effects, and allows for setting different playback conditions for transparent videos and advertising videos, providing greater flexibility.

[0120] In this embodiment, the method of this application embodiment will be described in detail using the server-side processing of advertising videos as an example.

[0121] like Figure 3a As shown, the specific process of an object interaction method is as follows:

[0122] 310. Obtain the initial RGB channel video and the initial Alpha channel video.

[0123] Among them, the initial RGB channel video refers to the initial video corresponding to the interactive object, and the initial Alpha channel video refers to the video containing the transparency information corresponding to the interactive object.

[0124] It should be noted that the server refers to the end that provides services to the terminal, which can be a server.

[0125] 320. Combine the initial RGB channel video and the initial Alpha channel video to create the target interactive video.

[0126] like Figure 3b As shown, a media library can be set up to store target interactive videos. Advertisers upload initial RGB channel videos and initial alpha channel videos of the same size to the server. The server can add pre-processing logic to the existing media upload logic to synthesize the initial RGB channel videos and initial alpha channel videos into the target interactive video required by the terminal, and then upload it to the media library. At the same time, the ad videos can also be uploaded to the media library.

[0127] 330. Based on the preset advertising delivery strategy, send advertising videos and target interactive videos to the terminal.

[0128] The pre-defined advertising strategy can be set by advertisers according to application scenarios. When the server receives a trigger operation for displaying the advertising video content, it can send a link to the target interactive video to the terminal through the pre-defined advertising playback logic (ad delivery strategy), causing the terminal to display an ad with a frame-breaking effect by playing the target interactive video. For example, ... Figure 3b As shown, the server-side can include a creative composition unit, a creative library, an ad creation and delivery unit, and an ad playback service unit. When an advertiser delivers an ad video, they can configure the ad video settings in the ad creation and delivery unit. For example, they can set the ad style to "full-screen card ad," select the style "IP interactive," and click to switch between options such as native promotion page, native promotion page mini-program version, simplified native page, WeChat official account article, custom link, WeChat mini-program, and landing page, etc. The creative materials that advertisers need to upload to the delivery platform when delivering this type of ad can include: two transparent MP4 format videos with a size of 1920×1440, an aspect ratio of 4:3, and a length of 5-30 seconds; PNG format images with a file size of less than or equal to 50kb and a length of 200×200 pixels; MP4 format videos with a size of 1280×960 pixels and a length of 5-30 seconds; other text-based copy, etc. After the advertiser completes the settings on the ad delivery platform, when the server receives the trigger operation for displaying the ad video content, the ad playback service unit will send the set ad video and target interactive video to the terminal so that the terminal can play the ad video and target interactive video.

[0129] It should be noted that the ad playback unit can send target interface information to the terminal when sending ad videos and target interactive videos, or it can send target interface information to the terminal when it receives a switching request (the request corresponding to the switching operation) so that the terminal can switch the application interface to the target interface. Target interface information is the information used to switch the application interface to the target interface, and may include, but is not limited to, information from native promotional pages, native promotional page mini-program versions, simplified native pages, official account articles, custom links, WeChat mini-programs, and alternative landing pages, etc., which can be specifically set according to the application scenario.

[0130] For details on the implementation of each step in this embodiment, please refer to the previous embodiments, which will not be repeated here.

[0131] As can be seen from the above, the solution provided in this embodiment offers advertisers a solution from uploading materials to ad playback. Based on the advertiser's own settings, it can provide more and more flexible ad interaction solutions, increase user interaction with ad content, and enhance the diversity of ad content interaction methods.

[0132] In this embodiment, the method of this application embodiment will be described in detail using the user's nickname as the interaction object in advertising video interaction as an example.

[0133] In practical applications, user nicknames can be used as the interaction object according to the advertiser's choice. The user nicknames can be integrated with the advertising creative itself, and target interactive videos can be created based on the user nicknames for out-of-frame display.

[0134] like Figure 4a and Figure 4b As shown, the specific process of an object interaction method is as follows:

[0135] 410. In response to a display trigger operation for an advertising video, the terminal retrieves the advertising video from the server and displays the advertising video in the advertising area of ​​the application interface.

[0136] After a user performs a display triggering operation on the terminal (such as opening the application interface or performing a swipe operation on the application interface), the terminal generates a first request and sends it to the server. This first request is used to request the ad video from the server. After receiving the first request, the server sends the ad video to the terminal according to a preset ad delivery strategy. The terminal then displays the ad video in the ad area of ​​the application interface.

[0137] 420. When more than half of the display area is displayed on the terminal screen, the terminal starts playing an advertising video.

[0138] When a user swipes across the application interface to display at least half of the screen area, the ad video within that area begins to play.

[0139] 430. In response to an input operation, the terminal obtains the input comment information and sends the comment information to the server.

[0140] When a user comments on an advertising video, the terminal can send the user's comment information to the server for processing. For example, the terminal can store the user's comment information in an XML configuration file, then upload it to a cloud server in XML format for synchronization. The cloud server then moves the XML file to the server for processing to obtain the user's nickname and create a target interactive video.

[0141] 440. The server compares the received comment information with preset keywords.

[0142] The server compares the received comment information with preset keywords to determine whether the comment information contains the preset keywords. For example, the server can iterate and compare the keywords set by the advertiser with the text comment information in the XML file. When a consecutive matching keyword is found, the frame-breaking effect is triggered to execute steps 450-470. For example, if the advertiser sets the keyword "happy", and the user enters the comment "very happy", the match is successful and the frame-breaking effect is triggered.

[0143] 450. When the comment information contains preset keywords, the server obtains the user's nickname and the interactive video template.

[0144] If the comment information contains preset keywords, the server will obtain the materials needed to create the target interactive video displaying the user's nickname, namely the user's nickname and the interactive video template. The target interactive video can be obtained in advance through the following method: the server obtains the advertiser's initial RGB channel video and initial alpha channel video, and then combines these two videos into the interactive video template. The initial RGB channel video refers to the initial interactive video template corresponding to the interactive object, and the initial alpha channel video refers to the video containing transparent information corresponding to the interactive object.

[0145] 460. The server generates a target interactive video based on the user's nickname and the interactive video template, and sends the target interactive video to the terminal.

[0146] For example, the interactive video template can be a transparent video. The server can fill the user's nickname into the interactive video template to generate the target interactive video, which is also a transparent video.

[0147] 470. The terminal receives the target interactive video sent by the server and plays it over the advertising video.

[0148] When a target interactive video is overlaid on top of an advertising video, since the multimedia content is only displayed within the display area, and the user's nickname in the target interactive video can move from the display area to the interactive area, it can achieve the effect of the user's nickname breaking out of the existing playback frame (display area) to reach the interactive area. This increases user interaction with the target audience and enhances the diversity of interactive methods for the displayed multimedia content. Furthermore, if the target interactive video is transparent, overlaying it on the advertising video can create the visual effect of the user's nickname breaking out of the advertising video (not the target interactive video), further increasing user interaction with the target audience and enhancing the diversity of interactive methods for the displayed multimedia content.

[0149] 480. In response to the switching operation, the terminal switches the application interface to the target interface.

[0150] For example, a user can switch interfaces by clicking on an ad video or interactive object. At this point, the terminal generates a second request and sends it to the server. This second request requests information about the target interface from the server. This information may include, but is not limited to, information about the native page corresponding to the ad video, information about the mini-program, or custom links, etc. Upon receiving the second request, the server sends the target interface information back to the terminal, allowing the terminal to switch the application interface to the target interface based on this information.

[0151] For details on the implementation of each step in this embodiment, please refer to the previous embodiments, which will not be repeated here.

[0152] As can be seen from the above, the solution provided in this embodiment increases the interaction between users and target objects by obtaining user comment information, thereby enhancing the diversity of interactive methods for displayed advertising videos.

[0153] To better implement the above methods, this application also provides an object interaction device, which can be integrated into an electronic device, such as a terminal or server. The terminal can be a mobile phone, tablet computer, smart Bluetooth device, laptop computer, or personal computer; the server can be a single server or a server cluster composed of multiple servers.

[0154] For example, in this embodiment, the method of this application embodiment will be described in detail by taking the object interaction device specifically integrated into the terminal as an example.

[0155] For example, such as Figure 5 As shown, the object interaction device may include a first display unit 510, a determination unit 520, and a second display unit 530, as follows:

[0156] (a) First display unit 510

[0157] Used to display the application interface, which includes a display area and an interactive area. The display area displays multimedia content, which includes target objects, and the target objects correspond to interactive objects.

[0158] In some embodiments, the first display unit 510 may also be used for:

[0159] Get the initial video and the transparency information corresponding to the interactive object. The initial video includes the interactive object, and the transparency information is used to indicate the transparent area when the initial video is played.

[0160] Generate the target interactive video based on the initial video and transparency information.

[0161] In some implementations, generating a target interactive video based on an initial video and transparency information may include:

[0162] Based on the transparency information, determine the transparent areas in the initial video;

[0163] Adjust the transparency of the transparent areas to generate the target interactive video.

[0164] In some implementations, obtaining the initial video corresponding to the interactive object and the transparency information corresponding to the interactive object includes:

[0165] Get the initial interactive video;

[0166] The initial interactive video is separated to obtain the initial video and transparent information.

[0167] (II) Determine Unit 520

[0168] Used to determine the preset playback progress corresponding to multimedia content.

[0169] (III) Second display unit 530

[0170] This is used to overlay interactive objects onto multimedia content when the multimedia content reaches a preset playback progress; it is also used to control the interactive objects to be displayed according to a preset display trajectory, where the starting point of the preset display trajectory is the display area and the ending point is the interactive area.

[0171] In some embodiments, the second display unit 530 may specifically be used for:

[0172] If the multimedia content reaches the preset playback progress, in response to the interactive trigger operation for the target object, the interactive object is overlaid and displayed on the multimedia content.

[0173] In some implementations, the interactive triggering operation includes an input operation of a preset keyword. In response to the interactive triggering operation targeting a target object, the interactive object is overlaid and displayed on the multimedia content, including:

[0174] Responding to input operations, it retrieves the input text information;

[0175] When the text information contains preset keywords, interactive objects are overlaid on the multimedia content.

[0176] In some implementations, displaying and interacting objects overlaid on multimedia content includes:

[0177] A target interactive video is overlaid on multimedia content. The target interactive video is a transparent video used to display interactive objects according to a preset display trajectory. The playback area of ​​the target interactive video includes the display area and the interactive area.

[0178] Controlling interactive objects to display according to a preset display trajectory includes:

[0179] In the target interactive video, control the interactive object to move from the display area to the interactive area according to the preset display trajectory.

[0180] In some implementations, playing a target interactive video overlaid on multimedia content includes:

[0181] The current frame to the target frame of the multimedia content is determined as the background image, and all frames of the target interactive video are determined as the foreground image;

[0182] The foreground image is overlaid on the background image and displayed in chronological order.

[0183] In some embodiments, the second display unit 530 may also be used for:

[0184] If the multimedia content reaches the preset playback progress, obtain the target identifier information as the interactive object;

[0185] Generate an interactive video of the target based on the target identification information.

[0186] In some implementations, generating a target interactive video based on target identification information includes:

[0187] Get an interactive video template, which is used to edit and create interactive videos containing identification information;

[0188] Fill the target identifier information into the interactive video template to generate the target interactive video.

[0189] In some implementations, the interactive video template includes at least one material filling position, into which target identification information is filled to generate the target interactive video, including:

[0190] Obtain at least one target material corresponding to the target identification information;

[0191] Based on the type of target material, fill the corresponding material filling position to generate the target interactive video.

[0192] In practice, each of the above units can be implemented as an independent entity or can be arbitrarily combined to be implemented as the same or several entities. For the specific implementation of each of the above units, please refer to the previous method embodiments, which will not be repeated here.

[0193] As can be seen from the above, the object interaction device of this embodiment may include a first display unit, a determining unit, and a second display unit. The first display unit is used to display an application interface, which includes a display area and an interaction area. The display area displays multimedia content, which includes a target object and an interactive object. The determining unit is used to determine the preset playback progress corresponding to the multimedia content. The second display unit is used to overlay and display the interactive object on the multimedia content if the multimedia content reaches the preset playback progress. The second display unit is also used to control the interactive object to be displayed according to a preset display trajectory, where the starting point of the preset display trajectory is the display area and the ending point is the interaction area.

[0194] Therefore, in this embodiment, the interactive object corresponding to the target object is overlaid on the multimedia content, and the interactive object is controlled to move from the display area to the interaction area. Since the multimedia content is only displayed within the display area, the effect displayed on the application interface is that the interactive object breaks out of the existing display area and arrives at the interaction area, thereby enabling the target object in the multimedia content to exhibit a new interactive effect. This provides a new interaction method for the target object in the multimedia content, increases the interaction between the user and the target object, and enhances the diversity of interactive methods for the displayed multimedia content.

[0195] This application also provides an electronic device, which can be a terminal, a server, or other similar device. The terminal can be a mobile phone, tablet computer, smart Bluetooth device, laptop computer, personal computer, etc.; the server can be a single server or a server cluster composed of multiple servers, etc.

[0196] In some embodiments, the object interaction device may also be integrated into multiple electronic devices. For example, the object interaction device may be integrated into multiple servers, and the object interaction method of this application may be implemented by multiple servers.

[0197] In this embodiment, the electronic device will be described in detail as a terminal, for example, such as... Figure 6 As shown, it illustrates the structural diagram of the terminal involved in the embodiments of this application, specifically:

[0198] The terminal may include components such as a processor 610 with one or more processing cores, a memory 620 with one or more computer-readable storage media, a power supply 630, an input module 640, and a communication module 650. Those skilled in the art will understand that... Figure 6 The terminal structure shown does not constitute a limitation on the terminal and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein:

[0199] The processor 610 is the control center of the terminal, connecting various parts of the terminal via various interfaces and lines. It executes various functions and processes data by running or executing software programs and / or modules stored in the memory 620, and by calling data stored in the memory 620. In some embodiments, the processor 610 may include one or more processing cores; in some embodiments, the processor 610 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may also not be integrated into the processor 610.

[0200] The memory 620 can be used to store software programs and modules. The processor 610 executes various functional applications and data processing by running the software programs and modules stored in the memory 620. The memory 620 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the terminal, etc. In addition, the memory 620 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 620 may also include a memory controller to provide the processor 610 with access to the memory 620.

[0201] The terminal also includes a power supply 630 that supplies power to the various components. In some embodiments, the power supply 630 can be logically connected to the processor 610 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 630 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0202] The terminal may also include an input module 640, which can be used to receive input numeric or character information, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

[0203] The terminal may also include a communication module 650. In some embodiments, the communication module 650 may include a wireless module, through which the terminal can perform short-range wireless transmission, thereby providing users with wireless broadband internet access. For example, the communication module 650 can be used to help users send and receive emails, browse web pages, and access streaming media.

[0204] Although not shown, the terminal may also include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 610 in the terminal loads the executable files corresponding to the processes of one or more applications into the memory 620 according to the following instructions, and the processor 610 runs the applications stored in the memory 620 to realize various functions, as follows:

[0205] The application interface is displayed, including a display area and an interactive area. The display area shows multimedia content, which includes target objects and corresponding interactive objects. The preset playback progress of the multimedia content is determined. If the multimedia content reaches the preset playback progress, the interactive objects are overlaid on the multimedia content. The interactive objects are controlled to display according to a preset display trajectory, with the starting point of the preset display trajectory being the display area and the ending point being the interactive area.

[0206] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0207] As can be seen from the above, this embodiment overlays and displays the interactive object corresponding to the target object on top of the multimedia content, and controls the interactive object to move from the display area to the interaction area. Since the multimedia content is only displayed within the display area, the effect displayed on the application interface is that the interactive object breaks out of the existing display area and arrives at the interaction area, thereby enabling the target object in the multimedia content to exhibit a new interactive effect. This provides a new interaction method for the target object in the multimedia content, increases the interaction between the user and the target object, and enhances the diversity of interactive methods for the displayed multimedia content.

[0208] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0209] Therefore, embodiments of this application provide a computer-readable storage medium storing a plurality of instructions that can be loaded by a processor to execute steps in any of the object interaction methods provided in embodiments of this application. For example, the instructions can execute the following steps:

[0210] The application interface is displayed, including a display area and an interactive area. The display area shows multimedia content, which includes target objects and corresponding interactive objects. The preset playback progress of the multimedia content is determined. If the multimedia content reaches the preset playback progress, the interactive objects are overlaid on the multimedia content. The interactive objects are controlled to display according to a preset display trajectory, with the starting point of the preset display trajectory being the display area and the ending point being the interactive area.

[0211] The storage medium may include: read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0212] According to one aspect of this application, a computer program product or computer program is provided, comprising a computer program / instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer program / instructions from the computer-readable storage medium and executes the computer program / instructions, causing the computer device to perform the methods provided in various optional implementations of the social application aspect of the above embodiments.

[0213] Since the instructions stored in the storage medium can execute the steps of any of the object interaction methods provided in the embodiments of this application, the beneficial effects that any of the object interaction methods provided in the embodiments of this application can achieve can be realized. For details, please refer to the previous embodiments, which will not be repeated here.

[0214] The foregoing has provided a detailed description of an object interaction method, apparatus, terminal, and computer-readable storage medium provided in the embodiments of this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A method for object interaction, characterized in that, include: The application interface includes a display area and an interactive area. The display area displays multimedia content, which includes a target object. The target object is an object determined in advance from the multimedia content. The target object corresponds to an interactive object, which is an object used to display the interactive effects of the target object. Determine the preset playback progress corresponding to the multimedia content; If the multimedia content reaches a preset playback progress, the interactive object is overlaid on the multimedia content, including: acquiring an initial RGB channel video and an initial Alpha channel video; wherein, the initial RGB channel video refers to the initial video corresponding to the interactive object, and the initial Alpha channel video refers to the video containing the transparency information corresponding to the interactive object; combining the initial RGB channel video and the initial Alpha channel video into a target interactive video; and overlaying the target interactive video on the multimedia content. The interactive object is controlled to be displayed according to a preset display trajectory, the starting point of which is the display area and the ending point is the interactive area.

2. The object interaction method as described in claim 1, characterized in that, The step of overlaying the interactive object onto the multimedia content if the multimedia content reaches a preset playback progress includes: If the multimedia content reaches a preset playback progress, in response to an interactive trigger operation targeting the target object, the interactive object is overlaid on the multimedia content.

3. The object interaction method as described in claim 2, characterized in that, The interactive triggering operation includes inputting preset keywords. The step of overlaying the interactive object onto the multimedia content in response to the interactive triggering operation targeting the target object includes: Responding to input operations, it retrieves the input text information; When the text information contains preset keywords, the interactive object is overlaid on the multimedia content.

4. The object interaction method as described in any one of claims 1 to 3, characterized in that, The overlay display of the interactive object on the multimedia content includes: A target interactive video is overlaid on the multimedia content. The target interactive video is a transparent video used to display the interactive object according to a preset display trajectory. The playback area of ​​the target interactive video includes a display area and an interactive area. The control of the interactive object to display according to a preset display trajectory includes: In the target interactive video, the interactive object is controlled to move from the display area to the interactive area according to a preset display trajectory.

5. The object interaction method as described in claim 4, characterized in that, The step of overlaying and playing the target interactive video on the multimedia content includes: The current frame to the target frame of the multimedia content is determined as the background image, and all frames of the target interactive video are determined as the foreground image; The foreground image is overlaid on the background image and displayed in chronological order.

6. The object interaction method as described in claim 4, characterized in that, Before overlaying the target interactive video onto the multimedia content, the method further includes: If the multimedia content reaches the preset playback progress, the target identification information is obtained as the interactive object; Based on the target identification information, generate a target interactive video.

7. The object interaction method as described in claim 6, characterized in that, The step of generating a target interactive video based on the target identifier information includes: Obtain an interactive video template, which is used to edit and create an interactive video containing identification information; The target identification information is filled into the interactive video template to generate the target interactive video.

8. The object interaction method as described in claim 7, characterized in that, The interactive video template includes at least one material filling position. The step of filling the target identifier information into the interactive video template to generate the target interactive video includes: Obtain at least one target material corresponding to the target identification information; Based on the type of the target material, the target material is filled into the corresponding material filling position to generate the target interactive video.

9. The object interaction method as described in claim 4, characterized in that, Before determining the preset playback progress corresponding to the multimedia content, the method further includes: Obtain the initial video corresponding to the interactive object and the transparency information corresponding to the interactive object. The initial video includes the interactive object, and the transparency information is used to indicate the transparent area when the initial video is played. Based on the initial video and the transparency information, a target interactive video is generated.

10. The object interaction method as described in claim 9, characterized in that, The step of generating a target interactive video based on the initial video and the transparency information includes: Based on the transparency information, determine the transparent areas in the initial video; Adjust the transparency of the transparent area to generate the target interactive video.

11. The object interaction method as described in claim 9, characterized in that, The step of obtaining the initial video corresponding to the interactive object and the transparency information corresponding to the interactive object includes: Get the initial interactive video; The initial interactive video is separated to obtain the initial video and the transparent information.

12. An object interaction device, characterized in that, include: The first display unit is used to display an application interface, which includes a display area and an interactive area. The display area displays multimedia content, which includes a target object. The target object is an object determined in advance from the multimedia content. The target object corresponds to an interactive object, which is an object used to display the interactive effect of the target object. A determining unit is used to determine the preset playback progress corresponding to the multimedia content; The second display unit is configured to overlay and display the interactive object on the multimedia content if the multimedia content reaches a preset playback progress, including: acquiring an initial RGB channel video and an initial Alpha channel video; wherein, the initial RGB channel video refers to the initial video corresponding to the interactive object, and the initial Alpha channel video refers to the video containing the transparency information corresponding to the interactive object; combining the initial RGB channel video and the initial Alpha channel video into a target interactive video; and overlaying and displaying the target interactive video on the multimedia content. The second display unit is also used to control the interactive object to be displayed according to a preset display trajectory, wherein the starting point of the preset display trajectory is the display area and the ending point is the interactive area.

13. A terminal, characterized in that, It includes a processor and a memory, the memory storing multiple instructions; the processor loads instructions from the memory to perform the steps in the object interaction method as described in any one of claims 1 to 11.

14. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a plurality of instructions adapted for loading by a processor to perform the steps of the object interaction method according to any one of claims 1 to 11.

15. A computer program product comprising a computer program / instructions, characterized in that, When the computer program / instructions are executed by the processor, they implement the steps of the object interaction method according to any one of claims 1 to 11.

Images