Methods, apparatus, devices, media and products for interaction
By displaying special effects triggering elements in different areas during video playback and dynamically integrating special effects in response to user operations, the problem of insufficient interactivity in existing technologies is solved, enabling personalized customization of video content and saving computing resources.
Patent Information
- Application Number
- CN202611373625.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-09-04
- Publication Date
- 2026-11-17
AI Technical Summary
Existing video playback technology cannot achieve dynamic effect changes and personalized adjustments, resulting in insufficient user interactivity, difficulty for users to deeply engage with video content, and a monotonous viewing experience that fails to meet personalized needs.
During video playback, media content is displayed in a first area, while special effects triggering elements are displayed in a different second area. Special effects are dynamically integrated in response to user operations, achieving a dynamic combination of media content and special effects. This avoids special effects operations from obscuring video content and reduces repeated playback.
It enhances the interactivity and user engagement of media content, improves user experience, saves computing resources, achieves regional isolation between media content display and special effects control, and reduces the number of repeated playbacks.
Smart Images

Figure CN123123634A_ABST
Abstract
Description
Technical Field
[0001] It relates to the field of computers, and more specifically to methods, apparatus, devices, computer-readable storage media, and computer program products for interaction. Background Technology
[0002] With the development of mobile internet technology, short video applications have become widely popular and have become the mainstream digital content consumption medium. Summary of the Invention
[0003] A method, apparatus, device, computer storage medium, and computer program product for interaction are provided.
[0004] In a first aspect, a method for interaction is provided, comprising displaying first media content in a first area. The method further comprises displaying a first element in a second area in response to the first media content playing to a first progress point, wherein the first and second areas are distinct areas, and the first element is used to apply effects to objects within the first media content. The method further comprises displaying second media content in response to a triggering action on the first element, the second media content including objects adjusted using the effects. This method dynamically integrates the first media content and effects, enhancing the interactivity and user engagement of the media content, improving the user experience. Furthermore, it achieves regional isolation between media content display and effect control, preventing effects operations from obscuring the first media content, reducing the number of replays, and saving computational resources.
[0005] In a second aspect, an interactive device is provided, comprising a first display module configured to display first media content in a first area. The device also includes a second display module configured to display a first element in the second area in response to playback of the first media content reaching a first progress point. The first and second areas are distinct areas, and the first element is used to apply special effects to objects within the first media content. The device further includes a third display module configured to display second media content, including objects adjusted using special effects, in response to a triggering operation on the first element. This device dynamically integrates the first media content and special effects, enhancing the interactivity and user engagement of the media content and improving the user experience. Furthermore, it achieves regional isolation between media content display and special effects control, preventing special effects operations from obscuring the first media content, reducing the number of replays, and saving computational resources.
[0006] In a third aspect, an electronic device is provided, comprising: at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform an interactive method when executed by the at least one processing unit. The method includes displaying first media content in a first area. The method further includes displaying a first element in a second area in response to the first media content playing to a first progress point, the first and second areas being distinct areas, the first element being used to apply special effects to objects in the first media content. The method further includes displaying second media content in response to a triggering operation on the first element, the second media content including objects adjusted using special effects. This electronic device can dynamically integrate first media content and special effects, enhancing the interactivity and user engagement of the media content, improving the user experience. Furthermore, it achieves regional isolation between media content display and special effects control, preventing special effects operations from obscuring the first media content, reducing the number of repeated playbacks, and saving computational resources.
[0007] In a fourth aspect, a computer-readable storage medium is provided having machine-executable instructions stored thereon, which, when executed by a device, cause the device to perform a method for interaction, the method comprising displaying first media content in a first area. The method further comprises displaying a first element in a second area in response to playback of the first media content reaching a first progress point, the first and second areas being distinct areas, the first element being used to apply effects to objects in the first media content. The method further comprises displaying second media content in response to a triggering operation on the first element, the second media content including objects adjusted using effects. This computer-readable storage medium can dynamically integrate first media content and effects, enhancing the interactivity and user engagement of the media content, improving the user experience. Furthermore, it achieves regional isolation between media content display and effects control, preventing effects operations from obscuring the first media content, reducing the number of repeated playbacks, and saving computational resources.
[0008] In a fifth aspect, a computer program product is provided, including computer-executable instructions, wherein a method for interaction is implemented when a processor executes the computer-executable instructions. The method includes displaying first media content in a first area. The method further includes displaying a first element in a second area in response to the first media content playing to a first progress point. The first and second areas are different areas, and the first element is used to apply special effects to objects in the first media content. The method further includes displaying second media content in response to a triggering operation on the first element. The second media content includes objects adjusted using special effects. This computer program product can dynamically integrate first media content and special effects, enhancing the interactivity and user engagement of the media content, improving the user experience. Furthermore, it achieves regional isolation between media content display and special effects control, preventing special effects operations from obscuring the first media content, reducing the number of repeated playbacks, and saving computing resources.
[0009] The summary section is provided to present a series of concepts in a simplified form, which will be further described in the detailed description below. The summary section is not intended to identify key or essential features, nor is it intended to limit the scope. Other features will become readily apparent from the following description. Attached Figure Description
[0010] Figure 1 A schematic diagram of an example environment that can be implemented in one scenario is shown;
[0011] Figure 2 A flowchart of the methods used for interaction is shown;
[0012] Figure 3A A schematic diagram of the second element is shown;
[0013] Figure 3B A schematic diagram of the first identifier is shown;
[0014] Figure 3C A schematic diagram of the second style is shown;
[0015] Figure 3D A schematic diagram of the second media content is shown;
[0016] Figure 3E A diagram illustrating the subsequent content is shown;
[0017] Figure 3F A schematic diagram of the interactive panel is shown.
[0018] Figure 4 A schematic diagram of the process for displaying special effects is shown;
[0019] Figure 5 A schematic diagram of the first interface is shown;
[0020] Figure 6 A schematic block diagram of a device for interaction is shown; and
[0021] Figure 7 A block diagram of an electronic device is shown.
[0022] In all the accompanying figures, the same or similar reference numerals denote the same or similar elements. Detailed Implementation
[0023] The names of messages or information exchanged between multiple devices in the implementation are for illustrative purposes only and are not intended to limit the scope of these messages or information. It is understood that before using the technical solutions disclosed in each situation, users should be informed of the type, scope of use, and usage scenarios of the personal information involved, and their authorization should be obtained in accordance with relevant laws and regulations through appropriate means.
[0024] For example, upon receiving a user's active request, a prompt message can be sent to the user, explicitly informing them that the requested operation will require the acquisition and use of their personal information. This allows the user to choose whether to provide personal information to the software or hardware such as the electronic device, application, server, or storage medium performing the relevant operation, based on the prompt message. As an optional but non-limiting implementation, the prompt message can be sent to the user in the form of a pop-up window, which can present the prompt message in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.
[0025] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation method. Other methods that comply with relevant laws and regulations may also be applied in various situations.
[0026] The various scenarios will now be described in more detail with reference to the accompanying drawings. While some scenarios are shown in the drawings, it should be understood that implementations can take many forms and should not be construed as limited to the one scenario described herein. Rather, these scenarios are provided to provide a more thorough and complete understanding of the technical content. It should be understood that the drawings and scenarios are for illustrative purposes only and are not intended to limit the scope of protection.
[0027] In the descriptions of each situation, the term "comprising" and similar expressions should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The terms "a situation" or "the situation" should be understood as "at least one situation". The terms "first", "second", etc., may refer to different or the same objects unless explicitly stated. Other explicit and implicit definitions may also be included below.
[0028] Current video playback technologies can only provide basic playback functionality for native videos. The images, items, and environments displayed during playback are all original, fixed content, lacking dynamic effects or personalized adjustments. Users cannot trigger effects to enhance the video content, resulting in insufficient interactivity and limited user engagement. For example, users cannot replace a regular ring in a video with a crystal ring, nor can they alter the overall scene. This limited viewing experience fails to meet personalized viewing needs.
[0029] To address this, an interactive method is proposed. This method displays first media content in a first area, and when the first media content reaches a first progress point, displays a first element in a second area different from the first area. Furthermore, in response to a triggering operation on the first element, it displays second media content with effects applied to objects within the first media content. This method dynamically integrates the first media content and effects, enhancing the interactivity and user engagement of the media content and improving the user experience. Moreover, it achieves regional isolation between media content display and effect control, preventing effects from obscuring the first media content, reducing the number of replays, and conserving computational resources.
[0030] Figure 1 A schematic diagram of an example environment 100 that can be implemented in one scenario is shown. The example environment 100 includes a user device 130, a server 140, and a user 150. The user device 130 may have an application 110 (such as a content application, including social applications, media applications, short video applications, short drama applications, comic applications, etc.) installed on it. The application 110 serves as the execution carrier of the method and undertakes tasks such as acquiring, processing, displaying, and responding to user interactions in the media content stream.
[0031] In some cases, such as Figure 1As shown, application 110 can be installed on user device 130, for example, as a software application. User 150 can use user device 130 to launch application 110. Application 110 can communicate with server 140 via a network. In some cases, user 150 operates application 110 on user device 130 to initiate a business request; user device 130 encapsulates the request and sends it to server 140 via the network; server 140 parses the received request, executes the corresponding business processing operation (such as data query, logical operation, content delivery, etc.), and returns the processing result to user device 130; user device 130 visualizes the processing result through application 110 for user 150 to view, thereby completing the interaction between the client side and the server side.
[0032] In some scenarios, application 110 may display a browsing interface 120, which may include a video area (an example of the first area) and an element area (an example of the second area). For example, the video area may be at the top, and the element area at the bottom. Users can browse media content, such as the first media content, in the browsing interface 120. For ease of description, "first video" is used instead of "first media content," and "special effects video clip" is used instead of "second media content." However, it should be understood that this does not limit the various scenarios; for example, the first media content can also be text, audio, or graphic information.
[0033] In some cases, application 110 may display the first video in the video area of the browsing interface 120. In some cases, the first video may be media content recommended by the server or actively selected by the user, and its form includes, but is not limited to, short videos, movie clips, or animation content. The video area, as a region of the browsing interface, presents the playback screen of the first video in a specified proportion, thereby providing the user with an immersive viewing experience.
[0034] In some scenarios, if the first video reaches a certain progress point, application 110 can display an effect trigger element (i.e., an example of the first element) in the element area. This effect trigger element indicates that effects can be applied to objects within the first media content. The first progress point can be a preset time point on the video playback timeline. When the first video reaches this progress point, application 110 presents the effect trigger element associated with the current video content in the element area, allowing users to perceive interactive effect options without obscuring the video. The element area and video area are spatially independent, allowing users to simultaneously view video content and interact with effect elements, avoiding visual obstruction caused by the effect control interface being superimposed on the video screen.
[0035] In some scenarios, application 110 may respond to a triggering operation on an effect triggering element by displaying an effect video clip in the video area of the browsing interface 120. This effect video clip includes the object adjusted using the effect. In some scenarios, when a user clicks or touches an effect triggering element, application 110 merges and renders the corresponding segment of the first video with the effect, generating and displaying an effect video clip with enhanced effect capabilities, thereby achieving a dynamic combination of video content and effect. In some scenarios, application 110 pre-stores effect clips; when a user clicks or touches an effect triggering element, the effect clip is played directly to replace the corresponding original clip. This application may include overlaying or replacing effect clips on specific objects (such as items, people, scene backgrounds, etc.) in the video frame, allowing users to obtain personalized video viewing effects through simple interactive operations.
[0036] In this scenario, by dividing the user's device's browsing interface into independent video and element areas, the application can play the first video normally in the video area. When the video reaches a preset progress point, it presents special effects trigger elements related to the current video content in the element area. This allows users to perceive interactive special effects options without obstructing the video screen. When the user performs an operation on the special effects trigger element, the application merges and renders the corresponding segment of the first video with the special effects or directly plays a pre-stored special effects segment, generating and displaying a special effects video segment with enhanced special effects. This achieves the fusion of video content and special effects, resulting in a personalized video viewing experience. It effectively enhances the interactivity and user participation during video playback, reduces the number of video replays caused by obstruction, saves computing resources, and improves the user experience.
[0037] As understood by those skilled in the art, an instance of server 140 may be a single physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, and data processing and artificial intelligence platforms.
[0038] User equipment 130 can be any type of mobile computing device, including mobile computers (e.g., personal digital assistants, laptops, notebooks, tablets, netbooks, etc.), mobile phones (e.g., cellular phones, smartphones, etc.), wearable computing devices (e.g., smartwatches, head-mounted devices, including smart glasses, etc.) or other types of mobile devices. In some cases, user equipment 130 can also be a fixed computing device, such as a desktop computer, game console, smart TV, etc. It should be understood that the above operations can be performed jointly by user equipment 130 and server 140.
[0039] It should be understood that the architecture and functionality in the example environment are described for illustrative purposes only and do not imply any limitation on the scope. This scenario can also be applied to other environments with different structures and / or functionalities.
[0040] The processes of each scenario will be described in detail below with reference to other accompanying drawings. For ease of understanding, the specific data mentioned in the following description are exemplary and are not intended to limit the scope of protection. It is understood that the scenarios described below may also include additional actions not shown and / or the actions shown may be omitted, and their scope is not limited in this respect.
[0041] Figure 2 A flowchart of a method 200 for interaction is shown. In this case, it can be... Figure 1 The method is executed by application 110 on user equipment 130. The method performs the steps shown in boxes 202-206 as follows:
[0042] In box 202, the first media content is displayed in the first area. In some cases, the first area can be a display area in the application interface used to hold and display media content, such as the main display window of a video player or a content display area specifically designated in the interface. The first media content can be various types of media content, including but not limited to text, audio, video, graphic information, animation, etc. For example, the first media content can be short video content that the user is browsing or playing, which can be media content that the application plays automatically or that the user actively triggers to play. The relationship between the first area and the first media content can be: the first area provides space for displaying the first media content.
[0043] In box 204, in response to the first media content playing to the first progress, the first element is displayed in the second area. The first area and the second area are different areas. The first element is used to apply effects to objects in the first media content.
[0044] In some cases, the first progress point can refer to a specific point in time on the playback timeline of the first media content, such as the 5th second or one-third of the total duration. This progress point can be a preset fixed progress point or a progress point dynamically determined based on the content characteristics of the media content (such as scene transition points, audio beat points, etc.). When the first media content reaches this progress point, the first element is triggered to be displayed in the second area.
[0045] In some cases, the second area can be a different interface area from the first area. The first and second areas are distinct, meaning their spatial positions on the interface do not overlap. For example, the first area could be the central playback area of the interface, while the second area could be an auxiliary area at the bottom, side, or top of the interface. The second area is used to display the first element, providing the user with an interactive entry point. In some cases, the first element is a collective term for elements associated with special effects. It can be interactive elements such as buttons, capsules, icons, floating controls, and cards. The first element can include the identifier of the special effect, such as the name or icon of the effect, indicating that the effect can be applied to objects in the first media content. The first element appears when the first media content reaches the first progress point, prompting the user that an effect can be triggered. This object can be various objects in the first media content, such as characters, environment, background, and items. The special effects in this step are a collective term for various special effects, which can be of any type and any number. For example, the effects can include a first effect and a second effect; the identifier of the first effect is displayed in the first element at the first progress point, and the identifier of the second effect is displayed in the first element at the second progress point. In some cases, the first and second effects are different instances of an effect, such as different filter effects, different animation effects, or different audio effects.
[0046] In some cases, special effects can be enhancements to objects in primary media content through visual or auditory processing, such as filter effects (e.g., beauty filters, stylized filters), animation effects, and audio effects (e.g., reverb, voice changing). Applying special effects to objects in primary media content can alter their visual presentation, auditory presentation, or both.
[0047] In box 206, in response to a trigger action on the first element, second media content is displayed, which includes objects adjusted using effects.
[0048] In some scenarios, the triggering action can be a user interaction with the first element, such as clicking, double-clicking, long-pressing, or swiping. This triggering action on the first element is a prerequisite for displaying the second media content; that is, the user expresses their desire to apply effects to objects within the first media content by manipulating the first element. In other scenarios, the second media content can be new media content generated by applying effects to objects within the first media content, such as a video clip with effects. "Applying" can refer to compositing and rendering effects onto objects within the first media content to create media content with special effects. The second media content can be generated and displayed in real-time after the user executes the triggering action, or it can be a pre-rendered preview of the effects displayed after triggering. For example, the second media content could be a video clip of the first media content starting from the first progress bar, with adjustments made to the objects, allowing the user to see the effects applied in the interface.
[0049] Figure 2 The method described dynamically integrates primary media content and special effects, enhancing the interactivity and user engagement of the media content and improving the user experience. Furthermore, it achieves regional isolation between media content display and special effects control, preventing special effects operations from obscuring the primary media content, reducing the number of repeated playbacks, and saving computational resources. In addition, this method avoids the occlusion of the primary media content caused by special effects operations in traditional methods, which would require users to repeatedly trigger media content playback and generate numerous decoding requests. This significantly reduces unnecessary media data decoding, memory usage, and graphics processor rendering overhead, lowering processor resource consumption.
[0050] In some cases, a marker indicating the first stage of playback can be displayed on the playback progress bar of the first media content. This progress bar can be a bar displayed on the interface to indicate the playback progress of the first media content. When the first media content reaches the first stage, the application can display a marker on the progress bar using dots, scales, color changes, etc., allowing the user to intuitively understand the location of the special effects triggering during playback, thus preparing for interaction.
[0051] In some scenarios, a second element is displayed in the second area before the first playback progresses. This second element uses a progress bar style to display descriptive information about the first progress. In other words, before the first media content reaches its first progress, the application can pre-display a progress bar-style second element in the element area, displaying descriptive information about the first progress (e.g., "Entering interactive storyline in x seconds") through text, numbers, etc., and visually showing the dynamic change of the remaining time until the first progress, allowing users to anticipate upcoming interactive opportunities. This second element can appear at the start of the first media content playback or at an intermediate point. Its purpose is to provide users with anticipation guidance, helping them prepare for interaction in advance and avoiding situations where users are caught off guard by sudden special effects triggering, thus improving the user experience. Figure 3A A schematic diagram of the second element is shown. The application can display a browsing interface 310, with the bottom area of the browsing interface 310 being the second area and the top area being the first area. Six seconds before reaching the first progress point, the application can play the first media content in the first area and display the second element 312 in the second area. The application displays the message "Entering interactive story mode in x seconds" in the second element 312, where x indicates the remaining seconds. The application loads a dynamic progress bar in the second element 312, indicating the percentage of the 6-second preview period that has elapsed. The user can click the cross control to cancel the second element.
[0052] In some scenarios, if the first media content has reached its initial playback progress, the application can pause its display or slow down its playback speed. This provides the user with ample time to interact. By pausing or slowing down the playback when the first media content reaches its initial progress, the user can calmly view the special effects indicated by the first element in a static or slowly changing scene and decide whether to trigger the effect, avoiding missing interaction opportunities due to continuously fast video playback. The specific method of pausing or slowing down can be configured according to actual needs; for example, it can remain on the current screen or gradually reduce the playback speed to 0.
[0053] In some scenarios, when the first piece of media content reaches a certain point in the playback, the application can play the first audio. This first audio can be a notification sound, a voice announcement, or background sound effects associated with the current video content. It serves to auditorily alert the user to the arrival at a point in the storyline that requires interaction, providing an additional sensory pathway beyond visual cues and enhancing the user's awareness of when to engage. For example, when the first video reaches a preset point, the application can play a short notification sound, improving the user experience.
[0054] In some cases, the second area displays multiple effect icons, each associated with a different effect, including the first icon. The element area doesn't just display a single effect trigger icon; it can simultaneously or sequentially display multiple icons corresponding to different effects. Each icon is associated with a specific effect; for example, one icon might correspond to a crystallization effect, another to a fire effect, and yet another to a scene transition effect. Users can select any icon to trigger the corresponding effect. Multiple icons can be arranged horizontally in the icon area, each accompanied by an effect name, preview icon, or brief description, helping users quickly identify and differentiate different effects. This makes personalized video content customization more flexible and diverse, meeting the needs of different users. Figure 3BA schematic diagram of the first identifier is shown. The application can display a browsing interface 320 and show a "Big Foot" identifier and a "Golden Big Foot" identifier 322 in the second area, each corresponding to a different special effect. The first media content can be a video of Character 1 kicking a ball. From the first progress (e.g., the 10th second), the next 10 seconds (i.e., from the 10th to the 20th second) of the original clip shows Character 1 scoring a goal, with no change in expression, and simply swaying their body from side to side in celebration. In some cases, the "Big Foot" identifier can enlarge the foot in the following shooting clip of Character 1, while keeping the rest of the body unchanged, allowing Character 1 to use an exaggeratedly large foot to shoot, which can be reflected in special effect clip 1. The "Golden Big Foot" identifier 322 can enlarge the foot and render a gold effect on the foot in the following shooting clip of Character 1, thereby enhancing the expressiveness of Character 1's shot, which can be reflected in special effect clip 2.
[0055] In some cases, the first media content includes at least one character, and the second media content indicates the alteration of at least one of the following: first appearance, first action, first scene, and first item. The first appearance is the appearance of at least one character, the first action is the action of at least one character, the first scene is the scene in the first media content, and the first item is the item in the first media content. The images presented in the first media content may include various characters such as people, animals, buildings, and props. By changing the appearance of these characters (such as clothing, color, texture, and material) with special effects, effects such as replacing an ordinary ring with a crystal ring can be achieved. By enhancing or modifying the character's actions (such as walking, turning, and gestures) with special effects, characters can present animation effects that were not originally present. By changing the scene environment (such as background weather, lighting atmosphere, and geographical environment) with special effects, scene transitions from day to night and from indoors to outdoors can be achieved. By replacing or enhancing the objects in the image (such as props, decorations, and vehicles) with special effects, the presentation of the objects can be changed. The aforementioned changes can be implemented individually or in combination, thereby providing users with multi-dimensional personalized video content customization capabilities and significantly enhancing the interactivity and immersion of video playback.
[0056] In some cases, the first element includes an identifier for a first effect, which is displayed according to a first style. Triggering operations for the first element include selection and confirmation operations. Upon receiving a triggering operation, the application can also receive a selection operation triggered by the identifier of the first effect, and a confirmation operation to display the identifier of the first effect according to a second style. In some cases, the complete user interaction with the first element can be broken down into two stages: selection and confirmation. The selection operation is the first stage, which triggers the identifier of the first effect to switch from the first style to the second style, thus informing the user that the first effect is selected. The first and second styles can differ visually; for example, the first style can be grayed out, while the second style can be highlighted, changed color, or other selected states. Figure 3C A schematic diagram of the second style is shown. The application can display a browsing interface 330. For example, if the user clicks on the "Golden Foot" icon 322, in some cases, the application can highlight the "Golden Foot" icon 322, i.e., darken the background color.
[0057] In some scenarios, the application can receive a confirmation action triggered on the first element. This confirmation is a second-stage action; after the selection is complete and the first effect's indicator has switched to the second style, the user continues with a confirmation action triggered on the first element to finally confirm the use of the first effect associated with it, thereby triggering the display of the second media content. This avoids resource waste caused by accidental effect blending due to accidental touches and enhances controllability.
[0058] In some scenarios, upon receiving a selection action, the application can display a reselection element, indicating that a new selection should be made. In other scenarios, after the user completes a selection, the application presents a reselection element (such as a "Reselect" button) on the interface, providing the user with an interactive channel to reselect a different effect or cancel the current selection before final confirmation. This design allows users to return to the display state of multiple effect icons at any time before triggering a confirmation action, enabling them to re-browse and select other effect icons, thus improving the fault tolerance of the interaction flow. Figure 3C As shown, after the user clicks the "golden foot" icon 322, the application can also display a "Reselect" button in the element area. If the user clicks the "Reselect" button, the element area will revert to its previous state. Figure 3B The state shown indicates that multiple special effect icons are displayed, and the first special effect icon is displayed in the second area according to the first style.
[0059] Figure 3DA schematic diagram of the second media content is shown. The application can display a browsing interface 340. In some cases, the user clicks on the "golden foot" element 322, and the application plays the second media content, which corresponds to the original segment from second 10 to second 20 of the first media content. This second media content shows Character 1 shooting a goal with a golden, glowing foot. After scoring, Character 1 wears a medal, has a happy expression (rather than being expressionless), a trophy is displayed above the goal, and the sun in the sky becomes even more radiant and bright. The original first media content could be Character 1 shooting a goal with an ordinary foot. After scoring, Character 1 is expressionless and merely sways slightly from side to side. The second media content enhances the corresponding segment without changing the direction of the plot.
[0060] In some scenarios, when displaying secondary media content, the application shows a description of the effect in the first area, indicating that the effect is currently in use. The application can also display descriptive text associated with the effect (such as "Golden Big Foot, Very Powerful") to further explain its effect. This scenario clearly informs the user of the type of effect currently being applied through text, icons, or animations, allowing the user to be aware of the current effect status in real time while watching the effect video clip. Figure 3D As shown, while displaying the second media content, the application can display a floating window (i.e., an example of the effect's description information) in the first area. This floating window can display "Effect 2 in use" and the icon of Effect 2. At the same time, the descriptive text "XXXX" specifically for Effect 2 is displayed in the associated position of the floating window, such as "Golden Big Foot, Very Powerful". Figure 3E This illustrates the subsequent content. The application can display a browsing interface 350. In some cases, after the second media content finishes displaying, a corresponding segment (original segment) of the first media content can be displayed. That is, the segment after 20 seconds of the first media content is displayed.
[0061] In some scenarios, the application can receive a cancel display operation, which cancels the display of the first element and continues to display the first media content. When a user performs a cancel display operation by clicking, swiping, or similar means, it indicates that the user does not currently wish to use the effects. Upon receiving this operation, the application maintains the normal playback state of the first media content, does not trigger the effects blending process, and allows the video to continue playing as originally intended. This design avoids the appearance of effects elements interfering with the user's normal viewing experience.
[0062] In some scenarios, special effects include a first effect and a second effect, with the second media content associated with the first effect. If the first media content plays to a second progress point, the application can display a first element in the second area, where the first element is used to apply effects to objects within the first media content. The first media content can have multiple progress points during playback, each corresponding to a different opportunity to trigger an effect. The second progress point is another preset time point distinct from the first progress point. When the first media content plays to the second progress point, the application presents the first element in the second area. In some scenarios, the application can receive trigger actions for the first element and display third media content associated with the second effect. That is, in response to the first media content playing to the first progress point and executing a trigger action for the first element, the application displays the second media content associated with the first effect; in response to the first media content playing to the second progress point and executing a trigger action for the first element, the application displays the third media content associated with the second effect. In this scenario, even after the user cancels the display of the first element in the first progress point, the application can still provide the first element in the second progress point as an interaction opportunity, allowing the user to choose an appropriate progress point for interaction, thereby improving the user experience. Through the above scenarios, users can trigger different special effects at different progress points in the same video, achieving multi-segment and multi-type special effects, making the personalized customization of video content more flexible and rich.
[0063] In some scenarios, the application can display a prompt message after receiving a preset number of cancel display operations. This message indicates that the first element's display has been canceled and provides a method to restore it. The application can cumulatively count the number of times a user cancels the display (i.e., refuses to trigger the effect). When the consecutive cancellation count reaches a preset value (e.g., 3 times, 5 times, or other preset thresholds), the application determines that the user lacks interest in or has low willingness to participate in the effect interaction function. If the user then performs a further trigger operation on the first media content itself (e.g., long-pressing, double-tapping on the video screen, or accessing it through the settings menu), the application can display a third element, which is used to restore the display of the first element. The application can also display a prompt message (e.g., "Effects are off" text or icon) indicating that the effect recommendation and display function has been canceled for the user, and providing a method to restore it. This approach avoids the repeated pop-up of effect elements disturbing the user, while retaining a channel for the user to re-enable the effect interaction through the third element. This ensures the usability of the interactive function while also catering to the personalized usage habits of different users, thus improving the user experience. Figure 3F A schematic diagram of the interactive panel is shown. (For example...) Figure 3FAs shown, after canceling the display operation (i.e., refusing to trigger special effects) three times, if the user long-presses the currently displayed media content, an interaction panel 362 will appear on the playback interface 360. The interaction panel 362 displays a prompt message 364, indicating that the current plot and interactive functions are closed. The user can click on the prompt message 364 to re-enable the plot and interactive functions.
[0064] Figure 4 The diagram illustrates the flow of displaying special effects. In some cases, at 410, the application can play the first media content in the first area and display a preview message (i.e., an example of the second element) in the second area. This preview message may include text indicating the remaining time to reach the first progress (such as "Entering interactive story mode in 3 seconds") and a close control for closing the preview message. At 412, if the user clicks the close control to close the preview message, the application determines whether the user has closed the preview message consecutively a preset number of times (e.g., 3 times). If the user has not closed it consecutively 3 times, the application continues playing the first media content at 418. At 420, if the user long-presses the browsing interface, they will see that the interactive story mode is still enabled, and the application will continue to display preview messages and special effects elements. If the user clicks the close control to close the preview message, and the user has closed it consecutively 3 times, the application continues playing the first media content at 414, skipping the interactive phase at the first progress stage. At point 416, if the user long-presses the browsing interface, they will see that the story interaction function is turned off (i.e., the example of the prompt message). The application can display a third element, and by operating the third element, the first element can be displayed again. Subsequently, the application will display the preview information and special effects elements again.
[0065] If the user does not click the close control to close the preview information, the application pauses the playback of the first media content at point 422, and displays the effect trigger element and the user's virtual item quantity in the second area at point 424. The effect trigger element can include multiple elements corresponding to multiple effects (such as the "Big Foot" element and the "Golden Big Foot" element 322). The virtual item quantity indicates the number of virtual items in the user's current account that can be used to pay for the use of the effect. The second area can also display a close control for closing the element selection interface. In some cases, the first effect consumes a first quantity of virtual items. If the virtual item quantity is less than the first quantity, the application displays a first interface configured to replenish the virtual item quantity. Figure 5A schematic diagram of the first interface is shown. When the user's virtual items are insufficient, for example, after the user clicks on a special effect element, the special effect element requires 50 virtual diamonds, but the user only has 30 virtual diamonds, the application can display the first interface 510 (e.g., an interface for replenishing virtual items). The first interface 510 provides multiple options for the user to replenish virtual items (e.g., virtual diamonds).
[0066] return Figure 4 In some cases, in response to the user's selection of an effect trigger element, at point 426, the application determines whether the user's account has sufficient virtual items to pay for the selected effect. If the virtual items are insufficient, at point 428, a recharge interface (i.e., an interface to replenish virtual items) is displayed, guiding the user to complete the recharge, and then a confirmation pop-up is displayed at point 430. If the virtual items are sufficient, at point 430, a confirmation pop-up is directly displayed, prompting the user to confirm whether to apply the selected effect. In some cases, in response to the user's confirmation in the confirmation pop-up, at point 432, a second media content is displayed in the first area. This second media content applies the selected effect to an object in the first media content, such as replacing the feet in a character's shooting scene with large golden feet and enhancing the celebration. In some cases, when displaying the second media content, the application may display feedback information, where the feedback information represents the object's feedback and includes at least one of the following: the object's identifier, the account's identifier, the effect's identifier, and the feedback content. The feedback message could be a bubble to notify the user that the effect has taken effect or to provide interactive feedback (such as "Thank you, User 1, for using Golden Feet"). At point 434, after the second media content has finished displaying, the application continues to play the subsequent segment of the first media content that corresponds to the second media content.
[0067] In some scenarios, when displaying second media content, the application can insert the second media content into the first media content and display the adjusted first media content. For example, the first media content may include 30 frames, where frames 1 to 10 are segment 1, frames 11 to 20 are segment 2, and frames 21 to 30 are segment 3. In some cases, the server can pre-adjust segment 2, re-rendering the video frames to obtain an effects segment (i.e., the second media content), marking the start frame of the effects segment as 11 and the end frame as 20, and sending it to the application. In some cases, the application can receive the effects segment and, when the user clicks on an effects element, insert the effects segment into the positions of frames 11 to 20, replacing segment 2. The adjusted first media content includes not only the second media content but also a portion of the first media content. Thus, when the application plays the adjusted first media content, it can smoothly transition from segment 1 to the effects segment and from the effects segment to segment 3, thereby improving the smoothness of the playback.
[0068] In some cases, the application can also select appropriate transition frames based on the characteristics of segment 1. For example, frames 6 to 10 in segment 1 can be designated as transition frames, with frame 6 corresponding to the first progress bar. When playing to frame 6, the application can slow down the playback, continuing until frame 10 and then pausing. When selecting transition frames, the application can use frames with a resolution below a threshold between segment 1 and segment 2 as transition frames. This ensures that the user fully understands the preceding content and its context, thereby encouraging the user to utilize special effects elements.
[0069] In some cases, the second media content is generated based on the first media content, special effects information, and at least one special effects image. The at least one special effects image is generated based on the special effects information and image frames from the first segment. The first segment and the special effects information are determined based on the first media content. In other cases, the generated special effects image is a static reference image used to represent the core elements of the special effects. For example, for the effect of a flower blooming, a static special effects image can be generated that centrally represents the flower's shape, color, texture, and spatial position. This image serves as the visual reference basis for subsequently generating special effects segments. In other words, the role of the special effects image is to summarize the overall visual expression of the special effects with a single static image, rather than generating special effects content frame by frame, thereby reducing generation complexity and providing guidance for the generation of special effects segments.
[0070] In some cases, a special effects segment corresponding to the first segment can be generated based on the first media content, special effects information, and at least one special effects image. In other cases, using a static special effects image as a visual reference, and combining the configuration information such as the special effects type and motion parameters contained in the special effects information, as well as the image frame content of the first segment in the first media content, a special effects segment with continuous dynamic effects in the time dimension can be generated. For example, based on a static flower special effects image, and combined with the object's motion trajectory and posture changes in the first segment, a special effects video segment can be generated in which the flower dynamically blooms and changes its alignment with the object's movement, making the special effects highly integrated with the original media content in terms of visual effect, presenting a natural and realistic visual performance.
[0071] Figure 6 A schematic block diagram of a device 600 for interaction is shown. Device 600 can be implemented through software, hardware, or a combination of both. Figure 6 As shown, the device 600 includes a first display module 610, a second display module 620, and a third display module 630.
[0072] In some cases, the first display module 610 can be configured to display first media content in a first area. The second display module 620 can be configured to display a first element in a second area in response to the first media content reaching a first progress point. The first and second areas are different areas, and the first element is used to apply effects to objects in the first media content. The third display module 630 can be configured to display second media content in response to a triggering operation on the first element. The second media content includes objects adjusted using effects.
[0073] In some cases, device 600 includes a progress bar module configured to display a marker indicating a first progress on the playback progress bar of the first media content.
[0074] In some cases, device 600 further includes a second element module configured to display a second element in a second area before playback reaches the first progress, wherein the second element uses a progress bar style to display descriptive information of the first progress.
[0075] In some cases, the special effects include a first special effect and a second special effect, the second media content is associated with the first special effect, and the device 600 further includes: a second progress module configured to display a first element in a second area in response to the first media content playing to a second progress; and a third media content module configured to display third media content in response to a trigger operation on the first element, wherein the third media content is associated with the second special effect.
[0076] In some cases, the device 600 further includes a prompting module configured to display a prompt message in response to a preset number of times the display cancellation operation is performed, wherein the display cancellation operation is used to cancel the display of a first element, and the prompt message indicates that the display of the first element has been cancelled and the method for restoration.
[0077] In some cases, device 600 further includes a third element module configured to display a third element in response to a triggering operation on the first media content, wherein the third element is used to restore the display of the first element.
[0078] In some cases, the device 600 further includes a description information module configured to display description information of an effect in a first area when displaying second media content, wherein the description information of the effect indicates that the effect is being used.
[0079] In some cases, device 600 further includes a feedback module configured to display feedback information when displaying second media content, wherein the feedback information represents feedback from an object and includes at least one of an object identifier, an account identifier, an effect identifier, and feedback content.
[0080] In some cases, the first element includes an identifier for a first effect, the identifier for the first effect is displayed according to a first style, and the third display module 630 includes: a selection module configured to receive a selection operation, wherein the selection operation is triggered for the identifier of the first effect; a second style module configured to display the identifier of the first effect according to a second style, wherein the second style indicates that the first effect is selected; and a confirmation module configured to display second media content in response to a confirmation operation, wherein the confirmation operation is triggered for the first element.
[0081] In some cases, device 600 further includes: a reselection module configured to display a reselection element in response to a selection operation; and a recovery module configured to display an identifier of a first effect in a second area in accordance with a first style in response to a trigger operation on the reselection element.
[0082] In some cases, the second media content is generated based on the first media content, special effects information, and at least one special effects image, the at least one special effects image being generated based on the special effects information and image frames in the first segment, and the first segment and special effects information being determined based on the first media content.
[0083] The division of modules or units in each scenario is illustrative and represents only one logical functional division. In actual implementation, other division methods are possible. Furthermore, the functional units in each scenario can be integrated into one unit, exist as separate physical entities, or combine two or more units into one unit. The integrated units described above can be implemented in hardware or as software functional units.
[0084] Figure 7 A block diagram of electronic device 700 is shown. It should be understood that... Figure 7 The device 700 shown is merely an example and should not be construed as limiting the functionality and scope of the described implementation. For example, device 700 could correspond to... Figure 1 The user equipment described above can be used to perform the above-described... Figures 1 to 5 The process. For example, device 700 may correspond to the electronic device of the third aspect of the invention.
[0085] like Figure 7 As shown, device 700 is in the form of a general-purpose computing device. Elements of device 700 may include, but are not limited to, one or more processors or processing units 710, memory 720, storage devices 730, one or more communication units 740, one or more input devices 750, and one or more output devices 760. Processing unit 710 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 720. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capability of device 700.
[0086] Device 700 typically includes multiple computer storage media. Such media can be any available media accessible to device 700, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 720 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof). Storage device 730 can be removable or non-removable media and may include machine-readable media, such as flash drives, disks, or any other media capable of storing information and / or data (e.g., training data for training) and accessible within device 700.
[0087] Device 700 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not specified in the original text... Figure 7As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 720 may include computer program product 725 having one or more program modules configured to perform various methods or actions in various implementations.
[0088] Communication unit 740 enables communication with other computing devices via a communication medium. Additionally, the functionality of the elements of device 700 can be implemented as a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, device 700 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.
[0089] Input device 750 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 760 can be one or more output devices, such as a monitor, speaker, printer, etc. Device 700 can also communicate as needed with one or more external devices (not shown) via communication unit 740. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with device 700, or with any device that enables device 700 to communicate with one or more other computing devices (e.g., network card, modem, etc.). Such communication can be performed via an input / output (I / O) interface (not shown).
[0090] Furthermore, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein a processor executes the computer-executable instructions to implement the method described above. This computer-readable storage medium may be a non-transitory computer-readable storage medium. Furthermore, a computer program product is also provided, tangibly stored on a non-transitory computer-readable medium and including computer-executable instructions, which a processor executes to implement the method described above. Additionally, a computer program product is provided, including a computer program that implements the method described above when executed by a processor.
[0091] This document describes various aspects of the scenarios with reference to flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the various scenarios. It should be understood that each block of the flowcharts and / or block diagrams, as well as combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.
[0092] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.
[0093] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.
[0094] The flowcharts and block diagrams in the accompanying figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products based on multiple implementations. In this respect, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the figures. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.
[0095] The various scenarios have been described above. The foregoing description is exemplary and not exhaustive, nor is it limited to the disclosed scenarios. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described scenarios. The terminology used is chosen to best explain the principles, practical applications, or technical improvements to technology in the market, or to enable others skilled in the art to understand the scenarios.
Claims
1. A method for interaction, comprising: Display the primary media content in the first area; In response to the first media content playing to a first progress, a first element is displayed in a second area. The first area and the second area are different areas. The first element is used to apply special effects to objects in the first media content. In response to a triggering operation on the first element, second media content is displayed, the second media content including the object adjusted using the effect.
2. The method according to claim 1, further comprising: A marker indicating the first progress is displayed on the playback progress bar of the first media content.
3. The method according to claim 1, further comprising: Before playing to the first progress point, a second element is displayed in the second area, wherein the second element uses a progress bar style to display descriptive information of the first progress point.
4. The method of claim 1, wherein the special effects include a first special effect and a second special effect, the second media content is associated with the first special effect, and the method further includes: In response to the first media content playing to a second progress point, the first element is displayed in the second area; In response to a triggering action on the first element, third media content is displayed, wherein the third media content is associated with the second effect.
5. The method according to claim 1, further comprising: In response to the number of times the display cancellation operation is performed reaching a preset value, a prompt message is displayed, wherein the display cancellation operation is used to cancel the display of the first element, and the prompt message indicates that the display of the first element has been cancelled and the method to restore it.
6. The method according to claim 5, further comprising: In response to a trigger operation on the first media content, a third element is displayed, wherein the third element is used to restore the display of the first element.
7. The method according to claim 1, further comprising: When displaying the second media content, a description of the effect is displayed in the first area, wherein the description of the effect indicates that the effect is being used.
8. The method according to claim 1, further comprising: When displaying the second media content, feedback information is displayed, wherein the feedback information represents the object's feedback, and the feedback information includes at least one of the object's identifier, account identifier, special effect identifier, and feedback content.
9. The method of claim 1, wherein the first element includes an identifier of the first effect, the identifier of the first effect is displayed according to a first style, and displaying the second media content in response to a triggering operation on the first element includes: Receive a selection operation, wherein the selection operation is triggered in response to the identifier of the first effect; The identifier of the first effect is displayed according to a second style, wherein the second style indicates that the first effect is selected; In response to a confirmation action, the second media content is displayed, wherein the confirmation action is triggered in response to the first element.
10. The method of claim 9, further comprising: In response to the selection operation, the reselected element is displayed; In response to a triggering operation on the reselected element, the identifier of the first effect is displayed in the second area according to the first style.
11. The method of claim 1, wherein the second media content is generated based on the first media content, special effects information, and at least one special effects image, the at least one special effects image being generated based on the special effects information and image frames in the first segment, and the first segment and the special effects information being determined based on the first media content.
12. A device for interaction, comprising: The first display module is configured to display first media content in the first area; The second display module is configured to display a first element in a second area in response to the first media content playing to a first progress. The first area and the second area are different areas. The first element is used to apply special effects to objects in the first media content. The third display module is configured to display second media content in response to a trigger operation on the first element, the second media content including the object adjusted using the effects.
13. An electronic device, comprising: At least one processing unit; At least one memory coupled to the at least one processing unit and storing operations to be performed by the at least one processing unit, the operations causing the electronic device to perform the method according to any one of claims 1 to 11 when performed by the at least one processing unit.
14. A computer-readable storage medium having machine-executable instructions stored thereon, which, when executed by a device, cause the device to perform the method according to any one of claims 1 to 11.
15. A computer program product, wherein the computer program product includes computer-executable instructions that, when executed by a processor, implement the method according to any one of claims 1 to 11.
