3D Trajectory-Mapped Effect Images for Real-Time Video Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing effect image applications lack real-time interaction with users, limiting their application scenes and efficiency due to pre-generated effects that are not user behavior-relevant.
Innovation Solution
Perform trajectory tracking on a target video to obtain a three-dimensional point set, mesh the set to create a target mesh structure, and map this structure to generate a target effect image, displaying it on the motion trajectory of the target object.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If pre-generated effect images are used, then the implementation speed is fast, but the adaptability to user behavior and application scenes is limited
Solution Approach 1:
The patent implements dynamic effect generation by tracking user device motion trajectories in real-time and generating effect images that adapt to the dynamic behavior. The system continuously updates the effect image based on current trajectory data, making the effect adaptive to user actions while maintaining real-time performance through optimized processing pipelines.
Solution Approach 2:
The patent performs preliminary trajectory tracking and effect image generation in advance during video playback, preparing effect images before they are needed for final composition. This preliminary processing enables the system to maintain fast implementation speed while generating adaptive effects, as the heavy computational work is done proactively rather than reactively.
2Ease of operation
If real-time trajectory tracking and effect generation are implemented, then the adaptability and interaction are improved, but the computational complexity and processing time increase
Solution Approach 1:
The patent segments the effect generation process into distinct modules: trajectory tracking module, effect image generation module, and composition module. Each module handles specific computational tasks independently, reducing overall complexity by allowing specialized optimization of each segment and enabling parallel processing where possible.
Solution Approach 2:
The patent introduces an intermediary data structure (trajectory point cloud) that bridges raw sensor data and final effect images. This intermediary representation simplifies the computational pipeline by providing a standardized format for processing, reducing complexity in both tracking and generation stages while enabling real-time interaction.
3Adaptability or versatility
If pre-generated effects are used, then the processing efficiency is high, but the application scenes are limited
Solution Approach 1:
The patent creates a universal effect generation system that can handle multiple application scenes (video playback, AR interaction, live streaming) through a single trajectory-based framework. The system processes different types of user interactions and generates appropriate effects across various scenarios, achieving high versatility while maintaining efficient processing through reusable computational components.
Data Source
AI summary
The embodiment of the disclosure provides a method, an apparatus, a device, and a medium for drawing an effect image. The method includes: in response to an effect drawing request triggered by a user, performing trajectory tracking on a target video provided by the user to obtain a three-dimensional point set corresponding to a motion trajectory of a target object in the target video; performing a meshing processing on the three-dimensional point set to obtain a target mesh structure; performing a map processing on the target mesh structure to obtain a target effect image; and displaying, in the target video, the target effect image corresponding to the motion trajectory of the target object. According to the technical solution, the effect image is generated with the three-dimensional point set to obtain stereo effect image, thus the display performance of the effect image is improved.