Video Sticker Rendering Beyond Screen Boundaries Using Mapped Textures
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video processing methods limit user interaction to a fixed screen range, reducing flexibility and interactivity, as users can only doodle on a screen and apply textures within a confined area.
Innovation Solution
A method and device that generate a render texture based on the moving track of a control object's positions, determine a rendering area using a preset sticker base image, and display sticker content within this area to create a target video, allowing doodling effects to extend beyond the screen boundaries.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If users doodle on a fixed screen range, then the doodling function is simple and easy to implement, but the interaction flexibility and range are limited
Solution Approach 1:
The patent extends the doodling interaction from a two-dimensional fixed screen range to a three-dimensional virtual space by mapping control object positions to a target area in the video. This allows users to doodle beyond the physical screen boundaries, achieving greater interaction flexibility while maintaining manageable system complexity through computational geometry transformations.
Solution Approach 2:
The patent introduces a render texture as an intermediary element that bridges the control object positions and the target area in the video. This render texture serves as a mediator to transfer the doodling effects from the control object's movement to the video display, enabling flexible interaction without directly manipulating the video pixels, thus managing system complexity.
2Area of stationary object
If users can only doodle within a fixed screen range, then the display processing is simple, but the doodling area is confined and less interactive
Solution Approach 1:
The patent expands the doodling area from a fixed two-dimensional screen range to a dynamically determined target area in the video that can extend beyond the screen boundaries. This is achieved by mapping control object positions to coordinates in the video's target area, effectively increasing the doodling area while using standard video processing techniques to manage complexity.
Solution Approach 2:
The patent pre-determines the target area in the video before the doodling operation. By establishing the target area boundaries and mapping relationships in advance, the system can efficiently process the doodling effects without complex real-time calculations, thus expanding the doodling area while controlling processing complexity.
3Ease of operation
If the doodling is displayed only on the screen, then the display implementation is straightforward, but the interaction intensity and richness are reduced
Solution Approach 1:
The patent transitions the display from a two-dimensional screen to a three-dimensional virtual space by mapping doodling effects to the target area in the video. This allows the doodling to be displayed at different positions and depths within the video frame, increasing interaction intensity and richness while maintaining straightforward display implementation through standard video compositing techniques.
Data Source
AI summary
Embodiments of the present disclosure relate to a video processing method and apparatus, a device and a medium, the method includes: obtaining a moving track of display positions mapped into a target area of an original video, based on a moving track of positions of a control object; generating a render texture according to the moving track of the display positions; determining a rendering area according to a preset sticker base image above the target area and the render texture; and displaying sticker content in the sticker base image within the rendering area to generate a target video.