Pattern-Guided Image Interaction With Real-Time Visual Blending
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing content interaction applications struggle with users' difficulty in describing specific elements, such as animals or scenes, using natural language, leading to insufficient richness and aesthetic quality in user-generated content.
Innovation Solution
A method and apparatus that allows users to input a pattern of lines through a control, which is used to generate a visually matching image, and combine it with real-time captured images, enhancing the visual effect and interactivity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users describe specific elements using natural language, then the interaction process is simple, but the richness and aesthetic quality of generated content is insufficient
Solution Approach 1:
The patent introduces an image generation model as an intermediary between the user's simple pattern input and the final high-quality image output. The model translates basic line patterns into detailed, aesthetically pleasing images, bridging the gap between simple interaction and high-quality results
Solution Approach 2:
The system captures real-time images through the camera and combines them with generated images. This copying and merging of real-world visual data with AI-generated content enhances the overall richness and quality of the output while maintaining simple user interaction
2Manufacturing precision
If users draw patterns to generate images, then the aesthetic quality improves, but the interaction complexity increases
Solution Approach 1:
The system accepts partial pattern inputs from users - even simple line drawings or incomplete sketches are sufficient. The image generation model completes the rest of the work, generating full high-quality images from minimal user input, thus maintaining simplicity while achieving high quality
Solution Approach 2:
The interaction is segmented into two distinct parts: the user's simple pattern drawing task and the model's complex image generation task. This segmentation allows the user to perform only the simple portion while the system handles the complex portion, reducing overall interaction complexity
3Quantity of substance
If real-time captured images are combined with generated images, then visual richness increases, but processing time increases
Solution Approach 1:
The system uses periodic triggering mechanisms where the camera captures images at specific intervals or upon user action, rather than continuously. This periodic capture reduces processing overhead while still providing sufficient real-time visual content to combine with generated images
Data Source
Figure 1
Figure 2
Figure 3A
AI summary
Embodiments of the disclosure provides a method, an apparatus, a device, and a storage medium for interaction. The method includes: presenting an input control in a first user interface; presenting, in a first user interface, a pattern received via the input control, the pattern including one or more lines; obtaining a first image based on the pattern, the first image visually at least partially matching with the pattern; presenting the first image; and presenting, in response to a predetermined condition being satisfied, at least a portion of a second image captured in real time together with at least a portion of the first image.