Image Stylization Using Structural and Texture Feature Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing technologies fail to provide comprehensive content processing, resulting in poor display effects and user experience due to incomplete stylization of both target objects and backgrounds, especially in large angle and expression facial images, and require manual drawing of stylized samples for training, which is time-consuming and labor-intensive.
Innovation Solution
A method and apparatus that determine object structural features and style texture features to generate a target style image by fusing these features, using a pre-trained encoder to extract and combine structural and texture features from both the image and reference style images, enabling comprehensive stylization of both objects and backgrounds.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If traditional image processing algorithms are used to generate effect images, then processing speed is maintained, but the comprehensiveness of image content processing is poor and display effect is inadequate
Solution Approach 1:
The patent introduces a pre-trained encoder as an intermediary component that automatically extracts structural features from images. This encoder serves as a bridge between raw image data and the style transfer process, enabling comprehensive content processing without manual intervention. The encoder processes both target objects and backgrounds uniformly, ensuring complete stylization while maintaining processing efficiency through automated feature extraction.
2Measurement precision
If manual drawing of stylized samples is used for training, then training accuracy can be improved, but time consumption and labor intensity increase significantly
Solution Approach 1:
The system employs a pre-trained encoder that performs self-service by automatically extracting structural features from images without requiring manual drawing of stylized samples. The encoder is pre-trained on general image data and can be directly applied to extract features from any input image, eliminating the need for time-consuming manual sample creation while maintaining high processing accuracy through its learned feature representation capabilities.
3Manufacturing precision
If style transfer is applied only to target objects, then object stylization is achieved, but background stylization is incomplete resulting in poor overall display effect
Solution Approach 1:
The patent implements a universal style transfer approach where the pre-trained encoder and subsequent processing steps apply uniformly to both target objects and backgrounds. The encoder extracts structural features from the entire image without discrimination, and the style transfer mechanism processes all regions consistently. This multi-functional approach ensures that both foreground objects and background elements receive comprehensive stylization, achieving complete image transformation.
Data Source
AI summary
Embodiments of the disclosure provide a method, apparatus, electronic device and storage medium for processing image, and the method includes: obtaining an image to be processed; determining an object structural feature within the image to be processed corresponding to a target object and determining a style texture feature corresponding to a reference style image to be applied; and determining a target style image corresponding to the image to be processed based on the object structural feature and the style texture feature.


