Garment Image Extraction With Edge Smoothing and Depth-Aware Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for extracting garment images suffer from poor image quality due to edge aliasing and high labeling costs, making them unsuitable for complex scenarios with multiple depths of field, such as worn-visible and worn-invisible portions, leading to inefficient composition with model images.
Innovation Solution
A method involving image scaling with bilinear interpolation to smooth edge aliasing, optimizing contrast with defogging algorithms, and using an image segmentation model to determine a target image mask for the worn-visible garment portion, combining these processes to extract a high-quality garment foreground image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If binary classification technology is used to segment garment images, then the classification process is simple, but the image quality deteriorates due to obvious edge aliasing
Solution Approach 1:
The patent segments the image processing task into multiple stages: first performing binary classification to identify foreground/background, then applying bilateral filtering to smooth edges, and finally using quantized matting to refine boundary regions. This multi-stage segmentation approach resolves the contradiction by breaking down the simple binary classification into finer-grained processing steps that progressively improve image quality while maintaining manageable complexity at each stage.
Solution Approach 2:
The patent applies different processing qualities to different regions of the image: bilateral filtering is applied globally to smooth edges, while quantized matting with alpha matting is applied specifically to boundary regions where foreground and background meet. This local quality approach ensures that computational resources are concentrated on regions where they are most needed (edge regions) while maintaining efficiency in uniform regions.
2Manufacturing precision
If image matting algorithm is used to acquire quantized values, then the image quality improves with natural transitions, but the labeling cost increases
Solution Approach 1:
The patent uses the binary classification result as a coarse copy or approximation of the final segmentation mask, then refines it through automated bilateral filtering and quantized matting processes. This copying approach allows the system to start with a simple, low-cost binary mask and progressively improve it through automated processing rather than requiring expensive manual labeling at the finest detail level from the start.
Solution Approach 2:
The patent performs preliminary binary classification and bilateral filtering before applying the more computationally intensive quantized matting algorithm. This preliminary action prepares the data by providing a good initial estimate and smoothing the input, which reduces the complexity and cost of the subsequent matting process while still achieving high-quality results.
3Speed
If traditional segmentation methods are used, then the processing speed is fast, but the applicability to complex scenarios with multiple depths of field deteriorates
Solution Approach 1:
The patent extends traditional 2D image segmentation by introducing a third dimension through depth estimation and multi-depth mask generation. The system processes images to identify worn-visible portions, worn-invisible portions, and background at different depth levels, creating a multi-dimensional segmentation structure that maintains processing efficiency while significantly improving adaptability to complex e-commerce scenarios with multiple depths of field.
Data Source
Figure 1~3
Figure 4~6
Figure 7~9
AI summary
The present application relates to a garment image extraction method and apparatus, and a device, a medium and a product. The method comprises: acquiring an original image, wherein the original image comprises garment content; converting the original image into a specification image, from which edge sawteeth in image content of the original image are eliminated; optimizing the contrast of the specification image, so as to obtain an enhanced image; merging the specification image and the enhanced image and inputting same into an image segmentation model, so as to determine a target image mask corresponding to a depth of field at which a visible wearing part constituting a garment in the garment content is located; and extracting a garment main-body image from the garment content according to the target image mask. The present application can accurately extract a garment main-body image of a visible wearing part from an original image, which comprises garment content, and the obtained garment main-body image is natural and fine, thereby providing reliable materials for a virtual fitting technique. Therefore, the present application has a wide range of application scenarios, and a lower implementation cost.