Clothes color recognition method, device and system based on semantic segmentation

A color recognition and semantic segmentation technology, applied in the field of image processing, can solve the problems of inaccurate color judgment, difficulty in practical use, and low precision of coordinate points, and achieve short color recognition time, narrow color recognition range, and high recognition accuracy Effect

Inactive Publication Date: 2020-06-23
SUZHOU KEDA TECH
View PDF4 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] However, in practical applications, these schemes are difficult to adapt to the identification of complex situations. For example, in the aforementioned patent, the clothing area must be positioned based on the coordinate point information of the clothing. When part of the coordinate point information of a certain clothing area is blocked or When the loss is caused by shooting angle and other reasons, it is necessary to fit the lost coordinate points. In addition to the slow recognition speed due to the large amount of calculation in the fitting process, the low precision of the fitted coordinate points also makes the actual application The final recognition effect is greatly reduced
[0007] To sum up, the above-mentioned technology still has many problems in color judgment, such as misjudgment, missed judgment, etc., resulting in inaccurate color judgment in many cases, and it is difficult to achieve practical purposes.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Clothes color recognition method, device and system based on semantic segmentation
  • Clothes color recognition method, device and system based on semantic segmentation
  • Clothes color recognition method, device and system based on semantic segmentation

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment 1

[0049] to combine figure 1 , the present invention proposes a clothing color recognition method based on semantic segmentation, and the clothing color recognition method includes the following steps:

[0050] S1: Collect a certain amount of portrait pictures with different parameters in different scenes, and label the collected portrait pictures. The content of the label includes clothing area segmentation information labeling and human body joint point information labeling; perform random parameter transformation processing on the marked portrait pictures, and generate initial sample set.

[0051] S2: Create a clothing region extraction model based on the JPPNet network (Joint Body Parsing&Pose Estimation Network). The clothing region extraction model is used to extract the clothing region on the portrait image in combination with human body joint point information annotation and clothing region segmentation information annotation; the initial The portrait pictures in the sa...

specific Embodiment 2

[0069] to combine figure 2 , on the basis of the successful training of the aforementioned clothing color recognition model, in step S5, the use of the clothing region extraction model and the clothing color recognition model to identify the clothing color of one or more clothing regions in the portrait image includes the following steps:

[0070] S51: Collect a portrait image containing clothing information in real time, and import the portrait image into a clothing region extraction model to extract a partial image of each clothing region included in the portrait image.

[0071] S52: Perform size unification and background transformation processing on the extracted partial pictures of each clothing region, and import the processed partial pictures of each clothing region into the clothing color recognition model to identify corresponding clothing colors.

[0072] Such as image 3 The portrait picture in (a), when adopting the clothing color recognition method mentioned in ...

specific Embodiment 3

[0080] Based on the aforementioned clothing color recognition method, the present invention proposes a clothing color recognition device based on semantic segmentation, and the clothing color recognition device includes:

[0081](1) The clothing area extraction model created based on the JPPNet network is used to extract the clothing area on the portrait image by combining the human body joint point information labeling and clothing area segmentation information labeling.

[0082] (2) The clothing color recognition model created based on the classifier is used to recognize the clothing color in the imported partial image of each clothing area.

[0083] (3) A portrait picture collection module, used to collect portrait pictures with different parameters in different scenes.

[0084] (4) A sample set generation module, which is used to perform random parameter transformation processing on the imported pictures to generate a corresponding training picture sample set.

[0085] (5...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a clothes color recognition method based on semantic segmentation, and the method comprises the steps: collecting a certain number of portrait pictures with different parametersin different scenes, and marking the collected portrait pictures; carrying out random parameter transformation processing on the marked portrait picture to generate an initial sample set; creating aclothing region extraction model based on a JPPNet network, and extracting a local picture of each clothing region contained in each portrait picture; carrying out background transformation and colorclassification labeling on the extracted local picture; performing size unification and random parameter transformation processing on the marked local pictures to generate a training sample set; and creating a clothing color recognition model based on the classifier, and importing the training sample set into the clothing color recognition model to train the clothing color recognition model. According to the method, higher recognition success rate and recognition accuracy can be achieved, and particularly, the improvement amplitude of the recognition success rate and the recognition accuracy is higher under the complex conditions that only a half figure exists in a picture, and shielding exists in the picture.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to a clothing color recognition method, device and system based on semantic segmentation. Background technique [0002] The recognition of clothing color generally classifies the upper and lower clothing colors directly by inputting the whole portrait into the classifier, but this method is not suitable for incomplete portraits caused by shooting angles, occlusions, etc., or complex postures of portraits. difficult problem to judge. [0003] In addition to directly using the classifier to judge, the industry also has multi-label classification based on the graph neural network. The reason for this is that the relationship between the color of the upper garment, the color of the lower garment, and other attributes of the human body can be used. There is no obvious connection between attributes such as clothing style and clothing length, which leads to a certain degr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/90G06K9/32G06K9/34G06K9/62
CPCG06T7/90G06T2207/20081G06T2207/20084G06T2207/10024G06V10/267G06V10/25G06F18/214G06F18/24
Inventor 王江鹏毛晓蛟赵文忠章勇曹李军
Owner SUZHOU KEDA TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products