Unlock instant, AI-driven research and patent intelligence for your innovation.

Head segmentation method based on position controllability

A human head and resolution technology, applied in the field of image processing, can solve the problems of complex post-processing, reduced playability, and low consideration of instance segmentation technology operation, and achieves the effect of flexible method and improved operation efficiency.

Pending Publication Date: 2021-11-05
HANGZHOU QUWEI SCI & TECH
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, when there are multiple people in the picture, it is impossible to carry out targeted deduction for a single head, resulting in a greatly reduced playability
Although there is an instance segmentation technology that can differentiate the head segmentation in a multi-person scene, the current instance segmentation technology is not considered high in operation and requires complex post-processing, which is not suitable for device-side deployment.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Head segmentation method based on position controllability
  • Head segmentation method based on position controllability
  • Head segmentation method based on position controllability

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

[0020] Such as figure 1 In the described embodiment, a kind of head segmentation method based on position controllable, specifically comprises the following steps:

[0021] (1) Preprocess the input image, scale the resolution to 256x256, and then normalize it to control the range of pixels between -1 and 1;

[0022] (2) Construct the head key point detection module, input the input image in step (1) into the head key point detection module, get the key point features of 1x256x256, analyze the key point features, and get the center point coordinates of each head , assuming N={N 1 ,N 2 ,N 3 ,…} represents the number of heads, where N i ={x i ,y i} indicates the specific position of each head in the picture; the key point detection module of the head refers to: a fully convolutional neural network, consisting of two modules of encoding and ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a head segmentation method based on position controllability. The method adopts a human head key point detection module, a position correction module and a human head segmentation module, a user click position is corrected through the position correction module, so that a human head key point position is matched, and a final human head segmentation result is obtained by utilizing key point information and the human head segmentation module. The method has the beneficial effects that the single head in a multi-person scene can be accurately segmented, the method is more flexible, the operation efficiency is improved, and the method is deployed at a mobile phone end.

Description

technical field [0001] The present invention relates to the technical field related to image processing, in particular to a position-controllable head segmentation method. Background technique [0002] Head segmentation is a relatively common function in short video software at present. Its purpose is to provide a basis for users to create special effects such as emoticons, head stickers, and animation bodies. [0003] At present, most of the head segmentation is developed based on deep learning technology, and the semantic segmentation model is usually used to deduct the head part of the image. However, when there are many people in the picture, it is impossible to deduct a single head in a targeted manner, resulting in a greatly reduced playability. Although there are instance segmentation technologies that can differentiate the heads of people in multi-person scenarios, the current instance segmentation technology has little consideration for operation and requires compl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/00G06T7/11G06N3/04G06N3/08
CPCG06T7/0012G06T7/11G06N3/08G06T2207/10016G06T2207/20021G06T2207/20081G06T2207/20084G06T2207/30196G06N3/048G06N3/045
Inventor 张明琦吴茗
Owner HANGZHOU QUWEI SCI & TECH