Real-time human face interaction method and system
A technology of face and face detection, applied in the real-time face interaction method and its system field, can solve the problems of incapable of real-time video processing, incapable of human-computer interaction, incapable of truly reflecting the emotions of operators, etc.
Active Publication Date: 2016-06-29
SHENZHEN SENSETIME TECH CO LTD
View PDF3 Cites 2 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0002] With the development of science and technology, the performance improvement of hardware devices and the enhancement of image processing technology have enabled many camera devices to perform image processing by themselves, and some of the image processing can produce cartoon or text rendering, but currently such processing is based on static images , and it is artificially added cartoon or text rendering, and the video cannot be processed in real time, let alone human-computer interaction
At present, most human-computer interaction systems are based on voice or body movements, which cannot truly reflect the emotions of the operator.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0015] In a basic embodiment, a real-time face interaction method is provided, the method includes the following steps, such as figure 1 Shown:
[0016] S100, acquiring the real-time video of the current user in front of the electronic distorting mirror;
[0017] S200. Acquire a video frame image based on the real-time video, and perform face detection and recognition on the video frame image;
[0018] S300. After the face detection and recognition, use the cascade regression model to extract face features, and perform face deformation;
[0019] S400. Present the distorting mirror visual image after the current user's face is deformed on the electronic disabling mirror in real time.
[0020] In this embodiment, the method can be applied to mobile phones, tablets, advertising machines with cameras, computers with cameras, etc., and can intelligently control the output objects in the video through the state of facial movements, and truly reflect the operation through the outpu...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present disclosure relates to a real-time human face interaction method and system. The method comprises: acquiring a real-time video in front of an electronic distorting mirror; recognizing a human face in a video image; extracting a feature of the human face by using a cascading regression model; and after the human face is distorted, presenting a distorting mirror visual image of a current user on the electronic distorting mirror in real time, and if the human face has a real-time facial action, changing the visual image in the distorting mirror in real time. The system is implemented based on the method and facilitates application of the method. According to the method and system, an output object in a video can be intelligently controlled by means of a facial action state, and the facial action changes of an operator, such as joy, anger, sorrow and happiness, are reflected actually by means of the output object.
Description
technical field [0001] The present disclosure relates to the field of computer graphics and image processing, in particular to a real-time human-face interaction method and system thereof. Background technique [0002] With the development of science and technology, the performance improvement of hardware devices and the enhancement of image processing technology have enabled many camera devices to perform image processing by themselves, and some of the image processing can produce cartoon or text rendering, but currently such processing is based on static images , and it is artificially added cartoon or text rendering, and it cannot process the video in real time, let alone perform human-computer interaction. At present, most human-computer interaction systems are based on voice or body movements, which cannot truly reflect the emotions of the operator. Contents of the invention [0003] To address some of the above problems, the present disclosure provides a real-time f...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06K9/00
CPCG06F3/011G06V40/161G06V20/46
Inventor 左冬冬郭玉京马堃王贵杰徐立
Owner SHENZHEN SENSETIME TECH CO LTD