A 3D structured light face recognition method
A face recognition and structured light technology, applied in the field of 3D structured light face recognition, can solve the problem of low accuracy of single visual feature recognition
Active Publication Date: 2022-07-22
福建平潭瑞谦智能科技有限公司
View PDF5 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0006] Provide a method of multi-modal fusion to improve the accuracy of lip language recognition, and solve the problem of low accuracy of single visual feature recognition in the prior art
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment
[0048] example, see figure 1
[0049] Step 100: Projecting structured light on the upper body of the target user, and receiving the upper body information and audio information through the sensor; the projecting structured light in step 100 adopts a forward projection method; the upper body information in step 100 includes: Color image data and depth data.
[0050] It should be further explained that this embodiment uses KinectV1 to perform structured light projection and data extraction; the principle is that the infrared transmitter that comes with KinectV1 continuously radiates light to the target user through the grating, and projects random light on the upper half of the target user's limbs. Speckle, and then use its built-in infrared camera to record the speckle distribution in the space, thereby realizing the acquisition of depth data; at the same time, KinectV1 comes with a built-in RGB camera, which can simultaneously extract color image data; it should be further ex...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a 3D structured light face recognition method, belonging to the technical field of face recognition; the method comprises: projecting structured light, receiving information through a sensor; information preprocessing, obtaining information during action; speech recognition; Face and lip language recognition is realized by feature fusion processing of facial information, hand information and audio data; the present invention realizes the fusion of three modal information of sign language, speech and lip language through structured light face recognition and voice, and provides a It has a multi-assisted fusion method for deaf, dumb and deaf-mute people; it solves the problem of how to generate features that better reflect the speaker's visual information in the process of lip movement, and further improves the accuracy of recognition; from different The mapping from modality to viseme solves the problem of visual ambiguity; at the same time, the fusion of multimodality also solves the problem that the result cannot be output when the single modality cannot be recognized, which ensures the feasibility of the method in practical application to the greatest extent.
Description
technical field [0001] The invention belongs to the technical field of face recognition, and particularly relates to a 3D structured light face recognition method. Background technique [0002] 3D structured light face recognition is based on infrared, adding an infrared dot matrix transmitter. The output image includes an infrared IR image and a depth image. Both the depth image and the IR image are light sources using infrared light. , so it can be used in dark environments and is not easily disturbed by natural light environments. The live detection of 3D structured light face recognition is through the introduction of a depth map, which uses two face images, IR and depth, for 3D live detection. Moreover, based on the attack algorithm of infrared face recognition prevention, the added depth map carries depth information, which can effectively prevent plane attacks, such as attacks on photos, videos, paper masks and other materials. The detection of surface materials can...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06V40/16G06V10/26G06V10/80G06V10/82G06K9/62G06N3/04G06N3/08G06T17/20
CPCG06T17/20G06N3/08G06N3/045G06F18/253
Inventor 程超超王书琪许晓东
Owner 福建平潭瑞谦智能科技有限公司